Here are the workarounds:
- Prepare MKV file with H264 video track and DTS or AC3 audio track.
- Use XMedia Recode (3.1.7.2) to remux MKV to M4V.
- Choose "Apple TV 3 (H.264)" and "m4v" as output format in Format tab. (Remember to disable: Streaming - Fast start)