it seems it's encoding issue, i think moov atom are place at the end of your file
Important considerations when streaming H.264 content
One important thing about playing an H.264 video file as progressive download is that the moov atom needs to be located at the beginning of the file, or else the entire file will have to be downloaded before it begins playing. The moov atom is a part of the file that holds index information for the whole file. Unfortunately, tools such as Adobe Premiere and After Effects place this information at the end of the file, but Adobe is working to fix this in a future update to the CS3 video production tools. This isn't an issue for streaming the H.264 video files, however, so Flash Media Server users can breathe easy.