TEST TO COMPARE A PMW-F3 RECORDING ON ATAMOS SAMURAI, CONVERGENT DESIGN GEMINI and INTERNALLY.

Now I thought this would be simple. Set up my PMW-F3 with a Convergent Design Gemini and an Atamos Samurai and shoot a few shots so that I could compare the output from each recording codec. Well, the shoot side of things went just fine, a couple of different shots recording to DPX on the Gemini, ProRes on the Samurai and the internal recordings on the F3. The shots were exposed using a grey card exposed at 38%. The F3 was set to output 444 Dual Link S-Log.

However all sorts of strange things are happening when I bring the clips into my edit applications. What’s worse I get different results with different apps. For example bringing in all the material in to Adobe CS5.5 results in different luma levels for all the clips. Not only that, I also created some ProRes 4444 clips from the uncompressed DPX files and these are different again. This makes it really hard to analyse the footage when black levels are different or brightness and saturation are different. Heck all the clips were shot at exactly the same moment in time or at least within a few seconds of each other. The ONLY difference should be between the quality of the recordings. This is just more Apple Quicktime weirdness making my life difficult.

Anyway, after much head scratching and trying FCP, Avid and Premier to view the clips I was able to draw some useful conclusions which I’ll share with you here. Now the first, which may seem obvious, is that of the bunch, the Convergent Design Gemini DPX files are without doubt the best. They have zero artefacts and no added noise. After that though things become much more confusing!

Now you would expect (or at least I expected) the F3’s internal 8 bit recordings to be the worst of the bunch as all the others are 10 bit and much higher bit rates, but you know what the F3 recordings stand up really well. Why? Well in the tests I did the S-Log footage really didn’t need much of a grade to produce a nice looking image, so the clips were not being pushed very hard. One thing I’ve noticed about ProRes in the past and once again noticed in these tests, is that it’s noisy, or at least adds noise on the first encode. When you look at the Grey card in the frame grabs you can see that all of the ProRes clips show more noise than the DPX files or the F3 internal recordings, I conclude from this that ProRes is adding noise.

So in a low motion, fairly static scene the F3 recordings hold up impressively well against the ProRes ones. However I also know from experience that when you start adding in a lot of motion to a scene that 35Mb/s Mpeg can start to soften a little and in extreme circumstances really struggle and this is where ProRes starts to win as the extra data the HQ version uses really helps.

Going back to the clips from this test and looking more closely at the my wife’s face there is a difference in the way the EX codec and the ProRes codecs look. The ProRes is showing a little less blockiness and this would be a big help if you were harding the material harder. Again the clear winner is the DPX files from the Gemini, but then what do you expect!

So these are my conclusions from this test:

The Gemini DPX files produce the cleanest most gradeable images.

ProRes is noisy compared to the original source.

F3 S-Log recordings using the internal codec can be graded successfully by small amounts without obvious degradation, but I would not recommend it as you never know how much the colourist may want to push the material.

I need to shoot more challenging scenes for this type of test.

Registered users can download a 45MB zip file containing full resolution frames, graded and un-graded recorded using the Gemini, Samurai and F3. If you are not a registered user you will get the option to create an account.

[downloads_box title=”Download The Frame Grabs”]
Codec Tests Frame Grabs, 45MB
[/downloads_box]

Just heard from Paul Williams, one of the every growing band of happy Hurricane Rig owners. He’s been busy using his rig to shoot segments for a new IMAX movie. Pictures and scant details on his web site: http://paulwilliamz.com/index.php?p=1_5_3D-Stereography

This is a great article by Den Lennie of F-Stop Academy. If your struggling to make ends meet it’s well worth a read.

http://www.fstopacademy.com/2011/11/23/8-reasons-aspiring-film-makers-fail-to-ever-make-any-money/

For many years I have always said that it’s the quality of the lens followed by the sensor that ultimately determines the quality of the images that a video camera will produce. Well, I’m starting to believe that that is no longer the case. Why do I think this? Well, we have reached a point in the development in sensor technology where most sensors made for mid to high end video are capable of resolving more than may be required, capturing greater dynamic range than can be sensibly displayed and with noise levels that are low enough not to be a significant issue. I’m not for one minute suggesting that all sensors are created equal, but most professional video cameras now have sensors that perform to a very high standard, so much so that other factors start to play a more significant role in your choice of camera.

Lets take a look for a moment at 3 cameras from 3 very different companies. Red Epic, the Sony F3 and the Canon C300. Now I have not used a C300 for myself yet, so I’m basing my comments on the opinions of others and the clips that I have been able to view online, so I may be wrong, but basically all three of these cameras have sensors that perform very similarly (with the obvious exception of the Epic’s resolution). When you view footage at 1920 x 1080 from any of these cameras it can be damn hard to tell which is which. There are small, subtle difference between the images but many of these can be changed and tweaked in post production. I’d bet that if you could examine the raw data from the sensors you would see similar dynamic range, similar noise per pixel.

With sensors that now perform at such a high level, it’s post production and workflow, which is actually now becoming a bigger differentiator between cameras, or to be more precise, how you get that wonderful sensor data from the camera to the edit suite. Red’s Epic uses a workflow that records the sensor data in a largely un processed state on to solid state hard drives. The 14 bit bayer sensor data is compressed (default 5:1)  but as this is a 4/5K camera your still looking at around 3.5GB per minute. This results in large files that must be processed before you can do anything with them. It’s kind of like developing a negative before you can edit. For those used to working with film this won’t be an issue, but those of us used to an instant, ready to edit workflow might find this a drag. Unless you have a Red Rocket card or a supercomputer the processing is slow and time consuming. You certainly don’t what to be doing it with a laptop. But, because you have the almost raw sensor data to work with you do get an amazing amount of flexibility, great dynamic range and the ability to choose your gain levels and white balance in post production.

Now if we look at the F3 with S-Log the approach is slightly different. The sensors output is processed to give a colour image (but that’s about it) and then just about the entire  sensor dynamic range is mapped to a special gamma curve in such a way that each stop of exposure gets allocated roughly the same amount of data. This makes it possible to use the shallower bit depth of 10 bits compared to Red’s 14 bits to record a very similar dynamic range, in effect it is a type of signal compression. Then the F3 feeds that high dynamic range, full R,G,B signal out of its dual link HDSDi connectors so that it can be recorded on an external device. So let’s say we take that output and record it as an uncompressed stream on a Convergent Design Gemini. The Gemini records the dual link RGB output as uncompressed DPX files on to SSD’s. Now I do love the image quality that’s possible with this workflow, but it comes at a price. The price you have to pay is file size. For 24p you looking at 750GB per hour, that’s a lot of GB’s to transfer from the SSD’s to your edit suite. Even if you encode from the DPX files to the codec of your choice at this stage, it’s still a time consuming process. Not as slow as Red, but it still needs to be allowed for.  Another point is that the DPX files don’t have audio, so you will need to sync up your audio and video tracks. So, OK we don’t use the Gemini and instead record using a Cinedeck recording to ProRes 444. Now we have smaller files, sync sound but have introduced compression artefacts. These artefacts might be incredibly small but they will be there. We can push things further still with the F3 and take the reduced chroma resolution 4:2:2 S-Log output from the single HDSDi monitor output (or SDi A after firmware update scheduled for early 2012) and record it on something like the Atamos Samurai using ProRes 422. Now the files are getting quite manageable in size, the quality is still good enough for the grading that goes hand in hand with S-Log, but we have thrown away a bit of our colour resolution.

So lot’s of options with the F3 and S-Log. Of course it shouldn’t be forgotten that you don’t have to use S-Log, you can take the 10 bit output with a standard gamma or cinegamma applied and then record that on an external recorder. The downside here though is that now some of the cameras look, i.e. the chosen gamma, is now baked in to the image and it may require a little bit of un-picking in post to achieve your desired look.

Now lets look at the Canon C300. The C300 does not have raw sensor data recording like Red Epic, nor does it have dual HDSDi outputs that can take the full sensor latitude and send it out to an external device as 444 RGB like the F3 with S-Log. In fact, and I’ve already criticised Canon for this, it only has an 8 bit output, so it’s not ideal for grading. But, and it’s a big BUT, what the C300 does have is internal recording using 50Mb/s Mpeg 2 at 4:2:2. Now this isn’t the greatest or best codec in the world and it is only 8 bit, but it is a good solid codec that is very widely supported and well understood. The files are small and easily recorded onto low cost compact flash cards. You see not everyone want’s to heavily grade everything they shoot. Nor do they want to have to hang on external recorders just to meet the standards laid down by some broadcasters such as the BBC. The Sony F3, while an excellent camera, cannot be used on a BBC HD production without an external recorder, but the C300 can. This makes the C300 simpler and easier to use. If you are on the road or a long way from base, being able to use cheap, readily available compact flash cards is a major advantage and the small sized files means that you don’t have to lug around big raid arrays or super computers. The C300 produces a nice clean image, so even though it’s only 8 bit and 50Mb/s it will stand some moderate grading. Lets face it, TV production has been using 8 bit for many years and many, many 8 bit shows go through the grading suite and come out looking great. Perhaps you won’t be able to push and pull the footage from the C300 as much as Red Epic or F3 and S-Log, but then with careful shooting and a good camera setup the C300 should still be able to deliver a great image.

Going back to the title of this post, as I see it and as I hope my examples above show, it’s not all about the sensor anymore. Perhaps now it’s as much about the workflow as anything else. You need to figure out what it is you need to achieve and how you will get there. Do you need to squeeze every last ounce of performance out of the sensor at the expense of a slower or more convoluted workflow or will a simple workflow allow you to spend more time actually shooting or editing your piece helping you achieve the result you desire.

I’ll be attending BVE North in Manchester on the 16th and 17th of November. You’ll find me on the Manfrotto booth most of the time doing demos of the Genus Hurricane 3D rig with a pair of F3, 20mm lenses and full remote focus and interaxial control. If you want to discuss anything you’ve read in my blog on in the forum, please drop by for a chat. It’s always good to meet my readers!