Raw and the PXW-FS5

workshops-275 Raw and the PXW-FS5

This isn’t a “how to” guide. There are many different recorders that can be used to record raw from the FS5 and each would need it’s own user guide. This is an overview of what raw is and how raw recording works to help those that are a bit confused, or not getting the best results.

First of all – you need to have the raw upgrade installed on the FS5 and it must be set to output raw. Then you need a suitable raw recorder. Just taking the regular SDI or HDMI output and recording it on an external recorder is not raw.

Raw is raw data direct from the cameras sensor with very little image processing. It isn’t even a color image, it won’t become color until some external processing, often called “De-Bayer” is done to convert the raw data to a color image.

For raw to work correctly the camera has to be set up just right. On the FS5 you should use Picture Profile 7. Don’t try and use any other profile, don’t try and shoot without a profile. You must use Picture Profile 7 at it’s factory default settings. In addition don’t add any gain or change the ISO from 3200. Even if the scene is a dark one, adding gain will not help and it may in fact degrade the recorded image.

White balance is set using the appropriate SGamut + color temperature preset chosen from within Picture Profile 7, there are only 3 to choose from for S-Gamut, but with a raw workflow you will normally fine tune the white balance in post. No other color matrix or white balance method should be used. Trying to white balance any other way may result in the sensor data being skewed or shifted in a way that makes it hard to deal with later on.

All of the above is done to get the best possible, full dynamic range data off the sensor and out of the camera.

If you are viewing the S-Log2 (ie don’t have viewfinder gamma assist enabled) then the exposure level that Sony recommend is to have a white card at 60%. So consider setting the zebras to 60%. Don’t worry that this may look a bit dark or appear to be a low level, but that’s the level you should start with… More about exposure later on.

This raw data is then passed down the SDI cable to the external recorder. The external recorder will then process it, turn it into a color signal (de-bayer) and add a gamma curve so that it can be viewed on the recorders screen. Exactly what it will look like on the monitor screen will depend on how the recorder is set up. IF the recorder is set to show S-Log2, then the recorders screen and the FS5’s LCD should look similar. However you might find that it looks very different to what you are seeing on the FS5’s LCD screen. This is not unexpected. If the recorder is setup to convert the raw to Rec-709 for display then the image on the recorder will be brighter and show more contrast, in fact it should look “normal”.

Under the surface however, the external raw recorder is going to be doing one of two things (normally at least). It’s either going to be recording the raw data coming from the camera as it is, in other words as raw. Or it will be converting the raw data to S-Log2 and recording it as a conventional ProRes or DNxHR video file. Either way when you bring this footage in to post production it will normally appear as a flat, low contrast S-Log2 image rather than a bright, contrasty rec-709 image. So understand that the footage will normally need to be graded or have some other changes made to it to look nice.

Recording the actual raw data will give you the best possible information that you can get from the FS5 to work with in post production. The downside is that the files will be huge and will take a fair amount of processing power to work with. Recording a ProRes or DNxHR video file with S-Log2 gamma is second best. You are throwing away a bit of image quality (going from 12 bit linear down to 10 bit log) but the files should still be far superior to the 8 bit UHD internal recordings or even an external recording done via the HDMI which is also limited to 8 bit in UHD.

Most raw recorders have the ability to add a LUT – Look Up Table – to the image viewed on the screen. The purpose of the LUT is to convert the S-Log2/raw to a conventional gamma such as Rec-709 so that the picture looks normal. If you are using a LUT then the normal way to do things is to view the normal looking picture on the recorders screen while the recorder continues to record S-Log2 or raw. This is useful as the image on the screen looks normal so it is easier to judge exposure. With a 709 LUT you would expose the picture so that the image on the recorders screen looks as bright as normal, skin tones would be the usual 70% (ish) and white would be 90%.

There is a further option and that is to “bake in the LUT”. This means that instead of just using the LUT to help with monitoring and exposure you actually record the image that you see on the recorders screen. This might be useful if you don’t have any time for grading, but… and it’s a big BUT…. you are now no longer recording S-log2 or raw. You will no longer have the post production grading flexibility that raw or S-Log2 provide and for me at least this really does defeat the whole point of recording raw.

Exposure: Raw will not help you in low light. Raw needs to be exposed brightly. If viewing S-Log2 then Sony’s recommendation is to have a white card or white piece of paper at 60%. I consider that to be the absolute minimum level you can get away with. The best results will normally be achieved if you can expose that white card or piece of paper at around 70% (when looking at an S-Log2 image). Skin tones would be around 55%. If you expose like this you may need to use a different LUT on the recorder to ensure the picture doesn’t look over exposed on the recorders monitor screen. Most of the recorders include LUT’s that have offsets for brighter exposures to allow for this. Then in post production you will also want a LUT with an exposure offset to apply to the S-Log2 recordings. You can use the search function (top right) to find my free LUT sets and download them.

SEE ALSO: https://www.sony.co.uk/pro/article/broadcast-products-FS5-raw-shooting-tips

 

Advertisements

27 thoughts on “Raw and the PXW-FS5”

  1. Very VERY nice article as always! Alister can you talk a bit about this software and how it can be used with Sony?
    My setup is: FS5 + Odyssey 7Q+.

    Thanks

  2. Thanks for the write up. Question though. Why use SLOG2 instead of SLOG3 with RAW? I had read elsewhere that PP9 was the profile to use for export. I should note i’m using a shogun inferno so I can’t record raw, just the 10-bit output into prores or dnxhd.

    Thank you.

    1. PP7 is the recommend profile. The raw signal contains a metadata flag for S-Log2 no matter what the camera is set to and the recorders will default to S-Log2. In addition as there are no LUT’s in the camera S-Log2 will provide a higher contrast image that is easier to focus and judge exposure with. There is absolutely no benefit to S-Log3 when using raw and Sony’s 12 bit raw is decoded as S-Log2 by default.

  3. Hi Alister,

    Got another issue.
    http://i.imgur.com/tE6RNII.jpg

    Image on the left is what i’m getting out of the shogun. Image on the right is out of the camera. The color is way off. Recorded PP7 as you said, and the shogun is not set to record any lut into the image.

    Thank you.

    1. See my other replies. When you record ProRes you are not recording raw. The recorder has to take the raw data and convert it to a YCbCr conventional video signal and as part of that process it has to add a gamma curve and conventional color encoding, so this can and often will result in an image different to what is seen in the viewfinder. I also wonder if you are using Adobe Premiere? as this does some strange things to the signal levels of Sony’s S-Log XAVC.

      1. Hi Alister, yes I am using Premiere.
        The images have the same look in Resolve as well. The XAVC is much flatter than what i’m seeing on the files from the inferno. I really don’t care about “True RAW” I just wanted an uncompressed signal from the FS5 so I can get a similar image to the FS7’s XAVC-I. I’m shooting a feature doc with very long interview segments, I don’t have the space to handle all those DNG’s.

        I’ve noticed also that no matter what picture profile I choose, it basically looks the same on the Shogun Inferno. I can change the white balance, and there appears to be a slight shift in color if I move from PP7 to something like PP4, but no matter what the picture profile, it doesn’t seem to be changing it.

        Is there no way to get uncompressed 4K SLOG out of the camera?

        Thank you,

        1. Hi Paul.

          I’m experiencing the same thing as you. The Infernos footage is waay more contrasty than the FS5s internal.

          Have you figured out what’s going on, and any “solution”?

        2. As I tried to explain in the article when using raw you are getting raw sensor data out of the camera, so there is no gamma curve etc, so changing the profiles will make no difference, it’s the raw information from the sensor. But you MUST use PP7 to ensure the sensor gain is set correctly.

          The Inferno has to decode the raw to turn it into a viewable image, it is applying it’s own processing and adding it’s own gamma curve, so it may look different to the cameras own display.

          You can get uncompressed S-Log by going back to the conventional shooting mode and taking the conventional SDI or HDMI output to an external recorder. However this will be limited to 8 bit in UHD.

  4. I’ve sent the screencaps to Atomos, they asked for the waveform information, nothing back yet. I’m very irritated at the whole thing. I bought the FS5 and the Inferno specifically so I could get uncompressed 10-bit prores, the RAW is too much to handle for 4 hour documentary interviews.

    Sure you can go HDMI, but it’s 8 bit, so that’s a fail. If Atomos provided a LUT or something that corrected for their own gamma curve, maybe that would be okay, but they are basically just spitting out a compressed image.

    1. Lets make sure we are getting our terminology right here. I’m guessing that by compressed you mean restricted in range? Because ProRes is always compressed and that’s why the files are so much smaller than the uncompressed cDNG raw files. If the files were uncompressed YCbCr then they would actually be much larger than the raw.

  5. Hi guys,

    Alister thank you as usual for cutting through the fog of the internet to explain things so simply. I am really just wanting to get 4K 10bit pro res out of my FS5. What I’ve interpreted from the comments is that this is possible when outputing RAW from the camera to a recorder that then compresses the signal to pro res. I made th mistake of getting a Video Devices pix e5 and am thinking that it won’t be able to interpret a raw signal from the FS5. Can anyone confirm this? I do documentary so was really wanting to keep the small form factor of the camera but at this point I might just need to get an FS7!

    1. The regular HD output is 10 bit. But to get 10 bit 4K you need the raw upgrade option in the camera plus a compatible recorder such as an Atomos Flame/Inferno that can convert the raw to ProRes.

      Generally if you just want high quality 10 bit 4K the FS7 is my recommendation. But don’t dismiss the FS5’s 8 bit. It can produce wonderful results if treated carefully.

  6. I’ve just got an Atomos Shogun Inferno, the FS raw interface and the V4 firmware for the FS5. I’ve done (I think) everything suggested here and on Alistair’s Sony videos, and also the Atomos video guides, and get nothing out of the SDI.

    Any suggestions? The Atomos just says “no signal”.

      1. Hi Alistar. After watching your videos many times, I feel like I know you well!

        I have sorted it.. There are four SDI inputs on the Atomos, but only one works for Raw output from FS5. It’s marked differently “1.5/3/6/12G”. The others are 1.3/3G.
        Of course, I can’t see anywhere in any documentation that says there is only one SDI input that works.. I thought they were all the same.

  7. Hello Alister,
    I also have made some tests with a FS5 + RAW recorded as CDNG on the Shogun Inferno, and I also find that the individual recorded DNG frames are way more contrasty than the slog2 footage, when looked at on a calibrated computer screen, in CameraRaw 9.1.1 (you can’t play the CDNG footage from the Inferno).

    Of course, I have carefully followed your recommended settings, using PP7. Are you sure that “Sony’s 12 bit raw is decoded as S-Log2 by default”? By the way, while shooting, I was able to see that the image on the Inferno’s screen was REALLY slog2 like! It’s only that it doesn’t at all look the same when you look at it once it has been recorded as CDNG.

    Thank’s again for sharing your knowledge.
    Jean (Ravnastua, Feb. 2013)

    1. Raw is raw, so first of all if it’s looking different to what you saw when monitoring don’t worry as the raw recording itself is just sensor data and doesn’t have a gamma curve until after it’s been decoded. There are so many variables in a raw workflow that it’s hard to know exactly what is going on. How has the debayer been set in CameraRaw? Is it decoding to data levels (which would be the correct settings) or legal video levels? Is it decoding to SGamut or to 709 color? Who’s debayer process does CameraRaw use? Sony’s or their own – this can make a huge quality difference. You can override the decode metadata and some decoders do this, perhaps that’s what is happening.

  8. Hey alister.

    Im really struggling fo understand a couple of things. I have just got the shogun inferno and about to put the sony raw keys in to my fs5

    Is there no way to record raw to
    slog3 prores? I know you talk about metadata but can this be changed easily ? I have become much more used to grading slog3.

    Also whats this thing about a compressed slog curve people are talking about on the shogun? If i record raw to prores slog 2 or 3 is the resulting file going to look different to the internally recorded equivilant. Apparently they are saying its coming out darker… these things are all worrying me.

    Would be great if you could help me out even if its just explaining again.

    Also last thing, i see you were explaining that joys and benifits of having raw on the fs5 in your video in the related article but in this article you say for 10bit 4k just use the fs7, the fs5 8 bit is not that bad and that the fs5 already does 10bit hd, slightly conflicting positions?

    I was kind of hoping that bypasing the internal fs5 codecs when working at either hd or uhd will provide me with generally better results compression wise? In doing raw to proress

    Thank you
    Allan

    1. Raw is raw, it isn’t S-log, doesn’t have a gamma curve, it’s just raw data. However Sony’s FS-Raw by default is designed to be decoded to S-Log2 and the metadata for this is hard coded into the data, even if you do set the camera to S-Log3. You can force the data to be decoded to whatever you want, that is up to you, but don’t be surprised if you do see some inconsistency on different monitors or software if you do.

      When you record S-Log internally on the Sony cameras the recordings use full range data levels to maximise the codec performance. You can use full range (which exceeds the normal video range) as it is assumed the data will be graded and as part of this process restored to video range data for viewing. However the Atomos products always record using full range video. This shouldn’t be a huge problem if the grading software behaves itself and treats each type of content correctly, shifting each to one unified range, but sadly this is rarely the case (especially with Adobe). So not only do the images come out with different brightness and contrast, but also LUT’s designed for one don’t work as the same with the other. It’s a bit of a minefield as each accessory manufacturer does their own thing. But of course if you are recording S-Log on the Atomos, you are not recording raw anymore.

      The FS5 is only 8 bit internally in UHD. So the FS7 can outperform in UHD when recording internally as XACV-I is always 10 bit.

      12 bit linear raw is actually an impossible format for a 14 stop camera. To truly record 14 stops with linear data requires at least 16 bit data, there just aren’t enough code values with only 12 bits (which is why no one else does it). So Sony cheat and use data rounding to make it work. This reduces the tonal information in the shadows compared to 10 bit 709 or 10 bit log. On it’s own this isn’t a huge problem, just make sure you expose brightly to avoid trying to pull to much info out of the shadows and definitely don’t use it for low light.

      Where you really do run into problems is if you take 12 bit raw (with noticeably reduced shadow data) and convert that to 10 bit log (which has reduced highlight data relative to the scene you are shooting). What you end up with is 10 bit log with reduced shadow data compared to a straight 10 bit log recording. If you compare the direct 10 bit log from an FS7 to 10 bit log derived from 12 bit raw from an FS5 the FS7 picture will have a lot more shadow information while the highlights from both will be similar. So the 10 bit direct log recording from an FS7 will be better than the raw derived log from an FS5 in the shadows.

      So I’d much rather have an FS7 if I want to shoot UHD log. But, if you only have an FS5, the raw to log workflow will outperform the very limited 8 bit UHD log, so it is still beneficial for FS5 owners.

  9. Hello Thanks for your detailed response.

    What bout HD? If i am just shooting HD and like the HD SLOG3 on the Sony FS5

    Can I confirm that adding the RAW upgrade in combination with an external recorder wont help me at all in achieving a better HD image?

    I have done some quick tests with the Black magic video assist recording the standard HD output in prores over SDI (no raw upgrade) and the image seems a little sharper on the external recorder on close inspection when compared to the internal recorded HD content on the FS5 – is this prores file a “better” image? Is it retaining the SLOG3 curves and not loosing anything etc?

    I know prores HQ has a higher bit-rate than the internal but is there anything that will hurt the SLOG3 image in recordng to external recorder over SDI? anything I need to know.

    Much appreciated.

    Please also reply with a link where I can buy you a coffee – i have seen it before but cant find it now

    Thanks

    Allan

Leave a Reply

Your email address will not be published. Required fields are marked *

*