cinematography, PXW-FS5, PXW-FS7, Shooting Tips, Technology, Workflow

ProRes Raw Over Exposure Magic Tricks – It’s all smoke and mirrors!

1 Comment

There are a lot of videos circulating on the web right now showing what appears to be some kind of magic trick where someone has shot over exposed, recorded the over exposed images using ProRes Raw and then as if by magic made some adjustments to the footage and it goes from being almost nothing but a white out of over exposure to a perfectly exposed image.

This isn’t magic, this isn’t raw suddenly giving you more over exposure range than you have with log, this is nothing more than a quirk of the way FCP-X handles ProRes Raw material.

Before going any further – this isn’t a put-down of raw or ProRes raw. It’s really great to be able to take raw sensor data and record that with only minimal processing. There are a lot of benefits to shooting with raw (see my earlier post showing all the extra data that 12 bit raw can give). But a magic ability to let you over expose by seemingly crazy amounts isn’t something raw does any better than log.

Currently to work with ProRes Raw you have to go through FCP-X. FCP-X applies a default sequence of transforms to the Raw footage to get it from raw data to a viewable image. These all expect the footage to be exposed exactly as per the camera manufacturers recommendations, with no leeway. Inside FCP-X it’s either exposed exactly right, or it isn’t.

The default decode settings include a heavy highlight roll-off. Apple call it “Tone Mapping”. Fancy words used to make it sound special but it’s really no different to a LUT or the transforms and processes that take place in other raw decoders. Like a LUT it maps very specific values in the raw data  to very specific output brightness values. So if you shoot just a bit bright – as you would often do with log to improve the signal to noise ratio – The ProRes raw appears to be heavily over exposed. This is because anything bright ends up crushed into nothing but flat white by the default highlight roll off that is applied by default.

In reality the material is probably only marginally over exposed, maybe just one to 2 stops which is something we have become used to doing with log. When you view brightly exposed log, the log itself doesn’t look over exposed, but if you apply a narrow high contrast 709 LUT to it, it then the footage looks over exposed until you grade it or add an exposure compensated LUT.  This is what is happening by default inside FCP-X, a transform is being applied that makes brightly exposed footage look very bright and possibly over exposed – because thats the way it was shot!

This is why in FCP-X  it is typical to change the color library to WCG (Wide Color Gamut) as this changes the way FCP-X processes the raw, changing the Tone Mapping and most importantly getting rid of the highlight roll off. With no roll-off, highlights and any even slight over exposure will still blow out as you can’t show 14 stops on a conventional 6 stop TV or monitor. Anything beyond the first 6 stops will be lost, the image will look over exposed until you grade or adjust the material to control the brighter parts of the image and bring them back into a viewable range. When you are in WCG mode in FCP-X the there is no longer a highlight roll off crushing the highlights and now because they are not crushed they can be recovered, but there isn’t any more highlight range than you would have if you shot with log on the same camera!

None of this is some kind of Raw over exposure magic trick as is often portrayed. It’s simply not really understanding how the workflow works and appreciating that if you shoot bright – well it’s going to look bright – until you normalise it in post. We do this all the time with log via LUT’s and grading too! It can be a little more straight forward to recover highlights from Linear Raw footage as comes form an FS5 or FS7 compared to log. That’s because of the way log maintains a constant data level in each highlight stop and often normal grading and colour correction tools don’t deal with this correctly. The highlight range is there, but it can be tricky to normalise the log without log grading tools such as the log controls in DaVinci Resolve.

Another problem is the common use of LUT’s on log footage. The vast majority of LUT’s add a highlight roll off, if you try to grade the highlights after adding a LUT with a highlight roll off it’s going to be next to impossible to recover the highlights. You must do the highlight recovery before the LUT is added or use a LUT that has compensation for any over exposure. All of these things can give the impression that log has less highlight range than the raw from the same camera. This is not normally the case, both will be the same as it’s the sensor that limits the range.

The difference in the highlight behaviour is in the workflows and very often both log and raw workflows are miss-understood. This can lead to owners and users of these cameras thinking that one process has more than the other, when in reality there is no difference, it’s appears to be different because the workflow works in a different way.

cinematography, PXW-FS5

Why I Choose To Shoot ProRes Raw with the FS5

17 Comments

This is a much discussed topic right now, so as I promised in my last article about this, I have put together a video. Unfortunately YouTube’s compression masks many of the differences between the UHD XAVC and the ProRes Raw, but you can still see them, especially on the waveform scopes.

To really appreciate the difference you should watch the video on a large screen at at high quality, preferably 4K.

cinematography, Everything Else, HDR, Venice

Philips Extreme Earth Episode 2 now on YouTube.

Leave a comment

This is a part of a much larger project I have been working on recently for Philips. The Philips “Extreme Earth” project. The idea being to show of some of the latest technologies in their HDR Ambilight TV’s.

Last year we started the project up in Norway filming the Northern Lights. This year we travelled to Nevada and Arizona to shoot the second set of films under the “Canyon” headline, then we spent another couple of weeks travelling all over the Midwest shooting what will be the 3rd set of films under the headline “Storm”. We are now looking ahead to next year with several ideas being looked at from Volcanoes to Rain Forests.

For the Norway and Canyon shoots competitions were run ahead of the shoots in various consumer technology magazines . The winners getting to come on our adventures, stay in nice hotels and take part in various activities such has horse riding.

The main Canyon film was shot by myself on a Sony Venice using Sigma FF Primes as well as an Angenieux EZ zoom. The 1000fps Super Slow motion by Dustin Farrell on a Phantom Flex. I shot some additional 4K 120fps footage on an FS5 on a gimbal recording ProRes raw to a Shogun (horse riding and some tracking shots). The interviews and behind the scenes footage was shot by the projects director Leigh Emmerson of Persistence of Vision Productions (POV) using an A7sII, but there is a fair bit of FS5 (ProRes Raw) footage that I shot in there too.

The main film was produced at 60fps in HDR (I did the grade and encoding) and will be shown at the IFA trade show next month. The other films are all SDR.
Here is the HDR main video. To view this correctly ensure your HDR TV or HDR monitor is set to HDR10 (ST2084 gamma with Rec2020 colour).

Here is the “Making Off” video.

Here’s a video of the Canyon launch event:

A7, PMW-F55, PXW, PXW-FS5, PXW-FS7

New Venice Look LUT’s Version 3. Includes minus green LUTs. For FX9, FX6, FS5, FS7, F55, A7S, A7R.

33 Comments

I released my first version of the Venice Look LUT’s a few weeks ago and they have been a big hit. Overall most people seem to like them and get some great results. I’ve seen quite a few good looking videos produced using them.

I have received some feedback though that some people feel that the LUT’s may be crushing the blacks a bit too much for them, personally I think the deep shadows gives quite a film like look. However in response to that feedback I created an additional LUT set that keeps the blacks slightly higher. This can make grading a little easier, especially in FCP-X. You will find these new version 3 LUT’s here in the packages below – but please read on…..

While I was at it I also created another set of LUTs with a minus green offset. The idea behind these was that they can be used for material shot under lights with a green tint such as many LED or fluorescent light fixtures. Playing with these “-G1” LUT’s I have decided that I really like the slightly warmer and even less “Sony” look that these versions of the LUT’s give when shooting under “normal” lighting. So do please give them a try for a warmer look for skin tones both with LED/Fluorescent lighting and also with full spectrum lighting such as tungsten and sunlight.

Taking that a step further I have also included an even stronger minus green offset in a further -G2 set of LUT’s. So between the 3 sets of LUT’s offered in this download you should be able to find a set for most types of lighting with a variety of skin tone renditions.

Included in the LUT sets are LUTs for grading (with exposure offsets), LUT’s for Small HD monitors and the Zacuto Gratical. The grading LUT’s can also be used in other monitors and devices such as the Atomos recorder/monitors.

As always (to date at least) I offer these as a free download available by clicking on the links below. However a lot of work goes into creating and hosting these. I feel that this LUT set is worth $25.00 and would really appreciate that being paid if you find the LUT’s useful. But I will let you pay what you feel is fair, all contributions are greatly appreciated and it really does help keep this website up and running. If you can’t afford to pay, then just download the LUT’s and enjoy using them. If in the future you should choose to use them on a paying project, please remember where you got them and come back and make a contribution. More contributions means more LUT offerings in the future. I’m currently working on a couple of different film stock emulations based combined with the Venice look highlight rendition.

Please feel free to share a link to this page if you wish to share these LUT’s with anyone else or anywhere else.

To make a contribution please use the drop down menu here, there are several contribution levels to choose from.


Your choice:



There are two different LUT sets. One set is for S-Log3 and S-Gamut3.cine. The other set is for S-Log2 and SGamut. Please only download what you need to save my bandwidth!

Typically if you are shooting with 8 bit, for example with an FS5 in UHD or an A7S, A7R etc, then I recommend you use S-Log2 with SGamut. For most other cameras that have 10 bit recording then I recommend S-Log3 and SGamut3.cine.

Here are the links to my Venice Look Version 3 LUT’s. Including the minus green offset LUTs. Make sure you choose the right version and once you have downloaded them please read the README file included within the package.

Alister V-Look V3 LUT’s S-Log2/SGamut

Alister V-Look V3 LUT’s S-Log3/SGamut3.cine

I got a request for a set of Rec-709 Venice Look LUT’s – So here they are. I’m not expecting miracles from these, you will be starting with a much reduced dynamic range by shooting with Rec-709, but try them if you wish. I make no promises as to how well they will or will not work!

Alister Venice Look for Rec709

PXW-FS7

Replacement Mic Holder for the PXW-FS5 (and others).

8 Comments

Here’s another of my “I need one of these” products. The standard Sony mic mount isn’t the greatest thing in the world. It’s a little limited as to the range of microphones it can hold and over time they become floppy and loose. What I wanted was a lightweight, sturdy, simple to use mic mount that would fit easily on to the camera without taking up either of the shoe mounts. So I designed one for myself. A  few years ago I did a mic mount for the PMW-F5 and PMW-F55 that turned out to be be pretty popular and this mount shares some of that DNA.  It’s made out of plastic and uses either rubber bands or O-Rings to give really good vibration and handling isolation.

It mounts where the stock mount attaches using the two screws used to secure the original mount. There are two different mounting positions so you can adjust how far from the carry handle the microphone sits.

If you want one for yourself you can order one from my Shapeways store in a variety of colours. I also have a similar  generic mic mount that fits many of the Sony camcorder lineup.

To buy one check out my Shapeways store: https://www.shapeways.com/shops/alisterchapman

Microphone mount for the PXW-FS5
Replacement microphone mount for the PXW-FS5. Note the two sets of mounting holes so you can choose how far the mic is from the camera body.
Another view of my replacement mic mount for the PXW-FS5
cinematography, Shooting Tips

Log and Raw Don’t have highlight a highlight roll off.

3 Comments

This just keeps coming up over and over. Almost all log gamma curves and the majority of raw recording formats don’t have a highlight roll-off. Any roll off that you might see is probably in the LUT’s that you are using.

The whole point of log and raw is to capture as much information about the scene that you are shooing as you can. Log normally achieves this by recording every stop above middle grey with a constant amount of data, so even the very brightest stop has the same amount of recording data as the ones below it – there is no roll off.

In conventional limited range recordings such as Rec-709, hypergamma, cinegamma etc, highlight roll-offs work by reducing the contrast in the highlights to make the amount of data needed to record the very brightest stops much smaller than used for the rest of the image. This allows 2 or 3 stops to be squeezed into a very small recording range, keeping most of the recording data available for a nice bright high contrast image. The reduction in contrast in the extreme highlights helps hide any highlight handling problems and makes it appear as though the sensors clipping point is reach in a more pleasing soft manner.

But you don’t want this in a log or raw recording as it makes grading much harder as the footage will contain different contrast ranges, each needing it’s own grading adjustments. Also by reducing contrast in the highlights you are reducing the data. It would be very difficult to un-pick a highlight roll off and if you did want to expand the data back out you will get issues such as banding.

Chart showing S-Log2 and S-Log3 plotted against f-stops and code values. Note how little data there is for each of the darker stops, the best data is above middle grey and there is no highlight roll-off. Note that current sensor only go to +6 stops over middle grey so S-Log2 and S-Log record to different peak levels.

S-Log2 and S-Log3 like almost all log gammas have no highlight roll-off. The only roll off is from middle grey and down. So if you underexpose you will start to roll away the data in your scenes mid range and that’s not good. Expose for the mid range, this is the most important part of any image. If your highlights are a bit clipped don’t worry about this too much. In post production you can add a roll off in the grade that will make any clipped highlights roll away gently. Adding a bit of highlight diffusion in post will also nicely mask any clipped highlights and make them look natural.

PXW-FS5

PXW-FS5 Screen Protector updated images.

4 Comments

Here are some updated pictures of the screen protector for the FS5 that I sell via Shapeways. It’s not an exciting product, it’s just a clip on plastic cover that protects the LCD panel from damage when you are not using the camera. I travel a lot with my camera and the unprotected LCD screen is very vulnerable and could easily get scratched or worse still smashed. Arriving for a shoot and finding the FS5’s LCD screen smashed would be a disaster!

If you want one for yourself you can order them through my Shapeways store: https://www.shapeways.com/shops/alisterchapman

PXW-FS5 screen protector front view.
PXW-FS5 screen protection cover clipped on to the LCD screen.
PXW-FS5 clip on screen saver attached to the LCD.
PXW-FS5, Technology

What are the benefits of ProRes Raw with the PXW-FS5?

1 Comment

There has been a lot of discussion recently and few videos posted that perhaps give the impression that if you shoot with S-Log2 on an FS5 and compare it to raw shot on the FS5 there is very little difference.

Many of the points raised in the videos are correct. ProRes raw won’t give you any more dynamic range. It won’t improve the cameras low light performance. There are features such as automatic lens aberration correction applied when shooting internally which isn’t applied when shooting raw.  Plus it’s true that shooting ProRes raw requires an external recorder that makes the diminutive little FS5 much more bulky.

So why in that case shoot ProRes Raw?

Frankly, if all you are doing is producing videos that will be compressed to within an inch of their life for YouTube, S-Log2 can do an excellent job when exposed well, it can be graded and can produce a nice image.

But if you are trying to produce the highest quality images possible then well shot ProRes raw will give you more data to work with in post production with fewer compression artefacts than the internal 8 bit UHD XAVC.

I was looking at some shots that I did in preparation for my recent webinar on ProRes raw earlier today and at first glance there isn’t perhaps much difference between the UHD 8 bit XAVC S-Log2 files and the ProRes raw files that were shot within seconds of each other. But look more closely and there are some important differences, especially if skin tones are important too you.

Skin tones sit half way between middle grey and white and typically span around 2 to 3 stops. So with S-Log 2 and an 8 bit recording a face would span around 24 to 34 IRE and have a somewhere between 24 and 35 code values – Yes, that’s right, maybe as few as 24 shades in each of the R, G and B channels. If you apply a basic LUT to this and then view it on a typical 8 bit monitor it will probably look OK.

But compare that to 12 bit linear raw recording and the same face with 2 to 3 stops across it will have anywhere up to 10 to 20 times as many code values ( somewhere around 250 – 500 code values depending on exactly how it’s exposed) . Apply the same LUT as for the S-Log2 and on the surface it looks pretty much the same – or does it?

Look closely and you will see more texture in the 12 bit raw. If you are lucky enough to have a 10 bit monitor the differences are even more apparent. Sure, it isn’t an in-your-face night and day difference but the 12 bit skin tones look less like plastic and much more real, they just look nicer, especially if it’s someone with a good complexion.

In addition looking at my test material I am also seeing some mpeg compression artefacts on the skin tones in the 8 bit XAVC that has a smoothing effect on the skin tones, reducing some of the subtle textures and adding to the slightly un-real, video look.

The other deal with a lack of code values and H624 compression  is banding. Take 8 bit S-Log2 and start boosting the contrast in a sky scene, perhaps to bring out some cloud details and you will start to see banding and stair stepping if you are not very careful. You will also see it across wall and other textureless surfaces. You can even see this on your grading suite waveform scopes in many cases. You won’t get this with well exposed 12 bit linear raw (for any normal grading at least).

None of these are huge deals perhaps. But what is it that makes a great picture? Take Sony’s Venice or the Arri Alexa as examples. We know these to be great cameras that produce excellent images. But what is it that makes the images so good? The short answer is that it is a combination of a wide range of factors, each done as well as is possible. Good DR, good colour, good skin tones etc. So what you want to record is whatever the sensor in your camera can deliver as well as you can. 8 bit UHD compressed to only 100Mb/s is not really that great. 12 bit raw will give you more textures in the mid range and highlights. It does have some limitations in the shadows, but that is easily overcome with a nice bright exposure and printing down in post.

And it’s not just about image quality.

Don’t forget that ProRes Raw makes shooting at 4K DCI possible. If you hope to ever release your work for cinema display, perhaps on the festival circuit, you are going to be much better off shooting in the cinema DCI 4K standard rather than the UHD TV standard. It also allows you to shoot 60fps in 4K (I’m in the middle of a very big 4K 60p project right now). Want to shoot even faster – well with ProRes Raw you can, you can shoot at up to 120fps in 4K. So there are many other benefits to the raw option on the FS5 and recording to ProRes raw on a Shogun Inferno.

There is also the acceptability of 8 bit UHD. No broadcaster that I know of will ever consider 8 bit UHD unless there is absolutely no other way to get the material. You are far more likely to be able to get them to accept 12 bit raw.

Future proofing is another consideration. I am sure that ProRes raw decoders will improve and support in other applications will eventually come. By going back to your raw sensor data with better software you may be able to gain better image quality from your footage in the future. With Log you are already somewhat limited as the bulk of the image processing has already been done and is baked into the footage.

It’s late on Friday afternoon here in the UK and I’ve promised to spend some time with the family this evening. So no videos today. But next week I’ll post some of the examples I’ve been looking at so that you can see where ProRes raw elevates the image quality possible from the FS5.

PXW-FS5, Shooting Tips

Using an FS5 to shoot in low light – what can I do?

8 Comments

The PXW-FS5 is a pretty good camera overall. Compared to cameras from 6 or 7 years ago it’s actually pretty sensitive. The exposure rating of 800 ISO for the standard rec-709 picture profile tells us that it is a little more than twice as sensitive as most old school shoulder cams. But it also suggests that it is only around half as sensitive as the king of low light, the Sony A7S. The A7S is so sensitive because it’s sensor is 1.5x bigger than the sensor in the FS5 and as a result the pixels in the A7S are almost twice the size, so are able to capture more light.

So what can you do if shooting in low light? 

The most important thing to do is to make the optical system as efficient as possible. You want to capture as much of the available light as you can and squeeze it down onto the FS5’s sensor. If you take a fast full frame lens and use it in conjunction with a Speed Booster type adapter you will end up with similar performance to using the same lens, without the speed booster on an A7S.

This is because the lens has a fixed light gathering capability. Use it on an A7S and all of the captured light is passed to all of those big pixels on the sensor. The light is split evenly across 4K’s worth of pixels.

Use it on an FS5 with a speedbooster and the same thing happens, all of the light is compressed down, which makes it brighter and all of this now brighter light falls on 4K’s worth of pixels. The smaller pixels are about half as sensitive, but now the light is twice as bright, so the end result is similar.

A speedbooster adapter such as the Metabones makes a huge difference in low light. But you MUST use a full frame lens.

The biggest performance gains are to be had from using a very fast lens and then making sure all the light from the lens is used, none wasted. Anything slower than f2.8 will be a waste. If you are thinking of using the Sony f4 lens for very low light… well frankly you may as well not bother. The lens is THE most important factor in low light. When I go up to Norway to shoot the Aurora I use f1.4 and f1.8 lenses.

What about Picture Profiles?

The standard picture profile isn’t a bad choice for low light but you might want to look at using cinegamma 3. Although with a low light, low contrast scene none of the picture profiles will be significantly different from the others with the exception of PP2, PP7, PP8 or PP9. None of the profiles make the camera more sensitive, the sensitivity is governed by the sensor itself and all the profiles do is alter the way gain is distributed across the image.

PP2 will crush your shadows giving less to work with in post. The log curves in PP7,8,9 will roll off the darkest parts of the image, again giving you less in post. So I would probably avoid these.

For color I suggest using the Pro colour matrix. This works well for most situations and it will help limit the noise levels as it keeps the saturation fairly low keeping the noisy blue channel in check.

Gain or ISO?

I recommend you set the camera to gain rather than ISO as the ISO’s for each each gamma curve are different, so it can be difficult to understand how much gain is being added, especially if you are switching between gamma curves. Use gain and you will have a good idea of the noise levels as every time you add +6dB the image becomes one stop brighter and you double the noise in the image, +12 dB is 2 stops brighter and 4x noisier than 0dB etc. ISO is an exposure rating, it is not a sensitivity measurement. But don’t use too much gain or too high an ISO as this will affect you ability to use some of the very good post production noise reduction tools that are available.

Noise and Noise Reduction.

If shooting in very low light then you are quite probably going to want to use some noise reduction tools in post production. “Neat Video” works very well at cleaning up a noisy image as do the various NR tools in the paid versions of DaVinci Resolve.  These post production  tools work best when the noise is clean. By that I mean well defined. When using any of the 709 or Cinegamma curves a bit of gain can be used, but I wouldn’t go above 12dB as above this the NR starts to introduce a lot of smear and this than makes it hard for any post production NR processes like Neat Video to do a decent job without the image turning into a blurry mess. So don’t go crazy with the gain or use very high ISO’s as the post production NR won’t work as well on footage that already has a lot of in camera NR applied.

And if you can add a little light-

If you are adding any light use a daylight balanced light where you can. Video cameras are least sensitive in the blue channel. If you use a tungsten light which is predominantly warm/red to get a good white balance you have to increase the gain of the cameras least sensitive and as a result most noisy blue channel. This will add more noise than if you use a daylight balance light as for daylight you need less gain in the noisy blue channel.

There is no miracle cure for shooting in very low light levels. But with the right lens and a speedbooster the FS5 can do a very good job. But just in case yo haven’t worked it out already, I’ll say it one more time: The lens is the most important bit! Beyond this your next step would be adding an image intensifier for that green night vision look.

Uncategorized

LCD Screen protector for the PXW-FS5.

5 Comments

One thing that has always worried me when travelling with my PXW-FS5 has been the fact that there is no protection for the LCD screen when in transit. There would be nothing worse than arriving for an importat shoot and finding the delicate LCD screen cracked or smashed.

No cover is supplied by Sony and I haven’t seen a proper cover for the LCD anywhere. So I decided to make my own. This is a simple plastic cover that snaps over the LCD screen when not in use. It helps protect it from scratches and other damage while you travelling, when the camera is in your camera bag or if you have to ship the camera anywhere. The prototype in these pictures was 3D printed on my home 3D printer and it works really well. There are small lugs that clip over the back of the LCD panel and when fitted it cannot slide off

My clip on LCD protector fitted to my FS5 (This is a home printed version).
The clip on cover designed to protect the LCD when in transit.

If you want one for yourself you can order them from my Shapeways store. Shapeways will professionally print them to order in a range of colours from a strong plastic material. The Shapeways prints are of far higher quality than can be achieved with most consumer 3D printers and the finish will be smooth and professional looking (unlike my prototype).

You can order these screen protection covers from my Shapeways store: https://www.shapeways.com/shops/alisterchapman