Most computer screens run at 60Hz and very often this rate can’t be changed. 25p shown on most computer screens requires 15 frames to be shown twice and 10 frames to be shown 3 times to create a total of 60 frames every second. This creates an uneven cadence and it’s not something you can control as the actual structure of the cadence depends on the video subsystem of the computer the end user is using.
Every now and again I get asked how to adjust the color matrix in a video camera. Back in 2009 I made a video on how to adjust the color matrix in the Sony’s EX series of cameras. This video is just as relevant today as it was then. The basic principles have not changed.
The exact menu settings and menu layout may be a little different in the latest cameras, but the adjustment of the matrix setting (R-G, G-R etc) have exactly the same effect in the latest camera that provide matrix adjustments (FS7, F5, F55 and most of the shoulder mount and other broadcast cameras). So if you want a better understanding of how these settings and adjustment works, take a look at the video.
I’ll warn you now that adjusting the color matrix is not easy as each setting interacts with the others. So creating a specific look via the matrix is not easy and requires a fair bit of patience and a lot of fiddling and testing to get it just right.
This came up on facebook the other day, how long do SD cards last?
First of all – I have found SD cards to be pretty reliable overall. Not as reliable as SxS cards or XQD cards, but pretty good generally. The physical construction of SD cards has let me down a few times, the little plastic fins between the contacts breaking off. I’ve had a couple of cards that have just died, but I didn’t loose any content as the camera wouldn’t let me record to them. Plus I have also had SD cards that have given me a lot of trouble getting content and files off them. But compared to tape, I’ve had far fewer problems with solid state media.
But something that I don’t think most people realise is that a lot of solid state media ages the more you use it. In effect it wears out.
There are a couple of different types of memory cell that can be used in solid state media. High end professional media will often use single level memory cells that are either on or off. These cells can only store a single value, but they tend to be fast and extremely reliable due to their simplicity. But you need a lot of them in a big memory card. The other type of cell found in most lower cost media is a multi-level cell. Each multi-level cell stores a voltage and the level of the voltage in that cell represents many different values. As a result each cell can store more than one single value. The memory cells are insulated to prevent the voltage charge leaking away. However each time you write to the cell the insulation can be eroded. Over time this can result in the cell becoming leaky and this allows the voltage in the cell to change slightly resulting in a change to the data that it holds. This can lead to data corruption.
So multi level cards that get used a lot, may develop leaky cells. But if the card is read reasonably soon after it was written to (days, weeks, a month perhaps) then it is unlikely that the user will experience any problems. The cards include circuitry designed to detect problem cells and then avoid them. But over time the card can reach a point where it no longer has enough memory to keep mapping out damaged cells, or the cells loose there charge quickly and as a result the data becomes corrupt.
Raspberry Pi computers that use SD cards as memory can kill SD cards in a matter of days because of the extremely high number of times that the card may be written to.
With a video camera it will depend on how often you use the cards. If you only have one or 2 cards and you shoot a lot I would recommend replacing the cards yearly. If you have lots of cards either use one or two and replace them regularly or try to cycle through all the cards you have to extend their life and avoid any one card from excessive use which might make it less reliable than the rest.
One thing regular SD cards are not good for is long term storage (more than a year and never more than 5 years) as the charge in the cells will leak away over time. There are special write once SD cards designed for archival purposes where each cell is permanently fused to either On or Off. Most standard SD cards, no matter how many times they have been used won’t hold data reliably beyond 5 years.
I have been asked whether you should still expose log a bit brighter than the recommended base levels on the Sony PXW-FS5 now that Sony have released new firmware that gives it a slightly lower base ISO. In this article I take a look at why it might be a good idea to expose log (with any camera) a bit brighter than perhaps the manufacturer recommends.
There are a couple of reasons to expose log nice and bright, not just noise. Exposing log brighter makes no difference to the dynamic range. That’s determined by the sensor and the gain point at which the sensor is working. You want the camera to be at it’s native sensitivity or 0dB gain to get that maximum dynamic range.
Exposing brighter or darker doesn’t change the dynamic range but it does move the mid point of the exposure range up and down. Exposing brighter increases the under exposure range but decreases the over exposure range. Exposing darker decreases the under exposure range but increases the over exposure range.
Something that’s important when thinking about dynamic range and big dynamic ranges in particular is that dynamic range isn’t just about the highlights it’s also about the shadows, it isn’t just over exposure, it’s under exposure too, it’s RANGE.
So why is a little bit of extra light often beneficial? You might call it “over exposure” but that’s not a term I like to use as it implies “too much exposure”. I prefer to use “brighter exposure”.
It’s actually quite simple, it’s about putting a bit more light on to the sensor. Most sensors perform better when you put a little extra light on them. One thing you can be absolutely sure of – if you don’t put enough light on the sensor you won’t get the best pictures.
Put more light on to the sensor and the shadows come up out of the sensors noise floor. So you will see further into the shadows. I’ve had people comment that “why would I ever want to use the shadows, they are always noisy and grainy”? But that’s the whole point – expose a bit brighter and the shadows will be much less noisy, they will come up out of the noise. Expose 1 stop brighter and you halve the shadow noise (for the same shadows at the previous exposure). Shadows are are only ever noise ridden if you have under exposed them.
This is particularly relevant in controlled lighting. Say you light a scene for 9 stops. So you have 9 stops of dynamic range but a 14 stop sensor. Open up the aperture, put more light on the sensor, you get a better signal to noise ratio, less noisy shadows but no compromise of any type to the highlights because if the scene is 9 stops and you have 14 to play with, you can bring the exposure up by a couple of stops comfortably within the 14 stop capture range.
Look at the above diagram of Sony’s S-Log2 and S-Log3 curves. The vertical 0 line in the middle is middle grey. Note how above middle grey the log curves are more or less straight lines. That’s because above the nominal middle grey exposure level each stop is recorded with the same amount of data, this you get a straight line when you plot the curve against exposure stops. So that means that it makes very little difference where you expose the brighter parts of the image. Expose skin tones at stop + 1 or stop +3 and they will have a very similar amount of code values (I’m not considering the way dynamic range expands in the scene you shoot as you increase the light in the scene in this discussion). So it makes little difference whether you expose those skin tones at stop +1 or +3, after grading they will look the same.
Looking at the S-Log curve plots again note what happens below the “0” middle grey line. The curves roll off into the shadows. Each stop you go down has less data than the one before, roughly half as much. This mimics the way the light in a real scene behaves, but it also means there is less data for each stop. This is one of the key reasons why you never, ever want to be under exposed as if you are underexposed you mid range ends up in this roll off and will lack data making it not only noisy but also hard to grade as it will lack contrast and tonal information.
Open up by 1 additional stop and each of those darker stops is raised higher up the recording curve by one stop and every stop that was previously below middle grey doubles the amount of tonal values compared to before, so that’s 8 stops that will have 2x more data than before. This gives you a nice fat (lots of data) mid range that grades much better, not just because it has less noise but because you have a lot more data where you really need it – in the mid range.
Note: Skin tones can cover a wide exposure range, but typically the mid point is around 1 to 1.5 stops above middle grey. In a high contrast lighting situation skin tones will start just under middle grey and extend to about 2 stops over. If you accidentally under expose by 1 stop or perhaps don’t have enough light for the correct exposure you will seriously degrade the quality of your skin tones as half of your skin tones will be well below middle grey and in the data roll-off.
Now of course you do have to remember that if your scene does have a very large dynamic range opening up an extra stop might mean that some of the very brightest highlights might end up clipped. But I’d happily give up a couple of specular highlights for a richer more detailed mid range because when it comes to highlights – A: you can’t show them properly anyway because we don’t have 14 stop TV screens and B: because highlights are the least important part of our visual range.
A further consideration when we think about the highlights is that with log there is no highlight roll-off. Most conventional gamma curves incorporate a highlight roll-off to help increase the highlight range. These traditional highlight roll-offs reduce the contrast in the highlights as the levels are squeezed together and as a result the highlights contain very little tonal information. So even after grading they never look good, no matter what you do. But log has no highlight roll-off. So even the very brightest stop, the one right on the edge of clipping contains just as much tonal information as each of the other brighter than middle grey stops. As a result there is an amazingly large amount of detail than can be pulled out of these very bright stops, much more than you would ever be able to pull from most conventional gammas.
Compare log to standard gammas for a moment. Log has a shadow roll-off but no highlight roll-off. Most standard gammas have a strong highlight roll-off. Log is the opposite of standard gammas. With standard gammas, because of the highlight roll-off, we normally avoid over exposure because it doesn’t look good. With Log we need to avoid under exposure because of the shadow roll-off, it is the opposite to shooting with standard gammas.
As a result I strongly recommend you never, ever under expose log. I normally like to shoot log between 1 and 2 stops brighter than the manufacturers base recommendation.
Next week: Why is a Sony camera like the FS7,F5 800 ISO with standard gamma but 2000 ISO in log and how does that impact the image?
I was recently asked by Sony to write a user guide for the PXW-FS7 and FS7M2. Well it’s now complete and available for free download from Sony. The guide does not replace the manual but should act as a useful point of reference for those unfamiliar with the cameras. It should also help guide you through the use of the CineEI mode or change the various gammas settings in custom mode to suit different types of scene.
There are sections on exposure tools and controls, the variable ND filter, exposure tools and controls. Custom mode paint settings, Cine EI and LUT’s and additional information on the various shooting modes and functions.
There are two versions of the guide. One is an ePub book that can be displayed and read by may book reader programs such as iBooks and the other is an interactive PDF formatted for use on a mobile phone or tablet.
While we wait for Sony to re-release the version 4 firmware for the FS5 I thought I would briefly take a look at what HLG is and what it’s designed to do as there seems to be a lot of confusion.
HLG stands for Hybrid Log Gamma. It is one of the gamma curves used for DISTRIBUTION of HDR content to HDR TV’s that support the HLG standard. It was never meant to be used for capture, it was specifically designed for delivery.
As the name suggests HLG is a hybrid gamma curve. It is a hybrid of Rec-709 and Log. But before you get all excited by the log part, the log used by HLG is only a small part of the curve and it is very agressive – it crams a very big dynamic range into a very small space – This means that if you take it into post production and start to fiddle around with it there is a very high probability of problems with banding and other similar artefacts becoming apparent.
The version of HLG in the FS5 firmware follows the BBC HLG standard (there is another NHK standard). From black to around 70% the curve is very similar to Rec 709, so from 0 to 70% you get quite reasonable contrast. Around 70% the curve transitions to a log type gamma allowing a dynamic range much greater than 709 to be squeezed into a conventional codec. The benefit this brings is that on a conventional Rec-709 TV the picture doesn’t look wrong. It looks like a very slightly darker than normal, only slightly flat mid range, but the highlights are quite flat and washed out. For the average home TV viewer watching on a 709 TV the picture looks OK, maybe not the best image ever seen, but certainly acceptable.
However feed this same signal to an HDR TV that supports HLG and the magic starts to happen. IF the TV supports HLG (and currently only a fairly small proportion of HDR TV’s support HLG. Most use PQ/ST2084) then the HLG capable HDR TV will take the compressed log highlight range and stretch it out to give a greater dynamic range display. The fact that the signal gets stretched out means that the quality of the codec used is critical. HLG was designed for 10 bit distribution using HEVC, it was never meant to be used with 8 bit codecs, so be very, very careful if using it in UHD with the FS5 as this is only 8 bit.
So, HLG’s big party trick is that it produces an acceptable looking image on a Rec-709 TV, but also gives an HDR image on an HDR TV. So one signal can be used for both HDR and SDR giving what might be called backwards compatibility with regular SDR TV’s. But it is worth noting that on a 709 TV HLG images don’t look as good as images specifically shot or graded for 709. It is a bit of a compromise.
What about the dynamic range? High end HDR TV’s can currently show about 10 stops. Lower cost HDR TV’s may only be able to show 8 stops (compared to the 6 stops of a 709 TV). There is no point in feeding a 14 stop signal to a 10 stop TV, it won’t look the best. From what I’ve seen of the HLG curves in the FS5 they allow for a maximum of around 10 to 11 stops, about the same as the cinegammas. HLG can be used for much greater ranges, but as yet there are no TV’s that can take advantage of this and it will be a long tome before there are. So for now, the recorded range is a deliberately limited so you don’t see stuff in the viewfinder that will never be seen on todays HDR TV’s. As a result the curves don’t use the full recording range of the camera. This means they are not using the recording data in a particularly efficient way, a lot of data is unused and wasted. But this is necessary to make the curves directly compatible with an HLG display.
What about grading them? My advice – don’t try to grade HLG footage. There are three problems. The first is that the gamma is very different in the low/mid range compared to the highlights. This means that in post the shadows and mid range will respond to corrections and adjustments very differently to the high range. That makes grading tricky as you need to apply separate correction to the midrange and highlights.
The second problem is that the is a very large highlight range squeezed into a very small recording range. It should look OK when viewed directly with no adjustment. But if you try stretching that out to make the highlights brighter (remember they never reach 100% as recorded) or to make them more contrasty, there is a higher probability of seeing banding artefacts than with any other gamma in the camera.
The third issue is simply that the limited recording range means you have fewer code values per stop than regular Rec-709, the cinegammas or S-Log2. HLG is the least best choice for grading in the FS5.
Next problem is color. Most HDR TV’s want Rec-2020 color. Most conventional monitors want Rec-709 color. Feed Rec-2020 into a 709 monitor and the colors look flat and the hues are all over the place, especially skin tones. Some highly saturated colors on the edge of the color gamut may pop out more than others and this looks odd.
Feed 709 into a 2020 TV and it will look super saturated and once again the color hues will be wrong. Also don’t fool yourself into thinking that by recording Rec2020 you are actually capturing more. The FS5 sensor is designed for 709. The color filters on the sensor do work a little beyond 709, but nowhere near what’s needed to actually “see” the full 2020 color space. So if you set the FS5 to 2020 what you are capturing is only marginally greater than 709. All you really have is the 709 with the hues shifted and saturation reduced so color looks right on a 2020 monitor or TV.
So really, unless you are actually feeding an Rec 2100 (HLG + 2020) TV, there is no point in using 2020 color as this require you to grade the footage to get the colors to look right on most normal TV’s and monitors. As already discussed, HLG is far from ideal for grading, so better to shot 709 if that’s what your audience will be using.
Don’t let the hype and fanfares that have surrounded this update cloud your vision. HLG is certainly very useful if you plan to directly feed HDR to a TV that supports HLG. But if you plan on creating HDR content that will be viewed on both HLG TV’s and the more common PQ/ST2084 TV’s then HLG is NOT what you want. You would be far – far better off shooting with S-Log and then grading your footage to these two very different HDR standards. If you try to convert HLG to PQ it is not going to look nearly as good as if you start with S-Log.
Exposure levels: If you want to get footage that works both with an HLG HDR TV and a SDR 709 TV then you need to expose carefully. A small bit of over exposure wont hurt the image when you view it on a 709 TV or monitor, so it will look OK in the viewfinder. But on an HDR TV any over exposure could result in skin tones that look much too bright and an image that is unpleasantly bright. As a guide you should expose diffuse 90% white (a white card or white piece of paper) at no more than 75%. Skin tones should be around 55 to 60%. You should not expose HLG as brightly as you do Rec-709.
Sure you can shoot with HLG for non HDR applications. You will get some slightly flat looking footage with rolled off highlights. If that’s the image you want then I’m not going to stop you shooting that way. If that’s what you want I suggest you consider the Cinegamma as these capture a similar DR also have a nice highlight roll off (when exposed correctly) and do use the full recording range.
Whatever you do make sure you understand what HLG was designed for. Make sure you understand the post production limitations and above all else understand that it absolutely is not a substitute for S-log.
This is not good. Unfortunately any clips recorded in the FS5 using the Rec2020 color option in the new Picture Profile 10 cause Adobe Premiere CC 2017.1.2 to crash as soon as you try to play them back. The clips play back fine in Resolve or in earlier versions of Premiere CC, but with the latest version of Premiere CC you get a near instant crash no matter what your playback settings.
If you are running an earlier version of CC then stay with that for now if you want to work with the new HLG clips and 2020 color. Rec 709 color works just fine so you can shoot HLG with Rec709 color and edit that in Premiere CC, but HLG + 2020 color will crash Premiere CC 2017.1.2. Hopefully this will get resolved soon by Adobe/Sony.
Sony will be releasing an update for the firmware in the Sony PXW-FS5 in the next few days. This update amongst other things will allow users of the FS5 to shoot to HDR directly using the Hybrid Log Gamma HDR gamma curve and Rec2020 color. By doing this you eliminate the need to grade your footage and could plug the camera directly in to a compatible HDR TV (the TV must support HLG) and see an HDR image directly on the screen.
But what about FS7 and F5/F55 owners? Well, for most HDR productions I still believe the best workflow is to shoot in S-Log3 and then to grade the footage to HDR. However there may be times when you need that direct HDR output. So for the FS7, F5 and F55 I have created a set of Hybrid Log Gamma LUT’s that you can use to bake in HLG and Rec2020 while you shoot. This gives you the same capabilities as the FS5 (with the exception of the ability to add HLG metadata to the HDMI).
For a video explanation of the process please follow the link to my new Patreon page where you will find the video and the downloadable LUT’s.
One of THE most common complaints I hear, day in, day out, is: There is banding in my footage.
Before you start complaining about banding or other image artefacts ask yourself one very simply, but very important question: Do I know EXACTLY what is happening to my footage within my computer or playback system? As an example, editing on a computer your footage will be starting of at it’s native bit depth. It might then be converted to a different bit depth by the edit or grading software for manipulation. Then that new bit depth signal is passed to the computers graphic card to be displayed. At this point it will possibly be converted to another bit depth as it passes through the GPU and then it will be converted to the bit depth of the computers desktop display. From there you might be passing it down an HDMI cable where another bit depth change might be needed before it finally arrives at your monitor at goodness knows what bit depth.
The two images below are very telling. The first is a photo of a high end TV connected to my MacBook ProRetina via HDMI playing back a 10 bit ProRes file in HD. The bottom picture is exactly the same file being played back out of an Atomos Shogun via HDMI to exactly the same TV. The difference is striking to say the least. Same file, same TV, same resolution. The only difference is the top one is playing back off the computer, the lower from a proper video player. I also know from experience that if I plug in a proper video output device such as a Blackmagic Mini-monitor to the laptops Thunderbolt port I will not see the same artefacts as I do when using the computers built in HDMI.
And this is a not just a quirk of my laptop, my grading suite is exactly the same. If I use the PC’s built in HDMI the pictures suck. Lots of banding and other unwanted artefacts. Play back the same clip via a dedicated, made for video, internal PCI card such as a Decklink card and almost always all of the problems go away. If you use SDI rather than HDMI things tend to be even better.
So don’t skimp on your monitoring path if you really want to know what your footage looks like. Get a proper video card, don’t rely on the computers GPU. Get a decent monitor with an SDI input and try to avoid HDMI for any critical monitoring.
Once upon a time it was really simple. We made TV programmes and videos that would only ever be seen on TV screens. If you lived and worked in a PAL area you would produce programmes at 25fps. If you lived in an NTSC area, most likely 30fps. But today it’s not that simple. For a start the internet allows us to distribute our content globally, across borders. In addition PAL and NTSC only really apply to standard definition television as they are the way the SD signal is broadcast with a PAL frame being larger than an NTSC one and both use non-square pixels. With HD Pal and NTSC does not exist, both are 1280×720 or 1920×1080 and both use square pixels, the only difference between HD in a 50hz country and a 60hz country is the frame rate.
Today with HD we have many different frame rates to choose from. For film like motion we can use 23.98fps or 24fps. For fluid smooth motion we can use 50fps or 60fps. In between sits the familiar 25fps and 30fps (29.97fps) frame rates. Then there is also the option of using interlace or progressive scan. Which do you choose?
If you are producing a show for a broadcaster then normally the broadcaster will tell you which frame rate they need. But what about the rest of us?
There is no single “right” frame rate to use. A lot will depend on your particular application, but there are some things worth considering.
If you are producing content that will be viewed via the internet then you probably want to steer clear of interlace. Most modern TV’s and all computer monitors use progressive scan and the motion in interlaced content does not look good on progressive TVs and monitors. In addition most computer monitors run by default at 60hz. If you show content shot at 25fps or 50fps on a 60hz monitor it will stutter slightly as the computer repeats an uneven number of frames to make 25fps fit into 60Hz. So you might want to think about shooting at 30fps or 60fps for smoother less stuttery motion.
24fps or 23.98fps will also stutter slightly on a 60hz computer screen, but the stutter is very even as 1 frame gets repeated in every 4 frames shown. This is very similar to the “pull-up” that gets added to 24fps movies when shown on 30fps television, so it’s a kind of motion that many viewers are used to seeing anyway. Because it’s a regular stutter pattern it tends to be less noticeable in the irregular conversion from 25fps to 60hz. 25 just doesn’t fit into 60 in a nice even manner. Which brings me to another consideration – If you are looking for a one fits all standard then 24 or 23.98fps might be a wise choice. It works reasonably well via the internet on 60hz monitors. It can easily be converted to 30fps (29.97fps) using the pull-up for television and it’s not too difficult to convert to 25fps simply by speeding it up by 4% (many feature films are shown in 25fps countries simply by being sped up and a pitch shift added to the audio).
So, even if you live and work in a 25fps (Pal) area, depending on how your content will be distributed you might actually want to consider 24, 30 or 60fps for your productions. 25fps or 50fps looks great on a 50hz TV, but with the majority of non broadcast content being viewed on computers, laptops and tablets 24/30/60fps may be a better choice.
What about the “film look”? Well I think it’s obvious to say that 24p or 23.98p will be as close as you can get to the typical cadence and motion seen in most movies. But 25p also looks more or less the same. Even 30p has a hint of the judder that we see in a 24p movie, but 30p is a little smoother. 50p and 60p will give very smooth motion, so if you shoot sports or fast action and you want it to be smooth you may need to use 50/60p. But 50/60p files will be twice the size of 24/25 and 30p files in most cases, so then storage and streaming bandwidth have to be considered. It’s much easier to stream 24p than 60p.
For almost all of the things that I do I shoot at 23.98p, even though I live in a 50hz country. I find this gives me the best overall compatibility. It also means I have the smallest files sizes and the clips will normally stream pretty well. One day I will probably need to consider shooting everything at 60fps, but that seems to be some way off for now, HDR and higher resolutions seem to be what people want right now rather than higher frame rates.