Tag Archives: noise

Why doesn’t every camera have a global shutter?

Global shutter cameras are not a new thing. They have been around for a very long time.  The Sony Z750 is 2.5 years old and has had a global shutter since day 1. There are also the HDC-3200 and F5500 4K global shutter cameras.
Screenshot-2023-11-15-at-11.46.52-600x435 Why doesn't every camera have a global shutter?
Global Shutter Sony PMW-F55
 
The PMW-F55 had a global shutter and CCD cameras had global shutters.

And now Sony have announced the new A9 MKIII stills camera that also has a global shutter:
 
Screenshot-2023-11-15-at-12.09.54-600x419 Why doesn't every camera have a global shutter?
Sony’s new A9 III has a global shutter.


So, given that it’s not really a new thing – why doesn’t every camera have a global shutter?

The main reason is noise – and in particular fixed pattern noise that will show up in blacks and deep shadow areas if you try to lift the shadows or use high levels of gain. With a global shutter the signal from every pixel is globally shifted into a memory cell at the end of each exposure period and then those memory cells are read out while the next frame is being capture. Each memory cell will have a slightly different very tiny signal offset and as the arrangement of the memory cells never changes these offsets get added to the signal and appear in the output as a fixed noise pattern. It can be harder to eliminate this fixed pattern noise in post production compared to random noise and it can look very ugly, not at all like film grain.

In addition the readout can be delayed by up to 1 frame more than a rolling shutter sensor as the readout from the sensor to the image processor must wait until after the frame has been captured and shifted from the pixels to the memory cells. This adds additional latency to the monitoring (not really an issue in a photo camera, but more of a problem in a video camera).

IQ IS A BALANCING ACT.

Image quality is never about one single factor. It is about the balance between noise, readout speed, DR, colour, artefacts. But when one issue, such as fixed pattern noise overwhelms any other benefits it tends to become a problem. The F55 was well know for it’s fixed pattern noise, so a good bright exposure was always desirable to avoid the noise. An under exposed F55 was ugly and generally you would always try to shoot 1 or 2 stops brighter than the cameras base ISO. Early tests of the A9 III appear to indicate that it is a bit noisier that other similar rolling shutter cameras and the limited ISO range suggests that the sensors DR is also a bit more limited – this shouldn’t really be a surprise as noise limits the shadow DR. Plus this is a single ISO camera, no dual ISO goodness with the A9 III.
 
So, a high end global shutter camera may well be good to have, but are you willing to give up dual ISO, exceptional low light performance or low noise? Given the A9 III sensor appears to have a native ISO of 250, what about needing to use an EI of 250 to get the best performance out of your S-Log3 or raw video camera when everything else can now be rated at 800 without issue? The F55 was 1250 ISO, but you needed to shoot at around 320-640 EI to get an image as clean as we can now get at 800EI with the newer cameras and there was no way you would want to shoot at 4000ISO/EI with an F55 but now we take for granted the ability to shoot at high ISOs without excessive noise.

I have no doubt that the A9 III is a great photo camera and that it’s global shutter can bring some benefits such as eliminating the need for a mechanical shutter and very high speed flash synchronisation. But these benefits are not essential for a video camera. In the future maybe all cameras will have global shutters, but we are not yet at the point where a global shutter doesn’t have any downsides. The extra memory cells, the extra transistors used to control the movement of the tiny signals on the sensor all add a little extra noise. The sensor might run hotter too especially if used for video. Plus the sensor is probably more expensive to make. So, while I think the A9 III is a welcome addition I don’t think it makes our rolling shutter video cameras obsolete. The majority of films shot on film had a small small amount of rolling shutter caused by the sweep of the cameras rotary shutter across the film.

FX6 Fan Noise and Fan Modes.

fx6-fan-noise-600x384 FX6 Fan Noise and Fan Modes.Cooling fans (or perhaps more accurately temperature regulating fans) are an unfortunate necessity on modern high resolution cameras. As we try to read more and more pixels, process them and then encode them at ever greater resolutions more and more heat is generated. Throw in higher frame rates and the need to do that processing even faster and heat becomes an issue, especially in smaller camera bodies. So forced air cooling becomes necessary if you wish to shoot uninterrupted for extended periods..

Many camcorder users complain about fan noise. Not just with the FX6 but with many modern cameras. But fans are something we need, so we need to learn to live with the noise they make. And the fan isn’t just cooling the electronics, it is carefully regulating the temperature of the camera trying to keep it within a narrow temperature range.

The fan regulates the temperature of the sensor by taking warm air from the processing electronics and passing it over fins attached to the back of the sensor. I am led to believe that at start up the fan runs for around 30 seconds to quickly warm up the sensor. From there the camera tries to hold the sensor and electronics at a constant warm temperature, not too cold, not too hot, so that the sensor noise levels and black levels remain constant. The sensor is calibrated for this slightly warm temperature.

As well as running in the default auto mode there are  “minimum” and “off in record” modes for the fan in the technical section of the FX6’s main menu. Minimum forces the fan to run all the time at a low level so it doesn’t cycle on and off, possibly at higher levels. Off in record turns the fan off when recording – however the fan will still come on if there is a risk of damage due to overheating. Off in record can result in minor changes to noise as black levels during longer takes as the camera’s internal temperature rises, but you’ll likely only see this if you look carefully for it.

Shooting Raw With The FS5 And Ninja V+

This came up in one of the user groups today and I thought I would repeat the information here.

One issue when using the Atomos Ninja V+ rather than an older Atomos Shogun or Inferno is that the Ninja V+ doesn’t have an internal S-Log2 option. This seems to cause some users a bit of confusion as most are aware that for the best results the FS5 MUST to be set to PP7 and S-Log2 as this is the only setting that fully optimises the sensor setup.
 
When you shoot raw, you are recording linear raw, the recordings don’t actually have any gamma as such and they are not S-log2 or S-Log3, they are raw. The S-Log2 setting in the FS5 just ensures the camera is optimised correctly. If you use the S-Log3 settings, what you record is exactly the same – linear raw, just with more noise because the camera isn’t as well optimised.
 
Any monitor or post production S-Log2 or S-Log3 settings are simply selecting the intermediate gamma that the raw will be converted to for convenience. So when the Ninja V+ states S-Log3 this is simply what the Ninja converts the raw to, before applying any LUT’s. It doesn’t matter that this is not S-Log2 because you didn’t record S-Log2, you recorded linear raw. This is simply what the Ninja V+ will use internally when processing the raw.
 
You have to convert the raw to some sort of gamma so that you can add LUT’s to it and as S-Log3 LUT’s are commonly available S-Log3 is a reasonable choice. With earlier recorders you had the option to choose S-Log2 so that when viewing the native S-Log2 output from the camera, what you saw on the monitors screen looked similar to what you saw on the FS5’s LCD screen when the FS5 was set to S-Log2. But S-Log2 is no longer included in the latest monitors, so now you only have the option to use S-Log3. But from an image quality point of view this monitor setting makes no difference and has no effect on what is recorded (the FS5 should still be set to PP7 and S-Log2).
 
In post production in the past, for consistency it would have been normal to decode the raw to S-Log2 so that everything match throughout your production pipeline from camera to post. But again, it doesn’t really matter if you now decode the raw to S-Log3 instead if you wish. There will be no significant quality difference and there is a wider range of S-Log3 LUT’s to choose from.
 
If the footage is too noisy then it is under exposed, it’s the only reason why the footage will be excessively noisy. It is true that raw bypasses the majority of the cameras internal noise reduction processes, but this only makes a small difference to the overall noise levels. 

Even with the latest Ninja V+ what is recorded when outputting raw from the FS5 is 12 bit linear raw.
 
12 bit Linear raw is a somewhat restricted format. 12 bits is not a lot of code values to record a high dynamic range linear signal. This is why most cameras use log recording for wide dynamic ranges, log is much more efficient and distributes the available recording data in a way very sympathetic to the way human vision works.
 
In practice what this means is that the 12 bit linear raw has LOTS of data and image information in the upper mid range and the very brightest  highlights. But relatively very little picture information in the lower mid range and shadows. So if it is even the slightest bit under exposed the image will degrade very quickly as for each stop yu go down in brightness you halve the amount of image information you have.
 
In an underexposed image the noise will be very coarse in appearance and the image will be difficult to grade. You really do need to expose the raw nice and bright and because of the way the data is distributed, the brighter you can get away with the better. Never be afraid of exposing linear raw “just a little bit brighter”. It is unlikely to severely bite you if you are over exposed but highly likely to bite you if it is even a fraction under.
 
The 12 bit linear raw from the FS5 is not going to be good in low light or when shooting scenes with large shadow areas unless you can expose bright so that you are bring your levels down in post. If you have to bring any levels up in post the image will not be good.
 
Raw is not a magic bullet that makes everything look great. Just as with S-Log it must be exposed carefully and 12 bit linear raw is particularly unforgiving – but when exposed well it is much better than the internal 8 bit log recordings of the FS5 and can be a fantastic format to work with, especially given the low cost of an FS5.
 
I recommend going back to basics and using a white card to measure the exposure. If monitoring the raw via S-Log3 the white card needs to be exposed around 70%. If using a light meter with the FS5 set the light meter to 640 ISO.
 
If you do want to use a LUT on the Ninja to judge your exposure use a LUT with a -1.5 stop offset. The darker LUT will encourage you to expose the raw brighter and you will find the footage much easier to grade. But it should also be considered that it is also quite normal to add a small amount of selective noise reduction in post production when shooting raw. 

Why hasn’t anyone brought out a super sensitive 4K camera?

Our current video cameras are operating at the limits of current sensor technology. As a result there isn’t much a camera manufacturer can do to improve sensitivity without compromising other aspects of the image quality.
Every sensor is made out of silicon and silicon is around 70% efficient at converting photons of light into electrons of electricity. So the only things you can do to alter the sensitivity is change the pixel size, reduce losses in the colour and low pass filters, use better micro lenses and use various methods to prevent the wires and other electronics on the face of the sensor from obstructing the light. But all of these will only ever make very small changes to the sensor performance as the key limiting factor is the silicon used to make the sensor.
 
This is why even though we have many different sensor manufacturers, if you take a similar sized sensor with a similar pixel count from different manufacturers the performance difference will only ever be small.
 
Better image processing with more advanced noise reduction can help reduce noise which can be used to mimic greater sensitivity. But NR rarely comes without introducing other artefacts such as smear, banding or a loss of subtle details. So there are limits as to how much noise reduction you want to apply. 
 

So, unless there is a new sensor technology breakthrough we are unlikely to see any new camera come out with a large, actual improvement in sensitivity. Also we are unlikely to see a sudden jump in resolution without a sensitivity or dynamic range penalty with a like for like sensor size. This is why Sony’s Venice and the Red cameras are moving to larger sensors as this is the only realistic way to increase resolution without compromising other aspects of the image. It’s why all the current crop of S35mm 4K cameras are all of very similar sensitivity, have similar dynamic range and similar noise levels.

 

A great example of this is the Sony A7s. It is more sensitive than most 4K S35 video cameras simply because it has a larger full frame sensor, so the pixels can be bigger, so each pixel can capture more light. It’s also why cameras with smaller 4K sensors will tend to be less sensitive and in addition have lower dynamic range (because the pixel size determines how many electrons it can store before it overloads).

What does ISO mean with todays cameras?

Once upon a time the meaning of ISO was quite clear. It was a standardised sensitivity rating of the film stock you were using. If you wanted more sensitivity, you used film with a higher ISO rating. But today the meaning of ISO is less clear and we can’t swap our sensor out for more or less sensitive ones. So what does it mean?

ISO is short for International Standards Organisation. And they specify many, many different standards for many different things. For example ISO 3166 is for country codes, ISO 50001 is for energy management.

But in our world of film and TV there are two ISO standards that we have blended into one and we just call it “ISO”.

ISO 5800:2001 is the system used to determine the sensitivity of color negative film found by plotting the density of the film against exposure to light.

ISO 12232:2006 specifies the method for assigning and reporting ISO speed ratings, ISO speed latitude ratings, standard output sensitivity values, and recommended exposure index values, for digital still cameras.

Note a key difference: ISO 5800 is the measurement of the actual sensitivity to light of film.  ISO 12232 is a standardised way to report the speed rating, it is not a direct sensitivity measurement.

Within the digital camera ISO rating system there are 5 different standards that a camera manufacturer can use when obtaining the ISO rating of a camera. The most commonly used method is the Recommended Exposure Index (REI) method, which allows the manufacturer to specify a camera model’s EI or base ISO arbitrarily based on what the manufacturer believes produces a satisfactory image. So it’s not really a measure of the cameras sensitivity, but a rating that if used with a standard external calibrated light meter to set the exposure will give a satisfactory looking image. This is very different to a sensitivity measurement and variations in the opinion as to what is a satisfactory image will vary from person to person. So there is a lot of scope for movement as to how an electronic camera might be rated.

As you cannot change the sensor in a digital camera, you cannot change the cameras efficiency at converting light into electrons (which is largely determined by the materials used and the physical construction). So you cannot change the actual sensitivity of the camera to light. But we have all seen how the ISO number of most digital cameras can normally be increased (and sometimes lowered) from the base ISO number.

Raising and lowering the ISO in an electronic camera is normally done by adjusting the amplification of the signal coming from the sensor, typically referred to as “gain” in the camera. It’s not actually a physical change in the cameras sensitivity to light, it like turning up the volume on a radio to make the music louder. Dual ISO cameras that claim not to add gain when switching between ISO’s typically do this by adjusting the way the signal from the sensor is converted from an analog signal to a digital one. While it is true that this is different to a gain shift it does typically alter the noise levels as to make the picture brighter you need to sample the sensors output lower down and closer to the noise floor. Once again though it is not an actual sensitivity change, it does not alter the sensors sensitivity to light, you are just picking a different part of it’s output range.

Noise and Signal To Noise Ratio.

Most of the noise in the pictures we shoot comes from the sensor and the level of this noise coming from the sensor is largely unchanged no matter what you do (some dual ISO cameras use variations in the way the sensor signal is sampled to shift the noise floor up and down a bit). So the biggest influence on the signal to noise ratio is the amount of light you put on the sensor. More light = More signal. The noise remains the same but the signal is bigger so you get a better signal to noise ratio, up to the point where the sensor overloads.

But what about low light?

To obtain a brighter image when there the light levels are low and the picture coming from the sensor looks dark the signal coming from the sensor is boosted or amplified (gain is added). This amplification makes both the desirable signal bigger but also the noise bigger. If we make the desirable picture 2 times brighter we also make the noise 2 x bigger. As a result the picture will be more noisy and grainy than one where we had enough light to get the brightness we want.

The signal to noise ratio deteriorates because the added amplification means the recording will clip more readily. Something that is close to the recordings clip point may be sent above the clip point by adding gain, so the range you can record reduces while the noise gets bigger. However the optimum exposure is now achieved with less light so the equivalent ISO number is increased. If you were using a light meter you would increase the ISO setting on the light meter to get the correct exposure. But the camera isn’t more sensitive, it’s just that the optimum amount of light for the “best” or “correct” exposure is reduced due to the added amplification.

So with an electronic camera, ISO is a rating that will give you the correct brightness of recording for the amount of light and the amount of gain that you have. This is different to sensitivity. Obviously the two are related, but they are not quite the same thing.

Getting rid of noise:

To combat the inevitable noise increase as you add gain/amplification most modern cameras use electronic noise reduction which is applied more and more aggressively as you increase the gain. At low levels this goes largely un-noticed. But as you start to add more gain and thus and more noise reduction you will start to degrade the image. It may become softer, it may become smeary. You may start to see banding ghosting or other artefacts.

Often as you increase the gain you may only see a very small increase in noise as the noise reduction does a very good job of hiding the noise. But for every bit of noise thats reduced there will be another artefact replacing it.

Technically the signal to noise ratio is improved by the use of noise reduction, but this typically comes at a price and NR can be very problematic if you later want to grade or adjust the footage as often you won’t see the artefacts until after the corrections or adjustments have been made. So be very careful when adding gain. It’s never good to have extra gain.

ISO Confusion Once Again!

I’m going to keep bringing this up until people start to take note and understand that with an electronic camera ISO is NOT sensitivity.

With an electronic camera ISO is a guide to the required shutter speed and aperture needed to get the correct exposure. This is different to sensitivity. The ISO rating of a video camera and it’s sensitivity are closely related, but they are not quite the same thing. Because different gamma curves require different exposures the ISO rating for each gamma curve will be different even though the gain and actual sensitivity of the camera may be exactly the same.

Lets take the  Sony PXW-FS5 as an example.

If you shoot using the standard camera settings you should expose white at 90%, middle grey will be around 42% and skin tones typically around 70%. At 0dB gain the camera the camera will display an ISO equivalent rating of 1000 ISO. So let’s say you are using a light meter. You set it to 1000 ISO and it tells you you need an aperture of f5.6 to get the right exposure.

Now you change to S-Log2. If you do nothing else your white card will now be at around 75% and middle grey will be around 40%. At 0dB gain the camera will show an equivalent ISO of 3200 ISO.

But hang on – The camera is still at 0dB gain, so there is no change in sensitivity. .But the camera is over exposed, S-Log2 is supposed to be exposed with white at 59% and middle grey at 32%.

So we go to our light meter and change the ISO on the light meter from 1000 ISO to 3200 ISO. Because the light meter now “thinks” the camera is more sensitive by almost 2 stops it will tell us to close the aperture by nearly 2 stops. So we go to the camera and stop down to f10 and bingo, the image is exposed correctly.

But here’s the important thing – The camera hasn’t become any more sensitive. We haven’t replaced the sensor with a different, more sensitive one (as you would do with a film camera where you actually change the film stock). We are still at 0dB gain (even though the camera tells us this is the equivalent to a higher ISO).

The only reason that ISO number changes is so that if we were using an external light meter we would get the recommended exposure levels for the gamma curve we are using. In this example closing the aperture increase the highlight range that the camera would be able to cope with and this helps us get that full 14 stop range from the camera, although closing the aperture means less light on the sensor so the pictures end up a little noisier as a result – That is unless you choose to rate the camera at a different ISO by over exposing the log a bit.

ISO is useful, but you need to understand that it isn’t really sensitivity. After all we can’t change the sensors on our video cameras and that would be the only way to truly change the sensitivity. Any “sensitivity” change is really nothing more than a gain or amplification change. Useful but not the same as changing the actual sensitivity. Gain will make a dark picture brighter but it won’t allow you to see something that the sensor can’t detect.

It is much easier to understand dB gain with an electronic camera as it actually tells you exactly what the camera is doing and it is actually my recommendation that people use gain rather than ISO for all of the above reasons.  The use of ISO on electronic cameras is very badly understood, in part because it’s a largely meaningless term because it doesn’t tell us how sensitive the sensor is, how much gain we are using or how much noise we are adding. Give any experienced camera operator a camera and ask them how noisy will it be a 18dB gain and they will have a pretty good idea of what the pictures will look like. Give them the same camera and ask them how noisy will it be at 8000 ISO and they won’t have a clue.

The problem is ISO is trendy and fashionable as that’s what “cinematographers” use. But lets be honest with ourselves – we are using electronic video cameras, whether that’s a Red, Alexa or FS5 so really we should be using the correct terminology for an electronic camera which is gain. It would eliminate an aweful lot of confusion and tell us how much noise and grain our pictures will have. It’s noise and grain will levels will determine how good a clip looks and how much we can grade it, so we need to clearly understand how much gain is being added in camera and dB gian tells us this. ISO does not.

Side Note: Modern film stocks will often have 2 ratings, the ISO or actual measured sensitivity of the film stock plus the EI or Exposure Index which is the recommended setting for the light meter to get the best exposure. In some respects the ISO rating of a video camera is closer to the EI rating of a film stock. Perhaps we should stop calling it ISO and use the term EI instead, this would be me appropriate and signify that it is a reference for best exposure rather than true sensitivity.

UPDATE: A comment on facebook was why not display both ISO and Gain side by side. This is an obvious solution really. Why do camera manufacturers force us to choose either ISO or gain? Why can’t we use a hybrid of the 2? I see no technical reason why cameras can’t show both the gain and ISO at the same time – Problem solved.

Understanding the all important “Signal to Noise Ratio”.

The Signal to Noise ratio is one of the key factors in determining the quality of a video or stills image. A noisy, grainy picture rarely looks as good as a low noise “clean” image. In addition it’s noise in your images will limit how far you can grade them before the picture quality becomes unacceptably poor.

Almost always what you want is the biggest possible signal with the least possible noise. In a video or film camera the signal is the desired image information or in simple terms the picture. While the noise is…. well….. the noise.

Once upon a time, when film cameras were normal for both still photography and film the noise in the pictures came primarily from the grain structure of the film stock. One of the great features of film cameras is that you can actually change that film stock to suit the type of scene that you are shooting. For low light you could use a more sensitive film stock that was actually truly more sensitive to light. However, often a very sensitive film stock will show more noise as the grain of more sensitive film is normally larger.

With video and digital stills cameras however things are quite different. You can’t normally change the sensor in a video camera and it’s the sensor that determines the sensitivity of the camera and it is the sensor that is the source of the majority of the noise.

Modern CMOS video sensors consist of two parts. The light gathering part and the readout part. The size of the pixels on a sensor is one of the key factors in determining the sensitivity and dynamic range. Small pixels are not good at capturing, converting and storing large numbers of photons of light or electrons of electricity.  Bigger pixels are much better at this, so big pixels typically mean better sensitivity and a better dynamic range. Each pixel is unique and as a result every pixel on the sensor will perform slightly differently. The signal stored in the pixels is a tiny analog signal that is easily disturbed by stray electric currents and variations in temperature. As a result of the small variations from pixel to pixel, the stray signals and heat, there is a small variation from moment to moment in the signal that comes off the pixel when it is read out and these variations are what we see as noise.

The analog signal from the pixels is passed to a circuit that converts it to a digital signal. The analog to digital conversion process normally includes some form of noise reduction circuitry to help minimise the noise. By carefully mapping the A to D circuity to the signal range the pixels provide, a sensor manufacturer can find the best combination of noise, dynamic and sensitivity. Once the signal has been converted to a digital one, the noise level, sensitivity and dynamic range is more or less locked in and can’t be changed (Some cameras have the ability to use slightly different A to D conversion ranges to help give improved noise levels at different brightness/dynamic ranges).

The bottom line of all this is that with the vast majority of video cameras the noise level is more or less fixed,  as is the sensitivity as we can’t actually swap out the sensor.

But wait! I hear you say…. My camera allows me to change the ISO or gain. Well yes it probably does and in both cases, ISO or gain, with a digital video or stills camera what you are changing is the cameras internal signal amplification. You are NOT making the camera more sensitive, you are simply turning up the volume. As anyone with any type of sound system will know, when you turn up the gain you get more hiss. This is because gain makes not only the desired signal bigger but also the noise. As a result adding gain or increasing the ISO is rarely a great thing to do.

So normally we want to use a digital camera at it’s native sensitivity wherever possible. The native sensitivity is where no gain is being added by the camera or 0dB. In ISO, well you need to find out what the native ISO is and be aware that different gamma curves will have different base ISO’s (which is why I prefer to use dB gain as 0dB = native sensitivity, least noise, best dynamic range, no matter what gamma curve).

To get the best possible image we then want to make our signal (picture information) as big as possible. As we can’t swap out the sensor, the only way to do that is to put as much light as possible onto the sensor. Obviously we don’t want to overload the sensor or exceed the limitations of the recording system, but generally the more light you get on the sensor, the better your pictures will be.

As the sensors noise output remains more or less constant, the best signal to noise ratio will be gained when you put a lot of light on the sensor. This generates a very large signal, so the signal becomes big compared to the noise and the noise becomes only a small percentage of the overall image.

If we are unable to get enough light onto the sensor to expose it fully then it is often tempting to add some gain to make the picture brighter. 6dB of gain is the equivalent to 1 stop of exposure. Just like f-stops, each time we go up a stop we are doubling. So adding 6db of gain doubles everything. It makes the picture the equivalent of one stop brighter, but it also doubles the noise. Adding 12dB gain multiplies the noise 4 times, adding 18dB multiplies the noise 8 times.

What if instead of adding gain to make the picture brighter we let 4x more light fall on the sensor (2 stops)? Well the image gets brighter by the equivalent of 2 stops but as we are not adding gain this means the desirable signal, the picture is now going to be the equivalent of 12dB bigger than the noise than it was before we added the 2 stops of light. That’s going to give you a much cleaner looking image.

How do you get more light onto the sensor? There are many ways such as using a faster lens with a larger aperture that will let more light through. Or you could try using a slower shutter speed (I often find it beneficial in low light to use a 1/24th or 1/25th shutter if there is not too much motion to cause the image to become excessively blurred). Then of course you can also add light to your scene by lighting it. It’s very rare to find noisy and grainy night scenes in feature films and that’s because the night scenes normally have well lit foregrounds but keep dark backgrounds to maintain the sensation of night time or darkness. High contrast is the key to good looking night scenes, well lit foregrounds or actors with deep, dark shadows and backgrounds.

The desire to have a good signal to noise ratio is one of the reasons why when shooting in log or raw you want to expose as brightly as you can (while still maintaining consistent exposure from shot to shot, scene to scene). It’s a little bit harder with standard gammas as we have things like the knee or highlight roll off to deal with. Plus the need to have a shot that looks correct straight out of the camera. But at the end of the day the best results are almost always gained when the gain is kept to a minimum (but don’t use negative gain as this can effect the dynamic range) and the amount of light falling on the sensor as high as possible.

In the next article I’ll give you an interesting experiment to try on a PMW-F5, F55 or PMW-FS7 that is very revealing  about the way ISO, gain, exposure and noise behaves that will show why exposing log or raw at +1 to +2 stops is so important.

Camera Gain: It doesn’t make the camera more sensitive! (also relevant EI S-Log).

This is something that’s not well understood by many people. It helps explain why the PMW-F3 (and other cameras) EI S-Log function is so useful.

You see, camera gain does not normally actually change the cameras ability to capture photons of light. A CCD or CMOS sensor has a number of photo sites that capture photons of light and convert those photons into electrons or electrical charge. The efficiency of that capture and conversion process is fixed, it’s known as the QE or quantum efficiency. There are a  lot of factors that effect this efficiency, such as the use of micro lenses, whether the sensor is back or front illuminated etc. But all of these factors are physical design factors that do not change when you add extra camera gain. The sensitivity of the sensor itself remains constant, no matter what the camera gain is set to.

Camera gain is applied to the signal coming out of the sensor. It’s a bit like turning up the volume on a stereo amplifier. If you have a quite piece of music, turning up the volume makes it louder, but the original piece of music is still a quiet piece of music. Turning up the volume on your stereo, as well as making the music louder will also make any hiss or background noise in the music louder and it’s exactly the same with a video camera. As you increase the gain, as well as the wanted video signal getting bigger (brighter) all the unwanted noise also get bigger. So adding gain on your video camera doesn’t actually make the camera more sensitive, but it does make what light the camera has captured brighter in the recordings and output, giving the impression that the camera has become more sensitive, however this is at the penalty of increased background noise.

As well as adding gain to the image in the camera, we can also add gain in post production. Traditionally gain has been added in camera because the gain is added before the recording process. In the uncompressed analog days the recording process itself added a lot of noise. In the digital age the process of compressing the image adds noise.  8 bit recordings have quite small number of grey shades. So any gain added in post production amplifies not only the camera signal but also the added recording or compression noise so generally gives an inferior result to adding gain in camera. With an 8 bit signal the stretching of the relatively few grey shades results in banding.

Now, however the use of lower noise sensors and much improved 10 bit or higher recording codecs or even uncompressed recording means that adding gain in post as opposed to in camera is not such a bad thing. In some cases you can use post production noise reduction prior to adding post gain and by leveraging the processing and rendering power of a computer, which will normally be of greater quality than the in camera processing, you can get a cleaner, lower noise output than you would using in camera gain. So before you flick on the gain switch of your camera, if your using only very light 10 bit or higher compression (HDCAM SR, Cineform, ProRes HQ) or uncompressed do consider that you may actually be better waiting until you get into post before you add gain.

Some modern cameras, like Red or the Sony F3 can use something called EI gain. EI gain does not actually add any gain to the recorded signal (or signal output in the case of the F3). Instead it adds gain to the monitor output only and adds metadata to the recording to tell the post facility or conversion software to add gain. This way you see on the monitor what the image should look like when the gain has been added, but the recording itself has no gain added giving the post production team the ability to fine tune exactly how much gain is applied.

What is ISO and how does it compare to gain?

With more and more people using 35mm size sensors, more of the old traditional filming styles and techniques are trickling down from the high end to lower and lower production levels. This is a good thing as it often involves slowing down the pace of the shoot and more time being taken over each shot. One of the key things with film is that you can’t see the actual exposure on a monitor as you can with a video camera. A good video assist system will help, but at the end of the day exposure for film is set by using a light meter to measure the light levels within the scene and then you calculate the optimum exposure using the films ISO rating.
So what exactly is an ISO rating?

Well it is a measure of sensitivity. It tells you how sensitive the film is to light, or in the case of a digital stills or video camera how sensitive the sensor is to light. Every time you double the ISO number you are looking at doubling the sensitivity. So ISO 200 is twice as sensitive as ISO 100. ISO 1600 is twice as sensitive as ISO 800 etc.
Now one very important thing to remember is that ISO is a measure of sensitivity ONLY. It does not tell you how noisy the pictures are or how much grain there is.  So you could have two cameras rated at 800 ISO but one may have a lot more noise than the other. It’s important to remember this because if you are trying, for example, to shoot in low light you may have a choice of two cameras. Both rated with a native sensitivity of 800 ISO but one has twice as much noise as the other. This would mean that you could use gain (or an increased ISO) on the less noisy camera and get greater sensitivity, but with a final picture that is no more noisy than the noisier camera.
How does this relate to video cameras?

Well most video camera don’t have an ISO rating, although if you search online you can often find someone that has worked out an equivalent ISO rating. The EX1 is rated around 360 ISO. The sensitivity of a video camera is adjusted by adding or reducing electronic gain, for example +3db, +9db etc. Every 6db of gain you add, doubles the sensitivity of the camera. So taking an EX1 (360 ISO) if you add 6db of gain you double the sensitivity and you double the ISO to 720 ISO, but you also double the amount of noise.
Now lets compare two cameras. The already mentioned EX1 rated at approx 360 ISO and the PMW-350 rated at approx 600 ISO. As you can see from the numbers the 350 is already almost twice as sensitive as the EX1 at 0db gain. But when you also look at the noise figures for the cameras, EX1 at 54db and 350 at 59db we can see that the 350 has almost half as much noise as the EX1. In practice what this means is that if we add +6db gain to the 350 we add +6db of noise so that brings the noise level 53db, very close to the EX1. So for the same amount of noise the 350 is between 3 and 4 times as sensitive as the EX1.
Does your head hurt yet?
There is also a good correlation between sensitivity and iris setting or f-stop. Each f stop represents a doubling or halving of the amount of light going through the lens. So 1 f-stop is equal to 6db of gain, which is equal to a doubling (or halving) of the ISO. You may also hear another term in film circles and that is the T-stop. A T stop is a measured f-stop, it includes not only the light restriction created by the iris but also any losses in the lens. Each element in a lens will lead to a reduction in light and T stops take this into account.

So there you go. The key thing to take away is that ISO (and even the 0db gain setting on a video camera) tells you nothing about the amount of noise in the image. Ultimately it is the noise in the image that determines how much light you need in order to get a decent picture, not the ISO number.