When is 4k really 4k, Bayer Sensors and resolution.

When is 4k really 4k, Bayer Sensors and resolution.

First lets clarify a couple of term. Resolution can be expressed two ways. It can be expressed as pixel resolution, ie how many individual pixels are there on the sensor. Or as TV lines or TVL/ph, or how many individual lines can I see. If you point a camera at a resolution chart, what you talking about is at what point can I no longer discern one black line from the next. TVL/ph is also the resolution normalised for the picture height, so aspect ratio does not confuse the equation. TVL/ph is a measure of the actual resolution of the camera system.  With video cameras TVL/ph is the normally quoted term, while  pixel resolution or pixel count is often quoted for film replacement cameras. I believe the TVL/ph term to be prefferable as it is a true measure of the visible resolution of the camera.
The term 4k started in film with the use af 4k digital intermediate files for post production and compositing. The exposed film is scanned using a single row scanner that is 4,096 pixels wide. Each line of the film is scanned 3 times, once each through a red, green and blue filter, so each line is made up of three 4K pixel scans, a total of just under 12k per line. Then the next line is scanned in the same manner all the way to the bottom of the frame. For a 35mm 1.33 aspect ratio film frame (4×3) that equates to roughly 4K x 3K. So the end result is that each 35mm film frame is sampled using 3 (RGB) x 4k x 3k, or 36 million samples. That is what 4k originally meant, a 4k x 3k x3 intermediate file.
Putting that into Red One perspective, it has a sensor with 8 Million pixels, so the highest possible sample size would be 8 million samples. Red Epic 13.8 million. But it doesn’t stop there because Red (like the F3) use a Bayer sensor where the pixels have to sample the 3 primary colours. As the human eye is most sensitive to resolution in the middle of the colour spectrum, twice as many of these pixel are used for green compared to red and blue. So you have an array made up of blocks of 4 pixels, BG above GR.
Now all video cameras (at least all correctly designed ones) include a low pass filter in the optical path, right in front of the sensor. This is there to prevent moire that would be created by the fixed pattern of the pixels or samples. To work correctly and completely eliminate moire and aliasing you have to reduce the resolution of the image falling on the sensor below that of the pixel sample rate. You don’t want fine details that the sensor cannot resolve falling on to the sensor, because the missing picture information will create strange patterns called moire and aliasing.
It is impossible to produce an Optical Low Pass Filter that has an instant cut off point and we don’t want any picture detail that cannot be resolved falling on the sensor, so the filter cut-off must start below the sensor resolution. Next we have to consider that a 4k bayer sensor is in effect a 2K horizontal pixel Green sensor combined with a 1K Red and 1K Blue sensor, so where do you put the low pass cut-off? As information from the four pixels in the bayer patter is interpolated, left/right/up/down there is some room to have the low pass cut off above the 2k pixel of the green channel but this can lead to problems when shooting objects that contain lots of primary colours.  If you set the low pass filter to satisfy the Green channel you will get strong aliasing in the R and B channels. If you put it so there would be no aliasing in the R and B channels the image would be very soft indeed. So camera manufacturers will put the low pass cut-off somewhere between the two leading to trade offs in resolution and aliasing. This is why with bayer cameras you often see those little coloured blue and red sparkles around edges in highly saturated parts of the image. It’s aliasing in the R and B channels. This problem is governed by the laws of physics and optics and there is very little that the camera manufacturers can do about it.
In the real world this means that a 4k bayer sensor cannot resolve more than about 1.5k to 1.8k TVL/ph without serious aliasing issues. Compare this with a 3 chip design with separate RGB sensors. With a three 1920×1080 pixel sensors, even with a sharp cut-off  low pass filter to eliminate any aliasing in all the channels you should still get at 1k TVL/ph. That’s one reason why bayer sensors despite being around since the 70s and being cheaper to manufacture than 3 chip designs (with their own issues created by big thick prisms) have struggled to make serious inroads into professional equipment. This is starting to change now as it becomes cheaper to make high quality, high pixel count sensors allowing you to add ever more pixels to get higher resolution, like the F35 with it’s (non bayer) 14.4 million pixels.
This is a simplified look at whats going on with these sensors, but it highlights the fact that 4k does not mean 4k, in fact it doesn’t even mean 2k TVL/ph, the laws of physics prevent that. In reality even the very best 4k pixels bayer sensor should NOT be resolving more than 1.8k TVL/ph. If it is it will have serious aliasing issues.
After all that, those that I have not lost yet are probably thinking: well hang on a minute, what about that film scan, why doesn’t that alias as there is no low pass filter there? Well two things are going on. One is that the dynamic structure of all those particles used to create a film image, which is different from frame to frame reduces the fixed pattern effects of the sampling, which causes the aliasing to be totally different from frame to frame so it is far less noticeable. The other is that those particles are of a finite size so the film itself acts as the low pass filter, because it’s resolution is typically lower than that of the 4k scanner.

JVC GS-TD1 3D camcorder launched at CES.

JVC GS-TD1

JVC GS-TD1 3D Camcorder

Everyone is at it! Hot on the heels of the Sony TD10 comes the JVC TD1. With such similar names and numbers this is going to get confusing fast! Anyway this is another dual stream full 1920×1080 3D camcorder with some impressive specifications. This taken from the JVC press release:

The new GS-TD1 uses two camera lenses and two 3.32 megapixel CMOS sensors – one for each lens – to capture three-dimensional images much the same way that human eyes work.  JVC’s new high-speed imaging engine simultaneously processes the two Full HD images – left and right images at 1920 x 1080i – within that single chip.  The newly developed “LR Independent Format” makes the GS-TD1 the world’s first consumer-oriented camcorder capable of 3D shooting in Full HD.  JVC’s new camcorder offers other shooting modes as well, including the widely used “Side-by-Side Format” for AVCHD (3D) and conventional AVCHD (2D) shooting.

Side by side recording is going to be very usefull for going direct to consumer TV’s or for YouTube uploads so this is a nice feature indeed. It appears to only have a 5x optical zoom in 3D compare to the Sony’s 10x, like the Sony it features image stabilisation. It’s certainly an impressive looking unit. The flip out LCD screen once again uses some kind of parallax barrier for 3D viewing without glasses. The consumer 3D market is certainly growing at a rapid rate and I’m really excited about these new cameras. Sony.. JVC.. Anyone want to lend me one for my 3D shoot in Iceland in March???

The GS-TD1 should be available in March for $1995. More details on the JVC web site: http://newsroom.jvc.com/2011/01/jvc-full-hd-3d-consumer-camcorder-is-world’s-first/

My Product of the Year 2010.


Well we are now in to 2011 so it’s time to look back at 2010 and some of the products that became available. Last year my award went to the excellent Convergent Designs NanoFlash. As with last year there is no real meaning to the award, it’s just an excuse for me to highlight my favourite product from 2010.

So what was new in 2010?  There were some significant announcements of new products like the Sony PMW-F3 and the un named NXCAM but these won’t be available until 2011. Sony did release the PMW-320, 1/2? shoulder mount camcorder to compliment the PMW-350. I was at first a little sceptical about this camera, but it does produce a good image and the price is attractive where you need to have the looks and ergonomics of a shoulder mount camera but don’t need high end 2/3? sensors and lenses. So the 320 gets good points for value and ergonomics, but it’s not a stand out product. Later in the year we saw the release of the PMW-500. This was the logical combination of a high end CCD camera with Sony’s solid state SxS recording system. The PMW-500 is a fantastic camcorder that will be excellent for news and documentary production. I’m sure it will do very well indeed and users will appreciate the light weight and low power consumption. However again for me it isn’t a stand out product, it’s very nice but you have to pay a significant premium for those CCD’s and 50Mb/s recording and really it is a completely logical extension of the Sony XDCAM product family.

Jumping out of the Sony camp there is Panasonics new AF100/AF101 with it’s APS-C sized sensor. Canon and their video enabled DSLR’s showed what could be achieved with a big sensor, however the DSLR’s were, first and foremost, high resolution stills cameras with 12 megapixel (or more) sensors. The video was an afterthought and suffered from various artefacts as a result, but they really had a huge impact on the whole industry, forcing the big guns of the video world to seriously re-think. Not to be left behind Panasonic and Sony had to jump on the big sensor band wagon. The first to market was the Sony NEX-VG10 which is basically a stills camera pretending to be a video camera. It’s not bad and can produce a good image but it’s not really a professional product. The next to market was the Panasonic AF100. This is a serious attempt at producing a low cost, big sensor video camera. The sensor is APS-C sized, so it’s not quite as big as would be found in a 35mm film camera, but the smaller sensor does allow for the use of a very wide range of DSLR lenses and the Depth of Field is pleasing when you use a fast lens. Sadly Panasonic chose to use AVCHD for the codec, so for best results you really want to record using an external high quality recorder. This camera would have been sooo much better if it used AVC-Intra. Despite the codec (and it’s looks) the AF100 was certainly a stand out product and gets added to my shortlist for my award.

On the camcorder front there was of course the Canon XF305. This is a very good camcorder, of that there is no doubt. I’m still a little skeptical of the sensor performance, they look a little noisy too me. However it has certainly raised the bar when it comes to 1/3? sensor performance. The incorporation of a 50 Mb/s 4:2:2 codec in to a compact camcorder is something that Sony EX users have been clamouring for ever since the launch of the EX1. In addition the extra zoom range from the 20x lens is nice to have. The Canon XF305 certainly stands out from the crowd with it’s excellent 50Mb/s codec so it’s definitely in my shortlist.

One product that I really like is the Black Magic HDLink 3D. This clever little box allows you to combine the output of any pair of HDSDi equipped cameras on a 3D rig and gives a huge range of outputs compatible with most off the shelf 3D consumer TV’s and PC monitors. This one product has made 3D monitoring so much cheaper and easier than ever before. What’s more it’s remarkably low cost at around $499 USD. So this too deserves to get shortlisted, but it’s overshadowed by another computer adapter that’s slowly getting quite a following:

The Matrox MXO2 range is a range of input and output adapters for Mac computers. These boxes, depending on the exact model give you HDSDI, HDMI and component inputs and outputs. They will work with a MacBook Pro Laptop connecting via the express card slot or with MacPro work stations. There’s hardware up and down scaling, a range of encoding accelerators and 3D monitoring tools. They have so many applications form providing HDSDI or HDMI monitoring for Avid or FCP to a way to record 10 bit HD on location via a laptop. They support XDCAM, RED, DVCPRO HD, PRORES and DNxHD workflows. An MXO2 could easily become the center point of many a production facility, OB truck or one man band.

For the flexibility, cost effectiveness and affordability the Matrox MXO2 gets my award for product of the year 2010. It has so many uses that it’s impossible to list them all. It’s one of those boxes that you will find useful for so many things and the best bit is that it’s highly affordable.