Can a 1 CCD Compete Camcorder with a 3 CCD Camcorder

Can a Single CCD Compete Camcorder with a three CCD Camcorder?

JVC announcement of the GR-HD1 and JY-HD10 low-cost, high-definition camcorder has brought forth an avalanche of controversy about the technology required for the capture and recording of high-quality images. At first questions centered on what was perceived as a far too low MPEG-2 recording data rate. More recently, the issue of the number of CCD chips has come to the fore. This issue, in fact, has been lurking in the background for the last year.

Many of us have been shooting photographs with single CCD cameras. We have found our pictures have excellent color quality even though our cameras use only a single CCD. Moreover, many of us have seen the announcement by Foveon about their X3 technology that enables 35mm film quality images to be captured by a single chip. The Foveon image sensor employs three layers of photo detectors embedded in silicon. The layers are positioned to take advantage of the fact that silicon absorbs different wavelengths of light to different depths, so the top layer records blue, the middle layer records green, and the bottom layer records red. This means that for every pixel location on Foveon, there is a stack of three photo detectors.

Three chip cameras also capture all three colors from each spatial location. Single CCD cameras, however, do not. Single chip cameras employ one of three filter schemes: Bayer (primary color), Complimentary color, and JVC’s new Hybrid Complementary-Primary design. All make use of a 2 by 2 CCD element cluster to obtain luminance and chrominance information as shown in the charts below.

Bayer Mosaic Filter

Complementary Mosaic Filter

Hybrid Complementary-Primary Mosaic Filter

Because of the interest in the new JVC camcorder, I’ll use it as an example of a contemporary single CCD camera.

The new JVC design uses clear, green, cyan, and yellow filters to deliver maximum vertical resolution as appropriate for a progressive scan (480p and 720p) camera. The filter matrix employs two complimentary color filters (Ye and Cy) with one primary (Gr) color filter. Adding two complimentary color (Mg, Ye, and Cy) yields white as shown below.

The following chart shows how luma (L) and chroma (R, G, and B) samples are generated by the JVC’s CCD elements (E).

Generation of Luma (L) and Chroma (RGB) Samples

Luma is obtained from the color mosaic using the following algebra: Y = .29R =+59G+.11B or Y = R+2G+B. Odd row luma samples are calculated as Yodd = W + G. White, of course, equals R + G + B. Thus, the White filter plus the Green filter elements yieldsYodd = R + 2G + B.Even row luma samples are calculated as Yeven = Cy + Ye. Now Cy = G + B and Ye = R + G. Thus the Cyan filter plus the Yellow filter samples yields Yeven = R + 2G + B.

In the chart above, 12 luma samples (H-1 x V) are generated from the 16 (H x V) elements. Using this formula, the JVC chip in 720p mode generates 842,861 luma samples from 659 CCD rows. (The camera’s DSP scales the image up to 720-lines.) The diagram below shows the signal generation process.

JVC CCD Operation

The chroma generation process requires the upper CCD row of each pair of CCD rows to be delayed one video line. The delayed line is then available to be combined with the current line.Red is obtained via R = W - (G + B) where(G + B) = Cy. Using all four filters for greater sensitivity and equal matrix sampling, R = (W+Ye) – (G+Cy). Blue is obtained via B = W - (R + G) where (R + G) = Ye. Again using all four filters, B = (W+Cy) – (G+Ye). Green is obtained via G = W - (B + R) where (B + R) = Mg. There is no Mg filter but we can use B and R. And once again using all four filters for greater sensitivity and equal matrix sampling, G = (G+Cy+Ye) – W.

Note in the chart above, that 9 chroma samples (H-1 x V-1) are generated from the 16 (H x V) elements. Using this formula, the chip in 720p mode generates 841,582 RGB chroma samples. Looked at purely from the number of luma and chroma samples generated, as the chart below shows, there is a very small difference between single- and three-chip camera 720p cameras.

1280x659 CCD(s) / CCD Elements / Luma Samples / RGB Chroma Samples
Single CCD / 843,520 / 843,520 / 843,520
Three CCD / 843,520 / 842,861 / 841,582

Samples Generated by Single and Three CDD Chips

To understand the real difference between camera designs one must look beyond the number of samples generated from the CCD elements. Rather, you need to look at the spatial nature of elements that are combined to create a sample. Doing so will provide a count of the number of pixels generated which determinesthe camera’s horizontal and vertical resolution.

Let’s start by looking at a conventional NTSC CCD that captures 481-rows of information during a time period determined by the camera’s shutter-speed setting. The CCD is then read-out from the top-row to the bottom-row – during 1/60th second. One interlace field is obtained from the upper 480-rows. To capture a frame’s field-mate, once again the CCD captures the image during the shutter exposure time, and then over the next 1/60th second, the lower 480-rows are read-out from the CCD.

Each element from a row is delayed one “line time” and added to the equivalent element in the next lower line. By adding data from two successive rows together, a filter is created that softens horizontal edges thereby reducing “interline flicker.” When signals from two CCD elements are summed, signal strength is increased by 6dB. And appropriately, the filtering process outputs 240-video lines – the number of lines required for an NTSC field.

A price must be paid for the benefits of a sliding-row filter. The filter decreases image vertical resolution by about 25% — to 180-lines per field. Thus, the effective vertical resolution of an interlaced NTSC frame is reduced to about 360-lines. And when in DV mode, the JVC camcorder is measured at 360 vertical lines of resolution.

It’s important to note that when an interlace scanned image is recorded, the sliding filter is used no matter whether the camera uses one or three CCDs. Conversely, when a progressive image is recorded – no matter the number of chips employed – a sliding-row filter is not used to obtain luminance information. (The filter can, however, be activated as when a Panasonic AG-DVX100 is switched to “thick” mode.) When the JVC camera is in 480p mode, it’s vertical resolution is measured at 480 vertical lines.

All single CCD cameras, including the JVC, generate luma samples by means of a sliding filter that moves across pairs of CCD columns. This filter decreases horizontal resolution by about 25%. Therefore, 720 elements (DV mode) yield a video row with 540 pixels; 941 elements (SD mode) yield a video row with 706 pixels; and 1,280 elements (HD mode) yield a video row with 960 pixels. Unfortunately, a second process is at work that causes measured resolution to be less than expected from these pixel counts.

All CCD-based cameras utilize optical and electrical low-pass filters to reduce aliasing that naturally occurs from the discrete sampling of an image by the array of CCD elements. The cut-off frequency is a function of the number of CCD horizontal elements as well as the use of green-element pixel-shift technology. Vertical resolution is not effected by the optical filter because the cut-off frequency is set based on far higher number of horizontal CCD elements.

The mosaic array in front of a single CCD increases the severity of aliasing and so requires the cut-off frequency be lowered, thereby resulting in a loss of measured horizontal luminance resolution. The JVC camera has an anti-aliasing filter that reduces fine detail – and only fine detail – by about 25% for both 480p and 720p scanned images. The cut-off frequency for the anti-aliasing filter is too high to reduce detail for the relatively lower resolution DV capture.

CCD Rows / Vertical Pixels / Measured Number of Vertical Lines / CCD Columns / Horizontal Pixels / Measured Number of Horizontal Lines
480i Mode / 480 / 360 / 360 / 720 / 540 / 540
480p Mode / 480 / 480 / 480 / 940 / 706 / 525
720p Mode / 659 / 659 / 650 / 1280 / 960 / 700

Captured Mode and Measured Resolution

The Table above shows vertical and horizontal resolution measures for the JVC camcorder. As you can see, the measured SD and HD horizontal resolution values reflect two 25% reductions in fine detail.

Ignoring the effects of the anti-aliasing filter, how much greater HD resolution would be available if three CCDs were used rather a single CCD? There are two ways to answer this. At the superficial level, because a sliding filter would not be used, the potential horizontal resolution would increase – in 720p mode – from 960 pixels to 1,280 pixels. However, that is a measure of luminance performance. Most concerns about single CCD cameras relate to their expected poor chroma performance.

Let’s look at a simple way to compare three chip and single chip cameras. What’s the ratio of chrominance to luminance pixels for a three CCD camera? The chroma/luma ratio is 1:1, or simply 1.00.

The JVC chip provides a total 632,640 luma pixels (960 pixels by 659 pixels). Each RGB sample is obtained from information from two CCD columns using a “sliding 2 sample window.” Thus, horizontal chroma resolution is also decreased by 25% from 1,280 elements to about 960 pixels. A “sliding 2 sample window” is also used in the vertical direction. Thus, vertical chroma resolution is decreased by 25% from 659 samples to about 494 RGB pixels. Thus, total RGB chroma “resolution” is 474,240 pixels.

The ratio of chroma pixels to luma pixels is 474,240 632,640 = .75. Thus, the JVC chip’s chroma/luma ratio is lower than that of a three CCD camcorder. However, chroma detail must be reduced before it is recorded as color difference components. The reduction required is the same for DV (4:1:1) and MPEG-2 (4:2:0). And, this reduction is required for both 1 and 3 CCD cameras.

Prior to recording, the RGB chroma information undergoes two processes. The Red, Green, and Blue samples are combined (.29R =+59G+.11B) to generate an alternate luma samples, Y´. These luma samples are then mathematically combined with the Red and Blue samples to create two color difference components: R-Y´ and B-Y´.

At the same time, for both DV and MPEG-2 compression, the chrominance detail is reduced by one-quarter. Therefore, with DV’s 4:1:1 sampling structure, R-Y´ and B-Y´ color samples for every fourth luminance pixel on every line are recorded. MPEG-2 Main Profile, with its 4:2:0 sampling structure, records R-Y´ and B-Y´ color samples for every other luminance pixel on every other line. Both sampling spaces represent chroma resolution reduction by a factor of four – attenuating the chroma resolution advantage of a three CCD camera.

So, are three imaging chips necessary for high quality video? I think it’s fair to say that, at present, cameras with three CCDs offer image quality benefits. Benefits that could, however, be equalized by a single CCD with enough elements to support oversampling. Oversampling can eliminate the negative effects of filtering performed prior to compression or encoding. Currently, very high resolution chips have problems with low light sensitivity and low light latitude. Nevertheless, such CCD chips are already in use within consumer camcorders. Sony, for example, currently offers camcorders with a 2.11 megapixel CCD.

I believe technology advances will enable single CCD video cameras to become the norm. Not simply for low cost HD camcorders. But, because there are limitations tocameras that employ three CCDs. Three chips and an optical-prism add bulk and cost. And, theprism limits the maximum F-stop of the lens. Moreover, where video is shot rather than film, it’s difficult to shoot with a desirable shallow-focus. A single, large (35mm) CCD would solve this problem.

Therefore, whether future CCD chips are large or small, technology advances will force us to stop counting CCDs in our efforts to prejudge camera quality.