What does the retinex theory say?

Abstract

Sensations of color show a strong correlation with reflectance, even though the amount of visible light reaching the eye depends on the product of reflectance and illumination. The visual system must achieve this remarkable result by a scheme that does not measure flux. Such a scheme is described as the basis of retinex theory. This theory assumes that there are three independent cone systems, each starting with a set of receptors peaking, respectively, in the long-, middle-, and short-wavelength regions of the visible spectrum. Each system forms a separate image of the world in terms of lightness that shows a strong correlation with reflectance within its particular band of wavelengths. These images are not mixed, but rather are compared to generate color sensations. The problem then becomes how the lightness of areas in these separate images can be independent of flux. This article describes the mathematics of a lightness scheme that generates lightness numbers, the biologic correlate of reflectance, independent of the flux from objects

© 1971 Optical Society of America

Full Article  |  PDF Article


More Like This

References

You do not have subscription access to this journal. Citation lists with outbound citation links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Figures (10)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

The experiment addresses questions like "Does color inhere in the world, or in the eye?" It is a re-creation of Edwin Land's retinex theory experiment.

What It Shows

Color is not actually a property of light or of objects that reflect light; it is a sensation that arises in the brain. Unlike a spectro-photometer, which cannot categorize the color of objects, the eye has evolved to see the world in unchanging colors, regardless of unpredicatable illumination. Edwin Land dramatically demonstrated the phenomenon with his "Color Mondrian" experiment and posited a retina/cortex system (retinex) explanation.1 The present demonstration is a simplified re-creation of his experiment.

How It Works

Three projectors2 with band-pass color filters3 are set up to illuminate a 2'×3' poster with red, green, and blue light. Three independent brightness controls4 adjust the light intensities so that illumination can be mixed in any ratio. The poster is a collage of different colors of paper.5

What does the retinex theory say?
What does the retinex theory say?

What does the retinex theory say?

Before performing the experiment on the collage, it might be instructive to first define what it means when an object appears "white" in terms of what wavelengths of light are reflected. To that end, one would start with a different poster that has white, gray, and black paper on it (in addition to red, green, and blue). A telescopic photometer6 is used to measure the amount of light reflected off the piece of white paper.

What does the retinex theory say?
What does the retinex theory say?

Generally speaking, when we perceive an object as being white, we reason that the object must be reflecting all parts of the visible spectrum with equal intensities. Since red, green, and blue provide a broad sampling of the visible spectrum, one would think that if the object reflects equal intensities of red, green, and blue light, it will appear white. To show that that is indeed the case, illuminate the poster with just blue light. With the photometer, measure and note the intensity of blue light reflected off the white sheet of paper. Turn off the blue light and turn on the green. Adjust the brightness of the green projector so that the photometer indicates the same intensity as was measured with the blue. Turn off the green and turn on the red. Again, adjust the brightness of the red projector so that the photometer indicates the same intensity as was measured with the blue. Now turn on all three projectors — the white paper will appear to be truly white and the other colors will look vibrant and realistic. Having "defined" white empirically in this manner, we can now move on to experiment with the collage.

Pick any swatch of color on the collage, say yellow, and aim the photometer at it. Turn on the blue projector and note the amount of blue light reflected by the yellow paper. Turn off the blue and turn on the green. Adjust the brightness of the green projector so that the photometer indicates the same intensity as was measured with the blue. Turn off the green and turn on the red. Again, adjust the brightness of the red projector so that the photometer indicates the same intensity as was measured with the blue. Now turn on all three projectors. Amazingly enough, the yellow looks quite natural, as do the rest of the color swatches. The spectro-photometer has read equal intensities of reflected red, green, and blue light off the paper and, if queried, would say that the paper is white. After all, that's how we "defined" white. Thus, the spectro-photometer is not capable of categorizing the colors of objects. On the other hand, we can determine without any trouble that the color of the paper is yellow. The eye is our photometer and we are not fooled because it is working in concert with the brain.

One can repeat this experiment for any of the other colors with similar results. It turns out that the yellow, green, and blue swatches work best in that the perceived color looks very much like the color you see when viewing in daylight. Magenta is the worst in the sense that it does not look very much like magenta. It is of course subjective, but more experimentation is in order to explain why.

Setting It Up

The three slide projectors sit on a dedicated cart. A camera tripod, positioned next to the projectors, holds the photometer. The poster sits on an easel situated about 2 meters in front of the projectors.

All the room lights need to be off.

Comments

Although not as sophisticated as Land's original experiment, this re-creation works remarkably well. One drawback is that the Pentax Spotmeter has no output aside from its analog meter, which must be viewed through the eyepiece. It is worth investigating alternatives, or possibly adapting a video camera to the eyepiece so that the audience can view the photometer readings. Better yet would be a photodetector/spectrometer combination enabling one to see the reflection intensities across the entire visible wavelength spectrum. One could then compare and contrast these spectra with what one perceives. For those interested in seeing the original, the Harvard Collection of Historical Scientific Instruments houses many of Land's experimental materials, including equipment and sketches that Land used to develop Retinex theory.

Notes

1 Edwin Land, "The Retinex Theory of Color Vision," Scientific American 236(6), 108-128, (December, 1977).

2 Kodak Ektagraphic III slide projector

3 Kodak Wratten 2 tri-color filters #29 (red), #61 (green), and #47 (blue). These are available from Kodak Cinema & Television (800) 621-3456. The website is motion.kodak.com Spectral transmission graphs are available.

4 Lutron® 600 W rotary dimmers mounted in an electrical box.

5 Selected colors from HUE SET (37 colors) from Coloraid.com. It is a set of calibrated saturated colors (plus white, gray, and black) on paper having a matte finish to minimize specular reflection. Their website has useful information. (Land used these papers.)

6 Pentax Spotmeter V: With a 1 degree angle of view, it is possible to take accurate reflection measurements of specific areas on the poster (an area about the size of a quarter), one wave band at a time. Meter measuring range is 1 - 19 EV.

A meter/filter calibration was performed by measuring the intensity of reflected light off the white matte paper illuminated by the mid-day sun (a source of "white" light). Separate measurements were taken through the red, green, and blue filters. It was found that the reading through the green filter was 2/3 EV higher than the blue, and the reading through the red filter was 2 EV higher than the blue. These "calibration" numbers are used to adjust the measurements in the collage experiment. For example, whatever the level of intensity of blue light reflected off some color is, the green projector will be adjusted so that the reflected light intensity is 2/3 EV higher than the blue reading, and the red projector will be adjusted so that the reflected light intensity is 2 EV higher than the blue reading. One can verify that these "corrections" work properly by applying them to reflections off white paper; the white paper looks pure white when illuminated by the three projectors but does not w/o the corrections.

How does the trichromatic theory explain color vision?

Trichromatic theory indicates that we can receive 3 types of colors (red, green, and blue) and that the cones vary the ratio of neural activity (Like a projection T.V.). The ratio of each color to the other then determines the exact color that we see.

What is retinex image enhancement?

Retinex is basically a concept of capturing an image in such a way in which a human being perceives it after looking at an object at the place with the help of their retina (Human Eye) and cortex (Mind). On the basis of Retinex theory, we can say an image as a product of illumination and reflectance from the object.

What is color constancy in psychology?

Color constancy refers to our ability to perceive colors as relatively constant over varying illuminations (i.e. light sources). For example, a red apple will still look red on a sunny day or cloudy day – or in a grocery store or a home.

How color information is encoded in the retina?

Color processing begins with the absorption of light by cone photoreceptors, and progresses through a series of hierarchical stages: Retinal signals carrying color information are transmitted through the lateral geniculate nucleus of the thalamus (LGN) up to the primary visual cortex (V1).