The light field, first described in Arun Gershun's classic 1936 paper of the same name, is defined as radiance as a function of position and direction in regions of space free of occluders. In free space, the light field is a 4D function - scalar or vector depending on the exact definition employed. Light fields were introduced into computer graphics in 1996 by Marc Levoy and Pat Hanrahan. Their proposed application was image-based-rendering - computing new views of a scene from pre-existing views without the need for scene geometry. (A workshop on image-based modeling and rendering was held at Stanford in 1998.)
 |
 |
 |
 |
 |
| (a) | (b) | (c) | (d) | (e) |
 |
 |
 |
 |
 |
| (f) | (g) | (h) | (i) | (j) |
Since 1996, research on light fields has followed a number of lines. On the theoretical side, researchers have developed spatial and frequency domain analyses of light field sampling and have proposed several new parameterizations of the light field, including surface light fields and unstructured Lumigraphs. On the practical side, researchers have experimented with literally dozens of ways to capture light fields, ranging from camera arrays to kaleidoscopes, as well as several ways to display them, such as an array of video projectors aimed at a lenticular sheet. Researchers have also explored the relationship between light fields and other sampled representations of light transport, such as incident light fields and reflectance fields. At Stanford, we have focused on the boundary between light fields, photography, and high-performance imaging, an area we sometimes call computational photography. (A workshop on this theme was held at MIT in May of 2005.) However, computational photography has grown to become broader than light fields, and our research also touches on other aspects of light fields, such as interactive animation of light fields and computing shape from light fields.
The images above depict some of the methods we have used in our laboratory for creating light fields:
(a) an image from our SIGGRAPH 1996 paper, showing an array of renderings of a 3D computer model of a buddha statuette (at top) and the transpose of the light field (at bottom). (b) The Stanford Spherical Gantry, a multi-purpose 4-degree of freedom motorized gantry we built for capturing light fields and bidirectional reflectance distribution functions (BRDFs) of small stationary objects. (c) An array of 128 synchronized CMOS video cameras we built as part of the Stanford Multi-Camera Array project. (d) PhD student Gaurav Garg rides in a pickup truck with a sideways-looking video camera, which we used to construct multi-perspective panoramas of urban landscapes in the Stanford CityBlock project. (e) An array of 16 planar mirrors, into which we aimed a high-resolution camera and projector to produce 16 virtual cameras and projectors for our paper on synthetic aperture confocal imaging. (f) An array of curved mirrorlets, created by machining and chrome-plating an aluminum block. Arrays like this are an alternative to aiming a camera into an array of microlenses. (g) PhD student Ren Ng holds a medium format SLR camera into which he has inserted a microlens array between the sensor and main lens. The camera captures light fields instead of photographs. Here are papers describing the camera and its theory of operation. (h) A photo-resister, which we used in conjunction with a video projector to capture slices of a light field using a technique called dual photography. (i) By inserting a microlens array (circled in red) into a standard microscope, we create a light field microscope (LFM). From its images we can produce perspective flybys, focal stacks, and volume datasets at a single instant in time. Here is a paper describing the idea. (j) We sometimes create light fields synthetically. This Venn diagram shows a taxonomy of the kinds of apertures that can occur in light fields, under a formulation we have devised of general linear cameras with finite (i.e. non-pinhole) apertures.
People:
- Andrew Adams <
This email address is being protected from spambots. You need JavaScript enabled to view it. > - Billy Chen <
This email address is being protected from spambots. You need JavaScript enabled to view it. > - Gaurav Garg <
This email address is being protected from spambots. You need JavaScript enabled to view it. > - Pat Hanrahan <
This email address is being protected from spambots. You need JavaScript enabled to view it. > - Mark Horowitz <
This email address is being protected from spambots. You need JavaScript enabled to view it. > - Marc Levoy
- Eino-Ville (Eddy) Talvala <
This email address is being protected from spambots. You need JavaScript enabled to view it. > - Ren Ng <
This email address is being protected from spambots. You need JavaScript enabled to view it. > - Pradeep Sen < psen at graphics dot stanford dot edu >
- Vaibhav Vaish <
This email address is being protected from spambots. You need JavaScript enabled to view it. > - Zhengyun Zhang
- See also the people working on the Stanford Multi-Camera Array, Light Field Microscope, and CityBlock projects
Emeritus:
- Cindy Chen <
This email address is being protected from spambots. You need JavaScript enabled to view it. > - Apostolos Lerios <
This email address is being protected from spambots. You need JavaScript enabled to view it. > - Lucas Pereira <
This email address is being protected from spambots. You need JavaScript enabled to view it. > - Li-Yi Wei <
This email address is being protected from spambots. You need JavaScript enabled to view it. > - Benjamin Zhu <
This email address is being protected from spambots. You need JavaScript enabled to view it. >
Source: Stanford