Appearance Models in Computer Graphics and Vision
COMS 6998-03, Fall 2002,
Prof. Ravi Ramamoorthi Wednesday, 6:40-8:30, 833 Mudd
Overview
Artists and scientists have long been fascinated by
understanding and modeling the appearance of everyday materials,
ranging from human faces and clothing to natural materials like
leaves, sand, and the sky. Within computer graphics, creating
realistic images requires simulating and modeling many different
materials. Within computer vision, understanding the world around us
requires an understanding of the nature of effects related to
illumination, reflectance and texture. In this course, we consider
the computational aspects of appearance measurement, modeling,
simulation, and analysis. Topics include reflectance models,
acquisition of material models from real scenes, image-based modeling
and rendering methods, interactive rendering with complex appearance
models, and analysis techniques including low-dimensional lighting
models, factored representations and signal-processing.
Below are some example images and computer renderings corresponding to
the types of appearance we will be discussing.
Prerequisites
This is an advanced course concentrating on current research topics in
computer graphics and vision. It is targetted towards students with a
knowledge of and interest in computer graphics
and/or computer vision (at the level of 4160 and/or 4731)
Course Format and Requirements
The course will consist of lectures on the relevant topics by the instructor,
student presentations of papers covering current research in the area, and
student projects. A syllabus/schedule is noted below.
The grading will be 30% for paper presentations,
60% for the project, and 10% for class participation. A project is
not required for students taking the course pass/fail. Auditors, who
simply want to sit in on the course are also welcome; however, we prefer if
you sign up for the course pass/fail instead [this just involves doing one
or two paper presentations, depending on the number of students in the course].
Students taking the course for a letter grade are required to do a
project [this may be in groups of 2-3], give a presentation in class
regarding their results, and also submit a final written report. Wide
flexibility is available with respect to project topics, provided they
relate to the subject matter of the course. Some ideas are listed
below. You can also implement an algorithm from any of
the papers in the reading material. The best projects will go beyond
the published work in some way, such as trying out an alternative or
better approach or trying to develop some variant or more general
version of the technique.
As a potentially easier alternative to the project, we will also
accept a well-written summary or tutorial, covering 3 or 4 papers.
The best summaries will point out links between the papers not noticed
by the original authors and suggest improvements or directions for
future research. However, this option is recommended only as a last
resort and will generally receive a lower score; we prefer that you do
a good project (which may involve understanding a few papers in any case).
Topics
Topics to be covered include
- The BRDF and reflection models
- Measurement of material properties and inverse rendering
- More complex material models (BTF and BSSRDF)
- Image-based modeling and Rendering
- Low-dimensional lighting models in vision
- Signal-processing framework for reflection
- Real-time rendering with realistic lighting and materials
Resources
- Books: There are no books specifically required for this course.
Chapters of books may be referenced as reading material and
will generally be handed out in class.
- Papers: I have downloaded many of these locally. Note that
SIGGRAPH papers are available directly from the ACM digital library.
- This course builds on a similar course taught at Stanford
and Berkeley. There are some useful links off
those pages.
- Project ideas
Outline
The tentative course schedule is as follows. This will likely change as the
semester progresses, and the number of paper presentations may be reduced if
the number of students is small.
Sep. 4:
- Lectures:
Introduction and Overview ,
BRDF and Radiometry
- Assignment: Sign up for paper presentations for next week.
- Reading: Books, notes and links
- M.F. Cohen and J.R. Wallace, 1993. Radiosity and Realistic Image
Synthesis, Chapter 2 by Pat Hanrahan. Rendering Concepts
[handed out in class; not available online]
- H. Jensen, 2001. Realistic Image Synthesis using Photon Mapping,
Chapter 2: Fundamentals of Global Illumination
[handed out in class; not available online]
- Scribed lecture notes on overview of appearance models and BRDFs
from Stanford. Overview and BRDFs
- BRDF viewer program
bv by Szymon Rusinkiewicz
Required papers
- M. Oren and S. Nayar, Generalization of
Lambert's Reflectance Model and also
(larger unzipped version)
SIGGRAPH 94, pp 239-246
- K. Torrance and E. Sparrow, 1967. Theory for Off-Specular
Reflection from Roughened Surfaces. Journal of the
Optical Society of America, volume 57, number 9, pp
1105-1114.
- J.J. Koenderink and A. J. van Doorn. Phenomenological Description of
bidirectional surface reflection Journal of the
Optical Society of America, volume 15, number 11, pp 2903-2912
- F.E. Nicodemus, J.C. Richmond, J. J. Hsia, I. W. Ginsberg and
T. Limperis, 1977. Geometric Considerations and
Nomenclature for Reflectance. NBS Monograph 160.
National Bureau of Standards [Optional: Handed out
in class]
Optional papers: anisotropic BRDF models
- J. Kajiya. Anisotropic Reflection Models. SIGGRAPH 85, pp 15-21
- J. Kajiya and T. Kay. Rendering Fur with Three Dimensional
Textures. SIGGRAPH 89, pp 271-280
- P. Poulin and A. Fournier. A Model for Anisotropic Reflection,
SIGGRAPH 90, pp 273-282
Sep. 11:
-
Lecture: Brief overview of different reflection models
- Student presentation of papers (20 min each):
- Oren Nayar. Generalization of Lambert's Reflectance Model
SIGGRAPH 94. Presented by Aner
- Torrance Sparrow. Theory for Off-Specular Reflection. JOSA 1967.
Presented by Kshitiz
- Koenderink van Doorn. Phenomenological Description... JOSA 2000.
- Assignment: Sign up for paper presentations.
- Reading:
Sep. 18:
-
Lecture: Overview of measurement, acquiring material models
using inverse rendering
- Student presentations of further papers on BRDF models
- Lafortune BRDF model, SIGGRAPH 97. Presented by Genevieve
- Virtual gonioreflectometry (Westin Arvo Torrance, SIGGRAPH 92).
Presented by Prasanna
- Assignment: e-mail brief description of proposed project(s).
Schedule meeting time to discuss projects on Friday/Monday
- Reading:
- Scribed lecture notes on measurement part 1 .
- G. Ward. Measuring and modeling
anisotropic reflection SIGGRAPH 92, pp 265-272.
- S. Marschner, S. Westin, E. Lafortune, K. Torrance and
D. Greenberg.
Image-based BRDF Measurement Including Human Skin
Eurographics Workshop on Rendering 2000, pp 139-152.
- Y. Sato, M. Wheeler and K. Ikeuchi.
Object shape and reflectance
modeling from observation SIGGRAPH 97, pp 379-387.
- Y. Yu, P. Debevec, J. Malik and T. Hawkins.
Inverse global illumination:
recovering reflectance models of real scenes from
photographs SIGGRAPH 99, pp 215-224.
- S. Boivin and A. Gagalowicz.
Image-based rendering of diffuse, specular and glossy
surfaces from a single image SIGGRAPH 01, pp 107-116.
- Optional:
Acquiring material models using inverse rendering.
SIGGRAPH 2002 course notes
Sep. 25:
- Student presentations of papers on inverse rendering:
- Marschner. Image-based BRDF measurement. Presented by Vlad
- Sato. Object shape and reflectance modeling. Presented by Mark
- Yu. Inverse global illumination. Presented by Jianhua
- Boivin. IBR from a single image. Presented by Alejandro
- Assignment: 1-2 page proposed project descriptions due
Oct 2:
Oct. 9:
Oct. 16:
- Student presentations of further papers on IBMR
- M. Levoy and P. Hanrahan Light Field
Rendering . SIGGRAPH 96, pp 31-42.
Presented by Rahul
- S. Gortler, R. Grzeszczuk, R. Szeliski, M. Cohen The Lumigraph . SIGGRAPH 96, pp 43-54.
Presented by Vlad
- D. Wood et al.
Surface Light Fields for 3D Photography . SIGGRAPH 00, pp 287-296.
Not Presented
- P. Debevec et al.
Acquiring the reflectance field of a human face . SIGGRAPH 00, pp 145-156.
Not presented
- M. Koudelka, S. Magda, P. Belhumeur and D. Kriegman
Image-based Modeling and Rendering of
Surfaces with Arbitrary BRDFs . CVPR 01, pp 568-575
Presented by Srinivas
- D. Zongker, D. Werner, B. Curless and D. Salesin
Environment Matting and Compositing
. SIGGRAPH 99, pp 205-214.
Presented by Jianhua
Oct. 23:
Oct. 30:
- Student presentations of papers on low-dimensional lighting
models
Nov. 6:
- Student presentations of papers on signal-processing
Nov. 13:
- Student presentations of papers on factored representations
for rendering
Nov. 20:
Nov 27:
Dec 4:
- Project Presentations
- Final reports (website with documentation required/preferred)
due December 8
Ravi Ramamoorthi
Last modified: Wed Nov 20 20:57:01 Pacific Standard Time 2002