Princeton University Computer Science Dept.

Computer Science 597c Advanced Topics in Computer Science: Immersive Computer Systems

Fall 1998

General Information:

Description:

The course is a graduate-level reading class.  At least once during the semester, each student will select a research topic related to immersive computer systems.  He/she will read papers from the literature on the topic, identify one or two papers for all members of the class to read, present a survey on the topic in a 30 minute talk during class, and lead a 30 minute discussion during class on current work and future opportunities.

Schedule:

Lectures and Readings:

• People:
• Professors: Tom Funkhouser & JP Singh
• Students: Jiannan Zheng
• Slides:
• Powerpoint (391KB)
• Postscript (2.6MB)
• Selected Reading:
• Draft section from our (not yet submitted) NSF proposal
• Thomas W. Crockett, Parallel Rendering. In Encyclopedia of Computer Science and Technology, Vol. 34, Supp. 19, A. Kent and J. G. Williams, eds., Marcel Dekker, 1996, pp. 335-371. Also available as ICASE Report No. 95-31 (NASA CR-195080), April 1995.
• Discussion Questions:
• What practical approaches should we try for the wall?
• What are the theoretical properties of various partitioning algorithms?
• Can partitioning algorithms from other applications be applied to parallel rendering?
• Related Readings:
• Carl Mueller, "The Sort-First Rendering Architecture for High-Performance Graphics," Computer Graphics, ACM SIGGRAPH Special Issue on 1995 Symposium on Interactive 3-D Graphics, April 1995.
• Carl Mueller, "Hierarchical Graphics Databases in Sort-First," Proceedings of the IEEE Symposium on Parallel rendering, 1997, 49-57
• David Ellsworth, "A New Algorithm for Interactive Graphics on Multicomputers," IEEE Computer Graphics and Applications, Vol 14, No. 4, July 1994, 33-40.
• Scott Whitman, "Dynamic Load Balancing for Parallel Polygon Rendering," IEEE Computer Graphics and Applications, Vol 14, No. 4, July, 1994, 41-48.
• D.R. Roble, "A Load Balanced Parallel Scanline Z-Buffer Algorithm for the iPSC Hypercube," Proc. Pixim 88, Hermes, Paris, France, October, 1988, 177-192.
• Background Readings:
• Thomas W. Crockett, "An Introduction to Parallel Rendering," Parallel Computing, Vol. 23, No. 7, July 1997, pp. 819-843.
• Thomas W. Crockett, "Design Considerations for Parallel Graphics Libraries," Proceedings of the Intel Supercomputer Users Group 1994 Annual North America Users Conference, Intel Supercomputer Users Group, San Diego, June 1994, pp. 3-14. Also available as ICASE Report No. 94-49 (NASA CR-194935), June 1994.
• S. Molnar, M. Cox, D. Ellsworth, H. Fuchs, "A Sorting Classification of Parallel Rendering," IEEE Computer Graphics and Applications, Vol 14, No. 4, July 1994, 23-32.
 

• People:
• Professors: Perry Cook
• Students: Georg Essl
• Slides:
• Selected Reading:
• Berkhout, A. J., D. de Vries, P. Vogel, "Acoustic control by wave field synthesis," J. Acoust. Soc. Am. 93 (5), 1993, pp. 2764-2778. This is on sound-field reconstruction discussing both the recording and the display part (mic and speaker arrays).
• Flanagan, J. L., J. D. Johnston, R. Zahn, G. W. Elko, "Computer-steered microphone arrays for sound transduction in large rooms," J. Acoust. Soc. Am. 78 (5), 1985, pp. 1508-1518, 1985. They talk about beam-steering by microphone arrays.
• Moore, F. R., "A General Model for Spatial Processing of Sounds" Computer Music Journal 7 (3), 1983. Reprinted in Roads, C., "The Music Machine," MIT Press, 1989, pp. 559-568. This is the moving sound sources algorithm we have implemented.
• Discussion Questions:
• Related Readings:
• Boone, M. M., E. N. G. Verheijen, P. F. van Tol, "Spatial Sound-Field Reproduction by Wave-Field Synthesis," J. Audio Eng. Soc. 43 (12), 1995, pp. 1003-1012.
• Casey, M. A., W. G. Gardner, S. Basu, "Vision Steered Beam-Forming and Transaural Rendering for the Artificial Life Interactive Video Environment (ALIVE)," Presented at the 99th AES Convention, New York, October 1995. AES preprint 4052 (B-5).
• Chowning, J. M., "The Simulation of Moving Sound Sources," Presented at the 38th AES Convention, May 1970. AES preprint 726 (M-3).
• Cook, P. R., G. Essl, G. Tzanetakis, D. Trueman, "N>>2: Multi-speaker Display Systems for Virtual Reality and Spatial Audio Projection," To appear in Proc. of the International Conference on Auditory Display (ICAD), Glasgow, 1998.
• Evans, M. J., A. I. Tew, J. A. S. Angus, "Spatial Audio Teleconferencing - Which Way is Better?," Proc. Int. Conf. on Auditory Display (ICAD), Palo Alto, November 1997, pp. 29-37.
• Kendall, G. S., W. L. Martens, S. L. Decker, "Spatial Reverberation: Discussion and Demonstration," In Mathews, M., J. R. Pierce eds., "Current Directions in Computer Music Research,", MIT Press, 1989, pp. 66-87.
• Khoury, S. A, A. Freed, D. Wessel, "Volumetric Modeling of acoustic Fields in CNMAT's Sound Spatialization Theatre," Proc. of the Audio Engineering Society, 1998. Available at http://cnmat.CNMAT.Berkeley.EDU/AcousticVisualization/.
• Leese, M. J., "Ambisonics Surround Sound FAQ," Available at http://www.omg.unb.ca/~mleese/faq_latest.html.
• Malham, D. G., "Primer on basic Ambisonics," Available at http://www.york.ac.uk/inst/mustech/3d_audio/ambis2.htm.
• Pulkki, V., "Virtual Sound Source Positioning Using Vector Base Amplitude Panning," J. Audio Eng. Soc. 45 (6), pp. 456-466.
• "FAQ LD#03: Surround Sound ," Avaible at http://www.tde.lth.se/home/hf/ce/ld/lda/ld03.html.
• Background Reading:
• Begault, D., "3-D Sound. For Virtual Reality and Multimedia," Academic Press, 1994.
• Blauert, J., "Spatial Hearing. The Psychophysics of Human Sound Localization," revised edition, MIT Press, 1997.
• Gardner, W. G., "3-D Audio Using Loudspeakers," Ph.D. thesis. MIT, September, 1997. Chapter 2.
• Gilkey, R. H., T. R. Anderson eds., "Binaural and Spatial Hearing in Real and Virtual Environments," Lawrence Erlbaum Associates, 1997. Chapter 29.
• Wenzel, E. M., "Spatial Sound and Sonification," In  Kramer, G., "Auditory Display," SFI Studies in the Sciences of Complexity, Proc. Vol. XVIII, Addison-Wesley, 1994.
• Unrelated Readings (maybe):
• Yoneyama, M., J.-I. Fujimoto, "The audio spotlight: An Application of nonlinear interaction of sound waves to a new type of loudspeaker design," J. Acoust. Soc. Am. 73 (5), 1983, pp. 1532-1536.

• People:
• Professors: Adam Finkelstein
• Students: Patrick Min, Xiaodong Wen
• Slides:

Click here for a short writeup on some of the issues discussed during the seminar.
• Selected Reading:

(to appear in your mailboxes on Wednesday morning)

Shojiro Nagata, "How to reinforce perception of depth in single two-dimensional pictures", p. 527, in Pictorial Communication in Virtual and Real Environments, Stephen R. Ellis, Taylor and Francis, London 1991

• Discussion Questions:
• Related Readings:
• N.A. Valyus, "Stereoscopy", Focal Press, London, 1966
• Günter Wyszecki and W.S. Stiles, "Color Science, Concepts and Methods, Quantitative Data and Formulae", John Wiley & Sons, 2nd edition, 1982
• Carolina Curz-Neira, Daniel J. Sandin, Thomas A. DeFanti, "Surround-screen projection-based virtual reality: The design and implementation of the cave", SIGGRAPH 93, pp. 135-142
• Matthew Regan and Ronald Post, "Priority Rendering with a Virtual Reality Address Recalculation Pipeline", SIGGRAPH 94, pp. 24-29

• People:
• Professors: Doug Clark
• Students: Yuqun Chen
• Slides:
• Selected Reading:
• Design and Simulation of Opera Lighting and Projection Effects

Julie O'B. Dorsey, Francois X. Sillion, and Donald P. Greenberg

Appears in Proceedings of SIGGRAPH'91, page 41-50

• Efficient Image Generation for Multiprojector and Multisurface Displays
Ramesh Raskar, Matt Cutts, Greg Welch, and Wolfgang Sturzlinger
Appears in Proceedings of 9th Eurographics Workshop on Rendering
June 1998.
• Discussion Questions:
• Related Readings:
• Image Warping For Multiprojector Systems (Slides)

Courtesy of Rajeev Surati, MIT

• Colour Spaces and Monitor Considerations

In 3D Computer Graphics, 2nd Edition, Chapter 14, pp. 409-434

Alan Watt. Addison-Wesley, 1993.

• A Technical Introduction to Digital Video

Charles A. Poynton. John Wiley & Sons, Inc., 1996.

• Optics

Eugene Hecht and Alfred Zajac. Addison-Wesley, 1979.

• Optical System Design

Rudolf Kingslake. Academic Press, Inc., 1983.

• People:
• Professors: Tom Funkhouser
• Students: Rudro Samanta
• Slides:
• Powerpoint (Web-based)
• Powerpoint (200KB)
• Postscript (11.5MB)
• Slides:
• Selected Reading:
• Rudrajit Samanta and Thomas A. Funkhouser,

Dynamic Algorithms for Sorting Primitives Among Screen-Space Tiles in a Parallel Rendering System.
submitted to 1999 SIGGRAPH Symposium on Interactive 3D Graphics.
• Discussion Questions:
• Related Readings:
• Milton Chen, Gordon Stoll, Homan Igehy, Kekoa Proudfoot, and Pat Hanrahan,

Simple Models of the Impact of Overlap in Bucket Rendering,
1998 Eurographics/SIGGRAPH Workshop on Graphics Hardware,
Lisbon, Portugal, 1998, 105-112.
• Michael Cox, Architectural Implications of Hardware-Accelerated Bucket Rendering on the PC,

1997 SIGGRAPH/Eurographics Workshop on Graphics Hardware, Los Angeles, CA, 1997, 25-34.
• Michael Cox, Algorithms for Parallel Rendering,

Ph.D. thesis, Department of Computer Science, Princeton University, May, 1995.
 
11/5: Fall Break

11/12: People Tracking & Eye tracking & Gesture Recognition &
        Wireless Pointing Devices & Sensitive Floor

• People:
• Professors: Perry Cook & Adam Finkelstein
• Students: Jie Chen & Jon Forsythe
• Slides:
• Selected Reading:
  • Pfinder: Real-Time Tracking of the Human Body
    Wren., C. et al, MIT Media Lab
  • Office of the Future: A Unified Approach to Image-based Modeling and Spatially Immersive Displays
    Raskar, R., SIGGRAPH '98
• Discussion Questions:
• Related Readings:
  • Multiperspective Panoramas for Cel Animation
    Wood, D. et al, SIGGRAPH '97
11/19: Parallel Video
• People:
• Professors: JP Singh & Kai Li
• Students: Yefim Shuf & Han Chen
• Slides:
• Selected Reading:
• Creating Full View Panoramic Image Mosaics and Environment Maps
  Richard Szeliski and Heung-Yeung Shum, Microsoft Research
• Discussion Questions:
• Related Readings:
• Virtual Space Teleconferencing using a Sea of Cameras
  Henry Fuchs, et al., UNCC
• The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays
  Ramesh Raskar, et al., UNCC
• Robot Vision
  Berthold Klaus Paul Horn, The MIT Press, 1986
11/16: Thanksgiving break

12/3: Inter-System & Intra-System Communication

• People:
• Professors:
• Students:
• Slides:
• Selected Reading:
• Discussion Questions:
• Related Readings:
12/10: Texture Management
• People:
• Professors: Kai Li
• Students: Han Chen
• Slides:
• Selected Reading:
• Multi-Level Texture Caching for 3D Graphics Hardware
  Michael Cox, Narendra Bhandari, Michael Shantz
  ISCA '25, 1998
• Prefetching in a Texture Cache Architecture
  Homan Igehy, Matthew Eldridge, Kekoa Proudfoot
  '98 EuroGraphics
• Discussion Questions:
• Related Readings:
• The Design and Analysis of a Cache Architecture for Texture Mapping
  Ziyad S. Hakura, Anoop Gupta
  ISCA '24, 1997
• The Clipmap: A Virtual Mipmap
  Christopher C. Tanner, Christopher J. Migdal, Michael T. Jones
  '98 SIGGRAPH
12/17: Design Aesthetics
• People:
• Professors:
• Students:
• Slides:
• Selected Reading:
• Discussion Questions:
• Related Readings:

---

People:

Professors:
• Doug Clark
• Perry Cook
• Adam Finkelstein
• Tom Funkhouser
• Kai Li
• JP Singh
Students:
• Han Chen
• Jie Chen
• Mao Chen
• Yuqun Chen
• Georg Essl
• Jon Forsythe
• Allison Klein
• Patrick Min
• Lena Petrovic
• Emil Praun
• Rudro Samanta
• Yefim Shuf
• George Tzanetakis
• Xiaodong Wen
• Jiannan Zheng