article

A photon accurate model of the human eye

Author:

Michael F. DeeringAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 24, Issue 3

Pages 649 - 658

https://doi.org/10.1145/1073204.1073243

Published: 01 July 2005 Publication History

Abstract

A photon accurate model of individual cones in the human eye perceiving images on digital display devices is presented. Playback of streams of pixel video data is modeled as individual photon emission events from within the physical substructure of each display pixel. The thus generated electromagnetic wavefronts are refracted through a four surface model of the human cornea and lens, and diffracted at the pupil. The position, size, shape, and orientation of each of the five million photoreceptor cones in the retina are individually modeled by a new synthetic retina model. Photon absorption events map the collapsing wavefront to photon detection events in a particular cone, resulting in images of the photon counts in the retinal cone array. The custom rendering systems used to generate sequences of these images takes a number of optical and physical properties of the image formation into account, including wavelength dependent absorption in the tissues of the eye, and the motion blur caused by slight movement of the eye during a frame of viewing. The creation of this new model is part of a larger framework for understanding how changes to computer graphics rendering algorithms and changes in image display devices are related to artifacts visible to human viewers.

Supplementary Material

MP4 File (pps031.mp4)

Download
41.79 MB

References

[1]

Ahumada, A, and Poirson, A. 1987. Cone Sampling Array Models. J. Opt. Soc. Am. A 4, 8, 1493-1502.

[2]

Atchison, A., and Smith, G. 2000. Optics of the Human Eye. Butterworth-Heinemann.

[3]

Barsky, B. 2004. Vision-Realistic Rendering: Simulation of the Scanned Foveal Image from Wavefront Data of Human Subjects. First Symposium on Applied Perception in Graphics and Visualization, 73--81.

Digital Library

[4]

Barten, P. 1999. Contrast Sensitivity of the Human Eye and Its Effects on Image Quality. SPIE.

[5]

Van Den Berg, T., and Tan, K. 1994. Light Transmittance of the Human Cornea from 320 to 700 nm for Different Ages. Vision Research, 34, 1453--1456.

[6]

Cook, R. 1986. Stochastic Sampling in Computer Graphics. ACM Transactions on Graphics, 5, 1, 51--72.

Digital Library

[7]

Cook, R. Carpenter, L, and Catmull, E. 1987. The Reyes Image Rendering Architecture. In Computer Graphics (Proceedings of ACM SIGGRAPH 1987), 21, 4 ACM, 95--102.

Digital Library

[8]

Curcio, C., Sloan, K., Kalina, R., and Hendrickson, A. 1990. Human Photoreceptor Topography. J. Comparative Neurology 292, 497--523.

[9]

Deering, M. 1998. The Limits of Human Vision, in 2nd International Immersive Projection Technology Workshop.

[10]

Dobkin, D., Eppstein, D., and Mitchell, D. 1996. Computing the Discrepancy with Applications to Supersampling Patterns. ACM Transactions on Graphics, 15, 4, 354--376.

Digital Library

[11]

Escudero-Sanz, I., and Navarro, R. 1999. Off-Axis Aberrations of a Wide-Angle Schematic Eye Model. J. Opt. Soc. Am. A, 16, 1881--1891.

[12]

Geisler, W. 1989. Sequential Ideal-Observer Analysis of Visual Discriminations. Psychological Review, 96, 2, 267--314.

[13]

Glassner, A. 1995. Principles of Digital Image Synthesis. Morgan Kaufmann.

Digital Library

[14]

Haslwanter, T. 1995. Mathematics of Three-Dimensional Eye Rotations. Vision Research, 35, 1727--1739.

[15]

Halstead, A., Barsky, B., Klein, S., and Mandell, R. 1996. Reconstructing Curved Surfaces from Specular Reflection Patterns Using Spline Surface Fitting of Normals. In Proceedings of ACM SIGGRAPH 1996 23, Annual Conference Series, 335--342.

Digital Library

[16]

Hennig, M, Funke, K., and Wörögtter, F. 2002. The Influence of Different Retinal Subcircuits on the Non-linearity of Ganglion Cell Behavior. The Journal of Neuroscience, 22, 19, 8726--8738.

[17]

Lakshminarayanan, Raghuram, A., and V, Enoch, J. 2003. The Stiles-Crawford Effects. Optical Society of America.

[18]

Mahajan, V. 2001. Optical Imaging and Aberrations: Part II Wave Diffraction Optics. SPIE.

[19]

Martinez-Conde, S, Macknik, S. and Hubel, D. 2004. The Role of Fixational Eye Movements in Visual Perception. Nature Reviews: Neuroscience, 5. March.

[20]

Oyster, C. 1999. The Human Eye: Structure and Function. Sinauer.

[21]

Rodieck, R. 1998. The First Steps in Seeing. Sinauer.

[22]

Roorda, A., Metha, A., Lennie, P, and Williams, D. 2001. Packing Arrangements of the Three Cone Classes in Primate Retina. Vision Research, 41, 1291-1306.

[23]

Roorda, A., and Williams, D. 1999. The Arrangement of the Three Cone Classes in the Living Human Eye. Nature, 397, 520--522.

[24]

Steinman, R. 1996. Moveo Ergo Video: Natural Retinal Image Motion and its Effect on Vision. In Exploratory Vision: The Active Eye. M. Landy et al., Ed., Springer Verlag, 3-49.

Digital Library

[25]

Stockman, A., Sharpe, L., and Fach, C. 1999. The spectral sensitivity of the human short-wavelength cones. Vision Research, 40, 1711--1737.

[26]

Stockman, A., and Sharpe. 2000. Spectral sensitivities of the middle- and long-wavelength sensitive cones derived from measurements in observers of known genotype. Vision Research, 39, 2901--2927.

[27]

Stockman, A., and Sharpe, L. 2004. Colour & Vision Database. http:// cvrl.ucl.ac.uk/.

[28]

Thibos, L. 2000. Formulation and Sampling of the Retinal Image. In Seeing, K. De Valois, Ed., Academic Press, 1--54.

[29]

Tyler, C. 1997. Analysis of Human Receptor Density, in Basic and Clinical Applications of Vision Science, Ed. V. Kluwer Academic Publishers, 63--71.

[30]

Wyatt, H. 1995. The Form of the Human Pupil. Vision Research, 35, 14, 2021--2036.

Cited By

Bellingrath JLi KAziz KIzzi JLiu YSingh M(2024)Large animal model species in pluripotent stem cell therapy research and development for retinal diseases: a systematic reviewFrontiers in Ophthalmology10.3389/fopht.2024.13770984Online publication date: 26-Aug-2024
https://doi.org/10.3389/fopht.2024.1377098
Nakada MChen HLakshmipathy ATerzopoulos D(2021)Locally-Connected, Irregular Deep Neural Networks for Biomimetic Active Vision in a Simulated Human2020 25th International Conference on Pattern Recognition (ICPR)10.1109/ICPR48806.2021.9412771(4465-4472)Online publication date: 10-Jan-2021
https://doi.org/10.1109/ICPR48806.2021.9412771
Wang LZhou MZhang H(2021)The Emerging Role of Topical Ocular Drugs to Target the Posterior EyeOphthalmology and Therapy10.1007/s40123-021-00365-yOnline publication date: 4-Jul-2021
https://doi.org/10.1007/s40123-021-00365-y
Show More Cited By

Index Terms

A photon accurate model of the human eye
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics

Recommendations

A photon accurate model of the human eye
SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

A photon accurate model of individual cones in the human eye perceiving images on digital display devices is presented. Playback of streams of pixel video data is modeled as individual photon emission events from within the physical substructure of each ...
Interactive screen-space accurate photon tracing on GPUs
EGSR '06: Proceedings of the 17th Eurographics conference on Rendering Techniques

Recent advances in algorithms and graphics hardware have opened the possibility to render caustics at interactive rates on commodity PCs. This paper extends on this work in that it presents a new method to directly render caustics on complex objects, to ...
Anatomically accurate modeling and rendering of the human eye
SIGGRAPH '07: ACM SIGGRAPH 2007 sketches

Recovering anatomical features of organic materials is a challenging issue. The human eye, as an important part of the non verbal communication, needs to be accurately modeled and rendered to increase the realism of virtual characters. The recent ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 24, Issue 3

July 2005

826 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1073204

Issue’s Table of Contents

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2005

Published in TOG Volume 24, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
3,024
Total Downloads

Downloads (Last 12 months)58
Downloads (Last 6 weeks)8

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bellingrath JLi KAziz KIzzi JLiu YSingh M(2024)Large animal model species in pluripotent stem cell therapy research and development for retinal diseases: a systematic reviewFrontiers in Ophthalmology10.3389/fopht.2024.13770984Online publication date: 26-Aug-2024
https://doi.org/10.3389/fopht.2024.1377098
Nakada MChen HLakshmipathy ATerzopoulos D(2021)Locally-Connected, Irregular Deep Neural Networks for Biomimetic Active Vision in a Simulated Human2020 25th International Conference on Pattern Recognition (ICPR)10.1109/ICPR48806.2021.9412771(4465-4472)Online publication date: 10-Jan-2021
https://doi.org/10.1109/ICPR48806.2021.9412771
Wang LZhou MZhang H(2021)The Emerging Role of Topical Ocular Drugs to Target the Posterior EyeOphthalmology and Therapy10.1007/s40123-021-00365-yOnline publication date: 4-Jul-2021
https://doi.org/10.1007/s40123-021-00365-y
Nguyen VFolz JLi YHenry JZhang WQian TWang XPaulus Y(2021)Indocyanine green‐enhanced multimodal photoacoustic microscopy and optical coherence tomography molecular imaging of choroidal neovascularizationJournal of Biophotonics10.1002/jbio.20200045814:5Online publication date: 11-Feb-2021
https://doi.org/10.1002/jbio.202000458
Song HZeng YSardar Pasha SBush RVijayasarathy CQian HWei LWiley HWu ZSieving P(2020)Trans-Ocular Electric Current In Vivo Enhances AAV-Mediated Retinal Transduction in Large Animal Eye After Intravitreal Vector AdministrationTranslational Vision Science & Technology10.1167/tvst.9.7.289:7(28)Online publication date: 24-Jun-2020
https://doi.org/10.1167/tvst.9.7.28
Zeng YBoyd RBartoe JWiley HMarangoni DWei LSieving P(2020)“Para-retinal” Vector Administration into the Deep Vitreous Enhances Retinal Transgene ExpressionMolecular Therapy - Methods & Clinical Development10.1016/j.omtm.2020.06.01518(422-427)Online publication date: Sep-2020
https://doi.org/10.1016/j.omtm.2020.06.015
Matthews LPerin G(2019)Exploiting ambiguity: The diffraction artefact and the architectural surfaceInternational Journal of Architectural Computing10.1177/147807711880415317:1(103-115)Online publication date: 14-Mar-2019
https://doi.org/10.1177/1478077118804153
Nakada MLakshmipathy AChen HLing NZhou TTerzopoulos D(2019)Biomimetic eye modeling & deep neuromuscular oculomotor controlACM Transactions on Graphics10.1145/3355089.335655838:6(1-14)Online publication date: 8-Nov-2019
https://dl.acm.org/doi/10.1145/3355089.3356558
Akita JToda M(2018)[Papers] CMOS Image Sensor with Pseudorandom Pixel Placement for Image Measurement using Hough TransformITE Transactions on Media Technology and Applications10.3169/mta.6.2126:3(212-216)Online publication date: 2018
https://doi.org/10.3169/mta.6.212
Nakada MChen HTerzopoulos DGrimm CWillemsen PKearney JRiecke B(2018)Deep learning of biomimetic visual perception for virtual humansProceedings of the 15th ACM Symposium on Applied Perception10.1145/3225153.3225161(1-8)Online publication date: 10-Aug-2018
https://dl.acm.org/doi/10.1145/3225153.3225161
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents