research-article

ILM's multitrack: a new visual tracking framework for high-end VFX production

Authors:

Christoph Bregler,

Kiran Bhat,

Jeff Saltzman,

Brett AllenAuthors Info & Claims

SIGGRAPH '09: SIGGRAPH 2009: Talks

Article No.: 29, Page 1

https://doi.org/10.1145/1597990.1598019

Published: 03 August 2009 Publication History

Get Access

Abstract

Tracking 2D features on film footage is the starting point for several applications in a VFX pipeline such as camera calibration, match-moving, photomodeling, vision-based motion capture and object tracking. The diversity of captured footage and the accuracy requirements make the feature tracking problem very challenging. For instance, typical background footage exhibits drastic changes in lighting, motion blur, occlusions, and is usually corrupted with environment effects such as smoke or explosions. Tracking features on hero characters such as a human faces is equally challenging, especially near the eyes and lips, where the textures change continuously.

Reference

[1]

Baker, S., and Matthews, I. 2004. Lucas-kanade 20 years on: A unifying framework. International Journal of Computer Vision 56, 3 (February), 221--255.

Digital Library

Google Scholar

Cited By

View all

Tian ZWeng DFang HShen TZhang W(2024)Robust facial marker tracking based on a synthetic analysis of optical flows and the YOLO networkThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-02931-w40:4(2471-2489)Online publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1007/s00371-023-02931-w
Tian ZWeng DFang HBao Y(2023)Deep Detector and Optical Flow-based Tracking Approach of Facial Markers for Animation Capture2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00134(625-630)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00134
Barber ACosker DJames OWaine TPatel RPearce AEnderton EHorvath CGibbs J(2016)Camera tracking in visual effects an industry perspective of structure from motionProceedings of the 2016 Symposium on Digital Production10.1145/2947688.2947697(45-54)Online publication date: 23-Jul-2016
https://dl.acm.org/doi/10.1145/2947688.2947697
Show More Cited By

Index Terms

ILM's multitrack: a new visual tracking framework for high-end VFX production
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Tracking
      2. Computer vision tasks
        Scene understanding
  2. Computer graphics
2. General and reference

Recommendations

ILM facial performance capture
SIGGRAPH '16: ACM SIGGRAPH 2016 Talks

Industrial Light & Magic utilized facial capture technology on a massive scale to bring more than two dozen computer-generated characters to life in the new Warcraft, Teenage Mutant Ninja Turtles, and Star Wars films. Here we present our flexible ...
ILM VFX: Rogue One: A Star Wars Story
SIGGRAPH '17: ACM SIGGRAPH 2017 Computer Animation Festival

Join ILM for a journey back to a galaxy far, far away and dive deep into the visual effects of "Rogue One: A Star Wars Story". The reel showcases the effects work that helped Gareth Edwards bring his vision for the film to life. A deft combination of ...
ILM presents: making "The Irishman"
SIGGRAPH '20: ACM SIGGRAPH 2020 Production Sessions

This production session will describe the schedule, production, and tech aspects of The Irishman movie. From the very beginning (including some early "markerless" capture work done as early as in 2015) till the end of production showing before and after ...

Comments

Information & Contributors

Information

Published In

SIGGRAPH '09: SIGGRAPH 2009: Talks

August 2009

82 pages

ISBN:9781605588346

DOI:10.1145/1597990

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 August 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

SIGGRAPH09

Sponsor:

SIGGRAPH

SIGGRAPH09: Special Interest Group on Computer Graphics and Interactive Techniques Conference

August 3 - 7, 2009

Louisiana, New Orleans

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
474
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)3

Reflects downloads up to 19 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Tian ZWeng DFang HShen TZhang W(2024)Robust facial marker tracking based on a synthetic analysis of optical flows and the YOLO networkThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-02931-w40:4(2471-2489)Online publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1007/s00371-023-02931-w
Tian ZWeng DFang HBao Y(2023)Deep Detector and Optical Flow-based Tracking Approach of Facial Markers for Animation Capture2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00134(625-630)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00134
Barber ACosker DJames OWaine TPatel RPearce AEnderton EHorvath CGibbs J(2016)Camera tracking in visual effects an industry perspective of structure from motionProceedings of the 2016 Symposium on Digital Production10.1145/2947688.2947697(45-54)Online publication date: 23-Jul-2016
https://dl.acm.org/doi/10.1145/2947688.2947697
Bhat KGoldenthal RYe YMallet RKoperwas MChai JYu YKim TSumner R(2013)High fidelity facial animation capture and retargeting with contoursProceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation10.1145/2485895.2485915(7-14)Online publication date: 19-Jul-2013
https://dl.acm.org/doi/10.1145/2485895.2485915
Spiro ITaylor GWilliams GBregler C(2010)Hands by hand: Crowd-sourced motion tracking for gesture annotation2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops10.1109/CVPRW.2010.5543191(17-24)Online publication date: Jun-2010
https://doi.org/10.1109/CVPRW.2010.5543191

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

Reference

Cited By

Index Terms

Recommendations

ILM facial performance capture

ILM VFX: Rogue One: A Star Wars Story

ILM presents: making "The Irishman"

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations