MASSACHUSETTS INSTITUTE OF TECHNOLOGY

School of Architecture and Planning Faculty Personnel Record

Date: January 19, 1999 Full Name: Aaron F. Bobick

Department: Media Laboratory, Perceptual Computing

1. Date of Birth: December 27, 1959

2. Citizenship: United States Citizen

Immigration Status:

3. Education:

School Degree Date

Massachusetts Institute of Technology S.B. Mathematics 1981

Massachusetts Institute of Technology S.B. Computer Science 1981

Massachusetts Institute of Technology Ph.D. Cognitive Science 1987

4. Title of Thesis for Most Advanced Degree

"Natural Object Categorization," Ph.D. dissertation, Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, July, 1987.

5. Principal Fields of Interest:

Human and Machine Vision, Artificial Intelligence, Cognitive Science.

6. Name and Rank of Other Departmental Faculty in Same Field:

Alex Pentland, Professor

7. Name and Rank of Faculty of Other Departments in Same Field:

Eric Grimson, Electrical Engineering and Computer Science, Professor

Tomaso Poggio, Brain and Cognitive Science, Professor

8. Non-MIT Experience (including military service):

Employer Position Beginning Ending

SRI International, Menlo Park, CA Computer Scientist 1987 1992

Stanford University, Palo Alto, CA Visiting Scholar, 1987 1992

Center for the Study of Language and Information

CyberGear, Cambridge, MA Founder 1993 1996

and Chief Technical Officer

C.S. Draper Laboratory Computer Scientist 1979 1981

Cambridge, MA

Tectrix, Cambridge, MA Chief Technical Officer 1996 1997

 

9. History of MIT Appointments:

Rank Beginning Ending

Research Assistant, Natural Computation Group 1983 1987

Department of Brain and Cognitive Sciences

Assistant Professor of Computational Vision 1992 1995

Media Laboratory, Perceptual Computing Group

LG Electronics Inc., Career Development 1995 1998

Assistant Professor of Computational Vision Media Laboratory,

Perceptual Computing Group

Associate Professor of Computational Vision 1998 Present

Media Laboratory, Perceptual Computing Group

10. Consulting Record:

Firm Beginning Ending

Siemens, Corporate Research 1997 Present

Walt Disney, Imagineering Research 1997 Present

Tectrix, Inc. 1996 1997

Hertz Design Inc. 1994 1996

CyberGear, Inc. 1993 1996

Tekscan, Inc. 1985 1992

Barry Wright Corporation 1983 1984

11. Department and Institute Committees, Other Assigned Duties:

Activity Beginning Ending

Departmental Committee on Graduate Students 1993 1994

Departmental Committee on Graduate Students 1996 1997

Departmental Committee on Undergraduate Students 1996 Present

 

12. Government and Other Outside Committees, Service, etc.:

Committee Beginning Ending

Program Co-Chair DARPA Image Understanding Mtg. 1996 1997

ARPA HCI Steering Group 1995 1996

Program Committees:

Computer Vision and Pattern Recognition 1998 Present

Computer Vision and Pattern Recognition 1997 1998

Computer Vision and Pattern Recognition 1996 1997

International Face and Gesture 1995 1996

Recognition Conference

Computer Vision and Pattern Recognition 1995 1996

International Conference Computer Vision 1994 1995

IEEE Workshop on Context-Based Vision 1994 1995

Workshop Chair:

IEEE Interpretation of Visual Motion 1997 1998

NSF/DARPA Perception of Action 1996 1997

International Joint Conference on 1992 1993

Artificial Intelligence

NSF Review Committee 1995 1995

NSF Review Committee 1998 1999

13. Awards Received:

Award Date

14. Current Organization Membership:

Organization Offices Held

Optical Society of America Chairman of Image Understanding Technical Group, 1991-1992

IEEE Computer Society

American Association for Artificial Intelligence

15. Patents and Patent Applications Pending:

(with CyberGear) Patent #5462503 "Interactive Exercise Apparatus"

(with CyberGear) Patent #5466200 "Interactive Exercise Apparatus"

(with Jim Davis) "Method and Apparatus for Isolating Silhouettes in an Interactive Environment"

16. Professional Registration:

Association for Computing Machinery

 

 

 

Term Sub. No. Title Role Enrollment

FT92 4.996 Learning, Seeing and Deciding Co-Instructor 6

ST93 4.998 High Level Computer Vision Instructor 2

FT93 MAS 620 Learning, Seeing and Deciding Co-Instructor 9

ST94 MAS 624 High Level Computer Vision Instructor 2

FT94 MAS 626 Image Representation for Vision Co-Instructor 15

ST95 MAS 624 High Level Computer Vision Instructor 6

FT95 MAS 626 Image Representation for Vision Co-Instructor 15

ST96 MAS 622J Pattern Recognition and Analysis Instructor 21

FT96 MAS 626 Image Representation Co-Instructor 20

ST97 MAS 624 High Level Computer Vision Instructor 5

FT97 MAS 626 Image Representation Co-Instructor 20

FT97 MAS 964 Interaction Techniques for Interactive Co-Instructor 30

Virtual Environments

ST98 MAS 622J Pattern Recognition and Analysis Co-Instructor 15
FT98 MAS 964 Interaction Techniques for Interactive Co-Instructor 20

Virtual Environments

 

 

1. Books:

2. Papers in Refereed Journals:

    1. Bobick, A. and J. Davis, "The recognition of human movement using temporal templates," submitted to IEEE Transaction on Pattern Analysis & Machine Intelligence.
    2. Davis, J. and A. Bobick, "Interactive Virtual Aerobics Using A Robust Human-Silhouette Extraction Technique and Motion Templates," submitted to Visual Computer.
    3. Ivanov, Y., A. Bobick, and J. Liu, "Fast lighting independent background subtraction," submitted to International Journal of Computer Vision Special Issue on Visual Surveillance.
    4. Wilson, A. and A. Bobick, "Parametric Hidden Markov Models for Gesture Recognition," IEEE Transaction on Pattern Analysis & Machine Intelligence, in press.
    5. Bobick, A., S. Intille, J. Davis, F. Baird, C. Pinhanez, L. Campbell, Y. Ivanov, A. Schutte, A. Wilson, "The KidsRoom: A Perceptually-based Interactive and Immersive Story Environment," Presence, to appear.
    6. Mase, K., P. Pinhanez, and A. Bobick,, "Scripting Method Based on Temporal Intervals for Designing Interactive Systems". Transaction of IPSJ (Information Processing Society of Japan), Vol. 39. No. 5, pp. 1403--1413, May 1998.
    7. Bobick, A. "Movement, Activity, and Action: The Role of Knowledge in the Perception of Motion." Phil. Trans. Royal Society London B, 352, pp. 1257-1265, 1997.
    8. Bobick, A. and A. Wilson, "A State-based Approach to the Representation and Recognition of Gesture." IEEE Transaction on Pattern Analysis & Machine Intelligence, Vol. 19, No. 12, December 1997.
    9. Bobick, A. and S. Intille, "Large Occlusion Stereo." International Journal of Computer Vision, in press.
    10. Pinhanez, C. and A. Bobick, "Intelligent Studios: Modeling Space and Action to Control TV Cameras." Applications of Artificial Intelligence, Vol. 11(4), pp. 285-306, 1997.
    11. Bobick, A. and R. C. Bolles, "The Representation Space Paradigm of Concurrent Evolving Scene Descriptions." IEEE Transactions Pattern Analysis and Machine Intelligence, Vol. 14, No. 2, pp. 146-156, February 1992.

 

 

 

 

 

 

 

3. Papers in Refereed Conference Proceedings: [Conferences indicated in bold represent papers in stringently reviewed (<30% acceptance) International Conferences]

    1. Pinhanez, C. and A. Bobick, " Using Computer Vision to Control a Reactive Computer Graphics Character in a Theater Play", To Appear in Proceedings of International Conference on Vision Systems (ICVS’99), Las Palmas, Gran Canaria, Spain, January 1999.
    2. Davis, J. and A. Bobick, "Virtual PAT: A Virtual Personal Aerobics Trainer", To Appear in Proceedings of Workshop on Perceptual User Interfaces (PUI98), November 1998.
    3. Davis, J. and A. Bobick, "A Robust Human-Silhouette Extraction Technique for Interactive Virtual Environments", To Appear in Proceedings of IFIP Workshop on Modelling and Motion Capture Techniques for Virtual Environments (CAPTECH98), November 1998.
    4. Pinhanez, C. and A. Bobick, "It/I: Theater with an Automatic and Reactive Computer Graphics", SIGGRAPH'98 Conference Abstracts and Applications, p. 302, Orlando, Florida, July 1998.
    5. Bobick, A. and Y. Ivanov, " Action Recognition Using Probabilistic Parsing", Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, , Santa Barbara, CA, pp. 196-202, June 1998.
    6. Pinhanez, C. and A. Bobick, "Human Action Detection Using PNF Propagation of Temporal Constraints", Proceedings of IEEE Conference on Computer Vision and Pattern Recognition , Santa Barbara, CA, pp. 898-904, June 1998.
    7. Wilson, D. and A. Bobick, "Nonlinear PHMMs for the Interpretation of Parameterized Gesture", Proceedings of IEEE Conference on Computer Vision and Pattern Recognition , Santa Barbara, CA, pp. 879-884, June 1998.
    8. Pinhanez, C. and A. Bobick, " It/I: An Experiment Towards Interactive Theatrical Performances", Proceedings of CHI ‘98, Los Angeles, CA, pp. 333-334, April 1998.
    9. Wilson, D. and A. Bobick, "Recognition and interpretation of parametric gesture", Proceedings of International Conference on Computer Vision, Bombay, India, pp. 329-336, 1998.
    10. Bobick, A. and C. Pinhanez, "Controlling View-Based Algorithms Using Approximate World Models and Action Information." Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Puerto Rico, pp. 955-961, June 1997.
    11. Davis, J. and A. Bobick, "The Representation and Recognition of Action Using Temporal Templates." Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Puerto Rico, pp. 928-934, June 1997.
    12. Wilson, D., A. Bobick and J. Cassell, "Temporal classification of natural gesture and application to video coding", Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Puerto Rico, pp. 948-954, June 1997.
    13. Intille, S., J. Davis and A. Bobick, "Real-Time Closed-World Tracking." Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 697-703, Puerto Rico, June 1997.
    14. Pinhanez, C., K. Mase and A. Bobick, "Interval Scripts: A Design Paradigm for Story-Based Interactive Systems." Proceedings of CHI ‘97, Atlanta, GA, pp. 287-294, March 1997.
    15. Pinhanez, C., K. Mase and A. Bobick, "Designing Story-Based Interfaces by Interval Scripts." Proceedings of Interaction ‘97, Tokyo, Japan, 8 pages, February 1997.
    16. Bobick, A. and J. Davis, "Real-time Recognition of Activity Using Temporal Templates." IEEE Workshop on Applications of Computer Vision, Sarasota, FL, 4 pages, December 1996.
    17. Campbell, L., D. Becker, A. Azarbayejani, A. Bobick and A. Pentland, "Invariant Features for 3-D Gesture Recognition." Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, Killington, VT, pp. 157-162, October 1996.
    18. Wilson, A., A. Bobick and J. Cassell, "Recovering the Temporal Structure of Natural Gesture." Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, Killington, VT, pp. 66-71, October 1996.
    19. Bobick, A. "Computers Seeing Action." British Machine Vision Conference, Edinburgh, Scotland, pp. 13-22, September 1996.
    20. *Bobick A. and J. Davis, "An Appearance-based Representation of Action." Proceedings of International Conference on Pattern Recognition, Vienna, Austria, Track A, pp. 307-312, August 1996.
    21. Pinhanez, C. and A. Bobick, "Computer Theater: Stage for Action Understanding." Proceedings of the AAAI ‘96 Workshop on AI/A-Life Entertainment, AAAI Press Technical Report WS-96-03, Portland, OR, pp. 28-33, August 1996.
    22. Pinhanez, C. and A. Bobick, "Approximate World Models: Incorporating Qualitative and Linguistic Information into Vision Systems." Proceedings of the AAAI ‘96, Portland, OR, pp. 1116-1123, August 1996.
    23. Bobick, A., "Video Annotation: Computers watching video." Second Asian Conference on Computer Vision, Vol. I, Singapore, pp. 19-23, December 1995.
    24. Pinhanez, C. and A. Bobick, "Scripts in Machine Understanding of Image Sequences." Proceedings of the 1995 AAAI Fall Symposium on Computational Models for Integrating Language and Vision, Cambridge, MA, pp. 96-101, November 1995.
    25. *Wilson, A. and A. Bobick, "Learning Visual Behavior for Gesture Analysis." Proceedings of the IEEE Symposium on Computer Vision, Coral Gables, FL, pp. 229-234, November 1995.
    26. Pinhanez, C. and A. Bobick, "Intelligent Studios: Using Computer Vision to Control TV Cameras." Proceedings of the International Joint Conference on Artificial Intelligence Workshop on Entertainment and AI/Alife, Montreal, Canada, pp. 69-76, August 1995.
    27. Bobick, A. and S. Intille, "Exploiting Contextual Information for Tracking by Using Closed-Worlds." Proceedings of the Workshop on Context-Based Vision, Cambridge, MA, pp. 87-98, June 1995.
    28. Bobick, A. and C. Pinhanez, "Using Approximate Models as Source of Contextual Information for Vision Processing." Proceedings of the Workshop on Context-Based Vision, Cambridge, MA, pp. 13-21, June 1995.
    29. Bobick, A. and A. Wilson, "A State-Based Technique for the Summarization and Recognition of Gesture." Fifth International Conference on Computer Vision, Cambridge, MA, pp. 382-388, June 1995.
    30. *Campbell, L. and A. Bobick, "Recognition of Human Body Motion Using Phase Space Constraints." Fifth International Conference on Computer Vision, Cambridge, MA, 624-630, June 1995.
    31. *Campbell, L. and A. Bobick, "Using Phase Space Constraints to Represent Human Body Motion." International Workshop on Automatic-Face and Gesture-Recognition, Zurich, Switzerland, pp. 338-343, June 1995.
    32. *Intille, S. and A. Bobick, "Closed-World Tracking." Fifth International Conference on Computer Vision, Cambridge, MA, pp. 672-678, June 1995.
    33. Wilson, A. and A. Bobick, "Configuration States for the Representation and Recognition of Gesture." International Workshop on Automatic-Face and Gesture-Recognition, Zurich, Switzerland, pp. 129-134, June 1995.
    34. Intille, S. and A. Bobick, "Incorporating Intensity Edges in the Recovery of Occlusion Regions." International Conference on Pattern Recognition, Jerusalem, Israel, Vol. I, pp. 674-677, October 1994.
    35. Bobick, A, "Representational Frames in Dynamic Scene Annotation." Proceedings of the Workshop on Visual Behaviors, Seattle, WA, pp. 54-59, June 1994.
    36. Intille, S. and A. Bobick, "Disparity-Space Images and Large Occlusion Stereo." European Conference on Computer Vision, J-O. Eklundh (ed.), Stockholm, Sweden, Vol. 801, pp. 179-186, May 1994.
    37. Bobick, A, "Representational Frames in Video Annotation." The Twenty-Seventh Asilomar Conference on Signals and Systems , Pacific Grove, CA, Vol. 1, pp. 111-115, November 1993.
    38. Bobick, A, "Using Stability of Interpretation as Verification for Low Level Processing: An example from ego motion and optic flow." IEEE Computer Vision and Pattern Recognition, New York, NY, pp. 718-719, June 1993.
    39. Bobick, A. and R. Bolles, "Multiple Concurrent Object Descriptions in Support of Autonomous Navigation." P. S. Schenker (ed.), Proceedings SPIE Sensor Fusion, Vol. 1828, No. 5, Boston, MA, pp. 383-392, November 1992.
    40. Leclerc, Y. and A. Bobick, "The Direct Computation of Height from Shading." IEEE Computer Vision and Pattern Recognition, Lahaina, Maui, HI, pp. 552-558, June 1991.
    41. Bobick, A. and R. Bolles, "An Evolutionary Approach to Constructing Object Descriptions." H. Miura and S. Arimoto (ed.), Fifth International Symposium on Robotics Research, Tokyo, Japan, pp. 107-115, August 1989.
    42. Bobick, A. and R. Bolles, "Representation Space: An Approach to the Integration of Visual Information." IEEE Computer Vision and Pattern Recognition, San Diego, CA, pp. 492-499, June 1989.
    43. Bolles, R. and A. Bobick, "Exploiting Temporal Coherence in Scene Analysis for Autonomous Navigation." Robotics and Automation, Scottsdale, AR, Vol. 2, pp. 990-996, May 1989.
    44. Bobick, A., "Using Mirror Reflections to Recover Shape." Technical Program, Optical Society of America Annual Meeting, San Diego, CA, Abstract, October 1984.
    45. Bobick, A., "A Hybrid Approach to Structure-From-Motion." N. Badler and J. Tsotsos (ed.), Motion: Representation and Perception, Proceedings of Association of Computing Machinery Siggraph Workshop on Motion, Toronto, Canada, pp. 91-109, April 1983.

4. Other Major Publications:

    1. Bobick, A. and A. Wilson, "State-based recognition of Gesture." in M. Shah and R. Jain (eds.), Motion-Based Recognition, pp. 201-226, 1997.
    2. Bobick, A. and J. Davis, "Action Recognition Using Temporal Templates." in M. Shah and R. Jain (eds.), Motion-Based Recognition, pp. 125-146, 1997.
    3. Bobick, A., A. Pentland and T. Poggio, "VSAM at the MIT Media Laboratory and CBCL: Learning and Understanding Action in Video Imagery." Proceedings of the 1997 Image Understanding Workshop, New Orleans, LA, pp. 25-29, May 1997.
    4. Pinhanez, C., and A. Bobick, "PNF Propagation and the Detection of Actions Described by Temporal Intervals." Proceedings of the 1997 Image Understanding Workshop, New Orleans, LA, pp. 227-233, May 1997.
    5. Bobick, A., "Video Annotation: Computers Watching Video." in Lecture Notes in Computer Science: Recent Developments in Computer Vision, Vol. 1035, S. Z. Li, D. P. Mital, E. K. Teoh and H. Wang (eds.), Springer, pp. 23-31, 1995.
    6. Richards, W. and A. Bobick, "Playing Twenty Questions with Nature." Chapter 1, in Z. Pylyshyn (eds.), Computational Processes in Human Vision: An Interdisciplinary Perspective, Ablex, Norwood, NJ, pp. 3-26, 1988.

5. Selected Invited Lectures and Seminars:

    1. Parametric HMMs and their use in Gesture Recognition.
      University of Maryland, College Park, MD. April 1998.
    2. Learning to Perceive Actions (sometimes).
      Newton Institute, University of Cambridge, Cambridge, UK, October, 1997.
    3. Movement, Activity and Action: Understanding Motion.
      Kodak Innovative Speakers, Rochester NY, September 1997.
    4. Explicit and Implicit Knowledge in Seeing Action.
      Royal Society Workshop on Knowledge-based Vision
      , London, February, 1997.
    5. Learning the Variation of Representation Over the Course of an Action.
      Learning Vision Workshop at NIPS, Snowbird, CO, December 1996.
    6. Interpreting Action in Video Sequences.
      Washington, DC , October, 1996.
    7. Computers Seeing Action.
      Keynote address at British Machine Vision Conference, September 1996.
    8. Computers Understanding Action.
      National Research Council, Ottawa, Canada, April 1996.
    9. Video Annotation - Computers Watching Video. Asian Conference on Computer Vision, Session on the Future of Computer Vision, Singapore, December 1995.
    10. Computer Vision Tools for the Exploitation of Video Imagery.
      Video Photogrammetry and Exploitation Conference, Washington, DC, May 1995.
    11. Computer Vision and Video Annotation.
      MIT Artificial Intelligence Lab, Cambridge, MA, February 1995.
    12. Computer Vision and Video Annotation.
      University of Illinois , Urbana, IL, February 1995.
    13. Computer Vision and Video Annotation.
      University of Chicago, Chicago, IL, February 1995.
    14. Computer Vision and Video Annotation.
      University of Rochester, Rochester, NY, February 1995.
    15. Computer Annotation of Video.
      Video Photogrammetry and Exploitation Conference, Washington, DC, December 1994.
    16. Multiple Concurrent Object Descriptions in support of Autonomous Navigation.
      (with R. C. Bolles), Proceedings of the SPIE, November 1992.
    17. Concurrent Evolving Object Descriptions in Support of Autonomous Navigation.
      SPIE Annual Meeting, Boston, MA, 1992.
    18. Representation Space.
      Stanford University Artificial Intelligence Lab
      , Palo Alto, CA, 1990.
    19. Evolving Scene Descriptions.
      Optical Society of America Annual Meeting, Boston, MA, 1990.
    20. Natural Object Categorization and Perceptual Inference.
      Cognitive Science Society Conference, Boston, MA, 1990.
    21. Representation Space.
      Image Understanding Workshop, Palo Alto, CA, 1990.

 

Title: Dynamic Scene Analysis

Sponsor: ORD

Effective Dates: 10/1/94 - 12/30/96

Dollar Volume: $479,872.00

Title: Dynamic Scene Analysis

Sponsor: ORD

Effective Dates: 10/1/96 - 9/30/97

Dollar Volume: $250,000.00

Title: Learning and Understanding Action in Video Imagery

Sponsor: DARPA/ARL

Effective Dates: 4/10/97 - 1/31/99

Dollar Volume: $622,000.00

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Summary

Total Completed In Progress

S.B.

M.Eng. 3 3

S.M. 6 5 1

Ph.D.

As Supervisor 5 5

As Reader 1 1

S.B. Theses:

M.Eng. Theses:

Tanguay, Donald, "Multiple Feature Hidden Markov Models for Human Gesture Recognition," September 1995.

Nguyen, Katerina H., "Hand Gesture Recognition, Prediction, and Coding Using Hidden Markov Models." May 1996.

Yao, Peter Y., "Image Enhancement Using Statistical Spatial Segmentation." May 1996.

S.M. Theses:

Intille, Stephen, "Tracking using a local closed-world assumption: tracking in the football domain," September 1994.

Campbell, Lee, "Recognizing Classical Ballet Steps Using Phase Space Constraints," September 1994.

Wilson, Andrew, "Learning Visual Behavior for Gesture Analysis" September 1995.

Krom, Matt, "Machine Perception of Musical Conducting Gestures." May 1996.

Davis, James W., "Appearance-Based Motion Recognition of Human Actions." July 1996.

Ivanov, Yuri, "Application of stochastic grammar systems to action recognition," January, 1998.

Doctoral Theses, Supervisor:

Doctoral Theses, Reader:

Darrell, Trevor, "Perceptive Agents with Attentive Interfaces: learning and vision for man-machine systems." April 1996.