References

1

Norihiro Abe, Itsuya Soga, and Saburo Tsuji. A plot understanding system on reference to both image and language. In Proceedings of the Seventh International Joint Conference on Artificial Intelligence, pages 77-84, Vancouver, BC, August 1981.

2

Norihiro Abe and Saburo Tsuji. A learning of object structures by verbalism. In J. Horecky, editor, COLING 92, pages 1-6. Elsevier North-Holland, 1982.

3

Mark R. Adler. Computer interpretation of Peanuts cartoons. In Proceedings of the Fifth International Joint Conference on Artificial Intelligence, page 608, Cambridge, MA, August 1977.

4

James F. Allen. Maintaining knowledge about temporal intervals. Communications of the ACM, 26(11):832-843, November 1983.

5

Norman I. Badler. Temporal scene analysis: Conceptual descriptions of object movements. Technical Report 80, University of Toronto Department of Computer Science, February 1975.

6

Renée Baillargeon. Representing the existence and the location of hidden objects: Object permanence in 6- and 8-month-old infants. Cognition, 23:21-41, 1986.

7

Renée Baillargeon. Object permanence in - and -month-old infants. Developmental Psychology, 23(5):655-664, 1987.

8

Renée Baillargeon, Elizabeth S. Spelke, and Stanley Wasserman. Object permanence in five-month-old infants. Cognition, 20:191-208, 1985.

9

M. Blum, A. K. Griffith, and B. Neumann. A stability test for configurations of blocks. A. I. Memo 188, MIT Artificial Intelligence Laboratory, February 1970.

10

Aaron F. Bobick and Yuri A. Ivanov. Action recognition using probabilistic parsing. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 196-202, Santa Barbara, CA, June 1998.

11

Dan Bobrow. Natural language input for a computer problem solving system. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA, 1964.

12

Gary C. Borchardt. A computer model for the representation and identification of physical events. Technical Report T-142, Coordinated Sciences Laboratory, University of Illinois at Urbana-Champaign, May 1984.

13

Gary C. Borchardt. Event calculus. In Proceedings of the Ninth International Joint Conference on Artificial Intelligence, pages 524-527, Los Angeles, CA, August 1985.

14

Matthew Brand. Understanding manipulation in video. In Proceedings of the International Conference on Face and Gesture Recognition, pages 94-99, Killington, VT, 1996.

15

Matthew Brand. The inverse hollywood problem: From video to scripts and storyboards via causal analysis. In Proceedings of the Fourteenth National Conference on Artificial Intelligence, pages 132-137, Providence, RI, 1997.

16

Matthew Brand. Physics-based visual understanding. Computer Vision and Image Understanding, 65(2):192-205, 1997.

17

Matthew Brand, Lawrence Birnbaum, and Paul Cooper. Sensible scenes: Visual understanding of complex scenes through causal analysis. In Proceedings of the Eleventh National Conference on Artificial Intelligence, pages 588-593, July 1993.

18

Matthew Brand, Nuria Oliver, and Alex Pentland. Coupled hidden Markov models for complex action recognition. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1997.

19

Alan Bundy, L. Byrd, George Luger, Chris Mellish, R. Milne, and Martha Palmer. MECHO: a program to solve mechanics problems. Technical Report Working paper 50, Department of Artificial Intelligence, Edinburgh University, 1979.

20

Alan Bundy, George Luger, Martha Palmer, and Robert Welham. MECHO: Year one. In M. Brady, editor, Proceedings of the AISB Conference, pages 94-103, Edinburgh, July 1998.

21

Chad Cumby and Dan Roth. Relational representations that facilitate learning. In Proceedings of the International Conference on Knowledge Representation and Reasoning, pages 425-434, Colorado, April 2000. Morgan Kaufmann.

22

David R. Dowty. Word Meaning and Montague Grammar. D. Reidel Publishing Company, Boston, MA, 1979.

23

Scott Elliott Fahlman. A planning system for robot construction tasks. Artificial Intelligence, 5(1):1-49, 1974.

24

Brian V. Funt. Problem-solving with diagrammatic representations. Artificial Intelligence, 13(3):201-230, May 1980.

25

Annette Herskovits. Language and Spatial Cognition: An Interdisciplinary Study of the Prepositions in English. Cambridge University Press, New York, NY, 1986.

26

Ray Jackendoff. Semantics and Cognition. MIT Press, Cambridge, MA, 1983.

27

Ray Jackendoff. Semantic Structures. MIT Press, Cambridge, MA, 1990.

28

Ray Jackendoff and Barbara Landau. Spatial language and spatial cognition. In Donna Jo Napoli and Judy Anne Kegl, editors, Bridges Between Psychology and Linguistics: A Swarthmore Festschrift for Lila Gleitman. Erlbaum, Mahwah, NJ, 1991.

29

Allan D. Jepson and W. A. Richards. What is a percept? Technical Report RBCV-TR-93-43, University of Toronto Department of Computer Science, March 1993.

30

Manfred Krifka. Thematic relations as links between nominal reference and temporal constitution. In Ivan A. Sag and Anna Szabolcsi, editors, Lexical Matters. CSLI, 1992.

31

Geoffrey N. Leech. Towards a Semantic Description of English. Indiana University Press, 1969.

32

George Luger. Mathematical model building in the solution of mechanics problems: Human protocols and the MECHO trace. Cognitive Science, 5:55-77, 1981.

33

Richard Mann and Allan D. Jepson. Toward the computational perception of action. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 794-799, Santa Barbara, CA, June 1998.

34

Richard Mann, Allan D. Jepson, and Jeffrey Mark Siskind. The computational perception of scene dynamics. In Proceedings of the Fourth European Conference on Computer Vision, pages 528-529, Cambridge, UK, April 1996. Springer-Verlag.

35

Richard Mann, Allan D. Jepson, and Jeffrey Mark Siskind. The computational perception of scene dynamics. Computer Vision and Image Understanding, 65(2), February 1997.

36

David Marr and Lucia Vaina. Representation and recognition of the movements of shapes. Proc. R. Soc. Lond. B, 214:501-524, 1982.

37

M. Martin and Hector Geffner. Learning generalized policies in planning using concept languages. In Proceedings of the International Conference on Knowledge Representation and Reasoning, Colorado, April 2000. Morgan Kaufmann.

38

John McCarthy. Circumscription--a form of non-monotonic reasoning. Artificial Intelligence, 13(1-2):27-39, 1980.

39

George A. Miller. English verbs of motion: A case study in semantics and lexical memory. In Arthur W. Melton and Edwin Martin, editors, Coding Processes in Human Memory, chapter 14, pages 335-372. V. H. Winston and Sons, Inc., Washington, DC, 1972.

40

Gordon Novak. Computer understanding of physics problems stated in natural language. American Journal of Computational Linguistics, 53, 1976.

41

Gordon S. Novak and William C. Bulko. Understanding natural language with diagrams. In Proceedings of the Eighth National Conference on Artificial Intelligence, Boston, MA, July 1990.

42

Naoyuki Okada. SUPP: Understanding moving picture patterns based on linguistic knowledge. In Proceedings of the Sixth International Joint Conference on Artificial Intelligence, pages 690-692, Tokyo, August 1979.

43

Martha Palmer. Semantic Processing for Finite Domains. ACL Book Series. Cambridge University Press, New York, NY, 1990.

44

Steven Pinker. Learnability and Cognition. MIT Press, Cambridge, MA, 1989.

45

Terrance Philip Regier. The Acquisition of Lexical Semantics for Spatial Terms: A Connectionist Model of Perceptual Categorization. PhD thesis, University of California at Berkeley, 1992.

46

John M. Rubin and W. A. Richards. Boundaries of visual motion. A. I. Memo 835, MIT Artificial Intelligence Laboratory, April 1985.

47

Roger C. Schank. The fourteen primitive actions and their inferences. Memo AIM-183, Stanford Artificial Intelligence Laboratory, March 1973.

48

Yoav Shoham. Temporal logics in AI: Semantical and ontological considerations. Artificial Intelligence, 33(1):89-104, September 1987.

49

Jeffrey Mark Siskind. Naive physics, event perception, lexical semantics and language acquisition. In The AAAI Spring Symposium Workshop on Machine Learning of Natural Language and Ontology, pages 165-168, March 1991.

50

Jeffrey Mark Siskind. Naive Physics, Event Perception, Lexical Semantics, and Language Acquisition. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA, January 1992.

51

Jeffrey Mark Siskind. Grounding language in perception. In Proceedings of the Annual Conference of the Society of Photo-Optical Instrumentation Engineers, Boston, MA, September 1993.

52

Jeffrey Mark Siskind. Axiomatic support for event perception. In Paul McKevitt, editor, Proceedings of the AAAI Workshop on the Integration of Natural Language and Vision Processing, pages 153-160, Seattle, WA, August 1994.

53

Jeffrey Mark Siskind. Grounding language in perception. Artificial Intelligence Review, 8:371-391, 1995.

54

Jeffrey Mark Siskind. Unsupervised learning of visually-observed events. In The AAAI Fall Symposium Workshop on Learning Complex Behaviors in Adaptive Intelligent Systems, pages 82-83, November 1996.

55

Jeffrey Mark Siskind. Visual event perception. In Katsushi Ikeuchi and Manuela Veloso, editors, Symbolic Visual Learning, chapter 9. Oxford University Press, New York, NY, 1997.

56

Jeffrey Mark Siskind. Visual event perception. In Proceedings of the NEC Research Symposium, 1999. Also available as Technical report 99-033, NEC Research Institute, Inc.

57

Jeffrey Mark Siskind. Visual event classification via force dynamics. In Proceedings of the Seventeenth National Conference on Artificial Intelligence, pages 149-155, Austin, TX, 2000.

58

Jeffrey Mark Siskind and Quaid Morris. A maximum-likelihood approach to visual event classification. In Proceedings of the Fourth European Conference on Computer Vision, pages 347-360, Cambridge, UK, April 1996. Springer-Verlag.

59

Elizabeth S. Spelke. Cognition in infancy. Occasional Papers in Cognitive Science 28, Massachusetts Institute of Technology, 1983.

60

Elizabeth S. Spelke. Where perceiving ends and thinking begins: the apprehension of objects in infancy. In A. Yonas, editor, Perceptual development in infancy. Minnesota symposia in child psychology, pages 197-234. Erlbaum, Mahwah, NJ, 1987.

61

Elizabeth S. Spelke. The origins of physical knowledge. In L. Weiskrantz, editor, Thought Without Language, chapter 7, pages 168-184. Oxford University Press, New York, NY, 1988.

62

Thad Eugene Starner. Visual recognition of American Sign Language using hidden Markov models. Master's thesis, Massachusetts Institute of Technology, Cambridge, MA, February 1995.

63

Leonard Talmy. Force dynamics in language and cognition. Cognitive Science, 12:49-100, 1988.

64

Robert Thibadeau. Artificial perception of actions. Cognitive Science, 10(2):117-149, 1986.

65

Saburo Tsuji, Akira Morizono, and Shinichi Kuroda. Understanding a simple cartoon film by a computer vision system. In Proceedings of the Fifth International Joint Conference on Artificial Intelligence, pages 609-610, Cambridge, MA, August 1977.

66

Saburo Tsuji, Michiharu Osada, and Masahiko Yachida. Three dimensional movement analysis of dynamic line images. In Proceedings of the Sixth International Joint Conference on Artificial Intelligence, pages 896-901, Tokyo, August 1979.

67

Saburo Tsuji, Michiharu Osada, and Masahiko Yachida. Tracking and segmentation of moving objects in dynamic line images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2(6):516-522, November 1980.

68

Zeno Vendler. Linguistics in Philosophy. Cornell University Press, Ithaca, NY, 1967.

69

H. J. Verkuyl. Aspectual classes and aspectual composition. Linguistics and Philosophy, 12(1):39-94, February 1989.

70

David L. Waltz. Toward a detailed model of processing for language describing the physical world. In Proceedings of the Seventh International Joint Conference on Artificial Intelligence, pages 1-6, Vancouver, BC, August 1981.

71

David L. Waltz and Lois Boggess. Visual analog representations for natural language understanding. In Proceedings of the Sixth International Joint Conference on Artificial Intelligence, pages 926-934, Tokyo, August 1979.

72

Terry Winograd. Understanding Natural Language. Academic Press, New York, NY, 1972.

73

Junji Yamoto, Jun Ohya, and Kenichiro Ishii. Recognizing human action in time-sequential images using hidden Markov model. In Proceedings of the 1992 IEEE Conference on Computer Vision and Pattern Recognition, pages 379-385. IEEE Press, 1992.