References

1

D. A. Pormerleau, Neural Network Perception for Mobile Robot Guidance. Kluwer Academic Publishers, 1993.

2

S. J. Russell and P. Norvig, Artificial Intelligence: A Modern Approach. Englewood Cliffs, NJ: Prentice Hall, 1995.

3

G. Weiß and S. Sen, eds., Adaptation and Learning in Multiagent Systems. Berlin: Springer Verlag, 1996.

4

AAAI, Adaptation, Coevolution and Learning in Multiagent Systems: Papers from the 1996 AAAI Spring Symposium, (Menlo Park,CA), AAAI Press, March 1996. AAAI Technical Report SS-96-01. Sandip Sen-Chair.

5

M. Benda, V. Jagannathan, and R. Dodhiawala, ``On optimal cooperation of knowledge sources - an empirical investigation,'' Tech. Rep. BCS-G2010-28, Boeing Advanced Technology Center, Boeing Computing Services, Seattle, Washington, July 1986.

6

V. R. Lesser, ``Multiagent systems: An emerging subdiscipline of AI,'' ACM Computing Surveys, vol. 27, pp. 340-342, September 1995.

7

K. S. Decker, ``Distributed problem solving: A survey,'' IEEE Transactions on Systems, Man, and Cybernetics, vol. 17, pp. 729-740, September 1987.

8

H. V. D. Parunak, ``Applications of distributed artificial intelligence in industry,'' in Foundations of Distributed Artificial Intelligence (G. M. P. O'Hare and N. R. Jennings, eds.), pp. 139-164, Wiley Interscience, 1996.

9

E. H. Durfee, ``What your computer really needs to know, you learned in kindergarten,'' in Proceedings of the Tenth National Conference on Artificial Intelligence, (Philadelphia, PA), Morgan Kaufman, 1992. Invited Talk.

10

E. H. Durfee, V. R. Lesser, and D. D. Corkill, ``Trends in cooperative distributed problem solving,'' IEEE Transactions on Knowledge and Data Engineering, vol. 1, pp. 63-83, March 1989.

11

K. S. Decker, ``Task environment centered simulation,'' in Simulating Organizations: Computational Models of Institutions and Groups (M. Prietula, K. Carley, and L. Gasser, eds.), AAAI Press/MIT Press, 1996.

12

K. Decker, ``Personal correspondence,'' May 1996.

13

G. Weiß, ``Ecai-96 workshop on learning in distributed artificial intelligence.'' Call For Papers, 1996.

14

K. Dautenhahn, ``Getting to know each other--artificial social intelligence for autonomous robots,'' Robotics and Autonomous Systems, vol. 16, pp. 333-356, 1995.

15

G. Weiß, ``Distributed reinforcement learning,'' Robotics and Autonomous Systems, vol. 15, pp. 135-142, 1995.

16

A. S. Rao and M. P. Georgeff, ``Bdi agents: From theory to practice,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 312-319, AAAI Press, June 1995.

17

B. Hayes-Roth, L. Brownston, and R. van Gent, ``Multiagent collaboration in directed improvisation,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 148-154, AAAI Press, June 1995.

18

J. A. Sanchez, F. S. Azevedo, and J. J. Leggett, ``Paragente: Exploring the issues in agent-based user interfaces,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 320-327, AAAI Press, June 1995.

19

I. A. Ferguson and G. J. Karakoulas, ``Multiagent learning and adaptation in an information filtering market,'' in Adaptation, Coevolution and Learning in Multiagent Systems: Papers from the 1996 AAAI Spring Symposium, (Menlo Park,CA), pp. 28-32, AAAI Press, March 1996. AAAI Technical Report SS-96-01.

20

K. S. Decker, Environment Centered Analysis and Design of Coordination Mechanisms. PhD thesis, University of Massachusetts, 1995.

21

L. M. Stephens and M. B. Merx, ``The effect of agent control strategy on the performance of a dai pursuit problem,'' in Proceedings of the 10th International Workshop on Distributed Artificial Intelligence, (Bandera, Texas), October 1990.

22

J. M. Vidal and E. H. Durfee, ``Recursive agent modeling using limited rationality,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 376-383, AAAI Press, June 1995.

23

R. Levy and J. S. Rosenschein, ``A game theoretic approach to the pursuit problem,'' in Working Papers of the 11th International Workshop on Distributed Artificial Intelligence, pp. 195-213, February 1992.

24

R. E. Korf, ``A simple solution to pursuit games,'' in Working Papers of the 11th International Workshop on Distributed Artificial Intelligence, pp. 183-194, February 1992.

25

T. Haynes, K. Lau, and S. Sen, ``Learning cases to compliment rules for conflict resolution in multiagent systems,'' in Adaptation, Coevolution and Learning in Multiagent Systems: Papers from the 1996 AAAI Spring Symposium, (Menlo Park,CA), pp. 51-56, AAAI Press, March 1996. AAAI Technical Report SS-96-01.

26

T. Balch and R. C. Arkin, ``Motor schema-based formation control for multiagent robot teams,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 10-16, AAAI Press, June 1995.

27

S. Roychowdhury, N. Arora, and S. Sen, ``Effects of local information on group behavior,'' in Adaptation, Coevolution and Learning in Multiagent Systems: Papers from the 1996 AAAI Spring Symposium, (Menlo Park,CA), pp. 78-83, AAAI Press, March 1996. AAAI Technical Report SS-96-01.

28

E. H. Durfee, ``Blissful ignorance: Knowing just enough to coordinate well,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 406-413, AAAI Press, June 1995.

29

J. Schmidhuber, ``A general mehod for multi-agent reinforcement learning in unrestricted environments,'' in Adaptation, Coevolution and Learning in Multiagent Systems: Papers from the 1996 AAAI Spring Symposium, (Menlo Park,CA), pp. 84-87, AAAI Press, March 1996. AAAI Technical Report SS-96-01.

30

O. Holland, ``Multiagent systems: Lessons from social insects and collective robotics,'' in Adaptation, Coevolution and Learning in Multiagent Systems: Papers from the 1996 AAAI Spring Symposium, (Menlo Park,CA), pp. 57-62, AAAI Press, March 1996. AAAI Technical Report SS-96-01.

31

M. J. Mataric, ``Interaction and intelligent behavior,'' MIT EECS PhD Thesis AITR-1495, MIT AI Lab, August 1994.

32

M. K. Sahota, ``Reactive deliberation: An architecture for real-time intelligent control in dynamic environments,'' in Proceedings of the Twelfth National Conference on Artificial Intelligence, pp. 1303-1308, 1994.

33

L. P. Kaelbling, M. L. Littman, and A. W. Moore, ``Reinforcement learning: A survey,'' Journal of Artificial Intelligence Research, vol. 4, pp. 237-285, May 1996.

34

T. Haynes, R. Wainwright, S. Sen, and D. Schoenefeld, ``Strongly typed genetic programming in evolving cooperation strategies,'' in Proceedings of the Sixth International Conference on Genetic Algorithms (S. Forrest, ed.), (San Mateo, CA), pp. 271-278, Morgan Kaufman, July 1995.

35

T. Haynes and S. Sen, ``Evolving behavioral strategies in predators and prey,'' in Adaptation and Learning in Multiagent Systems (G. Weißand S. Sen, eds.), pp. 113-126, Berlin: Springer Verlag, 1996.

36

Y. Mor and J. Rosenschein, ``Time and the prisoner's dilemma,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 276-282, AAAI Press, June 1995.

37

M. L. Littman, ``Markov games as a framework for multi-agent reinforcement learning,'' in Proceedings of the Eleventh International Conference on Machine Learning, (San Mateo, CA), pp. 157-163, Morgan Kaufman, 1994.

38

J. Grefenstette and R. Daley, ``Methods for competitive and cooperative co-evolution,'' in Adaptation, Coevolution and Learning in Multiagent Systems: Papers from the 1996 AAAI Spring Symposium, (Menlo Park,CA), pp. 45-50, AAAI Press, March 1996. AAAI Technical Report SS-96-01.

39

C. D. Rosin and R. K. Belew, ``Methods for competitive co-evolution: Finding opponents worth beating,'' in Proceedings of the Sixth International Conference on Genetic Algorithms (S. Forrest, ed.), (San Mateo,CA), pp. 373-380, Morgan Kaufman, July 1995.

40

M. J. Huber and E. H. Durfee, ``Deciding when to commit to action during observation-based coordination,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 163-170, AAAI Press, June 1995.

41

Y. Permpoontanalarp, ``Generalised proof-theory for multi-agent autoepistemic reasoning,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 304-311, AAAI Press, June 1995.

42

M. Tambe, ``Recursive agent and agent-group tracking in a real-time , dynamic environment,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 368-375, AAAI Press, June 1995.

43

M. Tambe, ``Tracking dynamic team activity,'' in Proceedings of the Thirteenth National Conference on Artificial Intelligence, (Menlo Park, California), AAAI Press, 1996.

44

J. S. Sichman and Y. Demazeau, ``Exploiting social reasoning to deal with agency level inconistency,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 352-359, AAAI Press, June 1995.

45

N. Arora and S. Sen, ``Resolving social dilemmas using genetic algorithms,'' in Adaptation, Coevolution and Learning in Multiagent Systems: Papers from the 1996 AAAI Spring Symposium, (Menlo Park,CA), pp. 1-5, AAAI Press, March 1996. AAAI Technical Report SS-96-01.

46

A. Schaerf, Y. Shoham, and M. Tennenholtz, ``Adaptive load balancing: A study in multi-agent learning,'' Journal of Artificial Intelligence Research, vol. 2, pp. 475-500, 1995.

47

M. Fenster, S. Kraus, and J. S. Rosenschein, ``Coordination without communication: Experimental validation of focal point techniques,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 102-108, AAAI Press, June 1995.

48

A. Walker and M. Wooldridge, ``Understanding the emergence of conventions in multi-agent systems,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 384-389, AAAI Press, June 1995.

49

M. V. N. Prasad, V. R. Lesser, and S. E. Lander, ``Learning organizational roles in a heterogeneous multi-agent system,'' in Adaptation, Coevolution and Learning in Multiagent Systems: Papers from the 1996 AAAI Spring Symposium, (Menlo Park,CA), pp. 72-77, AAAI Press, March 1996. AAAI Technical Report SS-96-01.

50

X. Wang, ``Planning while learning operators,'' in Proceedings of the Third International Conference on AI Planning Systems, May 1996.

51

N. S. Glance and T. Hogg, ``Dilemmas in computational societies,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 117-124, AAAI Press, June 1995.

52

M. Tan, ``Multi-agent reinforcement learning: Independent vs. cooperative agents,'' in Proceedings of the Tenth International Conference on Machine Learning, pp. 330-337, 1993.

53

E.-I. Osawa, ``A metalevel coordination strategy for reactive cooperative planning,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 297-303, AAAI Press, June 1995.

54

M. R. Genesereth and R. E. Fikes, ``Knowledge interchange format, version 3.0 reference manual,'' Technical Report Logic-92-1, Computer Science Department, Stanford University, 1992.

55

T. Finin, D. McKay, R. Fritzson, and R. McEntire, ``Kqml: An information and knowledge exchange protocol,'' in Knowledge Building and Knowledge Sharing (K. Fuchi and T. Yokoi, eds.), Ohmsha and IOS Press, 1994.

56

P. R. Cohen and H. J. Levesque, ``Communicative actions for artificial agents,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 65-72, AAAI Press, June 1995.

57

A. Lux and D. Steiner, ``Understanding cooperation: an agent's perspective,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 261-268, AAAI Press, June 1995.

58

M. J. Mataric, ``Learning to behave socially,'' in Third International Conference on Simulation of Adaptive Behavior, 1994.

59

D. Zeng and K. Sycara, ``Bayesian learning in negotiation,'' in Adaptation, Coevolution and Learning in Multiagent Systems: Papers from the 1996 AAAI Spring Symposium, (Menlo Park,CA), pp. 99-104, AAAI Press, March 1996. AAAI Technical Report SS-96-01.

60

J. A. Clouse, ``Learning from an automated training agent,'' in Adaptation and Learning in Multiagent Systems (G. Weißand S. Sen, eds.), Berlin: Springer Verlag, 1996.

61

M. A. Potter, K. A. D. Jong, and J. J. Grefenstette, ``A coevolutionary approach to learning sequential decision rules,'' in Proceedings of the Sixth International Conference on Genetic Algorithms (S. Forrest, ed.), (San Mateo,CA), pp. 366-372, Morgan Kaufman, July 1995.

62

L. Bull, T. Fogarty, and M. Snaith, ``Evolution in multi-agent systems: Evolving communicating classifier systems for gait in a quadrupedal robot,'' in Proceedings of the Sixth International Conference on Genetic Algorithms (S. Forrest, ed.), (San Mateo,CA), pp. 382-388, Morgan Kaufman, July 1995.

63

T. Sandholm and V. Lesser, ``Issues in automated negotiation and electronic commerce: Extending the contract net framework,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 328-335, AAAI Press, June 1995.

64

B. Huberman and S. H. Clearwater, ``A multi-agent system for controlling building environments,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 171-176, AAAI Press, June 1995.

65

K. S. Decker and V. R. Lesser, ``Designing a family of coordination algorithms,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 73-80, AAAI Press, June 1995.

66

C. Castelfranchi, ``Commitments: From individual intentions to groups and organizations,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 41-48, AAAI Press, June 1995.

67

A. Haddadi, ``Towards a pragmatic theory of interactions,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 133-139, AAAI Press, June 1995.

68

G. Zlotkin and J. S. Rosenschein, ``Coalition, cryptography, and stability: Mechanisms for coalition formation in task oriented domains,'' in Proceedings of the Twelfth National Conference on Artificial Intelligence, (Menlo Park, California), pp. 432-437, AAAI Press, August 1994.

69

M. Barbuceanu and M. S. Fox, ``Cool: A language for describing coordination in multi agent systems,'' in Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park, California), pp. 17-24, AAAI Press, June 1995.

70

R. G. Smith, ``The contract net protocol: High-level communication and control in a distributed problem solver.,'' IEEE Transactions on Computers, vol. C-29, pp. 1104-1113, December 1980.

71

J.-H. Kim, ``Third call for participation: Micro-robot world cup soccer tournament (mirosot'96),'' 1996. Accessible from http://vivaldi.kaist.ac.kr/.

72

H. Kitano, M. Asada, Y. Kuniyoshi, I. Noda, and E. Osawa, ``Robocup: The robot world cup initiative,'' in IJCAI-95 Workshop on Entertainment and AI/Alife, (Montreal, Quebec), pp. 19-24, August 1995.

73

M. K. Sahota, A. K. Mackworth, R. A. Barman, and S. J. Kingdon, ``Real-time control of soccer-playing robots using off-board vision: the dynamite testbed,'' in IEEE International Conference on Systems, Man, and Cybernetics, pp. 3690-3663, 1995.

74

M. Asada, E. Uchibe, S. Noda, S. Tawaratsumida, and K. Hosoda, ``Coordination of multiple behaviors acquired by vision-based reinforcement learning,'' in Proc. of IEEE/RSJ/GI International Conference on Intelligent Robots and Systems 1994 (IROS '94), pp. 917-924, 1994.

75

S. Achim, P. Stone, and M. Veloso, ``Building a dedicated robotic soccer system.'' Submitted to International Conference on Intelligent Robots and Systems 1996 (IROS '96), November 1996.

76

I. Noda, ``Soccer server : a simulator of robocup,'' in Proceedings of AI symposium '95, pp. 29-34, Japanese Society for Artificial Intelligence, December 1995.

77

K. S. Decker, ``Distributed artificial intelligence testbeds,'' in Foundations of Distributed Artificial Intelligence (G. M. P. O'Hare and N. R. Jennings, eds.), pp. 119-138, Wiley Interscience, 1996.

78

P. Stone and M. Veloso, ``Beating a defender in robotic soccer: Memory-based learning of a continuous function,'' in Advances in Neural Information Processing Systems 8 (D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, eds.), (Cambridge, MA), MIT press, 1996.

79

P. Stone and M. Veloso, ``Broad learning from narrow training: A case study in robotic soccer,'' Technical Report CMU-CS-95-207, Computer Science Department, Carnegie Mellon University, 1995. Reduced version submitted to Neural Information Processing Systems 1996 (NIPS*96).

80

H. Matsubara, I. Noda, and K. Hiraki, ``Learning of cooperative actions in multi-agent systems: a case study of pass play in soccer,'' in Adaptation, Coevolution and Learning in Multiagent Systems: Papers from the 1996 AAAI Spring Symposium, (Menlo Park,CA), pp. 63-67, AAAI Press, March 1996. AAAI Technical Report SS-96-01.

81

AAAI, Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), (Menlo Park,CA), AAAI Press, June 1995. Victor Lessor-General Chair.

Peter Stone is a Ph.D. candidate in Computer Science at Carnegie Mellon University (CMU). He completed his undergraduate education in Mathematics with a concentration in Computer Science at the University of Chicago in 1993. His interests are in the areas of multiagent systems, collaborative and adversarial machine learning, and planning, especially in multiagent, real-time environments.

Peter Stone
Computer Science Department
Carnegie Mellon University
Pittsburgh, PA   15213-3891
Tel:  (412) 268-7123
Fax:  (412) 268-5576
e-mail: pstone@cs.cmu.edu
WWW: http://www.cs.cmu.edu/~pstone

Manuela Veloso is Finmeccanica Assistant Professor in Computer Science at Carnegie Mellon University (CMU). She received her Ph.D. in in Computer Science from Carnegie Mellon University in 1992. She received an M.S. degree in Computer Science from Boston University in 1986. She also received an M.S. degree in Electrical and Computer Engineering and a B.S. in Electrical Engineering from the Instituto Superior Técnico in Lisbon, Portugal. Dr. Veloso's research interests include planning, analogical reasoning, and the combination of analytical and inductive learning methods. She also investigates methods in which perception and learning are combined to address jointly high-level and low-level reasoning tasks, and multiagent collaborative and adversarial planning and learning scenarios, such as robotics soccer. Dr. Veloso's long term general research goal is to bring AI systems and algorithms to a level that makes them efficiently applicable to real-world problems. Dr. Veloso aims at the development of autonomous agents capable of perceiving their surroundings through sensors, and improving their perception and problem solving ability through experience.

Manuela Veloso
Computer Science Department
Carnegie Mellon University
Pittsburgh, PA   15213-3891
Tel:  (412) 268-8464
Fax:  (412) 268-5576
e-mail: veloso@cs.cmu.edu
WWW: http://www.cs.cmu.edu/~mmv

We would like to thank Keith Decker, Rala Stone, Russell Stone, and Astro Teller for their helpful comments and suggestions.

This research is sponsored by the Wright Laboratory, Aeronautical Systems Center, Air Force Materiel Command, USAF, and the Advanced Research Projects Agency (ARPA) under grant number F33615-93-1-1330. The views and conclusions contained in this document are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Wright Laboratory or the U. S. Government.