The success of WebWatcher depends crucially on the quality of its knowledge for guiding search. Because of the difficulty of hand-crafting this knowledge, and because we wish for many different copies of WebWatcher to become knowledgeable about many different regions of the Web, we are exploring methods for automatically learning this search control knowledge from experience.