Before moving over to the ETC & HCII, I was a Senior Member of the Technical Staff at the Software Engineering Institute from 1987-1997. At the SEI I led the Advanced Learning Technologies (ALT) Project, blending AI techniques and digital video technology in the creation of a code inspection course. Latter I led projects exploring the use of multimedia for requirements elicitation, and improving the utility of large multimedia databases for both software engineering tools and training. This included work on the Advanced Multimedia Organizer for Requirements Elicitation (AMORE) which was the forerunner to the Informedia Digital Video Library Project. We recently finished working on the Silver Project, developing an intelligent editor for Informedia video.
In collaboration with faculty at UPMC's Western Psychiatric Institute and Clinic we investigated applications of CMU Informedia technologies to clinical research and patient quality of life. Called CareMedia this five-year research projects funded by NSF Information Technology Research program created a meaningful, manageable information resource that enables more complete and accurate assessment, diagnosis, treatment, and evaluation of behavioral problems for the elderly. During this project we recorded video from 24 cameras in a dementia ward, 24 hours a day for 30 days. The resulting 17,000 hours of video were automatically analyzed using image, speech, and languages technologies resulting in the largest study of the social and behavioral ecology of a dementia unit
ALPS: Putting a Face on Cognitive Tutors was a five-year research project also funded by the NSF-ITR program. This project built an “active learning” environment combining the framework and benefits of cognitive tutors with the support of “active inquiry” through synthetic interviews.