Physical Events: Input

The user has two input devices, the mouse and a microphone. The keyboard is used only in restricted situations, such as entering a new subject ID, and never by children.

The system can recognize the following physical events:

• Mouse clicks in the tutor window
• Onset of sound
• Onset of silence

Logical Events

System-Level Logical Events

• No Action
• Startup
• Open Story
• Pause
• Unpause

User Logical Events

• Request Help on Sentence
• Request Help on Word
• Request New Story
• Request Introduction
• Request Playback
• Interrupt
• Go Back
• Go Forward
• Reach End of Story
• Right Click (otherwise unclassified)
• Middle Click (otherwise unclassified)
• Left Click (otherwise unclassified)
• Click on Invalid Word

Listener Logical Events

• Update Hypothesis
• Detect EOS
• Detech Speech
• Detect Continued Speech (not used)
• Detect Silence
• Buffer Full (Heard Enough)
• Final Utterance

Player Logical Events

• Play Sound
• Show Text (not used)
• Highlight
• Unhighlight
• Gray Sentence
• Ungray sentence
• Mask word

Tutor Logical Events

• Self Interrupt
• Interrupt User
• Backchannel
• Unstick
• Take Turn
• Prompt User
• Give Preemptive Help
• Read Sentence (obsolete)
• Read Word (obsolete)
• Read Phrase (obsolete)
• Stop Speaking
• Go Forward
• Stay in Sentence
• Display (New) Sentence
• Suggest New Story

Turn-taking events are instantiated with respect to the current context (student performance and discourse module) to yield specific interventions such as reading a word.

Physical Events: Output

The system can display text, play sound files (including sentence and word recordings), and display new sentences.