Introduction to this Course: What is an Interaction Technique and Why are they Important?

Slides for Lecture 1, and Panopto video

Recommended Readings:

• Brad A. Myers. "Challenges of HCI Design and Implementation," ACM Interactions. vol. 1, no. 1. January, 1994. pp. 73-83. pdf

History of Personal Computers and their Interaction Techniques

Slides for Lecture 2, and Panopto video

Required Readings:

• Brad A. Myers. "A Brief History of Human Computer Interaction Technology." ACM interactions. Vol. 5, no. 2, March, 1998. pp. 44-54. pdf
• Ivan Sutherland Sketchpad Demo, 20:42 min Video, 1964. mpg or (YouTube1 and YouTube2)
• Bill Moggridge, "Designing Interactions" excerpt #1, pp. 17 – 111. (on blackboard--only accessible to class members)

Recommended Readings:

• William L. Bewley, Teresa L. Roberts and William L. Verplank David Schroit. “Human Factors Testing in the Design of Xerox's 8010 'Star' Office Workstation,” Proceedings SIGCHI'83: Human Factors in Computing Systems, Boston, MA, Dec, 1983. pp. 72-77. ACM ref
• Ivan E. Sutherland. “Sketchpad: A Man-Machine Graphical Communication System,” AFIPS Spring Joint Computer Conference, 1963. pp. 329-346. ACM ref
• Larry Tesler. “The Smalltalk Environment,” Byte Magazine. Aug, 1981. 6(8). pp. 90-147. archive.org version
• Gregg Williams. “The Lisa Computer System,” Byte Magazine. Feb, 1983. 8(2). pp. 33-50. archive.org version

Start on Homework 1

No Class: MLK Day

Studying Interaction Techniques: Fitts Law to Formal Studies

Slides for Lecture 3, and Panopto video
Here is the spreadsheet Jeff used.

Required Readings:

• McIver, JP., "Introduction to Quantitative Methods", on-line pdf
• Card, S.K., English, W.K., & Burr, B.J. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics, 21(8), pp. 601-613. 1978. pdf
• Brad A. Myers, Rishi Bhatnagar, Jeffrey Nichols, Choon Hong Peck, Dave Kong, Robert Miller, and A. Chris Long. "Interacting At a Distance: Measuring the Performance of Laser Pointers and Other Devices." Proceedings CHI'2002: Human Factors in Computing Systems. Minneapolis, Minnesota, April 20-25, 2002. pp. 33-40. pdf.

Recommended Readings:

• Wobbrock, J. O., Shinohara, K. and Jansen, A. (2011). The effects of task dimensionality, endpoint deviation, throughput calculation, and experiment design on pointing measures and models. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '11). Vancouver, British Columbia (May 7-12, 2011). New York: ACM Press, pp. 1639-1648. ACM ref
• Soukoreff, R. W. and MacKenzie, I. S. (2004). Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI. International Journal of Human-Computer Studies 61 (6), pp. 751-789. ScienceDirect

History of Handhelds (PDAs to Smartphones) and their Interaction Techniques

Slides for Lecture 4, and Panopto video

Required Readings:

• Bill Moggridge, "Designing Interactions" excerpt #2, pp. 180-235. (on blackboard--only accessible to class members)

Recommended Readings:

• Eric Bergman, Ed. Information Appliances and Beyond. San Francisco, Morgan Kaufmann Publishers. 2000. excerpt, pp. 82-129. (on blackboard--only accessible to class members)
• GO Corporation - Introducing PenPoint (1991), 15:20 video on YouTube

Deep Dive: Desktop Metaphors, Icons, Window Managers

Slides for Lecture 5, and Panopto video

Required Readings:

• All the Widgets video, vimeo or download wmv file (600MB), sections: "Introduction" (0:00 - 02:30), and "Icons and windows", "Manipulating windows", "Conclusion and credits" (1:39:15 - 2:14:54 (end)).
• Brad A. Myers. “A Taxonomy of User Interfaces for Window Managers,” IEEE Computer Graphics and Applications. Sept, 1988. 8(5). pp. 65-84. IEEE DL or local pdf
  

Recommended Readings:

• Sara A. Bly and Jarrett K. Rosenberg. “A Comparison of Tiled and Overlapping Windows,” Human Factors in Computing Systems, Proceedings SIGCHI'86. Boston, Mass, Apr, 1986, 1986. pp. 101-106. ACM DL or pdf
  

Guest Lecture: David Canfield Smith (by Skype)

Slides relevant to Lecture 6, and Panopto video

David Canfield Smith coined the term "icons" in his landmark 1975 PhD thesis "Pygmalion: A Computer Program to Model and Stimulate Creative Thought". He was a leader of the user interface design team for the Xerox Star, which innovated many important interaction techniques which are still used today, and others which are arguably more effective than what we currently use. David was also leader in the area of Programming by Example. The picture at right shows David giving a demonstration to Brad at CHI'1995 of the KidSim system which eventually became Stagecast Creator. (Picture credit: Ben Shneiderman)

Required Readings:

• Nader Salha, SECOND CASE STUDY: THE XEROX STAR, in "Early Development of Modern GUI," Chapter 3 of Aesthetics & Art in the Early Development of Human-Computer Interfaces, Ph.D. thesis, 2012. (on blackboard--only accessible to class members). Book available on Amazon.
• David Canfield Smith, DigiBarn TV: Xerox Star 8010 Final Demo - Live Demo, YouTube Video

Recommended Readings:

• David Canfield Smith, Charles Irby, Ralph Kimball, Bill Verplank and Erik Harslem. “Designing the Star User Interface,” Byte. Apr, 1982. 7(4). pp. 242-282. on-line version

Homework 1 Due.
Start on Homework 2

Guest Lecture: Larry Tesler (by Skype)

Slides for Lecture 7 in pdf or in keynote and Panopto video

Larry Tesler's work at Xerox PARC and Apple has impacted literally every computer user today. He was closely involved in the invention of a many of the now-familiar low-level interaction techniques in all graphical user interfaces. These included cut-copy-and-paste editing along with their keyboard shortcuts, inserting and overwriting text without entering a mode by simply clicking or dragging and then typing, typing or pasting find and replace text into a form that can be edited before and after searching, between-character text insertion points, drop-down menus, paned-window browsing (now called frames in web browsers), and the GUI integrated development environment (IDE) for programmers including code browsers, object inspectors and stack-inspection debuggers. The picture at right is me giving Larry the "SIGCHI Lifetime Practice Award" at CHI'2011. Picture by Ben Shneiderman.

Deep Dive: Menus
(Jeff out of town)

Slides for Lecture 8, and Panopto video

Required Readings:

• All the Widgets video, vimeo or download wmv file (600MB), sections: "Menus", "Palettes", "Buttons", "Radio buttons", "Checkboxes" (00:17:16 - 01:01:14), and "Forms and dialog boxes" (01:21:31 - 01:30:05)
• J. Callahan, D. Hopkins, M. Weiser, and B. Shneiderman. 1988. An empirical comparison of pie vs. linear menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '88), J. J. O'Hare (Ed.). ACM, New York, NY, USA, 95-100. ACM ref or local pdf.

Recommended Readings:

• Benjamin B. Bederson. 2000. "Fisheye menus". In Proceedings of the 13th annual ACM symposium on User interface software and technology (UIST '00). ACM, New York, NY, USA, 217-225. ACM DL
• Gordon Kurtenbach and William Buxton. 1993. "The limits of expert performance using hierarchic marking menus." In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93). ACM, New York, NY, USA, 482-487. ACM DL
  
• Gordon Kurtenbach and William Buxton. 1994. "User learning and performance with marking menus." In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94), Beth Adelson, Susan Dumais, and Judith Olson (Eds.). ACM, New York, NY, USA, 258-264. ACM DL
  

Deep Dive: Selecting and Creating Objects across Different Kinds of Views

Slides for Lecture 9, and Panopto video

Required Readings:

• All the Widgets video, vimeo or download wmv file (600MB), sections: "Selecting text" (01:01:43 - 01:13:26) and "Selecting graphical objects", "Editing graphical objects" (01:30:07 - 01:39:15)

Recommended Readings:

• Brad A. Myers. (1998) "Scripting Graphical Applications by Demonstration," Proceedings CHI'98. pp. 534-541. ACM DL, or local pdf, and video or YouTube (3:09). (Topaz)

Deep Dive: Scrolling Techniques & Sliders

Slides for Lecture 10, and Panopto video

Required Readings:

• All the Widgets video, vimeo or download wmv file (600MB), sections: "Scroll bars" (00:02:30 - 00:17:16)
• William Buxton and Brad Myers. "A Study in Two-Handed Input," Proceedings SIGCHI '86: Human Factors in Computing Systems. Boston, MA. April 13-17, 1986. pp. 321-326. pdf or html and video.
• Brad Myers, Kin Pou ("Leo") Lie and Bo-Chieh ("Jerry") Yang, "Two-Handed Input Using a PDA and a Mouse", Proceedings CHI'2000: Human Factors in Computing Systems. April 1-6, 2000. The Hague, The Netherlands. pp. 41-48. local pdf .

Homework 2 Due.
Start on Homework 3

Formal Models and Design Spaces for Interaction Techniques

Slides for Lecture 11, and Panopto video

Recommended Readings:

• William Buxton, "Lexical and Pragmatic Considerations of Input Structures," Computer Graphics, January, 1983, (17)1, pp. 31-37.  ACM DL  or local html.
• Brad A. Myers. 1990. A new model for handling input. ACM Trans. Inf. Syst. 8, 3 (July 1990), pp. 289-320. ACM DL or local pdf.

Past to Future: Text Entry for Computers and Handhelds, and Text Editing

Slides for Lecture 12, and Panopto video

Required Readings:

• All the Widgets video, vimeo or download wmv file (600MB), sections: "Entering input" (01:13:26 - 01:21:31)
• Jacob O. Wobbrock and Brad A. Myers. 2006. Analyzing the input stream for character- level errors in unconstrained text entry evaluations. ACM Trans. Comput.-Hum. Interact. 13, 4 (December 2006), pp. 458-489. ACM DL or local pdf.
  Note: You can skip section 4 -- you do not need to read about the algorithms.
  

(Brad away)

TA Lecture: Ergonomics and Human Factors for Interaction Techniques

Slides for Lecture 13, and Panopto video

Required Readings:

• Scott R. Klemmer, Bjorn Hartmann, and Leila Takayama. 2006. How bodies matter: five themes for interaction design. In Proceedings of the 6th conference on Designing Interactive systems (DIS '06). ACM, pp. 140-149. ACM DL
  
• Bonnie E. John and David E. Kieras. 1996. Using GOMS for user interface design and evaluation: which technique?. ACM Trans. Comput.-Hum. Interact. 3, 4 (December 1996), pp. 287-319. ACM DL
  Note: You should just skim this and check out the case studies to get an idea of how to go about doing this sort of stuff.
  

Guest Lecture: Ted Selker (by Skype)

Slides for Lecture 14, link to the video shown during the talk, and Panopto video

Ted Selker is probably best known as the inventor of the TrackPoint in-keyboard pointing device while he was at IBM, but he has also invented a large number of other devices and interaction techniques (he has 58 patents issued or pending). Here is his bio:

Ted Selker manages Research on Accessible Voting at University of California Berkeley. Ted spent 5 years as director of Considerate Systems research at Carnegie Mellon University Silicon Valley. He was also responsible for developing the campus's research mission, teaching HCI, Android product design, and research in voting with disabilities.

He is well known as a creator and tester of new scenarios for working with computing systems. His design practice includes speaking engagements, innovation workshops consulting. He is CTO of Foldimate for which he made a shirt-folding robot this year.

Ted spent ten years as an associate Professor at the MIT Media Laboratory where he created the Context Aware Computing group, co-directed the Caltech/MIT Voting Technology Project, and directed the CIDI Kitchen of the future/ product design of the future project. His work is noted for creating demonstrations of a more considerate world in which intentions are recognized and respected in complex domains.

His successes at targeted product creation and enhancement lead to his role of IBM Fellow and director of User Systems Ergonomics Research at IBM. He has also served as a consulting professor at Stanford University, taught at Hampshire, University of Massachusetts at Amherst and Brown Universities and worked at Xerox PARC and Atari Research Labs.

Ted's innovation has been responsible for profitable and award winning products ranging from notebook computers to operating systems. For example, his design of the TrackPoint in-keyboard pointing device is used in many notebook computers. His visualization and visual interface work has made impacts in the performance of the PowerPC, usability in OS/2, ThinkPad setup, Google maps, etc. His adaptive help system has been the basis of products as well. Ted's work has resulted in numerous awards, patents, and papers and has often been featured in the press. Ted was co-recipient of the Computer Science Policy Leader Award for Scientific American 50 in 2004, the American Association for People with Disabilities Thomas Paine Award for his work on voting technology in 2006 and the Telluride Tech fest award in 2008.

Homework 3 Due.
Start on Homework 4

Past to Future: Interactions in 3D, Very Large Displays, and Virtual Reality

Slides for Lecture 16, and Panopto video

Recommended Readings:

• Rick Carey, Tony Fields, Andries van Dam, Dan Venolia. 1994. Why is 3-D interaction so hard and what can we really do about it? (panel). In Proceedings SIGGRAPH '94. ACM, pp. 492-493. ACM DL
• Michael Chen, S. Joy Mountford, and Abigail Sellen. 1988. A study in interactive 3-D rotation using 2-D control devices. In Proceedings SIGGRAPH '88. ACM pp. 121-129.ACM DL

Homework 4 Due.
Start on Final Project

TA Lecture: Past to Future: Interactions for Game Control & Consumer Electronics

Slides for Lecture 17, and Panopto video

Required Readings:

• Steve Swink. Game Feel. CRC Press. Chapters 1, 6, and 7. (on blackboard--only accessible to class members)
  (Note: Game Feel is written by a game designer rather than a traditional HCI practitioner, so he doesn't practice the formal study of interaction techniques. Think about how our class techniques and his approach relate as you're reading. Because he is a game designer, he may reference video games in passing with which you may be unfamiliar. If you're interested, YouTube is filled with demo videos that can show you what the game looks like and how it plays, especially if you add "review" or "gameplay" to your search.)

Recommended Readings:

• Steve Swink. Game Feel. CRC Press. Chapter 15. (on blackboard--only accessible to class members)
• Video of Game Controllers from 1972 to 2006. http://youtu.be/Q-03HmcjOPs
• Video about the camera design of Super Mario World (2d predecessor to
  Super Mario 64): http://youtu.be/TCIMPYM0AQg

Topics for Final Projects due

Interaction Techniques for People with Disabilities

Slides for Lecture 18, and Panopto video

Required Readings:

• Brad A. Myers, Jacob O. Wobbrock, Sunny Yang, Brian Yeung, Jeffrey Nichols, and Robert Miller. "Using Handhelds to Help People with Motor Impairments", Fifth International ACM SIGCAPH Conference on Assistive Technologies; ASSETS 2002. July 8-10, 2002. Edinburgh, Scotland. pp. 89-96. local pdf
• W3C, "Introduction to Web Accessibility," on-line

Form Final Project Groups due

Physical Gadgets and their Interaction Techniques

Slides for Lecture 19, and Panopto video

Required Readings:

• Saul Greenberg and Chester Fitchett. 2001. Phidgets: easy development of physical interfaces through physical widgets. In Proceedings of the 14th annual ACM symposium on User interface software and technology (UIST '01). ACM, pp. 209-218. ACM DL or local pdf
  NOTE: only pages 209-211 and 215-218 (not the architecture)

Recommended Readings:

• Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical atoms: beyond tangible bits, toward transformable materials. interactions 19, 1 (January 2012), 38-51. ACM DL

Slides for Lecture 20, and Panopto video

Required Readings:

• Brad A. Myers. (1998) "Scripting Graphical Applications by Demonstration," Proceedings CHI'98. pp. 534-541. ACM DL, or local pdf, and video or YouTube (3:09). (Topaz)

Recommended Readings:

• Kurlander, D. and Feiner, S. Editable Graphical Histories. Proc. 1988 IEEE Workshop on Visual Languages. (Pittsburgh, Oct. t0-12, 1988). 127-134. IEEE DL, or pdf and video (2:42)

Two-page proposal for Projects due

Past to Future: Gesture Recognition and Its Algorithms

Slides for Lecture 21, and Panopto video

Required Readings:

• Video: Dean Rubine. 1992. Combining gestures and direct manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92), ACM, actual video or (ACM Ref for description)

Recommended Readings:

• Paper: Dean Rubine. 1991. Specifying gestures by example. In Proceedings of the 18th annual conference on Computer graphics and interactive techniques (SIGGRAPH '91). ACM, 329-337. ACM DL

Legal Issues Around Interaction Techniques such as Patents

Slides for Lecture 22, and Panopto video

Required Readings:

• Brad A. Myers, "Legal and Intellectual Property Issues," sidebar in The UX Book: Process and Guidelines for Ensuring a Quality User Experience, by: Rex Hartson & Pardha S. Pyla. Waltham, MA: Elsevier/Morgan Kaufmann, 2012. pp. 851-852. (on blackboard--only accessible to class members)

Recommended Readings:

• Jacob O. Wobbrock and Brad A. Myers. "Using Edges and Corners for Character Input." US Patent No. 7,729,542, issued June 1, 2010, Filed March 29, 2004, claiming priority to provisional filed April 4, 2003. pdf

Guest Lecture: Chris Harrison

Slides for Lecture 23, and Panopto video

Seven years ago, multi-touch devices went mainstream, and changed our field, the industry and our lives. In that time, mobile devices have gotten much more capable, yet the core user experience has evolved little. Contemporary touch gestures rely on poking screens with different numbers of fingers: one-finger tap, two-finger pinch, three-finger swipe and so on. We often label these as "natural" interactions, yet the only place I perform these "gestures" is on my touchscreen device. We are also too quick to blame the "fat finger" problem for much of our touch interface woes - if a zipper or pen were too small to use, we would simply call that "bad design". Fortunately, our fingers and hands are amazing, and with good technology and design, we can elevate touch interaction to new heights. I believe the era of multi-touch is coming to a close, and that we are on the eve of an exciting new age of "rich-touch" devices and experiences.

Bio:
Chris Harrison is an Assistant Professor of Human-Computer Interaction at Carnegie Mellon University. He broadly investigates novel sensing technologies and interaction techniques, especially those that empower people to interact with small devices in big ways. Harrison was recently named as one of the top 30 scientists under 30 by Forbes, a top 35 innovator under 35 by MIT Technology Review, and one of six innovators to watch in 2013 by Smithsonian. Harrison has worked at Microsoft Research, IBM Research, AT&T Labs and Disney Research, and has been awarded Ph.D. fellowships by Google, Microsoft and Qualcomm. When not in the lab, Chris can be found welding sculptures, blowing glass, and visiting remote corners of the globe.

Interim Reports on Final Projects due

Implementation Techniques and Tools for Interaction Techniques

Slides for Lecture 24, and Panopto video

Recommended Readings:

• Brad Myers, Scott E. Hudson, and Randy Pausch, "Past, Present and Future of User Interface Software Tools," ACM Transactions on Computer Human Interaction. March, 2000. Vol. 7, no. 1. pp. 3-28. ACM ref or local pdf

Past to Future: Artificial Intelligence (AI) in Interaction Techniques

Slides for Lecture 25, and Panopto video

Final Project Presentations, 1

Panopto video

Final Project Presentations, 2

Panopto video

Everyone please fill out the Course Survey and also please do the official CMU course evaluations).