Introduction to this Course: What is an Interaction Technique and Why are they Important?

Slides for Lecture 1

Recommended Readings:

• Brad A. Myers. "Challenges of HCI Design and Implementation," ACM Interactions. vol. 1, no. 1. January, 1994. pp. 73-83. pdf

History of Personal Computers and their Interaction Techniques

Slides for Lecture 2

Required Readings:

• Brad A. Myers. "A Brief History of Human Computer Interaction Technology." ACM interactions. Vol. 5, no. 2, March, 1998. pp. 44-54. pdf
• Ivan Sutherland's Sketchpad Demo, 20:42 min Video, 1964. mpg or (YouTube1 and YouTube2)
• Bill Moggridge, "Designing Interactions" excerpt #1, pp. 17 – 111. (on blackboard--only accessible to class members)

Recommended Readings:

• William L. Bewley, Teresa L. Roberts and William L. Verplank David Schroit. “Human Factors Testing in the Design of Xerox's 8010 'Star' Office Workstation,” Proceedings SIGCHI'83: Human Factors in Computing Systems, Boston, MA, Dec, 1983. pp. 72-77. ACM ref
• Ivan E. Sutherland. “Sketchpad: A Man-Machine Graphical Communication System,” AFIPS Spring Joint Computer Conference, 1963. pp. 329-346. ACM ref
• Larry Tesler. “The Smalltalk Environment,” Byte Magazine. Aug, 1981. 6(8). pp. 90-147. archive.org version
• Gregg Williams. “The Lisa Computer System,” Byte Magazine. Feb, 1983. 8(2). pp. 33-50. archive.org version

Start on Homework 1

No Class: MLK Day

Pointing Devices and Fitts' Law

Slides for Lecture 3

Required Readings:

• Card, S.K., English, W.K., & Burr, B.J. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics, 21(8), pp. 601-613. 1978. pdf
• Brad A. Myers, Rishi Bhatnagar, Jeffrey Nichols, Choon Hong Peck, Dave Kong, Robert Miller, and A. Chris Long. "Interacting At a Distance: Measuring the Performance of Laser Pointers and Other Devices." Proceedings CHI'2002: Human Factors in Computing Systems. Minneapolis, Minnesota, April 20-25, 2002. pp. 33-40. pdf.
• Video of guest lecture by Ted Selker to 2014 class about the IBM Pointing Stick: Slides for his lecture, link to the video shown during the talk, and Panopto video of the talk

Recommended Readings:

• Wobbrock, J. O., Shinohara, K. and Jansen, A. (2011). The effects of task dimensionality, endpoint deviation, throughput calculation, and experiment design on pointing measures and models. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '11). Vancouver, British Columbia (May 7-12, 2011). New York: ACM Press, pp. 1639-1648. ACM ref
• Soukoreff, R. W. and MacKenzie, I. S. (2004). Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI. International Journal of Human-Computer Studies 61 (6), pp. 751-789. ScienceDirect

History of Handhelds (PDAs to Smartphones) and their Interaction Techniques

Slides for Lecture 4

Required Readings:

• Bill Moggridge, "Designing Interactions" excerpt #2, pp. 180-235. (on blackboard--only accessible to class members)

Recommended Readings:

• Eric Bergman, Ed. Information Appliances and Beyond. San Francisco, Morgan Kaufmann Publishers. 2000. excerpt, pp. 82-129. (on blackboard--only accessible to class members)
• GO Corporation - Introducing PenPoint (1991), 15:20 video on YouTube

Deep Dive: Desktop Metaphors, Icons, Window Managers

Slides for Lecture 5

Required Readings:

• All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Introduction" (0:00 - 02:30), and "Icons and windows", "Manipulating windows", "Conclusion and credits" (1:39:15 - 2:14:54 (end)).
• Video of guest lecture by David Canfield Smith to 2014 class about the invention of icons and the Star UI: Slides for his lecture and Panopto video of the talk
• Brad A. Myers. “A Taxonomy of User Interfaces for Window Managers,” IEEE Computer Graphics and Applications. Sept, 1988. 8(5). pp. 65-84. IEEE DL or local pdf
  

Recommended Readings:

• Sara A. Bly and Jarrett K. Rosenberg. “A Comparison of Tiled and Overlapping Windows,” Human Factors in Computing Systems, Proceedings SIGCHI'86. Boston, Mass, Apr, 1986, 1986. pp. 101-106. ACM DL or pdf
• David Canfield Smith, DigiBarn TV: Xerox Star 8010 Final Demo - Live Demo, YouTube Video
  

Guest Lecture #1: Norm Cox

Slides for Lecture 6 (pdf), and Panopto video

Required Readings:

• Nader Salha, SECOND CASE STUDY: THE XEROX STAR, in "Early Development of Modern GUI," Chapter 3 of Aesthetics & Art in the Early Development of Human-Computer Interfaces, Ph.D. thesis, 2012. (on blackboard--only accessible to class members). Book available on Amazon.

Recommended Readings:

• David Canfield Smith, Charles Irby, Ralph Kimball, Bill Verplank and Erik Harslem. “Designing the Star User Interface,” Byte. Apr, 1982. 7(4). pp. 242-282. on-line version

Norm Cox began his professional career at Xerox in 1972 designing typefaces for the company’s line of electronic typewriters. In 1978 he took his visual design skills to Xerox's famed Palo Alto Research Center in California as the visual and interface designer for the Xerox "Star" personal workstation, the world’s first graphical user interface. He designed many of the now-standard icons, including the "hamburger icon" to pop up a menu.

As a result of the industry-wide acceptance of the Star’s revolutionary “user friendly” design, Norm began his own consulting practice in 1982, where he has designed numerous diverse and award winning user interfaces for a broad range of domestic and international clients. He is named as inventor on 29 design patents relating to user interface design and is a frequent lecturer to businesses, universities and design conferences. He has also juried international design competitions and been an expert witness in high profile copyright infringement litigation relating to interaction and interface design.

Homework 1 Due.
Start on Homework 2

Deep Dive: Menus

Slides for Lecture 7

Required Readings:

• All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Menus", "Palettes", "Buttons", "Radio buttons", "Checkboxes" (00:17:16 - 01:01:14), and "Forms and dialog boxes" (01:21:31 - 01:30:05)
• J. Callahan, D. Hopkins, M. Weiser, and B. Shneiderman. 1988. An empirical comparison of pie vs. linear menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '88), J. J. O'Hare (Ed.). ACM, New York, NY, USA, 95-100. ACM ref or local pdf.

Recommended Readings:

• Benjamin B. Bederson. 2000. "Fisheye menus". In Proceedings of the 13th annual ACM symposium on User interface software and technology (UIST '00). ACM, New York, NY, USA, 217-225. ACM DL
• Gordon Kurtenbach and William Buxton. 1993. "The limits of expert performance using hierarchic marking menus." In Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93). ACM, New York, NY, USA, 482-487. ACM DL
  
• Gordon Kurtenbach and William Buxton. 1994. "User learning and performance with marking menus." In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94), Beth Adelson, Susan Dumais, and Judith Olson (Eds.). ACM, New York, NY, USA, 258-264. ACM DL

Deep Dive: Selecting and Creating Objects across Different Kinds of Views

Slides for Lecture 8

Required Readings:

• All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Selecting text" (01:01:43 - 01:13:26) and "Selecting graphical objects", "Editing graphical objects" (01:30:07 - 01:39:15)

Recommended Readings:

• Brad A. Myers. (1998) "Scripting Graphical Applications by Demonstration," Proceedings CHI'98. pp. 534-541. ACM DL, or local pdf, and video or YouTube (3:09). (Topaz)
  

Deep Dive: Scrolling Techniques & Sliders

Slides for Lecture 9

Required Readings:

• All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Scroll bars" (00:02:30 - 00:17:16)
• William Buxton and Brad Myers. "A Study in Two-Handed Input," Proceedings SIGCHI '86: Human Factors in Computing Systems. Boston, MA. April 13-17, 1986. pp. 321-326. pdf or html and video.
• Brad Myers, Kin Pou ("Leo") Lie and Bo-Chieh ("Jerry") Yang, "Two-Handed Input Using a PDA and a Mouse", Proceedings CHI'2000: Human Factors in Computing Systems. April 1-6, 2000. The Hague, The Netherlands. pp. 41-48. local pdf .

Formal Models and Design Spaces for Interaction Techniques

Slides for Lecture 10

Recommended Readings:

• William Buxton, "Lexical and Pragmatic Considerations of Input Structures," Computer Graphics, January, 1983, (17)1, pp. 31-37.  ACM DL  or local html.
• Brad A. Myers. 1990. A new model for handling input. ACM Trans. Inf. Syst. 8, 3 (July 1990), pp. 289-320. ACM DL or local pdf.

Homework 2 Due.
Start on Homework 3

Guest Lecture #2: Bruce Horn (by Skype)
(See also his personal web page)

Slides for Lecture 11 (pdf) and Panopto video (but there are audio problems)

Bruce Horn was a member of the original Apple Macintosh design team at Apple Computer, where he created the Macintosh Finder and the Macintosh Resource Manager. His signature is amongst those molded to the case of the Macintosh 128K. His name was mentioned in the 2015 Steve Jobs movie.

Bruce received a B.S. in Mathematical Sciences from Stanford University in 1982 and a M.S. and Ph.D. from Carnegie Mellon University in Computer Science in 1994. He was a student in the Learning Research Group of Xerox PARC where Smalltalk was developed starting while he was still in high school (1973–1981), and he overlapped at PARC in the summer of 1976 with Prof. Brad Myers who was a summer intern there from MIT. While there, Bruce worked on various projects including the NoteTaker, a portable Smalltalk machine, and wrote the initial Dorado Smalltalk microcode for Smalltalk.

Bruce was employed by Powerset as the principal development manager of the Natural Language Technology group. Powerset was acquired by Microsoft in the fall of 2008 and is part of Live Search. Currently, Horn is an Intel Fellow and Chief Scientist for Smart Device Innovation in the New Devices Group at Intel Corporation.

Past to Future: Text Entry for Computers and Handhelds, and Text Editing

Slides for Lecture 12

Required Readings:

• All the Widgets video, vimeo or YouTube or download wmv file (600MB), sections: "Entering input" (01:13:26 - 01:21:31)
• Video of guest lecture by Larry Tesler to 2014 class about the invention of copy and paste and other text editing ideas: Slides from his lecture in pdf or in keynote and Panopto video of lecture.
• Jacob O. Wobbrock and Brad A. Myers. 2006. Analyzing the input stream for character- level errors in unconstrained text entry evaluations. ACM Trans. Comput.-Hum. Interact. 13, 4 (December 2006), pp. 458-489. ACM DL or local pdf.
  Note: You can skip section 4 -- you do not need to read about the algorithms.
  

Guest Lecture #3: Loren Brichter (by Skype)

Slides for Lecture 13 (pdf) (including links to videos) and Panopto video (but the audio is a little warbled)

Loren was an engineer on the original iPhone at Apple. He left to start a company that made one of the most popular Twitter apps for iOS and Macintosh, Tweetie, which won an Apple design award. It was ultimately sold to Twitter and became the official client. He advises numerous companies, and is the inventor on several patents, including widely used pull-to-refresh interaction technique, which is now widely used on smartphones.

Ergonomics and Human Factors for Interaction Techniques

Slides for Lecture 14

Required Readings:

• Scott R. Klemmer, Bjorn Hartmann, and Leila Takayama. 2006. How bodies matter: five themes for interaction design. In Proceedings of the 6th conference on Designing Interactive systems (DIS '06). ACM, pp. 140-149. ACM DL

Homework 3 Due.
Start on Homework 4

(Mid-Semester Grades Due by 4:00 p.m. on Mon. March 7)

Past to Future: Interactions in 3D, Very Large Displays, and Virtual Reality

Slides for Lecture 16

Recommended Readings:

• Rick Carey, Tony Fields, Andries van Dam, Dan Venolia. 1994. Why is 3-D interaction so hard and what can we really do about it? (panel). In Proceedings SIGGRAPH '94. ACM, pp. 492-493. ACM DL
• Michael Chen, S. Joy Mountford, and Abigail Sellen. 1988. A study in interactive 3-D rotation using 2-D control devices. In Proceedings SIGGRAPH '88. ACM pp. 121-129.ACM DL

Homework 4 Due.
Start on Final Project

Guest Lecture #4: Tandy Trower (by Skype)

Slides for Lecture 17 and Panopto video (but the audio is a little warbled)

Tandy Trower has been a leader in the creation, marketing, and deployment of a wide variety of consumer and business products, as well as operating systems and developer tools for over 30 years. At Microsoft, Trower managed a wide variety of new initiatives and products that include the company's programming languages, the first releases of Windows, applications for the Apple Macintosh, as well as hardware products and games and educational software products. He also established Microsoft’s first usability labs and user-interface design services organization. In more recent years, he served as the founder and General Manager of the Microsoft Robotics group that created Microsoft Robotics Developer Studio. He is now the Founder and CEO of Hoaloha Robotics.

Topics for Final Projects due

Past to Future: Interactions for Game Control & Consumer Electronics

Slides for Lecture 18

Required Readings:

• Steve Swink. Game Feel. CRC Press. Chapters 1, 6, and 7. (on blackboard--only accessible to class members)
  (Note: Game Feel is written by a game designer rather than a traditional HCI practitioner, so he doesn't practice the formal study of interaction techniques. Think about how our class techniques and his approach relate as you're reading. Because he is a game designer, he may reference video games in passing with which you may be unfamiliar. If you're interested, YouTube is filled with demo videos that can show you what the game looks like and how it plays, especially if you add "review" or "gameplay" to your search.)

Recommended Readings:

• Steve Swink. Game Feel. CRC Press. Chapter 15. (on blackboard--only accessible to class members)
• Video of Game Controllers from 1972 to 2006. http://youtu.be/Q-03HmcjOPs
• Video about the camera design of Super Mario World (2d predecessor to
  Super Mario 64): http://youtu.be/TCIMPYM0AQg

Form Final Project Groups due

Physical Gadgets and their Interaction Techniques

Slides for Lecture 19

Required Readings:

• Saul Greenberg and Chester Fitchett. 2001. Phidgets: easy development of physical interfaces through physical widgets. In Proceedings of the 14th annual ACM symposium on User interface software and technology (UIST '01). ACM, pp. 209-218. ACM DL or local pdf
  NOTE: only pages 209-211 and 215-218 (not the architecture)

Recommended Readings:

• Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical atoms: beyond tangible bits, toward transformable materials. interactions 19, 1 (January 2012), 38-51. ACM DL

Interaction Techniques for People with Disabilities

Slides for Lecture 20

Required Readings:

• Brad A. Myers, Jacob O. Wobbrock, Sunny Yang, Brian Yeung, Jeffrey Nichols, and Robert Miller. "Using Handhelds to Help People with Motor Impairments", Fifth International ACM SIGCAPH Conference on Assistive Technologies; ASSETS 2002. July 8-10, 2002. Edinburgh, Scotland. pp. 89-96. local pdf
• W3C, "Introduction to Web Accessibility," on-line

Two-page proposal for Projects due

Past to Future: Various Undo Models, Interaction Histories, and Macro Recording

Slides for Lecture 21

Required Readings:

• Brad A. Myers. (1998) "Scripting Graphical Applications by Demonstration," Proceedings CHI'98. pp. 534-541. ACM DL, or local pdf, and video or YouTube (3:09). (Topaz)

Recommended Readings:

• Kurlander, D. and Feiner, S. Editable Graphical Histories. Proc. 1988 IEEE Workshop on Visual Languages. (Pittsburgh, Oct. t0-12, 1988). 127-134. IEEE DL, or pdf and video (2:42)

Past to Future: Gesture Recognition and Its Algorithms

Slides for Lecture 22

Required Readings:

• Video: Dean Rubine. 1992. Combining gestures and direct manipulation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92), ACM, actual video or (ACM Ref for description)

Recommended Readings:

• Paper: Dean Rubine. 1991. Specifying gestures by example. In Proceedings of the 18th annual conference on Computer graphics and interactive techniques (SIGGRAPH '91). ACM, 329-337. ACM DL

Legal Issues Around Interaction Techniques such as Patents

Slides for Lecture 23

Required Readings:

• Brad A. Myers, "Legal and Intellectual Property Issues," sidebar in The UX Book: Process and Guidelines for Ensuring a Quality User Experience, by: Rex Hartson & Pardha S. Pyla. Waltham, MA: Elsevier/Morgan Kaufmann, 2012. pp. 851-852. (on blackboard--only accessible to class members)

Recommended Readings:

• Jacob O. Wobbrock and Brad A. Myers. "Using Edges and Corners for Character Input." US Patent No. 7,729,542, issued June 1, 2010, Filed March 29, 2004, claiming priority to provisional filed April 4, 2003. pdf

Interim Reports on Final Projects due

Implementation Techniques and Tools for Interaction Techniques

Slides for Lecture 24

Recommended Readings:

• Brad Myers, Scott E. Hudson, and Randy Pausch, "Past, Present and Future of User Interface Software Tools," ACM Transactions on Computer Human Interaction. March, 2000. Vol. 7, no. 1. pp. 3-28. ACM ref or local pdf

Guest Lecture #5: May-Li Khoe (by Skype)

Sorry, no slides or video

May-Li Khoe was an Interaction Designer / Prototyper at Apple from June 2010 – June 2014, where she invented new ways for people and devices to communicate with each other in the Human Interface Device Prototyping group. She designed and prototyped experiences across iPhone, iPad, Mac, Apple TV, and more. She was the co-inventor of Apple's Force Touch, 3D Touch, and Taptic Engine technology now in the Apple Watch, Macbook Pro, and iPhone 6S. She also designed and prototyped interactions to help justify development of the iPad Pro, iPad mini, and Apple Pencil. She has a S.B. and M.Eng in Computer Science and Electrical Engineering from MIT. Since 2014, she has been at the Khan Academy where she is now Design Director and Long-Term Research Co-Director.

Past to Future: Artificial Intelligence (AI) in Interaction Techniques

Slides for Lecture 26

Final Project Presentations, 1.

Everyone please fill out the Course Survey and also the official CMU course evaluations).

Here is the form to evaluate the project presentations.

Final Project Presentations, 2

Final Project Presentations, 3

(Final day of classes = April 29, 2016.)

Everyone please fill out the peer evaluation for your project.

(Final grades due by 4:00 p.m. on May 12, 2016 for Seniors.)