Module 4
The Computer and Task
At the end of the chapter, the learner should be able to:
• Learn different interaction devices
• Know Abowd and Beale framework
• Understand different interaction elements
Module 4 – The Computer & Task
Advance Interaction
Module 4: The Computer & Task > Advance Interaction
Human
Computer
Being
Task
Module 4: The Computer & Task > Advance Interaction
Human
Computer
Being
Task
Module 4: The Computer & Task > Advance Interaction
• What are our goals
when interacting
with people?
• Interaction is a
process of
information transfer
Module 4: The Computer & Task > Advance Interaction
https://media.gcflearnfree.org/content/55e0730c7dd48174331f5164_01_17_2014/desktop_full_view_alt.jpg
Module 4: The Computer & Task > Advance Interaction
http://ambuj.files.wordpress.com/2009/06/cloudcomputing-2.jpg
Module 4: The Computer & Task > Advance Interaction
• Input devices
• Output devices
• VR systems, 3D displays
• Sound, smell, haptic interfaces
• Sensors
• Paper input and output
• Memory
• Processing
Module 4: The Computer & Task > Advance Interaction
• Input devices
• Output devices
• VR systems, 3D displays
• Sound, smell, haptic interfaces
• Sensors
• Paper input and output
• Memory
• Processing
Module 4: The Computer & Task > Advance Interaction
https://4.bp.blogspot.com/-1vgeh7hv74Y/WZlcOO-
zMlI/AAAAAAAAJho/TIfweI0mGBE5wsEADurDDt0dAggSeTOLwCLcBGAs/s1600/examples%2Bof%2BInput%2BDevices%2Bof%2BComputer.png
Module 4: The Computer & Task > Advance Interaction
• Input devices
• Output devices
• VR systems, 3D displays
• Sound, smell, haptic interfaces
• Sensors
• Paper input and output
• Memory
• Processing
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
• Input devices
• Output devices
• VR systems, 3D displays
• Sound, smell, haptic interfaces
• Sensors
• Paper input and output
• Memory
• Processing
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
More on this at https://www.slideshare.net/atinav242/the-
sixth-sense-technology-complete-ppt
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
• Input devices
• Output devices
• VR systems, 3D displays
• Sound, smell, haptic interfaces
• Sensors
• Paper input and output
• Memory
• Processing
Module 4: The Computer & Task > Advance Interaction
http://www.avid.com/~/media/avid/images/solutions/live-
sound/livesound_2000x1000.jpeg?h=600&la=en&mw=1200&w=1200&v20170331135135&hash=BC3F37990437790DCFB72B6BA5AAF9A8274CD171
Module 4: The Computer & Task > Advance Interaction
https://www.newyorker.com/tech/elements/is-digital-smell-doomed
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
• Input devices
• Output devices
• VR systems, 3D displays
• Sound, smell, haptic interfaces
• Sensors
• Paper input and output
• Memory
• Processing
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
• Input devices
• Output devices
• VR systems, 3D displays
• Sound, smell, haptic interfaces
• Sensors
• Paper input and output
• Memory
• Processing
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
• Input devices
• Output devices
• VR systems, 3D displays
• Sound, smell, haptic interfaces
• Sensors
• Paper input and output
• Memory
• Processing
Module 4: The Computer & Task > Advance Interaction
Short-term
Memory
Module 4: The Computer & Task > Advance Interaction
Long-term
Memory
Module 4: The Computer & Task > Advance Interaction
Long-term
Memory
Module 4: The Computer & Task > Advance Interaction
Long-term
Memory
Module 4: The Computer & Task > Advance Interaction
Long-term
Memory
Module 4: The Computer & Task > Advance Interaction
Long-term
Memory
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
• Input devices
• Output devices
• VR systems, 3D displays
• Sound, smell, haptic interfaces
• Sensors
• Paper input and output
• Memory
• Processing
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
Module 4: The Computer & Task > Advance Interaction
• Computation bound
• Storage channel bound
• Graphics bound
• Network capacity
Module 4: The Computer & Task > Advance Interaction
• Computation bound
• Storage channel bound
• Graphics bound
• Network capacity
Module 4: The Computer & Task > Advance Interaction
• Computation bound
• Storage channel bound
• Graphics bound
• Network capacity
Module 4: The Computer & Task > Advance Interaction
• Computation bound
• Storage channel bound
• Graphics bound
• Network capacity
Module 4: The Computer & Task > Advance Interaction
• Computation bound
• Storage channel bound
• Graphics bound
• Network capacity
Module 4 – The Computer and Task
Interaction Framework
Module 4: The Computer & Task > Interaction Framework
Human
Computer
Being
Task
Module 4: The Computer & Task > Interaction Framework
Human
Computer
Being
Task
Module 4: The Computer & Task > Interaction Framework
• Occurs when a human performs a task using a
computing technology or some sort of.
• To accomplish a goal within an application
domain
Module 4: The Computer & Task > Interaction Framework
Module 4: The Computer & Task > Interaction Framework
• User formulates a goal and a task to achieve that goal
Presentation O Observation
Output
S
Core
U
Task
Performance I Articulation
Input
Module 4: The Computer & Task > Interaction Framework
• Task must be articulated within the input language
Presentation O Observation
Output
S
Core
U
Task
Performance I Articulation
Input
Module 4: The Computer & Task > Interaction Framework
• Input language is translated to the system’s core language as
operations to be performed
Presentation O Observation
Output
S
Core
U
Task
Performance I Articulation
Input
Module 4: The Computer & Task > Interaction Framework
• The system transforms itself based on the operations
Presentation O Observation
Output
S
Core
U
Task
Performance I Articulation
Input
Module 4: The Computer & Task > Interaction Framework
• Current values are presented to the user
Presentation O Observation
Output
S
Core
U
Task
Performance I Articulation
Input
Module 4: The Computer & Task > Interaction Framework
Module 4: The Computer & Task > Interaction Framework
Module 4: The Computer & Task > Interaction Framework
Module 4: The Computer & Task > Interaction Framework
Module 4: The Computer & Task > Interaction Framework
Module 4: The Computer & Task > Interaction Framework
Module 4: The Computer & Task > Interaction Framework
Module 4: The Computer & Task > Interaction Framework
This is a challenge! Game?
https://images.theconversation.com/files/327017/original/file-20200409-112571-1lbz2fo.jpg?ixlib=rb-
1.1.0&q=45&auto=format&w=1200&h=900.0&fit=crop
Module 4: The Computer & Task > Interaction Framework
The four translations involved in the interaction framework are:
1. ARTICULATION - the user articulates the task in the input language
2. PERFORMANCE - the interface translates the input language into stimuli
for the system
3. PRESENTATION - the system presents the results in the output language
4. OBSERVATION - the user translates the output language into personal
understanding
Module 4 – The Computer and Task
Interaction Elements
Module 4: The Computer & Task > Interaction Elements
• Hard controls and soft controls
• Control-display relationships
• Natural versus learned relationships
• Mental models and metaphor
• Modes
• Mobile context
Module 4: The Computer & Task > Interaction Elements
• Hard controls and soft controls
• Control-display relationships
• Natural versus learned relationships
• Mental models and metaphor
• Modes
• Mobile context
Module 4: The Computer & Task > Interaction Elements
Module 4: The Computer & Task > Interaction Elements
• Hard controls and soft controls
• Control-display relationships
• Natural versus learned relationships
• Mental models and metaphor
• Modes
• Mobile context
Module 4: The Computer & Task > Interaction Elements
• CD Relationships
• Sometimes called as “Mappings”
• Relationship on what the user does and how the
system responds
• Should be natural, seamless, intuitive, & efficient
Module 4: The Computer & Task > Interaction Elements
• Spatial
• Gain and transfer functions
• Latency
• Property sensed and order of control
Module 4: The Computer & Task > Interaction Elements
specifies how some object is located in space
in relation to some reference object.
Module 4: The Computer & Task > Interaction Elements
Module 4: The Computer & Task > Interaction Elements
Module 4: The Computer & Task > Interaction Elements
https://gest.co/
Module 4: The Computer & Task > Interaction Elements
• Ratio between movement of the controller and
movement of the display.
• Transfer function – nonlinear relationship
between C and D
Module 4: The Computer & Task > Interaction Elements
Module 4: The Computer & Task > Interaction Elements
• delay between an input action and the
corresponding response
• Lag
Module 4: The Computer & Task > Interaction Elements
Module 4: The Computer & Task > Interaction Elements
Module 4: The Computer & Task > Interaction Elements
• Human actions – touching, tapping, grasping,
moving, pushing, flicking, squeezing
• Property sensed by controller – position,
displacement, force
• Does the property sensed control the position or
the velocity of the display?
Module 4: The Computer & Task > Interaction Elements
Module 4: The Computer & Task > Interaction Elements
Isometric Isotonic
Module 4: The Computer & Task > Interaction Elements
• Hard controls and soft controls
• Control-display relationships
• Natural versus learned relationships
• Mental models and metaphor
• Modes
• Mobile context
Module 4: The Computer & Task > Interaction Elements
• Natural relationships - spatially congruent
• Learned relationships - spatial transformation
(relationship must be learned)
Module 4: The Computer & Task > Interaction Elements
Module 4: The Computer & Task > Interaction Elements
Module 4: The Computer & Task > Interaction Elements
• Hard controls and soft controls
• Control-display relationships
• Natural versus learned relationships
• Mental models and metaphor
• Modes
• Mobile context
Module 4: The Computer & Task > Interaction Elements
• physical analogy, metaphor, conceptual models
• a physical understanding of an interface or
interaction technique based on real-world
experience
• Interaction design base on human experience
Module 4: The Computer & Task > Interaction Elements
https://www.sanyang.com.ph/product/office-table-fot2448a/
Module 4: The Computer & Task > Interaction Elements
https://www.mnn.com/your-home/organic-farming-gardening/stories/good-bug-bad-bug-how-can-you-tell-the-difference
Module 4: The Computer & Task > Interaction Elements
https://pixabay.com/en/browse-book-read-pages-fly-over-57279/
Module 4: The Computer & Task > Interaction Elements
https://www.bettycrocker.com/recipes/ultimate-chocolate-chip-cookies/77c14e03-d8b0-4844-846d-f19304f61c57
Module 4: The Computer & Task > Interaction Elements
https://www.businessnewsdaily.com/10748-top-5-cloud-certifications.html
Module 4: The Computer & Task > Interaction Elements
Module 4: The Computer & Task > Interaction Elements
• Hard controls and soft controls
• Control-display relationships
• Natural versus learned relationships
• Mental models and metaphor
• Modes
• Mobile context
Module 4: The Computer & Task > Interaction Elements
• a functioning arrangement or condition
Module 4: The Computer & Task > Interaction Elements
Module 4: The Computer & Task > Interaction Elements
• Hard controls and soft controls
• Control-display relationships
• Natural versus learned relationships
• Mental models and metaphor
• Modes
• Mobile context
Module 4: The Computer & Task > Interaction Elements
• Touchscreens are the full embodiment of direct
manipulation
• No need for a cursor (cf. indirect input)
Module 4: The Computer & Task > Interaction Elements
Multi-touch
Drag
Swipe / Slide
Module 4: The Computer & Task > Interaction Elements
Accelerometers
Module 4: The Computer & Task > Interaction Elements
Newer Tech
Module 4: The Computer & Task > Interaction Elements
http://www.flexenable.com/blog/organic-lcd-technology-paving-the-way-to-flexible-displays/
Module 4: The Computer & Task > Interaction Elements
https://www.youtube.com/watch?v=XkmwG588zp0
Module 4: The Computer & Task > Interaction Elements
Module 4: The Computer & Task > Interaction Elements
http://duoskin.media.mit.edu/
Module 4: The Computer & Task > Interaction Elements
https://www.businessinsider.sg/phone-case-mimics-human-skin-created-by-researcher-2019-10
• https://cio-wiki.org/wiki/Abowd_and_Beale_Framework
• https://www.newyorker.com/tech/elements/is-digital-smell-doomed
• https://www.slideshare.net/jyotichintadi/digital-scent-technology
• https://www.slideshare.net/atinav242/the-sixth-sense-technology-complete-ppt
• http://www3.cs.stonybrook.edu/~mueller/teaching/cse323/03-InteractionElements.pdf
