Research Papers

Evaluating the Affective Aspect of Intuitive Interactions Using Image Schemas

[+] Author and Article Information
Obokhai Kess Asikhia

School of Engineering,
Cardiff University,
14-17 The Parade, Queen's Buildings,
Cardiff CF24 3AA, UK

Rossitza Setchi

School of Engineering,
Cardiff University,
14-17 The Parade, Queen's Buildings,
Cardiff CF24 3AA, UK
e-mail: setchi@cardiff.ac.uk

1Corresponding author.

Contributed by the Computers and Information Division of ASME for publication in the JOURNAL OF COMPUTING AND INFORMATION SCIENCE IN ENGINEERING. Manuscript received April 24, 2015; final manuscript received June 13, 2018; published online July 5, 2018. Assoc. Editor: Bahram Ravani.

J. Comput. Inf. Sci. Eng 18(4), 041006 (Jul 05, 2018) (12 pages) Paper No: JCISE-15-1149; doi: 10.1115/1.4040606 History: Received April 24, 2015; Revised June 13, 2018

Intuitive use is a desirable feature in product and interface design. Until recently, however, there has been little research on the affective aspects of intuitive use. This paper contributes to the research in this area by proposing a systematic analytical method for assessing the affective aspect of intuitive use; the method uses an ontology of image schemas, computational semantics, and a sentiment analysis to determine the affect associated with interactions. The approach is evaluated through an empirical study involving 40 participants who completed a task with two products. The results show that the approach links the image schemas used for the completion of a task to the affective experiences of the users. The study has the potential to lead to improvements in design and the improved evaluation of intuitive use because it allows experiences to be linked directly to the specific image schemas employed in the design.

Copyright © 2018 by ASME
Your Session has timed out. Please sign back in to continue.


Agor, W. H. , 1986, The Logic of Intuitive Decision Making: A Research-Based Approach for Top Management, Quorum Books, New York.
Bastick, T. , 1982, Intuition: How We Think and Act, Wiley, Chichester, UK.
Klein, G. , 1998, Sources of Power: How People Make Decisions, MIT Press, Cambridge, MA.
Hogarth, P. M. , 2001, Educating Intuition, University of Chicago Press, Chicago, IL.
Simon, H. A. , 1987, “ Making Management Decisions: The Role of Intuition and Emotion,” Acad. Manage. Exec., 1(1), pp. 57–64.
Klein, G. A. , 1993, “ Recognition Prime Decision (RPD) Model of Rapid Decision Making,” Decision Making in Action: Models and Methods, G. A. Klein , J. Orasunu , R. Calderwood , and C. E. Zsambok , eds., Ablex, Norwood, NJ, pp. 138–147.
Park, J. , Hans, S. H. , Kim, H. K. , Choi, Y. , and Park, W. , 2013, “ Developing Elements of User Experience for Mobile Phones and Services: Survey, Interview and Observation Approaches,” Hum. Factors Ergonom. Manuf. Service Ind., 23(4), pp. 279–293.
Kahneman, D. , 2003, “ A Perspective on Judgment and Choice: Mapping Bounded Rationality,” Am. Psychol., 58(9), pp. 697–720. [PubMed]
Epstein, S. , 1998, “ Cognitive-Experiential Self-Theory: A Dual-Process Personality Theory With Implications for Diagnosis and Psychotherapy,” Empirical Perspective on the Psychoanalytic Unconscious, R. F. Bornstein and J. M. Mashling , eds., American Psychological Association, Washington DC, pp. 99–140.
Sinclair, M. , and Ashkanasy, N. M. , 2005, “ Intuition: Myth or Decision Making Tool?,” Manage. Learn., 36(3), pp. 353–370.
Sinclair, M. , Ashkanasy, N. M. , Chattopadhyay, P. , and Boyle, M. V. , 2002, “ Determinants of Intuitive Decision-Making in Management: The Moderating Role of Affect,” Managing Emotions in the Workplace, N. M. Ashkanasy , W. J. Zerbe , and C. E. J. Hartel , eds., M.E. Sharpe, Armonk, NY, pp. 143–163.
Blackler, A. , Popovic, V. , and Mahar, D. P. , 2010, “ Investigating User's Intuitive Interaction With Complex Artefacts,” Appl. Ergon., 41(1), pp. 72–92. [PubMed]
Fischer, S. , Itoh, M. , and Inagaki, T. , 2009, “ A Cognitive Schema Approach to Diagnose Intuitiveness: An Application to Onboard Computer,” First International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI), Sept. 21–22, Essen, Germany, pp. 35–42.
Britton, A. , Setchi, R. , and Marsh, A. , 2013, “ Intuitive Interaction With Multifunctional Mobile Interfaces,” J. King Saud Univ.-Comput. Inf. Sci., 25(2), pp. 187–196.
Antle, A. N. , Corness, G. , and Allen, B. , 2011, “ Springboard: Designing Image Schema Based Embodied Interaction for an Abstract Domain,” Whole Body Interaction (Human Computer Interaction Series), D. England , ed., Springer-Verlag, London.
O'Brien, M. A. , Rogers, W. A. , and Fisk, A. D. , 2010, “ Developing an Organizational Model for Intuitive Design,” Georgia Institute of Technology, Atlanta, GA, Technical Report No. HFA-TR-1001.
Hurtienne, J. , and Blessing, L. , 2007, “ Design for Intuitive Use-Testing Image Schema Theory for User Interface Design,” 16th International Conference on Engineering Design (ICED07), Paris, France, Aug. 28–31.
Asikhia, O. K. , Setchi, R. , Hicks, Y. , and Andrews, W. , 2015, “ Conceptual Framework for Evaluating Intuitive Interactions Based on Image Schemas,” Interact. Comput., 27(3), pp. 287–310.
Setchi, R. , and Asikhia, O. K. , 2017, “ Exploring User Experience With Image Schemas, Sentiments, and Semantics,” IEEE Trans. Affective Comput. (epub).
Johnson, M. , 1987, The Body in the Mind: The Bodily Basis of Meaning, Imagination and Reason, University of Chicago Press, Chicago, IL.
Macaranas, A. , Antle, A. N. , and Riecke, B. E. , 2012, “ Bridging the Gap: Attribute and Spatial Metaphors for Tangible Interface Design,” International Conference on Tangible and Embedded Interface (TEI2012), Kingston, ON, Canada, Feb. 19–22, pp. 161–168.
Hurtienne, J. , 2011, “ Image Schemas and Design for Intuitive Use,” Ph.D. thesis, Techniscie Universitat, Berlin.
Moh's, C. , Hurtienne, J. , Israel, J. H. , Neumann, A. , Kindmuller, N. C. , Meyer, H. A. , and Pohlmeyer, A. , 2006, “ IUUI—Intuitive to Use of User Interfaces,” Usability Professionals 2006, T. Bosenick , M. Hassenzahi , M. Muller-Prove , and M. Peissner , eds., pp. 130–133.
Stanfield, R. A. , and Zwaan, R. A. , 2001, “ The Effect of Implied Orientation Derived From Verbal Content on Pictures Recognition,” Psychol. Sci., 12(2), pp. 153–156. [PubMed]
Glover, S. , Rosenbaum, D. A. , Graham, J. , and Dixon, P. , 2004, “ Grasping the Meaning of Words,” Exp. Brain Res., 154(1), pp. 103–108. [PubMed]
Zwaan, R. A. , and Taylor, L. J. , 2006, “ Seeing, Acting, Understanding. Motor Resonance in Language Comprehension,” J. Exp. Psychol.: General, 135(1), pp. 1–11.
Kuhn, W. , and Frank, A. U. , 1991, “ A Formalization of Metaphors and Image Schema in User Interfaces,” Cognitive and Linguistic Aspect of Geographical Space, D. M. Mark and A. U. Frank , eds., Kluwer Academic, Dordrecht, The Netherlands, pp. 419–434.
Hurtienne, J. , and Israel, J. H. , 2007, “ Image Schemas and Their Metaphorical Extensions: Intuitive Patterns for Tangible Interaction,” First International Conference on Tangible and Embedded Interaction (TE), Baton Rouge, LA, Feb. 15–17, pp. 127–134.
Maglio, P. P. , and Matlock, J. , 1999, “ The Conceptual Structure of Information Space,” Designing Information Spaces: The Social Navigation Approach (Computer Supported Cooperative Work), A. Munro , D. Benyon , and K. Hook , eds., Springer, London, pp. 155–173.
Raubal, M. , and Worboys, M. , 1999, “ A Formal Model of the Process of Way Finding in Built in Environments,” International Conference on Spatial Information Theory, Cognitive Computational Foundations of Geographic Information Science (COSIT'99), Stade, Germany, Aug. 25–29, pp. 381–400.
Hurtienne, J. , and Langdon, P. , 2010, “ Keeping Warm in Winter: Image-Schematic Metaphors and Their Role in Design of Central Heating Controls,” Fourth International Conference of the German Cognitive Linguistics Association, Bremen, Germany, Oct. 7–9, pp. 53–54.
Hurtienne, J. , Israel, J. H. , and Weber, K. , 2008, “ Cooking Up Real World Business Application Combining Physicality, Digitality, and Image Schema,” Second International Conference on Tangible and Embedded Interaction (TEI'08), Bonn, Germany, Feb. 18–20, pp. 239–246.
Boucavalas, M. , 1997, “ Intuition: The Concept and the Experience,” Intuition: The Inside Story, D. Floyds and P. S. Arvidson , eds., Routledge, New York, pp. 39–56.
Hodgkinson, G. P. , Lagan-Fox, J. , and Sadler-Smith, E. , 2008, “ Fundamental Building Construct in the Behavioural Sciences,” Br. J. Psychol., 99(1), pp. 1–27. [PubMed]
Simonton, D. K. , 1980, “ Intuition and Analysis: A Predictor and Exploratory Model,” Genet. Psychol. Monogr., 102(1), pp. 3–60.
Kahneman, D. , and Fredrick, S. , 2002, “ Representativeness Revisited: Attributed Substitution in Intuitive Judgment,” Heuristic Biases: The Psychology of Intuitive Judgment, T. Gilovich , D. , Griffin , and D. , Kahneman , eds., Cambridge University Press, Cambridge, UK, pp. 49–81.
Damasio, A. R. , 1994, Error: Emotion, Reason and the Human Brain, Putnam, New York.
Lieberman, M. D. , 2000, “ Intuition: A Social Cognitive Neuroscience Approach,” Psychol. Bull., 126(1), pp. 109–137. [PubMed]
Hammond, K. R. , Hamm, R. M. , Grassia, J. , and Pearson, T. , 1987, “ Direct Comparison of the Efficacy of Intuitive and Analytical Cognition in Expert Judgment,” IEEE Trans. Syst. Man Cybern., 17(5), pp. 753–770.
Zhou, F. , Jiao, R. J. , Schaefer, D. , and Chen, S. , 2010, “ Hybrid Association Mining and Refinement for Affective Mapping in Emotional Design,” ASME J. Comput. Inf. Sci. Eng., 10(3), p. 031010.
Xu, Q. , Zhou, F. , and Jiao, J. R. , 2011, “ Affective-Cognitive Modelling for User Experience With Modular Colored Fuzzy Petri Nets,” ASME J. Comput. Inf. Sci. Eng., 11(1), p. 011004.
Stanovich, K. E. , and West, R. F. , 2000, “ Individual Differences in Reasoning: Implications for the Rationality Debate,” Behav. Brain Sci., 23(5), pp. 645–665. [PubMed]
Sloman, S. A. , 1996, “ The Empirical Case for Two Systems of Reasoning,” Psychol. Bull., 119(1), pp. 3–22.
Evans, J. S. B. T. , 2009, “ How Many Dual-Process Theories Do We Need? One, Two, or Many?,” In Two Minds: Dual Processes and Beyond, J. S. B. T. Evans and K. Frankisch , eds., Oxford University Press, New York, pp. 33–54.
Rasmussen, J. , 1993, “ Deciding and Doing: Decision Making in Naturalistic Contexts,” Decision Making in Action: Models and Methods, G. A. Klein. , J. Orasunu. , R. Calderwood , and C. E. Zsambok , eds., Ablex, Norwood, NJ, pp. 159–171.
Wickens, C. D. , Gordon, S. E. , and Liu, Y. , 1998, An Introduction to Human Factor Engineering, Addison-Wesley Educational Publisher, New York.
Blackler, A. L. , 2006, “ Intuitive Interaction With Complex Artefacts,” Ph.D. thesis, Queensland University of Technology, Brisbane, Australia.
Finucane, M. L. , Alhakami, A. , Slovic, P. , and Johnson, S. M. , 2000, “ The Affect Heuristic in Judgments of Risks and Benefits,” J. Behav. Decis. Making, 13(1), pp. 1–17.
Slovic, P. , Finucane, M. , Peters, E. , and MacGregor, D. G. , 2002, “ The Affect Heuristic,” Heuristics and Biases: The Psychology of Intuitive Judgment, T. Gilovich , D. Griffin , and D. Kahneman , eds., Cambridge University Press, New York, pp. 397–420.
Liu, B. , 2012, Sentiment Analysis and Opinion Mining, Morgan and Claypool Publisher, San Rafael, CA.
Cambria, E. , Schuller, B. , Liu, B. , Wang, H. , and Havasi, C. , 2013, “ Knowledge-Based Approaches to Concept Level Sentiment Analysis,” IEEE Comput. Soc., 28(2), pp. 12–14.
Scherer, K. R. , 2005, “ What Are Emotions? and How Can They Be Measured?,” Soc. Sci. Inf., 44(4), pp. 695–729.
Ortony, G. , Clore, A. , and Collins, A. , 1988, The Cognitive Structure of Emotions, Cambridge University Press, Cambridge, UK.
Mehrabian, A. , 1995, “ Framework for a Comprehensive Description and Measurement of Emotional States,” J. Genet. Psychol., 121(3), pp. 339–361.
Langdon, P. , and Clarkson, J. , 2007, “ The Effects of Prior Experience on the Use of Consumer Products,” Univers. Access Inf. Soc., 6(2), pp. 179–191.
Zwaan, R. A. , and Yaxley, R. H. , 2003, “ Spatial Iconicity Affects Semantic Relatedness Judgments,” Psychon. Bull. Rev., 10(4), pp. 954–958. [PubMed]
Zwaan, R. A. , Madden, C. J. , Yaxley, R. H. , and Aveyard, M. E. , 2004, “ Moving Words: Dynamic Representations in Language Comprehension,” Cognit. Sci., 28(4), pp. 611–619.
Kaschak, M. P. , Zwaan, R. A. , Aveyard, M. , and Yaxley, R. H. , 2006, “ Perception of Auditory Motion Affects Language Processing,” Cognit. Sci., 30(4), pp. 733–744.
ISCAT, 2012, Image Schema Catalogue, Berlin, Germany, accessed Nov. 26, 2012, zope.psyergo.uni-wuerzburg.de/iscat
Davidson, E. , ed., 2003, Roget's Thesaurus of English Words and Phrases, Penguin, London.
Setchi, R. , and Bouchard, C. , 2010, “ In Search of Design Inspiration: A Semantic-Based Approach,” ASME J. Comput. Inf. Sci. Eng., 10(3), p. 031006.
Setchi, R. , Tang, Q. , and Stankov, I. , 2011, “ Semantic-Based Information Retrieval in Support of Concept Design,” J. Adv. Eng. Inf., 24(2), pp. 131–146.
Fadzli, S. A. , and Setchi, R. , 2012, “ Concept-Based Indexing of Annotated Images Using Semantic DNA,” J. Eng. Appl. Artif. Intell., 25(8), pp. 1644–1655.
Princeton University, 2010, “ About WordNet,” accessed Aug. 15, 2014, wordnet.princeton.edu.
Clausner, T. , and Croft, W. , 1999, “ Domains and Image Schemas,” Cognit. Linguist., 10(1), pp. 1–31.
Dodge, E. , and Lakoff, G. , 2005, “ Image Schemas: From Linguistic Analysis to Neural Grounding,” From Perception to Meaning: Image Schemas in Cognitive Linguistics, B. Hampe , ed., Mouton De Gruyter, New York.
Noldus Observer XT 10, 2010, Innovative Solutions for Behavioural Research, 4th ed., Wageningen, The Netherlands, pp. 5–39.
IBM, 2011, “IBM SPSS Statistics for Windows, Version 20.0,” IBM Corporation, Armonk, NY.
Becker, L. , 2000, “ Effect Size Calculator,” Colorado Springs, CO, accessed 30 June 2018, https://www.uccs.edu/lbecker/


Grahic Jump Location
Fig. 1

Method for assessing intuitive interactions

Grahic Jump Location
Fig. 2

Linking image schemas and affect

Grahic Jump Location
Fig. 3

An algorithm for extracting image schemas from utterances

Grahic Jump Location
Fig. 4

Accuracy of the developed algorithm

Grahic Jump Location
Fig. 5

Products used in the current study

Grahic Jump Location
Fig. 6

Q value and positive sentiments

Grahic Jump Location
Fig. 7

Positive sentiments and image schema

Grahic Jump Location
Fig. 8

Negative sentiments and image schema



Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In