Mobile HCI Tutorials
After more than 10 years of Mobile HCI, providing an overview of the state of the art becomes more and more challenging. During the tutorial days of Mobile HCI 2008 & 2009, a number of well-known researchers in Mobile HCI gave overviews of the state of the art and cover many of the relevant topics. The tutorials also introduced the must read papers in this domain. The audience varied and included new students starting a PhD in Mobile HCI, practitioners wanting a quick survey of the state of the art and educators wishing to get an overview of Mobile HCI for their own teaching. Tutorial days have been held at Mobile HCI 2008, Mobile HCI 2009 and Mobile HCI 2010.
Mobile HCI 2010 Tutorials
Paul Coulton (Lancaster University, UK): Mobile Games and Playful Experiences (Slides) Mobile gaming is still in relative infancy with the first, Snake, only appearing in 1997 and whilst early games predominantly mimicked PC and console games it has become apparent that many of these genres do not readily transfer to the mobile and more social and casually orientated experiences are required. As mobile phones are now equipped with an array of sensors such as RFID/NFC, cameras, GPS, 3-D accelerometers, magnetometers etc they offer unique possibilities for creating new gaming and playful experiences in a wider range of social contexts. However, a novel interaction modality alone is not enough to create a good gaming experience and in this tutorial we will explore not only the possibilities of these technologies through practical demonstrations and examples but also how they can be married to the underlying principles of good game design.
Kaisa Väänänen-Vainio-Mattila (Tampere University of Technology, Finland): User Experience of Mobile Services (Slides) Mobile devices and services have spread to people´s everyday lives both at work and in leisure time. Still, many services fail to gain user acceptance for various reasons such as: The device-service combination may be too complex to use, the input/output modalities are not appropriate for mobile usage contexts, or the service may fail to provide pleasurable experiences to the user. This tutorial gives an overview of various issues related to user experience (UX) of mobile services. We will first define UX, and in specific, the factors of mobile service UX. Then we will go through examples of mobile services which illustrate the key issues of mobile service UX, such as mobile interaction design, context-awareness, social UX of mobile services, and cross-platform service UX. Finally, we will briefly discuss design and evaluation methods for mobile service UX. We will also point out future directions of UX of mobile services.
Cosmin Munteanu (National Research Council, Canada): Hands-free Interfaces: The Myths, Challenges, and Opportunities of Speech-based Interaction (Slides) (Videos) Speech remains the "holy grail" of interaction, as this is the most natural form of communication that humans employ. Unfortunately, it is also one of the most difficult modalities to be understood by machines, mainly due to its complex nature. This is particularly prevalent for unconstrained tasks and under adverse environments - common situations when interacting with mobile devices. While the accuracies of understanding speech input are still discouraging, several interesting areas are yet to be explored that could make speech-based interaction truly hands-free. The goal of this tutorial is to inform the MobileHCI community of the current state of speech and natural language research, to dispel some of the myths surrounding speech-based interaction, as well as to provide an opportunity for researchers and practitioners to learn more about how speech recognition works, what are its limitations, and to explore how it could enhance current mobile interaction paradigms.
Alessandro Mulloni (Graz University of Technology, Austria): Mobile Phone Augmented Reality (Slides: shown version)(Slides: complete version) In his talk Alessandro will present best practices in mobile phone Augmented Reality development. The following topics will be covered: enabling techniques for AR on mobile phones, mobile phone platforms relevant for research, mobile phone sensors for AR, AR application development on mobile phones and potential future mobile phone hardware and how it will be relevant to AR.
Fabio Paternò (National Research Council, Italy): Adaptation and Continuity in Multi-Device User Interfaces (Slides) This tutorial aims to help user interface designers and developers to understand the issues involved in multi-device interactive applications, which can be accessed through both mobile and stationary devices even exploiting different interaction modalities (graphical, vocal, gesture, ...). It will provide a discussion of the possible solutions in terms of concepts, techniques, languages, and tools, with particular attention to Web environments. The tutorial will deal with the various strategies in order to adapt the user interface according to the interaction resources available, also discussing what results can be obtained through model-based approaches when multi-device interfaces are considered. It will consider how to address such issues both when authoring multi-device interfaces and when user interfaces for different devices are dynamically adapted and can even migrate seamlessly across them to follow the mobile user. Thus, it will discuss how to support task continuity across multiple devices in examples of distributed and migratory interfaces and related usability issues.
Gary Marsden (University of Cape Town, South Africa): Mobile Services in the Developing World (Slides) This tutorial will present ways of doing mobile interaction design in the developing world. The tutorial will cover the following areas:
- Context: An overview of the mobile landscape in the developing world, with a particular focus on Africa.
- Methods: How to engage users, who may be illiterate and have no experience of technology, to become active participants in the design process. We look at how familiar methods need to be adapted in different contexts.
- Guidelines and pitfalls: A look at some successful designs and how they came into being. We also reflect on how to avoid pitfalls common to many projects.
Mobile HCI 2009 Tutorials
Matt Jones (Swansea University, UK): Mobile Search (Slides) Desktop search is the most popular interactive web-activity with billions of interactions daily. Mobile search is increasing in significance and this tutorial will review the state-of-the-art knowledge touching topics such as: user motivations for mobile search; query capture; and, search result visualisation and interaction. While we will of course consider query-result, screen-based mobile systems, the tutorial will also explore more adventurous visions for seeking and finding including those involving multimodal elements (such as audio and gestures) and social-network based schemes.
Luca Chittaro (University of Udine, Italy): Information Visualization and Visual Interfaces for Mobile Devices (Slides) Mobile devices have now powerful graphics capabilities that enable the creation of novel visual interfaces based on 2D (or even 3D) graphics - to help users on the move in dealing more quickly and easily with larger amounts of information. This tutorial will introduce participants to what we can learn (and what we need to adapt) from the field of visualization to build effective visual interfaces on mobile devices. It will also briefly show how information visualization techniques are useful to create new tools for studying the behaviour of mobile users. No particular background in information visualization is required.
Chris Kray (Newcastle University, UK): Mobile Guides (Slides) Mobile guides are one of the most widely used location-based services, and are now being rolled out commercially on a large scale. Often, mobile guides are thought of as just being maps with a few markers and a highlighted route but this is a very narrow perspective - they can be much more. This tutorial will provide a systematic overview over the large body of research in this area. Topics covered will include psychological foundations of way finding and producing directions, different means to convey route instructions through a mobile interface as well as ways to represent and deal with location.
Marc Langheinrich (Universita della Svizzera italiana, Switzerland): Mobile Privacy (Slides) Mobile applications that go beyond simple GPS-enabled maps often involve significant privacy issues. This tutorial will first frame the problem associated with mobile applications and personal privacy, i.e., why should we care about privacy issues when designing mobile applications? It will then summarize the current state-of-the-art in location privacy, i.e., computational countermeasures, consumer attitudes, and legal realities. Last but not least, it will also try to offer a somewhat larger view of privacy in general: what is it, and why should we want it?
Enrico Rukzio (Lancaster University, UK): Mobile Interaction with the Real World (Slides) Over the last years, there has been an increasing interested in extending the interaction between users and mobile devices to the interaction with objects from the everyday world. For example, people can use their mobile phones to take pictures of visual markers and have their codes recognized. A further example is the usage of RFID/NFC that is gaining popularity as it can reduce payment, identification or access control by simply swiping a mobile phone over a reader. This tutorial will provided a systematic overview of such interaction techniques, will discuss different technologies that are used for their implementation and will discuss applications areas and upcoming trends.
Paul Holleis (DOCOMO Euro-Labs, Germany): Modelling and Developing Mobile Applications (Slides) The development of mobile, pervasive applications is still a difficult task. Although by now there have been introduced APIs and several studies explored many aspects of mobile interfaces and services, it is often a complex and time-consuming task to create mobile applications and evaluate their usability properties. In this tutorial we will see current research and results about how to use usability models for easily and automatically evaluating certain aspects of mobile interfaces. Concentrating on the time to completion of tasks, I present approaches of how to integrate such methods into the development process and thus remove some of the burden from the developer.
Mobile HCI 2008 Tutorials
Scott MacKenzie: Text input for mobile devices (Slides) Scott gave an overview of different input means (e.g. key-based, stylus, predictive, virtual keyboard), parameters relevant for designing and assessing mobile text input (e.g., writing speed, cognitive load) and issues related to the context of use (e.g., walking/standing).
Patrick Baudisch: Mobile GUIs and Mobile Visualization (Slides) Patrick introduced input and output options for mobile devices. He will talk about the design process, prototyping and assessment of user interfaces, trade-offs related to the design of mobile GUIs and different possible interaction styles.
Mirjana Spasojevic: Understanding Mobile User Experience (Slides) Mirjana discussed different means for studying mobile user needs and evaluating the user experience. This includes explorative studies and formal evaluations (in the lab vs. in the field), including longitudinal pilot deployments. The lecture discusses traditional HCI methods of user research and how they need to be adapted for different mobile contexts and products.
Albrecht Schmidt: Context-Aware Communication and Interaction (Slides) Albrecht gave an overview of work in context-awareness and activity recognition that is related to mobile HCI. He discussed how sharing of context in communication applications can improve the user experience. The lecture explained how perception and sensing can be used to acquire context and activity information and show examples how such information can be exploited.
Stephen Brewster: Haptics, audio output and sensor input in mobile HCI (Slides) Stephen discussed the design space for haptics, audio output as well as sensor and gesture input in mobile HCI. Furthermore he assessed resulting interaction methods and implications for the interactive experience.
Michael Rohs: Camera-based interaction and interaction with public displays (Slides) Michael introduced camera based interaction with mobile devices; this included a assessment of optical markers, 2D-barcodes and optical flow as well as techniques related to augmented reality. In this context he addressed interaction with public displays, too.