Funded projects
| Since 01/2008 | MULTITAG project (funded by the NTT DoCoMo Euro-Labs |
| Since 10/2006 | Intermedia - Interactive Media with Personal Networked Devices (partly founded by the European Union) |
| 10/2005-09/2006 | Perci (PERvasive serviCe Interaction) project (funded by the NTT DoCoMo Euro-Labs |
| 02/2004-02/2006 | Simplicity - Secure, Internet-able, Mobile Platforms Leading Citizens Towards Simplicity (partly founded by the European Union) |
| 10/2002-01/2004 | @virtu - Partizipative Entwicklung diagnostischer Frühwarnsysteme für die Arbeit in virtuellen Unternehmen (founded by the German Federal Ministry of Education and Research) |
| 02/2001-09/2002 | Contigra (Component-oriented Three-dimensional Interactive Graphical Applications) |
Research sub-projects
Projector Phones
It is expected that projector phones (mobile phones with an integrated pico projector) will hit the market in the next few years. So far no research exists regarding how mobile applications should be designed when using a projection and which applications will profit from such a large high-resolution display. In this project we analyse different application areas like photo browsing or map interaction, develop corresponding prototypes, develop software and interface widgets for such system, and provide guidelines and best practices for the development of applications for projector phones. References:
- Alina Hang, Enrico Rukzio, Andrew Greaves. Projector Phone: A Study of Using Mobile Phones with Integrated Projector for Interaction with Maps. 10th International Conference on Human-Computer Interaction with Mobile Devices and Services (Mobile HCI 2008). Amsterdam, Netherlands. 2-5 September 2008.
- Andrew Greaves, Enrico Rukzio. Evaluation of Picture Browsing using a Projector Phone. 10th International Conference on Human-Computer Interaction with Mobile Devices and Services (Mobile HCI 2008). Amsterdam, Netherlands. 2-5 September 2008.
- Andrew Greaves, Alina Hang, Enrico Rukzio. Picture Browsing and Map Interaction using a Projector Phone. Demonstration at 10th International Conference on Human-Computer Interaction with Mobile Devices and Services (Mobile HCI 2008). Amsterdam, Netherlands. 2-5 September 2008.
- Andrew Greaves, Enrico Rukzio. View & Share: A Collaborative Media Viewing and Sharing Framework using a Projector Phone. MobileHCI 2008 workshop on Mobile Interaction with the Real World (MIRW 2008). Amsterdam, Netherlands. 2-5 September 2008.
Touch & Interact
Using Touch & Interact, a person is able to touch a corresponding screen with their mobile device in order to perform interactions. The approach is comparable to a touch screen but the mobile phone replaces the finger during interaction. Consequently, the mobile phone can be utilized throughout the interaction offering: an auxiliary display, audio and haptic feedback, storage capabilities and connectivity for Internet access. References:
- Robert Hardy, Enrico Rukzio. Touch & Interact: Touch-based Interaction of Mobile Phones with Displays. 10th International Conference on Human-Computer Interaction with Mobile Devices and Services (Mobile HCI 2008). Amsterdam, Netherlands. 2-5 September 2008.
- Robert Hardy, Enrico Rukzio. Direct Touch-based Mobile Interaction with Dynamic Displays. CHI 2008 Workshop on Designing and Evaluating Mobile Phone-Based Interaction with Public Displays. Florence, Italy. 5 April 2008.
- Robert Hardy, Enrico Rukzio, Massimo Paolucci, Matthias Wagner. Touch & Interact: Touch-based Interaction with a Tourist Application. Demonstration at 10th International Conference on Human-Computer Interaction with Mobile Devices and Services (Mobile HCI 2008). Amsterdam, Netherlands. 2-5 September 2008.
- Robert Hardy, Enrico Rukzio, Matthias Wagner, Massimo Paolucci. Touch & Interact: Applied to a Tourist Guide Prototype. Demonstration at NFC Forum Global Competition at 2nd European NFC Developers Summit (WIMA 2008). Monaco. 28-30 April 2008.
Automatic Form Filling on Mobile Devices
Filling out forms of web based services on mobile devices is a very time consuming and frustrating task for users because of the limited text input capabilities. This is a critical point to get a wide acceptance of such services, especially mobile commerce that often requires filling user data. We developed an architecture based on a local proxy on a mobile device and a lightweight algorithm for a comprehensive analysis of forms, which leads to the highest probable user data to be filled in, driven by an initial rule set. The references below discuss our implementation and the evaluation results of the algorithm as well as the usability of the prototype.References:
- Enrico Rukzio, Chie Noda, Alexander De Luca, John Hamard, Fatih Coskun. Automatic Form Filling on Mobile Devices. Pervasive and Mobile Computing journal. Vol 4/2 pp 161-181. 2008.
- Enrico Rukzio, John Hamard, Chie Noda, Alexander De Luca. Visualization of Uncertainty in Context Aware Mobile Applications. 8th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI 2006). Espoo, Finland. 12.-15 September 2006.
- Enrico Rukzio, Albrecht Schmidt, Heinrich Hussmann. Privacy-enhanced Intelligent Automatic Form Filling for Context-aware Services on Mobile Devices. Workshop Artificial Intelligence in Mobile Systems 2004 (AIMS 2004) in conjunction with UbiComp 2004, Nottingham, UK, September 7 2004.
Rotating Compass
In the rotating compass interaction technique that aims at public spaces, we combine a public display that shows
directions with a synchronized output on a personal device. In this system a compass with a rotating needle is shown on the public display . When the compass needle points in the desired direction, the mobile device of the user vibrates. This unobtrusive cue, allows the user to navigate without listening to or looking at the mobile device. References:
- Enrico Rukzio, Albrecht Schmidt, Antonio Krüger. The Rotating Compass: A Novel Interaction Technique for Mobile Navigation. CHI 2005 extended abstract. Portland. Oregon, USA. 2005.
Contextual Bookmarks
Using our Contextual Bookmark system a user can define a snapshot with her mobile phone consisting of a picture, time stamp and location. Such a bookmark can then be stored on the mobile phone, exchanged with friends, and in particular be used to access related videos, web pages, and other services. This helps the user to bridge the gap between the virtual and the real world in order to use related services. By combining content and context analysis objects are recognized without any visual markers or electronic tags. References:
- Niels Henze, Rene Reiners, Xavier Righetti, Enrico Rukzio, Susanne Boll. Services Surround You: Physical-Virtual Linkage with Contextual Bookmarks. The Visual Computer. 2008.
- Niels Henze, Enrico Rukzio, Andreas Lorenz, Xavier Righetti, Susanne Boll. Physical-Virtual Linkage with Contextual Bookmarks. Demonstration at 10th International Conference on Human-Computer Interaction with Mobile Devices and Services (Mobile HCI 2008). Amsterdam, Netherlands. 2-5 September 2008.
- Niels Henze, Mingyu Lim, Andreas Lorenz, Michael Mueller, Xavier Righetti, Enrico Rukzio, Nadia Magnenat-Thalmann, Andreas Zimmermann. Contextual Bookmarks. MobileHCI 2007 workshop on Mobile Interaction with the Real World (MIRW 2007). Singapore. 9 September 2007.
Mobile Interaction in Smart Environments
Other work has shown that mobile devices can act as universal remote controls for interaction with smart objects but, to date, there has been no research which has analyzed when a given mobile interaction technique should be used. In this project
we analyzed the appropriateness of the three interaction techniques touching, pointing and scanning as selection techniques in smart environments.References:
- Enrico Rukzio, Gregor Broll, Karin Leichtenstern, Albrecht Schmidt. Mobile Interaction with the Real World: An Evaluation and Comparison of Physical Mobile Interaction Techniques. European Conference on Ambient Intelligence (AmI-07). Darmstadt, Germany. 7-10 November 2007.
- Enrico Rukzio, Karin Leichtenstern, Vic Callaghan, Albrecht Schmidt, Paul Holleis, Jeannette Chin. An Experimental Comparison of Physical Mobile Interaction Techniques: Touching, Pointing and Scanning. Eighth International Conference on Ubiquitous Computing (Ubicomp 2006). California, USA. 17-21 September 2006.
- Karin Leichtenstern, Enrico Rukzio, Vic Callaghan, Albrecht Schmidt. Mobile Interaction in Smart Environments. Late Breaking Result and Poster at 4th International Conference on Pervasive Computing (Pervasive 2006), May 7-10, 2006, Dublin, Ireland.
PMIF (Physical Mobile Interaction Framework)
The Physical Mobile Interaction Framework (PMIF) was developed to support the rapid development of mobile applications and services based on physical mobile interactions. PMIF supports different implementations of the interaction techniques touching, pointing, scanning and user-mediated object selection. Furthermore it is possible to easily integrate new interaction techniques through a plug-and-play mechanism. In addition to that provides PMIF a simple and uniform stream metaphor to communicate with augmented objects.References:
- [an error occurred while processing this directive]
- Sergej Wetzstein. Real World Interaction Platform for Mobile Devices. Diploma thesis. University of Munich. 2005.
- Enrico Rukzio, Sergej Wetzstein, Albrecht Schmidt. A Framework for Mobile Interactions with the Physical World. Wireless Personal Multimedia Communication (WPMC'05). Aalborg, Denmark. 18-22 September 2005.
Perci (PERvasive serviCe Interaction)
In order to facilitate and leverage mobile interaction with services, a generic framework that combines Semantic Web Service technology and Physical Mobile Interaction was developed. This interaction paradigm uses mobile devices to extract information from augmented physical objects and use it for a more intuitive and convenient invocation of associated
services. The framework exploits Web Service descriptions for the automatic and dynamic generation of customizable user
interfaces that support and facilitate Physical Mobile Interaction. This generic approach to mobile interaction with services through the interaction with physical objects promises to meet the complementary development of the Internet of Things. A user study with a prototype application for mobile ticketing confirms the concept and shows its limits.References:
- Perci (PERvasive serviCe Interaction) project (funded by the NTT DoCoMo Euro-Labs
- Gregor Broll, Sven Siorpaes, Enrico Rukzio, Massimo Paolucci , John Hamard, Matthias Wagner, Albrecht Schmidt. Supporting Mobile Service Usage through Physical Mobile Interaction. Demonstration at the Fifth Annual IEEE International Conference on Pervasive Computing and Communications (Percom 2007). White Plains, NY, USA. 19-23 March 2007.
- Gregor Broll, Sven Siorpaes, Enrico Rukzio, Massimo Paolucci, John Hamard, Matthias Wagner, Albrecht Schmidt. Supporting Mobile Service Usage through Physical Mobile Interaction. Fifth Annual IEEE International Conference on Pervasive Computing and Communications (Percom 2007). White Plains, NY, USA. 19-23 March 2007.
- Enrico Rukzio, Massimo Paolucci, Matthias Wagner, Hendrik Berndt, John Hamard, Albrecht Schmidt. Mobile Service Interaction with the Web of Things. 13th International Conference on Telecommunications (ICT 2006). Funchal, Madeira Island, Portugal. 9-12 May 2006.
- Gregor Broll, Sven Siorpaes, Enrico Rukzio, Massimo Paolucci, John Hamard, Matthias Wagner, Albrecht Schmidt. Supporting Mobile Service Interaction through Semantic Service Description Annotation and Automatic Interface Generation. ISWC 2006 workshop on Semantic Desktop and Social Semantic Collaboration (Semdesk 2006). Athens, GA, USA. 6 November 2006.
- Sven Siorpaes, Gregor Broll, Massimo Paolucci, Enrico Rukzio, John Hamard, Matthias Wagner, Albrecht Schmidt. Mobile Interaction with the Internet of Things. Late Breaking Result and Poster at 4th International Conference on Pervasive Computing (Pervasive 2006), May 7-10, 2006, Dublin, Ireland.
- Gregor Broll, Sven Siorpaes, Enrico Rukzio, Massimo Paolucci, John Hamard, Matthias Wagner, Albrecht Schmidt. Supporting Service Interaction in the Real World. Workshop Permid 2006 in conjunction with Pervasive 2006, Dublin, Ireland, May 7 2006.
- Sven Siorpaes. A Physical Mobile Interactions Framework based on Semantic Descriptions. (supervised together with Massimo Paolucci and John Hamard from NTT DoCoMo Euro-Labs) Diploma thesis. University of Munich. 2006.
- Gregor Broll. Mobile Interaction with Real World Services. (supervised together with Massimo Paolucci and John Hamard from NTT DoCoMo Euro-Labs) Diploma thesis. University of Munich. 2006.
Context-aware Mobile Services
In this project a novel adaptation architecture as well as a process for the development of policy based adaptive services for mobile commerce was developed. The architecture is based on three basic requirements and defines the four core elements
context, policies, policy decision point and policy enforcement point. The feasibility of the architecture as well as of the process is shown based on a prototype which implements a typical scenario for an adaptive mobile service.References:
- Enrico Rukzio, Sven Siorpaes, Oliver Falke, Heinrich Hussmann. Policy Based Adaptive Services for Mobile Commerce. 2nd Workshop on Mobile Commerce and Services (WMCS 2005). Munich, Germany. 19 July 2005.
- Oliver Falke. Rule-based Adaption of Mobile Services. Project thesis. University of Munich. 2005.
- Sven Siorpaes. Development of Intelligent Agents based on Jade and Jess. Project thesis. University of Munich. 2004.
Mobile Services for Near Field Communication
Using physical objects as entry points to data and services can ease mobile information access. Near Field Communication (NFC), which is an extension of Radio Frequency Identification (RFID) technology, has the potential to bring mobile
devices and physical objects together. This project assesses the capabilities NFC technology offers. We report on a study that we have implemented and tested with users which demonstrates the new possibilities for physical mobile interactions. References:
- Oliver Falke, Enrico Rukzio, Ulrich Dietz, Paul Holleis, Albrecht Schmidt. Mobile Services for Near Field Communication. Technical Report LMU-MI-2007-1, ISSN 1862-5207. Munich, Germany. March 2007.
- Oliver Falke. Mobile Services for Near Field Communication. (supervised together with Ulrich Dietz - Vodafone Group R&D) Diploma thesis. University of Munich. 2005.
- Video showing the implemented prototype: (MPG - 96 MByte, XVid - 91 MByte, DivX - 65 MByte)
Privacy and Curiosity in Mobile Interactions with Public Displays
Personal multimedia devices like mobile phones create new needs for larger displays distributed at specific points in the environment to look up information about the current place, playing games or exchanging multimedia data. The technical prerequisites are covered; however, using public displays always exposing information. In this project we look at these issues from the privacy as well as from the curiosity perspective with several studies showing and confirming users reservations against public interactions. Interactive advertisements can exploit this best using specific types of interaction techniques.References:
- Paul Holleis, Enrico Rukzio, Friderike Otto, Albrecht Schmidt. Privacy and Curiosity in Mobile Interactions with Public Displays. Poster at Mobile Spatial Interaction workshop at CHI 2007, 28 April, 2007 San Jose, California, USA.
- Friederike Otto. Usage of Mobile Devices for Interactions with Public Displays. Project thesis. University of Munich. 2006.
JaGD - An Photo Oriented Learning and Gaming Platform for Mobile Phones
Mobile phones with camera and network connections are ubiquitously available. In this project we developed a platform for photo oriented games and learning applications that make use of such devices. The system consists of a web based authoring tool and a runtime environment on the mobile phone. Games and learning applications are made up of a set of tasks that have to be carried and documented with the phone camera. Results are uploaded to a server. The server supports discussion and
voting on pictures. References:
- Albrecht Schmidt, Enrico Rukzio, Eva Vodvarsky, Alexander De Luca. JaGD - An Photo Oriented Learning and Gaming Platform for Mobile Phones.(poster) Poster at The Seventh International Conference on Ubiquitous Computing (Ubicomp 2005), September 11-14, 2005, Tokyo, Japan.
- Video illustrating the prototype: MPG, 90 MByte
- Webpage of the practical course in which the prototype was developed.