Find a list of our publications at CHI 2023 below. Your own publication is missing? Send us an email: contact@germanhci.de
“In Your Face!”: Visualizing Fitness Tracker Data in Augmented Reality
Sebastian Rigling (University of Stuttgart), Xingyao Yu (University of Stuttgart), Michael Sedlmair (University of Stuttgart)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Rigling2023Face,
title = {“In Your Face!”: Visualizing Fitness Tracker Data in Augmented Reality},
author = {Sebastian Rigling (University of Stuttgart), Xingyao Yu (University of Stuttgart), Michael Sedlmair (University of Stuttgart)},
url = {https://www.vis.uni-stuttgart.de/en/institute/research_group/augmented_reality_and_virtual_reality/, Website},
doi = {10.1145/3544549.3585912},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {The benefits of augmented reality (AR) have been demonstrated in both medicine and fitness, while its application in areas where these two fields overlap has been barely explored. We argue that AR opens up new opportunities to interact with, understand and share personal health data. To this end, we developed an app prototype that uses a Snapchat-like face filter to visualize personal health data from a fitness tracker in AR. We tested this prototype in two pilot studies and found that AR does have potential in this type of application. We suggest that AR cannot replace the current interfaces of smartwatches and mobile apps, but it can pick up where current technology falls short in creating intrinsic motivation and personal health awareness. We also provide ideas for future work in this direction.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
The benefits of augmented reality (AR) have been demonstrated in both medicine and fitness, while its application in areas where these two fields overlap has been barely explored. We argue that AR opens up new opportunities to interact with, understand and share personal health data. To this end, we developed an app prototype that uses a Snapchat-like face filter to visualize personal health data from a fitness tracker in AR. We tested this prototype in two pilot studies and found that AR does have potential in this type of application. We suggest that AR cannot replace the current interfaces of smartwatches and mobile apps, but it can pick up where current technology falls short in creating intrinsic motivation and personal health awareness. We also provide ideas for future work in this direction.
“Nah, it’s just annoying!” A Deep Dive into User Perceptions of Two-Factor Authentication
Karola Marky (Ruhr-University Bochum, University of Glasgow), Kirill Ragozin (Keio University), George Chernyshov (Keio University), Andrii Matviienko (Technical University of Darmstadt), Martin Schmitz (Saarland University), Max Mühlhäuser (Technical University of Darmstadt), Chloe Eghtebas (TUM), Kai Kunze (Keio University)
Abstract | Tags: Journal | Links:
@article{Marky2023Nah,
title = {“Nah, it’s just annoying!” A Deep Dive into User Perceptions of Two-Factor Authentication},
author = {Karola Marky (Ruhr-University Bochum, University of Glasgow), Kirill Ragozin (Keio University), George Chernyshov (Keio University), Andrii Matviienko (Technical University of Darmstadt), Martin Schmitz (Saarland University), Max Mühlhäuser (Technical University of Darmstadt), Chloe Eghtebas (TUM), Kai Kunze (Keio University)},
url = {https://casa.rub.de/ueber-casa/team, Website},
doi = {10.1145/3503514},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Two-factor authentication (2FA) is a recommended or imposed authentication mechanism for valuable online assets. However, 2FA mechanisms usually exhibit user experience issues that create user friction and even lead to poor acceptance, hampering the wider spread of 2FA. In this article, we investigate user perceptions of 2FA through in-depth interviews with 42 participants, revealing key requirements that are not well met today despite recently emerged 2FA solutions. First, we investigate past experiences with authentication mechanisms emphasizing problems and aspects that hamper good user experience. Second, we investigate the different authentication factors more closely. Our results reveal particularly interesting preferences regarding the authentication factor “ownership” in terms of properties, physical realizations, and interaction. These findings suggest a path toward 2FA mechanisms with considerably better user experience, promising to improve the acceptance and hence, the proliferation of 2FA for the benefit of security in the digital world.},
keywords = {Journal},
pubstate = {published},
tppubtype = {article}
}
Two-factor authentication (2FA) is a recommended or imposed authentication mechanism for valuable online assets. However, 2FA mechanisms usually exhibit user experience issues that create user friction and even lead to poor acceptance, hampering the wider spread of 2FA. In this article, we investigate user perceptions of 2FA through in-depth interviews with 42 participants, revealing key requirements that are not well met today despite recently emerged 2FA solutions. First, we investigate past experiences with authentication mechanisms emphasizing problems and aspects that hamper good user experience. Second, we investigate the different authentication factors more closely. Our results reveal particularly interesting preferences regarding the authentication factor “ownership” in terms of properties, physical realizations, and interaction. These findings suggest a path toward 2FA mechanisms with considerably better user experience, promising to improve the acceptance and hence, the proliferation of 2FA for the benefit of security in the digital world.
“What if everyone is able to program?” – Exploring the Role of Software Development in Science Fiction
Kevin Krings (Cyber-Physical Systems, University of Siegen, Siegen, Germany), Nino S. Bohn (Cyber-Physical-Systems, University of Siegen, Siegen, Germany), Nora Anna Luise Hille (Cyber-Physical Systems, University of Siegen, Siegen, Germany), Prof. Dr. Thomas Ludwig (Cyber-Physical Systems, University of Siegen, Siegen, Germany)
Abstract | Tags: Full Paper | Links:
@inproceedings{Krings2023Software,
title = {“What if everyone is able to program?” – Exploring the Role of Software Development in Science Fiction},
author = {Kevin Krings (Cyber-Physical Systems, University of Siegen, Siegen, Germany), Nino S. Bohn (Cyber-Physical-Systems, University of Siegen, Siegen, Germany), Nora Anna Luise Hille (Cyber-Physical Systems, University of Siegen, Siegen, Germany), Prof. Dr. Thomas Ludwig (Cyber-Physical Systems, University of Siegen, Siegen, Germany)},
url = {https://cps.wineme.fb5.uni-siegen.de/?lang=en, Website},
doi = {10.1145/3544548.3581436},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {For decades, research around emerging technologies has been inspired by science fiction and vice versa. While so far almost only the technologies themselves have been considered, we explore the underlying software development and programming approaches. We therefore conduct a detailed media content analysis of twenty-seven movies that examines the role of software development in science fiction by identifying and investigating new approaches to programming and how software development is conceptualized portrayed within science fiction scenes. With the additional analysis of eighteen design fiction stories exploring the scenario “What if everyone is able to program?”, we envision potential impacts of the democratization of software development on business and society. Our study opens new discussions and perspectives, by investigating the current vision of the future of programming and uncovers new approaches to software development which can serve as a starting point for further research in the HCI community.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
For decades, research around emerging technologies has been inspired by science fiction and vice versa. While so far almost only the technologies themselves have been considered, we explore the underlying software development and programming approaches. We therefore conduct a detailed media content analysis of twenty-seven movies that examines the role of software development in science fiction by identifying and investigating new approaches to programming and how software development is conceptualized portrayed within science fiction scenes. With the additional analysis of eighteen design fiction stories exploring the scenario “What if everyone is able to program?”, we envision potential impacts of the democratization of software development on business and society. Our study opens new discussions and perspectives, by investigating the current vision of the future of programming and uncovers new approaches to software development which can serve as a starting point for further research in the HCI community.
"We Need a Big Revolution in Email Advertising": Users' Perception of Persuasion in Permission-based Advertising Emails
Anastasia Sergeeva (University of Luxembourg), Björn Rohles (University of Luxembourg), Verena Distler (University of Luxembourg / Bundeswehr University Munich), Vincent Koenig (University of Luxembourg)
Abstract | Tags: Full Paper | Links:
@inproceedings{Sergeeva2023Advertising,
title = {"We Need a Big Revolution in Email Advertising": Users' Perception of Persuasion in Permission-based Advertising Emails },
author = {Anastasia Sergeeva (University of Luxembourg), Björn Rohles (University of Luxembourg), Verena Distler (University of Luxembourg / Bundeswehr University Munich), Vincent Koenig (University of Luxembourg) },
url = {https://www.unibw.de/usable-security-and-privacy, Website
},
doi = {10.1145/3544548.3581163},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Persuasive tactics intend to encourage users to open advertising emails. However, these tactics can overwhelm users, which makes them frustrated and leads to lower open rates. This paper intends to understand which persuasive tactics are used and how they are perceived by users. We first developed a categorization of inbox-level persuasive tactics in permission-based advertising emails. We then asked participants to interact with an email inbox prototype, combined with interviews (N=32), to investigate their opinions towards advertising emails and underlying persuasive tactics. Our qualitative findings reveal poor user experience with advertising emails, which was related to feeling surveilled by companies, forced subscription, high prior knowledge about persuasive tactics, and a desire for more agency. We also found that using certain persuasive tactics on the inbox level is perceived as ethically inappropriate. Based on these insights, we provide design recommendations to improve advertising communication and make such emails more valuable to users.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Persuasive tactics intend to encourage users to open advertising emails. However, these tactics can overwhelm users, which makes them frustrated and leads to lower open rates. This paper intends to understand which persuasive tactics are used and how they are perceived by users. We first developed a categorization of inbox-level persuasive tactics in permission-based advertising emails. We then asked participants to interact with an email inbox prototype, combined with interviews (N=32), to investigate their opinions towards advertising emails and underlying persuasive tactics. Our qualitative findings reveal poor user experience with advertising emails, which was related to feeling surveilled by companies, forced subscription, high prior knowledge about persuasive tactics, and a desire for more agency. We also found that using certain persuasive tactics on the inbox level is perceived as ethically inappropriate. Based on these insights, we provide design recommendations to improve advertising communication and make such emails more valuable to users.
A Database for Kitchen Objects: Investigating Danger Perception in the Context of Human-Robot Interaction
Jan Leusmann (LMU Munich), Carl Oechsner (LMU Munich), Johanna Prinz (LMU Munich), Robin Welsch (Aalto University), Sven Mayer (LMU Munich)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Leusmann2023Kitchen,
title = {A Database for Kitchen Objects: Investigating Danger Perception in the Context of Human-Robot Interaction},
author = {Jan Leusmann (LMU Munich), Carl Oechsner (LMU Munich), Johanna Prinz (LMU Munich), Robin Welsch (Aalto University), Sven Mayer (LMU Munich)},
url = {https://www.en.um.informatik.uni-muenchen.de/index.html, Website
https://twitter.com/mimuc, twitter
https://twitter.com/janleusmann, twitter},
doi = {10.1145/3544549.3585884},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {In the future, humans collaborating closely with cobots in everyday tasks will require handing each other objects. So far, researchers have optimized human-robot collaboration concerning measures such as trust, safety, and enjoyment. However, as the objects themselves influence these measures, we need to investigate how humans perceive the danger level of objects. Thus, we created a database of 153 kitchen objects and conducted an online survey (N=300) investigating their perceived danger level. We found that (1) humans perceive kitchen objects vastly differently, (2) the object-holder has a strong effect on the danger perception, and (3) prior user knowledge increases the perceived danger of robots handling those objects. This shows that future human-robot collaboration studies must investigate different objects for a holistic image. We contribute a wiki-like open-source database to allow others to study predefined danger scenarios and eventually build object-aware systems: https://hri-objects.leusmann.io/.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
In the future, humans collaborating closely with cobots in everyday tasks will require handing each other objects. So far, researchers have optimized human-robot collaboration concerning measures such as trust, safety, and enjoyment. However, as the objects themselves influence these measures, we need to investigate how humans perceive the danger level of objects. Thus, we created a database of 153 kitchen objects and conducted an online survey (N=300) investigating their perceived danger level. We found that (1) humans perceive kitchen objects vastly differently, (2) the object-holder has a strong effect on the danger perception, and (3) prior user knowledge increases the perceived danger of robots handling those objects. This shows that future human-robot collaboration studies must investigate different objects for a holistic image. We contribute a wiki-like open-source database to allow others to study predefined danger scenarios and eventually build object-aware systems: https://hri-objects.leusmann.io/.
About Engaging and Governing Strategies: A Thematic Analysis of Dark Patterns in Social Networking Services
Thomas Mildner (University of Bremen), Gian-Luca Savino (University of St.Gallen), Philip R. Doyle (University College Dublin), Benjamin R. Cowen (University College Dublin), Rainer Malaka (University of Bremen)
Abstract | Tags: Full Paper | Links:
@inproceedings{Mildner2023Dark,
title = {About Engaging and Governing Strategies: A Thematic Analysis of Dark Patterns in Social Networking Services },
author = {Thomas Mildner (University of Bremen), Gian-Luca Savino (University of St.Gallen), Philip R. Doyle (University College Dublin), Benjamin R. Cowen (University College Dublin), Rainer Malaka (University of Bremen)},
url = {http://dm.tzi.de/, Website
https://twitter.com/dmlabbremen, twitter
},
doi = {10.1145/3544548.3580695},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Research in HCI has shown a growing interest in unethical design practices across numerous domains, often described as "dark patterns". There is, however, a literature gap regarding social networking services (SNSs). Meanwhile, related studies emphasise a need for more control over personal data and agency on SNSs. To understand how dark patterns manifest in SNSs, we recorded over 16 hours of usage from four mobile SNS applications: Facebook, Instagram, TikTok, and Twitter. To mitigate possible difficulties of non-experts studied before, we turned towards six HCI experts as reviewers. Two researchers then conducted a thematic analysis based on existing taxonomies. Our results deliver two key findings: We observed which instances occur in SNSs and identified two strategies - engaging and governing - with five dark patterns undescribed before. This work expands prior research by demonstrating how existing taxonomies can be applied in alternative contexts, enabling the discovery of undefined ones.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Research in HCI has shown a growing interest in unethical design practices across numerous domains, often described as "dark patterns". There is, however, a literature gap regarding social networking services (SNSs). Meanwhile, related studies emphasise a need for more control over personal data and agency on SNSs. To understand how dark patterns manifest in SNSs, we recorded over 16 hours of usage from four mobile SNS applications: Facebook, Instagram, TikTok, and Twitter. To mitigate possible difficulties of non-experts studied before, we turned towards six HCI experts as reviewers. Two researchers then conducted a thematic analysis based on existing taxonomies. Our results deliver two key findings: We observed which instances occur in SNSs and identified two strategies - engaging and governing - with five dark patterns undescribed before. This work expands prior research by demonstrating how existing taxonomies can be applied in alternative contexts, enabling the discovery of undefined ones.
Accidentally Evil: On Questionable Values in Smart Home Co-Design
Arne Berger (Computer Science, Languages, Anhalt University of Applied Sciences, Koethen, Germany), Albrecht Kurze (Computer Science, Chemnitz University of Technology, Chemnitz, Germany), Andreas Bischof (Chemnitz University of Technology, Chemnitz, Germany), Jesse Josua Benjamin (Lancaster University, Imagination Lancaster, Lancaster, United Kingdom), Richmond Y. Wong (Digital Media, Georgia Institute of Technology, Atlanta, Georgia, United States), Nick Merrill (Daylight Lab, Center for Long-Term Cybersecurity, University of California, Berkeley, Berkeley, California, United States)
Abstract | Tags: Full Paper | Links:
@inproceedings{berger2023Evil,
title = {Accidentally Evil: On Questionable Values in Smart Home Co-Design},
author = {Arne Berger (Computer Science and Languages, Anhalt University of Applied Sciences, Koethen, Germany),
Albrecht Kurze (Computer Science, Chemnitz University of Technology, Chemnitz, Germany),
Andreas Bischof (Chemnitz University of Technology, Chemnitz, Germany),
Jesse Josua Benjamin (Lancaster University, Imagination Lancaster, Lancaster, United Kingdom),
Richmond Y. Wong (Digital Media, Georgia Institute of Technology, Atlanta, Georgia, United States),
Nick Merrill (Daylight Lab, Center for Long-Term Cybersecurity, University of California, Berkeley, Berkeley, California, United States)},
doi = {10.1145/3544548.3581504},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {An ongoing mystery of HCI is how do well-intentioned designers consistently enable products with unintentionally evil consequences. Using “questionable values” as a lens, we retell and analyze four design scenarios for smart homes that were created by participants with an IoT toolkit we designed. The selected design scenarios reveal practices that violate principles of responsible smart home design. Through our analysis we show (1) how participants explore sensor-driven objectification of the home then leverage data for surveillance, nudging, and control over others; (2) how the dominant technosolutionist narratives of efficiency and productivity ground such questionable values; (3) and how the materiality of mass-produced sensors pre-mediates questionable design scenarios. We discuss how to attend to and utilize questionable values in design: Making space for questionable values will empower design researchers to better “look around corners”, anticipating tomorrow’s concerns and forestalling the worst of their harms.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
An ongoing mystery of HCI is how do well-intentioned designers consistently enable products with unintentionally evil consequences. Using “questionable values” as a lens, we retell and analyze four design scenarios for smart homes that were created by participants with an IoT toolkit we designed. The selected design scenarios reveal practices that violate principles of responsible smart home design. Through our analysis we show (1) how participants explore sensor-driven objectification of the home then leverage data for surveillance, nudging, and control over others; (2) how the dominant technosolutionist narratives of efficiency and productivity ground such questionable values; (3) and how the materiality of mass-produced sensors pre-mediates questionable design scenarios. We discuss how to attend to and utilize questionable values in design: Making space for questionable values will empower design researchers to better “look around corners”, anticipating tomorrow’s concerns and forestalling the worst of their harms.
An Examination of Motivation in Physical Therapy Through the Lens of Self-Determination Theory: Implications for Game Design
Maria Aufheimer (KIT), Kathrin Gerling (KIT), Nicholas Graham (Queen's University), Mari Naaris (KU Leuven), Marco Konings (KU Leuven), Elegast Monbaliu (KU Leuven), Hans Hallez (KU Leuven), Els Ortibus (UZ Leuven)
Abstract | Tags: Full Paper | Links:
@inproceedings{Aufheimer2023Therapy,
title = {An Examination of Motivation in Physical Therapy Through the Lens of Self-Determination Theory: Implications for Game Design},
author = {Maria Aufheimer (KIT), Kathrin Gerling (KIT), Nicholas Graham (Queen's University), Mari Naaris (KU Leuven), Marco Konings (KU Leuven), Elegast Monbaliu (KU Leuven), Hans Hallez (KU Leuven), Els Ortibus (UZ Leuven)},
url = {https://hci.anthropomatik.kit.edu/, Website},
doi = {10.1145/3544548.3581171},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {While it is widely assumed that games can engage patients in therapy through their inherent 'motivational pull', relatively little attention has been paid to what HCI games research can learn from strategies employed by therapists. We address this gap by leveraging Self-Determination Theory (SDT) and its mini-theories Basic Psychological Needs Theory and Organismic Integration Theory as a theoretical lens on physical therapy for children and adolescents. Results from in-depth interviews with twelve therapists show that they carefully adjust sessions to allow patients to experience competence, making more comprehensive adjustments than currently offered by games. Additionally, we highlight how therapists leverage their relationship with patients to support motivation, but struggle to reconcile meaningful experiences of autonomy with therapeutic goals. On this basis, we reflect on implications for researchers and designers who create games for physical therapy, and the potential of SDT to provide a foundation for game design and therapeutic practice.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
While it is widely assumed that games can engage patients in therapy through their inherent 'motivational pull', relatively little attention has been paid to what HCI games research can learn from strategies employed by therapists. We address this gap by leveraging Self-Determination Theory (SDT) and its mini-theories Basic Psychological Needs Theory and Organismic Integration Theory as a theoretical lens on physical therapy for children and adolescents. Results from in-depth interviews with twelve therapists show that they carefully adjust sessions to allow patients to experience competence, making more comprehensive adjustments than currently offered by games. Additionally, we highlight how therapists leverage their relationship with patients to support motivation, but struggle to reconcile meaningful experiences of autonomy with therapeutic goals. On this basis, we reflect on implications for researchers and designers who create games for physical therapy, and the potential of SDT to provide a foundation for game design and therapeutic practice.
ARound the Smartphone: Investigating the Effects of Virtually-Extended Display Size on Spatial Memory
Sebastian Hubenschmid (University of Konstanz), Johannes Zagermann (University of Konstanz), Daniel Leicht (University of Konstanz), Harald Reiterer (University of Konstanz), Tiare Feuchtner (University of Konstanz)
Abstract | Tags: Full Paper | Links:
@inproceedings{Hubenschmidt2023Around,
title = {ARound the Smartphone: Investigating the Effects of Virtually-Extended Display Size on Spatial Memory},
author = {Sebastian Hubenschmid (University of Konstanz), Johannes Zagermann (University of Konstanz), Daniel Leicht (University of Konstanz), Harald Reiterer (University of Konstanz), Tiare Feuchtner (University of Konstanz) },
url = {https://hci.uni-konstanz.de, Website
https://twitter.com/hcigroupkn, twitter
https://www.youtube.com/watch?v=LnLQL220lQ4, Teaser Video
https://www.youtube.com/watch?v=p6cHwLxHWJg, Full Video
},
doi = {10.1145/3544548.3581438},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Smartphones conveniently place large information spaces in the palms of our hands. While research has shown that larger screens positively affect spatial memory, workload, and user experience, smartphones remain fairly compact for the sake of device ergonomics and portability. Thus, we investigate the use of hybrid user interfaces to virtually increase the available display size by complementing the smartphone with an augmented reality head-mounted display. We thereby combine the benefits of familiar touch interaction with the near-infinite visual display space afforded by augmented reality. To better understand the potential of virtually-extended displays and the possible issues of splitting the user's visual attention between two screens (real and virtual), we conducted a within-subjects experiment with 24 participants completing navigation tasks using different virtually-augmented display sizes. Our findings reveal that a desktop monitor size represents a "sweet spot" for extending smartphones with augmented reality, informing the design of hybrid user interfaces.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Smartphones conveniently place large information spaces in the palms of our hands. While research has shown that larger screens positively affect spatial memory, workload, and user experience, smartphones remain fairly compact for the sake of device ergonomics and portability. Thus, we investigate the use of hybrid user interfaces to virtually increase the available display size by complementing the smartphone with an augmented reality head-mounted display. We thereby combine the benefits of familiar touch interaction with the near-infinite visual display space afforded by augmented reality. To better understand the potential of virtually-extended displays and the possible issues of splitting the user's visual attention between two screens (real and virtual), we conducted a within-subjects experiment with 24 participants completing navigation tasks using different virtually-augmented display sizes. Our findings reveal that a desktop monitor size represents a "sweet spot" for extending smartphones with augmented reality, informing the design of hybrid user interfaces.
AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction Studies
Pascal Jansen (Ulm University), Julian Britten (Ulm University), Alexander Häusele (Ulm University), Thilo Segschneider (Ulm University), Mark Colley (Ulm University), Enrico Rukzio (Ulm University)
Abstract | Tags: Full Paper | Links:
@inproceedings{Jansen2023AutoVis,
title = {AutoVis: Enabling Mixed-Immersive Analysis of Automotive User Interface Interaction Studies},
author = {Pascal Jansen (Ulm University), Julian Britten (Ulm University), Alexander Häusele (Ulm University), Thilo Segschneider (Ulm University), Mark Colley (Ulm University), Enrico Rukzio (Ulm University)},
url = {https://youtu.be/JhxoEHHTItQ, Teaser Video
https://youtu.be/xaY64NHyblo, Full Video},
doi = {10.1145/3544548.3580760},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Automotive user interface (AUI) evaluation becomes increasingly complex due to novel interaction modalities, driving automation, heterogeneous data, and dynamic environmental contexts. Immersive analytics may enable efficient explorations of the resulting multilayered interplay between humans, vehicles, and the environment. However, no such tool exists for the automotive domain. With AutoVis, we address this gap by combining a non-immersive desktop with a virtual reality view enabling mixed-immersive analysis of AUIs. We identify design requirements based on an analysis of AUI research and domain expert interviews (N=5). AutoVis supports analyzing passenger behavior, physiology, spatial interaction, and events in a replicated study environment using avatars, trajectories, and heatmaps. We apply context portals and driving-path events as automotive-specific visualizations. To validate AutoVis against real-world analysis tasks, we implemented a prototype, conducted heuristic walkthroughs using authentic data from a case study and public datasets, and leveraged a real vehicle in the analysis process.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Automotive user interface (AUI) evaluation becomes increasingly complex due to novel interaction modalities, driving automation, heterogeneous data, and dynamic environmental contexts. Immersive analytics may enable efficient explorations of the resulting multilayered interplay between humans, vehicles, and the environment. However, no such tool exists for the automotive domain. With AutoVis, we address this gap by combining a non-immersive desktop with a virtual reality view enabling mixed-immersive analysis of AUIs. We identify design requirements based on an analysis of AUI research and domain expert interviews (N=5). AutoVis supports analyzing passenger behavior, physiology, spatial interaction, and events in a replicated study environment using avatars, trajectories, and heatmaps. We apply context portals and driving-path events as automotive-specific visualizations. To validate AutoVis against real-world analysis tasks, we implemented a prototype, conducted heuristic walkthroughs using authentic data from a case study and public datasets, and leveraged a real vehicle in the analysis process.
Balancing Power Relations in Participatory Design: The Importance of Initiative and External Factors
Torben Volkmann (Universität zu Lübeck), Markus Dresel (Universität zu Lübeck), Nicole Jochems (Universität zu Lübeck)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Volkmann2023Participatory,
title = {Balancing Power Relations in Participatory Design: The Importance of Initiative and External Factors },
author = {Torben Volkmann (Universität zu Lübeck), Markus Dresel (Universität zu Lübeck), Nicole Jochems (Universität zu Lübeck)},
url = {https://www.imis.uni-luebeck.de, Website},
doi = {10.1145/3544549.3585864},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Power imbalances between users and designers impede the intent to equal contributions in a participatory process. Recent years have shown that unforeseen external factors pose a risk of exacerbating this power imbalance by limiting in-person meetings and communication in general. This study evaluated a projects' power relations using a three-part reflection-on-action approach. Results show, that external factors can act as an actor in the power relationship model and that the change of initiative can change the power relations. Thus, we propose a power relation triangle for Participatory Design processes, including participants, designers and external conditions as actors and the decision-making at the center based on the combination of the actor's relations. This framework can help to better understand and address power imbalances in Participatory Design.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Power imbalances between users and designers impede the intent to equal contributions in a participatory process. Recent years have shown that unforeseen external factors pose a risk of exacerbating this power imbalance by limiting in-person meetings and communication in general. This study evaluated a projects' power relations using a three-part reflection-on-action approach. Results show, that external factors can act as an actor in the power relationship model and that the change of initiative can change the power relations. Thus, we propose a power relation triangle for Participatory Design processes, including participants, designers and external conditions as actors and the decision-making at the center based on the combination of the actor's relations. This framework can help to better understand and address power imbalances in Participatory Design.
Bees, Birds and Butterflies: Investigating the Influence of Distractors on Visual Attention Guidance Techniques
Nina Doerr (University of Stuttgart), Katrin Angerbauer (University of Stuttgart), Melissa Reinelt (University of Stuttgart), Michael Sedlmair (University of Stuttgart)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Doerr2023Bees,
title = {Bees, Birds and Butterflies: Investigating the Influence of Distractors on Visual Attention Guidance Techniques },
author = {Nina Doerr (University of Stuttgart), Katrin Angerbauer (University of Stuttgart), Melissa Reinelt (University of Stuttgart), Michael Sedlmair (University of Stuttgart)},
url = {https://github.com/visvar/, Website},
doi = {10.1145/3544549.3585816},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Visual attention guidance methods direct the viewer's gaze in immersive environments by visually highlighting elements of interest. The highlighting can be done, for instance, by adding a colored circle around elements, adding animated swarms (HiveFive), or removing objects from one eye in a stereoscopic display (Deadeye). We contribute a controlled user experiment (N=30) comparing these three techniques under the influence of visual distractors, such as bees flying by. Our results show that Circle and HiveFive performed best in terms of task performance and qualitative feedback, and were largely robust against different levels of distractions. Furthermore, we discovered a high mental demand for Deadeye.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Visual attention guidance methods direct the viewer's gaze in immersive environments by visually highlighting elements of interest. The highlighting can be done, for instance, by adding a colored circle around elements, adding animated swarms (HiveFive), or removing objects from one eye in a stereoscopic display (Deadeye). We contribute a controlled user experiment (N=30) comparing these three techniques under the influence of visual distractors, such as bees flying by. Our results show that Circle and HiveFive performed best in terms of task performance and qualitative feedback, and were largely robust against different levels of distractions. Furthermore, we discovered a high mental demand for Deadeye.
Behavioural Design in Video Games: Ethical, Legal, and Health Impact on Players
Max Birk (TU Eindhoven), Simone van der Hof (Leiden University), Celia Hodent (Raising Good Gamers), Kathrin Gerling (KIT), Tony van Rooij (Timbos Institute)
Abstract | Tags: Workshop | Links:
@inproceedings{Birk2023Behavioural,
title = {Behavioural Design in Video Games: Ethical, Legal, and Health Impact on Players},
author = {Max Birk (TU Eindhoven), Simone van der Hof (Leiden University), Celia Hodent (Raising Good Gamers), Kathrin Gerling (KIT), Tony van Rooij (Timbos Institute)},
url = {https://hci.anthropomatik.kit.edu/, Website},
doi = {10.1145/3544549.3573801},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Videogames use behavioural design strategies, i.e., dark pattern, to increase engagement and drive revenue. These practices affect consumer behaviour, e.g., extended play time, and subsequently health, e.g., social well-being. HCI approaches such as motivational design or personalization are central to behavioural design strategies. Some approaches, e.g., guild tripping of users, are ethically and legally questionable. In this workshop, we explore the ethical, health, and legal implications of behavioural design strategies. Our workshop aims to integrate interdisciplinary viewpoints, to co-develop a road map to address behavioural design, and to collect contemporary perspectives on behavioural design. Participants will take away knowledge from different expert perspectives, concrete steps to address the impact of behavioural design, and a multidisciplinary expert network.},
keywords = {Workshop},
pubstate = {published},
tppubtype = {inproceedings}
}
Videogames use behavioural design strategies, i.e., dark pattern, to increase engagement and drive revenue. These practices affect consumer behaviour, e.g., extended play time, and subsequently health, e.g., social well-being. HCI approaches such as motivational design or personalization are central to behavioural design strategies. Some approaches, e.g., guild tripping of users, are ethically and legally questionable. In this workshop, we explore the ethical, health, and legal implications of behavioural design strategies. Our workshop aims to integrate interdisciplinary viewpoints, to co-develop a road map to address behavioural design, and to collect contemporary perspectives on behavioural design. Participants will take away knowledge from different expert perspectives, concrete steps to address the impact of behavioural design, and a multidisciplinary expert network.
Behind the Scenes of Automation: Ghostly Care-Work, Maintenance, and Interferences
Yana Boeva (University of Stuttgart, Stuttgart, Germany), Arne Berger (Computer Science, Languages, Anhalt University of Applied Sciences, Koethen, Germany), Andreas Bischof (Chemnitz University of Technology, Chemnitz, Germany), Olivia Doggett (Faculty of Information, University of Toronto, Toronto, Ontario, Canada), Hendrik Heuer (Institute for Information Management Bremen, University of Bremen, Bremen, Bremen, Germany), Juliane Jarke (University of Graz, Graz, Austria), Pat Treusch (The Trinity Long Room Hub, Trinity College Dublin, Dublin, Ireland), Roger Soraa (NTNU Norwegian University of Science, Technology, Trondheim, Norway), Zhasmina Tacheva (School of Information Studies, Syracuse University, Syracuse, New York, United States), Maja-Lee Voigt (Leuphana University Lüneburg, Lüneburg, Germany)
Abstract | Tags: Workshop | Links:
@inproceedings{Boeva2023Automation,
title = {Behind the Scenes of Automation: Ghostly Care-Work, Maintenance, and Interferences},
author = {Yana Boeva (University of Stuttgart, Stuttgart, Germany), Arne Berger (Computer Science and Languages, Anhalt University of Applied Sciences, Koethen, Germany), Andreas Bischof (Chemnitz University of Technology, Chemnitz, Germany), Olivia Doggett (Faculty of Information, University of Toronto, Toronto, Ontario, Canada), Hendrik Heuer (Institute for Information Management Bremen, University of Bremen, Bremen, Bremen, Germany), Juliane Jarke (University of Graz, Graz, Austria), Pat Treusch (The Trinity Long Room Hub, Trinity College Dublin, Dublin, Ireland), Roger Soraa (NTNU Norwegian University of Science and Technology, Trondheim, Norway), Zhasmina Tacheva (School of Information Studies, Syracuse University, Syracuse, New York, United States), Maja-Lee Voigt (Leuphana University Lüneburg, Lüneburg, Germany)
},
url = {http://www.arneberger.de, Website
http://www.twitter.com/arneberger, twitter},
doi = {10.1145/3544549.3573830},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Industry and media have long represented automation as a harbinger of development and convenience in different areas of life. An anxious prospect to some, automation systems promise “progress” and profitability to others by conjuring corporate computational futures. What remains behind the scenes of these predictions and imaginaries of automation is the invisible human labor of global ghost workers caring for, maintaining, and repairing technologies. Invisible but irreplaceable, computation performed by humans in precarious conditions fills gaps that computer technologies lack skills and sensibility for. In this hybrid workshop, we ask who the “ghosts” are in the machines. The workshop will address the ghostly presence of humans and human labor in automation and its challenges to HCI research and design.},
keywords = {Workshop},
pubstate = {published},
tppubtype = {inproceedings}
}
Industry and media have long represented automation as a harbinger of development and convenience in different areas of life. An anxious prospect to some, automation systems promise “progress” and profitability to others by conjuring corporate computational futures. What remains behind the scenes of these predictions and imaginaries of automation is the invisible human labor of global ghost workers caring for, maintaining, and repairing technologies. Invisible but irreplaceable, computation performed by humans in precarious conditions fills gaps that computer technologies lack skills and sensibility for. In this hybrid workshop, we ask who the “ghosts” are in the machines. The workshop will address the ghostly presence of humans and human labor in automation and its challenges to HCI research and design.
Blended Interaction: Communication and Collaboration Between Two Users Across the Reality-Virtuality Continuum
Lucie Kruse (Universität Hamburg), Joel Wittig (Universität Hamburg), Sebastian Finnern (Universität Hamburg), Melvin Gundlach (Universität Hamburg), Niclas Iserlohe (Universität Hamburg), Dr. Oscar Ariza (Universität Hamburg), Prof. Dr. Frank Steinicke (Universität Hamburg)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Kruse2023Blended,
title = {Blended Interaction: Communication and Collaboration Between Two Users Across the Reality-Virtuality Continuum },
author = {Lucie Kruse (Universität Hamburg), Joel Wittig (Universität Hamburg), Sebastian Finnern (Universität Hamburg), Melvin Gundlach (Universität Hamburg), Niclas Iserlohe (Universität Hamburg), Dr. Oscar Ariza (Universität Hamburg), Prof. Dr. Frank Steinicke (Universität Hamburg)},
url = {https://www.inf.uni-hamburg.de/en/inst/ab/hci.html, Website
},
doi = {10.1145/3544549.3585881},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Mixed reality (MR) technologies provide enormous potential for collaboration between multiple users across the Reality–Virtuality continuum. We evaluate communication in a MR-based two-user collaboration task, in which the users have to move an object through an obstacle without collision. We used a blended reality environment, in which one user is immersed in virtual reality, whereas the other uses mobile augmented reality. Both users have different abilities and information and mutually depend on each other for successful completion of the task. Communication consensus can either be achieved by using speech, visual widgets, or a combination of both. The results indicate that speech plays a fundamental role. The usage of widgets served as an extension rather than a replacement of language. However, the combination of speech and widgets improved the clearness of communication with less miscommunication. These results provide important indications about how to design blended collaboration across the Reality–Virtuality continuum.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Mixed reality (MR) technologies provide enormous potential for collaboration between multiple users across the Reality–Virtuality continuum. We evaluate communication in a MR-based two-user collaboration task, in which the users have to move an object through an obstacle without collision. We used a blended reality environment, in which one user is immersed in virtual reality, whereas the other uses mobile augmented reality. Both users have different abilities and information and mutually depend on each other for successful completion of the task. Communication consensus can either be achieved by using speech, visual widgets, or a combination of both. The results indicate that speech plays a fundamental role. The usage of widgets served as an extension rather than a replacement of language. However, the combination of speech and widgets improved the clearness of communication with less miscommunication. These results provide important indications about how to design blended collaboration across the Reality–Virtuality continuum.
BrailleBuddy: A Tangible User Interface to Support Children with Visual Impairment in Learning Braille
Florian Lang (LMU Munich), Verena Pues (LMU Munich), Albrecht Schmidt (LMU Munich), Tonja-Katrin Machulla (TU Chemnitz)
Abstract | Tags: Full Paper | Links:
@inproceedings{Lang2023Braille,
title = {BrailleBuddy: A Tangible User Interface to Support Children with Visual Impairment in Learning Braille},
author = {Florian Lang (LMU Munich), Verena Pues (LMU Munich), Albrecht Schmidt (LMU Munich), Tonja-Katrin Machulla (TU Chemnitz)},
doi = {10.1145/3544548.3580844},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Learning to read Braille is crucial to academic success for people with blindness or severe visual impairment. In our work, we investigate how we can support early learning of Braille with tangible computing. In a human-centered inclusive design process with interviews, six design iterations with prototypes, and feedback from experts, students, and teachers, we created BrailleBuddy. BrailleBuddy is a tangible user interface supporting children with visual impairments in learning Braille. We evaluated BrailleBuddy in a user study with children with blindness. Our results show that BrailleBuddy provides intrinsic motivation for learning Braille and can be used by children without supervision. BrailleBuddy complements the educational program as it allows children to play with and explore Braille characters at their own pace, thus lowering the challenge of learning to read Braille. In addition, an open-source toolkit is provided to enable educators and researchers to support individual requirements.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Learning to read Braille is crucial to academic success for people with blindness or severe visual impairment. In our work, we investigate how we can support early learning of Braille with tangible computing. In a human-centered inclusive design process with interviews, six design iterations with prototypes, and feedback from experts, students, and teachers, we created BrailleBuddy. BrailleBuddy is a tangible user interface supporting children with visual impairments in learning Braille. We evaluated BrailleBuddy in a user study with children with blindness. Our results show that BrailleBuddy provides intrinsic motivation for learning Braille and can be used by children without supervision. BrailleBuddy complements the educational program as it allows children to play with and explore Braille characters at their own pace, thus lowering the challenge of learning to read Braille. In addition, an open-source toolkit is provided to enable educators and researchers to support individual requirements.
Challenges and Opportunities for Interactive Technology to Support Parents of HIV-Positive Children in Ethiopia in the Disclosure Process
Alemitu Bezabih (KU Leuven), Kathrin Gerling (KIT), Workeabeba Taye (Addis Ababa University), Vero Vanden Abeele (KU Leuven)
Abstract | Tags: Full Paper | Links:
@inproceedings{Bezabih2023HIV,
title = {Challenges and Opportunities for Interactive Technology to Support Parents of HIV-Positive Children in Ethiopia in the Disclosure Process},
author = {Alemitu Bezabih (KU Leuven), Kathrin Gerling (KIT), Workeabeba Taye (Addis Ababa University), Vero Vanden Abeele (KU Leuven)},
url = {https://hci.anthropomatik.kit.edu/, Website},
doi = {10.1145/3544548.3580756},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Fearing stigma, parents often hide their children’s HIV diagnosis from them, and postpone disclosure, in turn negatively impacting children’s well-being. Our work explores whether interactive technology can support disclosure. In the first study, we examine disclosure experiences and the role of interactive technology from the perspective of HIV-positive children and parents. Through Thematic Analysis, we highlight how disclosure is linked with parents’ own experience of HIV, and that disclosure needs to be viewed as a process. On this basis, we contribute an experience prototype that guides parents through an incremental disclosure process using interactive storytelling. In a second study, we evaluate the prototype through interviews with six parents. Leveraging Interpretative Phenomenological Analysis, we show that the prototype has potential to transform how parents understand and approach disclosure. Based on our results, we present further design directions, and discuss the (limitations of the) role that technology can play in this context.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Fearing stigma, parents often hide their children’s HIV diagnosis from them, and postpone disclosure, in turn negatively impacting children’s well-being. Our work explores whether interactive technology can support disclosure. In the first study, we examine disclosure experiences and the role of interactive technology from the perspective of HIV-positive children and parents. Through Thematic Analysis, we highlight how disclosure is linked with parents’ own experience of HIV, and that disclosure needs to be viewed as a process. On this basis, we contribute an experience prototype that guides parents through an incremental disclosure process using interactive storytelling. In a second study, we evaluate the prototype through interviews with six parents. Leveraging Interpretative Phenomenological Analysis, we show that the prototype has potential to transform how parents understand and approach disclosure. Based on our results, we present further design directions, and discuss the (limitations of the) role that technology can play in this context.
Children with ADHD and their Care Ecosystem: Designing Beyond Symptoms
Evropi Stefanidi (University of Bremen), Johannes Schöning (University of St. Gallen), Yvonne Rogers (UCLIC, UCL), Jasmin Niess (University of St. Gallen, University of Oslo)
Abstract | Tags: Full Paper | Links:
@inproceedings{Stefanidi2023Children,
title = {Children with ADHD and their Care Ecosystem: Designing Beyond Symptoms},
author = {Evropi Stefanidi (University of Bremen), Johannes Schöning (University of St. Gallen), Yvonne Rogers (UCLIC, UCL), Jasmin Niess (University of St. Gallen and University of Oslo)},
url = {https://hci.uni-bremen.de/, Website
https://twitter.com/HCIBremen, twitter},
doi = {10.1145/3544548.3581216},
year = {2023},
date = {2023-04-23},
urldate = {2023-04-23},
publisher = {ACM},
abstract = {Designing for children with ADHD has been of increasing interest to the HCI community. However, current approaches do not adequately involve all relevant stakeholders, and primarily focus on addressing symptoms, following a medical model of disability that is extrinsic to neurodivergent interests. To address this, we employed a multi-step, multi-stakeholder approach (N=31). First, we conducted 1) interviews with children with ADHD and their care ecosystem followed by 2) a co-design pilot with one child with ADHD and his therapists and an interview with a UX designer and an occupational therapist. We then employed 3) co-design sessions with neurotypical children and children with ADHD, and 4) a focus group with their therapists. We identified communication and reflection as key concepts for empowering and promoting the well-being of children with ADHD and their care ecosystem. We contribute design implications for future systems aiming to promote the overall well-being of this population.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Designing for children with ADHD has been of increasing interest to the HCI community. However, current approaches do not adequately involve all relevant stakeholders, and primarily focus on addressing symptoms, following a medical model of disability that is extrinsic to neurodivergent interests. To address this, we employed a multi-step, multi-stakeholder approach (N=31). First, we conducted 1) interviews with children with ADHD and their care ecosystem followed by 2) a co-design pilot with one child with ADHD and his therapists and an interview with a UX designer and an occupational therapist. We then employed 3) co-design sessions with neurotypical children and children with ADHD, and 4) a focus group with their therapists. We identified communication and reflection as key concepts for empowering and promoting the well-being of children with ADHD and their care ecosystem. We contribute design implications for future systems aiming to promote the overall well-being of this population.
Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting
Hai Dang (University of Bayreuth), Sven Goller (University of Bayreuth), Florian Lehmann (University of Bayreuth), Daniel Buschek (University of Bayreuth) (Ed.)
Abstract | Tags: Full Paper | Links:
@inproceedings{dang2023diegetic,
title = {Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting},
editor = {Hai Dang (University of Bayreuth), Sven Goller (University of Bayreuth), Florian Lehmann (University of Bayreuth), Daniel Buschek (University of Bayreuth)},
url = {https://www.hciai.uni-bayreuth.de/,. Webseite},
doi = {10.1145/3544548.3580969},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {We propose a conceptual perspective on prompts for Large Language Models (LLMs) that distinguishes between (1) diegetic prompts (part of the narrative, e.g. "Once upon a time, I saw a fox..."), and (2) non-diegetic prompts (external, e.g. "Write about the adventures of the fox."). With this lens, we study how 129 crowd workers on Prolific write short texts with different user interfaces (1 vs 3 suggestions, with/out non-diegetic prompts; implemented with GPT-3): When the interface offered multiple suggestions and provided an option for non-diegetic prompting, participants preferred choosing from multiple suggestions over controlling them via non-diegetic prompts. When participants provided non-diegetic prompts it was to ask for inspiration, topics or facts. Single suggestions in particular were guided both with diegetic and non-diegetic information. This work informs human-AI interaction with generative models by revealing that (1) writing non-diegetic prompts requires effort, (2) people combine diegetic and non-diegetic prompting, and (3) they use their draft (i.e. diegetic information) and suggestion timing to strategically guide LLMs.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
We propose a conceptual perspective on prompts for Large Language Models (LLMs) that distinguishes between (1) diegetic prompts (part of the narrative, e.g. "Once upon a time, I saw a fox..."), and (2) non-diegetic prompts (external, e.g. "Write about the adventures of the fox."). With this lens, we study how 129 crowd workers on Prolific write short texts with different user interfaces (1 vs 3 suggestions, with/out non-diegetic prompts; implemented with GPT-3): When the interface offered multiple suggestions and provided an option for non-diegetic prompting, participants preferred choosing from multiple suggestions over controlling them via non-diegetic prompts. When participants provided non-diegetic prompts it was to ask for inspiration, topics or facts. Single suggestions in particular were guided both with diegetic and non-diegetic information. This work informs human-AI interaction with generative models by revealing that (1) writing non-diegetic prompts requires effort, (2) people combine diegetic and non-diegetic prompting, and (3) they use their draft (i.e. diegetic information) and suggestion timing to strategically guide LLMs.
Co-Writing with Opinionated Language Models Affects Users' Views
Maurice Jakesch (Cornell University), Advait Bhat (Microsoft Research), Daniel Buschek (University of Bayreuth), Lior Zalmanson (Tel Aviv University), Mor Naaman (Cornell Tech)
Abstract | Tags: Full Paper | Links:
@inproceedings{Jakesch2023models,
title = {Co-Writing with Opinionated Language Models Affects Users' Views},
author = {Maurice Jakesch (Cornell University), Advait Bhat (Microsoft Research), Daniel Buschek (University of Bayreuth), Lior Zalmanson (Tel Aviv University), Mor Naaman (Cornell Tech)},
url = {https://www.hciai.uni-bayreuth.de/, Webseite},
doi = {10.1145/3544548.3581196},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {If large language models like GPT-3 preferably produce a particular point of view, they may influence people's opinions on an unknown scale. This study investigates whether a language-model-powered writing assistant that generates some opinions more often than others impacts what users write -- and what they think. In an online experiment, we asked participants (N=1,506) to write a post discussing whether social media is good for society. Treatment group participants used a language-model-powered writing assistant configured to argue that social media is good or bad for society. Participants then completed a social media attitude survey, and independent judges (N=500) evaluated the opinions expressed in their writing. Using the opinionated language model affected the opinions expressed in participants' writing and shifted their opinions in the subsequent attitude survey. We discuss the wider implications of our results and argue that the opinions built into AI language technologies need to be monitored and engineered more carefully.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
If large language models like GPT-3 preferably produce a particular point of view, they may influence people's opinions on an unknown scale. This study investigates whether a language-model-powered writing assistant that generates some opinions more often than others impacts what users write -- and what they think. In an online experiment, we asked participants (N=1,506) to write a post discussing whether social media is good for society. Treatment group participants used a language-model-powered writing assistant configured to argue that social media is good or bad for society. Participants then completed a social media attitude survey, and independent judges (N=500) evaluated the opinions expressed in their writing. Using the opinionated language model affected the opinions expressed in participants' writing and shifted their opinions in the subsequent attitude survey. We discuss the wider implications of our results and argue that the opinions built into AI language technologies need to be monitored and engineered more carefully.
Collaborating Across Realities: Analytical Lenses for Understanding Dyadic Collaboration in Transitional Interfaces
Jan-Henrik Schröder (University of Lübeck), Daniel Schacht (University of Lübeck), Niklas Peper (University of Lübeck), Anita Marie Hamurculu (University of Lübeck), Hans-Christian Jetter (University of Lübeck)
Abstract | Tags: Full Paper | Links:
@inproceedings{Schroeder2023Transitional,
title = {Collaborating Across Realities: Analytical Lenses for Understanding Dyadic Collaboration in Transitional Interfaces},
author = {Jan-Henrik Schröder (University of Lübeck), Daniel Schacht (University of Lübeck), Niklas Peper (University of Lübeck), Anita Marie Hamurculu (University of Lübeck), Hans-Christian Jetter (University of Lübeck)},
url = {https://www.imis.uni-luebeck.de/de/institut/professuren/professur-fuer-interaktionsdesign-und-user-experience, Website
},
doi = {10.1145/3544548.3580879},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Transitional Interfaces are a yet underexplored, emerging class of cross-reality user interfaces that enable users to freely move along the reality-virtuality continuum during collaboration. To analyze and understand how such collaboration unfolds, we propose four analytical lenses derived from an exploratory study of transitional collaboration with 15 dyads. While solving a complex spatial optimization task, participants could freely switch between three contexts, each with different displays (desktop screens, tablet-based augmented reality, head-mounted virtual reality), input techniques (mouse, touch, handheld controllers), and visual representations (monoscopic and allocentric 2D/3D maps, stereoscopic egocentric views). Using the rich qualitative and quantitative data from our study, we evaluated participants' perceptions of transitional collaboration and identified commonalities and differences between dyads. We then derived four lenses including metrics and visualizations to analyze key aspects of transitional collaboration: (1) place and distance, (2) temporal patterns, (3) group use of contexts, (4) individual use of contexts.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Transitional Interfaces are a yet underexplored, emerging class of cross-reality user interfaces that enable users to freely move along the reality-virtuality continuum during collaboration. To analyze and understand how such collaboration unfolds, we propose four analytical lenses derived from an exploratory study of transitional collaboration with 15 dyads. While solving a complex spatial optimization task, participants could freely switch between three contexts, each with different displays (desktop screens, tablet-based augmented reality, head-mounted virtual reality), input techniques (mouse, touch, handheld controllers), and visual representations (monoscopic and allocentric 2D/3D maps, stereoscopic egocentric views). Using the rich qualitative and quantitative data from our study, we evaluated participants' perceptions of transitional collaboration and identified commonalities and differences between dyads. We then derived four lenses including metrics and visualizations to analyze key aspects of transitional collaboration: (1) place and distance, (2) temporal patterns, (3) group use of contexts, (4) individual use of contexts.
Comparing Dwell time, Pursuits and Gaze Gestures for Gaze Interaction on Handheld Mobile Devices
Omar Namnakani (University of Glasgow, Glasgow), Yasmeen Abdrabou (University of the Bundeswehr Munich, University of Glasgow), Jonathan Grizou (University of Glasgow), Augusto Esteves (University of Lisbon), Mohamed Khamis (University of Glasgow)
Abstract | Tags: Full Paper | Links:
@inproceedings{Namnakani2023Gaze,
title = {Comparing Dwell time, Pursuits and Gaze Gestures for Gaze Interaction on Handheld Mobile Devices},
author = {Omar Namnakani (University of Glasgow, Glasgow), Yasmeen Abdrabou (University of the Bundeswehr Munich and University of Glasgow), Jonathan Grizou (University of Glasgow), Augusto Esteves (University of Lisbon), Mohamed Khamis (University of Glasgow)},
url = {https://www.unibw.de/usable-security-and-privacy-en, Website
},
doi = {10.1145/3544548.3580871},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Gaze is promising for hands-free interaction on mobile devices. However, it is not clear how gaze interaction methods compare to each other in mobile settings. This paper presents the first experiment in a mobile setting that compares three of the most commonly used gaze interaction methods: Dwell time, Pursuits, and Gaze gestures. In our study, 24 participants selected one of 2, 4, 9, 12 and 32 targets via gaze while sitting and while walking.
Results show that input using Pursuits is faster than Dwell time and Gaze gestures especially when there are many targets. Users prefer Pursuits when stationary, but prefer Dwell time when walking. While selection using Gaze gestures is more demanding and slower when there are many targets, it is suitable for contexts where accuracy is more important than speed. We conclude with guidelines for the design of gaze interaction on handheld mobile devices.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Gaze is promising for hands-free interaction on mobile devices. However, it is not clear how gaze interaction methods compare to each other in mobile settings. This paper presents the first experiment in a mobile setting that compares three of the most commonly used gaze interaction methods: Dwell time, Pursuits, and Gaze gestures. In our study, 24 participants selected one of 2, 4, 9, 12 and 32 targets via gaze while sitting and while walking.
Results show that input using Pursuits is faster than Dwell time and Gaze gestures especially when there are many targets. Users prefer Pursuits when stationary, but prefer Dwell time when walking. While selection using Gaze gestures is more demanding and slower when there are many targets, it is suitable for contexts where accuracy is more important than speed. We conclude with guidelines for the design of gaze interaction on handheld mobile devices.
Results show that input using Pursuits is faster than Dwell time and Gaze gestures especially when there are many targets. Users prefer Pursuits when stationary, but prefer Dwell time when walking. While selection using Gaze gestures is more demanding and slower when there are many targets, it is suitable for contexts where accuracy is more important than speed. We conclude with guidelines for the design of gaze interaction on handheld mobile devices.
CrowdSurfer: Seamlessly Integrating Crowd-Feedback Tasks into Everyday Internet Surfing
Saskia Haug (KIT, h-lab), Ivo Benke (KIT, h-lab), Daniel Fischer (KIT, h-lab), Alexander Maedche (KIT, h-lab)
Abstract | Tags: Full Paper | Links:
@inproceedings{Haug2023CrowdSurfer,
title = {CrowdSurfer: Seamlessly Integrating Crowd-Feedback Tasks into Everyday Internet Surfing},
author = {Saskia Haug (KIT, h-lab), Ivo Benke (KIT, h-lab), Daniel Fischer (KIT, h-lab), Alexander Maedche (KIT, h-lab)},
url = {https://h-lab.iism.kit.edu/, Website
https://twitter.com/h_lab_KIT, Twitter
https://youtu.be/CAAjFfK5UqA, Teaser Video},
doi = {10.1145/3579456},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Crowd feedback overcomes scalability issues of feedback collection on interactive website designs. However, collecting feedback on crowdsourcing platforms decouples the feedback provider from the context of use. This creates more effort for crowdworkers to immerse into such context in crowdsourcing tasks. In this paper, we present CrowdSurfer, a browser extension that seamlessly integrates design feedback collection in crowdworkers' everyday internet surfing. This enables the scalable collection of in situ feedback and, in parallel, allows crowdworkers to flexibly integrate their work into their daily activities. In a field study, we compare the CrowdSurfer against traditional feedback collection. Our qualitative and quantitative results reveal that, while in situ feedback with the CrowdSurfer is not necessarily better, crowdworkers appreciate the effortless, enjoyable, and innovative method to conduct feedback tasks. We contribute with our findings on in situ feedback collection and provide recommendations for the integration of crowdworking tasks in everyday internet surfing.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Crowd feedback overcomes scalability issues of feedback collection on interactive website designs. However, collecting feedback on crowdsourcing platforms decouples the feedback provider from the context of use. This creates more effort for crowdworkers to immerse into such context in crowdsourcing tasks. In this paper, we present CrowdSurfer, a browser extension that seamlessly integrates design feedback collection in crowdworkers' everyday internet surfing. This enables the scalable collection of in situ feedback and, in parallel, allows crowdworkers to flexibly integrate their work into their daily activities. In a field study, we compare the CrowdSurfer against traditional feedback collection. Our qualitative and quantitative results reveal that, while in situ feedback with the CrowdSurfer is not necessarily better, crowdworkers appreciate the effortless, enjoyable, and innovative method to conduct feedback tasks. We contribute with our findings on in situ feedback collection and provide recommendations for the integration of crowdworking tasks in everyday internet surfing.
Deep Learning Super-Resolution Network Facilitating Fiducial Tangibles on Capacitive Touchscreens
Marius Rusu (LMU Munich), Sven Mayer (LMU Munich)
Abstract | Tags: Full Paper | Links:
@inproceedings{Rusu2023Fiducial,
title = {Deep Learning Super-Resolution Network Facilitating Fiducial Tangibles on Capacitive Touchscreens},
author = {Marius Rusu (LMU Munich), Sven Mayer (LMU Munich)},
url = {https://www.medien.ifi.lmu.de/, Website
https://twitter.com/mimuc, twitter
},
doi = {10.1145/3544548.3580987},
year = {2023},
date = {2023-04-23},
urldate = {2023-04-23},
publisher = {ACM},
abstract = {Over the last years, we have seen many approaches using tangibles to address the limited expressiveness of touchscreens. Mainstream tangible detection uses fiducial markers embedded in the tangibles. However, the coarse sensor size of capacitive touchscreens makes tangibles bulky, limiting their usefulness. We propose a novel deep-learning super-resolution network to facilitate fiducial tangibles on capacitive touchscreens better. In detail, our network super-resolves the markers enabling off-the-shelf detection algorithms to track tangibles reliably. Our network generalizes to unseen marker sets, such as AprilTag, ArUco, and ARToolKit. Therefore, we are not limited to a fixed number of distinguishable objects and do not require data collection and network training for new fiducial markers. With extensive evaluation including real-world users and five showcases, we demonstrate the applicability of our open-source approach on commodity mobile devices and further highlight the potential of tangibles on capacitive touchscreens.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Over the last years, we have seen many approaches using tangibles to address the limited expressiveness of touchscreens. Mainstream tangible detection uses fiducial markers embedded in the tangibles. However, the coarse sensor size of capacitive touchscreens makes tangibles bulky, limiting their usefulness. We propose a novel deep-learning super-resolution network to facilitate fiducial tangibles on capacitive touchscreens better. In detail, our network super-resolves the markers enabling off-the-shelf detection algorithms to track tangibles reliably. Our network generalizes to unseen marker sets, such as AprilTag, ArUco, and ARToolKit. Therefore, we are not limited to a fixed number of distinguishable objects and do not require data collection and network training for new fiducial markers. With extensive evaluation including real-world users and five showcases, we demonstrate the applicability of our open-source approach on commodity mobile devices and further highlight the potential of tangibles on capacitive touchscreens.
Demonstrating Trusscillator: A System for Fabricating Human-Scale Human-Powered Oscillating Devices
Robert Kovacs (Hasso Plattner Institute, Potsdam, Germany), Lukas Rambold (Hasso Plattner Institute, Potsdam, Germany), Lukas Fritzsche (Hasso Plattner Institute, Potsdam, Germany), Dominik Meier (Hasso Plattner Institute, Potsdam, Germany), Jotaro Shigeyama (Hasso Plattner Institute, Potsdam, Germany), Shohei Katakura (Hasso Plattner Institute, Potsdam, Germany), Ran Zhang HCI (Hasso Plattner Institute, Potsdam, Germany), Patrick Baudisch (Hasso Plattner Institute, Potsdam, Germany
Abstract | Tags: Interactivity/Demonstration | Links:
@inproceedings{Kovacs2023Trusscillator,
title = {Demonstrating Trusscillator: A System for Fabricating Human-Scale Human-Powered Oscillating Devices},
author = {Robert Kovacs (Hasso Plattner Institute, Potsdam, Germany), Lukas Rambold (Hasso Plattner Institute, Potsdam, Germany), Lukas Fritzsche (Hasso Plattner Institute, Potsdam, Germany), Dominik Meier (Hasso Plattner Institute, Potsdam, Germany), Jotaro Shigeyama (Hasso Plattner Institute, Potsdam, Germany), Shohei Katakura (Hasso Plattner Institute, Potsdam, Germany), Ran Zhang HCI (Hasso Plattner Institute, Potsdam, Germany), Patrick Baudisch (Hasso Plattner Institute, Potsdam, Germany},
url = {https://hpi.de/baudisch/home.html, Website
https://www.youtube.com/@HassoPlattnerInstituteHCI, Youtube
https://www.youtube.com/watch?v=kyaL_wG0rJI, Teaser Video
https://www.youtube.com/watch?v=urW4iWfA-nQ&t=2s, Full Video},
doi = {10.1145/3472749.3474807},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Trusscillator is an end-to-end system that allows non-engineers to create human-scale human-powered devices that perform oscillatory movements, such as playground equipment, workout devices, and interactive kinetic installations. While recent research has been focusing on generating mechanisms that produce specific movement-path, without considering the required energy for the motion (kinematic approach), Trusscillator supports users in designing mechanisms that recycle energy in the system in the form of oscillating mechanisms (dynamic approach), specifically with the help of coil-springs. The presented system features a novel set of tools tailored for designing the dynamic experience of the motion. These tools allow designers to focus on user experience-specific aspects, such as motion range, tempo, and effort while abstracting away the underlying technicalities of eigenfrequencies, spring constants, and energy. Since the forces involved in the resulting devices can be high, Trusscillator helps users to fabricate from steel by picking out appropriate steal springs, generating part lists, and producing stencils and welding jigs that help weld with precision. To validate our system, we designed, built, and tested a series of unique playground equipment featuring 2-4 degrees of movement.},
keywords = {Interactivity/Demonstration},
pubstate = {published},
tppubtype = {inproceedings}
}
Trusscillator is an end-to-end system that allows non-engineers to create human-scale human-powered devices that perform oscillatory movements, such as playground equipment, workout devices, and interactive kinetic installations. While recent research has been focusing on generating mechanisms that produce specific movement-path, without considering the required energy for the motion (kinematic approach), Trusscillator supports users in designing mechanisms that recycle energy in the system in the form of oscillating mechanisms (dynamic approach), specifically with the help of coil-springs. The presented system features a novel set of tools tailored for designing the dynamic experience of the motion. These tools allow designers to focus on user experience-specific aspects, such as motion range, tempo, and effort while abstracting away the underlying technicalities of eigenfrequencies, spring constants, and energy. Since the forces involved in the resulting devices can be high, Trusscillator helps users to fabricate from steel by picking out appropriate steal springs, generating part lists, and producing stencils and welding jigs that help weld with precision. To validate our system, we designed, built, and tested a series of unique playground equipment featuring 2-4 degrees of movement.
Design and Fabrication of Body-Based Interfaces (Demo of Saarland HCI Lab)
Jürgen Steimle (Saarland University), Marie Muehlhaus (Saarland University), Madalina Nicolae (Saarland University), Aditya Nittala (Saarland University), Narges Pourjafarian (Saarland University), Adwait Sharma (Saarland University), Marc Teyssier (Saarland University), Marion Koelle (Saarland University), Bruno Fruchard (Saarland University), Paul Strohmeier (Saarland University)
Abstract | Tags: Interactivity/Demonstration | Links:
@inproceedings{Steimle2023Design,
title = {Design and Fabrication of Body-Based Interfaces (Demo of Saarland HCI Lab) },
author = {Jürgen Steimle (Saarland University), Marie Muehlhaus (Saarland University), Madalina Nicolae (Saarland University), Aditya Nittala (Saarland University), Narges Pourjafarian (Saarland University), Adwait Sharma (Saarland University), Marc Teyssier (Saarland University), Marion Koelle (Saarland University), Bruno Fruchard (Saarland University), Paul Strohmeier (Saarland University)},
url = {https://hci.cs.uni-saarland.de/, Website
https://twitter.com/HCI_Saarland, twitter},
doi = {10.1145/3544549.3583916},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {This Interactivity shows live demonstrations of our lab's most recent work on body-based interfaces. The soft, curved and deformable surface of the human body presents unique opportunities and challenges for interfaces. New form factors, materials and interaction techniques are required that move past the conventional rigid, planar and rectangular devices and the corresponding interaction styles. We highlight three themes of challenges for soft body-based interfaces: 1) How to design interfaces that are optimized for the body? We demonstrate how interactive computational design tools can help novices and experts to create better device designs. 2) Once they are designed, how to physically prototype and fabricate soft interfaces? We show accessible DIY fabrication methods for soft devices made of functional materials that make use of biomaterials. 3) How to leverage the richness of interacting on the body? We demonstrate on-body and off-body interactions that leverage the soft properties of the interface. },
keywords = {Interactivity/Demonstration},
pubstate = {published},
tppubtype = {inproceedings}
}
This Interactivity shows live demonstrations of our lab's most recent work on body-based interfaces. The soft, curved and deformable surface of the human body presents unique opportunities and challenges for interfaces. New form factors, materials and interaction techniques are required that move past the conventional rigid, planar and rectangular devices and the corresponding interaction styles. We highlight three themes of challenges for soft body-based interfaces: 1) How to design interfaces that are optimized for the body? We demonstrate how interactive computational design tools can help novices and experts to create better device designs. 2) Once they are designed, how to physically prototype and fabricate soft interfaces? We show accessible DIY fabrication methods for soft devices made of functional materials that make use of biomaterials. 3) How to leverage the richness of interacting on the body? We demonstrate on-body and off-body interactions that leverage the soft properties of the interface.
Designing for Uncontrollability: Drawing Inspiration from the Blessing Companion
Sara Wolf (Institute Human-Computer Media, Julius-Maximilians-Universität, Würzburg, Germany), Simon Luthe (Institute of Protestant Theology, Religious Education, Julius-Maximilians-Universität, Würzburg, Germany), Lennart Baumeister (Institute Human-Computer Media, Julius-Maximilians-Universität, Würzburg, Germany), Frauke Mörike (Department of Psychology, Ergonomics, Technische Universität Berlin, Germany), Vyjayanthi Janakiraman (Design department, York University, Toronto, Ontario, Canada), Jörn Hurtienne (Chair of Psychological Ergonomics, Julius-Maximilians-Universität Würzburg, Würzburg, Germany)
Abstract | Tags: Full Paper | Links:
@inproceedings{Wolf2023Uncontrollability,
title = {Designing for Uncontrollability: Drawing Inspiration from the Blessing Companion},
author = {Sara Wolf (Institute Human-Computer Media, Julius-Maximilians-Universität, Würzburg, Germany), Simon Luthe (Institute of Protestant Theology and Religious Education, Julius-Maximilians-Universität, Würzburg, Germany), Lennart Baumeister (Institute Human-Computer Media, Julius-Maximilians-Universität, Würzburg, Germany), Frauke Mörike (Department of Psychology and Ergonomics, Technische Universität Berlin, Germany), Vyjayanthi Janakiraman (Design department, York University, Toronto, Ontario, Canada), Jörn Hurtienne (Chair of Psychological Ergonomics, Julius-Maximilians-Universität Würzburg, Würzburg, Germany)},
url = {https://www.mcm.uni-wuerzburg.de/psyergo, Website
https://twitter.com/HCI_Saarland, twitter},
doi = {10.1145/3544548.3581421},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {This paper presents an inspirational concept for companion technology design, uncontrollability, and a corresponding artefact, the Blessing Companion. Both originated from a research through design project exploring companion technologies for blessing rituals. We established an exchange with Protestant theologians, explored believers' experiences of blessings, co-speculated on potential technologies, and refined the resulting ideas through ideation, prototyping, and testing. Inspired by believers' descriptions of blessing experiences as not plannable, predictable, controllable, or enforceable, we adopted the concept of uncontrollability, explored how it might be implemented in companion technologies, and designed the Blessing Companion. The Blessing Companion embodies uncontrollability through its ambiguous appearance and (partly) uncontrollable behaviour. It thus stands in contrast to the prevailing on-demand and user-driven interaction paradigms. We discuss how uncontrollability can be reflected in content, form, and interaction, highlight respective possibilities for companion technologies, and reflect on the Blessing Companion as an example of designing for religious rituals.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
This paper presents an inspirational concept for companion technology design, uncontrollability, and a corresponding artefact, the Blessing Companion. Both originated from a research through design project exploring companion technologies for blessing rituals. We established an exchange with Protestant theologians, explored believers' experiences of blessings, co-speculated on potential technologies, and refined the resulting ideas through ideation, prototyping, and testing. Inspired by believers' descriptions of blessing experiences as not plannable, predictable, controllable, or enforceable, we adopted the concept of uncontrollability, explored how it might be implemented in companion technologies, and designed the Blessing Companion. The Blessing Companion embodies uncontrollability through its ambiguous appearance and (partly) uncontrollable behaviour. It thus stands in contrast to the prevailing on-demand and user-driven interaction paradigms. We discuss how uncontrollability can be reflected in content, form, and interaction, highlight respective possibilities for companion technologies, and reflect on the Blessing Companion as an example of designing for religious rituals.
Don't Panic! - Influence of Virtual Stressor Representations from the ICU Context on Perceived Stress Levels
Sebastian Weiß (OFFIS), Wilko Heuten (OFFIS)
Abstract | Tags: Full Paper | Links:
@inproceedings{Weiss2023Panic,
title = {Don't Panic! - Influence of Virtual Stressor Representations from the ICU Context on Perceived Stress Levels},
author = {Sebastian Weiß (OFFIS), Wilko Heuten (OFFIS)},
url = {https://youtu.be/MD7G1ibTHmc, Teaser Video},
doi = {10.1145/3544548.3581189},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Intensive care nurses are prone to suffering from chronic stress due to constant exposure to two main profession-related stressors: interruption and time pressure. These stressors have detrimental effects on the well-being of the nursing staff and, by proxy, the patients. To alleviate stress, increase safety, and support the training of stressful scenarios, we investigate the impact these stressors have on subjective and objective stress levels in a virtual environment. We designed an intensive care unit in which participants (n=26, 18 healthcare professionals) perform common tasks, e.g. refilling an infusion pump, whilst being exposed to interruptions and time pressure. Results from our between-subjects study provide data indicating stress increase in both stressor conditions, suggesting that artificially evoking work-related stressors for stress inoculation training (SIT) is a possible extension to simulation training during nursing education. This knowledge is helpful for designing training scenarios of safety critical situations early in the professional apprenticeship.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Intensive care nurses are prone to suffering from chronic stress due to constant exposure to two main profession-related stressors: interruption and time pressure. These stressors have detrimental effects on the well-being of the nursing staff and, by proxy, the patients. To alleviate stress, increase safety, and support the training of stressful scenarios, we investigate the impact these stressors have on subjective and objective stress levels in a virtual environment. We designed an intensive care unit in which participants (n=26, 18 healthcare professionals) perform common tasks, e.g. refilling an infusion pump, whilst being exposed to interruptions and time pressure. Results from our between-subjects study provide data indicating stress increase in both stressor conditions, suggesting that artificially evoking work-related stressors for stress inoculation training (SIT) is a possible extension to simulation training during nursing education. This knowledge is helpful for designing training scenarios of safety critical situations early in the professional apprenticeship.
Dying, Death and the Afterlife in Human-Computer Interaction. A Scoping Review
Ruben Albers (University of Siegen), Shadan Sadeghian (University of Siegen), Matthias Laschke (University of Siegen), Marc Hassenzahl (University of Siegen)
Abstract | Tags: Full Paper | Links:
@inproceedings{Albers2023Dying,
title = {Dying, Death and the Afterlife in Human-Computer Interaction. A Scoping Review},
author = {Ruben Albers (University of Siegen), Shadan Sadeghian (University of Siegen), Matthias Laschke (University of Siegen), Marc Hassenzahl (University of Siegen) },
url = {http://www.experienceandinteraction.com, Website
},
doi = {10.1145/3544548.3581199 },
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Dying is a universal experience that entails uncertainty, loss, and termination. Often, people face death unprepared and miss out on opportunities to shape their fnal stage of life as well as their afterlife. To better understand how thanato-technology can support the dying and the bereaved, we performed a scoping review on the current state-of-art in Human Computer Interaction. Following the PRISMA-ScR procedure, we gathered and analyzed 107 relevant papers. We categorized theoretical and conceptual contributions into three overarching themes: digital remains, remembrance, and coping. We further highlight 18 practices, such as curation, honor-ing and letting go. We show that technology can help to capture the identity of the deceased, to validate the life lived, and to come to terms with death. However, available approaches focus more on the bereaved than on the dying. In addition, potentially impor-tant aspects of dying (e.g., balancing involvement and autonomy, spiritual meaning-making) remain largely unexplored.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Dying is a universal experience that entails uncertainty, loss, and termination. Often, people face death unprepared and miss out on opportunities to shape their fnal stage of life as well as their afterlife. To better understand how thanato-technology can support the dying and the bereaved, we performed a scoping review on the current state-of-art in Human Computer Interaction. Following the PRISMA-ScR procedure, we gathered and analyzed 107 relevant papers. We categorized theoretical and conceptual contributions into three overarching themes: digital remains, remembrance, and coping. We further highlight 18 practices, such as curation, honor-ing and letting go. We show that technology can help to capture the identity of the deceased, to validate the life lived, and to come to terms with death. However, available approaches focus more on the bereaved than on the dying. In addition, potentially impor-tant aspects of dying (e.g., balancing involvement and autonomy, spiritual meaning-making) remain largely unexplored.
Empathic Accuracy and Mental Effort during Remote Assessments of Emotions
Stephan Huber (Julius-Maximilians-Universität Würzburg, Chair for Psychological Ergonomics, Würzburg), Natalie Rathß (Julius-Maximilians-Universität Würzburg, Chair for Psychological Ergonomics, Würzburg)
Abstract | Tags: Full Paper | Links:
@inproceedings{Huber2023Empathic,
title = {Empathic Accuracy and Mental Effort during Remote Assessments of Emotions},
author = {Stephan Huber (Julius-Maximilians-Universität Würzburg, Chair for Psychological Ergonomics, Würzburg), Natalie Rathß (Julius-Maximilians-Universität Würzburg, Chair for Psychological Ergonomics, Würzburg)},
url = {https://www.mcm.uni-wuerzburg.de/psyergo/startseite/, Website},
doi = {10.1145/3544548.3580824},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Observing users in remote settings is unfavorable because it adds filters altering the information that underlie judgement. Still, the COVID pandemic led to an unprecedented popularity of remote user experience tests. In this work, we revisited the question, which information is most important for evaluators to assess users’ emotions successfully and efficiently. In an online study, we asked N=55 participants to assess users’ emotions from short videos of 30 interaction situations. As independent variable, we manipulated the combination of the information channels video of users, video of the interactive technology, and audio within subjects. Our findings indicate that empathic accuracy is highest and mental effort is lowest when all stimuli are present. Surprisingly, empathic accuracy was lowest and mental effort highest, when only video of users was available. We discuss these findings in the light of emotion literature focusing on persons’ facial expressions and derive practical implications for remote observations.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Observing users in remote settings is unfavorable because it adds filters altering the information that underlie judgement. Still, the COVID pandemic led to an unprecedented popularity of remote user experience tests. In this work, we revisited the question, which information is most important for evaluators to assess users’ emotions successfully and efficiently. In an online study, we asked N=55 participants to assess users’ emotions from short videos of 30 interaction situations. As independent variable, we manipulated the combination of the information channels video of users, video of the interactive technology, and audio within subjects. Our findings indicate that empathic accuracy is highest and mental effort is lowest when all stimuli are present. Surprisingly, empathic accuracy was lowest and mental effort highest, when only video of users was available. We discuss these findings in the light of emotion literature focusing on persons’ facial expressions and derive practical implications for remote observations.
Exploring Gesture and Gaze Proxies to Communicate Instructor's Nonverbal Cues in Lecture Videos
Tobias Wagner (Institute of Media Informatics, Ulm University), Teresa Hirzle (Department of Computer Science, University of Copenhagen), Anke Huckauf (Institute of Psychology, Education, Ulm University), Enrico Rukzio (Institute of Media Informatics, Ulm University)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Wagner2023Proxies,
title = {Exploring Gesture and Gaze Proxies to Communicate Instructor's Nonverbal Cues in Lecture Videos},
author = {Tobias Wagner (Institute of Media Informatics, Ulm University), Teresa Hirzle (Department of Computer Science, University of Copenhagen), Anke Huckauf (Institute of Psychology and Education, Ulm University), Enrico Rukzio (Institute of Media Informatics, Ulm University)},
url = {https://wgnrto.github.io/, Website
https://twitter.com/wgnrto, twitter},
doi = {10.1145/3544549.3585842},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Teaching via lecture video has become the defacto standard for remote education, but videos make it difficult to interpret instructors' nonverbal referencing to the content. This is problematic, as nonverbal cues are essential for students to follow and understand a lecture. As remedy, we explored different proxies representing instructors' pointing gestures and gaze to provide students a point of reference in a lecture video: no proxy, gesture proxy, gaze proxy, alternating proxy, and concurrent proxies. In an online study with 100 students, we evaluated the proxies' effects on mental effort, cognitive load, learning performance, and user experience. Our results show that the proxies had no significant effect on learning-directed aspects and that the gesture and alternating proxy achieved the highest pragmatic quality. Furthermore, we found that alternating between proxies is a promising approach providing students with information about instructors' pointing and gaze position in a lecture video.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Teaching via lecture video has become the defacto standard for remote education, but videos make it difficult to interpret instructors' nonverbal referencing to the content. This is problematic, as nonverbal cues are essential for students to follow and understand a lecture. As remedy, we explored different proxies representing instructors' pointing gestures and gaze to provide students a point of reference in a lecture video: no proxy, gesture proxy, gaze proxy, alternating proxy, and concurrent proxies. In an online study with 100 students, we evaluated the proxies' effects on mental effort, cognitive load, learning performance, and user experience. Our results show that the proxies had no significant effect on learning-directed aspects and that the gesture and alternating proxy achieved the highest pragmatic quality. Furthermore, we found that alternating between proxies is a promising approach providing students with information about instructors' pointing and gaze position in a lecture video.
Exploring Mixed Reality in General Aviation to Support Pilot Workload
Christopher Katins (HU Berlin), Sebastian S. Feger (LMU Munich), Thomas Kosch (HU Berlin)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Katins2023Pilot,
title = {Exploring Mixed Reality in General Aviation to Support Pilot Workload},
author = {Christopher Katins (HU Berlin), Sebastian S. Feger (LMU Munich), Thomas Kosch (HU Berlin)},
url = {cognisens.group, Website},
doi = {10.1145/3544549.3585742},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Pilots in non-commercial aviation have minimal access to digital support tools. Equipping aircraft with modern technologies introduces high costs and is labor intensive. Hence, wearable or mobile support, such as common 2D maps displayed on standard tablets, are often the only digital information source supporting pilot workload. Yet, they fail to adequately capture the 3D airspace and its surroundings, challenging the pilot's workload in return. In this work, we explore how mixed reality can support pilots by projecting supportive elements into their fields of view. Considering the design of a preliminary mixed reality prototype, we conducted a user study with twelve pilots in a full-sized flight simulator. Our quantitative measures show that the perceived pilot workload when handling surrounding aircraft reduced while improving the overall landing routine efficiency at the same time. This work shows the utility of mixed reality technologies while simultaneously emphasizing future research directions in general aviation.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Pilots in non-commercial aviation have minimal access to digital support tools. Equipping aircraft with modern technologies introduces high costs and is labor intensive. Hence, wearable or mobile support, such as common 2D maps displayed on standard tablets, are often the only digital information source supporting pilot workload. Yet, they fail to adequately capture the 3D airspace and its surroundings, challenging the pilot's workload in return. In this work, we explore how mixed reality can support pilots by projecting supportive elements into their fields of view. Considering the design of a preliminary mixed reality prototype, we conducted a user study with twelve pilots in a full-sized flight simulator. Our quantitative measures show that the perceived pilot workload when handling surrounding aircraft reduced while improving the overall landing routine efficiency at the same time. This work shows the utility of mixed reality technologies while simultaneously emphasizing future research directions in general aviation.
Exploring Physiological Correlates of Visual Complexity Adaptation: Insights from EDA, ECG, and EEG Data for Adaptation Evaluation in VR Adaptive Systems
Francesco Chiossi (LMU Munich), Changkun Ou (LMU Munich), Sven Mayer (LMU Munich)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Chiossi2023Physiological,
title = {Exploring Physiological Correlates of Visual Complexity Adaptation: Insights from EDA, ECG, and EEG Data for Adaptation Evaluation in VR Adaptive Systems},
author = {Francesco Chiossi (LMU Munich), Changkun Ou (LMU Munich), Sven Mayer (LMU Munich)},
url = {https://www.um.informatik.uni-muenchen.de/index.html, Website
https://twitter.com/mimuc, twitter},
doi = {10.1145/3544549.3585624},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Physiologically-adaptive Virtual Reality can drive interactions and adjust virtual content to better fit users' needs and support specific goals. However, the complexity of psychophysiological inference hinders efficient adaptation as the relationship between cognitive and physiological features rarely show one-to-one correspondence. Therefore, it is necessary to employ multimodal approaches to evaluate the effect of adaptations. In this work, we analyzed a multimodal dataset (EEG, ECG, and EDA) acquired during interaction with a VR-adaptive system that employed EDA as input for adaptation of secondary task difficulty. We evaluated the effect of dynamic adjustments on different physiological features and their correlation. Our results show that when the adaptive system increased the secondary task difficulty, theta, beta, and phasic EDA features increased. Moreover, we found a high correlation between theta, alpha, and beta oscillations during difficulty adjustments. Our results show how specific EEG and EDA features can be employed for evaluating VR adaptive systems.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Physiologically-adaptive Virtual Reality can drive interactions and adjust virtual content to better fit users' needs and support specific goals. However, the complexity of psychophysiological inference hinders efficient adaptation as the relationship between cognitive and physiological features rarely show one-to-one correspondence. Therefore, it is necessary to employ multimodal approaches to evaluate the effect of adaptations. In this work, we analyzed a multimodal dataset (EEG, ECG, and EDA) acquired during interaction with a VR-adaptive system that employed EDA as input for adaptation of secondary task difficulty. We evaluated the effect of dynamic adjustments on different physiological features and their correlation. Our results show that when the adaptive system increased the secondary task difficulty, theta, beta, and phasic EDA features increased. Moreover, we found a high correlation between theta, alpha, and beta oscillations during difficulty adjustments. Our results show how specific EEG and EDA features can be employed for evaluating VR adaptive systems.
Exploring Pseudo-Stiffness to Enrich the Haptic Experience in Virtual Reality
Yannick Weiss (LMU Munich), Steeven Villa (LMU Munich), Albrecht Schmidt (LMU Munich), Sven Mayer (LMU Munich), Florian Müller (LMU Munich)
Abstract | Tags: Full Paper | Links:
@inproceedings{Weiss2023Siffness,
title = {Exploring Pseudo-Stiffness to Enrich the Haptic Experience in Virtual Reality},
author = {Yannick Weiss (LMU Munich), Steeven Villa (LMU Munich), Albrecht Schmidt (LMU Munich), Sven Mayer (LMU Munich), Florian Müller (LMU Munich)},
url = {https://www.hcilab.org/, Website
https://www.youtube.com/@hcummunich6808, Youtube},
doi = {10.1145/3544548.3581223},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Providing users with a haptic sensation of the hardness and softness of objects in virtual reality is an open challenge. While physical props and haptic devices help, their haptic properties do not allow for dynamic adjustments. To overcome this limitation, we present a novel technique for changing the perceived stiffness of objects based on a visuo-haptic illusion. We achieved this by manipulating the hands' Control-to-Display (C/D) ratio in virtual reality while pressing down on an object with fixed stiffness. In the first study (N=12), we determine the detection thresholds of the illusion. Our results show that we can exploit a C/D ratio from 0.7 to 3.5 without user detection. In the second study (N=12), we analyze the illusion's impact on the perceived stiffness. Our results show that participants perceive the objects to be up to 28.1% softer and 8.9% stiffer, allowing for various haptic applications in virtual reality.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Providing users with a haptic sensation of the hardness and softness of objects in virtual reality is an open challenge. While physical props and haptic devices help, their haptic properties do not allow for dynamic adjustments. To overcome this limitation, we present a novel technique for changing the perceived stiffness of objects based on a visuo-haptic illusion. We achieved this by manipulating the hands' Control-to-Display (C/D) ratio in virtual reality while pressing down on an object with fixed stiffness. In the first study (N=12), we determine the detection thresholds of the illusion. Our results show that we can exploit a C/D ratio from 0.7 to 3.5 without user detection. In the second study (N=12), we analyze the illusion's impact on the perceived stiffness. Our results show that participants perceive the objects to be up to 28.1% softer and 8.9% stiffer, allowing for various haptic applications in virtual reality.
Exploring the Perception of Pain in Virtual Reality using Perceptual Manipulations
Gaëlle Clavelin (Telecom Paris, IP Paris), Mickael Bouhier (Telecom Paris, IP Paris), Wen-Jie Tseng (Telecom Paris, IP Paris), Jan Gugenheimer (TU Darmstadt)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Clavelin2023Pain,
title = {Exploring the Perception of Pain in Virtual Reality using Perceptual Manipulations},
author = {Gaëlle Clavelin (Telecom Paris, IP Paris), Mickael Bouhier (Telecom Paris, IP Paris), Wen-Jie Tseng (Telecom Paris, IP Paris), Jan Gugenheimer (TU Darmstadt)},
doi = {10.1145/3544549.3585674},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Perceptual manipulations (PMs) in Virtual Reality (VR) can steer users’ actions (e.g., redirection techniques) and amplify haptic perceptions (e.g., weight). However, their ability to amplify or induce negative perceptions such as physical pain is not well understood. In this work, we explore if PMs can be leveraged to induce the perception of pain, without modifying the physical stimulus. We implemented a VR experience combined with a haptic prototype, simulating the dislocation of a finger. A user study (n=18) compared three conditions (visual-only, haptic-only and combined) on the perception of physical pain and physical discomfort. We observed that using PMs with a haptic device resulted in a significantly higher perception of physical discomfort and an increase in the perception of pain compared to the unmodified sensation (haptic-only). Finally, we discuss how perception of pain can be leveraged in future VR applications and reflect on ethical concerns.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Perceptual manipulations (PMs) in Virtual Reality (VR) can steer users’ actions (e.g., redirection techniques) and amplify haptic perceptions (e.g., weight). However, their ability to amplify or induce negative perceptions such as physical pain is not well understood. In this work, we explore if PMs can be leveraged to induce the perception of pain, without modifying the physical stimulus. We implemented a VR experience combined with a haptic prototype, simulating the dislocation of a finger. A user study (n=18) compared three conditions (visual-only, haptic-only and combined) on the perception of physical pain and physical discomfort. We observed that using PMs with a haptic device resulted in a significantly higher perception of physical discomfort and an increase in the perception of pain compared to the unmodified sensation (haptic-only). Finally, we discuss how perception of pain can be leveraged in future VR applications and reflect on ethical concerns.
Exploring the Use of Electromagnets to Influence Key Targeting on Physical Keyboards
Lukas Mecke (University of the Bundeswehr Munich, LMU Munich), Ismael Prieto Romero (University of the Bundeswehr Munich), Sarah Delgado Rodriguez (University of the Bundeswehr Munich), Florian Alt (University of the Bundeswehr Munich)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Mecke2023Electromagnets,
title = {Exploring the Use of Electromagnets to Influence Key Targeting on Physical Keyboards},
author = {Lukas Mecke (University of the Bundeswehr Munich, LMU Munich), Ismael Prieto Romero (University of the Bundeswehr Munich), Sarah Delgado Rodriguez (University of the Bundeswehr Munich), Florian Alt (University of the Bundeswehr Munich)},
url = {https://www.unibw.de/usable-security-and-privacy, Website},
doi = {10.1145/3544549.3585703},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {In this work we explore the use of force induced through electromagnets to influence finger movement while using a keyboard. To achieve this we generate a magnetic field below a keyboard and place a permanent magnet on the user's finger as a minimally invasive approach to dynamically induce variable force. Contrary to other approaches our setup can thus generate forces even at a distance from the keyboard.
We explore this concept by building a prototype and analysing different configurations of electromagnets (i.e., attraction and repulsion) and placements of a permanent magnet on the user's fingers in a preliminary study (N=4). Our force measurements show that we can induce 3.56 N at a distance of 10 mm. Placing the magnet on the index finger allowed for influencing key press times and was perceived comfortable. Finally we discuss implications and potential application areas like mid-air feedback and guidance.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
In this work we explore the use of force induced through electromagnets to influence finger movement while using a keyboard. To achieve this we generate a magnetic field below a keyboard and place a permanent magnet on the user's finger as a minimally invasive approach to dynamically induce variable force. Contrary to other approaches our setup can thus generate forces even at a distance from the keyboard.
We explore this concept by building a prototype and analysing different configurations of electromagnets (i.e., attraction and repulsion) and placements of a permanent magnet on the user's fingers in a preliminary study (N=4). Our force measurements show that we can induce 3.56 N at a distance of 10 mm. Placing the magnet on the index finger allowed for influencing key press times and was perceived comfortable. Finally we discuss implications and potential application areas like mid-air feedback and guidance.
We explore this concept by building a prototype and analysing different configurations of electromagnets (i.e., attraction and repulsion) and placements of a permanent magnet on the user's fingers in a preliminary study (N=4). Our force measurements show that we can induce 3.56 N at a distance of 10 mm. Placing the magnet on the index finger allowed for influencing key press times and was perceived comfortable. Finally we discuss implications and potential application areas like mid-air feedback and guidance.
FingerMapper: Mapping Finger Motions onto Virtual Arms to Enable Safe Virtual Reality Interaction in Confined Spaces
Wen-Jie Tseng (Telecom Paris, IP Paris, TU Darmstadt), Samuel Huron (Telecom Paris, IP Paris), Eric Lecolinet (Telecom Paris, IP Paris), Jan Gugenheimer (Telecom Paris, IP Paris, TU Darmstadt)
Abstract | Tags: Full Paper | Links:
@inproceedings{Tseng2023Finger,
title = {FingerMapper: Mapping Finger Motions onto Virtual Arms to Enable Safe Virtual Reality Interaction in Confined Spaces},
author = {Wen-Jie Tseng (Telecom Paris, IP Paris, TU Darmstadt), Samuel Huron (Telecom Paris, IP Paris), Eric Lecolinet (Telecom Paris, IP Paris), Jan Gugenheimer (Telecom Paris, IP Paris, TU Darmstadt)},
url = {https://youtu.be/KomrhEYGBDw, Teaser Video
https://youtu.be/7Kfq7Ej1krw, Full Video},
doi = {10.1145/3544548.3580736},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Whole-body movements enhance the presence and enjoyment of Virtual Reality (VR) experiences. However, using large gestures is often uncomfortable and impossible in confined spaces (e.g., public transport). We introduce FingerMapper, mapping small-scale finger motions onto virtual arms and hands to enable whole-body virtual movements in VR. In a first target selection study (n=13) comparing FingerMapper to hand tracking and ray-casting, we found that FingerMapper can significantly reduce physical motions and fatigue while having a similar degree of precision. In a consecutive study (n=13), we compared FingerMapper to hand tracking inside a confined space (the front passenger seat of a car). The results showed participants had significantly higher perceived safety and fewer collisions with FingerMapper while preserving a similar degree of presence and enjoyment as hand tracking. Finally, we present three example applications demonstrating how FingerMapper could be applied for locomotion and interaction for VR in confined spaces.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Whole-body movements enhance the presence and enjoyment of Virtual Reality (VR) experiences. However, using large gestures is often uncomfortable and impossible in confined spaces (e.g., public transport). We introduce FingerMapper, mapping small-scale finger motions onto virtual arms and hands to enable whole-body virtual movements in VR. In a first target selection study (n=13) comparing FingerMapper to hand tracking and ray-casting, we found that FingerMapper can significantly reduce physical motions and fatigue while having a similar degree of precision. In a consecutive study (n=13), we compared FingerMapper to hand tracking inside a confined space (the front passenger seat of a car). The results showed participants had significantly higher perceived safety and fewer collisions with FingerMapper while preserving a similar degree of presence and enjoyment as hand tracking. Finally, we present three example applications demonstrating how FingerMapper could be applied for locomotion and interaction for VR in confined spaces.
Flowboard: How Seamless, Live, Flow-Based Programming Impacts Learning to Code for Embedded Electronics
Anke Brocker (RWTH Aachen University), René Schäfer (RWTH Aachen University), Christian Remy (Lancaster University), Simon Voelker (RWTH Aachen University), Jan Borchers (RWTH Aachen University)
Abstract | Tags: Journal | Links:
@article{Brocker2023Flowboard,
title = {Flowboard: How Seamless, Live, Flow-Based Programming Impacts Learning to Code for Embedded Electronics},
author = {Anke Brocker (RWTH Aachen University), René Schäfer (RWTH Aachen University), Christian Remy (Lancaster University), Simon Voelker (RWTH Aachen University), Jan Borchers (RWTH Aachen University)
},
url = {https://hci.rwth-aachen.de, Website
https://youtu.be/9AoHFA58khY, Full Video},
doi = {10.1145/3533015},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Toolkits like the Arduino system have brought embedded programming to STEM education. However, learning embedded programming is still hard, requiring an understanding of coding, electronics, and how both sides interact. To investigate the opportunities of using a different programming paradigm than the imperative approach to learning embedded coding, we developed Flowboard.
Students code in a visual iPad editor using flow-based programming, which is conceptually closer to circuit diagrams than imperative code. Two breadboards with I/O pins mirrored on the iPad connect electronics and program graph more seamlessly than existing IDEs. Program changes take effect immediately. This liveness reflects circuit behavior better than edit-compile-run loops. A first study confirmed that students can solve basic embedded programming tasks with Flowboard while highlighting important differences to a typical imperative IDE, Ardublock. A second, in-depth study provided qualitative insights into Flowboard's impact on students' conceptual models of electronics and embedded programming and exploring those.},
keywords = {Journal},
pubstate = {published},
tppubtype = {article}
}
Toolkits like the Arduino system have brought embedded programming to STEM education. However, learning embedded programming is still hard, requiring an understanding of coding, electronics, and how both sides interact. To investigate the opportunities of using a different programming paradigm than the imperative approach to learning embedded coding, we developed Flowboard.
Students code in a visual iPad editor using flow-based programming, which is conceptually closer to circuit diagrams than imperative code. Two breadboards with I/O pins mirrored on the iPad connect electronics and program graph more seamlessly than existing IDEs. Program changes take effect immediately. This liveness reflects circuit behavior better than edit-compile-run loops. A first study confirmed that students can solve basic embedded programming tasks with Flowboard while highlighting important differences to a typical imperative IDE, Ardublock. A second, in-depth study provided qualitative insights into Flowboard's impact on students' conceptual models of electronics and embedded programming and exploring those.
Students code in a visual iPad editor using flow-based programming, which is conceptually closer to circuit diagrams than imperative code. Two breadboards with I/O pins mirrored on the iPad connect electronics and program graph more seamlessly than existing IDEs. Program changes take effect immediately. This liveness reflects circuit behavior better than edit-compile-run loops. A first study confirmed that students can solve basic embedded programming tasks with Flowboard while highlighting important differences to a typical imperative IDE, Ardublock. A second, in-depth study provided qualitative insights into Flowboard's impact on students' conceptual models of electronics and embedded programming and exploring those.
Going, Going, Gone: Exploring Intention Communication for Multi-User Locomotion in Virtual Reality
Julian Rasch (LMU Munich), Vladislav Dmitrievic Rusakov (LMU Munich), Martin Schmitz (Saarland University, Saarland Informatics Campus), Florian Müller (LMU Munich)
Abstract | Tags: Full Paper | Links:
@inproceedings{Rasch2023Going,
title = {Going, Going, Gone: Exploring Intention Communication for Multi-User Locomotion in Virtual Reality},
author = {Julian Rasch (LMU Munich), Vladislav Dmitrievic Rusakov (LMU Munich), Martin Schmitz (Saarland University, Saarland Informatics Campus), Florian Müller (LMU Munich)},
url = {https://julian-rasch.com, Website
https://www.linkedin.com/in/julian-rasch, LinkedIn
},
doi = {10.1145/3544548.3581259},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Exploring virtual worlds together with others adds a social component to the Virtual Reality (VR) experience that increases connectedness. In the physical world, joint locomotion comes naturally through implicit intention communication and subsequent adjustments of the movement patterns. In VR, however, discrete locomotion techniques such as point&teleport come without prior intention communication, hampering the collective experience. Related work proposes fixed groups, with a single person controlling the group movement, resulting in the loss of individual movement capabilities. To close the gap and mediate between these two extremes, we introduce three intention communication methods and explore them with two baseline methods. We contribute the results of a controlled experiment (n=20) investigating these methods from the perspective of a leader and a follower in a dyadic locomotion task. Our results suggest shared visualizations support the understanding of movement intentions, increasing the group feeling while maintaining individual freedom of movement.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Exploring virtual worlds together with others adds a social component to the Virtual Reality (VR) experience that increases connectedness. In the physical world, joint locomotion comes naturally through implicit intention communication and subsequent adjustments of the movement patterns. In VR, however, discrete locomotion techniques such as point&teleport come without prior intention communication, hampering the collective experience. Related work proposes fixed groups, with a single person controlling the group movement, resulting in the loss of individual movement capabilities. To close the gap and mediate between these two extremes, we introduce three intention communication methods and explore them with two baseline methods. We contribute the results of a controlled experiment (n=20) investigating these methods from the perspective of a leader and a follower in a dyadic locomotion task. Our results suggest shared visualizations support the understanding of movement intentions, increasing the group feeling while maintaining individual freedom of movement.
Handheld Tools Unleashed: Mixed-Initiative Physical Sketching with a Robotic Printer
Narjes Pourjafarian (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany), Fjolla Mjaku (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany), Marion Koelle (OFFIS - Institute for Information Technology, Oldenburg, Germany), Martin Schmitz (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany), Jan Borchers (RWTH Aachen University, Aachen, Germany), Jürgen Steimle (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany)
Abstract | Tags: Full Paper | Links:
@inproceedings{Pourjafarian2023Handheld,
title = {Handheld Tools Unleashed: Mixed-Initiative Physical Sketching with a Robotic Printer},
author = {Narjes Pourjafarian (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany), Fjolla Mjaku (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany), Marion Koelle (OFFIS - Institute for Information Technology, Oldenburg, Germany), Martin Schmitz (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany), Jan Borchers (RWTH Aachen University, Aachen, Germany), Jürgen Steimle (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany)},
url = {https://hci.cs.uni-saarland.de/, Website
https://twitter.com/HCI_Saarland, twitter
https://youtu.be/yXAbLO7GjNg, Teaser Video
https://youtu.be/ztbTZ1SHxhc, Full Video},
doi = {10.1145/3544548.3580691},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Personal fabrication has mostly focused on handheld tools as embodied extensions of the user, and machines like laser cutters and 3D printers automating parts of the process without intervention. Although interactive digital fabrication has been explored as a middle ground, existing systems have a fixed allocation of user intervention vs. machine autonomy, limiting flexibility, creativity, and improvisation. We explore a new class of devices that combine the desirable properties of a handheld tool and an autonomous fabrication robot, offering a continuum from manual and assisted to autonomous fabrication, with seamless mode transitions. We exemplify the concept of mixed-initiative physical sketching with a working robotic printer that can be handheld for free-hand sketching, can provide interactive assistance during sketching, or move about for computer-generated sketches. We present interaction techniques to seamlessly transition between modes, and sketching techniques benefitting from these transitions to, e.g., extend (upscale, repeat) or revisit (refine, color) sketches. Our evaluation with seven sketchers illustrates that RoboSketch successfully leverages each mode's strengths, and that mixed-initiative physical sketching makes computer-supported sketching more flexible.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Personal fabrication has mostly focused on handheld tools as embodied extensions of the user, and machines like laser cutters and 3D printers automating parts of the process without intervention. Although interactive digital fabrication has been explored as a middle ground, existing systems have a fixed allocation of user intervention vs. machine autonomy, limiting flexibility, creativity, and improvisation. We explore a new class of devices that combine the desirable properties of a handheld tool and an autonomous fabrication robot, offering a continuum from manual and assisted to autonomous fabrication, with seamless mode transitions. We exemplify the concept of mixed-initiative physical sketching with a working robotic printer that can be handheld for free-hand sketching, can provide interactive assistance during sketching, or move about for computer-generated sketches. We present interaction techniques to seamlessly transition between modes, and sketching techniques benefitting from these transitions to, e.g., extend (upscale, repeat) or revisit (refine, color) sketches. Our evaluation with seven sketchers illustrates that RoboSketch successfully leverages each mode's strengths, and that mixed-initiative physical sketching makes computer-supported sketching more flexible.
HaptiX: Vibrotactile Haptic Feedback for Communication of 3D Directional Cues
Max Pascher (Westphalian University of Applied Sciences & University of Duisburg-Essen), Til Franzen(Westphalian University of Applied Sciences), Kirill Kronhardt (Westphalian University of Applied Sciences), Uwe Gruenefeld (University of Duisburg-Essen), Stefan Schneegass (University of Duisburg-Essen), Jens Gerken (Westphalian University of Applied Sciences)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Pascher2023HaptiX,
title = {HaptiX: Vibrotactile Haptic Feedback for Communication of 3D Directional Cues},
author = {Max Pascher (Westphalian University of Applied Sciences & University of Duisburg-Essen), Til Franzen(Westphalian University of Applied Sciences), Kirill Kronhardt (Westphalian University of Applied Sciences), Uwe Gruenefeld (University of Duisburg-Essen), Stefan Schneegass (University of Duisburg-Essen), Jens Gerken (Westphalian University of Applied Sciences)},
url = {https://hci.w-hs.de/, Website Westphalian University of Applied Sciences
https://www.hci.wiwi.uni-due.de, Website University of Duisburg-Essen},
doi = {10.1145/3544549.3585601},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {In Human-Computer-Interaction, vibrotactile haptic feedback offers the advantage of being independent of the visual perception of the environment. For example, the user's field of view is not obscured by user interface elements, and the visual sense is not unnecessarily strained. This is especially advantageous when the visual channel is already busy or the visual sense is limited. We developed three design variants based on different vibrotactile illusions to communicate 3D directional cues. In particular, we explored two variants based on the vibrotactile illusion of the cutaneous rabbit and one based on apparent vibrotactile motion. To communicate gradient information, we combined these with pulse-based and intensity-based mapping. A subsequent study showed that the pulse-based variants based on the vibrotactile illusion of the cutaneous rabbit are suitable for communicating both directional and gradient characteristics. The results further show that a representation of 3D directions via vibrations can be effective and satisfactory.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
In Human-Computer-Interaction, vibrotactile haptic feedback offers the advantage of being independent of the visual perception of the environment. For example, the user's field of view is not obscured by user interface elements, and the visual sense is not unnecessarily strained. This is especially advantageous when the visual channel is already busy or the visual sense is limited. We developed three design variants based on different vibrotactile illusions to communicate 3D directional cues. In particular, we explored two variants based on the vibrotactile illusion of the cutaneous rabbit and one based on apparent vibrotactile motion. To communicate gradient information, we combined these with pulse-based and intensity-based mapping. A subsequent study showed that the pulse-based variants based on the vibrotactile illusion of the cutaneous rabbit are suitable for communicating both directional and gradient characteristics. The results further show that a representation of 3D directions via vibrations can be effective and satisfactory.
Hexad-12: Developing and Validating a Short Version of the Gamification User Types Hexad Scale
Jeanine Krath (University of Koblenz-Landau, Koblenz, Germany), Maximilian Altmeyer (German Research Center for Artificial Intelligence (DFKI), Saarland Informatics Campus, Saarbrücken, Germany & HCI Games Group, Games Institute, University of Waterloo, Waterloo, Ontario, Canada), Dr. Gustavo F. Tondello (HCI Games Group, University of Waterloo, Waterloo, Ontario, Canada), Lennart E. Nacke (Stratford School of Interaction Design, Business, University of Waterloo, Waterloo, Ontario, Canada & HCI Games Group, Games Institute, University of Waterloo, Waterloo, Ontario, Canada)
Abstract | Tags: Full Paper | Links:
@inproceedings{Krath2023Hexad,
title = {Hexad-12: Developing and Validating a Short Version of the Gamification User Types Hexad Scale},
author = {Jeanine Krath (University of Koblenz-Landau, Koblenz, Germany), Maximilian Altmeyer (German Research Center for Artificial Intelligence (DFKI), Saarland Informatics Campus, Saarbrücken, Germany & HCI Games Group, Games Institute, University of Waterloo, Waterloo, Ontario, Canada), Dr. Gustavo F. Tondello (HCI Games Group, University of Waterloo, Waterloo, Ontario, Canada), Lennart E. Nacke (Stratford School of Interaction Design and Business, University of Waterloo, Waterloo, Ontario, Canada & HCI Games Group, Games Institute, University of Waterloo, Waterloo, Ontario, Canada)},
doi = {10.1145/3544548.3580968},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {The Hexad scale is a crucial tool for personalized gamification in user experience (UX) design. However, completing a 24-item questionnaire can increase dropout rates and screen fatigue within online surveys. When included in larger surveys, scale brevity makes a difference. To reduce the time required for the assessment process, we developed and validated a 12-item version of the Hexad scale. To create it, we carried out an exploratory factor analysis on an existing data set to identify appropriate items ($n=882$). To validate the 12-item version, we conducted a confirmatory factor analysis on a new data set ($n=1,101$). Our results show that Hexad-12 outperforms the original Hexad scale regarding model fit, reliability, convergent, and discriminant validity. Therefore, Hexad-12 resolves issues found in studies using the original Hexad scale and provides a suitable and swift instrument for concisely assessing Hexad user types in tailored gamification design.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
The Hexad scale is a crucial tool for personalized gamification in user experience (UX) design. However, completing a 24-item questionnaire can increase dropout rates and screen fatigue within online surveys. When included in larger surveys, scale brevity makes a difference. To reduce the time required for the assessment process, we developed and validated a 12-item version of the Hexad scale. To create it, we carried out an exploratory factor analysis on an existing data set to identify appropriate items ($n=882$). To validate the 12-item version, we conducted a confirmatory factor analysis on a new data set ($n=1,101$). Our results show that Hexad-12 outperforms the original Hexad scale regarding model fit, reliability, convergent, and discriminant validity. Therefore, Hexad-12 resolves issues found in studies using the original Hexad scale and provides a suitable and swift instrument for concisely assessing Hexad user types in tailored gamification design.
How to Communicate Robot Motion Intent: A Scoping Review
Max Pascher (Westphalian University of Applied Sciences & University of Duisburg-Essen), Uwe Gruenefeld (University of Duisburg-Essen), Stefan Schneegass (University of Duisburg-Essen), Jens Gerken (Westphalian University of Applied Sciences)
Abstract | Tags: Full Paper | Links:
@inproceedings{Pascher2023Robot,
title = {How to Communicate Robot Motion Intent: A Scoping Review },
author = {Max Pascher (Westphalian University of Applied Sciences & University of Duisburg-Essen), Uwe Gruenefeld (University of Duisburg-Essen), Stefan Schneegass (University of Duisburg-Essen), Jens Gerken (Westphalian University of Applied Sciences)},
doi = {10.1145/3544548.3580857},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Robots are becoming increasingly omnipresent in our daily lives, supporting us and carrying out autonomous tasks. In Human-Robot Interaction, human actors benefit from understanding the robot's motion intent to avoid task failures and foster collaboration. Finding effective ways to communicate this intent to users has recently received increased research interest. However, no common language has been established to systematize robot motion intent. This work presents a scoping review aimed at unifying existing knowledge. Based on our analysis, we present an intent communication model that depicts the relationship between robot and human through different intent dimensions (intent type, intent information, intent location). We discuss these different intent dimensions and their interrelationships with different kinds of robots and human roles. Throughout our analysis, we classify the existing research literature along our intent communication model, allowing us to identify key patterns and possible directions for future research.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Robots are becoming increasingly omnipresent in our daily lives, supporting us and carrying out autonomous tasks. In Human-Robot Interaction, human actors benefit from understanding the robot's motion intent to avoid task failures and foster collaboration. Finding effective ways to communicate this intent to users has recently received increased research interest. However, no common language has been established to systematize robot motion intent. This work presents a scoping review aimed at unifying existing knowledge. Based on our analysis, we present an intent communication model that depicts the relationship between robot and human through different intent dimensions (intent type, intent information, intent location). We discuss these different intent dimensions and their interrelationships with different kinds of robots and human roles. Throughout our analysis, we classify the existing research literature along our intent communication model, allowing us to identify key patterns and possible directions for future research.
I Need a Third Arm! Eliciting Body-based Interactions with a Wearable Robotic Arm
Marie Muehlhaus (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany), Marion Koelle (OFFIS - Institute for Information Technology, Oldenburg, Germany), Artin Saberpour (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany), Jürgen Steimle (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany)
Abstract | Tags: Full Paper | Links:
@inproceedings{Muehlhaus2023Arm,
title = {I Need a Third Arm! Eliciting Body-based Interactions with a Wearable Robotic Arm},
author = {Marie Muehlhaus (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany), Marion Koelle (OFFIS - Institute for Information Technology, Oldenburg, Germany), Artin Saberpour (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany), Jürgen Steimle (Saarland University, Saarland Informatics Campus, Saarbrücken, Germany)},
url = {https://hci.cs.uni-saarland.de, Website
https://twitter.com/HCI_Saarland, twitter},
doi = {10.1145/3544548.3581184},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Wearable robotic arms (WRA) open up a unique interaction space that closely integrates the user's body with an embodied robotic collaborator. This space affords diverse interaction styles, including body movement, hand gestures, or gaze. Yet, it is so-far unexplored which commands are desirable from a user perspective. Contributing findings from an elicitation study (N=14), we provide a comprehensive set of interactions for basic robot control, navigation, object manipulation, and emergency situations, performed when hands are free or occupied. Our study provides insights into preferred body parts, input modalities, and the users' underlying sources of inspiration. Comparing interaction styles between WRAs and off-body robots, we highlight how WRAs enable a range of interactions specific for on-body robots and how users use WRAs both as tools and as collaborators. We conclude by providing guidance on the design of ad-hoc interaction with WRAs informed by user behavior.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Wearable robotic arms (WRA) open up a unique interaction space that closely integrates the user's body with an embodied robotic collaborator. This space affords diverse interaction styles, including body movement, hand gestures, or gaze. Yet, it is so-far unexplored which commands are desirable from a user perspective. Contributing findings from an elicitation study (N=14), we provide a comprehensive set of interactions for basic robot control, navigation, object manipulation, and emergency situations, performed when hands are free or occupied. Our study provides insights into preferred body parts, input modalities, and the users' underlying sources of inspiration. Comparing interaction styles between WRAs and off-body robots, we highlight how WRAs enable a range of interactions specific for on-body robots and how users use WRAs both as tools and as collaborators. We conclude by providing guidance on the design of ad-hoc interaction with WRAs informed by user behavior.
I want to be able to change the speed and size of the avatar: Assessing User Requirements for Animated Sign Language Translation Interfaces
Amelie Nolte (University of Luebeck), Barbara Gleissl (Ergosign GmbH), Jule Heckmann (Ergosign GmbH), Dieter Wallach (Ergosign GmbH), Nicole Jochems (University of Luebeck)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Nolte2023Sign,
title = {I want to be able to change the speed and size of the avatar: Assessing User Requirements for Animated Sign Language Translation Interfaces},
author = {Amelie Nolte (University of Luebeck), Barbara Gleissl (Ergosign GmbH), Jule Heckmann (Ergosign GmbH), Dieter Wallach (Ergosign GmbH), Nicole Jochems (University of Luebeck)},
url = {https://www.imis.uni-luebeck.de/en, Website},
doi = {10.1145/3544549.3585675},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Despite research having shown that signing users vary in their preferences and needs of distinct sign language (SL) parameters, current research on SL avatars lacks consideration of the UI context's options for individualization or configuration of such parameters. Our paper addresses this gap as it presents our ability-oriented online survey, in which we asked native signers about parameters they would like to configure, as well content types that should be offered for translation within travel contexts. Our results indicate that parameters with a direct influence on the understandability of the avatar are most important for individual adjustments and situations with high time-pressure are valued highly for translation within travelling contexts. Also, our study design revealed that assessing the language background of participants in the form of an example-based self-assessment can help achieve more sensitive results, emphasizing the need for adequate research approaches. },
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Despite research having shown that signing users vary in their preferences and needs of distinct sign language (SL) parameters, current research on SL avatars lacks consideration of the UI context's options for individualization or configuration of such parameters. Our paper addresses this gap as it presents our ability-oriented online survey, in which we asked native signers about parameters they would like to configure, as well content types that should be offered for translation within travel contexts. Our results indicate that parameters with a direct influence on the understandability of the avatar are most important for individual adjustments and situations with high time-pressure are valued highly for translation within travelling contexts. Also, our study design revealed that assessing the language background of participants in the form of an example-based self-assessment can help achieve more sensitive results, emphasizing the need for adequate research approaches.
Immersive Reading: Comparison of Performance and User Experience for Reading Long Texts in Virtual Reality
Jenny Gabel (Understanding Written Artefacts, Human Computer Interaction, Universität Hamburg), Melanie Ludwig ( Human Computer Interaction, Universität Hamburg), Frank Steinicke (Human Computer Interaction, Understanding Written Artefacts, Universität Hamburg)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Gabel2023Reading,
title = {Immersive Reading: Comparison of Performance and User Experience for Reading Long Texts in Virtual Reality},
author = {Jenny Gabel (Understanding Written Artefacts, Human Computer Interaction, Universität Hamburg), Melanie Ludwig ( Human Computer Interaction, Universität Hamburg), Frank Steinicke (Human Computer Interaction, Understanding Written Artefacts, Universität Hamburg)},
url = {https://www.inf.uni-hamburg.de/en/inst/ab/hci.html, Website
https://twitter.com/uhhhci, twitter},
doi = {10.1145/3544549.3585895},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Specific use cases in virtual reality (VR) require users to read long texts on their headsets. We use VR to support researchers in the humanities, which includes the display of long text descriptions in VR. However, research on suitable user interface (UI) patterns for displaying and interacting with long texts in VR is scarce. To address this gap, we designed four text panel variants and conducted a within-participants study (N=24) to evaluate user experience (UX) and reading performance. Our findings suggest that there are no significant differences between conditions regarding reading performance. Yet, there are significant effects of conditions on some aspects of UX. Our work offers initial insights and future directions for research on the design of suitable UI patterns and the UX for reading long texts in VR.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Specific use cases in virtual reality (VR) require users to read long texts on their headsets. We use VR to support researchers in the humanities, which includes the display of long text descriptions in VR. However, research on suitable user interface (UI) patterns for displaying and interacting with long texts in VR is scarce. To address this gap, we designed four text panel variants and conducted a within-participants study (N=24) to evaluate user experience (UX) and reading performance. Our findings suggest that there are no significant differences between conditions regarding reading performance. Yet, there are significant effects of conditions on some aspects of UX. Our work offers initial insights and future directions for research on the design of suitable UI patterns and the UX for reading long texts in VR.
In Sync: Exploring Synchronization to Increase Trust Between Humans and Non-humanoid Robots
Wieslaw Bartkowski (University of Warsaw), Andrzej Nowak (University of Warsaw), Filip Ignacy Czajkowski (University of Warsaw), Albrecht Schmidt (LMU Munich), Florian Müller (LMU Munich)
Abstract | Tags: Full Paper | Links:
@inproceedings{Bartkowski2023Sync,
title = {In Sync: Exploring Synchronization to Increase Trust Between Humans and Non-humanoid Robots},
author = {Wieslaw Bartkowski (University of Warsaw), Andrzej Nowak (University of Warsaw), Filip Ignacy Czajkowski (University of Warsaw), Albrecht Schmidt (LMU Munich), Florian Müller (LMU Munich)},
url = {https://www.en.um.informatik.uni-muenchen.de/index.html, Website
https://twitter.com/mimuc, twitter},
doi = {10.1145/3544548.3581193},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {When we go for a walk with friends, we can observe an interesting effect: From step lengths to arm movements - our movements unconsciously align; they synchronize. Prior research found that this synchronization is a crucial aspect of human relations that strengthens social cohesion and trust. Generalizing from these findings in synchronization theory, we propose a dynamical approach that can be applied in the design of non-humanoid robots to increase trust. We contribute the results of a controlled experiment with 51 participants exploring our concept in a between-subjects design. For this, we built a prototype of a simple non-humanoid robot that can bend to follow human movements and vary the movement synchronization patterns. We found that synchronized movements lead to significantly higher ratings in an established questionnaire on trust between people and automation but did not influence the willingness to spend money in a trust game.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
When we go for a walk with friends, we can observe an interesting effect: From step lengths to arm movements - our movements unconsciously align; they synchronize. Prior research found that this synchronization is a crucial aspect of human relations that strengthens social cohesion and trust. Generalizing from these findings in synchronization theory, we propose a dynamical approach that can be applied in the design of non-humanoid robots to increase trust. We contribute the results of a controlled experiment with 51 participants exploring our concept in a between-subjects design. For this, we built a prototype of a simple non-humanoid robot that can bend to follow human movements and vary the movement synchronization patterns. We found that synchronized movements lead to significantly higher ratings in an established questionnaire on trust between people and automation but did not influence the willingness to spend money in a trust game.
Induce a Blink of the Eye: Evaluating Techniques for Triggering Eye Blinks in Virtual Reality
André Zenner (Saarland University & DFKI), Kristin Ullmann (Saarland University), Oscar Ariza (Universität Hamburg), Frank Steinicke (Universität Hamburg), Antonio Krüger (Saarland University & DFKI)
Abstract | Tags: Full Paper | Links:
@inproceedings{Zenner2023Blink,
title = {Induce a Blink of the Eye: Evaluating Techniques for Triggering Eye Blinks in Virtual Reality},
author = {André Zenner (Saarland University & DFKI), Kristin Ullmann (Saarland University), Oscar Ariza (Universität Hamburg), Frank Steinicke (Universität Hamburg), Antonio Krüger (Saarland University & DFKI)},
url = {https://umtl.cs.uni-saarland.de/, Website
https://youtu.be/IH7ynwDu9B0, Teaser Video
https://youtu.be/O6cf9DbgD5k, Full Video},
doi = {10.1145/3544548.3580888},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {As more and more virtual reality (VR) headsets support eye tracking, recent techniques started to use eye blinks to induce unnoticeable manipulations to the virtual environment, e.g., to redirect users' actions. However, to exploit their full potential, more control over users' blinking behavior in VR is required. To this end, we propose a set of reflex-based blink triggers that are suited specifically for VR. In accordance with blink-based techniques for redirection, we formulate (i) effectiveness, (ii) efficiency, (iii) reliability, and (iv) unobtrusiveness as central requirements for successful triggers. We implement the soft- and hardware-based methods and compare the four most promising approaches in a user study. Our results highlight the pros and cons of the tested triggers, and show those based on the menace, corneal, and dazzle reflexes to perform best. From these results, we derive recommendations that help choosing suitable blink triggers for VR applications.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
As more and more virtual reality (VR) headsets support eye tracking, recent techniques started to use eye blinks to induce unnoticeable manipulations to the virtual environment, e.g., to redirect users' actions. However, to exploit their full potential, more control over users' blinking behavior in VR is required. To this end, we propose a set of reflex-based blink triggers that are suited specifically for VR. In accordance with blink-based techniques for redirection, we formulate (i) effectiveness, (ii) efficiency, (iii) reliability, and (iv) unobtrusiveness as central requirements for successful triggers. We implement the soft- and hardware-based methods and compare the four most promising approaches in a user study. Our results highlight the pros and cons of the tested triggers, and show those based on the menace, corneal, and dazzle reflexes to perform best. From these results, we derive recommendations that help choosing suitable blink triggers for VR applications.
Inhabiting Interconnected Spaces: How Users Shape and Appropriate their Smart Home Ecosystems
Mikołaj P. Woźniak (University of Oldenburg), Sarah Vöge (University of Oldenburg), Ronja Krüger (University of Oldenburg), Heiko Müller (University of Oldenburg), Marion Koelle (OFFIS - Institute for Information Technology), Susanne Boll (University of Oldenburg)
Abstract | Tags: Full Paper | Links:
@inproceedings{Wozniak2023Inhabiting,
title = {Inhabiting Interconnected Spaces: How Users Shape and Appropriate their Smart Home Ecosystems },
author = {Mikołaj P. Woźniak (University of Oldenburg), Sarah Vöge (University of Oldenburg), Ronja Krüger (University of Oldenburg), Heiko Müller (University of Oldenburg), Marion Koelle (OFFIS - Institute for Information Technology), Susanne Boll (University of Oldenburg)},
url = {https://hci.uni-oldenburg.de/, Website},
doi = {10.1145/3544548.3581497},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Over the last decade, smart home technology (SHT) has become an integral part of modern households. As a result, smart home ecosystems blend with daily social life, appropriated and integrated into personalised domestic environments. The lived experience of inhabiting smart home ecosystems, however, is not yet understood, resulting in a mismatch between ecosystem design and inhabitants' needs.
Drawing on contextual inquiry methods, we conducted an explorative interview study (N=20) with SHT users in their homes. Our thematic analysis reveals how users shape their smart home ecosystems (SHEs), considering social relationships at home, perceived ownership of SHTs, and expected key benefits. Notably, our analysis shows that household members consciously choose `their' level of SHT interconnectedness, reflecting social, spatial and functional affinities between systems. Following our findings, we formulate five implications for designing future SHTs. Our work contributes insights on the dynamics and appropriation of smart home ecosystems by their inhabitants. },
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Over the last decade, smart home technology (SHT) has become an integral part of modern households. As a result, smart home ecosystems blend with daily social life, appropriated and integrated into personalised domestic environments. The lived experience of inhabiting smart home ecosystems, however, is not yet understood, resulting in a mismatch between ecosystem design and inhabitants' needs.
Drawing on contextual inquiry methods, we conducted an explorative interview study (N=20) with SHT users in their homes. Our thematic analysis reveals how users shape their smart home ecosystems (SHEs), considering social relationships at home, perceived ownership of SHTs, and expected key benefits. Notably, our analysis shows that household members consciously choose `their' level of SHT interconnectedness, reflecting social, spatial and functional affinities between systems. Following our findings, we formulate five implications for designing future SHTs. Our work contributes insights on the dynamics and appropriation of smart home ecosystems by their inhabitants.
Drawing on contextual inquiry methods, we conducted an explorative interview study (N=20) with SHT users in their homes. Our thematic analysis reveals how users shape their smart home ecosystems (SHEs), considering social relationships at home, perceived ownership of SHTs, and expected key benefits. Notably, our analysis shows that household members consciously choose `their' level of SHT interconnectedness, reflecting social, spatial and functional affinities between systems. Following our findings, we formulate five implications for designing future SHTs. Our work contributes insights on the dynamics and appropriation of smart home ecosystems by their inhabitants.
Interacting with Neural Radiance Fields in Immersive Virtual Reality
Ke Li (Universität Hamburg, Deutsches Elektronen-Synchrotron DESY), Tim Rolff (Universität Hamburg ), Susanne Schmidt (Universität Hamburg), Reinhard Bacher (Deutsches Elektronen Synchrotron DESY), Wim Leemans (Deutsches Elektronen Synchrotron DESY), Frank Steinicke (Universität Hamburg)
Abstract | Tags: Interactivity/Demonstration | Links:
@inproceedings{Li2023neural,
title = {Interacting with Neural Radiance Fields in Immersive Virtual Reality},
author = {Ke Li (Universität Hamburg, Deutsches Elektronen-Synchrotron DESY),
Tim Rolff (Universität Hamburg ),
Susanne Schmidt (Universität Hamburg),
Reinhard Bacher (Deutsches Elektronen Synchrotron DESY),
Wim Leemans (Deutsches Elektronen Synchrotron DESY),
Frank Steinicke (Universität Hamburg)},
url = {https://www.inf.uni-hamburg.de/en/inst/ab/hci.html, Webseite
},
doi = {10.1145/3544549.3583920},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {"Recent advancements in the neural radiance field (NeRF) technology, in particular its extension by instant neural graphics primitives, provide tremendous opportunities for the use of real-time immersive virtual reality (VR) applications. Moreover, the recent release
of an immersive neural graphics primitives framework (immersive-ngp) brings real-time, stereoscopic NeRF rendering to the Unity game engine. However, the system and application research combining NeRF and human-computer interaction in VR is still at the
very beginning.
In this demo, we present multiple interactive system features for immersive-ngp with design principles focusing on improving the usability and interactivity of the framework for small to medium-scale NeRF scenes. We demonstrate that these new feature implementations such as exocentric manipulation, VR tunneling effects, and immersive scene appearance editing enable novel VR-NeRF experiences, for example, for customized experiences in inspecting a particle accelerator environment."},
keywords = {Interactivity/Demonstration},
pubstate = {published},
tppubtype = {inproceedings}
}
"Recent advancements in the neural radiance field (NeRF) technology, in particular its extension by instant neural graphics primitives, provide tremendous opportunities for the use of real-time immersive virtual reality (VR) applications. Moreover, the recent release
of an immersive neural graphics primitives framework (immersive-ngp) brings real-time, stereoscopic NeRF rendering to the Unity game engine. However, the system and application research combining NeRF and human-computer interaction in VR is still at the
very beginning.
In this demo, we present multiple interactive system features for immersive-ngp with design principles focusing on improving the usability and interactivity of the framework for small to medium-scale NeRF scenes. We demonstrate that these new feature implementations such as exocentric manipulation, VR tunneling effects, and immersive scene appearance editing enable novel VR-NeRF experiences, for example, for customized experiences in inspecting a particle accelerator environment."
of an immersive neural graphics primitives framework (immersive-ngp) brings real-time, stereoscopic NeRF rendering to the Unity game engine. However, the system and application research combining NeRF and human-computer interaction in VR is still at the
very beginning.
In this demo, we present multiple interactive system features for immersive-ngp with design principles focusing on improving the usability and interactivity of the framework for small to medium-scale NeRF scenes. We demonstrate that these new feature implementations such as exocentric manipulation, VR tunneling effects, and immersive scene appearance editing enable novel VR-NeRF experiences, for example, for customized experiences in inspecting a particle accelerator environment."
Interaction Effects of Pedestrian Behavior, Smartphone Distraction and External Communication of Automated Vehicles on Crossing and Gaze Behavior
Mirjam Lanzer (Human Factors, Ulm University), Ina Koniakowsky (Human Factors, Ulm University), Mark Colley (Media Informatics, Ulm University), Martin Baumann (Human Factors, Ulm University)
Abstract | Tags: Full Paper | Links:
@inproceedings{lanzer2023pedestrian,
title = {Interaction Effects of Pedestrian Behavior, Smartphone Distraction and External Communication of Automated Vehicles on Crossing and Gaze Behavior },
author = {Mirjam Lanzer (Human Factors, Ulm University), Ina Koniakowsky (Human Factors, Ulm University), Mark Colley (Media Informatics, Ulm University), Martin Baumann (Human Factors, Ulm University)},
url = {https://www.uni-ulm.de/en/in/psy-hf/, Webseite
https://twitter.com/HumanFactorsUlm, Twitter},
doi = {10.1145/3544548.3581303},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {External communication of automated vehicles is proposed to replace driver-pedestrian communication in ambiguous crossing situations. So far, research has focused on simpler scenarios with one attentive pedestrian and one automated vehicle. This virtual reality study (N=115) investigates a more complex scenario with other crossing pedestrians, a distracting task on the smartphone, and external communication by the automated vehicle. Interaction effects were found for crossing duration, gaze behavior, and subjective measures. For attentive pedestrians, the external communication resulted in shorter crossing durations, higher perceived safety, as well as lower perceived criticality, cognitive workload, and effort. These positive effects were not found when pedestrians were distracted. Instead, distracted pedestrians benefited from other crossing pedestrians because they looked less at the stopping vehicle, felt safer, perceived the situation as less critical, and reported lower cognitive workload and effort. Pedestrians initiated crossings earlier with a group or external communication and later with a smartphone.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
External communication of automated vehicles is proposed to replace driver-pedestrian communication in ambiguous crossing situations. So far, research has focused on simpler scenarios with one attentive pedestrian and one automated vehicle. This virtual reality study (N=115) investigates a more complex scenario with other crossing pedestrians, a distracting task on the smartphone, and external communication by the automated vehicle. Interaction effects were found for crossing duration, gaze behavior, and subjective measures. For attentive pedestrians, the external communication resulted in shorter crossing durations, higher perceived safety, as well as lower perceived criticality, cognitive workload, and effort. These positive effects were not found when pedestrians were distracted. Instead, distracted pedestrians benefited from other crossing pedestrians because they looked less at the stopping vehicle, felt safer, perceived the situation as less critical, and reported lower cognitive workload and effort. Pedestrians initiated crossings earlier with a group or external communication and later with a smartphone.
Interpretable Time-Dependent Convolutional Emotion Recognition with Contextual Data Streams
David Bethge (LMU Munich, Dr. Ing. h.c. F. Porsche AG), Constantin Patsch (Dr. Ing. h.c. F. Porsche AG), Philipp Hallgarten (Dr. Ing. h.c. F. Porsche AG, Universität Tübingen), Thomas Kosch (HU Berlin)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Bethge2023Emotion,
title = {Interpretable Time-Dependent Convolutional Emotion Recognition with Contextual Data Streams},
author = {David Bethge (LMU Munich, Dr. Ing. h.c. F. Porsche AG), Constantin Patsch (Dr. Ing. h.c. F. Porsche AG), Philipp Hallgarten (Dr. Ing. h.c. F. Porsche AG, Universität Tübingen), Thomas Kosch (HU Berlin)},
url = {https://ubicomp.net/wp/, Website},
doi = {10.1145/3544549.3585672},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Emotion prediction is important when interacting with computers. However, emotions are complex, difficult to assess, understand, and hard to classify. Current emotion classification strategies skip why a specific emotion was predicted, complicating the user's understanding of affective and empathic interface behaviors. Advances in deep learning showed that transformer networks can learn powerful time-series patterns while showing classification decisions and feature importances. We present a novel transformer-based model that classifies emotions robustly. Our model not only offers high emotion-prediction performance but also enables transparency on the model decisions. Our solution thereby provides a time-aware feature interpretation of classification decisions using saliency maps. We evaluate the system on a contextual, real-world driving dataset involving twelve participants. Our model achieves a mean accuracy of 70% in 5-class emotion classification on unknown roads and outperforms in-car facial expression recognition by 14%. We conclude how emotion prediction can be improved by incorporating emotion sensing into interactive computing systems.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Emotion prediction is important when interacting with computers. However, emotions are complex, difficult to assess, understand, and hard to classify. Current emotion classification strategies skip why a specific emotion was predicted, complicating the user's understanding of affective and empathic interface behaviors. Advances in deep learning showed that transformer networks can learn powerful time-series patterns while showing classification decisions and feature importances. We present a novel transformer-based model that classifies emotions robustly. Our model not only offers high emotion-prediction performance but also enables transparency on the model decisions. Our solution thereby provides a time-aware feature interpretation of classification decisions using saliency maps. We evaluate the system on a contextual, real-world driving dataset involving twelve participants. Our model achieves a mean accuracy of 70% in 5-class emotion classification on unknown roads and outperforms in-car facial expression recognition by 14%. We conclude how emotion prediction can be improved by incorporating emotion sensing into interactive computing systems.
Investigating Tangible Privacy-Preserving Mechanisms for Future Smart Homes
Maximiliane Windl (LMU Munich, Munich Center for Machine Learning (MCML)), Albrecht Schmidt (LMU Munich), Sebastian S. Feger (LMU Munich)
Abstract | Tags: Full Paper | Links:
@inproceedings{Windl2023Tangible,
title = {Investigating Tangible Privacy-Preserving Mechanisms for Future Smart Homes},
author = {Maximiliane Windl (LMU Munich, Munich Center for Machine Learning (MCML)), Albrecht Schmidt (LMU Munich), Sebastian S. Feger (LMU Munich)},
url = {https://maximiliane-windl.com/, Website
https://twitter.com/maxiwindl, twitter
https://youtu.be/sWVIrSoQ3SA, Teaser Video
https://youtu.be/b16ARi1BPzQ, Full Video},
doi = {10.1145/3544548.3581167},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Most smart home devices have multiple sensors, such as cameras and microphones; however, most cannot be controlled individually. Tangible privacy mechanisms provide control over individual sensors and instill high certainty of privacy. Yet, it remains unclear how they can be used in future smart homes. We conducted three studies to understand how tangible privacy mechanisms scale across multiple devices and respond to user needs. First, we conducted a focus group (N=8) on speculative tangible control artifacts to understand the user perspective. Second, we ran a workshop at a human-computer interaction conference (N=8) on tangible privacy. Third, we conducted a six-week in-the-wild study with a tangible, static privacy dashboard across six households. Our findings help to contrast the need for tangible privacy mechanisms on the sensor level with user needs on a smart home level. Finally, we discuss our design implications for future smart homes through the lens of inclusive privacy.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Most smart home devices have multiple sensors, such as cameras and microphones; however, most cannot be controlled individually. Tangible privacy mechanisms provide control over individual sensors and instill high certainty of privacy. Yet, it remains unclear how they can be used in future smart homes. We conducted three studies to understand how tangible privacy mechanisms scale across multiple devices and respond to user needs. First, we conducted a focus group (N=8) on speculative tangible control artifacts to understand the user perspective. Second, we ran a workshop at a human-computer interaction conference (N=8) on tangible privacy. Third, we conducted a six-week in-the-wild study with a tangible, static privacy dashboard across six households. Our findings help to contrast the need for tangible privacy mechanisms on the sensor level with user needs on a smart home level. Finally, we discuss our design implications for future smart homes through the lens of inclusive privacy.
Investigating the Effects of Individual Spatial Abilities on Virtual Reality Object Manipulation
Tobias Drey (Institute of Media Informatics, Ulm University, Ulm, Germany), Michael Montag (Department of General Psychology, Magdeburg-Stendal University of Applied Science, Magdeburg, Germany), Andrea Vogt (Institute of Psychology, Education, Ulm University, Ulm, Germany), Nico Rixen (Institute of Media Informatics, Ulm University, Ulm, Germany), Tina Seufert (Institute of Psychology, Education, Ulm University, Ulm, Germany), Steffi Zander (Department of General Psychology, Magdeburg-Stendal University of Applied Science, Magdeburg, Germany), Michael Rietzler (Institute of Media Informatics, Ulm University, Ulm, Germany), Enrico Rukzio (Institute of Media Informatics, Ulm University, Ulm, Germany)
Abstract | Tags: Full Paper | Links:
@inproceedings{Drey2023Spatial,
title = {Investigating the Effects of Individual Spatial Abilities on Virtual Reality Object Manipulation},
author = {Tobias Drey (Institute of Media Informatics, Ulm University, Ulm, Germany), Michael Montag (Department of General Psychology, Magdeburg-Stendal University of Applied Science, Magdeburg, Germany), Andrea Vogt (Institute of Psychology and Education, Ulm University, Ulm, Germany), Nico Rixen (Institute of Media Informatics, Ulm University, Ulm, Germany), Tina Seufert (Institute of Psychology and Education, Ulm University, Ulm, Germany), Steffi Zander (Department of General Psychology, Magdeburg-Stendal University of Applied Science, Magdeburg, Germany), Michael Rietzler (Institute of Media Informatics, Ulm University, Ulm, Germany), Enrico Rukzio (Institute of Media Informatics, Ulm University, Ulm, Germany)},
url = {https://www.uni-ulm.de/in/mi/institut/mitarbeiterinnen/tobias-drey/, Website
https://twitter.com/TobiasDrey, twitter
https://youtu.be/Kwo32PkKZVk, Teaser Video
https://www.youtube.com/watch?v=5nitNnpFocM, Full Video
},
doi = {10.1145/3544548.3581004},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Object manipulation in 3D space, meaning translating, rotating, and scaling, is ubiquitous in virtual reality (VR), and several interaction techniques have been developed in the past to optimize the task performance and usability. However, preliminary research indicates that individual spatial abilities also have an impact. Yet, it was never investigated if users’ spatial abilities influence VR object manipulation. We assessed this in a user study (N=66) using 21 manipulation tasks defined in a Fitts’ law-related approach. As interaction techniques, we chose gizmos for simultaneously manipulating 1 and 3 degrees of freedom (DOF) and a handle bar metaphor for 7 DOF. Higher spatial abilities resulted in significantly shorter task completion time and more targeted manipulations, while task accuracy was unaffected. However, an optimized interaction technique could compensate individual disadvantages. We propose seven guidelines on spatial abilities in interaction technique design and research to personalize and improve VR applications.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Object manipulation in 3D space, meaning translating, rotating, and scaling, is ubiquitous in virtual reality (VR), and several interaction techniques have been developed in the past to optimize the task performance and usability. However, preliminary research indicates that individual spatial abilities also have an impact. Yet, it was never investigated if users’ spatial abilities influence VR object manipulation. We assessed this in a user study (N=66) using 21 manipulation tasks defined in a Fitts’ law-related approach. As interaction techniques, we chose gizmos for simultaneously manipulating 1 and 3 degrees of freedom (DOF) and a handle bar metaphor for 7 DOF. Higher spatial abilities resulted in significantly shorter task completion time and more targeted manipulations, while task accuracy was unaffected. However, an optimized interaction technique could compensate individual disadvantages. We propose seven guidelines on spatial abilities in interaction technique design and research to personalize and improve VR applications.
Keep it Real: Investigating Driver-Cyclist Interaction in Real-World Traffic
Ammar Al-Taie (University of Glasgow), Yasmeen Abdrabou (University of the BundeswehrMunich, University of Glasgow), Shaun Macdonald (University of Glasgow), Frank Pollick (University of Glasgow), Stephen Brewster (University of Glasgow)
Abstract | Tags: Full Paper | Links:
@inproceedings{AlTaie2023Keep,
title = {Keep it Real: Investigating Driver-Cyclist Interaction in Real-World Traffic},
author = {Ammar Al-Taie (University of Glasgow), Yasmeen Abdrabou (University of the BundeswehrMunich and University of Glasgow), Shaun Macdonald (University of Glasgow), Frank Pollick (University of Glasgow), Stephen Brewster (University of Glasgow)},
url = {https://www.unibw.de/usable-security-and-privacy-en, Website
},
doi = {10.1145/3544548.3581049},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Cyclists encounter drivers in many traffic scenarios; good communication is key to avoiding collisions. Little is known about everyday driver-cyclist interaction and communication. This is important in designing Automated Vehicles (AVs) that must drive safely around cyclists. We explored driver-cyclist interaction across diverse scenarios through in-the-wild observations (N=414) and a naturalistic study involving cyclists wearing eye-trackers (N=12). Results showed cyclists attended to road markings and traffic signs in controlled traffic scenarios but to vehicle sides and windows in uncontrolled encounters. Interactions were unlikely at controlled intersections, but various techniques were used to negotiate right-of-way in uncontrolled scenarios, e.g. cyclists used arm gestures and shoulder checks to communicate their intent and awareness when lane merging. Drivers communicated these through on-vehicle signals and head movements at roundabouts. We discuss the implications of driver-cyclist interaction behaviour on AV interaction design and offer insights into system requirements to support cyclists riding in traffic.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Cyclists encounter drivers in many traffic scenarios; good communication is key to avoiding collisions. Little is known about everyday driver-cyclist interaction and communication. This is important in designing Automated Vehicles (AVs) that must drive safely around cyclists. We explored driver-cyclist interaction across diverse scenarios through in-the-wild observations (N=414) and a naturalistic study involving cyclists wearing eye-trackers (N=12). Results showed cyclists attended to road markings and traffic signs in controlled traffic scenarios but to vehicle sides and windows in uncontrolled encounters. Interactions were unlikely at controlled intersections, but various techniques were used to negotiate right-of-way in uncontrolled scenarios, e.g. cyclists used arm gestures and shoulder checks to communicate their intent and awareness when lane merging. Drivers communicated these through on-vehicle signals and head movements at roundabouts. We discuss the implications of driver-cyclist interaction behaviour on AV interaction design and offer insights into system requirements to support cyclists riding in traffic.
Kerfmeter: Automatic Kerf Calibration for Laser Cutting
Shohei Katakura, Martin Taraz, Muhammad Abdullah, Paul Methfessel, Lukas Rambold, Robert Kovacs,, Patrick Baudisch
Abstract | Tags: Full Paper | Links:
@inproceedings{Katakura2023Kerfmeter,
title = {Kerfmeter: Automatic Kerf Calibration for Laser Cutting },
author = {Shohei Katakura, Martin Taraz, Muhammad Abdullah, Paul Methfessel, Lukas Rambold, Robert Kovacs, and Patrick Baudisch},
url = {https://hpi.de/baudisch/home.html, Website},
doi = {10.1145/3544548.3580914},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {We present Kerfmeter, a hardware + software device that automatically determines how much material the laser cutter burns off, also known as kerf. Its knowledge about kerf allows Kerfmeter to make the joints of laser cut 3D models fit together with just the right tension, i.e., loose enough to allow for comfortable assembly, yet tight enough to hold parts together without glue—all this without user interaction. Kerfmeter attaches to the head of a laser cutter and works as follows: when users send a model to the laser cutter, Kerfmeter intercepts the job, injects a brief calibration routine that determines kerf, dilates the cutting plan according to this kerf, and then proceeds to fabricate the cutting plan. During the calibration routine, Kerfmeter cuts a 2cm Archimedean spiral and uses a motor to rotate it in place until it jams against the surrounding material; the angle at which the spiral jams allows Kerfmeter to infer kerf. The calibration process takes about 20s, which is >10x faster than traditional, manual kerf calibration, while also eliminating the need for expertise. In our technical evaluation, Kerfmeter produced functioning press fit joints reliably at a precision comparable to traditional manual kerf strips. Kerfmeter makes it easy to sample repeatedly; we demonstrate how this allows boosting precision past any traditional kerf strip.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
We present Kerfmeter, a hardware + software device that automatically determines how much material the laser cutter burns off, also known as kerf. Its knowledge about kerf allows Kerfmeter to make the joints of laser cut 3D models fit together with just the right tension, i.e., loose enough to allow for comfortable assembly, yet tight enough to hold parts together without glue—all this without user interaction. Kerfmeter attaches to the head of a laser cutter and works as follows: when users send a model to the laser cutter, Kerfmeter intercepts the job, injects a brief calibration routine that determines kerf, dilates the cutting plan according to this kerf, and then proceeds to fabricate the cutting plan. During the calibration routine, Kerfmeter cuts a 2cm Archimedean spiral and uses a motor to rotate it in place until it jams against the surrounding material; the angle at which the spiral jams allows Kerfmeter to infer kerf. The calibration process takes about 20s, which is >10x faster than traditional, manual kerf calibration, while also eliminating the need for expertise. In our technical evaluation, Kerfmeter produced functioning press fit joints reliably at a precision comparable to traditional manual kerf strips. Kerfmeter makes it easy to sample repeatedly; we demonstrate how this allows boosting precision past any traditional kerf strip.
Let’s Face It: Influence of Facial Expressions on Social Presence in Collaborative Virtual Reality
Simon Kimmel (OFFIS - Institute for Information Technology), Frederike Jung (OFFIS - Institute for Information Technology), Andrii Matviienko (KTH Royal Institute of Technology), Wilko Heuten (OFFIS - Institute for Information Technology), Susanne Boll (University of Oldenburg)
Abstract | Tags: Full Paper | Links:
@inproceedings{Kimmel2023FaceIt,
title = {Let’s Face It: Influence of Facial Expressions on Social Presence in Collaborative Virtual Reality},
author = {Simon Kimmel (OFFIS - Institute for Information Technology), Frederike Jung (OFFIS - Institute for Information Technology), Andrii Matviienko (KTH Royal Institute of Technology), Wilko Heuten (OFFIS - Institute for Information Technology), Susanne Boll (University of Oldenburg)},
url = {https://hci.uni-oldenburg.de/, Website
https://www.facebook.com/HCIOldenburg/, facebook},
doi = {10.1145/3544548.3580707},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {As the world becomes more interconnected, physical separation between people increases. Existing collaborative Virtual Reality (VR) applications, designed to bridge this distance, are not yet sufficient in providing a sense of social connection comparable to face-to-face interactions. Possible reasons are the limited multimodality of VR systems and the lack of non-verbal cues in VR avatars. We systematically investigated how facial expressions influence Social Presence in two collaborative VR tasks. We explored four types of facial expressions: eyes and mouth movements, their combination, and no expressions, for two types of explanations: verbal and graphical. To examine how these expressions influence Social Presence, we conducted a controlled VR experiment (N = 48), in which participants had to explain a specific term to their counterpart. Our results demonstrate that eye and mouth movements positively influence Social Presence in VR. Particularly, combining verbal explanations and eye movements induces the highest feeling of co-presence.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
As the world becomes more interconnected, physical separation between people increases. Existing collaborative Virtual Reality (VR) applications, designed to bridge this distance, are not yet sufficient in providing a sense of social connection comparable to face-to-face interactions. Possible reasons are the limited multimodality of VR systems and the lack of non-verbal cues in VR avatars. We systematically investigated how facial expressions influence Social Presence in two collaborative VR tasks. We explored four types of facial expressions: eyes and mouth movements, their combination, and no expressions, for two types of explanations: verbal and graphical. To examine how these expressions influence Social Presence, we conducted a controlled VR experiment (N = 48), in which participants had to explain a specific term to their counterpart. Our results demonstrate that eye and mouth movements positively influence Social Presence in VR. Particularly, combining verbal explanations and eye movements induces the highest feeling of co-presence.
Linking Audience Physiology to Choreography
Jiawen Han (Keio University), George Chernyshov (Keio University), Moe Sugawa (Keio University), Dingding Zheng (Keio University), Danny Hynds (Keio University), Taichi Furukawa (Keio University), Marcelo Padovani (Keio University), Kouta Minamizawa (Keio University), Karola Marky (Ruhr-University Bochum), Jamie A Ward (Goldsmiths University of London), Kai Kunze (Keio University)
Abstract | Tags: Journal | Links:
@article{Han2023Choreography,
title = {Linking Audience Physiology to Choreography},
author = {Jiawen Han (Keio University), George Chernyshov (Keio University), Moe Sugawa (Keio University), Dingding Zheng (Keio University), Danny Hynds (Keio University), Taichi Furukawa (Keio University), Marcelo Padovani (Keio University), Kouta Minamizawa (Keio University), Karola Marky (Ruhr-University Bochum), Jamie A Ward (Goldsmiths University of London), Kai Kunze (Keio University)},
url = {https://casa.rub.de/ueber-casa/team, Website},
doi = {10.1145/3557887},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {The use of wearable sensor technology opens up exciting avenues for both art and HCI research, providing new ways to explore the invisible link between audience and performer. To be effective, such work requires close collaboration between performers and researchers. In this paper, we report on the co-design process and research insights from our work integrating physiological sensing and live performance.} We explore the connection between the audience’s physiological data and their experience during the performance, analyzing a multi-modal dataset collected from 98 audience members. We identify notable moments based on HRV and EDA, and show how the audience's physiological responses can be linked to the choreography. The longitudinal changes in HRV features suggest a strong connection to the choreographer’s intended narrative arc, while EDA features appear to correspond with short-term audience responses to dramatic moments. We discuss the physiological phenomena and implications for designing feedback systems and interdisciplinary collaborations.},
keywords = {Journal},
pubstate = {published},
tppubtype = {article}
}
The use of wearable sensor technology opens up exciting avenues for both art and HCI research, providing new ways to explore the invisible link between audience and performer. To be effective, such work requires close collaboration between performers and researchers. In this paper, we report on the co-design process and research insights from our work integrating physiological sensing and live performance.} We explore the connection between the audience’s physiological data and their experience during the performance, analyzing a multi-modal dataset collected from 98 audience members. We identify notable moments based on HRV and EDA, and show how the audience's physiological responses can be linked to the choreography. The longitudinal changes in HRV features suggest a strong connection to the choreographer’s intended narrative arc, while EDA features appear to correspond with short-term audience responses to dramatic moments. We discuss the physiological phenomena and implications for designing feedback systems and interdisciplinary collaborations.
Literature Reviews in HCI: A Review of Reviews
Evropi Stefanidi (University of Bremen), Marit Bentvelzen (Utrecht University), Paweł W. Woźniak (Chalmers University of Technology), Thomas Kosch (HU Berlin), Mikołaj P. Woźniak (University of Oldenburg), Thomas Mildner (University of Bremen), Stefan Schneegass (HCI Group, University of Duisburg-Essen), Heiko Müller (University of Oldenburg, OFFIS - Institute for Information Technology), Jasmin Niess (University of St. Gallen,, University of Oslo)
Abstract | Tags: Full Paper | Links:
@inproceedings{Sefanidi2023Review,
title = {Literature Reviews in HCI: A Review of Reviews},
author = {Evropi Stefanidi (University of Bremen), Marit Bentvelzen (Utrecht University), Paweł W. Woźniak (Chalmers University of Technology), Thomas Kosch (HU Berlin), Mikołaj P. Woźniak (University of Oldenburg), Thomas Mildner (University of Bremen), Stefan Schneegass (HCI Group, University of Duisburg-Essen), Heiko Müller (University of Oldenburg and OFFIS - Institute for Information Technology), Jasmin Niess (University of St. Gallen, and University of Oslo)},
url = {https://hci.uni-bremen.de/, Website
https://twitter.com/HCIBremen, twitter},
doi = {10.1145/3544548.3581332},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {This paper analyses Human-Computer Interaction (HCI) literature reviews to provide a clear conceptual basis for authors, reviewers, and readers. HCI is multidisciplinary and various types of literature reviews exist, from systematic to critical reviews in the style of essays. Yet, there is insufficient consensus of what to expect of literature reviews in HCI. Thus, a shared understanding of literature reviews and clear terminology is needed to plan, evaluate, and use literature reviews, and to further improve review methodology. We analysed 189 literature reviews published at all SIGCHI conferences and ACM Transactions on Computer-Human Interaction (TOCHI) up until August 2022. We report on the main dimensions of variation: (i) contribution types and topics; and (ii) structure and methodologies applied. We identify gaps and trends to inform future meta work in HCI and provide a starting point on how to move towards a more comprehensive terminology system of literature reviews in HCI.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
This paper analyses Human-Computer Interaction (HCI) literature reviews to provide a clear conceptual basis for authors, reviewers, and readers. HCI is multidisciplinary and various types of literature reviews exist, from systematic to critical reviews in the style of essays. Yet, there is insufficient consensus of what to expect of literature reviews in HCI. Thus, a shared understanding of literature reviews and clear terminology is needed to plan, evaluate, and use literature reviews, and to further improve review methodology. We analysed 189 literature reviews published at all SIGCHI conferences and ACM Transactions on Computer-Human Interaction (TOCHI) up until August 2022. We report on the main dimensions of variation: (i) contribution types and topics; and (ii) structure and methodologies applied. We identify gaps and trends to inform future meta work in HCI and provide a starting point on how to move towards a more comprehensive terminology system of literature reviews in HCI.
Memory Manipulations in Extended Reality
Elise Bonnail (Telecom Paris, IP Paris), Wen-Jie Tseng (Telecom Paris, IP Paris), Mark McGill (University of Glasgow, Glasgow), Eric Lecolinet (Telecom Paris, IP Paris), Samuel Huron (Telecom Paris, IP Paris), Jan Gugenheimer (TU Darmstadt)
Abstract | Tags: Full Paper | Links:
@inproceedings{Bonnail2023Memory,
title = {Memory Manipulations in Extended Reality },
author = {Elise Bonnail (Telecom Paris, IP Paris), Wen-Jie Tseng (Telecom Paris, IP Paris), Mark McGill (University of Glasgow, Glasgow), Eric Lecolinet (Telecom Paris, IP Paris), Samuel Huron (Telecom Paris, IP Paris), Jan Gugenheimer (TU Darmstadt)},
url = {https://youtu.be/asSejQTZILI, Teaser Video},
doi = {10.1145/3544548.3580988},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Human memory has notable limitations (e.g., forgetting) which have necessitated a variety of memory aids (e.g., calendars). As we grow closer to mass adoption of everyday Extended Reality (XR), which is frequently leveraging perceptual limitations (e.g., redirected walking), it becomes pertinent to consider how XR could leverage memory limitations (forgetting, distorting, persistence) to induce memory manipulations. As memories highly impact our self-perception, social interactions, and behaviors, there is a pressing need to understand XR Memory Manipulations (XRMMs). We ran three speculative design workshops (n=12), with XR and memory researchers creating 48 XRMM scenarios. Through thematic analysis, we define XRMMs, present a framework of their core components and reveal three classes (at encoding, pre-retrieval, at retrieval). Each class differs in terms of technology (AR/VR) and impact on memory (influencing quality of memories, inducing forgetting, distorting memories). We raise ethical concerns and discuss opportunities of perceptual and memory manipulations in XR.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Human memory has notable limitations (e.g., forgetting) which have necessitated a variety of memory aids (e.g., calendars). As we grow closer to mass adoption of everyday Extended Reality (XR), which is frequently leveraging perceptual limitations (e.g., redirected walking), it becomes pertinent to consider how XR could leverage memory limitations (forgetting, distorting, persistence) to induce memory manipulations. As memories highly impact our self-perception, social interactions, and behaviors, there is a pressing need to understand XR Memory Manipulations (XRMMs). We ran three speculative design workshops (n=12), with XR and memory researchers creating 48 XRMM scenarios. Through thematic analysis, we define XRMMs, present a framework of their core components and reveal three classes (at encoding, pre-retrieval, at retrieval). Each class differs in terms of technology (AR/VR) and impact on memory (influencing quality of memories, inducing forgetting, distorting memories). We raise ethical concerns and discuss opportunities of perceptual and memory manipulations in XR.
Moral Agents for Sustainable Transitions: Ethics, Politics, Design
Matthias Laschke (Interaction Design for Sustainability, Transformation, University of Siegen, Siegen, Germany), Amy Bucher (Lirio, Knoxville, Tennessee, United States), Paul Coulton LICA, Lancaster University, Lancaster, United Kingdom), Marc Hassenzahl (Ubiquitous Design / Experience & Interaction, University of Siegen, Siegen, Germany), Lenneke Kuijer (Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands), Carine Lallemand (Department of Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands Human-Computer Interaction research group, University of Luxembourg, Esch-sur-Alzette, Luxembourg, Dan Lockton (Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands), Geke Ludden (Department of Design, Production, Management, University of Twente, Enschede, Netherlands) Sebastian Deterding (Dyson School of Design Engineering, Imperial College, London, United Kingdom)
Abstract | Tags: Workshop | Links:
@inproceedings{Laschke2023Moral,
title = {Moral Agents for Sustainable Transitions: Ethics, Politics, Design},
author = {Matthias Laschke (Interaction Design for Sustainability and Transformation, University of Siegen, Siegen, Germany), Amy Bucher (Lirio, Knoxville, Tennessee, United States), Paul Coulton LICA, Lancaster University, Lancaster, United Kingdom), Marc Hassenzahl (Ubiquitous Design / Experience & Interaction, University of Siegen, Siegen, Germany), Lenneke Kuijer (Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands), Carine Lallemand (Department of Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands Human-Computer Interaction research group, University of Luxembourg, Esch-sur-Alzette, Luxembourg, Dan Lockton (Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands), Geke Ludden (Department of Design, Production and Management, University of Twente, Enschede, Netherlands) Sebastian Deterding (Dyson School of Design Engineering, Imperial College, London, United Kingdom)},
url = {https://www.sustainabilitybydesign.net/, Website},
doi = {10.1145/3544549.3573814},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Artificial moral agents – systems that engage in explicit moral reasoning on their own and with users – present a potential new paradigm for behavior and system change for social and environmental sustainability. Moral agents could replace current individualist, prescriptive, inflexible, and opaque interventions with systems that transparently state their values and then openly deliberate and contest these with users, or agents that represent human and non-human stakeholders such as future generations, species, or ecosystems. Indeed, moral agents could mark a genuine new form of more-than-human interactions and human-technology relation, where we relate to artificial systems as a counterpart. To jointly articulate key questions and possible futures around moral agents, this workshop convenes HCI, AI, behaviour change, and critical and speculative design researchers and practitioners.},
keywords = {Workshop},
pubstate = {published},
tppubtype = {inproceedings}
}
Artificial moral agents – systems that engage in explicit moral reasoning on their own and with users – present a potential new paradigm for behavior and system change for social and environmental sustainability. Moral agents could replace current individualist, prescriptive, inflexible, and opaque interventions with systems that transparently state their values and then openly deliberate and contest these with users, or agents that represent human and non-human stakeholders such as future generations, species, or ecosystems. Indeed, moral agents could mark a genuine new form of more-than-human interactions and human-technology relation, where we relate to artificial systems as a counterpart. To jointly articulate key questions and possible futures around moral agents, this workshop convenes HCI, AI, behaviour change, and critical and speculative design researchers and practitioners.
Never Skip Leg Day Again: Training the Lower Body with Vertical Jumps in a Virtual Reality Exergame
Sebastian Cmentowski (High-Performance Computing, University of Duisburg-Essen, Germany), Sukran Karaosmanoglu (Human-Computer Interaction, Universität Hamburg, Germany), Lennart E. Nacke (HCI Games Group, University of Waterloo, Canada), Frank Steinicke (Human-Computer Interaction, Universität Hamburg, Germany), Jens Krüger (High-Performance Computing, University of Duisburg-Essen, Germany)
Abstract | Tags: Full Paper | Links:
@inproceedings{Cmentowski2023Leg,
title = {Never Skip Leg Day Again: Training the Lower Body with Vertical Jumps in a Virtual Reality Exergame},
author = {Sebastian Cmentowski (High-Performance Computing, University of Duisburg-Essen, Germany), Sukran Karaosmanoglu (Human-Computer Interaction, Universität Hamburg, Germany), Lennart E. Nacke (HCI Games Group, University of Waterloo, Canada), Frank Steinicke (Human-Computer Interaction, Universität Hamburg, Germany), Jens Krüger (High-Performance Computing, University of Duisburg-Essen, Germany)},
url = {https://www.jens-krueger.com, Website
www.twitter.com/uhhhci, twitter
www.inf.uni-hamburg.de/en/inst/ab/hci.html, Lab Website
https://uni-duisburg-essen.sciebo.de/s/E6E04mwb5Ywi3xy/download, Teaser Video
},
doi = {10.1145/3544548.3580973},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Virtual Reality (VR) exergames can increase engagement in and motivation for physical activities. Most VR exergames focus on the upper body because many VR setups only track the users' heads and hands. To become a serious alternative to existing exercise programs, VR exergames must provide a balanced workout and train the lower limbs, too. To address this issue, we built a VR exergame focused on vertical jump training to explore full-body exercise applications. To create a safe and effective training, nine domain experts participated in our prototype design. Our mixed-methods study confirms that the jump-centered exercises provided a worthy challenge and positive player experience, indicating long-term retention. Based on our findings, we present five design implications to guide future work: avoid an unintended forward drift, consider technical constraints, address safety concerns in full-body VR exergames, incorporate rhythmic elements with fluent movement patterns, adapt difficulty to players' fitness progression status.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Virtual Reality (VR) exergames can increase engagement in and motivation for physical activities. Most VR exergames focus on the upper body because many VR setups only track the users' heads and hands. To become a serious alternative to existing exercise programs, VR exergames must provide a balanced workout and train the lower limbs, too. To address this issue, we built a VR exergame focused on vertical jump training to explore full-body exercise applications. To create a safe and effective training, nine domain experts participated in our prototype design. Our mixed-methods study confirms that the jump-centered exercises provided a worthy challenge and positive player experience, indicating long-term retention. Based on our findings, we present five design implications to guide future work: avoid an unintended forward drift, consider technical constraints, address safety concerns in full-body VR exergames, incorporate rhythmic elements with fluent movement patterns, adapt difficulty to players' fitness progression status.
ONYX: Assisting Users in Teaching Natural Language Interfaces Through Multi-Modal Interactive Task Learning
Marcel Ruoff (Karlsruhe Institute of Technology), Brad A. Myers (Carnegie Mellon University), Alexander Maedche (Karlsruhe Institute of Technology)
Abstract | Tags: Full Paper | Links:
@inproceedings{Ruoff2023Onyxb,
title = {ONYX: Assisting Users in Teaching Natural Language Interfaces Through Multi-Modal Interactive Task Learning},
author = {Marcel Ruoff (Karlsruhe Institute of Technology), Brad A. Myers (Carnegie Mellon University), Alexander Maedche (Karlsruhe Institute of Technology)},
url = {https://h-lab.iism.kit.edu/, Website},
doi = {10.1145/3544548.3580964},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Users are increasingly empowered to personalize natural language interfaces (NLIs) by teaching how to handle new natural language (NL) inputs. However, our formative study found that when teaching new NL inputs, users require assistance in clarifying ambiguities that arise and want insight into which parts of the input the NLI understands. In this paper we introduce ONYX, an intelligent agent that interactively learns new NL inputs by combining NL programming and programming-by-demonstration, also known as multi-modal interactive task learning. To address the aforementioned challenges, ONYX provides suggestions on how ONYX could handle new NL inputs based on previously learned concepts or user-defined procedures, and poses follow-up questions to clarify ambiguities in user demonstrations, using visual and textual aids to clarify the connections. Our evaluation shows that users provided with ONYX’s new features achieved significantly higher accuracy in teaching new NL inputs (median: 93.3%) in contrast to those without (median: 73.3%).},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Users are increasingly empowered to personalize natural language interfaces (NLIs) by teaching how to handle new natural language (NL) inputs. However, our formative study found that when teaching new NL inputs, users require assistance in clarifying ambiguities that arise and want insight into which parts of the input the NLI understands. In this paper we introduce ONYX, an intelligent agent that interactively learns new NL inputs by combining NL programming and programming-by-demonstration, also known as multi-modal interactive task learning. To address the aforementioned challenges, ONYX provides suggestions on how ONYX could handle new NL inputs based on previously learned concepts or user-defined procedures, and poses follow-up questions to clarify ambiguities in user demonstrations, using visual and textual aids to clarify the connections. Our evaluation shows that users provided with ONYX’s new features achieved significantly higher accuracy in teaching new NL inputs (median: 93.3%) in contrast to those without (median: 73.3%).
PEARL: Physical Environment based Augmented Reality Lenses for In-Situ Human Movement Analysis
Weizhou Luo (Interactive Media Lab Dresden, Technische Universität Dresden), Zhongyuan Yu (Immersive Experience Lab, Technische Universität Dresden), Rufat Rzayev (Interactive Media Lab Dresden, Technische Universität Dresden), Marc Satkowski (Interactive Media Lab Dresden, Technische Universität Dresden, Centre for Scalable Data Analytics, Artificial Intelligence (ScaDS.AI)), Stefan Gumhold (Computer Graphics, Visualization, Technische Universität Dresden, Germany Centre for Tactile Internet with Human-in-the-Loop, Centre for Scalable Data Analytics, Artificial Intelligence (ScaDS.AI)), Matthew McGinity (Immersive Experience Lab, Technische Universität Dresden), Raimund Dachselt (Interactive Media Lab Dresden, Technische Universität Dresden, Germany Centre for Tactile Internet with Human-in-the-Loop (CeTI), Centre for Scalable Data Analytics, Artificial Intelligence (ScaDS.AI)))
Abstract | Tags: | Links:
@inproceedings{Luo2023Pearl,
title = {PEARL: Physical Environment based Augmented Reality Lenses for In-Situ Human Movement Analysis},
author = {Weizhou Luo (Interactive Media Lab Dresden, Technische Universität Dresden), Zhongyuan Yu (Immersive Experience Lab, Technische Universität Dresden), Rufat Rzayev (Interactive Media Lab Dresden, Technische Universität Dresden), Marc Satkowski (Interactive Media Lab Dresden, Technische Universität Dresden, Centre for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI)), Stefan Gumhold (Computer Graphics and Visualization, Technische Universität Dresden, Germany Centre for Tactile Internet with Human-in-the-Loop, Centre for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI)), Matthew McGinity (Immersive Experience Lab, Technische Universität Dresden), Raimund Dachselt (Interactive Media Lab Dresden, Technische Universität Dresden, Germany Centre for Tactile Internet with Human-in-the-Loop (CeTI), Centre for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI)))},
doi = {10.1145/3544548.3580715},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {This paper presents PEARL, a mixed-reality approach for the analysis of human movement data in situ. As the physical environment shapes human motion and behavior, the analysis of such motion can benefit from the direct inclusion of the environment in the analytical process. We present methods for exploring movement data in relation to surrounding regions of interest, such as objects, furniture, and architectural elements. We introduce concepts for selecting and filtering data through direct interaction with the environment, and a suite of visualizations for revealing aggregated and emergent spatial and temporal relations. More sophisticated analysis is supported through complex queries comprising multiple regions of interest. To illustrate the potential of PEARL, we developed an Augmented Reality-based prototype and conducted expert review sessions and scenario walkthroughs in a simulated exhibition. Our contribution lays the foundation for leveraging the physical environment in the in-situ analysis of movement data.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
This paper presents PEARL, a mixed-reality approach for the analysis of human movement data in situ. As the physical environment shapes human motion and behavior, the analysis of such motion can benefit from the direct inclusion of the environment in the analytical process. We present methods for exploring movement data in relation to surrounding regions of interest, such as objects, furniture, and architectural elements. We introduce concepts for selecting and filtering data through direct interaction with the environment, and a suite of visualizations for revealing aggregated and emergent spatial and temporal relations. More sophisticated analysis is supported through complex queries comprising multiple regions of interest. To illustrate the potential of PEARL, we developed an Augmented Reality-based prototype and conducted expert review sessions and scenario walkthroughs in a simulated exhibition. Our contribution lays the foundation for leveraging the physical environment in the in-situ analysis of movement data.
Playful Reflection: Impact of Gamification on a Virtual Reality Simulation of Breastfeeding
Kymeng Tang (KU Leuven), Kathrin Gerling (KIT), Vero Vanden Abeele (KU Leuven), Luc Geurts (KU Leuven), Maria Aufheimer (KIT)
Abstract | Tags: Full Paper | Links:
@inproceedings{Tang2023Playful,
title = {Playful Reflection: Impact of Gamification on a Virtual Reality Simulation of Breastfeeding},
author = {Kymeng Tang (KU Leuven), Kathrin Gerling (KIT), Vero Vanden Abeele (KU Leuven), Luc Geurts (KU Leuven), Maria Aufheimer (KIT)},
url = {https://hci.anthropomatik.kit.edu/, Website},
doi = {10.1145/3544548.3580751},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Gamification is a popular technique to improve task engagement, and has broadly been deployed in health and education to a point where many users now expect gameful experiences in these settings. However, gamification has been criticised for being a potential obstacle to the experience of reflection. Motivated by this tension, our work examines how the addition of gamification to a Virtual Reality simulation of breastfeeding impacts player experience and reflection. Using a within-subjects design, we invited 34 participants to take part in a mixed-methods evaluation of a gamified and non-gamified variant of the simulation that included questionnaires and semi-structured interviews. Results show that gamification improved player experience and encouraged players to reflect on goal achievement and performance. However, it also diverted players' attention from nuances within the act of nursing. Drawing on our findings, we contribute considerations for the application of gamification in personal and sensitive settings such as breastfeeding.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Gamification is a popular technique to improve task engagement, and has broadly been deployed in health and education to a point where many users now expect gameful experiences in these settings. However, gamification has been criticised for being a potential obstacle to the experience of reflection. Motivated by this tension, our work examines how the addition of gamification to a Virtual Reality simulation of breastfeeding impacts player experience and reflection. Using a within-subjects design, we invited 34 participants to take part in a mixed-methods evaluation of a gamified and non-gamified variant of the simulation that included questionnaires and semi-structured interviews. Results show that gamification improved player experience and encouraged players to reflect on goal achievement and performance. However, it also diverted players' attention from nuances within the act of nursing. Drawing on our findings, we contribute considerations for the application of gamification in personal and sensitive settings such as breastfeeding.
Point Cloud Alignment through Mid-Air Gestures on a Stereoscopic Display
Katja Krug (Interactive Media Lab Dresden, Technische Universität Dresden, Germany), Marc Satkowski (Interactive Media Lab Dresden, Technische Universität Dresden, Germany), Reuben Docea (Translational Surgical Oncology, National Center for Tumor Diseases Dresden, Germany), Tzu-Yu Ku (Interactive Media Lab Dresden, Technische Universität Dresden, Germany), Raimund Dachselt (Interactive Media Lab Dresden, Technische Universität Dresden, Germany)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Krug2023Point,
title = {Point Cloud Alignment through Mid-Air Gestures on a Stereoscopic Display},
author = {Katja Krug (Interactive Media Lab Dresden, Technische Universität Dresden, Germany), Marc Satkowski (Interactive Media Lab Dresden, Technische Universität Dresden, Germany), Reuben Docea (Translational Surgical Oncology, National Center for Tumor Diseases Dresden, Germany), Tzu-Yu Ku (Interactive Media Lab Dresden, Technische Universität Dresden, Germany), Raimund Dachselt (Interactive Media Lab Dresden, Technische Universität Dresden, Germany)},
url = {https://imld.de/, Website
https://twitter.com/imldresden, twitter},
doi = {10.1145/3544549.3585862},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Manual point cloud registration is often a crucial step during the mapping of 3D point clouds and usually performed on a conventional desktop setup with mouse interaction. Since 3D point clouds are inherently spatial, these 2D applications suffer from impaired depth perception and inconvenient interaction. Nonetheless, there are few efforts to improve the usability of these applications. To address this, we propose an alternative setup, consisting of a stereoscopic display and an external hand tracker, allowing for enhanced depth perception and natural interaction without the need for body-worn devices or handheld controllers. We developed interaction techniques for point cloud alignment in 3D space, including visual feedback during alignment, and implemented a proof-of-concept prototype in the context of a surgical use case. We describe the use case, design and implementation of our concepts and outline future work. Herewith we provide a user-centered alternative to desktop applications for manual point cloud registration.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Manual point cloud registration is often a crucial step during the mapping of 3D point clouds and usually performed on a conventional desktop setup with mouse interaction. Since 3D point clouds are inherently spatial, these 2D applications suffer from impaired depth perception and inconvenient interaction. Nonetheless, there are few efforts to improve the usability of these applications. To address this, we propose an alternative setup, consisting of a stereoscopic display and an external hand tracker, allowing for enhanced depth perception and natural interaction without the need for body-worn devices or handheld controllers. We developed interaction techniques for point cloud alignment in 3D space, including visual feedback during alignment, and implemented a proof-of-concept prototype in the context of a surgical use case. We describe the use case, design and implementation of our concepts and outline future work. Herewith we provide a user-centered alternative to desktop applications for manual point cloud registration.
Point of no Undo: Irreversible Interactions as a Design Strategy
Beat Rossmy (LMU Munich), Nađa Terzimehić (LMU Munich), Tanja Döring (University of Bremen), Daniel Buschek (University of Bayreuth), Alexander Wiethoff (LMU Munich)
Abstract | Tags: Full Paper | Links:
@inproceedings{Rossmy2023Undo,
title = {Point of no Undo: Irreversible Interactions as a Design Strategy},
author = {Beat Rossmy (LMU Munich), Nađa Terzimehić (LMU Munich), Tanja Döring (University of Bremen), Daniel Buschek (University of Bayreuth), Alexander Wiethoff (LMU Munich)},
doi = {https://doi.org/10.1145/3544548.3581433},
year = {2023},
date = {2023-04-28},
publisher = {ACM},
abstract = {Despite irreversibility being omnipresent in the lifeworld, research on irreversibility in computing systems has been surprisingly sparse. In fact, user freedom – provided by the undo functionality – is considered to be a pillar of "usable" computer systems, overcoming irreversibility. Within this paper, we set up a thought experiment, challenging the "undo feature" and instead take advantage of irreversibility in the interaction with physical computing systems (tangibles, robots, etc). First, we present three exploratory design speculations, each inherently utilizing irreversibility. Second, we elaborate on the concept of irreversible interactions by contextualizing our work with critical HCI discourses and deducing three design strategies. Finally, we discuss irreversibility as a design element for self-reflection, meaningful acting, and a sustainable relationship with technology. While previously single aspects of irreversibility have been explored, we contribute the first comprehensive discussion of irreversible interactions in HCI presenting artifacts, a conceptualization, design strategies, and application purposes.
},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Despite irreversibility being omnipresent in the lifeworld, research on irreversibility in computing systems has been surprisingly sparse. In fact, user freedom – provided by the undo functionality – is considered to be a pillar of "usable" computer systems, overcoming irreversibility. Within this paper, we set up a thought experiment, challenging the "undo feature" and instead take advantage of irreversibility in the interaction with physical computing systems (tangibles, robots, etc). First, we present three exploratory design speculations, each inherently utilizing irreversibility. Second, we elaborate on the concept of irreversible interactions by contextualizing our work with critical HCI discourses and deducing three design strategies. Finally, we discuss irreversibility as a design element for self-reflection, meaningful acting, and a sustainable relationship with technology. While previously single aspects of irreversibility have been explored, we contribute the first comprehensive discussion of irreversible interactions in HCI presenting artifacts, a conceptualization, design strategies, and application purposes.
Reach Prediction using Finger Motion Dynamics
Dimitar Valkov (Saarland University, Germany; DFKI, Saarland Informatics Campus, Germany), Pascal Kockwelp (Computer Science Department, University of Münster, Germany), Florian Daiber (DFKI, Saarland Informatics Campus, Germany), Antonio Krüger (DFKI, Saarland Informatics Campus, Germany)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Valkov2023Reach,
title = {Reach Prediction using Finger Motion Dynamics},
author = {Dimitar Valkov (Saarland University, Germany; DFKI, Saarland Informatics Campus, Germany), Pascal Kockwelp (Computer Science Department, University of Münster, Germany), Florian Daiber (DFKI, Saarland Informatics Campus, Germany), Antonio Krüger (DFKI, Saarland Informatics Campus, Germany)},
url = {https://umtl.cs.uni-saarland.de/, Website},
doi = {10.1145/3544549.3585773},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {The ability to predict the object the user intends to grasp or to recognize the one she is already holding offers essential contextual information and may help to leverage the effects of point-to-point latency in interactive environments. This paper investigates the feasibility and accuracy of recognizing un-instrumented objects based on hand kinematics during reach-to-grasp and transport actions. In a data collection study, we recorded the hand motions of 16 participants while reaching out to grasp and then moving real and synthetic objects.
Our results demonstrate that even a simple LSTM network can predict the time point at which the user grasps an object with 23 ms precision and the current distance to it with a precision better than 1 cm. The target's size can be determined in advance with an accuracy better than 97%.
Our results have implications for designing adaptive and fine-grained interactive user interfaces in ubiquitous and mixed-reality environments.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
The ability to predict the object the user intends to grasp or to recognize the one she is already holding offers essential contextual information and may help to leverage the effects of point-to-point latency in interactive environments. This paper investigates the feasibility and accuracy of recognizing un-instrumented objects based on hand kinematics during reach-to-grasp and transport actions. In a data collection study, we recorded the hand motions of 16 participants while reaching out to grasp and then moving real and synthetic objects.
Our results demonstrate that even a simple LSTM network can predict the time point at which the user grasps an object with 23 ms precision and the current distance to it with a precision better than 1 cm. The target's size can be determined in advance with an accuracy better than 97%.
Our results have implications for designing adaptive and fine-grained interactive user interfaces in ubiquitous and mixed-reality environments.
Our results demonstrate that even a simple LSTM network can predict the time point at which the user grasps an object with 23 ms precision and the current distance to it with a precision better than 1 cm. The target's size can be determined in advance with an accuracy better than 97%.
Our results have implications for designing adaptive and fine-grained interactive user interfaces in ubiquitous and mixed-reality environments.
SelVReflect: A Guided VR Experience Fostering Reflection on Personal Challenges
Nadine Wagener (University of Bremen), Leon Reicherts (University College London), Nima Zargham (University of Bremen), Natalia Bartłomiejczyk (Lodz University of Technology), Ava Elizabeth Scott (University College London), Katherine Wang (University College London), Marit Bentvelzen (Utrecht University), Evropi Stefanidi (University of Bremen), Thomas Mildner (University of Bremen), Yvonne Rogers (University College London), Jasmin Niess (University of St. Gallen, University of Oslo)
Abstract | Tags: Full Paper | Links:
@inproceedings{Wagener2023SelVReflect,
title = {SelVReflect: A Guided VR Experience Fostering Reflection on Personal Challenges},
author = {Nadine Wagener (University of Bremen), Leon Reicherts (University College London), Nima Zargham (University of Bremen), Natalia Bartłomiejczyk (Lodz University of Technology), Ava Elizabeth Scott (University College London), Katherine Wang (University College London), Marit Bentvelzen (Utrecht University), Evropi Stefanidi (University of Bremen), Thomas Mildner (University of Bremen), Yvonne Rogers (University College London), Jasmin Niess (University of St. Gallen, University of Oslo)},
url = {https://hci.uni-bremen.de/, Website
https://twitter.com/hcibremen, twitter
https://www.instagram.com/hcibremen, instagram},
doi = {10.1145/3544548.3580763},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Reflecting on personal challenges can be difficult. Without encouragement, the reflection process often remains superficial, thus inhibiting deeper understanding and learning from past experiences. To allow people to immerse themselves in and deeply reflect on past challenges, we developed SelVReflect, a VR experience which offers active voice-based guidance and a space to freely express oneself. SelVReflect was developed in an iterative design process (N=5) and evaluated in a user study with N=20 participants. We found that SelVReflect enabled participants to approach their challenge and its (emotional) components from different perspectives and discover new relationships between these components. By making use of the spatial possibilities in VR, they got a better understanding of the situation and of themselves. We contribute empirical evidence of how a guided VR experience can support reflection. We discuss opportunities and design requirements for guided VR experiences that aim to foster deeper reflection.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Reflecting on personal challenges can be difficult. Without encouragement, the reflection process often remains superficial, thus inhibiting deeper understanding and learning from past experiences. To allow people to immerse themselves in and deeply reflect on past challenges, we developed SelVReflect, a VR experience which offers active voice-based guidance and a space to freely express oneself. SelVReflect was developed in an iterative design process (N=5) and evaluated in a user study with N=20 participants. We found that SelVReflect enabled participants to approach their challenge and its (emotional) components from different perspectives and discover new relationships between these components. By making use of the spatial possibilities in VR, they got a better understanding of the situation and of themselves. We contribute empirical evidence of how a guided VR experience can support reflection. We discuss opportunities and design requirements for guided VR experiences that aim to foster deeper reflection.
Short-Form Videos Degrade Our Capacity to Retain Intentions: Effect of Context Switching On Prospective Memory
Francesco Chiossi (LMU Munich), Luke Haliburton (LMU Munich), Changkun Ou (LMU Munich), Andreas Butz (LMU Munich), Albrecht Schmidt (LMU Munich)
Abstract | Tags: Full Paper | Links:
@inproceedings{Chiossi2023Short,
title = {Short-Form Videos Degrade Our Capacity to Retain Intentions: Effect of Context Switching On Prospective Memory},
author = {Francesco Chiossi (LMU Munich), Luke Haliburton (LMU Munich), Changkun Ou (LMU Munich), Andreas Butz (LMU Munich), Albrecht Schmidt (LMU Munich)},
url = {https://www.linkedin.com/in/francescochiossi/, LinkedIn
https://twitter.com/francescochios3, twitter
https://www.instagram.com/p/Co9ZUlGAa-l/, Teaser Video},
doi = {10.1145/3544548.3580778},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Social media platforms use short, highly engaging videos to catch users' attention. While the short-form video feeds popularized by TikTok are rapidly spreading to other platforms, we do not yet understand their impact on cognitive functions. We conducted a between-subjects experiment (N=60) investigating the impact of engaging with TikTok, Twitter, and YouTube while performing a Prospective Memory task (i.e., executing a previously planned action). The study required participants to remember intentions over interruptions. We found that the TikTok condition significantly degraded the users’ performance in this task. As none of the other conditions (Twitter, YouTube, no activity) had a similar effect, our results indicate that the combination of short videos and rapid context-switching impairs intention recall and execution. We contribute a quantified understanding of the effect of media feed formats on Prospective Memory and outline consequences for media technology designers to not harm the users’ memory and wellbeing.
},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Social media platforms use short, highly engaging videos to catch users' attention. While the short-form video feeds popularized by TikTok are rapidly spreading to other platforms, we do not yet understand their impact on cognitive functions. We conducted a between-subjects experiment (N=60) investigating the impact of engaging with TikTok, Twitter, and YouTube while performing a Prospective Memory task (i.e., executing a previously planned action). The study required participants to remember intentions over interruptions. We found that the TikTok condition significantly degraded the users’ performance in this task. As none of the other conditions (Twitter, YouTube, no activity) had a similar effect, our results indicate that the combination of short videos and rapid context-switching impairs intention recall and execution. We contribute a quantified understanding of the effect of media feed formats on Prospective Memory and outline consequences for media technology designers to not harm the users’ memory and wellbeing.
SparseIMU: Computational Design of Sparse IMU Layouts for Sensing Fine-Grained Finger Microgestures
Adwait Sharma (Saarland University, Saarland Informatics Campus, Germany), Christina Salchow-Hömmen (Department of Neurology, Charité-Universitätsmedizin Berlin, Germany & Control Systems Group, Technische Universität Berlin, Germany), Vimal Suresh Mollyn (Saarland University, Saarland Informatics Campus, Germany), Aditya Shekhar Nittala (Saarland University, Saarland Informatics Campus, Germany), Michael A. Hedderich (Saarland University, Saarland Informatics Campus, Germany), Marion Koelle (Saarland University, Saarland Informatics Campus, Germany), Thomas Seel (Control Systems Group, Technische Universität Berlin, Germany & Department of AI in Biomedical Engineering, FAU Erlangen-Nürnberg, Germany), Jürgen Steimle (Saarland University, Saarland Informatics Campus, Germany)
Abstract | Tags: Interactivity/Demonstration, Journal | Links:
@inproceedings{Sharma2023SparseIMU,
title = {SparseIMU: Computational Design of Sparse IMU Layouts for Sensing Fine-Grained Finger Microgestures},
author = {Adwait Sharma (Saarland University, Saarland Informatics Campus, Germany), Christina Salchow-Hömmen (Department of Neurology, Charité-Universitätsmedizin Berlin, Germany & Control Systems Group, Technische Universität Berlin, Germany), Vimal Suresh Mollyn (Saarland University, Saarland Informatics Campus, Germany), Aditya Shekhar Nittala (Saarland University, Saarland Informatics Campus, Germany), Michael A. Hedderich (Saarland University, Saarland Informatics Campus, Germany), Marion Koelle (Saarland University, Saarland Informatics Campus, Germany), Thomas Seel (Control Systems Group, Technische Universität Berlin, Germany & Department of AI in Biomedical Engineering, FAU Erlangen-Nürnberg, Germany), Jürgen Steimle (Saarland University, Saarland Informatics Campus, Germany)},
url = {https://hci.cs.uni-saarland.de/, Website
https://twitter.com/HCI_Saarland, twitter},
doi = {10.1145/3569894},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Gestural interaction with freehands and while grasping an everyday object enables always-available input. To sense such gestures, minimal instrumentation of the user's hand is desirable. However, the choice of an effective but minimal IMU layout remains challenging, due to the complexity of the multi-factorial space that comprises diverse finger gestures, objects and grasps. We present SparseIMU, a rapid method for selecting minimal inertial sensor-based layouts for effective gesture recognition. Furthermore, we contribute a computational tool to guide designers with optimal sensor placement. Our approach builds on an extensive microgestures dataset that we collected with a dense network of 17 inertial measurement units (IMUs). We performed a series of analyses, including an evaluation of the entire combinatorial space for freehand and grasping microgestures (393K layouts), and quantified the performance across different layout choices, revealing new gesture detection opportunities with IMUs. Finally, we demonstrate the versatility of our method with four scenarios.},
keywords = {Interactivity/Demonstration, Journal},
pubstate = {published},
tppubtype = {inproceedings}
}
Gestural interaction with freehands and while grasping an everyday object enables always-available input. To sense such gestures, minimal instrumentation of the user's hand is desirable. However, the choice of an effective but minimal IMU layout remains challenging, due to the complexity of the multi-factorial space that comprises diverse finger gestures, objects and grasps. We present SparseIMU, a rapid method for selecting minimal inertial sensor-based layouts for effective gesture recognition. Furthermore, we contribute a computational tool to guide designers with optimal sensor placement. Our approach builds on an extensive microgestures dataset that we collected with a dense network of 17 inertial measurement units (IMUs). We performed a series of analyses, including an evaluation of the entire combinatorial space for freehand and grasping microgestures (393K layouts), and quantified the performance across different layout choices, revealing new gesture detection opportunities with IMUs. Finally, we demonstrate the versatility of our method with four scenarios.
Spatiality and Semantics - Towards Understanding Content Placement in Mixed Reality
Mats Ole Ellenberg (Interactive Media Lab Dresden,Technische Universität Dresden; Centre for Tactile Internet with Human-in-the-Loop (CeTI), Technische Univerität Dresden), Marc Satkowski (Interactive Media Lab Dresden,Technische Universität Dresden; Centre for Scalable Data Analytics, Artificial Intelligence (ScaDS.AI), Dresden/Leipzig), Weizhou Luo (Interactive Media Lab Dresden,Technische Universität Dresden), Raimund Dachselt (Interactive Media Lab Dresden,Technische Universität Dresden; Centre for Tactile Internet with Human-in-the-Loop (CeTI), Technische Univerität Dresden; Centre for Scalable Data Analytics, Artificial Intelligence (ScaDS.AI), Dresden/Leipzig; Cluster of Excellence Physics of Life, Technische Universität Dresden)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Ellenberg2023Spatiality,
title = {Spatiality and Semantics - Towards Understanding Content Placement in Mixed Reality},
author = {Mats Ole Ellenberg (Interactive Media Lab Dresden,Technische Universität Dresden; Centre for Tactile Internet with Human-in-the-Loop (CeTI), Technische Univerität Dresden), Marc Satkowski (Interactive Media Lab Dresden,Technische Universität Dresden; Centre for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI), Dresden/Leipzig), Weizhou Luo (Interactive Media Lab Dresden,Technische Universität Dresden), Raimund Dachselt (Interactive Media Lab Dresden,Technische Universität Dresden; Centre for Tactile Internet with Human-in-the-Loop (CeTI), Technische Univerität Dresden; Centre for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI), Dresden/Leipzig; Cluster of Excellence Physics of Life, Technische Universität Dresden)},
url = {https://imld.de/en/, Website
},
doi = {10.1145/3544549.3585853},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Mixed Reality (MR) popularizes numerous situated applications where virtual content is spatially integrated into our physical environment. However, we only know little about what properties of an environment influence the way how people place digital content and perceive the resulting layout. We thus conducted a preliminary study (N = 8) examining how physical surfaces affect organizing virtual content like documents or charts, focusing on user perception and experience. We found, among others, that the situated layout of virtual content in its environment can be characterized by the level of spatial as well as semantic coupling. Consequently, we propose a two-dimensional design space to establish the vocabularies and detail their parameters for content organization. With our work, we aim to facilitate communication between designers or researchers, inform general MR interface design, and provide a first step towards future MR workspaces empowered by blending digital content and its real-world context.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Mixed Reality (MR) popularizes numerous situated applications where virtual content is spatially integrated into our physical environment. However, we only know little about what properties of an environment influence the way how people place digital content and perceive the resulting layout. We thus conducted a preliminary study (N = 8) examining how physical surfaces affect organizing virtual content like documents or charts, focusing on user perception and experience. We found, among others, that the situated layout of virtual content in its environment can be characterized by the level of spatial as well as semantic coupling. Consequently, we propose a two-dimensional design space to establish the vocabularies and detail their parameters for content organization. With our work, we aim to facilitate communication between designers or researchers, inform general MR interface design, and provide a first step towards future MR workspaces empowered by blending digital content and its real-world context.
Statistically Controlling for Processing Fluency Reduces the Aesthetic-Usability Effect
Jan Preßler (Julius-Maximilians-Universität), Lukas Schmid (Julius-Maximilians-Universität), Jörn Hurtienne (Julius-Maximilians-Universität)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Pressler2023Statistically,
title = {Statistically Controlling for Processing Fluency Reduces the Aesthetic-Usability Effect},
author = {Jan Preßler (Julius-Maximilians-Universität), Lukas Schmid (Julius-Maximilians-Universität), Jörn Hurtienne (Julius-Maximilians-Universität)},
url = {https://www.mcm.uni-wuerzburg.de/psyergo/startseite/, Website
},
doi = {10.1145/3544549.3585739},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {The aesthetic-usability effect asserts that user interfaces that appear aesthetic also appear easier to use. Most explanations for the effect see aesthetics in a causal role. In contrast, we propose that processing fluency as a third variable causes both judgements of aesthetics and usability. Processing fluency refers to the subjective ease of information processing and has been shown to influence, among others, judgements of aesthetics and usability. We tested our proposition in an experiment in which users rated screenshots of city websites. The aesthetic-usability effect was replicated by our data: aesthetics and usability correlated .79. When controlling for fluency, however, the aesthetic-usability effect was considerably diminished; the correlation decreased to .34. Future research will address the limitations of this study by investigating a wider range of website designs and adding interactivity to the interfaces.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
The aesthetic-usability effect asserts that user interfaces that appear aesthetic also appear easier to use. Most explanations for the effect see aesthetics in a causal role. In contrast, we propose that processing fluency as a third variable causes both judgements of aesthetics and usability. Processing fluency refers to the subjective ease of information processing and has been shown to influence, among others, judgements of aesthetics and usability. We tested our proposition in an experiment in which users rated screenshots of city websites. The aesthetic-usability effect was replicated by our data: aesthetics and usability correlated .79. When controlling for fluency, however, the aesthetic-usability effect was considerably diminished; the correlation decreased to .34. Future research will address the limitations of this study by investigating a wider range of website designs and adding interactivity to the interfaces.
Structural Equation Modeling in HCI Research using SEMinR
André Calero Valdez (University of Lübeck), Lilian Kojan (University of Lübeck), Nicholas Danks (Trinity College Dublin), Soumya Ray (National Tsing Hua University)
Abstract | Tags: Course | Links:
@inproceedings{Valdez2023Structural,
title = {Structural Equation Modeling in HCI Research using SEMinR},
author = {André Calero Valdez (University of Lübeck), Lilian Kojan (University of Lübeck), Nicholas Danks (Trinity College Dublin), Soumya Ray (National Tsing Hua University)},
url = {https://www.imis.uni-luebeck.de, Website},
doi = {10.1145/3544549.3574171},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Structural equation models (SEMs) are statistical techniques that help to identify models of latent variables in survey data. This allows researchers to test both the quality of the measurement instrument—the survey—as well as the hypothesized relationships using a single model. Partial least squares structural equation modeling (PLS-SEM) is a subset of SEM that works well with small sample sizes and non-parametric data, which frequently occur in HCI research. In this course, we will provide a short introduction into SEMinR, an open-source library for the R language. SEMinR is an easy-to-use domain-specific language for defining, estimating, visualizing, and validating SEMs using the PLS method. SEMinR provides means for scientific reporting and can be used by academics and practitioners alike.},
keywords = {Course},
pubstate = {published},
tppubtype = {inproceedings}
}
Structural equation models (SEMs) are statistical techniques that help to identify models of latent variables in survey data. This allows researchers to test both the quality of the measurement instrument—the survey—as well as the hypothesized relationships using a single model. Partial least squares structural equation modeling (PLS-SEM) is a subset of SEM that works well with small sample sizes and non-parametric data, which frequently occur in HCI research. In this course, we will provide a short introduction into SEMinR, an open-source library for the R language. SEMinR is an easy-to-use domain-specific language for defining, estimating, visualizing, and validating SEMs using the PLS method. SEMinR provides means for scientific reporting and can be used by academics and practitioners alike.
Supervising Multiple Operating Rooms Using a Head-Worn display: A Longitudinal Evaluation of the Experience of Supervising Anesthesiologists and Their Co-Workers
Tobias Grundgeiger (University of Würzburg, Germany) Alea Münz (University Hospital Würzburg, Germany) Paul Schlosser (The University of Queensland, Australia) Oliver Happel (University Hospital Würzburg, Germany)
Abstract | Tags: Full Paper | Links:
@inproceedings{Grundgeiger2023head,
title = {Supervising Multiple Operating Rooms Using a Head-Worn display: A Longitudinal Evaluation of the Experience of Supervising Anesthesiologists and Their Co-Workers },
author = {Tobias Grundgeiger (University of Würzburg, Germany)
Alea Münz (University Hospital Würzburg, Germany)
Paul Schlosser (The University of Queensland, Australia)
Oliver Happel (University Hospital Würzburg, Germany)},
url = {https://www.mcm.uni-wuerzburg.de/psyergo/startseite/, Webseite},
doi = {10.1145/3544548.3581180},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Research has explored head-worn displays (HWD) in various professional contexts. However, evaluations have been limited by short-term use, a focus on the person using the HWD, and on performance variables. In a field study, we evaluated a monocular, opaque HWD for multi-patient monitoring, which supervising anesthesiologists wore for 8-10 days each. We investigated the effect of prolonged HWD use on the experience of the supervising anesthesiologists and their co-workers using interviews and repeated observations. A reflexive thematic analysis showed (1) interaction and mindset changes over time, (2) information on the HWD is more than numbers, (3) the HWD affects co-workers' collaboration with supervisors, and (4) distraction depends on the point of view. Using activity theory, we discuss the fact that HWD use develops and changes over time and that even a single-user HWD influences the collaboration with co-workers. We conclude with implications for HWD design, implementation, and evaluation.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Research has explored head-worn displays (HWD) in various professional contexts. However, evaluations have been limited by short-term use, a focus on the person using the HWD, and on performance variables. In a field study, we evaluated a monocular, opaque HWD for multi-patient monitoring, which supervising anesthesiologists wore for 8-10 days each. We investigated the effect of prolonged HWD use on the experience of the supervising anesthesiologists and their co-workers using interviews and repeated observations. A reflexive thematic analysis showed (1) interaction and mindset changes over time, (2) information on the HWD is more than numbers, (3) the HWD affects co-workers' collaboration with supervisors, and (4) distraction depends on the point of view. Using activity theory, we discuss the fact that HWD use develops and changes over time and that even a single-user HWD influences the collaboration with co-workers. We conclude with implications for HWD design, implementation, and evaluation.
Sustainability by Design. How to Encourage Users to Choose Energy-Saving Programs and Settings when Washing Laundry
Laura Grönewald (Interaction Design for Sustainability, Transformation, University of Siegen, Siegen, Germany), Julian Weiblen (Interaction Design for Sustainability, Transformation, University of Siegen, Siegen, Germany), Matthias Laschke (Interaction Design for Sustainability, Transformation, University of Siegen, Siegen, Germany, Lara Christoforakos (Department Psychology, Ludwig-Maximilians-University, Munich, Bavaria, Germany), Marc Hassenzahl (Ubiquitous Design / Experience & Interaction, University of Siegen, Siegen, Germany)
Abstract | Tags: Full Paper | Links:
@inproceedings{Groenewald2023Sustainability,
title = {Sustainability by Design. How to Encourage Users to Choose Energy-Saving Programs and Settings when Washing Laundry},
author = {Laura Grönewald (Interaction Design for Sustainability and Transformation, University of Siegen, Siegen, Germany), Julian Weiblen (Interaction Design for Sustainability and Transformation, University of Siegen, Siegen, Germany), Matthias Laschke (Interaction Design for Sustainability and Transformation, University of Siegen, Siegen, Germany, Lara Christoforakos (Department Psychology, Ludwig-Maximilians-University, Munich, Bavaria, Germany), Marc Hassenzahl (Ubiquitous Design / Experience & Interaction, University of Siegen, Siegen, Germany)},
url = {https://www.sustainabilitybydesign.net/, Website
https://uni-siegen.sciebo.de/s/yddfaDaei0RDvev, Teaser Video
https://uni-siegen.sciebo.de/s/P3XuXZxKmYztHYj, Full Video},
doi = {10.1145/3544548.3581150},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {One way to counteract anthropogenic climate change, is to reduce individual energy consumption. An especially energy-intensive everyday practice is doing the laundry. In Germany, laundry accounts for about 5% of domestic electricity consumption. In part, this is because users do not make use of the energy-saving programs offered by modern washing machines. Based on different principles of behavior change, we created four concepts for washing machine interfaces to encourage users to choose energy-saving programs and settings. These concepts were implemented as functional prototypes. An online experiment (N=400) showed that all concepts increased the choice of energy-saving programs compared to a standard machine. Especially effective was to interrupt impulsive actions and suggest alternative choices (concept B) and to restructure the entry of settings (concept E). This demonstrates how small changes in a standard interfaces can significantly increase the probability of energy conservation in a private setting.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
One way to counteract anthropogenic climate change, is to reduce individual energy consumption. An especially energy-intensive everyday practice is doing the laundry. In Germany, laundry accounts for about 5% of domestic electricity consumption. In part, this is because users do not make use of the energy-saving programs offered by modern washing machines. Based on different principles of behavior change, we created four concepts for washing machine interfaces to encourage users to choose energy-saving programs and settings. These concepts were implemented as functional prototypes. An online experiment (N=400) showed that all concepts increased the choice of energy-saving programs compared to a standard machine. Especially effective was to interrupt impulsive actions and suggest alternative choices (concept B) and to restructure the entry of settings (concept E). This demonstrates how small changes in a standard interfaces can significantly increase the probability of energy conservation in a private setting.
Tailor Twist: Assessing Rotational Mid-Air Interactions for Augmented Reality
Dominik Schön (Technical University of Darmstadt), Thomas Kosch (HU Berlin), Florian Müller (LMU Munich), Martin Schmitz (Saarland Informatics Campus), Sebastian Günther (Technical University of Darmstadt), Lukas Bommhardt (Technical University of Darmstadt), Max Mühlhäuser (Technical University of Darmstadt)
Abstract | Tags: Full Paper | Links:
@inproceedings{Schoen2023Tailor,
title = {Tailor Twist: Assessing Rotational Mid-Air Interactions for Augmented Reality},
author = {Dominik Schön (Technical University of Darmstadt), Thomas Kosch (HU Berlin), Florian Müller (LMU Munich), Martin Schmitz (Saarland Informatics Campus), Sebastian Günther (Technical University of Darmstadt), Lukas Bommhardt (Technical University of Darmstadt), Max Mühlhäuser (Technical University of Darmstadt)},
url = {https://teamdarmstadt.de/, Website
https://youtu.be/FqFr_Eeh1dY, Teaser Video
https://youtu.be/K3q7uDyGu2o, Full Video},
doi = {10.1145/3544548.3581461},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Mid-air gestures, widely used in today's Augmented Reality applications, are prone to the "gorilla arm" effect, leading to discomfort with prolonged interactions. While prior work has proposed metrics to quantify this effect and means to improve comfort and ergonomics, these works usually only consider simplistic, one-dimensional AR interactions, like reaching for a point or pushing a button. However, interacting with AR environments also involves far more complex tasks, such as rotational knobs, potentially impacting ergonomics. This paper advances the understanding of the ergonomics of rotational mid-air interactions in AR. For this, we contribute the results of a controlled experiment exposing the participants to a rotational task in the interaction space defined by their arms' reach. Based on the results, we discuss how novel future mid-air gesture modalities benefit from our findings concerning ergonomic-aware rotational interaction.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Mid-air gestures, widely used in today's Augmented Reality applications, are prone to the "gorilla arm" effect, leading to discomfort with prolonged interactions. While prior work has proposed metrics to quantify this effect and means to improve comfort and ergonomics, these works usually only consider simplistic, one-dimensional AR interactions, like reaching for a point or pushing a button. However, interacting with AR environments also involves far more complex tasks, such as rotational knobs, potentially impacting ergonomics. This paper advances the understanding of the ergonomics of rotational mid-air interactions in AR. For this, we contribute the results of a controlled experiment exposing the participants to a rotational task in the interaction space defined by their arms' reach. Based on the results, we discuss how novel future mid-air gesture modalities benefit from our findings concerning ergonomic-aware rotational interaction.
Text Me if You Can: Investigating Text Input Methods for Cyclists
Andrii Matviienko (KTH Royal Institute of Technology, Sweden), Jean-Baptiste Durand-Pierre (Technical University of Darmstadt, Germany), Jona Cvancar (Technical University of Darmstadt, Germany), Max Mühlhäuser (Technical University of Darmstadt, Germany)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Matviienko2023Text,
title = {Text Me if You Can: Investigating Text Input Methods for Cyclists},
author = {Andrii Matviienko (KTH Royal Institute of Technology, Sweden), Jean-Baptiste Durand-Pierre (Technical University of Darmstadt, Germany), Jona Cvancar (Technical University of Darmstadt, Germany), Max Mühlhäuser (Technical University of Darmstadt, Germany)},
url = {https://teamdarmstadt.de/, Website},
doi = {10.1145/3544549.3585734},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Cycling is emerging as a relevant alternative to cars. However, the more people commute by bicycle, the higher the number of cyclists who use their smartphones on the go and endanger road safety. To better understand input while cycling, in this paper, we present the design and evaluation of three text input methods for cyclists: (1) touch input using smartphones, (2) midair input using a Microsoft Hololens 2, and (3) a set of ten physical buttons placed on both sides of the handlebar. We conducted a controlled indoor experiment (N = 12) on a bicycle simulator to evaluate these input methods. We found that text input via touch input was faster and less mentally demanding than input with midair gestures and physical buttons. However, the midair gestures were the least error-prone, and the physical buttons facilitated keeping both hands on the handlebars and were more intuitive and less distracting.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Cycling is emerging as a relevant alternative to cars. However, the more people commute by bicycle, the higher the number of cyclists who use their smartphones on the go and endanger road safety. To better understand input while cycling, in this paper, we present the design and evaluation of three text input methods for cyclists: (1) touch input using smartphones, (2) midair input using a Microsoft Hololens 2, and (3) a set of ten physical buttons placed on both sides of the handlebar. We conducted a controlled indoor experiment (N = 12) on a bicycle simulator to evaluate these input methods. We found that text input via touch input was faster and less mentally demanding than input with midair gestures and physical buttons. However, the midair gestures were the least error-prone, and the physical buttons facilitated keeping both hands on the handlebars and were more intuitive and less distracting.
The Aachen Lab Demo: From Fundamental Perception to Design Tools
Jan Borchers (RWTH Aachen University), Anke Brocker (RWTH Aachen University), Sebastian Hueber (RWTH Aachen University), Oliver Nowak (RWTH Aachen University),; René Schäfer (RWTH Aachen University), Adrian Wagner (RWTH Aachen University), Paul Preuschoff (RWTH Aachen University), Lea Schirp (RWTH Aachen University)
Abstract | Tags: Interactivity/Demonstration | Links:
@inproceedings{Borchers2023Demo,
title = {The Aachen Lab Demo: From Fundamental Perception to Design Tools},
author = {Jan Borchers (RWTH Aachen University), Anke Brocker (RWTH Aachen University), Sebastian Hueber (RWTH Aachen University), Oliver Nowak (RWTH Aachen University),; René Schäfer (RWTH Aachen University), Adrian Wagner (RWTH Aachen University), Paul Preuschoff (RWTH Aachen University), Lea Schirp (RWTH Aachen University)},
url = {https://hci.rwth-aachen.de, Website
https://youtu.be/t5btQe8GECs, Teaser Video
https://youtu.be/26fHE-nev4g, Full Video},
doi = {10.1145/3544549.3583937},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {This year, the Media Computing Group at RWTH Aachen University turns 20. We celebrate this anniversary with a Lab Interactivity Demo at CHI that showcases not past achievements, but the range of currently ongoing research at the lab. It features hands-on interactive demos ranging from fundamental research in perception and cognition with traditional devices, such as experiencing input latency and Dark Patterns, to new input and output techniques beyond the desktop, such as user-perspective rendering in handheld AR and interaction with time-based media through conducting, to physical interfaces and the tools and processes for their design and fabrication, such as textile icons and sliders, soft robotics, and 3D printing fabric-covered objects.},
keywords = {Interactivity/Demonstration},
pubstate = {published},
tppubtype = {inproceedings}
}
This year, the Media Computing Group at RWTH Aachen University turns 20. We celebrate this anniversary with a Lab Interactivity Demo at CHI that showcases not past achievements, but the range of currently ongoing research at the lab. It features hands-on interactive demos ranging from fundamental research in perception and cognition with traditional devices, such as experiencing input latency and Dark Patterns, to new input and output techniques beyond the desktop, such as user-perspective rendering in handheld AR and interaction with time-based media through conducting, to physical interfaces and the tools and processes for their design and fabrication, such as textile icons and sliders, soft robotics, and 3D printing fabric-covered objects.
The Art of Privacy - A Theatrical Privacy Installation in Virtual Reality
Frederike Jung (OFFIS - Institute for Information Technology), Jonah-Noël Kaiser (University of Oldenburg), Kai von Holdt (OFFIS - Institute for Information Technology), Wilko Heuten (OFFIS - Institute for Information Technology), Jochen Meyer (OFFIS - Institute for Information Technology)
Abstract | Tags: Interactivity/Demonstration | Links:
@inproceedings{jung2023privacy,
title = {The Art of Privacy - A Theatrical Privacy Installation in Virtual Reality},
author = {Frederike Jung (OFFIS - Institute for Information Technology), Jonah-Noël Kaiser (University of Oldenburg), Kai von Holdt (OFFIS - Institute for Information Technology), Wilko Heuten (OFFIS - Institute for Information Technology), Jochen Meyer (OFFIS - Institute for Information Technology)},
url = {https://bit.ly/3xmjnJF, Teaser Video},
doi = {10.1145/3544549.3583893},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {In a digitized world, matters of (online) privacy become increasingly immanent in people’s lives. Paradoxically, while consumers claim they care about what happens to their personal data, they undertake little to protect it. Awareness is a crucial step towards making informed privacy decisions. Therefore, we present the Art of Privacy, a Virtual Reality (VR) installation, generated in collaboration with theater artists. This Interactivity immerses viewers into the world of data and unfolds possible consequences of clicking ‘accept’, without reading the terms and conditions or privacy policies. With this work, we contribute an artistic VR installation, designed to shed new light on digital privacy, spark discussions and encourage self-reflection of personal privacy behaviors.},
keywords = {Interactivity/Demonstration},
pubstate = {published},
tppubtype = {inproceedings}
}
In a digitized world, matters of (online) privacy become increasingly immanent in people’s lives. Paradoxically, while consumers claim they care about what happens to their personal data, they undertake little to protect it. Awareness is a crucial step towards making informed privacy decisions. Therefore, we present the Art of Privacy, a Virtual Reality (VR) installation, generated in collaboration with theater artists. This Interactivity immerses viewers into the world of data and unfolds possible consequences of clicking ‘accept’, without reading the terms and conditions or privacy policies. With this work, we contribute an artistic VR installation, designed to shed new light on digital privacy, spark discussions and encourage self-reflection of personal privacy behaviors.
The Entoptic Field Camera as Metaphor-Driven Research-through-Design with AI Technologies
Jesse Josua Benjamin (Department of Philosophy, University of Twente, Enschede, Netherlands Lancaster University, Lancaster, United Kingdom), Heidi Biggs (College of Information Sciences, Technology, The Pennsylvania State University, University Park, Pennsylvania, United States), Arne Berger (Computer Science, Languages, Anhalt University of Applied Sciences, Koethen, Germany), Julija Rukanskaitė (Julija.Works, Malmö, Sweden), Michael B. Heidt (Computer Science, Languages, Anhalt University of Applied Sciences, Koethen, Germany), Nick Merrill (Daylight Lab, Center for Long-Term Cybersecurity, University of California, Berkeley, Berkeley, California, United States), James Pierce (School of Art + Art History + Design, University of Washington Seattle, Seattle, Washington, United States), Joseph Lindley (Lancaster University, Lancaster, Lancashire, United Kingdom)"
Abstract | Tags: Full Paper | Links:
@inproceedings{Jesse2023Enoptic,
title = {The Entoptic Field Camera as Metaphor-Driven Research-through-Design with AI Technologies},
author = {Jesse Josua Benjamin (Department of Philosophy, University of Twente, Enschede, Netherlands Lancaster University, Lancaster, United Kingdom),
Heidi Biggs (College of Information Sciences and Technology, The Pennsylvania State University, University Park, Pennsylvania, United States),
Arne Berger (Computer Science and Languages, Anhalt University of Applied Sciences, Koethen, Germany),
Julija Rukanskaitė (Julija.Works, Malmö, Sweden),
Michael B. Heidt (Computer Science and Languages, Anhalt University of Applied Sciences, Koethen, Germany),
Nick Merrill (Daylight Lab, Center for Long-Term Cybersecurity, University of California, Berkeley, Berkeley, California, United States),
James Pierce (School of Art + Art History + Design, University of Washington Seattle, Seattle, Washington, United States),
Joseph Lindley (Lancaster University, Lancaster, Lancashire, United Kingdom)"},
doi = {10.1145/3544548.3581175},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Artificial intelligence (AI) technologies are widely deployed in smartphone photography; and prompt-based image synthesis models have rapidly become commonplace. In this paper, we describe a Research-through-Design (RtD) project which explores this shift in the means and modes of image production via the creation and use of the Entoptic Field Camera. Entoptic phenomena usually refer to perceptions of floaters or bright blue dots stemming from the physiological interplay of the eye and brain. We use the term entoptic as a metaphor to investigate how the material interplay of data and models in AI technologies shapes human experiences of reality. Through our case study using first-person design and a field study, we offer implications for critical, reflective, more-than-human and ludic design to engage AI technologies; the conceptualisation of an RtD research space which contributes to AI literacy discourses; and outline a research trajectory concerning materiality and design affordances of AI technologies.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Artificial intelligence (AI) technologies are widely deployed in smartphone photography; and prompt-based image synthesis models have rapidly become commonplace. In this paper, we describe a Research-through-Design (RtD) project which explores this shift in the means and modes of image production via the creation and use of the Entoptic Field Camera. Entoptic phenomena usually refer to perceptions of floaters or bright blue dots stemming from the physiological interplay of the eye and brain. We use the term entoptic as a metaphor to investigate how the material interplay of data and models in AI technologies shapes human experiences of reality. Through our case study using first-person design and a field study, we offer implications for critical, reflective, more-than-human and ludic design to engage AI technologies; the conceptualisation of an RtD research space which contributes to AI literacy discourses; and outline a research trajectory concerning materiality and design affordances of AI technologies.
The Fits’ Law Filter Bubble
Heiko Drewes (LMU Munich)
Abstract | Tags: alt.chi | Links:
@inproceedings{Drewes2023Fits,
title = {The Fits’ Law Filter Bubble},
author = {Heiko Drewes (LMU Munich)},
doi = {10.1145/3544549.3582739},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Fitts derived a formula that allows one to calculate the time it takes to hit a target of a given size. MacKenzie called this formula imperfect and suggested an alternative formula. This paper asks some simple questions about MacKenzie's theory. If the human-computer interaction (HCI) community does not have satisfying answers, it means that MacKenzie's formula is unfounded. In consequence, the HCI community should stop using and citing MacKenzie's formula and use Fitts' original formula instead and only when necessary.
Additionally, the HCI community should review the Fitts' Law research of the last 35 years concerning criteria that indicate an echo chamber and a filter bubble and debate whether they want to publish papers based on information theory in the future.},
keywords = {alt.chi},
pubstate = {published},
tppubtype = {inproceedings}
}
Fitts derived a formula that allows one to calculate the time it takes to hit a target of a given size. MacKenzie called this formula imperfect and suggested an alternative formula. This paper asks some simple questions about MacKenzie's theory. If the human-computer interaction (HCI) community does not have satisfying answers, it means that MacKenzie's formula is unfounded. In consequence, the HCI community should stop using and citing MacKenzie's formula and use Fitts' original formula instead and only when necessary.
Additionally, the HCI community should review the Fitts' Law research of the last 35 years concerning criteria that indicate an echo chamber and a filter bubble and debate whether they want to publish papers based on information theory in the future.
Additionally, the HCI community should review the Fitts' Law research of the last 35 years concerning criteria that indicate an echo chamber and a filter bubble and debate whether they want to publish papers based on information theory in the future.
The Influence of Context on Response to Spear-Phishing Attacks: an In-Situ Deception Study
Verena Distler (University of Luxembourg, University of the Bundeswehr Munich, Germany)
Abstract | Tags: Full Paper | Links:
@inproceedings{Distler2023Spear,
title = {The Influence of Context on Response to Spear-Phishing Attacks: an In-Situ Deception Study},
author = {Verena Distler (University of Luxembourg, University of the Bundeswehr Munich, Germany) },
url = {https://www.unibw.de/usable-security-and-privacy, Website
},
doi = {10. 1145/3544548.3581170},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {In today's digitized societies, phishing attacks are a security threat with damaging consequences. Organizations remain vulnerable to phishing attacks, and it is not clear how the work context influences people’s perceptions and behaviors related to phishing attempts. I investigate (1) how contextual factors influence reactions to a spear-phishing attempt, (2) why people report or do not report phishing attempts, (3) which opportunities for security-enhancing interventions people identify. I use an in-situ deception methodology to observe participants (N=14) in their realistic work environment. I triangulate observational and self-reported data to obtain rich qualitative insights into participants’ emotions, thoughts, and actions when receiving a targeted phishing email. I find that task, IT, internal and social context play an important role. The email's request being aligned with expectations and perceived time pressure when responding to emails were associated with insecure behavior. The social context positively influenced phishing detection, but ``phished'' participants did not tell anyone.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
In today's digitized societies, phishing attacks are a security threat with damaging consequences. Organizations remain vulnerable to phishing attacks, and it is not clear how the work context influences people’s perceptions and behaviors related to phishing attempts. I investigate (1) how contextual factors influence reactions to a spear-phishing attempt, (2) why people report or do not report phishing attempts, (3) which opportunities for security-enhancing interventions people identify. I use an in-situ deception methodology to observe participants (N=14) in their realistic work environment. I triangulate observational and self-reported data to obtain rich qualitative insights into participants’ emotions, thoughts, and actions when receiving a targeted phishing email. I find that task, IT, internal and social context play an important role. The email's request being aligned with expectations and perceived time pressure when responding to emails were associated with insecure behavior. The social context positively influenced phishing detection, but ``phished'' participants did not tell anyone.
The Intricacies of Social Robots: Secondary Analysis of Fictional Documentaries to Explore the Benefits and Challenges of Robots in Complex Social Settings
Judith Dörrenbächer (Ubiquitous Design / Experience & Interaction, University of Siegen, Germany), Ronda Ringfort-Felner (Ubiquitous Design / Experience & Interaction, University of Siegen, Germany), Marc Hassenzahl (Ubiquitous Design / Experience & Interaction, University of Siegen, Germany)
Abstract | Tags: Full Paper | Links:
@inproceedings{Doerrenbaecher2023Intricacies,
title = {The Intricacies of Social Robots: Secondary Analysis of Fictional Documentaries to Explore the Benefits and Challenges of Robots in Complex Social Settings},
author = {Judith Dörrenbächer (Ubiquitous Design / Experience & Interaction, University of Siegen, Germany), Ronda Ringfort-Felner (Ubiquitous Design / Experience & Interaction, University of Siegen, Germany), Marc Hassenzahl (Ubiquitous Design / Experience & Interaction, University of Siegen, Germany)},
url = {http://www.experienceandinteraction.com/, Website
hhttps://www.facebook.com/experience.interact, facebook},
doi = {10.1145/3544548.3581526},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {In the design of social robots, the focus is often on the robot itself rather than on the intricacies of possible application scenarios. In this paper, we examine eight fictional documentaries about social robots, such as SEYNO, a robot that promotes respect between passengers in trains, or PATO, a robot to watch movies with. Overall, robots were conceptualized either (1) to substitute humans in relationships or (2) to mediate relationships (human-human-robot-interaction). While the former is basis of many current approaches to social robotics, the latter is less common, but particularly interesting. For instance, the mediation perspective fundamentally impacts the role a robot takes (e.g., role model, black sheep, ally, opponent, moralizer) and thus its potential function and form. From the substitution perspective, robots are expected to mimic human emotions; from the mediation perspective, robots can be positive precisely because they remain objective and are neither emotional nor empathic.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
In the design of social robots, the focus is often on the robot itself rather than on the intricacies of possible application scenarios. In this paper, we examine eight fictional documentaries about social robots, such as SEYNO, a robot that promotes respect between passengers in trains, or PATO, a robot to watch movies with. Overall, robots were conceptualized either (1) to substitute humans in relationships or (2) to mediate relationships (human-human-robot-interaction). While the former is basis of many current approaches to social robotics, the latter is less common, but particularly interesting. For instance, the mediation perspective fundamentally impacts the role a robot takes (e.g., role model, black sheep, ally, opponent, moralizer) and thus its potential function and form. From the substitution perspective, robots are expected to mimic human emotions; from the mediation perspective, robots can be positive precisely because they remain objective and are neither emotional nor empathic.
The Placebo Effect of Artificial Intelligence in Human-Computer Interaction
Thomas Kosch (HU Berlin), Robin Welsch (Aalto University), Lewis Chuang (Technische Universität Chemnitz), Albrecht Schmidt (LMU Munich)
Abstract | Tags: Journal | Links:
@article{Kosch2023Placebo,
title = {The Placebo Effect of Artificial Intelligence in Human-Computer Interaction},
author = {Thomas Kosch (HU Berlin), Robin Welsch (Aalto University), Lewis Chuang (Technische Universität Chemnitz), Albrecht Schmidt (LMU Munich)},
url = {https://cognisens.group, Website},
doi = {10.1145/3529225},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {In medicine, patients can obtain real benefits from a sham treatment. These benefits are known as the placebo effect. We report two experiments (Experiment I: N=369; Experiment II: N=100) demonstrating a placebo effect in adaptive interfaces. Participants were asked to solve word puzzles while being supported by no system or an adaptive AI interface. All participants experienced the same word puzzle difficulty and had no support from an AI throughout the experiments. Our results showed that the belief of receiving adaptive AI support increases expectations regarding the participant's own task performance, sustained after interaction. These expectations were positively correlated to performance, as indicated by the number of solved word puzzles. We integrate our findings into technological acceptance theories and discuss implications for the future assessment of AI-based user interfaces and novel technologies. We argue that system descriptions can elicit placebo effects through user expectations biasing the results of user-centered studies.},
keywords = {Journal},
pubstate = {published},
tppubtype = {article}
}
In medicine, patients can obtain real benefits from a sham treatment. These benefits are known as the placebo effect. We report two experiments (Experiment I: N=369; Experiment II: N=100) demonstrating a placebo effect in adaptive interfaces. Participants were asked to solve word puzzles while being supported by no system or an adaptive AI interface. All participants experienced the same word puzzle difficulty and had no support from an AI throughout the experiments. Our results showed that the belief of receiving adaptive AI support increases expectations regarding the participant's own task performance, sustained after interaction. These expectations were positively correlated to performance, as indicated by the number of solved word puzzles. We integrate our findings into technological acceptance theories and discuss implications for the future assessment of AI-based user interfaces and novel technologies. We argue that system descriptions can elicit placebo effects through user expectations biasing the results of user-centered studies.
The S-BAN: Insights into the Perception of Shape-Changing Haptic Interfaces via Virtual Pedestrian Navigation
Adam Spiers (Imperial College London, Max Planck Institute for Intelligent Systems), Eric Young (Max Planck Institute for Intelligent Systems),, Katherine J. Kuchenbecker (Max Planck Institute for Intelligent Systems)
Abstract | Tags: Journal | Links:
@article{Spier2023SBAN,
title = {The S-BAN: Insights into the Perception of Shape-Changing Haptic Interfaces via Virtual Pedestrian Navigation},
author = {Adam Spiers (Imperial College London and Max Planck Institute for Intelligent Systems), Eric Young (Max Planck Institute for Intelligent Systems), and Katherine J. Kuchenbecker (Max Planck Institute for Intelligent Systems)},
url = {https://hi.is.mpg.de, Website},
doi = {10.1145/3555046},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Screen-based pedestrian navigation assistance can be distracting or inaccessible to users. Shape-changing haptic interfaces can overcome these concerns. The S-BAN is a new handheld haptic interface that utilizes a parallel kinematic structure to deliver 2-DOF spatial information over a continuous workspace, with a form factor suited to integration with other travel aids. The ability to pivot, extend and retract its body opens possibilities and questions around spatial data representation. We present a static study to understand user perception of absolute pose and relative motion for two spatial mappings, showing highest sensitivity to relative motions in the cardinal directions. We then present an embodied navigation experiment in virtual reality. User motion efficiency when guided by the S-BAN was statistically equivalent to using a vision-based tool (a smartphone proxy). Although haptic trials were slower than visual trials, participants' heads were more elevated with the S-BAN, allowing greater visual focus on the environment.},
keywords = {Journal},
pubstate = {published},
tppubtype = {article}
}
Screen-based pedestrian navigation assistance can be distracting or inaccessible to users. Shape-changing haptic interfaces can overcome these concerns. The S-BAN is a new handheld haptic interface that utilizes a parallel kinematic structure to deliver 2-DOF spatial information over a continuous workspace, with a form factor suited to integration with other travel aids. The ability to pivot, extend and retract its body opens possibilities and questions around spatial data representation. We present a static study to understand user perception of absolute pose and relative motion for two spatial mappings, showing highest sensitivity to relative motions in the cardinal directions. We then present an embodied navigation experiment in virtual reality. User motion efficiency when guided by the S-BAN was statistically equivalent to using a vision-based tool (a smartphone proxy). Although haptic trials were slower than visual trials, participants' heads were more elevated with the S-BAN, allowing greater visual focus on the environment.
The Walking Talking Stick: Understanding Automated Note-Taking in Walking Meetings
Luke Haliburton (LMU Munich), Natalia Bartłomiejczyk (Lodz University of Technology), Albrecht Schmidt (LMU Munich), Paweł W. Woźniak (Chalmers University), Jasmin Niess (Oslo University)
Abstract | Tags: Full Paper | Links:
@inproceedings{Haliburton2023Walking,
title = {The Walking Talking Stick: Understanding Automated Note-Taking in Walking Meetings},
author = {Luke Haliburton (LMU Munich), Natalia Bartłomiejczyk (Lodz University of Technology), Albrecht Schmidt (LMU Munich), Paweł W. Woźniak (Chalmers University), Jasmin Niess (Oslo University)},
url = {https://www.instagram.com/mediagroup.lmu/, Instagram},
doi = {10.1145/3544548.3580986},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {While walking meetings offer a healthy alternative to sit-down meetings, they also pose practical challenges. Taking notes is difficult while walking, which limits the potential of walking meetings. To address this, we designed the prototype{}---a tangible device with integrated voice recording, transcription, and a physical highlighting button to facilitate note-taking during walking meetings. We investigated our system in a three-condition between-subjects user study with thirty pairs of participants (N=60) who conducted 15-minute outdoor walking meetings. Participants either used lapel microphones, the prototype without the button, or the prototype with the highlighting button. We found that the tangible device increased task focus, and the physical highlighting button facilitated turn-taking and resulted in more useful notes. Our work demonstrates how interactive artifacts can incentivize users to hold meetings in motion and enhance conversation dynamics. We contribute insights for future systems which support conducting work tasks in mobile environments.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
While walking meetings offer a healthy alternative to sit-down meetings, they also pose practical challenges. Taking notes is difficult while walking, which limits the potential of walking meetings. To address this, we designed the prototype{}---a tangible device with integrated voice recording, transcription, and a physical highlighting button to facilitate note-taking during walking meetings. We investigated our system in a three-condition between-subjects user study with thirty pairs of participants (N=60) who conducted 15-minute outdoor walking meetings. Participants either used lapel microphones, the prototype without the button, or the prototype with the highlighting button. We found that the tangible device increased task focus, and the physical highlighting button facilitated turn-taking and resulted in more useful notes. Our work demonstrates how interactive artifacts can incentivize users to hold meetings in motion and enhance conversation dynamics. We contribute insights for future systems which support conducting work tasks in mobile environments.
ThermalPen: Adding Thermal Haptic Feedback to 3D Sketching
Philipp Pascal Hoffmann (TU Darmstadt), Hesham Elsayed (TU Darmstadt), Max Mühlhäuser (TU Darmstadt), Rina Wehbe (Dalhousie University), Mayra D. Barrera Machuca (Dalhousie University)
Abstract | Tags: Interactivity/Demonstration | Links:
@inproceedings{Hoffmann2023ThemalPen,
title = {ThermalPen: Adding Thermal Haptic Feedback to 3D Sketching},
author = {Philipp Pascal Hoffmann (TU Darmstadt), Hesham Elsayed (TU Darmstadt), Max Mühlhäuser (TU Darmstadt), Rina Wehbe (Dalhousie University), Mayra D. Barrera Machuca (Dalhousie University)},
url = {https://www.teamdarmstadt.de/, Website
https://www.facebook.com/teamdarmstadt/, Facebook
https://www.instagram.com/teamdarmstadt/, instagram
https://www.youtube.com/user/TKLabs, Youtube
https://drive.google.com/file/d/1K7Ad7xZRQ1zHB16rlXldPJ2i3QvPV9VA/view, Teaser Video
https://drive.google.com/file/d/16toXSiT1crEn7oOHhmoGg2gN7ncZyMGt/view, Full Video},
doi = {10.1145/3544549.3583901},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Sketching in virtual 3D environments has enabled new forms of artistic expression and a variety of novel design use-cases. However, the lack of haptic feedback proves to be one of the main challenges in this field. While prior work has investigated vibrotactile and force-feedback devices, this paper proposes the addition of thermal feedback. We present ThermalPen, a novel pen for 3D sketching that associates the texture and colour of strokes with different thermal properties. For example, a fire texture elicits an increase in temperature, while an ice texture causes a temperature drop in the pen. Our goal with ThermalPen is to enhance the 3D sketching experience and allow users to use this tool to increase their creativity while sketching. We plan on evaluating the influence of thermal feedback on the 3D sketching experience, with a focus on user creativity in the future.},
keywords = {Interactivity/Demonstration},
pubstate = {published},
tppubtype = {inproceedings}
}
Sketching in virtual 3D environments has enabled new forms of artistic expression and a variety of novel design use-cases. However, the lack of haptic feedback proves to be one of the main challenges in this field. While prior work has investigated vibrotactile and force-feedback devices, this paper proposes the addition of thermal feedback. We present ThermalPen, a novel pen for 3D sketching that associates the texture and colour of strokes with different thermal properties. For example, a fire texture elicits an increase in temperature, while an ice texture causes a temperature drop in the pen. Our goal with ThermalPen is to enhance the 3D sketching experience and allow users to use this tool to increase their creativity while sketching. We plan on evaluating the influence of thermal feedback on the 3D sketching experience, with a focus on user creativity in the future.
TicTacToes: Assessing Toe Movements as an Input Modality
Florian Müller (LMU Munich), Daniel Schmitt (TU Darmstadt), Andrii Matviienko (KTH Royal Institute of Technology), Dominik Schön(TU Darmstadt), Sebastian Günther (TU Darmstadt) Thomas Kosch (HU Berlin), Martin Schmitz (Saarland Informatics Campus, Saarland University)
Abstract | Tags: Full Paper | Links:
@inproceedings{Mueller2023TicTacToes,
title = {TicTacToes: Assessing Toe Movements as an Input Modality},
author = {Florian Müller (LMU Munich), Daniel Schmitt (TU Darmstadt), Andrii Matviienko (KTH Royal Institute of Technology), Dominik Schön(TU Darmstadt), Sebastian Günther (TU Darmstadt)
Thomas Kosch (HU Berlin), Martin Schmitz (Saarland Informatics Campus, Saarland University)},
url = {https://www.um.informatik.uni-muenchen.de/index.html, Website
https://twitter.com/mimuc, twitter
https://www.youtube.com/watch?v=2cGBqSQq0LM, Teaser Video
https://www.youtube.com/watch?v=kVVY6ZZ5aHY, Full Video},
doi = {10.1145/3544548.3580954},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {From carrying grocery bags to holding onto handles on the bus, there are a variety of situations where one or both hands are busy, hindering the vision of ubiquitous interaction with technology. Voice commands, as a popular hands-free alternative, struggle with ambient noise and privacy issues. As an alternative approach, research explored movements of various body parts (e.g., head, arms) as input modalities, with foot-based techniques proving particularly suitable for hands-free interaction. Whereas previous research only considered the movement of the foot as a whole, in this work, we argue that our toes offer further degrees of freedom that can be leveraged for interaction. To explore the viability of toe-based interaction, we contribute the results of a controlled experiment with 18 participants assessing the impact of five factors on the accuracy, efficiency and user experience of such interfaces. Based on the findings, we provide design recommendations for future toe-based interfaces.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
From carrying grocery bags to holding onto handles on the bus, there are a variety of situations where one or both hands are busy, hindering the vision of ubiquitous interaction with technology. Voice commands, as a popular hands-free alternative, struggle with ambient noise and privacy issues. As an alternative approach, research explored movements of various body parts (e.g., head, arms) as input modalities, with foot-based techniques proving particularly suitable for hands-free interaction. Whereas previous research only considered the movement of the foot as a whole, in this work, we argue that our toes offer further degrees of freedom that can be leveraged for interaction. To explore the viability of toe-based interaction, we contribute the results of a controlled experiment with 18 participants assessing the impact of five factors on the accuracy, efficiency and user experience of such interfaces. Based on the findings, we provide design recommendations for future toe-based interfaces.
Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across Domains
Masoumehsadat Hosseini (University of Oldenburg, Oldenburg, Germany), Tjado Ihmels (University Oldenburg, Oldenburg, Germany), Ziqian Chen (Universität des Saarlandes, Saarbrücken), Marion Koelle (OFFIS - Institute for Information Technology, Oldenburg, Germany), Heiko Müller (OFFIS - Institute for Information Technology, Oldenburg, Germany), Susanne Boll (Media Informatics, Multimedia Systems, University of Oldenburg, Oldenburg, Germany)
Abstract | Tags: Full Paper | Links:
@inproceedings{Hosseini2023Consensus,
title = {Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across Domains},
author = {Masoumehsadat Hosseini (University of Oldenburg, Oldenburg, Germany), Tjado Ihmels (University Oldenburg, Oldenburg, Germany), Ziqian Chen (Universität des Saarlandes, Saarbrücken), Marion Koelle (OFFIS - Institute for Information Technology, Oldenburg, Germany), Heiko Müller (OFFIS - Institute for Information Technology, Oldenburg, Germany), Susanne Boll (Media Informatics and Multimedia Systems, University of Oldenburg, Oldenburg, Germany)},
doi = {10.1145/3544548.3581420},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Mid-air gesture-based systems are becoming ubiquitous. Many mid-air gestures control different kinds of interactive devices, applications, and systems. They are, however, still targeted at specific devices in specific domains and are not necessarily consistent across domain boundaries. A comprehensive evaluation of the transferability of gesture vocabulary between domains is also lacking. Consequently, interaction designers cannot decide which gestures to use for which domain. In this systematic literature review, we contribute to the future research agenda in this area, based on an analysis of 172 papers. As part of our analysis, we clustered gestures according to the dimensions of an existing taxonomy to identify their common characteristics in different domains, and we investigated the extent to which existing mid-air gesture sets are consistent across different domains. We derived a consensus gesture set containing 22 gestures based on agreement rates calculation and considered their transferability across different domains.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Mid-air gesture-based systems are becoming ubiquitous. Many mid-air gestures control different kinds of interactive devices, applications, and systems. They are, however, still targeted at specific devices in specific domains and are not necessarily consistent across domain boundaries. A comprehensive evaluation of the transferability of gesture vocabulary between domains is also lacking. Consequently, interaction designers cannot decide which gestures to use for which domain. In this systematic literature review, we contribute to the future research agenda in this area, based on an analysis of 172 papers. As part of our analysis, we clustered gestures according to the dimensions of an existing taxonomy to identify their common characteristics in different domains, and we investigated the extent to which existing mid-air gesture sets are consistent across different domains. We derived a consensus gesture set containing 22 gestures based on agreement rates calculation and considered their transferability across different domains.
Towards More Inclusive and Accessible Virtual Reality: Conducting Large-scale Studies in the Wild
Thereza Schmelter (Berlin University of Applied Sciences, Technologies), Lucie Kruse (Human-Computer Interaction, Universität Hamburg), Sukran Karaosmanoglu (Human-Computer Interaction, Universität Hamburg), Sebastian Rings(Human-Computer Interaction, Universität Hamburg), Frank Steinicke (Human-Computer Interaction, Universität Hamburg), Kristian Hildebrand (Berlin University of Applied Sciences, Technologies)
Abstract | Tags: Interactivity/Demonstration | Links:
@bachelorthesis{Schmelter2023Virtual,
title = {Towards More Inclusive and Accessible Virtual Reality: Conducting Large-scale Studies in the Wild},
author = {Thereza Schmelter (Berlin University of Applied Sciences and Technologies), Lucie Kruse (Human-Computer Interaction, Universität Hamburg), Sukran Karaosmanoglu (Human-Computer Interaction, Universität Hamburg), Sebastian Rings(Human-Computer Interaction, Universität Hamburg), Frank Steinicke (Human-Computer Interaction, Universität Hamburg), Kristian Hildebrand (Berlin University of Applied Sciences and Technologies)},
url = {http://hildebrand.beuth-hochschule.de/, Website
},
doi = {10.1145/3544549.3583888},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {In this work, we demonstrate a mobile laboratory with virtual and augmented reality (VR/AR) technology housed in a truck that enables large-scale VR/AR studies and therapies in real-world environments. This project aims to improve accessibility and inclusiveness in human-computer interaction (HCI) methods, providing a platform for researchers, medical professionals, and patients to utilize laboratory hardware and space. The mobile laboratory is equipped with motion tracking technology and other hardware to allow for a range of user groups to participate in VR studies and therapies that could otherwise never partake or benefit from these services. Our findings, applications, and experiences will be presented at the CHI interactivity track, with the goal of fostering future research opportunities.},
keywords = {Interactivity/Demonstration},
pubstate = {published},
tppubtype = {bachelorthesis}
}
In this work, we demonstrate a mobile laboratory with virtual and augmented reality (VR/AR) technology housed in a truck that enables large-scale VR/AR studies and therapies in real-world environments. This project aims to improve accessibility and inclusiveness in human-computer interaction (HCI) methods, providing a platform for researchers, medical professionals, and patients to utilize laboratory hardware and space. The mobile laboratory is equipped with motion tracking technology and other hardware to allow for a range of user groups to participate in VR studies and therapies that could otherwise never partake or benefit from these services. Our findings, applications, and experiences will be presented at the CHI interactivity track, with the goal of fostering future research opportunities.
Understanding and Mitigating Technology-Facilitated Privacy Violations in the Physical World
Maximiliane Windl (LMU Munich, Munich Center for Machine Learning (MCML)), Verena Winterhalter (LMU Munich), Albrecht Schmidt (LMU Munich), Sven Mayer (LMU Munich)
Abstract | Tags: Full Paper | Links:
@inproceedings{Windl2023Violations,
title = {Understanding and Mitigating Technology-Facilitated Privacy Violations in the Physical World},
author = {Maximiliane Windl (LMU Munich, Munich Center for Machine Learning (MCML)), Verena Winterhalter (LMU Munich), Albrecht Schmidt (LMU Munich), Sven Mayer (LMU Munich)},
url = {https://maximiliane-windl.com/, Website
https://twitter.com/MaxiWindl, twitter
https://youtu.be/CvrXu-lsmyI, Teaser Video
https://youtu.be/wplOcMp-ntg, Full Video},
doi = {10.1145/3544548.3580909},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {We are constantly surrounded by technology that collects and processes sensitive data, paving the way for privacy violations. Yet, current research investigating technology-facilitated privacy violations in the physical world is scattered and focused on specific scenarios or investigates such violations purely from an expert's perspective. Informed through a large-scale online survey, we first construct a scenario taxonomy based on user-experienced privacy violations in the physical world through technology. We then validate our taxonomy and establish mitigation strategies using interviews and co-design sessions with privacy and security experts. In summary, this work contributes (1) a refined scenario taxonomy for technology-facilitated privacy violations in the physical world, (2) an understanding of how privacy violations manifest in the physical world, (3) a decision tree on how to inform users, and (4) a design space to create notices whenever adequate. With this, we contribute a conceptual framework to enable a privacy-preserving technology-connected world.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
We are constantly surrounded by technology that collects and processes sensitive data, paving the way for privacy violations. Yet, current research investigating technology-facilitated privacy violations in the physical world is scattered and focused on specific scenarios or investigates such violations purely from an expert's perspective. Informed through a large-scale online survey, we first construct a scenario taxonomy based on user-experienced privacy violations in the physical world through technology. We then validate our taxonomy and establish mitigation strategies using interviews and co-design sessions with privacy and security experts. In summary, this work contributes (1) a refined scenario taxonomy for technology-facilitated privacy violations in the physical world, (2) an understanding of how privacy violations manifest in the physical world, (3) a decision tree on how to inform users, and (4) a design space to create notices whenever adequate. With this, we contribute a conceptual framework to enable a privacy-preserving technology-connected world.
Understanding Perception of Human Augmentation: A Mixed-Method Study
Steeven Villa (LMU Munich), Jasmin Niess (University of Oslo), Takuro Nakao (Keio University), Jonathan Lazar (Maryland University), Albrecht Schmidt (LMU Munich), Tonja Machulla (TU Chemnitz)
Abstract | Tags: Full Paper | Links:
@inproceedings{Villa2023Perception,
title = {Understanding Perception of Human Augmentation: A Mixed-Method Study},
author = {Steeven Villa (LMU Munich), Jasmin Niess (University of Oslo), Takuro Nakao (Keio University), Jonathan Lazar (Maryland University), Albrecht Schmidt (LMU Munich), Tonja Machulla (TU Chemnitz)},
doi = {doi.org/10.1145/3544548.3581485},
year = {2023},
date = {2023-04-28},
publisher = {ACM},
abstract = {Technologies that help users overcome their limitations and integrate with the human body are often termed ``human augmentations''. Such technologies are now available on the consumer market, potentially supporting people in their everyday activities. To date, there is no systematic understanding of the perception of human augmentations yet. To address this gap and build an understanding of how to design positive experiences with human augmentations, we conducted a mixed-method study of the perception of augmented humans (AHs). We conducted two scenario-based studies: interviews (n=16) and an online study (n=506) with participants from four countries. The scenarios include one out of three augmentation categories (sensory, motor, and cognitive) and specify if the augmented person has a disability or not. Overall, results show that the type of augmentation and disability impacted user attitudes towards AHs. We derive design dimensions for creating technological augmentations for a diverse and global audience.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Technologies that help users overcome their limitations and integrate with the human body are often termed ``human augmentations''. Such technologies are now available on the consumer market, potentially supporting people in their everyday activities. To date, there is no systematic understanding of the perception of human augmentations yet. To address this gap and build an understanding of how to design positive experiences with human augmentations, we conducted a mixed-method study of the perception of augmented humans (AHs). We conducted two scenario-based studies: interviews (n=16) and an online study (n=506) with participants from four countries. The scenarios include one out of three augmentation categories (sensory, motor, and cognitive) and specify if the augmented person has a disability or not. Overall, results show that the type of augmentation and disability impacted user attitudes towards AHs. We derive design dimensions for creating technological augmentations for a diverse and global audience.
UndoPort: Exploring the Influence of Undo-Actions for Locomotion in Virtual Reality on the Efficiency, Spatial Understanding and User Experience
Florian Müller (LMU Munich), Arantxa (LMU Munich), Dominik Schön (TU Darmstadt), Julian Rasch (LMU Munich)
Abstract | Tags: Full Paper | Links:
@inproceedings{Mueller2023UndoPort,
title = {UndoPort: Exploring the Influence of Undo-Actions for Locomotion in Virtual Reality on the Efficiency, Spatial Understanding and User Experience},
author = {Florian Müller (LMU Munich), Arantxa (LMU Munich), Dominik Schön (TU Darmstadt), Julian Rasch (LMU Munich)},
url = {https://www.um.informatik.uni-muenchen.de/index.html, Website
https://twitter.com/mimuc, twitter
https://www.youtube.com/watch?v=16ylRYe7WVk, Teaser Video
https://www.youtube.com/watch?v=pcifaRvG0yA, Full Video},
doi = {10.1145/3544548.3581557},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {When we get lost in Virtual Reality (VR) or want to return to a previous location, we use the same methods of locomotion for the way back as for the way forward. This is time-consuming and requires additional physical orientation changes, increasing the risk of getting tangled in the headsets' cables. In this paper, we propose the use of undo actions to revert locomotion steps in VR. We explore eight different variations of undo actions as extensions of point&teleport, based on the possibility to undo position and orientation changes together with two different visualizations of the undo step (discrete and continuous). We contribute the results of a controlled experiment with 24 participants investigating the efficiency and orientation of the undo techniques in a radial maze task. We found that the combination of position and orientation undo together with a discrete visualization resulted in the highest efficiency without increasing orientation errors.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
When we get lost in Virtual Reality (VR) or want to return to a previous location, we use the same methods of locomotion for the way back as for the way forward. This is time-consuming and requires additional physical orientation changes, increasing the risk of getting tangled in the headsets' cables. In this paper, we propose the use of undo actions to revert locomotion steps in VR. We explore eight different variations of undo actions as extensions of point&teleport, based on the possibility to undo position and orientation changes together with two different visualizations of the undo step (discrete and continuous). We contribute the results of a controlled experiment with 24 participants investigating the efficiency and orientation of the undo techniques in a radial maze task. We found that the combination of position and orientation undo together with a discrete visualization resulted in the highest efficiency without increasing orientation errors.
Versatile Immersive Virtual and Augmented Tangible OR - Using VR, AR and Tangibles to Support Surgical Practice
Anke V. Reinschluessel (Digital Media Lab, University of Bremen), Thomas Muender (Digital Media Lab, University of Bremen), Roland Fischer (CGVR, University of Bremen), Valentin Kraft (Fraunhofer MEVIS, Bremen), Verena N. Uslar (University Hospital for Visceral Surgery, University of Oldenburg), Dirk Weyhe (University Hospital for Visceral Surgery, Pius-Hospital Oldenburg), Andrea Schenk (Fraunhofer Institute for Digital Medicine MEVIS), Gabriel Zachmann (Mathematics, Computer Science, University of Bremen), Tanja Döring (Digital Media Lab / HCI Group, University of Bremen), Rainer Malaka (Digital Media Lab, University of Bremen)
Abstract | Tags: Interactivity/Demonstration | Links:
@inproceedings{Reinschluessel2023Versatile,
title = {Versatile Immersive Virtual and Augmented Tangible OR - Using VR, AR and Tangibles to Support Surgical Practice },
author = {Anke V. Reinschluessel (Digital Media Lab, University of Bremen), Thomas Muender (Digital Media Lab, University of Bremen), Roland Fischer (CGVR, University of Bremen), Valentin Kraft (Fraunhofer MEVIS, Bremen), Verena N. Uslar (University Hospital for Visceral Surgery, University of Oldenburg), Dirk Weyhe (University Hospital for Visceral Surgery, Pius-Hospital Oldenburg), Andrea Schenk (Fraunhofer Institute for Digital Medicine MEVIS), Gabriel Zachmann (Mathematics and Computer Science, University of Bremen), Tanja Döring (Digital Media Lab / HCI Group, University of Bremen), Rainer Malaka (Digital Media Lab, University of Bremen)
},
url = {https://www.uni-bremen.de/dmlab/, Website
https://twitter.com/dmlabbremen, twitter
},
doi = {10.1145/3544549.3583895},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {Immersive technologies such as virtual reality (VR) and augmented reality (AR), in combination with advanced image segmentation and visualization, have considerable potential to improve and support a surgeon's work. We demonstrate a solution to help surgeons plan and perform surgeries and educate future medical staff using VR, AR, and tangibles. A VR planning tool improves spatial understanding of an individual's anatomy, a tangible organ model allows for intuitive interaction, and AR gives contactless access to medical images in the operating room. Additionally, we present improvements regarding point cloud representations to provide detailed visual information to a remote expert and about the remote expert. Therefore, we give an exemplary setup showing how recent interaction techniques and modalities benefit an area that can positively change the life of patients.},
keywords = {Interactivity/Demonstration},
pubstate = {published},
tppubtype = {inproceedings}
}
Immersive technologies such as virtual reality (VR) and augmented reality (AR), in combination with advanced image segmentation and visualization, have considerable potential to improve and support a surgeon's work. We demonstrate a solution to help surgeons plan and perform surgeries and educate future medical staff using VR, AR, and tangibles. A VR planning tool improves spatial understanding of an individual's anatomy, a tangible organ model allows for intuitive interaction, and AR gives contactless access to medical images in the operating room. Additionally, we present improvements regarding point cloud representations to provide detailed visual information to a remote expert and about the remote expert. Therefore, we give an exemplary setup showing how recent interaction techniques and modalities benefit an area that can positively change the life of patients.
Virtual Tourism, Real Experience: A Motive-Oriented Approach to Virtual Tourism
Sara Wolf (Institute Human-Computer-Media, Julius-Maximilians-Universität, Würburg, Germany), Michael Weber (Institute Human-Computer-Media, Julius-Maximilians-Universität, Würburg, Germany), Jörn Hurtienne (Chair of Psychological Ergonomics, Julius-Maximilians-Universität, Würburg, Germany)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Wolf2023Tourism,
title = {Virtual Tourism, Real Experience: A Motive-Oriented Approach to Virtual Tourism},
author = {Sara Wolf (Institute Human-Computer-Media, Julius-Maximilians-Universität, Würburg, Germany), Michael Weber (Institute Human-Computer-Media, Julius-Maximilians-Universität, Würburg, Germany), Jörn Hurtienne (Chair of Psychological Ergonomics, Julius-Maximilians-Universität, Würburg, Germany)},
url = {https://www.mcm.uni-wuerzburg.de/psyergo/startseite/, Website},
doi = {10.1145/3544549.3585594},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Virtual tourism products promise to combine the best of two worlds: Staying in the safety of one’s home while having engaging tourism experiences. Previous tourism research has emphasised that tourism experiences involve more than just seeing other places. They address cultural motives such as novelty and education and socio-psychological motives like relaxation, escape from a mundane environment or facilitation of social interaction. We suggest applying the motive-oriented perspective in HCI research on virtual tourism and report on a corresponding analysis of 21 virtual tourism products. Our findings show that current virtual tourism products neglect the breadth of tourist motives. They mainly focus on cultural motives while rarely addressing socio-psychological motives, especially kinship relationships and prestige. Our findings demonstrate the usefulness of the motive-oriented perspective for HCI and inspired conceptual ideas for addressing motives in virtual tourism products that may be useful for future research and design in this area.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Virtual tourism products promise to combine the best of two worlds: Staying in the safety of one’s home while having engaging tourism experiences. Previous tourism research has emphasised that tourism experiences involve more than just seeing other places. They address cultural motives such as novelty and education and socio-psychological motives like relaxation, escape from a mundane environment or facilitation of social interaction. We suggest applying the motive-oriented perspective in HCI research on virtual tourism and report on a corresponding analysis of 21 virtual tourism products. Our findings show that current virtual tourism products neglect the breadth of tourist motives. They mainly focus on cultural motives while rarely addressing socio-psychological motives, especially kinship relationships and prestige. Our findings demonstrate the usefulness of the motive-oriented perspective for HCI and inspired conceptual ideas for addressing motives in virtual tourism products that may be useful for future research and design in this area.
VR Almost There: Simulating Co-located Multiplayer Experiences in Social Virtual Reality
Philipp Sykownik (University of Duisburg-Essen), Sukran Karaosmanoglu (Universität Hamburg), Katharina Emmerich (University of Duisburg-Essen), Frank Steinicke (Universität Hamburg), Maic Masuch (University of Duisburg-Essen)
Abstract | Tags: Full Paper | Links:
@inproceedings{Sykownik2023Almost,
title = {VR Almost There: Simulating Co-located Multiplayer Experiences in Social Virtual Reality},
author = {Philipp Sykownik (University of Duisburg-Essen), Sukran Karaosmanoglu (Universität Hamburg), Katharina Emmerich (University of Duisburg-Essen), Frank Steinicke (Universität Hamburg), Maic Masuch (University of Duisburg-Essen)},
url = {https://www.inf.uni-hamburg.de/en/inst/ab/hci.html, Website
https://twitter.com/uhhhci, twitter
},
doi = {10.1145/3544548.3581230},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Consumer social virtual reality (VR) applications have recently started to enable social interactions at a distance. Yet it is still relatively unknown if and to what extent such applications provide meaningful social experiences in cases where in-person leisure activities are not feasible. To explore this, we developed a custom social VR application and conducted an exploratory lab study with 25 dyads in which we compared an in-person and a virtual version of a co-located multiplayer scenario. Our mixed-methods analysis revealed that both scenarios created a socially rich atmosphere and strengthened the social closeness between players. However, the lack of facial animations, limited body language, and a low field of view led to VR's main social experiential limitations: a reduced mutual awareness and emotional understanding compared to the in-person scenario. We derive implications for social VR design and research as well as game user research.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Consumer social virtual reality (VR) applications have recently started to enable social interactions at a distance. Yet it is still relatively unknown if and to what extent such applications provide meaningful social experiences in cases where in-person leisure activities are not feasible. To explore this, we developed a custom social VR application and conducted an exploratory lab study with 25 dyads in which we compared an in-person and a virtual version of a co-located multiplayer scenario. Our mixed-methods analysis revealed that both scenarios created a socially rich atmosphere and strengthened the social closeness between players. However, the lack of facial animations, limited body language, and a low field of view led to VR's main social experiential limitations: a reduced mutual awareness and emotional understanding compared to the in-person scenario. We derive implications for social VR design and research as well as game user research.
VR, Gaze, and Visual Impairment: An Exploratory Study of the Perception of Eye Contact across different Sensory Modalities for People with Visual Impairments in Virtual Reality
Markus Wieland (University of Stuttgart), Michael Sedlmair (University of Stuttgart), Tonja-Katrin Machulla (TU Chemnitz)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Wieland2023Impairment,
title = {VR, Gaze, and Visual Impairment: An Exploratory Study of the Perception of Eye Contact across different Sensory Modalities for People with Visual Impairments in Virtual Reality},
author = {Markus Wieland (University of Stuttgart), Michael Sedlmair (University of Stuttgart), Tonja-Katrin Machulla (TU Chemnitz)},
url = {https://visvar.github.io/, Website},
doi = {10.1145/3544549.3585726},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {As social virtual reality (VR) becomes more popular, avatars are being designed with realistic behaviors incorporating non-verbal cues like eye contact. However, for people with visual impairments, perceiving eye contact during a conversation can be challenging. VR presents an opportunity to display eye contact cues in alternative ways, making them perceivable for people with visual impairments. We performed an exploratory study to gain initial insights on designing eye contact cues for people with visual impairments, including a focus group for a deeper understanding of the topic. We implemented eye contact cues via visual, auditory, and tactile sensory modalities in VR and tested these approaches with eleven participants with visual impairments and collected qualitative feedback. The results show that visual cues indicating the direction of gaze were preferred, but auditory and tactile cues were also prevalent as they do not superimpose additional visual information.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
As social virtual reality (VR) becomes more popular, avatars are being designed with realistic behaviors incorporating non-verbal cues like eye contact. However, for people with visual impairments, perceiving eye contact during a conversation can be challenging. VR presents an opportunity to display eye contact cues in alternative ways, making them perceivable for people with visual impairments. We performed an exploratory study to gain initial insights on designing eye contact cues for people with visual impairments, including a focus group for a deeper understanding of the topic. We implemented eye contact cues via visual, auditory, and tactile sensory modalities in VR and tested these approaches with eleven participants with visual impairments and collected qualitative feedback. The results show that visual cues indicating the direction of gaze were preferred, but auditory and tactile cues were also prevalent as they do not superimpose additional visual information.
VRisbee: How Hand Visibility Impacts Throwing Accuracy and Experience in Virtual Reality
Malte Borgwardt (University of Bremen), Jonas Boueke (University of Bremen), María Fernanda Sanabria (University of Bremen), Michael Bonfert (Digital Media Lab, University of Bremen), Robert Porzel (Digital Media Lab, University of Bremen)
Abstract | Tags: Late Breaking Work | Links:
@inproceedings{Borgwardt2023VRisbee,
title = {VRisbee: How Hand Visibility Impacts Throwing Accuracy and Experience in Virtual Reality},
author = {Malte Borgwardt (University of Bremen), Jonas Boueke (University of Bremen), María Fernanda Sanabria (University of Bremen), Michael Bonfert (Digital Media Lab, University of Bremen), Robert Porzel (Digital Media Lab, University of Bremen)},
url = {https://www.uni-bremen.de/dmlab, Website
https://twitter.com/dmlabbremen, twitter},
doi = {10.1145/3544549.3585868},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Hand interaction plays a key role in virtual reality (VR) sports. While in reality, athletes mostly rely on haptic perception when holding and throwing objects, these sensational cues can be missing or differ in virtual environments. In this work, we investigated how the visibility of a virtual hand can support players when throwing and what impact it has on the overall experience. We developed a Frisbee simulation in VR and asked 29 study participants to hit a target. We measured the throwing accuracy and self-reports of presence, disc control, and body ownership. The results show a subtle advantage of hand visibility in terms of accuracy. Visible hands further improved the subjective impression of realism, body ownership and subjective control over the disc.},
keywords = {Late Breaking Work},
pubstate = {published},
tppubtype = {inproceedings}
}
Hand interaction plays a key role in virtual reality (VR) sports. While in reality, athletes mostly rely on haptic perception when holding and throwing objects, these sensational cues can be missing or differ in virtual environments. In this work, we investigated how the visibility of a virtual hand can support players when throwing and what impact it has on the overall experience. We developed a Frisbee simulation in VR and asked 29 study participants to hit a target. We measured the throwing accuracy and self-reports of presence, disc control, and body ownership. The results show a subtle advantage of hand visibility in terms of accuracy. Visible hands further improved the subjective impression of realism, body ownership and subjective control over the disc.
Wearable Biofeedback for Knee Joint Health
Nataliya Rokhmanova (Haptic Intelligence Department, Max Planck Institute for Intelligent Systems)
Abstract | Tags: Doctoral Consortium | Links:
@inproceedings{Rokhmanova2023Wearable,
title = {Wearable Biofeedback for Knee Joint Health},
author = {Nataliya Rokhmanova (Haptic Intelligence Department, Max Planck Institute for Intelligent Systems)},
url = {https://hi.is.mpg.de/, Website},
doi = {10.1145/3544549.3577063},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
abstract = {The human body has the tremendous capacity to learn a new way of walking that can reduce risk of musculoskeletal disease progression. Wearable haptic biofeedback has been used to teach this new gait to patients with knee osteoarthritis, enabling reductions in pain and improvement in function. However, this promising gait retraining therapy is not yet a part of standard clinical practice. Here, I propose a two-pronged approach to improving the design and implementation of biofeedback for gait retraining. The first section concerns prescription, with the aim of providing clinicians with a model that predicts the mechanical outcome of gait retraining in order to best guide their treatment decisions. The second section concerns learning, by seeking to understand how internal physiological state and external environmental factors influence the process of learning a therapeutic gait. This work aims to address the challenges keeping this intervention from being widely used to maintain pain-free mobility throughout the lifespan. },
keywords = {Doctoral Consortium},
pubstate = {published},
tppubtype = {inproceedings}
}
The human body has the tremendous capacity to learn a new way of walking that can reduce risk of musculoskeletal disease progression. Wearable haptic biofeedback has been used to teach this new gait to patients with knee osteoarthritis, enabling reductions in pain and improvement in function. However, this promising gait retraining therapy is not yet a part of standard clinical practice. Here, I propose a two-pronged approach to improving the design and implementation of biofeedback for gait retraining. The first section concerns prescription, with the aim of providing clinicians with a model that predicts the mechanical outcome of gait retraining in order to best guide their treatment decisions. The second section concerns learning, by seeking to understand how internal physiological state and external environmental factors influence the process of learning a therapeutic gait. This work aims to address the challenges keeping this intervention from being widely used to maintain pain-free mobility throughout the lifespan.
What does it mean to cycle in Virtual Reality? Exploring Cycling Fidelity and Control of VR Bicycle Simulators
Andrii Matviienko (KTH Royal Institute of Technology, Sweden), Hajris Hoxha (Technical University of Darmstadt, Germany), Max Mühlhäuser (Technical University of Darmstadt, Germany)
Abstract | Tags: Full Paper | Links:
@inproceedings{Matviienko2023Cycling,
title = {What does it mean to cycle in Virtual Reality? Exploring Cycling Fidelity and Control of VR Bicycle Simulators},
author = {Andrii Matviienko (KTH Royal Institute of Technology, Sweden), Hajris Hoxha (Technical University of Darmstadt, Germany), Max Mühlhäuser (Technical University of Darmstadt, Germany)},
url = {https://teamdarmstadt.de/, Website},
doi = {10.1145/3544548.3581050},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Creating highly realistic Virtual Reality (VR) bicycle experiences can be time-consuming and expensive. Moreover, it is unclear what hardware parts are necessary to design a bicycle simulator and whether a bicycle is needed at all. In this paper, we investigated cycling fidelity and control of VR bicycle simulators. For this, we developed and evaluated three cycling simulators: (1) cycling without a bicycle (bikeless), (2) cycling on a fixed (stationary) and (3) moving bicycle (tandem) with four levels of control (no control, steering, pedaling, and steering + pedaling). To evaluate all combinations of fidelity and control, we conducted a controlled experiment (N = 24) in indoor and outdoor settings. We found that the bikeless setup provides the highest feeling of safety, while the tandem leads to the highest realism without increasing motion sickness. Moreover, we discovered that bicycles are not essential for cycling in VR.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Creating highly realistic Virtual Reality (VR) bicycle experiences can be time-consuming and expensive. Moreover, it is unclear what hardware parts are necessary to design a bicycle simulator and whether a bicycle is needed at all. In this paper, we investigated cycling fidelity and control of VR bicycle simulators. For this, we developed and evaluated three cycling simulators: (1) cycling without a bicycle (bikeless), (2) cycling on a fixed (stationary) and (3) moving bicycle (tandem) with four levels of control (no control, steering, pedaling, and steering + pedaling). To evaluate all combinations of fidelity and control, we conducted a controlled experiment (N = 24) in indoor and outdoor settings. We found that the bikeless setup provides the highest feeling of safety, while the tandem leads to the highest realism without increasing motion sickness. Moreover, we discovered that bicycles are not essential for cycling in VR.
What's That Shape? Investigating Eyes-Free Recognition of Textile Icons
René Schäfer (RWTH Aachen University), Oliver Nowak (RWTH Aachen University), Lovis Suchmann (RWTH Aachen University), Sören Schröder(RWTH Aachen University), Jan Borchers (RWTH Aachen University)
Abstract | Tags: Full Paper, Interactivity/Demonstration | Links:
@inproceedings{Schaefer2023Shape,
title = {What's That Shape? Investigating Eyes-Free Recognition of Textile Icons},
author = {René Schäfer (RWTH Aachen University), Oliver Nowak (RWTH Aachen University), Lovis Suchmann (RWTH Aachen University), Sören Schröder(RWTH Aachen University), Jan Borchers (RWTH Aachen University)
},
url = {https://hci.rwth-aachen.de, Website
https://youtu.be/7EgvDO3Ny44, Teaser Video
https://youtu.be/PFCvn-KhxbQ, Full Video},
doi = {10.1145/3544548.3580920},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Textile surfaces, such as on sofas, cushions, and clothes, offer promising alternative locations to place controls for digital devices. Textiles are a natural, even abundant part of living spaces, and support unobtrusive input. While there is solid work on technical implementations of textile interfaces, there is little guidance regarding their design—especially their haptic cues, which are essential for eyes-free use. In particular, icons easily communicate information visually in a compact fashion, but it is unclear how to adapt them to the haptics-centric textile interface experience. Therefore, we investigated the recognizability of 84 haptic icons on fabrics. Each combines a shape, height profile (raised, recessed, or flat), and affected area (filled or outline). Our participants clearly preferred raised icons, and identified them with the highest accuracy and at competitive speeds. We also provide insights into icons that look very different, but are hard to distinguish via touch alone.},
keywords = {Full Paper, Interactivity/Demonstration},
pubstate = {published},
tppubtype = {inproceedings}
}
Textile surfaces, such as on sofas, cushions, and clothes, offer promising alternative locations to place controls for digital devices. Textiles are a natural, even abundant part of living spaces, and support unobtrusive input. While there is solid work on technical implementations of textile interfaces, there is little guidance regarding their design—especially their haptic cues, which are essential for eyes-free use. In particular, icons easily communicate information visually in a compact fashion, but it is unclear how to adapt them to the haptics-centric textile interface experience. Therefore, we investigated the recognizability of 84 haptic icons on fabrics. Each combines a shape, height profile (raised, recessed, or flat), and affected area (filled or outline). Our participants clearly preferred raised icons, and identified them with the highest accuracy and at competitive speeds. We also provide insights into icons that look very different, but are hard to distinguish via touch alone.
When XR and AI Meet - A Scoping Review on Extended Reality and Artificial Intelligence
Teresa Hirzle (University of Copenhagen), Florian Müller (LMU Munich), Fiona Draxler (LMU Munich), Martin Schmitz (Saarland University), Pascal Knierim (Universität Innsbruck, Bundeswehr University Munich), Kasper Hornbæk (University of Copenhagen)
Abstract | Tags: Full Paper | Links:
@inproceedings{Hirzle2023XR,
title = {When XR and AI Meet - A Scoping Review on Extended Reality and Artificial Intelligence},
author = {Teresa Hirzle (University of Copenhagen), Florian Müller (LMU Munich), Fiona Draxler (LMU Munich), Martin Schmitz (Saarland University), Pascal Knierim (Universität Innsbruck, Bundeswehr University Munich), Kasper Hornbæk (University of Copenhagen)},
doi = {10.1145/3544548.3581072},
year = {2023},
date = {2023-04-28},
urldate = {2023-04-28},
publisher = {ACM},
abstract = {Research on Extended Reality (XR) and Artificial Intelligence (AI) is booming, which has led to an emerging body of literature in their intersection. However, the main topics in this intersection are unclear, as are the benefits of combining XR and AI. This paper presents a scoping review that highlights how XR is applied in AI research and vice versa. We screened 2619 publications from 203 international venues published between 2017 and 2021, followed by an in-depth review of 311 papers. Based on our review, we identify five main topics at the intersection of XR and AI, showing how research at the intersection can benefit each other. Furthermore, we present a list of commonly used datasets, software, libraries, and models to help researchers interested in this intersection. Finally, we present 13 research opportunities and recommendations for future work in XR and AI research.},
keywords = {Full Paper},
pubstate = {published},
tppubtype = {inproceedings}
}
Research on Extended Reality (XR) and Artificial Intelligence (AI) is booming, which has led to an emerging body of literature in their intersection. However, the main topics in this intersection are unclear, as are the benefits of combining XR and AI. This paper presents a scoping review that highlights how XR is applied in AI research and vice versa. We screened 2619 publications from 203 international venues published between 2017 and 2021, followed by an in-depth review of 311 papers. Based on our review, we identify five main topics at the intersection of XR and AI, showing how research at the intersection can benefit each other. Furthermore, we present a list of commonly used datasets, software, libraries, and models to help researchers interested in this intersection. Finally, we present 13 research opportunities and recommendations for future work in XR and AI research.