Multimodal User Interfaces and Experiences: Challenges, Applications, and Perspectives—2nd Edition

Special Issue Editors

Faculty of Psychology, Beijing Normal University, Beijing 100875, China
Interests: human–computer interaction; user experience; tangible interaction; engineering psychology
Special Issues, Collections and Topics in MDPI journals

E-Mail Website
Guest Editor
TD School, University of Technology Sydney, Broadway, Ultimo, NSW 2007, Australia
Interests: design thinking; organizational culture; innovation management; prototyping
Special Issues, Collections and Topics in MDPI journals

E-Mail Website
Guest Editor
Department of Transdisciplinary Science and Engineering, Tokyo Institute of Technology, Tokyo 152-8550, Japan
Interests: human-centered design; urban/rural sociology; qualitative research; engineering education
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

Our previous Special Issue, entitled “Multimodal User Interfaces and Experiences: Challenges, Applications, and Perspectives” (https://www.mdpi.com/journal/mti/special_issues/F24T6HSRT9), was a successful compilation of research and review articles. As this is a rapidly evolving topic, we would like to further explore multimodal user interfaces and experiences with a follow-up Special Issue.

This Special Issue aims to explore the challenges and opportunities of understanding, designing, and evaluating user experience (UX) across and beyond disciplines. By soliciting contributions from theoretical and practical perspectives that explicitly address the exploration and evaluation of user interfaces and experiences, we will envision the future directions of UX/HCI research on multimodal technologies and the application of user-friendly interfaces. The context includes but is not limited to education, healthcare, transportation, finance, and environmental protection. In particular, we are interested in contributions addressing the research through design approach and the intersection between applied psychology, human–computer interaction (HCI), cognitive neuroscience, anthropology, and design, such as transdisciplinary teaching to specific student groups, digitalized child/elderly/patient care services, car/train/aircraft human–machine interfaces (HMIs), mobile banking applications, carbon peaking and carbon neutrality strategies.

We encourage authors to submit original research articles, works in progress, surveys, reviews, and viewpoint articles, presenting transdisciplinary frameworks, methods, and practices that may significantly impact the field for years to come. Topics of interest include, but are not limited to, the following:

  • Transdisciplinary teaching and learning;
  • Design thinking, doing, and tinkering;
  • Human factors and applied psychology;
  • Kansei, emotional, and affective engineering;
  • Psychological and digital wellbeing;
  • Clinical and counseling psychology;
  • Psychological and behavioral big data;
  • Brand, advertising, and consumer psychology;
  • Measurement and human resources;
  • Interaction design qualities and guidelines;
  • Usability evaluation methods;
  • Emerging and multimodal technologies;
  • Augmented, mixed, and extended realities;
  • Inclusion, resilience, and new normal;
  • Creativity, innovation, and entrepreneurship;
  • Human-centered design (HCD);
  • User experience design (UXD);
  • Emotion-driven design (EDD);
  • Collaborative design (Co-Design);
  • Industrial design (ID);
  • NeuroDesign (ND).

Dr. Wei Liu
Dr. Jan Auernhammer
Dr. Takumi Ohashi
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Multimodal Technologies and Interaction is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 1600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • transdisciplinary teaching and learning
  • design thinking, doing, and tinkering
  • human factors and applied psychology
  • kansei, emotional, and affective engineering
  • psychological and digital wellbeing
  • clinical and counseling psychology
  • psychological and behavioral big data
  • brand, advertising, and consumer psychology
  • measurement and human resources
  • interaction design qualities and guidelines
  • usability evaluation methods
  • emerging and multimodal technologies
  • augmented, mixed, and extended realities
  • inclusion, resilience, and new normal
  • creativity, innovation, and entrepreneurship
  • human-centered design (HCD)
  • user experience design (UXD)
  • emotion-driven design (EDD)
  • collaborative design (Co-Design)
  • industrial design (ID)
  • neurodesign (ND)

Benefits of Publishing in a Special Issue

  • Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
  • Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
  • Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
  • External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
  • e-Book format: Special Issues with more than 10 articles can be published as dedicated e-books, ensuring wide and rapid dissemination.

Further information on MDPI's Special Issue polices can be found here.

Published Papers (2 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

Jump to: Review

17 pages, 4004 KiB  
Article
Designing a Tactile Document UI for 2D Refreshable Tactile Displays: Towards Accessible Document Layouts for Blind People
by Sara Alzalabny, Omar Moured, Karin Müller, Thorsten Schwarz, Bastian Rapp and Rainer Stiefelhagen
Multimodal Technol. Interact. 2024, 8(11), 102; https://doi.org/10.3390/mti8110102 - 8 Nov 2024
Viewed by 562
Abstract
Understanding document layouts is vital for enhancing document exploration and information retrieval for sighted individuals. However, for blind and visually impaired people, it becomes challenging to have access to layout information using typical assistive technologies such as screen readers. In this paper, we [...] Read more.
Understanding document layouts is vital for enhancing document exploration and information retrieval for sighted individuals. However, for blind and visually impaired people, it becomes challenging to have access to layout information using typical assistive technologies such as screen readers. In this paper, we examine the potential benefits of presenting documents on two-dimensional (2D) refreshable tactile displays. These displays enable the tactile perception of 2D data, offering the advantage of dynamic and interactive functionality. Despite their potential, the development of user interfaces (UIs) for such displays has not advanced significantly. Thus, we propose a design of an intelligent tactile user interface (TUI), incorporating touch and audio feedback to represent documents in a tactile format. Our exploratory study for evaluating this approach revealed satisfaction from participants with the experience of directly viewing documents in their true form, rather than relying on screen-reading interpretations. Additionally, participants offered recommendations for incorporating additional features and refining the approach in future iterations. To facilitate further research and development, we have made our dataset and models publicly available. Full article
Show Figures

Graphical abstract

Review

Jump to: Research

46 pages, 782 KiB  
Review
A Comprehensive Review of Multimodal XR Applications, Risks, and Ethical Challenges in the Metaverse
by Panagiotis Kourtesis
Multimodal Technol. Interact. 2024, 8(11), 98; https://doi.org/10.3390/mti8110098 - 6 Nov 2024
Viewed by 1149
Abstract
This scoping review examines the broad applications, risks, and ethical challenges associated with Extended Reality (XR) technologies, including Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), within the context of Metaverse. XR is revolutionizing fields such as immersive learning in education, [...] Read more.
This scoping review examines the broad applications, risks, and ethical challenges associated with Extended Reality (XR) technologies, including Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR), within the context of Metaverse. XR is revolutionizing fields such as immersive learning in education, medical and professional training, neuropsychological assessment, therapeutic interventions, arts, entertainment, retail, e-commerce, remote work, sports, architecture, urban planning, and cultural heritage preservation. The integration of multimodal technologies—haptics, eye-, face-, and body tracking, and brain–computer interfaces—enhances user engagement and interactivity, playing a key role in shaping the immersive experiences in the Metaverse. However, XR’s expansion raises serious concerns, including data privacy risks, cybersecurity vulnerabilities, cybersickness, addiction, dissociation, harassment, bullying, and misinformation. These psychological, social, and security challenges are further complicated by intense advertising, manipulation of public opinion, and social inequality, which could disproportionately affect vulnerable individuals and social groups. This review emphasizes the urgent need for robust ethical frameworks and regulatory guidelines to address these risks while promoting equitable access, privacy, autonomy, and mental well-being. As XR technologies increasingly integrate with artificial intelligence, responsible governance is essential to ensure the safe and beneficial development of the Metaverse and the broader application of XR in enhancing human development. Full article
Show Figures

Figure 1

Back to TopTop