Mixed-Reality Metaverse – A Collaborative Platform for Social Learning, Social Emotional Intelligence, and Work-Based Learning

by Marjorie Zielke

In this poster we present combined research from 1) a funded NSF Cyberlearning grant (No.1917994); 2) a submitted NSF Smart and Connected Communities grant proposal; and 3) research in 5G networks. The Mixed-Reality (MR) Metaverse concept consists of augmented reality (AR) educational experiences with virtual humans and provides an innovative resource for collaborative social learning, work-based learning, and social-emotional intelligence (SEI). High-fidelity conversational and emotive virtual humans may be used to provide accessible alternatives to teachers, peers, patients, and training partners through novel social learning paradigms such as co-located and distributed AR. In co-located AR, multiple users can share learning experiences while located next to each other; and in distributed AR users can collaborate remotely. To accurately measure user emotions and other physiological responses we propose integrating wearable biometric sensing devices such as the Empatica E4 wristband into the MR Metaverse. The MR Metaverse needs a strong networking backbone, such as high-speed low-latency 5G networks that support artificial intelligence, sensor-driven user data, and millions of users. These technologies combined may evolve into a MR Metaverse of connected users and virtual counterparts, creating new learning paradigms as robust social learning and workplace learning experiences become easily accessible and highly customizable.

Poster/Demo link.