Sharing the Extra Dimension

2025.2 - 2025.5

Virtual identity, real-world connection

Interactive Installation, Unreal Engine, Motion Capture

This interactive installation is a part of my master’s thesis project. It aims to explore and demonstrate the potential of virtual identities as a medium for collaborative content creation and community engagement, both online and in the physical world.

My inspiration comes from Japanese popular culture, where communities actively participate in the production and consumption of derivative works and fan-made content. This practice blurs the line between creators and audiences. With advancements in 3D computer graphics and motion capture, the concept of “VTuber” takes this relationship further. It leverages the unique duality of fictional settings and relatable real-life experiences to foster strong community connections and provide individuals with greater creative freedom in self-expression.

In this installation, each participant builds upon the previous person’s work, creating content collaboratively and iteratively, expanding the possibilities of face-to-face interactions.

Virtual Identity: Bridging the Gap Between Real and Virtual

In this immersive experience, participants can exist in the same space and time through a virtual identity. An Azure Kinect depth camera captures real-time motion, which is then sent and retargeted to the virtual identity of the participant’s choice within Unreal Engine.

Participants can also record their own motion using a web interface, which is automatically saved and replayed in the scene. This feature allows them to observe the virtual identities and motions of previous participants, fostering a sense of belonging and interaction even in the absence of real-time, face-to-face social interaction.

Real-time 3D: Unleashing Creativity in Derivative Works

Derivative works play a crucial role in Japanese popular culture, contributing to the vibrant community dynamic. These works, such as clips, compilations, and subtitles, enhance the original media’s format and expand its reach. Unlike traditional 2D media, real-time 3D offers significantly greater possibilities for derivative works. Since most elements, including the perspective, visual effects, and even the scene itself, are not fixed and can be easily manipulated.

This installation leverages this strength to provide participants with greater creative control. By using a game controller, participants can adjust the camera angle and post-process effects, allowing them to contribute to the collective content through another channel.

Enlin Li

Brooklyn, New York, United States