Researchers at the Korea Advanced Institute of Science and Technology (KAIST) have unveiled ComiXR, a groundbreaking open-source platform that shifts the webtoon reading experience from flat smartphone screens into three-dimensional, extended reality (XR) spaces. Led by Ian Oakley, the team presented the project at the 2026 ACM Designing Interactive Systems Conference, showcasing how digital comics can be integrated directly into a user's physical surroundings.
By utilizing hardware like the Meta Quest Pro, the platform allows users to manipulate 3D assets, including characters, speech bubbles, and sound effects, within a real-world environment. The system utilizes advanced eye-tracking technology to manage narrative flow, ensuring that dialogue boxes only appear when a reader focuses their gaze on a specific character. This design choice not only adds a layer of interactivity but serves a practical purpose by preventing accidental spoilers during the reading process.
Beyond basic navigation, the platform incorporates sensory feedback, such as haptic sensations that mimic a character's heartbeat and visual effects triggered by the reader's own facial expressions. The research team has proposed four distinct layout concepts—Panel Gallery, Pop-up, Around Comic, and Inclusive ComiX—the latter of which is specifically engineered to improve accessibility for readers with visual impairments.
The development team emphasized that this technology is intended to act as a supplementary medium for education, exhibitions, and storytelling rather than a replacement for traditional mobile webtoons. To encourage further development and experimentation, the platform has been made available as an open-source resource for the public.
