Original WebGL fisheye lens dewarp proof-of-concept
WebGL / Three.js / MediaPipe
This demo proved the Magic Window concept could be implemented in emerging web capabilities at the time (2014), including 3D GPU acceleration, WebRTC video conferencing, and mixed reality 3D content integration. The demo performs per-pixel fisheye correction in real time and supports both manual camera control and webcam-based tracked viewing.
One of the original cameras used in early prototypes.
This is an example fisheye image captured at the Aware Home at Georgia Tech. To see the dewarped version, interact with the demo.
This demonstration is a slightly refreshed presentation of the original Magic Window WebGL fisheye lens dewarp proof-of-concept work. The original demo was developed in 2014-2015 as part of the Magic Window project, a research initiative at the Georgia Tech Institute for People and Technology and Research Network Operations Center (RNoC).
Initially the project's technology stack had already been identified. However, a colleague and I decided to secretly work on this web-based approach in our spare time. When it turned out to be a viable path forward, we presented it to the rest of the team and ultimately we all decided to change course to this new approach. The rest is history.
This refreshed demo packages the original technical work with updated user controls, including that the Microsoft Kinect based tracking has been replaced with modern Google MediaPipe for tracked-view interaction.