SHARCC

This project was made in cooperation with LUGG. They provided me with a HoloLens 2 and source code for Rikard Olajos’s ARCC, which was the base for this project. During my work I gained a better understanding of the importance of lighting in 3D simulations, and how big of a role Spherical Harmonics have played over the years in that field. Great source on that topic is Robin’s Green Spherical Harmonics Lighting: The gritty detail. This was also my first experience with creating an UWP application based on DirectX 11.

About the project

While Virtual Reality headsets completely cut the user off the real world surrounding, Augmented Reality, as the name suggests, augments it by displaying virtual content on top of it, allowing user to still be fully aware of the real world environment. Being able to place and interact with digital objects on a physical desk is truly a mesmerizing experience for the first time users, that seems to bridge the gap between physical and virtual space. However, as the amazement wears off, one can notice that the digital objects are often easily distinguishable and appear to be out of place when compared with their real world equivalents. One of the main reasons for this phenomena is lighting of the virtual scene, which often does not fully match the lighting from the physical environment, hence rendered objects tend to stand out to the user. In this work I investigated colour correction of objects rendered in AR, in order to provide a way to seamlessly blend them with the environment, hence improving the realism and immersion for the user of HoloLens 2.