When flying to another destination, the KLM Take Off Tips Holobar allows you to get tips from locals that sit at the bar at your destination.
To achieve a more personal conversation, instead of sitting in front of a computer or looking at a mobile phone, the Holobar allows you to have a conversation as if sitting at a bar. This means that the person you are talking to 'blends' into the surroundings: you are talking with a hologram.
My role in this projects was to come up with a system that enhances the holographic effect, Instead of just projecting a video into a holographic fabric. For this I came up with a system that uses face tracking and subsequently moves the camera on the other side of the conversation, including the lighting.
When a person moves his/her head, you would expect a slight change in perspective of the person you are looking at. With a traditional videochat, only the perspective of the screen changes, not of the person on the screen. With the developed system you would actually get a slight perspective change when you would move your head. To amplify this effect, the lighting was dynamic as well: allowing for extra dramatized change in lighting/shadows.
For this I developed a system that does facetracking and sends this data to the other bars location and vice versa. On the receiving site this data is translated to the movement of a servo connected to the camera and to the adjustment of adressable lighting.