Brainlab - Exactrac (Magic Leap and PC Remote Play)

Brainlab - Exactrac (Magic Leap and PC Remote Play)

This project was initially meant to be a product demo for Brainlab's Exactrac hardware utilizing the Magic Leap augmented reality headset. After a successful launch of the Magic Leap project, COVID-19 came about which made it hard to demo. As a result, the product was approved for a second version which is streamed to a clients browser via cloud server.

I was the sole technical artist on this project which meant handling all the visual effects that appear on screen. These include but were not limited to

-Patient and hardware fade in and out FX
-Xray scanning of the head FX
-Xray beams
-Laser beam
-Surface Projection Patient layer (pulled out of the patient)
-Heat projection Patient layer (pulled out of the patient)
-bone layer (pulled out of the patient)
-Thermal camera image for the UI (seen in the top right during treatment)
-Positioning camera image for the UI (seen on the main UI screen during the positioning phase)
-Creating shaders for the projection pattern on the patient / patient table
-Creating shaders for the camera projection FX
-Particle events for successful grab and placement of mask events.
-Setting up Depth of filed layering system.
-Setting up Post processing.
-Assisting 3D team in light baking,reflection probe/ light probe placement and lightmap artifact debugging.
-Assisted engineering team to get remote play streaming working well with the depth of field camera system.
-Created dynamic scripts to track distance to patient and just depth of field values for consistent visuals.
-Testing capabilities of the Magic Leap hardware.

Team acknowledgements

Special thanks to all the team members that helped complete this project.
-Dan Laduca (3D and Client Team Art Lead)
-Paul Bellinghiere (Lead Programmer)
-Jeff Linville (Audio Engineer)
-Bob Nelson (Senior 2D UI)
-Andrew Johnson (Senior 2D UI)
-Jess Clark (Junior 3D)
-Sara Wong (Junior 2D)