Real-time neural face relighting for AR. Estimates environment lighting from the scene and re-renders the face under new illumination using OpenCV and OpenGL.
Real-time pipeline that captures an image, reconstructs the face in 3D, and re-renders it under user-specified illumination — bridging classical computer vision with real-time graphics for AR applications.
techniques
MediaPipe — 3D feature extraction of the face mesh
Open3D — point-cloud → surface reconstruction
OpenCV — computer-vision-based image processing
OpenGL — real-time relighting and overlay
gallery
MediaPipe — 3D feature extraction creating the face point cloud
