Realistic Reflections and Refractions on Graphics Hardware With Hybrid Rendering and Layered Environment Maps

We introduce hybrid rendering, a scheme that dynamically ray traces the local geometry of reflective and refractive objects, but approximates more distant geometry by hardware-supported environment maps (EMs). To limit computation, we use a greedy ray path shading model that prunes the binary ray tree generated by refractive objects to form just two ray paths. We also restrict ray queries to triangle vertices, but perform adaptive tessellation to shoot additional rays where neighboring ray paths differ sufficiently. By using layered, parameterized EMs that are inferred over a set of viewpoint samples to match ray traced imagery, we accurately handle parallax and view-dependent shading in the environment. We increase robustness of EMs by inferring them simultaneously across multiple viewpoints and including environmental geometry that is occluded from the viewpoint sample but is revealed in nearby viewpoints. We demonstrate realistic shiny and glass objects with a user-controlled viewpoint.