Rendering Neural Materials on Curved Surfaces

Abstract

Neural material reflectance representations address some limitations of traditional analytic BRDFs with parameter textures; they can theoretically represent any material data, whether a complex synthetic microgeometry with displacements, shadows and interreflections, or real measured reflectance. However, they still approximate the material on an infinite plane, which prevents them from correctly handling silhouette and parallax effects for viewing directions close to grazing. The goal of this paper is to design a neural material representation capable of correctly handling such silhouette effects. We extend the neural network query to take surface curvature information as input, while the query output is extended to return a transparency value in addition to reflectance. We train the new neural representation on synthetic data that contains queries spanning a variety of surface curvatures. We show an ability to accurately represent complex silhouette behavior that would traditionally require more expensive and less flexible techniques, such as on-the-fly geometry displacement or ray marching.

Download

Paper
Code (coming soon)

Video

Bibtex

@article{kuznetsov2022,
    title = {Rendering Neural Materials on Curved Surfaces},
    author = {Kuznetsov, Alexandr and Wang, Xuezheng and Mullia, Krishna 
               and Luan, Fujun and Xu, Zexiang and Ha\v{s}an, Milo\v{s} 
               and Ramamoorthi, Ravi},
    journal = {SIGGRAPH '22 Conference Proceedings},
    year = {2022},
    numpages = {9},
    doi = {10.1145/3528233.3530721},
}