UC Berkeley

Implicit model has emerged as a promising representation for numerous applications, including signal processing, image representation as well as 3D modeling. In thisthesis, we will showcase its applications in three domains. First, we show that implicit representation could aid single view surface reconstruction of scenes by learning from a large collections of indoor scene data, and generalize well to unseen indoor scenes. Second, we show that implicit modeling can facilitate grounding of the language query in the 3D space. Lastly, we show that neural relighting, a type of algorithm that incorporates the neural field for modeling the light field, could achieve promising results. On one hand, by incorporating the pre-computed radiance transfer into the neural radiance modeling, we can enable handling of the type of materials with subsurface scattering effects. A hypernet-based representation could further facilitate fast image-based relighting. On the other hand, by carefully modeling the local microgeometry with the surface normal modeling, as well as incorporating various hints for lighting reflection and self reflection, we could faithfully recover reflection highlights with varying material roughnesses.