Texture Transfer Using Geometry Correlation

Tom Mertens, Jan Kautz, Jiawen Chen, Philippe Bekaert and Frédo Durand

In proceedings of Eurographics Symposium on Rendering, Nicosia, Cyprus, June 26-28, 2006.



Abstract

Texture variation on real-world objects often correlates with underlying geometric characteristics and creates a visually rich appearance. We present a technique to transfer such geometry-dependent texture variation from an example textured model to new geometry in a visually consistent way. It captures the correlation between a set of geometric features, such as curvature, and the observed diffuse texture. We perform dimensionality reduction on the overcomplete feature set which yields a compact guidance field that is used to drive a spatially varying texture synthesis model. In addition, we introduce a method to enrich the guidance field when the target geometry strongly differs from the example. Our method transfers elaborate texture variation that follows geometric features, which gives 3D models a compelling photorealistic appearance.

Downloads

Scanned data: please visit this page
Paper (1.2Mb) [PDF]
Supplementary Material (.4Mb) [PDF]
PowerPoint Slides [PPT]
Video (21.5Mb) [MPEG-4]
Video (23.2Mb) [DivX]

Acknowledgments

We thank Carlos Hernández Esteban and Francis Schmitt for sharing their 3D models online. We would like to thank the following people for their help: Jon Chu, Eugene Hsu, Hendrik Lensch, Frank Van Reeth and Tiffany Wang. Bruno Lévy was so kind to provide his mesh parameterization tool (Graphite). Tom Mertens received a research fellowship from the Belgian American Educational Foundation. Part of this work was realized while Tom Mertens was a PhD student at the Expertise Centre for Digital Media (Hasselt University). Jan Kautz was supported in part by an Emmy-Noether fellowship from the German Research Foundation for his stay at MIT. Philippe Bekaert received financial support from the European Regional Development Fund and the Flemish Interdisciplinary Institute for Broadband Communication. This work was supported by a National Science Foundation CAREER award 0447561 "Transient Signal Processing for Realistic Imagery", an NSF Grant No. 0429739 "Parametric Analysis and Transfer of Pictorial Style", and a Microsoft Research New Faculty Fellowship held by Frédo Durand.


Back to Tom Mertens' home page