Attacking Image Classifiers to Generate 3D Textures

Camilo Pestana, Ajmal Mian

Research output: Chapter in Book/Conference paperConference paperpeer-review


Deep learning has been successfully used for many 2D image synthesis tasks such as in-painting,super-resolution,and image-to-image translation. Generative tasks in the 3D space are also becoming popular such as 3D volume generation from images,image based styling and subsequent texture mapping on 3D meshes,and novel view synthesis from single/multiple views. These are mainly possible due to advances in differentiable rendering. Some recent works also suggest the feasibility of generative tasks on 2D images through adversarial attacks,a topic that remains largely unexplored in the 3D domain. This paper bridges the gap and shows the potential of adversarial attacks for the task of 3D texture generation. It proposes the first of its kind method to re-purpose visual classifiers trained on images for the task of generating realistic textures for 3D meshes without the need for style images,multi-view images or retraining. Instead,our schema uses a targeted adversarial attack to directly minimize the classification loss of an ensemble of models whose gradients are backpropagated to estimate the texture for an input 3D mesh. We show promising results on 3D meshes and also propose a metric to evaluate the texture quality.

Original languageEnglish
Title of host publicationProceedings - 2021 International Conference on 3D Vision, 3DV 2021
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages10
ISBN (Electronic)9781665426886
Publication statusPublished - 2021
Event9th International Conference on 3D Vision, 3DV 2021 - Virtual, Online, United Kingdom
Duration: 1 Dec 20213 Dec 2021

Publication series

NameProceedings - 2021 International Conference on 3D Vision, 3DV 2021


Conference9th International Conference on 3D Vision, 3DV 2021
Country/TerritoryUnited Kingdom
CityVirtual, Online


Dive into the research topics of 'Attacking Image Classifiers to Generate 3D Textures'. Together they form a unique fingerprint.

Cite this