Generating Artistic Portrait Drawings from Images
Published in AAAI 2024, 2024
Abstract: This chapter addresses generating artistic portrait drawings (APDrawings) from images, and we focus on two methods based on generative adversarial networks (GANs). We first introduce the genre of portrait line drawings, and review some existing methods for generating them from images. We also describe the Artistic Portrait Drawing (APDrawing) dataset, which contains 140 high-resolution face photos and corresponding portrait drawings executed by a professional artist. We then describe the APDrawingGAN method, which is a hierarchical GAN model that learns from paired data of face photos and portrait drawings, and the QMUPD method, which can learn from unpaired data of face photos and drawing. APDrawingGAN uses a novel distance transform loss to learn stroke lines in the drawings, and a local transfer loss to capture different drawing styles for different facial regions. QMUPD uses an asymmetric cycle mapping to preserve important facial features, and a quality metric to guide the generation towards high-quality drawings. We further introduce some recent developments which are based on multiple scale analysis, 3D information and multi-modal information. Finally, we describe the evaluation of artistic portrait drawings, which is a challenging task since there are many possible drawings that would be considered by experts to be acceptable.
Recommended citation:Yi, R., Liu, YJ., Lai, YK., Rosin, P.L. (2024). Generating Artistic Portrait Drawings from Images. In: Lyu, Z. (eds) Applications of Generative AI. Springer, Cham. https://doi.org/10.1007/978-3-031-46238-2_22