20 March 2024 Stylized neural painting with dynamic stroke allocation
Yuan Qin, Xiaoman Liang, Yaqi Sun, Mugang Lin, Fachao Zhang, Bofeng Long, Tongzhe Liu
Author Affiliations +
Abstract

In traditional stroke-based image-to-painting techniques, strokes are often repeated in already drawn areas, resulting in ineffective rendering, low utilization of strokes, and low image quality. This paper presents an approach for image-to-painting that dynamically assigns strokes based on the intrinsic characteristics of different regions in the target image. The proposed method uses an estimation technique to determine the amount of information in different image regions to generate a sequence of content richness. The number of strokes is then dynamically assigned based on the sequence of content richness, which results in a sequence of strokes. Afterward, the distribution of strokes on the canvas is flexibly adjusted based on their sequence, allowing for the accurate rendering of the target image. In addition, the original network model is optimized and improved to make the stroke rendering more accurate and thus obtain a final result that better fits the input image. The experimental results show that the proposed approach can scientifically allocate strokes based on the inherent differences in different image regions, which leads to effective rendering, improved utilization of strokes, and higher visual performance. Furthermore, many indicators, such as the peak signal-to-noise ratio, structural similarity, and Learned Perceptual Image Patch Similarity demonstrate higher image quality compared with those obtained by traditional technologies.

© 2024 SPIE and IS&T
Yuan Qin, Xiaoman Liang, Yaqi Sun, Mugang Lin, Fachao Zhang, Bofeng Long, and Tongzhe Liu "Stylized neural painting with dynamic stroke allocation," Journal of Electronic Imaging 33(2), 023028 (20 March 2024). https://doi.org/10.1117/1.JEI.33.2.023028
Received: 20 September 2023; Accepted: 28 February 2024; Published: 20 March 2024
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image quality

Artificial intelligence

Image processing

Evolutionary algorithms

Visualization

Image analysis

Network architectures

Back to Top