Controlling Neural Style Transfer with Deep Reinforcement Learning

• URL: http://arxiv.org/abs/2310.00405v1
• Date: Sat, 30 Sep 2023 15:01:02 GMT
• Title: Controlling Neural Style Transfer with Deep Reinforcement Learning
• Authors: Chengming Feng, Jing Hu, Xin Wang, Shu Hu, Bin Zhu, Xi Wu, Hongtu Zhu and Siwei Lyu
• Abstract summary: We propose the first deep Reinforcement Learning based architecture that splits one-step style transfer into a step-wise process. Our method tends to preserve more details and structures of the content image in early steps, and synthesize more style patterns in later steps.
• Score: 55.480819498109746
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Controlling the degree of stylization in the Neural Style Transfer (NST) is a little tricky since it usually needs hand-engineering on hyper-parameters. In this paper, we propose the first deep Reinforcement Learning (RL) based architecture that splits one-step style transfer into a step-wise process for the NST task. Our RL-based method tends to preserve more details and structures of the content image in early steps, and synthesize more style patterns in later steps. It is a user-easily-controlled style-transfer method. Additionally, as our RL-based model performs the stylization progressively, it is lightweight and has lower computational complexity than existing one-step Deep Learning (DL) based models. Experimental results demonstrate the effectiveness and robustness of our method.

Related papers

Err

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.