A Review of Text Style Transfer using Deep Learning
- URL: http://arxiv.org/abs/2109.15144v1
- Date: Thu, 30 Sep 2021 14:06:36 GMT
- Title: A Review of Text Style Transfer using Deep Learning
- Authors: Martina Toshevska, Sonja Gievska
- Abstract summary: Text style transfer is a task of adapting and/or changing the stylistic manner in which a sentence is written.
We point out the technological advances in deep neural networks that have been the driving force behind current successes in the fields of natural language understanding and generation.
The review is structured around two key stages in the text style transfer process, namely, representation learning and sentence generation in a new style.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Style is an integral component of a sentence indicated by the choice of words
a person makes. Different people have different ways of expressing themselves,
however, they adjust their speaking and writing style to a social context, an
audience, an interlocutor or the formality of an occasion. Text style transfer
is defined as a task of adapting and/or changing the stylistic manner in which
a sentence is written, while preserving the meaning of the original sentence.
A systematic review of text style transfer methodologies using deep learning
is presented in this paper. We point out the technological advances in deep
neural networks that have been the driving force behind current successes in
the fields of natural language understanding and generation. The review is
structured around two key stages in the text style transfer process, namely,
representation learning and sentence generation in a new style. The discussion
highlights the commonalities and differences between proposed solutions as well
as challenges and opportunities that are expected to direct and foster further
research in the field.
Related papers
- Don't lose the message while paraphrasing: A study on content preserving
style transfer [61.38460184163704]
Content preservation is critical for real-world applications of style transfer studies.
We compare various style transfer models on the example of the formality transfer domain.
We conduct a precise comparative study of several state-of-the-art techniques for style transfer.
arXiv Detail & Related papers (2023-08-17T15:41:08Z) - MSSRNet: Manipulating Sequential Style Representation for Unsupervised
Text Style Transfer [82.37710853235535]
Unsupervised text style transfer task aims to rewrite a text into target style while preserving its main content.
Traditional methods rely on the use of a fixed-sized vector to regulate text style, which is difficult to accurately convey the style strength for each individual token.
Our proposed method addresses this issue by assigning individual style vector to each token in a text, allowing for fine-grained control and manipulation of the style strength.
arXiv Detail & Related papers (2023-06-12T13:12:29Z) - Conversation Style Transfer using Few-Shot Learning [56.43383396058639]
In this paper, we introduce conversation style transfer as a few-shot learning problem.
We propose a novel in-context learning approach to solve the task with style-free dialogues as a pivot.
We show that conversation style transfer can also benefit downstream tasks.
arXiv Detail & Related papers (2023-02-16T15:27:00Z) - Audience-Centric Natural Language Generation via Style Infusion [5.6732899077715375]
We propose the novel task of style infusion - infusing the stylistic preferences of audiences in pretrained language generation models.
We leverage limited pairwise human judgments to bootstrap a style analysis model and augment our seed set of judgments.
Our infusion approach can generate compelling stylized examples with generic text prompts.
arXiv Detail & Related papers (2023-01-24T19:57:50Z) - StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse
Representations and Content Enhancing [73.81778485157234]
Long texts usually involve more complicated author linguistic preferences such as discourse structures than sentences.
We formulate the task of non-parallel story author-style transfer, which requires transferring an input story into a specified author style.
We use an additional training objective to disentangle stylistic features from the learned discourse representation to prevent the model from degenerating to an auto-encoder.
arXiv Detail & Related papers (2022-08-29T08:47:49Z) - From Theories on Styles to their Transfer in Text: Bridging the Gap with
a Hierarchical Survey [10.822011920177408]
Style transfer aims at re-writing existing texts and creating paraphrases that exhibit desired stylistic attributes.
A handful of surveys give a methodological overview of the field, but they do not support researchers to focus on specific styles.
We organize them into a hierarchy, highlighting the challenges for the definition of each of them, and pointing out gaps in the current research landscape.
arXiv Detail & Related papers (2021-10-29T15:53:06Z) - Deep Learning for Text Style Transfer: A Survey [71.8870854396927]
Text style transfer is an important task in natural language generation, which aims to control certain attributes in the generated text.
We present a systematic survey of the research on neural text style transfer, spanning over 100 representative articles since the first neural text style transfer work in 2017.
We discuss the task formulation, existing datasets and subtasks, evaluation, as well as the rich methodologies in the presence of parallel and non-parallel data.
arXiv Detail & Related papers (2020-11-01T04:04:43Z) - Improving Disentangled Text Representation Learning with
Information-Theoretic Guidance [99.68851329919858]
discrete nature of natural language makes disentangling of textual representations more challenging.
Inspired by information theory, we propose a novel method that effectively manifests disentangled representations of text.
Experiments on both conditional text generation and text-style transfer demonstrate the high quality of our disentangled representation.
arXiv Detail & Related papers (2020-06-01T03:36:01Z) - Review of Text Style Transfer Based on Deep Learning [14.376596231697043]
In the traditional text style transfer model, the text style is relied on by experts knowledge and hand-designed rules.
With the application of deep learning in the field of natural language processing, the text style transfer method based on deep learning started to be heavily researched.
This article summarizes the research on the text style transfer model based on deep learning in recent years, and summarizes, analyzes and compares the main research directions and progress.
arXiv Detail & Related papers (2020-05-06T15:35:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.