Rhyme-aware Chinese Lyric Generator Based On GPT
Yuan Yixiao, Huang Yangchen, Ma Yu, Li Xinjin, Li Zhenglin, Shi Yiming, Zhou Huapeng. Arxiv 2024
[Paper]
Neural language representation models such as GPT, pre-trained on large-scale corpora, can effectively capture rich semantic patterns from plain text and be fine-tuned to consistently improve natural language generation performance. However, existing pre-trained language models used to generate lyrics rarely consider rhyme information, which is crucial in lyrics. Using a pre-trained model directly results in poor performance. To enhance the rhyming quality of generated lyrics, we incorporate integrated rhyme information into our model, thereby improving lyric generation performance.
Similar Work