Raply: A profanity-mitigated rap generator
Omar Manil Bendali, Samir Ferroum, Ekaterina Kozachenko, Youssef, Parviz, Hanna Shcharbakova, Anna Tokareva, Shemair Williams

TL;DR
This paper introduces Raply, a fine-tuned GPT-2 model that generates meaningful rap lyrics with complex rhymes while reducing offensive language, marking the first effort to mitigate profanity in rap lyric generation.
Contribution
The paper presents a novel profanity-mitigated rap lyric generation model based on fine-tuning GPT-2 with a new profanity-mitigated dataset, improving both rhyme quality and content appropriateness.
Findings
Achieved high rhyme density in generated lyrics.
Successfully reduced profanity content in outputs.
First approach to profanity mitigation in rap lyric generation.
Abstract
The task of writing rap is challenging and involves producing complex rhyming schemes, yet meaningful lyrics. In this work, we propose Raply, a fine-tuned GPT-2 model capable of producing meaningful rhyming text in the style of rap. In addition to its rhyming capabilities, the model is able to generate less offensive content. It was achieved through the fine-tuning the model on a new dataset Mitislurs, a profanity-mitigated corpus. We evaluate the output of the model on two criteria: 1) rhyming based on the rhyme density metric; 2) profanity content, using the list of profanities for the English language. To our knowledge, this is the first attempt at profanity mitigation for rap lyrics generation.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSwearing, Euphemism, Multilingualism · Hate Speech and Cyberbullying Detection · Phonetics and Phonology Research
MethodsRefunds@Expedia|||How do I get a full refund from Expedia? · Linear Layer · Weight Decay · Discriminative Fine-Tuning · Multi-Head Attention · Residual Connection · Attention Is All You Need · Softmax · Byte Pair Encoding · Cosine Annealing
