LLMs for Customized Marketing Content Generation and Evaluation at Scale
Haoran Liu, Amir Tahmasbi, Ehtesham Sam Haque, Purak Jain

TL;DR
This paper introduces MarketingFM, a retrieval-augmented system for generating targeted marketing content, and AutoEval systems for automated evaluation, significantly improving ad performance and reducing human effort in content creation and assessment.
Contribution
The paper presents MarketingFM for keyword-specific ad copy generation and AutoEval-Main and AutoEval-Update for automated, scalable evaluation aligned with marketing principles.
Findings
Keyword-focused ad copy outperforms templates with up to 9% higher CTR.
AutoEval-Main achieves 89.57% agreement with human reviewers.
AutoEval-Update reduces manual effort while maintaining evaluation quality.
Abstract
Offsite marketing is essential in e-commerce, enabling businesses to reach customers through external platforms and drive traffic to retail websites. However, most current offsite marketing content is overly generic, template-based, and poorly aligned with landing pages, limiting its effectiveness. To address these limitations, we propose MarketingFM, a retrieval-augmented system that integrates multiple data sources to generate keyword-specific ad copy with minimal human intervention. We validate MarketingFM via offline human and automated evaluations and large-scale online A/B tests. In one experiment, keyword-focused ad copy outperformed templates, achieving up to 9% higher CTR, 12% more impressions, and 0.38% lower CPC, demonstrating gains in ad ranking and cost efficiency. Despite these gains, human review of generated ads remains costly. To address this, we propose AutoEval-Main,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
