The Discovery Gap: How Product Hunt Startups Vanish in LLM Organic Discovery Queries

TL;DR

This study investigates how new startups from Product Hunt are discovered by large language models like ChatGPT and Perplexity, revealing significant gaps in organic discovery and the limited impact of content optimization practices.

Contribution

The paper provides empirical evidence on the low success rates of LLMs in discovering startups through organic queries and highlights the importance of traditional SEO over content optimization for AI visibility.

Findings

High recognition of startups when named explicitly (94-99%)

Discovery success drops to 3-8% for general queries

Traditional SEO signals correlate with discovery, GEO does not

Abstract

When someone asks ChatGPT to recommend a project management tool, which products show up in the response? And more importantly for startup founders: will their newly launched product ever appear? This research set out to answer these questions. I randomly selected 112 startups from the top 500 products featured on the 2025 Product Hunt leaderboard and tested each one across 2,240 queries to two different large language models: ChatGPT (gpt-4o-mini) and Perplexity (sonar with web search). The results were striking. When users asked about products by name, both LLMs recognized them almost perfectly: 99.4% for ChatGPT and 94.3% for Perplexity. But when users asked discovery-style questions like "What are the best AI tools launched this year?" the success rates collapsed to 3.32% and 8.29% respectively. That's a gap of 30-to-1 for ChatGPT. Perhaps the most surprising finding was that Generative Engine Optimization (GEO), the practice of optimizing website content for AI visibility, showed no correlation with actual discovery rates. Products with high GEO scores were no more likely to appear in organic queries than products with low scores. What did matter? For Perplexity, traditional SEO signals like referring domains (r = +0.319, p < 0.001) and Product Hunt ranking (r = -0.286, p = 0.002) predicted visibility. After cleaning the Reddit data for false positives, community presence also emerged as significant (r = +0.395, p = 0.002). The practical takeaway is counterintuitive: don't optimize for AI discovery directly. Instead, build the SEO foundation first and LLM visibility will follow.