GEO Strategy

Where Do LLMs Get Their Information? The Complete Source Guide

Genmark AI Team15 minutesPublished · Updated
LLMsAI Training DataRedditWikipediaQuoraGEO

Understanding where Large Language Models (LLMs) like ChatGPT and Gemini source their information is crucial for AI visibility. If you want to be cited in AI responses, you need to be present where AI systems learn. Here is what the evidence actually shows about LLM training data sources and how to optimize for each.

The short answer: LLMs source their information from two places. The first is training data: mostly filtered web crawls such as Common Crawl, plus Wikipedia, books, academic papers and code. The second, for assistants with search turned on, is live web pages retrieved at answer time by search crawlers such as OpenAI's OAI-SearchBot, PerplexityBot and Anthropic's Claude-SearchBot, or from search indexes such as Google's and Bing's. Training data shapes what a model "knows." Retrieval decides which pages it cites today. To check which sources a given answer used, see How to See Which Sources an AI Answer Used.

The Big Picture: How LLMs Are Trained

LLMs learn by processing enormous quantities of text from across the web and curated sources. The exact datasets vary by model and provider, and most do not publish their full training data composition. What researchers and public technical reports have documented:

Common Crawl is the dominant raw dataset used by most major LLMs. It is a nonprofit that crawls the public web and releases petabyte-scale snapshots. A Mozilla Foundation review (February 2024) of 47 LLMs for text generation published between 2019 and October 2023 found that at least 64% used some filtered version of Common Crawl for pre-training.

Wikipedia is explicitly included in the training data of most major models because it provides structured, reliable factual content across millions of topics. GPT-3's original technical paper listed Wikipedia as one of its explicitly included sources.

Books and academic papers are standard inclusions, contributing depth on specialized topics.

Code repositories (primarily GitHub) are included by models designed to handle programming tasks.

Curated high-quality text is often added through processes like Reinforcement Learning from Human Feedback (RLHF) to improve response quality.

The "60-70% from web crawls" figure that appears in many articles is a rough generalization. The actual ratio varies substantially by model and is not publicly verified for most frontier models.

Platform Deep Dives: Optimization Strategies

Wikipedia: The Foundation of AI Knowledge

Why It Matters:

  • Explicitly included in most major LLM training datasets
  • Structured, cross-referenced factual content
  • High trust signal due to editorial standards
  • Available in multiple languages

Wikipedia's English edition surpassed 7 million articles in May 2025 and as of November 2026 contains over 7.2 million articles with more than 5.2 billion words (Wikipedia:Size of Wikipedia). Its scale and editorial standards make it one of the most consistently cited sources across AI platforms.

Optimization Strategy:

  1. Create Notable Brand Presence

    • Meet Wikipedia notability guidelines (requires independent third-party coverage, set by Wikipedia's standards, not a marketing decision)
    • Gather verifiable third-party coverage
    • Build verifiable achievements
  2. Contribute Valuable Information

    • Edit relevant industry articles
    • Add citations to your research
    • Create missing topic pages
    • Update outdated information
  3. Build Wikipedia-Worthy Content

    • Publish original research that gets cited elsewhere
    • Create industry reports
    • Generate newsworthy data
    • Achieve industry milestones that receive independent coverage

Key Metrics:

  • Articles mentioning your brand
  • Citations to your content
  • Wikidata connections
  • Cross-language presence

Reddit: The Conversation Goldmine

Why It Matters:

  • Real user opinions and experiences appear in many training corpora
  • Problem-solving discussions train AI to understand real-world recommendations
  • Product recommendations in authentic voice
  • Note: Reddit's data licensing status for AI training changes over time. Reddit has entered licensing agreements with AI companies for training data access

Subreddit Prioritization:

  1. Tier 1 (Highest Impact):

    • r/technology
    • r/programming
    • r/entrepreneur
    • r/marketing
    • Industry-specific subreddits
  2. Tier 2 (Strong Impact):

    • r/AskReddit
    • r/explainlikeimfive
    • r/IAmA
    • r/todayilearned
    • Niche professional subreddits

Reddit Optimization Tactics:

DO

  • Provide genuine value first
  • Build karma organically
  • Participate consistently
  • Share unique insights
  • Answer questions thoroughly
  • Use data and examples
  • Engage in discussions

DON'T

  • Spam promotional content
  • Use multiple fake accounts
  • Buy upvotes
  • Ignore subreddit rules
  • Post low-effort content
  • Be overly promotional

Content Strategy for Reddit:

  1. Educational Posts

    • Industry insights
    • How-to guides
    • Case studies
    • Data analyses
  2. Community Engagement

    • Answer questions
    • Share experiences
    • Provide feedback
    • Solve problems
  3. AMA Sessions

    • Expert knowledge sharing
    • Brand awareness
    • Thought leadership
    • Direct engagement

Quora: The Q&A Authority

Why It Matters:

  • Direct question-answer format is well-suited for training AI to answer questions
  • High-quality, detailed responses demonstrate expertise
  • Topic expertise demonstration
  • Google search visibility drives additional discovery

Quora Optimization Framework:

Topic Selection:

  • Industry-specific spaces
  • Problem-solving topics
  • Comparison questions
  • How-to queries
  • Best practices discussions

Answer Structure Template:

## Opening Hook
[Personal experience or surprising fact]

## Direct Answer
[Clear, concise response to question]

## Detailed Explanation
[In-depth information with examples]

## Supporting Evidence
- Statistics
- Case studies
- Research findings
- Expert quotes

## Practical Application
[Step-by-step guide or tips]

## Conclusion & CTA
[Summary and subtle brand mention]

Quora Success Metrics:

  • Answer views
  • Upvotes received
  • Follower growth
  • Space contributions
  • Direct messages

Academic Papers & Research

Why It Matters:

  • Highest authority signals for factual claims
  • Peer-reviewed credibility
  • Citation networks amplify reach
  • Foundational knowledge that persists across training cycles

Publishing Strategy:

  1. Research Papers

    • Original studies
    • Industry surveys
    • Technical innovations
    • Methodology papers
  2. White Papers

    • Industry analysis
    • Best practices
    • Framework development
    • Solution comparisons
  3. Case Studies

    • Implementation details
    • Results and metrics
    • Lessons learned
    • Reproducible methods

Distribution Channels:

  • arXiv.org
  • SSRN
  • ResearchGate
  • Academia.edu
  • Industry journals

High-Authority News Sites

Target Publications:

  • Tier 1: Forbes, WSJ, NYT, Guardian
  • Tier 2: TechCrunch, Wired, VentureBeat
  • Tier 3: Industry publications
  • Tier 4: Regional news outlets

PR Strategy for LLM Visibility:

  1. Newsworthy Angles

    • Industry-first achievements
    • Data-driven insights
    • Trend predictions
    • Substantive opinion pieces
  2. Journalist Query Platforms

    • Qwoted: connects journalists with verified experts
    • Featured.com: acquired HARO in April 2025; runs expert roundups for Fortune, Fast Company, Yahoo
    • Source of Sources: created by HARO's original founder
    • Note: Connectively (the rebrand of HARO) shut down December 9, 2024
  3. Press Release Distribution

    • PRNewswire
    • Business Wire
    • PR Web
    • Industry wires

The Stack Overflow Effect (For Tech)

Optimization Approach:

  1. Answer Quality Questions

    • Complex problems
    • Common issues
    • Best practices
    • Tool comparisons
  2. Create Canonical Answers

    • Comprehensive solutions
    • Code examples
    • Performance comparisons
    • Security considerations
  3. Build Reputation

    • Consistent participation
    • High-quality answers
    • Community moderation
    • Tag expertise

GitHub: The Code Knowledge Base

Visibility Strategies:

  1. Open Source Projects

    • Popular libraries
    • Useful tools
    • Documentation
    • Examples
  2. README Optimization

    • Clear descriptions
    • Usage examples
    • Installation guides
    • API documentation
  3. Community Building

    • Issue responses
    • Pull request reviews
    • Discussion participation
    • Star accumulation

Social Media's Influence on AI Training

LinkedIn (Professional Context)

  • Thought leadership articles
  • Industry discussions
  • Company updates
  • Professional achievements
  • Generally included in crawled web data

X (formerly Twitter): Important Licensing Caveat

X updated its developer agreement in June 2025 to prohibit third parties from using its data to fine-tune or train AI models. X had also updated its own terms of service in October 2024 to allow itself to use user content for AI training. This means third-party AI providers face contractual restrictions on using X data, and the extent to which X data appears in current or future LLM training is subject to licensing agreements between X and individual AI companies.

YouTube (Video Knowledge)

  • Tutorial content transcripts
  • Expert interviews
  • Product demonstrations
  • Educational series

Optimizing for Future LLM Training

Emerging Patterns

  1. Real-time Data Integration

    • Perplexity, ChatGPT search, Gemini, Microsoft Copilot and Claude with web search access the live web
    • Fresh content is accessible for retrieval-augmented generation (RAG) even outside training cycles
  2. Multimodal Content

    • Text + images
    • Video transcripts
    • Audio content
  3. Structured Data Preference

Future-Proofing Strategies

  1. Content Velocity

    • Regular updates
    • Fresh perspectives
    • Timely responses
    • Trend participation
  2. Cross-Platform Presence

    • Consistent messaging
    • Platform-specific optimization
    • Integrated campaigns
    • Unified branding
  3. Authority Building

    • Expert positioning
    • Citation accumulation
    • Media mentions
    • Industry recognition

How to See Which Sources an AI Answer Used

If you want to find what sources an LLM pulls from, look at the answer itself first, then at your own server logs. Citations only exist when the assistant searched the web for that answer. An answer drawn purely from training data has no source list, and the model can't reliably tell you which documents it learned a fact from.

1. Open the citations in the answer

Assistant Where the sources appear
ChatGPT search Answers that used search include links to sources. OpenAI's launch post describes a Sources button below the response that opens a sidebar of references (OpenAI). The button's placement has moved in some versions of the app, so look for "Sources" in the answer's menu if it isn't under the reply.
Perplexity Each answer includes numbered citations that link to the original sources (Perplexity Help Center).
Microsoft Copilot The linked citation section of a Copilot Chat response shows the cited sites and the exact search queries Copilot sent to Bing. Microsoft notes these query citations are shown only in Copilot Chat and stay in the thread for 24 hours (Microsoft Learn).
Google AI Overviews and AI Mode AI Overviews give a generated snapshot "with key information and links to dig deeper" (Google Search Help), and AI Mode responses include links to supporting websites (Google Search Central).

Record the cited URLs for the same prompt more than once. Retrieved sources change between runs, so a single check is a sample, not a verdict.

2. Check your server logs for AI crawlers

Your logs show which AI systems are fetching your pages, even when no one cites you yet. Search your server or CDN logs for these documented user agents:

  • Search and answer-time fetches: OAI-SearchBot and ChatGPT-User (OpenAI), PerplexityBot and Perplexity-User (Perplexity), Claude-SearchBot and Claude-User (Anthropic), Googlebot for Google's index, and Bingbot for Bing's index, which Copilot queries (Bing).
  • Training crawlers: GPTBot (OpenAI) and ClaudeBot (Anthropic). Google's training and Gemini grounding control is the Google-Extended robots.txt token, not a separate crawler you'll see in logs (Google).

User agents are easy to spoof. OpenAI and Perplexity publish IP address lists for each bot on the same documentation pages, so verify hits against them before you draw conclusions. A user-triggered fetcher such as ChatGPT-User or Perplexity-User hitting a page usually means someone asked an assistant a question that led to it.

3. Use first-party reports and tracking tools

  • Bing Webmaster Tools AI Performance shows when your pages are cited in Microsoft Copilot and Bing AI answers, with page-level citation counts and the grounding queries behind them (Bing Webmaster Blog).
  • Google Search Console includes traffic from AI Overviews and AI Mode in the Performance report under the "Web" search type (Google Search Central). It doesn't break AI features out separately.
  • AI visibility tracking tools run a fixed set of prompts across assistants on a schedule and log which brands and URLs each answer cites. They are the practical way to see citation patterns across many prompts. Check how a tool collects its answers and how often, because results from the logged-out web interface, the API and different locations can differ. For how to build the prompt set, see How Many Prompts Is Enough?.

Measurement Framework

Direct Metrics

  • Wikipedia: Page views, citations, edits
  • Reddit: Karma, mentions, discussions
  • Quora: Views, upvotes, followers
  • News: Articles, quotes, mentions
  • Academic: Citations, downloads, references

Indirect Indicators

  • AI response mentions (test manually)
  • Brand recognition growth
  • Organic traffic increases
  • Expert status indicators
  • Community engagement

Your 90-Day LLM Source Optimization Plan

Month 1: Foundation

Week 1-2:

  • Audit current presence across platforms
  • Identify gaps and opportunities
  • Create platform accounts
  • Develop content strategy

Week 3-4:

  • Begin Reddit participation
  • Start Quora contributions
  • Submit first journalist query responses
  • Plan Wikipedia strategy

Month 2: Acceleration

Week 5-6:

  • Increase posting frequency
  • Build platform authority
  • Engage with communities
  • Create cornerstone content

Week 7-8:

  • Launch PR campaigns
  • Publish research/data
  • Expand platform presence
  • Monitor AI citations

Month 3: Optimization

Week 9-10:

  • Analyze performance data
  • Refine strategies
  • Scale successful tactics
  • Build relationships

Week 11-12:

  • Establish thought leadership
  • Achieve platform milestones
  • Document case studies
  • Plan next quarter

Platform-Specific Best Practices

Reddit Best Practices

✅ DO:

  • Read rules before posting
  • Contribute 10x more than promote
  • Use native Reddit formatting
  • Engage authentically
  • Provide proof when needed
  • Respect community culture
  • Build genuine relationships

❌ DON'T:

  • Delete downvoted content
  • Argue with moderators
  • Use URL shorteners
  • Cross-post excessively
  • Ignore post timing
  • Forget to follow up
  • Be overly salesy

Quora Best Practices

✅ DO:

  • Write comprehensive answers
  • Include relevant images
  • Cite credible sources
  • Update old answers
  • Follow topic spaces
  • Build expertise slowly
  • Engage with comments

❌ DON'T:

  • Copy-paste content
  • Over-promote products
  • Write short answers
  • Ignore question intent
  • Use clickbait tactics
  • Neglect formatting
  • Spam multiple answers

Common Mistakes to Avoid

  1. Over-Optimization

    • Appearing inauthentic
    • Gaming metrics
    • Ignoring community values
  2. Platform Neglect

    • Inconsistent presence
    • Abandoned profiles
    • Outdated information
  3. Quality Compromise

    • Prioritizing quantity
    • Generic content
    • Poor research
  4. Measurement Gaps

    • No tracking system
    • Ignoring feedback
    • Missing opportunities

Tools & Resources

Monitoring Tools

  • Google Alerts - Brand mentions
  • Mention - Social listening
  • Ahrefs - Backlink tracking
  • SimilarWeb - Traffic analysis

Content Tools

  • Grammarly - Writing quality
  • Hemingway - Readability
  • Canva - Visual content
  • Loom - Video creation

Analytics Platforms

  • Reddit Analytics - Subreddit stats
  • Quora Stats - Answer performance
  • Google Analytics - Traffic sources
  • Genmark AI - AI visibility tracking

The Genmark AI Advantage

Our platform helps you optimize for LLM sources:

  • Multi-platform tracking across all sources
  • AI citation monitoring in real time
  • Competitive intelligence on rival strategies
  • Optimization recommendations based on data
  • ROI measurement for all efforts

Explore Genmark AI →

Key Takeaways

  1. Wikipedia and Reddit are among the most influential training sources for most LLMs
  2. Authority and authenticity matter more than volume
  3. Platform-native optimization yields best results
  4. Consistency and quality build long-term visibility
  5. Cross-platform presence maximizes AI citations
  6. Social media licensing has changed: X/Twitter data access for third-party AI training is now contractually restricted

Next Steps

  1. Read: Why AI Engines Struggle to Cite PDF Content →
  2. Read our Reddit & Quora Strategy Guide →
  3. Get a free AI Visibility Snapshot →

Sources


Last updated: November 4, 2026 | Part of Genmark AI's AI Visibility Learning Center

Frequently asked questions

What are the primary sources of information for LLMs like ChatGPT?

LLMs draw from large crawled web datasets (Common Crawl is used by the majority of major models), Wikipedia, digitized books, academic papers, code repositories like GitHub, and curated high-quality sources. The exact mix varies by model and is typically not fully disclosed by providers.

Why is Wikipedia so important for AI visibility?

Wikipedia is explicitly included in the training datasets of most major LLMs because it provides structured, relatively reliable factual content across a vast range of topics. It is cross-referenced across many other sources, making it a high-trust signal. Brands mentioned in Wikipedia tend to be better represented in AI responses.

How does Reddit influence LLM responses?

Reddit's public discussion threads appear in many LLM training corpora. Subreddits with high engagement and upvoted content contribute real-world perspectives and recommendations that LLMs use to understand how people discuss products, topics, and decisions. Authentic participation in relevant subreddits can increase AI visibility.

Can I improve AI visibility without being on Wikipedia?

Yes, while Wikipedia helps significantly, you can build AI visibility through other high-impact sources like Reddit, Quora, authoritative news mentions, academic citations, and high-quality content on your own domain. Focus on multiple source presence.

Which academic sources do LLMs prioritize?

LLMs prioritize peer-reviewed journals, arXiv.org preprints, Google Scholar indexed papers, university publications (.edu domains), and conference proceedings. Papers with high citation counts and from recognized institutions carry more weight.

How important is Quora for LLM training data?

Quora is moderately important, especially for Q&A format understanding. High-upvote answers from verified experts, comprehensive responses with sources, and answers to popular questions have stronger influence on LLM training.

Do LLMs use social media as training data?

Yes, but selectively and with important licensing caveats. LinkedIn professional content and some public social data have been included in various training datasets. X (formerly Twitter) updated its developer terms in June 2025 to restrict third-party use of its data for AI model training, so recent models may have reduced or no X data depending on licensing agreements.

How do news sites influence LLM responses?

Major news outlets (Reuters, AP, BBC, CNN, NYT) significantly influence LLMs for current events, company information, and factual reporting. Being mentioned in reputable news sources dramatically increases AI citation likelihood.

What role does GitHub play in LLM training?

GitHub is crucial for technical and programming knowledge. README files, documentation, popular repositories, and code comments all contribute to LLMs' understanding of technical concepts. Well-documented projects gain visibility in technical AI responses.

How can I optimize for multiple LLM source platforms?

Create a multi-platform presence strategy: contribute to Wikipedia (following guidelines), engage authentically on Reddit, answer questions on Quora, publish research when possible, earn news mentions, and maintain high-quality content on your domain.

Do LLMs distinguish between reliable and unreliable sources?

Yes, through various signals including domain authority, cross-reference validation, citation frequency, and training weightings. Content appearing across multiple reliable sources receives higher confidence in LLM responses. However, the exact mechanisms are not publicly documented in detail by most providers.

How recent is the training data for different LLMs?

Training cutoffs vary by model and move with each release. As of November 2026, OpenAI's API docs list an April 30, 2026 knowledge cutoff for its flagship GPT-6 Astra and August 31, 2025 for the earlier GPT-5.2. Assistants with web search (ChatGPT search, Perplexity, Gemini, Copilot, Claude) also pull live pages at answer time, so the cutoff matters less for them. Check each provider's model documentation for current cutoffs.

How can I find what sources an LLM pulls from for a specific answer?

Open the answer's citations: ChatGPT search has a Sources panel, Perplexity numbers its citations, Microsoft Copilot lists linked citations and the exact Bing queries it ran, and Google AI Overviews link to supporting pages. Answers without web search have no citation list, because they come from training data.

How do I know if AI crawlers are reading my site?

Search your server or CDN logs for the documented user agents (OAI-SearchBot, GPTBot, ChatGPT-User, PerplexityBot, Perplexity-User, Claude-SearchBot, ClaudeBot, Claude-User, Googlebot, Bingbot) and check the IPs against the ranges OpenAI, Perplexity and the search engines publish, since user agents can be spoofed.

What kind of data is primarily used for training LLMs?

Mostly filtered web crawl text, with Common Crawl the most common base dataset, plus Wikipedia, books, academic papers and code repositories. Providers rarely publish the exact mix.

Can forum and community sites influence LLM responses?

Yes, specialized forums and communities provide niche expertise that LLMs value. Stack Overflow for programming, specialized professional communities, and high-quality industry forums contribute domain-specific knowledge that broader sources might miss.

How do LLMs handle conflicting information from different sources?

LLMs typically synthesize information, favoring consensus from authoritative sources. When conflicts exist, they may present multiple viewpoints or defer to the most credible sources based on domain authority and citation frequency.

What's the impact of government and educational sites on LLM training?

.gov and .edu domains carry high trust signals in LLM training. Government statistics, educational resources, research publications, and official documentation from these domains significantly influence factual responses in LLMs.

See where AI leaves your brand out

Put this into practice. Genmark AI shows you exactly how ChatGPT, Gemini, Perplexity and the other major engines answer about your brand — then helps you create the content that earns the citation.

Free · No account needed · Results by email

Need a team to execute? Explore Expert-Led Growth