A new analysis reveals that while most top Substack newsletters remain human-written, AI involvement is increasing in certain niches, challenging the authenticity of online publishing.

Taylor Lorenz has turned her attention to a question that has become increasingly hard for editors and readers to ignore: how much of Substack is actually written by humans? In an analysis of thousands of posts from leading newsletters, she used Pangram’s AI-detection tool to test whether top-performing publications were relying on machine-generated text or human authorship. Her conclusion was that much of the platform’s premium content still appears to be written by people, but that the picture varies sharply by topic and publication.

According to Lorenz’s findings, around two-thirds of the top publications she examined showed no detectable AI-generated content. But the analysis also pointed to clear pockets of heavier AI use, especially in Technology, Philosophy and Health. Technology stood out most, with about 28% AI involvement, suggesting that the line between reporting, commentary and automated content is already beginning to blur in some of Substack’s most active niches.

The stakes are not merely theoretical. Lorenz highlighted a viral AI-generated post about a fictional debate between Elon Musk and Keanu Reeves, which attracted roughly 25,000 likes and nearly 5,000 reposts. That kind of engagement suggests that synthetic writing is no longer confined to obscure corners of the web; it can now travel widely, especially when it is tuned for novelty, outrage or entertainment. WIRED has also reported on Pangram Labs’ Chrome extension, which has been used to flag AI-written content across platforms including Substack, Reddit, LinkedIn and X.

The broader backdrop is a publishing ecosystem already struggling to keep pace with automated output. A separate academic audit of American newspapers found that roughly 9% of newly published articles were partly or fully AI-generated, with heavier use concentrated in smaller outlets and subjects such as weather and technology. Taken together, the evidence points to an industry in transition: human-written work remains dominant in many places, but AI is steadily seeping into the pipeline, and the most visible platforms are becoming harder to trust at a glance.

Source Reference Map

Inspired by headline at: [1]

Sources by paragraph: - Paragraph 1: [2], [6] - Paragraph 2: [2] - Paragraph 3: [4], [6] - Paragraph 4: [3], [7]

Source: Noah Wire Services

Verification / Sources

  • https://www.bespacific.com/how-much-of-substack-is-actually-ai/ - Please view link - unable to able to access data
  • https://www.usermag.co/p/how-much-of-substack-is-actually-ai-pangram-analysis-substack-bestsellers - In this article, Taylor Lorenz analyses thousands of posts from top Substack newsletters to determine the extent of AI-generated content. Using Pangram's AI detection tool, she finds that two-thirds of top publications have no AI-generated content. However, certain categories like Technology, Philosophy, and Health have higher levels of AI involvement, with Technology at 28%. Lorenz discusses the implications of AI in content creation and the importance of human-written content in maintaining quality and trust.
  • https://agent-wars.com/news/2026-03-14-how-much-of-hn-is-ai-analysis-of-llm-content-on-hacker-news-in-february-2026 - Security researcher lcamtuf examines Hacker News' top stories from February 2026, revealing that AI-related content dominated the daily top 5 on nearly every day. Using Pangram, he identifies a significant share of stories likely AI-written, raising concerns about AI vendor announcements flooding the platform and the growing difficulty of detecting AI-generated content at scale.
  • https://theoverspill.blog/2026/04/28/openai-smartphone-ai-agent-plans-start-up-2661/ - This blog post discusses various tech developments, including Taylor Lorenz's analysis of AI-generated content on Substack. Lorenz highlights a viral AI-generated post about a debate between Elon Musk and Keanu Reeves, which amassed 25,000 likes and nearly 5,000 reposts. She notes that such AI-generated content is becoming more prevalent on Substack, mirroring broader web trends.
  • https://ai-navigate-news.com/en/articles/2d9bf3cb-668c-4f49-9374-4c16b5ffdb1f - This article discusses how tech reporters, including Taylor Lorenz, are integrating AI into their workflows. Lorenz uses AI tools like Gemini for SEO-friendly descriptions and Claude for data analysis but does not use AI to write or edit her articles, citing trust issues with AI systems for sensitive reporting materials and a preference for the craft of writing herself.
  • https://www.wired.com/story/pope-tweets-ai-generated-pangram-chrome-extension/ - WIRED reports on Pangram Labs' updated Chrome extension, which detects AI-generated content. The extension flagged a Reddit post claiming to be from the Pope as AI-generated, highlighting the tool's capability to identify AI-written text across social media platforms, including Reddit, LinkedIn, X, and Substack.
  • https://arxiv.org/abs/2510.18774 - This academic paper presents an audit of AI use in American newspapers, revealing that approximately 9% of newly published articles are partially or fully AI-generated. The study highlights uneven distribution, with higher AI usage in smaller, local outlets and specific topics like weather and technology, and calls for greater transparency and updated editorial standards regarding AI in journalism.

Noah Fact Check Pro

The draft above was created using the information available at the time the story first emerged. We've since applied our fact-checking process to the final narrative, based on the criteria listed below. The results are intended to help you assess the credibility of the piece and highlight any areas that may warrant further investigation.

Freshness check

Score: 8

Notes: The article was published on April 27, 2026, which is recent. However, the analysis references a viral AI-generated post from March 2025, indicating that the topic has been discussed for over a year. (usermag.co)

Quotes check

Score: 7

Notes: The article includes direct quotes from Taylor Lorenz's analysis. While these quotes are consistent with her known writing style, they cannot be independently verified without access to the original source. (usermag.co)

Source reliability

Score: 6

Notes: The article is published on User Mag, a Substack newsletter run by Taylor Lorenz. While Lorenz is a reputable journalist, the publication is self-hosted, which may raise concerns about editorial oversight and potential biases. (usermag.co)

Plausibility check

Score: 8

Notes: The claims about AI-generated content on Substack align with broader industry trends. However, the reliance on a single source (Lorenz's analysis) without independent verification limits the ability to fully assess the accuracy of these claims.

Overall assessment

Verdict (FAIL, OPEN, PASS): FAIL

Confidence (LOW, MEDIUM, HIGH): MEDIUM

Summary: The article presents claims about AI-generated content on Substack based on Taylor Lorenz's analysis. While the topic is timely and relevant, the reliance on a single, self-hosted source without independent verification raises concerns about the accuracy and reliability of the information presented. (usermag.co)