> ## Content Index
> Fetch the complete content index at: https://www.implicator.ai/llms.txt
> Use this file to discover other available public pages before exploring further.

# GitHub Pull Request Study Traces AI-Linked Vocabulary From 1% to 45% Since 2025
- URL: https://www.implicator.ai/github-pr-ai-linked-vocabulary-1-to-45-percent/
- Published: 2026-08-28T02:58:45.000Z
- Updated: 2026-08-28T02:58:45.000Z
- Description: A researcher sampling 100 GitHub pull requests a day found one vocabulary pattern rose from 1.0% of descriptions at the start of 2025 to about 45% by August 2026. Its most distinctive word was load-bearing, and the em dash rose roughly 660 times over the same corpus.
- Author: Marcus Schuler
- Tags: AI News, AI Research

In July 2025, GitHub user cskor opened [an issue](https://github.com/igrigorik/gharchive.org/issues/310?ref=implicator.ai) after a dataset suddenly began returning far fewer events. Another user, defgsus, checked the midnight files day by day, plotted the counts and found the same break across most event types. The files were present, but event IDs showed large gaps.

For Louis Abraham, the missing events had already produced a false result.

Abraham, a PhD candidate in financial economics who still regularly gives piano concerts, spent 2024 to 2025 as a core-team researcher and agent production team lead at H Company, building agentic models, before becoming founder and CTO of Reduck. Abraham rebuilt the project around GitHub’s search interface; the resulting [corpus](https://louisabraham.github.io/load-bearing/?ref=implicator.ai) describes a vocabulary pattern that rose from 1.0% of sampled pull request descriptions at the start of 2025 to about 45% in the last four weeks of the corpus.

What Changed

- A daily sample of GitHub pull request descriptions found one vocabulary group rose from 1.0% of the corpus at the start of 2025 to about 45% in the four weeks ending August 17, 2026.
- The group's most distinctive term, load-bearing, appeared 98 times inside it against three times outside, or 93 appearances per million words against 0.76.
- The em dash rose from 0.2 appearances per 10,000 words in the corpus's first four weeks to 132.4 in its final four weeks, a rise of roughly 660 times.
- Two model settings were chosen after the result was visible, and across 32 unconditioned fits the group's final share ranged from 36.3% to 63.8%.

AI-generated summary, reviewed by an editor. [More on our AI guidelines](https://www.implicator.ai/about/).

## How the sample is taken

The dataset contains 47,464 descriptions written between January 6, 2025, and August 17, 2026, with 5,024,747 word appearances. Abraham places one five-minute window at a random point each day, using the date as the seed so anyone can reproduce the timing. Abraham keeps the first 100 newly opened pull requests and combines complete seven-day periods into weeks of 700 descriptions.

The study is a daily sample rather than a census. Developers merged 43.2 million pull requests a month during the Octoverse year running from September 2024 through August 2025, up 23% year over year.

Four common apps are excluded in the search to keep automated accounts from supplying the answer. Usernames ending in `[bot]` or `-bot`, along with `copilot`, are removed later. That account filter discarded 7,901 rows from 1,042 accounts, or 13% of the collected material.

No author can contribute more than three descriptions in a week. The cap matters because one ordinary-looking human account posted 147 copies of the same sentence over a fortnight. A word must also appear at least 45 times, across 25 descriptions and 20 accounts. `load-bearing` appeared in 93 descriptions from 92 accounts, while `pullrequest` appeared in 201 descriptions from only 17 accounts and was excluded.

## How the sorting works

The model has no date or week variable. One set of eight word distributions covers the entire collection, and descriptions are assigned by vocabulary alone. Only after that assignment does the software count how many descriptions from each week landed in each group. A synthetic self-test recovered a planted writing pattern rising from zero to 35% at the specified week even though the fitting process had no clock.

Abraham uses KL-divergence k-means, also called Bregman hard clustering. Imagine eight bowls, each holding a different recipe of word frequencies. The model compares every description’s mix of words with those recipes and puts the whole description into the nearest bowl. It cannot split one description between several groups.

## What changed in the descriptions

One group accounted for 1.0% of the corpus at the start of 2025 and about 45% in the last four weeks ending August 17, 2026\. Its most distinctive term was `load-bearing`, used 98 times inside the group and three times outside it. Adjusted for the amount of text on each side, that was 93 appearances per million words inside against 0.76 outside, a ratio of 123.04.

FREE WEEKDAY MORNING BRIEFING

Don’t miss the next AI story that matters.

The Implicator Morning Briefing filters the AI news cycle to the stories worth your attention and explains their consequences. From San Francisco, every weekday at 4:45 a.m. Pacific, 7:45 a.m. Eastern.

Email address 

Send me tomorrow’s briefing 

Check your inbox. Click the link to confirm.

About five minutes. No hype. No spam.

Other highly ranked terms included `quietly`, `survived`, `latent`, `seam` and `byte-identical`.

The em dash rose from 0.2 appearances per 10,000 words during the corpus’s first four weeks in early 2025 to 132.4 appearances per 10,000 words during its final four weeks ending August 17, 2026, a rise of roughly 660 times.

Know someone who'd find this useful? [✉️ Email it to a friend in one click](mailto:?subject=A%20newsletter%20I%20think%20you%27d%20like&body=This%20is%20one%20of%20maybe%20three%20newsletters%20I%20actually%20read.%20The%20rest%20just%20pile%20up%2C%20unread%2C%20judging%20me.%0A%0AAnd%20yes%2C%20this%20email%20mostly%20wrote%20itself%2C%20which%20is%20a%20little%20on%20the%20nose%20for%20an%20AI%20newsletter.%20Doesn%27t%20make%20it%20wrong.%20implicator.ai%20is%20good.%0A%0ASubscribe%20free%3A%20https%3A%2F%2Fwww.implicator.ai%2Fsubscribe%2F%3Futm%5Fsource%3Dnewsletter%26utm%5Fmedium%3Dforward%26utm%5Fcampaign%3Demail%5Fforward), or they can [subscribe free here](https://www.implicator.ai/subscribe/?utm%5Fsource=newsletter&utm%5Fmedium=forward&utm%5Fcampaign=forward%5Fto%5Fcolleague).

A separate measurement led by Dmitry Kobak, a researcher at the Hertie Institute for AI in Brain Health in Tübingen (Germany), found [a related shift](https://arxiv.org/html/2406.07016v3?ref=implicator.ai) in more than 15 million PubMed abstracts from 2010 through 2024\. The team projected pre-ChatGPT word frequencies forward, much as excess-mortality research projects an expected baseline. At least 13.5% of abstracts published in 2024 were estimated to have been processed with a language model, with the lower bound reaching 40% in some subcorpora. The 2024 change was concentrated in style words, unlike the content words that surged during the Covid period.

## The choices inside the result

Abraham labels two settings as choices made after seeing the outcome. Abraham selected eight groups so that `load-bearing` would rank first in the arriving group. The minimum total frequency was also set after the result was visible, allowing the term into the vocabulary.

The random starting seed also changes the headline share. Across 32 unconditioned fits, the arriving group ended between 36.3% and 63.8%, with a median of 45.5%. The fits agreed closely on the weekly shape, with a mean correlation of 0.991, but their agreement over which descriptions belonged together had a mean F1 score of 0.770 and fell as low as 0.46.

Every five-minute search returns a full page, so the process does not enumerate everything opened during that interval. It takes the earliest 100 pull requests after a random instant. In the archive-based version Abraham had replaced by August 2026, `load-bearing` appeared in only 17 documents, an error by a factor of 158 because comments had vanished from the feed.

The evidence does not observe an assistant writing any pull request, and it cannot classify an individual description as machine-authored. That boundary matters because the median description is only 65 words. A [2026 study](https://arxiv.org/html/2603.23146?ref=implicator.ai) by Shushanta Pudasaini of Technological University Dublin and co-authors found that linguistic detectors become unreliable on very short text and can falsely flag technical writing whose constrained vocabulary resembles machine output. The corpus sits inside the length range where that literature says these signals stop being reliable.

Abraham measures only a corpus-level distribution: “None of this observes an assistant writing anything.”

Frequently Asked Questions

What did the study actually measure?

It grouped 47,464 GitHub pull request descriptions written between January 6, 2025, and August 17, 2026, into eight vocabulary patterns, then counted how many descriptions from each week fell into each group. The model has no date or week variable, so the weekly curves are counts made after the assignment rather than a fitted trend.

How was the sample collected?

One randomly placed five-minute window each day, seeded on the date so the timing is reproducible, keeping the first 100 newly opened pull requests. Complete seven-day periods were combined into weeks of 700 descriptions.

Does this prove the descriptions were written by AI?

No. The evidence does not observe an assistant writing any pull request and cannot classify an individual description as machine-authored. It measures a distribution across a corpus.

How were automated accounts excluded?

Four common apps were excluded in the search, and usernames ending in \[bot\] or -bot, along with copilot, were removed afterward. That account filter discarded 7,901 rows from 1,042 accounts, or 13% of the collected material.

What are the main limitations?

Two settings were chosen after the result was visible, the random seed moves the final share between 36.3% and 63.8% across 32 fits, and the median description is only 65 words, inside the length range where detection research says linguistic signals become unreliable.

AI-generated summary, reviewed by an editor. [More on our AI guidelines](https://www.implicator.ai/about/).

[Zed and Warp Both Ship AI Coding. They Bet on Opposite Surfaces.One product anchors the workday to the file under your cursor. The other anchors it to the agent sessions running in the background. Zed and Warp both moved AI coding toward the center of their produThe Implicator![](https://www.implicator.ai/content/images/2026/05/2026-05-24-19.01.54-zed_vs_warp@2x.webp)](https://www.implicator.ai/zed-and-warp-both-ship-ai-coding-they-bet-on-opposite-surfaces-2/)

[Intermediate Tutorial: How To Build Reliable Workflows With OpenAI CodexMost developers hit the same wall with Codex. The first week feels electric. You prompt, it codes, things work. Then the codebase grows. Fixes start landing in the wrong layer. Architecture quietly deThe Implicator![](https://www.implicator.ai/content/images/2026/04/2026-04-07-22.21.27-codex_workflows@2x.webp)](https://www.implicator.ai/intermediate-tutorial-how-to-build-reliable-workflows-with-openai-codex/)

[Simon Willison Ships Rodney v0.4.0, a Browser Automation CLI Built for Coding AgentsSimon Willison released Rodney v0.4.0 this week, adding Windows support, a JavaScript assertion engine, and directory-scoped sessions to his CLI tool that lets AI coding agents drive a real browser. TThe Implicator![](https://www.implicator.ai/content/images/2026/02/willision_rodney.png)](https://www.implicator.ai/simon-willison-ships-rodney-v0-4-0-a-browser-automation-cli-built-for-coding-agents/)