What % of the knowledge in all printed books are in the average frontier LLM?

I don't know what's in the training sets, but this snippet from a 2022 Brewster Kahle talk has a few relevant datapoints in terms of the % of printed books that have been digitized:

- "the total production of print books from major publishers to an American audience is expanding at approximately 200,000 titles a year."

- "The Google Book project (2004) set out to digitize all books. They currently estimate 100 million titles, and have achieved at least 25 million so far. The Internet Archive similarly attempts to digitize all books (currently over 6 million titles)"

Working on Farcaster and Warpcast. Longer thoughts at https://dwr.email

I don't know what's in the training sets, but this snippet from a 2022 Brewster Kahle talk has a few relevant datapoints in terms of the % of printed books that have been digitized:

- "the total production of print books from major publishers to an American audience is expanding at approximately 200,000 titles a year."

- "The Google Book project (2004) set out to digitize all books. They currently estimate 100 million titles, and have achieved at least 25 million so far. The Internet Archive similarly attempts to digitize all books (currently over 6 million titles)"

https://hub.scroll.pub/files1/snippet.html