Anthropic says its Claude AI can now read a whole book in under a minute

Anthropic says it has vastly expanded the amount of information its generative AI, Claude, is able to process. Claude has gone from having a limit of 9,000 tokens to 100,000 tokens, which corresponds to roughly 75,000 words. That’s a full novel. To put that into perspective, Claude now has the ability to easily read and finish Ernest Hemingway’s A Farewell to Arms (74,240 words), Mary Shelley’s Frankenstein (74,800 words) and Mark Twain’s The Adventures of Tom Sawyer (69,000 words). And, as The Verge notes, the company says Claude can read and analyze information from each book in under a minute. 

Generative AIs like Claude are still limited by the number of “tokens” they can process. As OpenAI explains in its help page, you can think of tokens as pieces of words. The AI cuts up words for processing, and they’re not always chopped up from the start to the end of each word, since spaces and other characters are also included. At the moment, OpenAI’s standard GPT-4 model is capable of processing 8,000 tokens, while an extended version can process 32,000 tokens. Meanwhile, its publicly available ChatGPT chatbot has <a class="colorbox" data-i13n="cpos:6;pos:1" …read more