An often-overlooked limitation for chatbots is memory. Also referred to as ‘context window’, for ChatGPT this amounts to about 3’000 words.
Now, AI startup Anthropic (founded by former OpenAI engineers), has massively expanded the memory of their own chatbot called Claude to around 75’000 words.
It takes a human around five hours to read 75’000 words of text. With Claude one can take on the task of reading, summarizing, analysing and correcting a long document like a novel in a matter of minutes.
The pricing is yet unknown, but likely to be significant. Processing more text means spending more money on compute capacity.MORE