South Africa-founded startup launches AI model with 10 million-token memory
Refiant AI, a South Africa-founded startup that uses algorithms to compress artificial intelligence (AI) models, has launched Protea, a suite of large language models (LLMs) that the company says is capable of processing up to 10 million tokens in a single prompt. The models can process and retain significantly more information at once before generating a response, according to the company. Protea comes in three versions with context windows of one million, five million, and 10 million tokens an