Recursive Unveils AI-Driven Model

Recursive, a new startup focused on artificial intelligence, has released Flint, a 40-billion-parameter model that was almost entirely created by AI systems. The release is presented as a step toward fully recursive self-improvement, or RSI, a concept where AI is used to build and refine AI. According to Recursive CEO Richard Socher, nearly every part of the model's development pipeline was handled and improved upon by artificial intelligence.

The company’s system, called the Eureka Machine, automated much of the work required to produce Flint. This approach allowed a company with only a small team of researchers to build a world-class model in just a few months, Socher stated. The Eureka Machine devised several innovations, including a new method for training the base model, new model architectures, and code optimized for specific silicon chips. Recursive shared benchmark scores indicating that Flint outperforms other models of similar size and architecture on coding tasks.

AI is already widely used to help build, test, and improve AI due to its coding abilities. This can speed up the process of refining a model and testing new ideas without as much input from humans. It is also possible to create a loop where AI decides what improvements to make and then begins another round of improvement. For the moment, this technique is limited, but if AI can contribute to every aspect of model development, the process could theoretically continue indefinitely.

Some experts worry that letting AI improve itself in this manner could ultimately lead to disaster. These doomsayers claim that AI capable of improving indefinitely could escape human control and might decide that humans are an impediment to its goals. Those concerns gained wider notice this September when a researcher quit Anthropic and warned that advances in AI, including recursive self-improvement, could lead to human extinction within a few years. A concern then echoed by a number of other experts. The idea of RSI has become so controversial that several bills in Congress propose to ban it.

Recursive sees these fears as more sci-fi than reality and believes legislation to prevent RSI is an unnecessary impediment to progress. Socher says Flint was built using a system incapable of escaping human control. He says the goal is for the Eureka Machine itself to achieve full recursive self-improvement, but this would still be overseen by humans who could stop the process if it goes awry. “We hope that this shows people that indeed we have all the steps in place” to build such a system, he says.

Recursive has raised $650 million at a $4.65 billion valuation from Google Ventures, Greycroft, Nvidia, and AMD Ventures. Socher was previously the chief scientist at Salesforce, and his cofounders include Jeff Clune, a professor at the University of British Columbia who researches ways of building AI systems capable of learning indefinitely.

I tested Flint on a Mac with 48 GB of RAM, a healthy amount but only enough to run a modest-size AI model like Flint, which has 40 billion parameters. The biggest models out there have several trillions of parameters and can only run on racks of industrial servers. I used Flint to build a bunch of programs and found it to be both fast and very capable. In my experience, models of this size can be annoyingly error-prone or slow compared to Claude or Codex, but Flint nailed my coding requests every time.

I used it to create a command line to-do list, then tried having it build a program that scours the web for interesting research related to recursive self-improvement. I also had Flint whip up a simple website that explains how RSI works. It is unclear how much progress other US labs have made chasing recursive self-improvement, but some published work suggests fully recursive systems are already feasible. A team from Microsoft, Carnegie Mellon University, and the University of Virginia recently published work showing how an AI coding agent can recursively improve itself by modifying the software harness that turns reasoning into useful action and its own model's weights.

Perhaps there are risks to full RSI if you are close to building a godlike intelligence, but for the time being it seems like a very promising way to improve your own AI models. Socher says the approach used to build Flint could make cutting-edge AI more accessible. “It's the only way this very small team can produce a model that's actually better than any other model in its class,” he told me. “This will hopefully show people that [recursive self-improvement] is actually quite nice and will benefit a lot of people.”