Former OpenAI researcher’s new firm will educate you how one can construct an LLM

Faculty’s in perpetually —

Karpathy’s Eureka Labs will pair human-made curriculum with an AI-powered assistant.

On Tuesday, former OpenAI researcher Andrej Karpathy introduced the formation of a brand new AI studying platform known as Eureka Labs. The enterprise goals to create an “AI native” instructional expertise, with its first providing centered on instructing college students how one can construct their very own massive language mannequin (LLM).

“It is nonetheless early days however I wished to announce the corporate in order that I can construct publicly as an alternative of protecting a secret that is not,” Karpathy wrote on X.

Whereas the concept of utilizing AI in schooling is not notably new, Karpathy’s method hopes to pair expert-designed course supplies with an AI-powered instructing assistant primarily based on an LLM, aiming to supply customized steering at scale. This mixture seeks to make high-quality schooling extra accessible to a world viewers.

The platform’s inaugural course, LLM101n, targets an undergraduate-level viewers. It’s going to stroll college students by way of the method of coaching an AI system known as a “Storyteller AI Massive Language Mannequin” that can “create, refine and illustrate little tales.” Eureka Labs will supply this course on-line at first, then by way of in-person teams sooner or later.

Karpathy no stranger to AI schooling

Karpathy’s roots in AI go deep. In 2015, he obtained a PhD from Stanford College underneath pc scientist Dr. Fei-Fei Li. He was one of many founding members of OpenAI as a analysis scientist, then moved to Tesla to grow to be its senior director of AI between 2017 and 2022. In 2023, Karpathy rejoined OpenAI for a yr, departing in February.

This new enterprise builds on Karpathy’s observe document of AI schooling. Over the previous yr, Karpathy has posted a number of extremely regarded tutorials overlaying AI ideas on YouTube, together with an tutorial video about how one can construct an LLM from scratch, which at the moment has 405 million views. The movies have showcased his capability to interrupt down complicated matters for a broader viewers.

“@EurekaLabsAI is the end result of my ardour in each AI and schooling over ~2 a long time,” Karpathy wrote on X. “My curiosity in schooling took me from YouTube tutorials on Rubik’s cubes to beginning CS231n at Stanford, to my more moderen Zero-to-Hero AI collection. Whereas my work in AI took me from educational analysis at Stanford to real-world merchandise at Tesla and AGI analysis at OpenAI. All of my work combining the 2 to date has solely been part-time, as aspect quests to my ‘actual job,’ so I’m fairly excited to dive in and construct one thing nice, professionally and full-time.”

Eureka Labs’ imaginative and prescient extends past its preliminary AI course, hinting at a broader curriculum that would span numerous topics. “In the present day, we’re heads down constructing LLM101n,” the announcement reads, “however we sit up for a future the place AI is a key know-how for growing human potential. What would you wish to study?“