On this episode, we’re joined by Stella Biderman, Executive Director at EleutherAI and Lead Scientist – Mathematician at Booz Allen Hamilton.
EleutherAI is a grassroots collective that enables open-source AI research and focuses on the development and interpretability of large language models (LLMs).
We discuss:
– How EleutherAI got its start and where it’s headed.
– The similarities and differences between various LLMs.
– How to decide which model to use for your desired outcome.
– The benefits and challenges of reinforcement learning from human feedback.
– Details around pre-training and fine-tuning LLMs.
– Which types of GPUs are best when training LLMs.
– What separates EleutherAI from other companies training LLMs.
– Details around mechanistic interpretability.
– Why understanding what and how LLMs memorize is important.
– The importance of giving researchers and the public access to LLMs.
Stella Biderman – https://www.linkedin.com/in/stellabiderman/
EleutherAI – https://www.linkedin.com/company/eleutherai/
Resources:
Thanks for listening to the Gradient Dissent podcast, brought to you by Weights & Biases. If you enjoyed this episode, please leave a review to help get the word out about the show. And be sure to subscribe so you never miss another insightful conversation.
#OCR #DeepLearning #AI #Modeling #ML