Partner event

Optimizing AI evaluations

Event Overview
We are thrilled to host a meetup in New York City with Google Cloud on Wednesday, October 16th. Enjoy snacks, refreshments, plenty of swag, and engaging conversations. Bring your colleagues and friends for a casual evening centered around
What to expect
  • Insights into evaluating LLM outputs using Weave and specialized models like Gemini, as well as an introduction to Google Gemini by Amir Imani.
  • Sessions covering productionizing LLM-as-a-judge systems, aligning them with human judgments, and building annotation UIs.
  • Chance to network with brilliant minds of the industry while enjoying an open bar and delicious snacks
What you'll learn
  • How to evaluate and optimize LLMs using the latest tools and research, including Weave and Google Gemini.
  • Strategies for integrating LLM-as-a-judge systems into your workflow and improving your existing evaluation processes.
Who should attend
  • AI, machine learning professionals, and engineers focused on LLM evaluation and deployment.
  • Researchers, data scientists, and developers interested in leveraging Google Gemini and cutting-edge LLM evaluation techniques.

Agenda

6:00pm
Introductions
6:45pm
Presentations
7:45pm
Q&A
8:15pm
Networking & Reception

Featured
speakers

Anish
Shah
Machine Learning Engineer
Weights & Biases
Amir
Imani
Ai Engineer
Google
Thank you to our partner