Skip to main content

Meta Unveils Llama 3

Meta's new LLM!
Created on April 18|Last edited on April 18
Meta has introduced Llama 3, available in two variants with 8 billion and 70 billion parameters, tailored to a wide variety of applications. This model is designed to excel in language understanding, contextual insights, and managing complex tasks like translation and dialogue generation. Enhanced by extensive training on a dataset over 15 trillion tokens in size, Llama 3 allows Meta AI to process information with a context length of 8,000 tokens, which is double the capacity of the previous iteration.

Benchmarks

Benchmarks demonstrate the models' exceptional performances across multiple AI tasks. The 8B variant scores 68.4% on MMLU 5-shot, 34.2% on GPQA 0-shot, and 62.2% on HumanEval 0-shot. The larger 70B variant shows even more remarkable results: 82.0% on MMLU 5-shot, 39.5% on GPQA 0-shot, and 81.7% on HumanEval 0-shot.



Meta AI Chatbot

Meta AI, a product similar to ChatGPT, is rolling out in English in more than a dozen countries utilizing Llama 3, with plans for continued expansion. It is designed to be a versatile tool, useful in various aspects of daily life, such as planning events, studying, or decorating a new home. Through seamless integration into Facebook, Instagram, WhatsApp, and Messenger, Meta AI is available without users needing to switch applications.

Enhanced Functionality and Creative Tools

Notably, Meta AI is enhancing its image generation feature, allowing users to create high-quality images in real-time. These can be used for a variety of purposes, from personal to professional, such as album art or event decor.

Meta AI Online Platform

Additionally, Meta is launching the meta.ai website to offer assistance on desktops. Users can get help with tasks ranging from academic support to professional writing enhancements.

Integration Across Platforms

Integration of Meta AI into search within Meta’s applications allows users to fetch real-time information seamlessly. This integration is a leap towards creating a more cohesive digital experience, bridging the gaps between social media browsing, information retrieval, and creative expression.

The Announcement: https://llama.meta.com/llama3/

Tags: ML News
Iterate on AI agents and models faster. Try Weights & Biases today.