UAE TII Releases Falcon 2 11B: A New LLama3 Alternative?
A new Llama3 alternative?
Created on May 13|Last edited on May 13
Comment
Abu Dhabi, UAE - The Technology Innovation Institute (TII), part of Abu Dhabi’s Advanced Technology Research Council, has introduced a new addition to its Falcon series of large language models, the Falcon 2. This release includes two versions: the Falcon 2 11B and the Falcon 2 11B VLM, the latter being the first vision-to-language model (VLM) in the series capable of converting visual inputs to textual outputs.
Outperforming Llama-3?
The Falcon 2 11B model, with 11 billion parameters and trained on 5.5 trillion tokens, has shown superior performance compared to Meta's recently launched Llama 3 model, and matches Google’s Gemma 7B model in effectiveness, according to results verified by Hugging Face’s leaderboard.
The benchmarks displayed evaluate the performance of AI models like Falcon 2 11B and Llama 3 8B across various aspects of language understanding, reasoning, and domain-specific knowledge. The ARC (AI2 Reasoning Challenge) assesses complex reasoning abilities using science exam questions. HellaSwag tests common-sense reasoning by predicting how sentences should logically continue. MMLU (Massive Multitask Language Understanding) measures the model's proficiency across a broad range of subjects through multiple-choice questions, assessing their ability to handle diverse and specialized knowledge domains. Together, these benchmarks provide a comprehensive picture of a model's capabilities in language processing and reasoning.
Open Source
Both versions of Falcon 2 are open-source, supporting multilingual capabilities and designed to function efficiently even on a single GPU. This accessibility and the implementation of features such as the 'Mixture of Experts' machine learning strategy, suggest a focus on advancing AI capabilities while enhancing model efficiency and flexibility.
Interesting Capabilities!
TII’s ongoing efforts to enrich its AI models are evident in the Falcon 2 series, especially with its versatility across multiple languages and potential applications in diverse sectors like healthcare, finance, and education. The incorporation of the vision-to-language technology in Falcon 2 11B VLM particularly highlights TII's commitment to improving accessibility in AI technologies, opening up new possibilities for user interaction across the globe.
Add a comment
Tags: ML News
Iterate on AI agents and models faster. Try Weights & Biases today.