The UAE's Technology Innovation Institute (TII) has introduced Falcon 3, the latest iteration of its open-source large language model series, designed to bring cutting-edge AI to edge devices (like smartphones and laptops). Falcon 3 sets a new standard for small AI models, enabling businesses and individuals to leverage powerful capabilities without relying on extensive computational infrastructure.
Key Points:
- Falcon 3 models operate efficiently on light infrastructures, including laptops, setting new global benchmarks for small LLMs.
- Trained on 14 trillion tokens, Falcon 3 outperforms Meta's LLaMA models and ranks first on Hugging Face leaderboards.
- The model family includes four sizes (1B, 3B, 7B, 10B) in Base and Instruct versions, optimized for tasks like reasoning, coding, and language understanding.
- Falcon 3 supports English, Spanish, French, and Portuguese and offers quantized versions for resource-constrained environments.
Trained on 14 trillion tokens—over double its predecessor Falcon 2—Falcon 3 achieves superior performance in benchmarks, topping Hugging Face’s leaderboard for models under 13 billion parameters. It surpasses competitors like Meta’s LLaMA variants and demonstrates exceptional proficiency in reasoning, instruction following, code generation, and mathematics tasks.
Falcon 3 offers four scalable model sizes: 1B, 3B, 7B, and 10B. Each size comes in two versions: Base, for general-purpose tasks, and Instruct, fine-tuned for conversational applications. Its quantized versions, optimized for rapid deployment, ensure smooth performance on resource-limited systems.
“With Falcon 3, we advance our contributions to the global AI community, providing accessible and responsible tools that empower innovation,” said Faisal Al Bannai, Secretary General of ATRC.
TII also launched Falcon Playground, a testing environment for developers and researchers to experiment with Falcon 3 before full deployment. The models are available under the TII Falcon License, which encourages ethical AI usage.
Falcon 3’s small footprint and high efficiency make it ideal for diverse applications, from startups to enterprise-level AI solutions. The series sets the stage for future updates, including multimodal functionalities like text, image, video, and voice processing, expected in early 2025.
Developers can download Falcon 3 immediately from Hugging Face or TII’s platform, and explore its capabilities to build next-generation AI tools.