Meta has recently released its latest large language model Llama 3.3 70B. Which is one of the latest trained LLM in the market. Lets deep dive what all the key features and new things added in this release.
Features of Llama 3.3
Llama 3.3 70B have the follwing main features
- Ultra modern multilingual open source large language model
- Experience 405B performance and quality at a lower cost
Training Data
Llama 3.3 was pretrained using approximately 15 trillion tokens sourced from publicly available datasets. For fine-tuning, the model utilized both publicly available instruction datasets and over 25 million synthetically generated examples.Llama 3.3 Data Freshness
The pretraining data includes content up to December 2023.