Llama 2 vs GPT-4

The next generation of our open source large language model

This release includes model weights and starting code for pretrained and fine-tuned Llama language models — ranging from 7B to 70B parameters.

Llama 2 was trained on 40% more data than Llama 1, and has double the context length.

Training Llama-2-chat: Llama 2 is pretrained using publicly available online data. An initial version of Llama-2-chat is then created through the use of supervised fine-tuning. Next, Llama-2-chat is iteratively refined using Reinforcement Learning from Human Feedback (RLHF), which includes rejection sampling and proximal policy optimization (PPO).

Meta and Microsoft have partnered to unveil Llama 2, the open-source successor to their widely-utilized large language model, Llama. This groundbreaking model is designed to enhance the capabilities of AI, offering it free for both research and commercial use. Recognized as the preferred partner, Microsoft is integrating Llama 2 into its Azure AI model catalog, providing developers with robust cloud-native tools and optimization for Windows platforms.

Llama 2 is also accessible through other major providers like AWS and Hugging Face. Dedicated to responsible AI innovation, Meta and Microsoft emphasize transparency and community-oriented development with resources like red-teaming exercises, a transparency schematic, and a responsible use guide. Collaborative initiatives such as the Open Innovation AI Research Community and the Llama Impact Challenge are also part of the rollout, aiming to spur responsible applications of Llama 2 across various sectors.

GPT-4 is the latest milestone in OpenAI’s effort in scaling up deep learning.

GPT-4 is a large multimodal model (accepting image and text inputs, emitting text outputs) that, while less capable than humans in many real-world scenarios, exhibits human-level performance on various professional and academic benchmarks. For example, it passes a simulated bar exam with a score around the top 10% of test takers; in contrast, GPT-3.5’s score was around the bottom 10%. We’ve spent 6 months iteratively aligning GPT-4 using lessons from our adversarial testing program as well as ChatGPT, resulting in our best-ever results (though far from perfect) on factuality, steerability, and refusing to go outside of guardrails.

GPT-4 is more creative and collaborative than ever before. It can generate, edit, and iterate with users on creative and technical writing tasks, such as composing songs, writing screenplays, or learning a user’s writing style.