Llama 2 vs ChatGPT Plugins

The next generation of our open source large language model

This release includes model weights and starting code for pretrained and fine-tuned Llama language models — ranging from 7B to 70B parameters.

Llama 2 was trained on 40% more data than Llama 1, and has double the context length.

Training Llama-2-chat: Llama 2 is pretrained using publicly available online data. An initial version of Llama-2-chat is then created through the use of supervised fine-tuning. Next, Llama-2-chat is iteratively refined using Reinforcement Learning from Human Feedback (RLHF), which includes rejection sampling and proximal policy optimization (PPO).

Meta and Microsoft have partnered to unveil Llama 2, the open-source successor to their widely-utilized large language model, Llama. This groundbreaking model is designed to enhance the capabilities of AI, offering it free for both research and commercial use. Recognized as the preferred partner, Microsoft is integrating Llama 2 into its Azure AI model catalog, providing developers with robust cloud-native tools and optimization for Windows platforms.

Llama 2 is also accessible through other major providers like AWS and Hugging Face. Dedicated to responsible AI innovation, Meta and Microsoft emphasize transparency and community-oriented development with resources like red-teaming exercises, a transparency schematic, and a responsible use guide. Collaborative initiatives such as the Open Innovation AI Research Community and the Llama Impact Challenge are also part of the rollout, aiming to spur responsible applications of Llama 2 across various sectors.

ChatGPT Plugins was OpenAI's 2023 extension system that let ChatGPT call third-party APIs for live data, calculations, and external services. Plugins appeared as tools the model could invoke during a conversation after users enabled them in ChatGPT. OpenAI's March 2023 announcement listed launch partners including Expedia, Instacart, KAYAK, Klarna, OpenTable, Shopify, Slack, Wolfram, and Zapier.

The beta also shipped OpenAI-built plugins for web browsing via Bing, a sandboxed Python code interpreter, and an open-source retrieval plugin for private document search. Developers published plugins through a manifest file and OpenAPI spec, and ChatGPT Plus subscribers were the first users to enable them in chat.

OpenAI deprecated the plugin beta in favor of custom GPTs. The official blog page now states plugins have been deprecated, and OpenAI ended new plugin conversations on March 19, 2024, with full shutdown on April 9, 2024. GPTs with custom actions replaced the integration model for developers and ChatGPT users.