MPT-30B vs ChatGPT Plugins

MPT-30B sets a new standard in the world of open-source foundation models, delivering enhanced performance and innovation. Developed using NVIDIA H100 Tensor Core GPUs, this transformational model boasts an impressive 8k context length, allowing for a deeper and more nuanced understanding of text. As part of the acclaimed MosaicML Foundation Series, MPT-30B offers open-source access and a license for commercial use, distinguishing itself as a highly accessible and powerful tool. It comes with specialized variants, including Instruct and Chat, suited for different applications.

The model is optimized for efficient inference and training performance through technologies like ALiBi and FlashAttention, also featuring remarkable coding abilities thanks to its comprehensive pre-training data mixture. MPT-30B is strategically designed for single-GPU deployment, making it a convenient choice for a wide range of users.

OpenAI follows an iterative deployment philosophy, and as part of this approach, it is gradually releasing plugins for ChatGPT. The purpose of this gradual release is to study the real-world use of the plugins, assess their impact, and identify any safety and alignment challenges that may arise. Getting these aspects right is essential for OpenAI to achieve its mission.

Since the launch of ChatGPT, users have expressed interest in having access to plugins, and many developers are experimenting with similar ideas. OpenAI is initially rolling out plugins to a small set of users and plans to gradually increase access as it learns more. After an alpha period, API users who want to integrate plugins into their products will also have access. OpenAI is excited to build a community that will help shape the future of the human-AI interaction paradigm.

Developers who have been invited off the waitlist can use OpenAI's documentation to build a plugin for ChatGPT. Once the plugin is created, it is listed in the prompt shown to the language model, along with documentation that instructs the model on how to use each one. The first set of plugins has been created by Expedia, FiscalNote, Instacart, KAYAK, Klarna, Milo, OpenTable, Shopify, Slack, Speak, Wolfram, and Zapier.