StarCoder vs ChatGPT Plugins

StarCoder is an innovative Large Language Model for Code (Code LLM) presented by Hugging Face, designed to revolutionize the way we work with programming languages. Trained on an extensive range of permissively licensed data gathered from GitHub, StarCoder understands and processes over 80 programming languages, Git commits, GitHub issues, and Jupyter notebooks. With its ~15B parameter model, StarsCoder is fine-tuned using 35B Python tokens, delivering unparalleled code completion, modification, and explanation capabilities. The model notably demonstrates superior performance in benchmarks against other open-source and proprietary Code LLMs like OpenAI's CodeX. StarCoder's advanced features include an extensive context length, the ability to function as a sophisticated technical assistant, and the promise of safe use through measures like PII redaction and novel attribution tracing. Additionally, StarCoder is being made accessible under the OpenRAIL license, encouraging widespread integration and adaptation to suit a variety of company products and community projects.

OpenAI follows an iterative deployment philosophy, and as part of this approach, it is gradually releasing plugins for ChatGPT. The purpose of this gradual release is to study the real-world use of the plugins, assess their impact, and identify any safety and alignment challenges that may arise. Getting these aspects right is essential for OpenAI to achieve its mission.

Since the launch of ChatGPT, users have expressed interest in having access to plugins, and many developers are experimenting with similar ideas. OpenAI is initially rolling out plugins to a small set of users and plans to gradually increase access as it learns more. After an alpha period, API users who want to integrate plugins into their products will also have access. OpenAI is excited to build a community that will help shape the future of the human-AI interaction paradigm.

Developers who have been invited off the waitlist can use OpenAI's documentation to build a plugin for ChatGPT. Once the plugin is created, it is listed in the prompt shown to the language model, along with documentation that instructs the model on how to use each one. The first set of plugins has been created by Expedia, FiscalNote, Instacart, KAYAK, Klarna, Milo, OpenTable, Shopify, Slack, Speak, Wolfram, and Zapier.