GLM-130B vs ChatGPT Plugins

GLM-130B, showcased at ICLR 2023, represents a groundbreaking open bilingual pre-trained model that stands out with its impressive 130 billion parameters. Developed for bidirectional dense modeling in both English and Chinese, the GLM-130B leverages the General Language Model (GLM) algorithm for pre-training and is optimized to run inference tasks on a single server setup whether it be the A100 (40G * 8) or the V100 (32G * 8). Furthermore, its compatibility with INT4 quantization means that the already modest hardware requirements can be reduced even further, allowing a server with 4 * RTX 3090 (24G) to support the model with minimal performance degradation.

As part of its training process, the GLM-130B has digested an extensive dataset consisting of over 400 billion text tokens, equally divided between Chinese and English. It boasts exceptional bilingual support, superior performance across various datasets when compared to its counterparts, and offers fast inference times. Additionally, this repository also promotes reproducibility by facilitating open-source code and model checkpoints for over 30 tasks.

OpenAI follows an iterative deployment philosophy, and as part of this approach, it is gradually releasing plugins for ChatGPT. The purpose of this gradual release is to study the real-world use of the plugins, assess their impact, and identify any safety and alignment challenges that may arise. Getting these aspects right is essential for OpenAI to achieve its mission.

Since the launch of ChatGPT, users have expressed interest in having access to plugins, and many developers are experimenting with similar ideas. OpenAI is initially rolling out plugins to a small set of users and plans to gradually increase access as it learns more. After an alpha period, API users who want to integrate plugins into their products will also have access. OpenAI is excited to build a community that will help shape the future of the human-AI interaction paradigm.

Developers who have been invited off the waitlist can use OpenAI's documentation to build a plugin for ChatGPT. Once the plugin is created, it is listed in the prompt shown to the language model, along with documentation that instructs the model on how to use each one. The first set of plugins has been created by Expedia, FiscalNote, Instacart, KAYAK, Klarna, Milo, OpenTable, Shopify, Slack, Speak, Wolfram, and Zapier.