FriendliAI vs ChatGPT Plugins

FriendliAI is dedicated to advancing the capabilities of generative AI by providing efficient and cost-effective infrastructure solutions that cater to a wide array of needs. With groundbreaking performance on offer, FriendliAI boasts being 7.5 times cheaper than OpenAI GPT-3.5, achieving 16 times higher throughput, and delivering 24 times lower latency. These remarkable metrics open new frontiers for businesses seeking to integrate generative AI models into their operations.

The company offers three core services to run generative AI models with its Friendli Engine: Friendli Container, Friendli Dedicated Endpoints, and Friendli Serverless Endpoints. Each of these is designed to meet different operational needs—whether it's serving large language models (LLMs) in private environments, building and serving custom LLMs on autopilot, or accessing fast and affordable APIs for open-source LLMs and LMMs.

Customer success stories on the FriendliAI website highlight how various companies have reduced their costs and operational burdens. For instance, NaCloud's novel writing service and Scatter Lab's chatbot have both halved their costs, while TUNiB has enjoyed a more convenient and reliable chatbot service without added management efforts.

FriendliAI also announces the integration of its Friendli Engine with Amazon Sagemaker Jumpstart, enabling users to better serve JumpStart Foundation Models with enhanced performance and cost efficiency.

The company's strong commitment to generative AI infrastructure is further underpinned by their contact information, showing presence in both Redwood City, California, and Seoul, Korea, encouraging potential clients to get started on harnessing the power of their AI models.

OpenAI follows an iterative deployment philosophy, and as part of this approach, it is gradually releasing plugins for ChatGPT. The purpose of this gradual release is to study the real-world use of the plugins, assess their impact, and identify any safety and alignment challenges that may arise. Getting these aspects right is essential for OpenAI to achieve its mission.

Since the launch of ChatGPT, users have expressed interest in having access to plugins, and many developers are experimenting with similar ideas. OpenAI is initially rolling out plugins to a small set of users and plans to gradually increase access as it learns more. After an alpha period, API users who want to integrate plugins into their products will also have access. OpenAI is excited to build a community that will help shape the future of the human-AI interaction paradigm.

Developers who have been invited off the waitlist can use OpenAI's documentation to build a plugin for ChatGPT. Once the plugin is created, it is listed in the prompt shown to the language model, along with documentation that instructs the model on how to use each one. The first set of plugins has been created by Expedia, FiscalNote, Instacart, KAYAK, Klarna, Milo, OpenTable, Shopify, Slack, Speak, Wolfram, and Zapier.