OPT-IML vs GPT-4

The paper titled "OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization" focuses on fine-tuning large pre-trained language models with a technique called instruction-tuning, which has been demonstrated to improve model performance on zero and few-shot generalization to unseen tasks. The main challenge addressed in the study is grasping the performance trade-offs due to different decisions made during instruction-tuning, such as task sampling strategies and fine-tuning objectives.

The authors introduce the OPT-IML Bench—a comprehensive benchmark comprising 2000 NLP tasks from 8 different benchmarks—and use it to evaluate the instruction tuning on OPT models of varying sizes. The resulting instruction-tuned models, OPT-IML 30B and 175B, exhibit significant improvements over vanilla OPT and are competitive with specialized models, further inspiring the release of the OPT-IML Bench framework for broader research use.

GPT-4 is the latest milestone in OpenAI’s effort in scaling up deep learning.

GPT-4 is a large multimodal model (accepting image and text inputs, emitting text outputs) that, while less capable than humans in many real-world scenarios, exhibits human-level performance on various professional and academic benchmarks. For example, it passes a simulated bar exam with a score around the top 10% of test takers; in contrast, GPT-3.5’s score was around the bottom 10%. We’ve spent 6 months iteratively aligning GPT-4 using lessons from our adversarial testing program as well as ChatGPT, resulting in our best-ever results (though far from perfect) on factuality, steerability, and refusing to go outside of guardrails.

GPT-4 is more creative and collaborative than ever before. It can generate, edit, and iterate with users on creative and technical writing tasks, such as composing songs, writing screenplays, or learning a user’s writing style.