Introducing prompt Playground 2.0: A New Prompt Engineering IDE

Prompt engineering is the foundation of any reliable LLM application. Yet most teams struggle with a fragmented workflow - testing prompts in one place, managing versions in another, and deploying somewhere else. Today, we're introducing Playground 2.0, a complete prompt engineering IDE that brings everything together.

Why We Built a New Kind of Prompt Playground

The original OpenAI playground changed how we interact with LLMs. But as applications grew more complex, its limitations became clear. You couldn't save test cases, compare models side-by-side, or manage prompts across environments.

We watched hundreds of teams build LLM applications and saw that success depends on rapid iteration - testing prompts, comparing models, and finding what works reliably. So we rebuilt our prompt engineering workflow from the ground up.

What Makes Playground 2.0 Different

Multi-Message Templates That Work

Modern LLM applications need more than single prompts. Now you can:

• Create templates with system and user messages in one view

• Add variables using {{variable}} syntax with built-in validation

• See exactly what your LLM will receive, eliminating surprises in production

Real Model Comparison

Stop guessing which model works best. Our playground lets you:

• Compare outputs from different models side-by-side

• Test across 50+ models including GPT-4, Claude, Gemini, Mistral, and DeepSeek

• Adjust parameters like temperature, top-k, and presence penalty to find optimal settings

• See cost and latency differences to make informed decisions

Testing Built In

We've made testing a core part of the workflow:

• Load test sets directly into the playground

• Save working examples as new test cases

• Import production data from traces for testing

• Build benchmark suites to evaluate model performance

An Integrated Platform

Everything you need in one place:

• Prompt management with version control and instant rollback

• Observability to track every model call in production

• Evaluation framework to measure and improve performance

• Deploy to different environments with one click

For Engineering Teams

We've built tools that make production deployment easier:

• Programmatic access through our API

• Works with any framework (LangChain, LlamaIndex, CrewAI)

• Version control for prompts and configurations

• Deploy to different environments without code changes

Creating prompts now happens instantly, and your whole team can collaborate without touching code.

Getting Started

Ready to improve your prompt engineering workflow? Here's how:

1. Create a free account

2. Create a new prompt

3. Load your test data

4. Start comparing models

Or book a demo to see how it fits your use case.

p.s. The new playground is available now. It's open source, so you can self-host or use our cloud version.