Prompt evaluation tools - AI tools

Promptotype The platform for structured prompt engineering
Promptotype is a platform designed for structured prompt engineering, enabling users to develop, test, and monitor LLM tasks efficiently.
- Freemium
- From 6$
PromptsLabs A Library of Prompts for Testing LLMs
PromptsLabs is a community-driven platform providing copy-paste prompts to test the performance of new LLMs. Explore and contribute to a growing collection of prompts.
- Free
prmpts.ai AI Prompt Interaction and Execution Platform
prmpts.ai offers an interface for crafting, testing, and running prompts with AI models to generate specific text-based outputs.
- Other
EvalPrompts Make your prompts pop with AI-powered crafting, scoring, and refinement
EvalPrompts is an AI tool that helps users create, evaluate, and refine prompts through a clean interface, enabling faster ideation and better outputs for various creative and professional applications.
- Free
Lisapet.ai AI Prompt testing suite for product teams
Lisapet.ai is an AI development platform designed to help product teams prototype, test, and deploy AI features efficiently by automating prompt testing.
- Paid
- From 9$
Prompt Octopus LLM evaluations directly in your codebase
Prompt Octopus is a VSCode extension allowing developers to select prompts, choose from 40+ LLMs, and compare responses side-by-side within their codebase.
- Freemium
- From 10$
PromptsRoyale Optimize Your Prompts with AI-Powered Testing
PromptsRoyale refines and evaluates AI prompts through objective-based testing and scoring, ensuring optimal performance.
- Free
BasicPrompt One prompt, every model
BasicPrompt is a comprehensive prompt engineering and management platform that enables users to build, test, deploy, and share prompts across multiple AI models through a unified interface.
- Freemium
- From 29$
Prompt Mixer Open source tool for prompt engineering
Prompt Mixer is a desktop application for teams to create, test, and manage AI prompts and chains across different language models, featuring version control and comprehensive evaluation tools.
- Freemium
- From 29$
Promptmetheus Forge better LLM prompts for your AI applications and workflows
Promptmetheus is a comprehensive prompt engineering IDE that helps developers and teams create, test, and optimize language model prompts with support for 100+ LLMs and popular inference APIs.
- Freemium
- From 29$
Parea Test and Evaluate your AI systems
Parea is a platform for testing, evaluating, and monitoring Large Language Model (LLM) applications, helping teams track experiments, collect human feedback, and deploy prompts confidently.
- Freemium
- From 150$