promptfoo
promptfoo.dev
Test and compare LLM prompts and models with assertions, locally or in CI.
Instead of Eyeballing prompt changes in a playground
Every tool tagged Testing. Narrow it down with a type filter or a search.
Test and compare LLM prompts and models with assertions, locally or in CI.
An offline API client that stores collections as plain text files in your repo.
A local SMTP server and web inbox for testing the emails your app sends.
Spin up real databases and services in Docker from inside your tests.
Test your Ansible roles and collections in throwaway containers or VMs.
A fast JavaScript runtime, package manager, bundler and test runner in one binary.