AutoResearch + PromptFoo = AutoPrompter. Run it with Neo AI Engineer
-
Updated
Apr 16, 2026 - Python
#
promptfoo
Here are 39 public repositories matching this topic...
This repository contains the code snippets used in "LLM Prompt Engineering For Developers"
react python nlp natural-language-processing openai gpt perplexity few-shot-learning gpt-4 llm prompt-engineering chain-of-thought chatgpt langchain chatgpt-api azure-prompt-flow promptfoo general-knowledge-prompting betterprompt
-
Updated
Apr 22, 2024
Your guide to the Agentic AI evolution. **Prompting Blueprints** offers a curated collection of concepts and tactics for building autonomous AI workflows. Master tool-specific playbooks, backed by structured prompt packs and rigorous evaluations for the latest AI models.
mkdocs gemini llm prompt-engineering generative-ai chatgpt prompt-library promptfoo context-engineering
-
Updated
May 14, 2026 - HTML
Runtime-secured AI tooling framework for production-grade LLM applications, protecting against prompt injection, jailbreaks, and adversarial attacks.
ai jailbreak ai-safety security-framework ai-defense ai-security prompt-injection llm-security promptfoo prompt-security llm-guard llm-guardrails ai-hacking garak llm-protection openai-security chatgpt-security hacking-tools-ai lakeraguard calypsoai-moderator
-
Updated
Apr 2, 2026 - Python
Community Plugin for Genkit to use Promptfoo
plugin testing firebase ai evaluation prompt prompts evaluation-framework llm llmops prompt-testing llm-eval llm-evaluation llm-evaluation-framework promptfoo genkit genkitx genkit-plugin
-
Updated
Jan 3, 2025 - TypeScript
prompt-evaluator is an open-source toolkit for evaluating, testing, and comparing LLM prompts. It provides a GUI-driven workflow for running prompt tests, tracking token usage, visualizing results, and ensuring reliability across models like OpenAI, Claude, and Gemini.
electron react typescript datascience developer-tools ai-evaluation llm prompt-engineering prompt-testing promptfoo ai-evaluation-tools ai-evaluation-metrics ai-evaluation-framework
-
Updated
Dec 4, 2025 - TypeScript
Compare models across prompts, test domains, and scenarios.
-
Updated
Apr 5, 2026 - Python
kotlin testing mcp moderation chatbot demo-app rag quarkus langchain4j llm-evaluation promptfoo rag-chatbot mcp-client
-
Updated
May 13, 2026 - Kotlin
Sample project demonstrates how to use Promptfoo, a test framework for evaluating the output of generative AI models
testing evaluation prompts evaluation-framework llm llmops prompt-testing llm-eval llm-evaluation llm-evaluation-framework promptfoo
-
Updated
Sep 10, 2024
CI-native evidence compiler for agent systems: MCP policy enforcement, evidence receipts, Trust Basis claims, and reviewable artifacts.
rust ci mcp provenance ai-agents evidence ai-security policy-enforcement sbom policy-as-code github-actions cyclonedx supply-chain-security openfeature promptfoo mcp-server agent-security evidence-bundles evidence-receipts trust-basis
-
Updated
May 12, 2026 - Rust
AI security co-pilot skill for Claude Code - identify, test, and fix vulnerabilities in LLM-powered applications
jailbreak owasp red-team security-testing ai-security prompt-injection llm-security promptfoo claude-code claude-skill
-
Updated
Dec 14, 2025
Quickstart guide for using PromptFoo to evaluate LLM prompts via CLI or Colab.
-
Updated
Nov 23, 2025
Evaluation patterns, release gates, and anti-hallucination techniques for developer-focused AI workflows.
-
Updated
Mar 27, 2026 - Python
A fun experiment using promptfoo for evaluating LLM responses on pizza order transcripts
-
Updated
Apr 15, 2025 - Python
Red teaming a banking and finance llm assistant
-
Updated
Nov 19, 2025
Config-driven CLI that runs promptfoo evals, identifies low-scoring prompts, rewrites them via Claude API, and re-evaluates.
-
Updated
Mar 26, 2026 - TypeScript
Multi-agent LLM-driven SOC pipeline (n8n + Ollama), adversarially red-teamed against the CSA Agentic AI Red Teaming Guide.
-
Updated
May 1, 2026 - Python
Multi-turn conversational AI agent for medication adherence, with CI-gated evaluation harness. LangGraph 1.0, multi-LLM (Groq/Cerebras/Anthropic), RAG with citation gate, OpenInference observability. Reference implementation, 100% synthetic data. Pattern transfers to other regulated industries.
python conversational-ai multi-turn rag fastapi guardrails groq opentelemetry healthcare-ai ai-agent llm huggingface-spaces anthropic cerebras llm-evaluation promptfoo langgraph llm-observability regulated-industries openinference
-
Updated
May 14, 2026 - Python
Improve this page
Add a description, image, and links to the promptfoo topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the promptfoo topic, visit your repo's landing page and select "manage topics."