Prompteneering. Open the library →

Evaluation & Testing AI agents

159 expert agents for Evaluation & Testing, within AI Engineering & LLMOps.

Search these in the library →

Agents

• Automated LLM Regression Test Suite BuilderEvaluation & Testing · Cursor
• Automated LLM Regression Test Suite Builder for Cost Optimization Runbook RefreshEvaluation & Testing · Claude
• Benchmark Latency and Cost per EvalEvaluation & Testing · Weights & Biases
• Benchmark Latency and Cost per Eval for Integration Cleanup Migration SprintEvaluation & Testing · Zapier
• Benchmark Latency and Cost per Eval for Production Hardening Design ReviewEvaluation & Testing · Claude
• Build a Golden Dataset for Regression TestsEvaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Automation Rollout Migration SprintEvaluation & Testing · Claude
• Build a Golden Dataset for Regression Tests for Cross-Functional RolloutEvaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Cross-Functional Rollout Scenario 0550Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Cross-Functional Rollout Scenario 1630Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Escalation TriageEvaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Escalation Triage Scenario 0190Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Escalation Triage Scenario 1270Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Governance Audit PrepEvaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Governance Audit Prep Scenario 0730Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Governance Audit Prep Scenario 1810Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Incident Prevention Runbook RefreshEvaluation & Testing · Zapier
• Build a Golden Dataset for Regression Tests for Portfolio PrioritizationEvaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Portfolio Prioritization Scenario 0370Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Portfolio Prioritization Scenario 1450Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Regional Launch Scenario 0910Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability ReviewEvaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability Review Scenario 0010Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability Review Scenario 1090Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability Review for Cross-Functional Rollout Scenario 0708Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability Review for Cross-Functional Rollout Scenario 1788Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability Review for Escalation Triage Scenario 0348Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability Review for Escalation Triage Scenario 1428Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability Review for Governance Audit Prep Scenario 0888Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability Review for Portfolio Prioritization Scenario 0528Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability Review for Portfolio Prioritization Scenario 1608Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability Review for Regional Launch Scenario 1068Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability Review for Service Reliability Review Scenario 0168Evaluation & Testing · Python
• Build a Golden Dataset for Regression Tests for Service Reliability Review for Service Reliability Review Scenario 1248Evaluation & Testing · Python
• Build a Human Annotation WorkflowEvaluation & Testing · LangSmith
• Build a Human Annotation Workflow for Cost Optimization Steady-State OptimizationEvaluation & Testing · Claude
• Build a Human Annotation Workflow for Cross-Functional Rollout Scenario 0551Evaluation & Testing · LangSmith
• Build a Human Annotation Workflow for Cross-Functional Rollout Scenario 1631Evaluation & Testing · LangSmith
• Build a Human Annotation Workflow for Escalation Triage Scenario 0191Evaluation & Testing · LangSmith
• Build a Human Annotation Workflow for Escalation Triage Scenario 1271Evaluation & Testing · LangSmith
• Build a Human Annotation Workflow for Governance Audit Prep Scenario 0731Evaluation & Testing · LangSmith
• Build a Human Annotation Workflow for Governance Audit Prep Scenario 1811Evaluation & Testing · LangSmith
• Build a Human Annotation Workflow for Pipeline Stabilization Backlog TriageEvaluation & Testing · Zapier
• Build a Human Annotation Workflow for Portfolio Prioritization Scenario 0371Evaluation & Testing · LangSmith
• Build a Human Annotation Workflow for Portfolio Prioritization Scenario 1451Evaluation & Testing · LangSmith
• Build a Human Annotation Workflow for Regional Launch Scenario 0911Evaluation & Testing · LangSmith
• Build a Human Annotation Workflow for Service Reliability Review Scenario 0011Evaluation & Testing · LangSmith
• Build a Human Annotation Workflow for Service Reliability Review Scenario 1091Evaluation & Testing · LangSmith
• Build a Multi-Turn Conversation EvalEvaluation & Testing · Python
• Build a Multi-Turn Conversation Eval for Latency Reduction Design ReviewEvaluation & Testing · Weights & Biases
• Build a Multi-Turn Conversation Eval for Latency Reduction Design Review for Cross-Functional Rollout Scenario 0624Evaluation & Testing · Weights & Biases
• Build a Multi-Turn Conversation Eval for Latency Reduction Design Review for Cross-Functional Rollout Scenario 1704Evaluation & Testing · Weights & Biases
• Build a Multi-Turn Conversation Eval for Latency Reduction Design Review for Escalation Triage Scenario 0264Evaluation & Testing · Weights & Biases
• Build a Multi-Turn Conversation Eval for Latency Reduction Design Review for Escalation Triage Scenario 1344Evaluation & Testing · Weights & Biases
• Build a Multi-Turn Conversation Eval for Latency Reduction Design Review for Governance Audit Prep Scenario 0804Evaluation & Testing · Weights & Biases
• Build a Multi-Turn Conversation Eval for Latency Reduction Design Review for Governance Audit Prep Scenario 1884Evaluation & Testing · Weights & Biases
• Build a Multi-Turn Conversation Eval for Latency Reduction Design Review for Portfolio Prioritization Scenario 0444Evaluation & Testing · Weights & Biases
• Build a Multi-Turn Conversation Eval for Latency Reduction Design Review for Portfolio Prioritization Scenario 1524Evaluation & Testing · Weights & Biases
• Build a Multi-Turn Conversation Eval for Latency Reduction Design Review for Regional Launch Scenario 0984Evaluation & Testing · Weights & Biases
• Build a Multi-Turn Conversation Eval for Latency Reduction Design Review for Service Reliability Review Scenario 0084Evaluation & Testing · Weights & Biases
• Build a Multi-Turn Conversation Eval for Latency Reduction Design Review for Service Reliability Review Scenario 1164Evaluation & Testing · Weights & Biases
• Build a Multi-Turn Conversation Eval for Release Readiness Migration SprintEvaluation & Testing · Claude
• Build a Pairwise A/B Eval for Two PromptsEvaluation & Testing · ChatGPT
• Build a Pairwise A/B Eval for Two Prompts for Evaluation Redesign Backlog TriageEvaluation & Testing · Weights & Biases
• Build a Pairwise A/B Eval for Two Prompts for Evaluation Redesign Backlog Triage for Cross-Functional Rollout Scenario 0695Evaluation & Testing · Weights & Biases
• Build a Pairwise A/B Eval for Two Prompts for Evaluation Redesign Backlog Triage for Cross-Functional Rollout Scenario 1775Evaluation & Testing · Weights & Biases
• Build a Pairwise A/B Eval for Two Prompts for Evaluation Redesign Backlog Triage for Escalation Triage Scenario 0335Evaluation & Testing · Weights & Biases
• Build a Pairwise A/B Eval for Two Prompts for Evaluation Redesign Backlog Triage for Escalation Triage Scenario 1415Evaluation & Testing · Weights & Biases
• Build a Pairwise A/B Eval for Two Prompts for Evaluation Redesign Backlog Triage for Governance Audit Prep Scenario 0875Evaluation & Testing · Weights & Biases
• Build a Pairwise A/B Eval for Two Prompts for Evaluation Redesign Backlog Triage for Portfolio Prioritization Scenario 0515Evaluation & Testing · Weights & Biases
• Build a Pairwise A/B Eval for Two Prompts for Evaluation Redesign Backlog Triage for Portfolio Prioritization Scenario 1595Evaluation & Testing · Weights & Biases
• Build a Pairwise A/B Eval for Two Prompts for Evaluation Redesign Backlog Triage for Regional Launch Scenario 1055Evaluation & Testing · Weights & Biases
• Build a Pairwise A/B Eval for Two Prompts for Evaluation Redesign Backlog Triage for Service Reliability Review Scenario 0155Evaluation & Testing · Weights & Biases
• Build a Pairwise A/B Eval for Two Prompts for Evaluation Redesign Backlog Triage for Service Reliability Review Scenario 1235Evaluation & Testing · Weights & Biases
• Build a Pairwise A/B Eval for Two Prompts for Integration Cleanup Steady-State OptimizationEvaluation & Testing · Zapier
• Build a Retrieval Quality EvalEvaluation & Testing · Python
• Build a Retrieval Quality Eval for Automation Rollout Steady-State OptimizationEvaluation & Testing · Claude
• Build a Retrieval Quality Eval for Incident Prevention Backlog TriageEvaluation & Testing · Zapier
• Compute Inter-Rater Agreement ScoresEvaluation & Testing · Python
• Compute Inter-Rater Agreement Scores for Automation Rollout Backlog TriageEvaluation & Testing · Claude
• Compute Inter-Rater Agreement Scores for Security Review Steady-State OptimizationEvaluation & Testing · Weights & Biases
• Create a Regression Test Harness for PromptsEvaluation & Testing · Python
• Create a Regression Test Harness for Prompts for Cross-Functional Rollout Scenario 0552Evaluation & Testing · Python
• Create a Regression Test Harness for Prompts for Cross-Functional Rollout Scenario 1632Evaluation & Testing · Python
• Create a Regression Test Harness for Prompts for Escalation Triage Scenario 0192Evaluation & Testing · Python
• Create a Regression Test Harness for Prompts for Escalation Triage Scenario 1272Evaluation & Testing · Python
• Create a Regression Test Harness for Prompts for Governance Audit Prep Scenario 0732Evaluation & Testing · Python
• Create a Regression Test Harness for Prompts for Governance Audit Prep Scenario 1812Evaluation & Testing · Python
• Create a Regression Test Harness for Prompts for Observability Uplift Migration SprintEvaluation & Testing · Zapier
• Create a Regression Test Harness for Prompts for Portfolio Prioritization Scenario 0372Evaluation & Testing · Python
• Create a Regression Test Harness for Prompts for Portfolio Prioritization Scenario 1452Evaluation & Testing · Python
• Create a Regression Test Harness for Prompts for Regional Launch Scenario 0912Evaluation & Testing · Python
• Create a Regression Test Harness for Prompts for Release Readiness Design ReviewEvaluation & Testing · Claude
• Create a Regression Test Harness for Prompts for Service Reliability Review Scenario 0012Evaluation & Testing · Python
• Create a Regression Test Harness for Prompts for Service Reliability Review Scenario 1092Evaluation & Testing · Python
• Design a Rubric for Customer-Support RepliesEvaluation & Testing · ChatGPT
• Design a Rubric for Customer-Support Replies for Incident Prevention Steady-State OptimizationEvaluation & Testing · Zapier
• Design a Rubric for Customer-Support Replies for Latency Reduction Migration SprintEvaluation & Testing · Weights & Biases
• Design a Rubric for Customer-Support Replies for Latency Reduction Migration Sprint for Cross-Functional Rollout Scenario 0696Evaluation & Testing · Weights & Biases
• Design a Rubric for Customer-Support Replies for Latency Reduction Migration Sprint for Cross-Functional Rollout Scenario 1776Evaluation & Testing · Weights & Biases
• Design a Rubric for Customer-Support Replies for Latency Reduction Migration Sprint for Escalation Triage Scenario 0336Evaluation & Testing · Weights & Biases
• Design a Rubric for Customer-Support Replies for Latency Reduction Migration Sprint for Escalation Triage Scenario 1416Evaluation & Testing · Weights & Biases
• Design a Rubric for Customer-Support Replies for Latency Reduction Migration Sprint for Governance Audit Prep Scenario 0876Evaluation & Testing · Weights & Biases
• Design a Rubric for Customer-Support Replies for Latency Reduction Migration Sprint for Portfolio Prioritization Scenario 0516Evaluation & Testing · Weights & Biases
• Design a Rubric for Customer-Support Replies for Latency Reduction Migration Sprint for Portfolio Prioritization Scenario 1596Evaluation & Testing · Weights & Biases
• Design a Rubric for Customer-Support Replies for Latency Reduction Migration Sprint for Regional Launch Scenario 1056Evaluation & Testing · Weights & Biases
• Design a Rubric for Customer-Support Replies for Latency Reduction Migration Sprint for Service Reliability Review Scenario 0156Evaluation & Testing · Weights & Biases
• Design a Rubric for Customer-Support Replies for Latency Reduction Migration Sprint for Service Reliability Review Scenario 1236Evaluation & Testing · Weights & Biases
• Design an LLM Eval Suite with RubricsEvaluation & Testing · Claude
• Design an LLM Eval Suite with Rubrics for Migration Planning Runbook RefreshEvaluation & Testing · Weights & Biases
• Design an LLM Eval Suite with Rubrics for Pipeline Stabilization Migration SprintEvaluation & Testing · Zapier
• Detect Eval Score Drift Over TimeEvaluation & Testing · Weights & Biases
• Detect Eval Score Drift Over Time for Cost Optimization Backlog TriageEvaluation & Testing · Claude
• Detect Eval Score Drift Over Time for Evaluation Redesign Steady-State OptimizationEvaluation & Testing · Weights & Biases
• Detect Eval Score Drift Over Time for Evaluation Redesign Steady-State Optimization for Cross-Functional Rollout Scenario 0623Evaluation & Testing · Weights & Biases
• Detect Eval Score Drift Over Time for Evaluation Redesign Steady-State Optimization for Cross-Functional Rollout Scenario 1703Evaluation & Testing · Weights & Biases
• Detect Eval Score Drift Over Time for Evaluation Redesign Steady-State Optimization for Escalation Triage Scenario 0263Evaluation & Testing · Weights & Biases
• Detect Eval Score Drift Over Time for Evaluation Redesign Steady-State Optimization for Escalation Triage Scenario 1343Evaluation & Testing · Weights & Biases
• Detect Eval Score Drift Over Time for Evaluation Redesign Steady-State Optimization for Governance Audit Prep Scenario 0803Evaluation & Testing · Weights & Biases
• Detect Eval Score Drift Over Time for Evaluation Redesign Steady-State Optimization for Governance Audit Prep Scenario 1883Evaluation & Testing · Weights & Biases
• Detect Eval Score Drift Over Time for Evaluation Redesign Steady-State Optimization for Portfolio Prioritization Scenario 0443Evaluation & Testing · Weights & Biases
• Detect Eval Score Drift Over Time for Evaluation Redesign Steady-State Optimization for Portfolio Prioritization Scenario 1523Evaluation & Testing · Weights & Biases
• Detect Eval Score Drift Over Time for Evaluation Redesign Steady-State Optimization for Regional Launch Scenario 0983Evaluation & Testing · Weights & Biases
• Detect Eval Score Drift Over Time for Evaluation Redesign Steady-State Optimization for Service Reliability Review Scenario 0083Evaluation & Testing · Weights & Biases
• Detect Eval Score Drift Over Time for Evaluation Redesign Steady-State Optimization for Service Reliability Review Scenario 1163Evaluation & Testing · Weights & Biases
• Evals Strategy Roadmap PlannerEvaluation & Testing · Claude Code
• Evals Strategy Roadmap Planner for Observability Uplift Pilot ValidationEvaluation & Testing · Zapier
• Evaluate Classification Outputs with a Confusion MatrixEvaluation & Testing · Python
• Evaluate Classification Outputs with a Confusion Matrix for Evaluation Redesign Migration SprintEvaluation & Testing · Weights & Biases
• Evaluate Classification Outputs with a Confusion Matrix for Integration Cleanup Design ReviewEvaluation & Testing · Zapier
• Evaluate JSON Schema ConformanceEvaluation & Testing · Python
• Evaluate JSON Schema Conformance for Migration Planning Backlog TriageEvaluation & Testing · Weights & Biases
• Evaluate JSON Schema Conformance for Pipeline Stabilization Steady-State OptimizationEvaluation & Testing · Zapier
• Evaluate Tool-Calling AccuracyEvaluation & Testing · LangSmith
• Evaluate Tool-Calling Accuracy for Observability Uplift Steady-State OptimizationEvaluation & Testing · Zapier
• Evaluate Tool-Calling Accuracy for Security Review Backlog TriageEvaluation & Testing · Weights & Biases
• LLM Evaluation Framework DesignerEvaluation & Testing · Claude
• LLM Evaluation Framework Designer for Release Readiness Post-Incident Follow-UpEvaluation & Testing · Claude
• LLM Output Faithfulness VerifierEvaluation & Testing · Claude
• LLM Regression Test Suite GeneratorEvaluation & Testing · Claude
• Measure Hallucination Rate on a RAG AppEvaluation & Testing · Python
• Measure Hallucination Rate on a RAG App for Incident Prevention Migration SprintEvaluation & Testing · Zapier
• Measure Hallucination Rate on a RAG App for Latency Reduction Backlog TriageEvaluation & Testing · Weights & Biases
• Prompt Regression Test Suite BuilderEvaluation & Testing · Cursor
• Score Summaries for FaithfulnessEvaluation & Testing · Claude
• Score Summaries for Faithfulness for Observability Uplift Backlog TriageEvaluation & Testing · Zapier
• Score Summaries for Faithfulness for Release Readiness Steady-State OptimizationEvaluation & Testing · Claude
• Set Up Continuous Eval in CIEvaluation & Testing · LangSmith
• Set Up Continuous Eval in CI for Migration Planning Steady-State OptimizationEvaluation & Testing · Weights & Biases
• Set Up Continuous Eval in CI for Production Hardening Migration SprintEvaluation & Testing · Claude
• Set Up an LLM-as-Judge PipelineEvaluation & Testing · LangSmith
• Set Up an LLM-as-Judge Pipeline for Migration Planning Migration SprintEvaluation & Testing · Weights & Biases
• Set Up an LLM-as-Judge Pipeline for Production Hardening Backlog TriageEvaluation & Testing · Claude
• Track Eval Runs in Weights & BiasesEvaluation & Testing · Weights & Biases
• Track Eval Runs in Weights & Biases for Integration Cleanup Backlog TriageEvaluation & Testing · Zapier
• Track Eval Runs in Weights & Biases for Production Hardening Steady-State OptimizationEvaluation & Testing · Claude
• Write Pytest Cases for Prompt OutputsEvaluation & Testing · Python
• Write Pytest Cases for Prompt Outputs for Latency Reduction Steady-State OptimizationEvaluation & Testing · Weights & Biases
• Write Pytest Cases for Prompt Outputs for Release Readiness Backlog TriageEvaluation & Testing · Claude