Prompteneering. Open the library →

LLM Fine-tuning & Evaluation AI agents

145 expert agents for LLM Fine-tuning & Evaluation, within AI Engineering & LLMOps.

Search these in the library →

Agents

• Build a Continuous Evaluation DashboardLLM Fine-tuning & Evaluation · Claude Code
• Build a Continuous Evaluation Dashboard for Release Readiness Steady-State OptimizationLLM Fine-tuning & Evaluation · Claude
• Build a Golden Dataset for EvaluationLLM Fine-tuning & Evaluation · Claude Code
• Build a Golden Dataset for Evaluation for Incident Prevention Steady-State OptimizationLLM Fine-tuning & Evaluation · Zapier
• Build a Hallucination Detection EvalLLM Fine-tuning & Evaluation · Claude
• Build a Hallucination Detection Eval for Security Review Steady-State OptimizationLLM Fine-tuning & Evaluation · Weights & Biases
• Build a Regression Eval for Model UpgradesLLM Fine-tuning & Evaluation · Claude Code
• Build a Regression Eval for Model Upgrades for Migration Planning Migration SprintLLM Fine-tuning & Evaluation · Weights & Biases
• Build an LLM Evaluation HarnessLLM Fine-tuning & Evaluation · Claude Code
• Build an LLM Evaluation Harness for Cost Optimization Migration SprintLLM Fine-tuning & Evaluation · Claude
• DPO & RLHF Preference Data Pipeline EngineerLLM Fine-tuning & Evaluation · GitHub Copilot
• DPO & RLHF Preference Data Pipeline Engineer for Latency Reduction Pilot ValidationLLM Fine-tuning & Evaluation · Weights & Biases
• Design a Fine-Tuning Dataset PipelineLLM Fine-tuning & Evaluation · Claude Code
• Design a Fine-Tuning Dataset Pipeline for Observability Uplift Migration SprintLLM Fine-tuning & Evaluation · Zapier
• Design a Human Evaluation ProtocolLLM Fine-tuning & Evaluation · Claude
• Design a Human Evaluation Protocol for Observability Uplift Steady-State OptimizationLLM Fine-tuning & Evaluation · Zapier
• Design a Multilingual Evaluation SetLLM Fine-tuning & Evaluation · Claude
• Design a Multilingual Evaluation Set for Migration Planning Steady-State OptimizationLLM Fine-tuning & Evaluation · Weights & Biases
• Design a Pairwise Model Comparison EvalLLM Fine-tuning & Evaluation · ChatGPT
• Design a Pairwise Model Comparison Eval for Cost Optimization Pre-Release CheckpointLLM Fine-tuning & Evaluation · Claude
• Design a Preference Dataset for AlignmentLLM Fine-tuning & Evaluation · Claude Code
• Design a Preference Dataset for Alignment for Automation Rollout Migration SprintLLM Fine-tuning & Evaluation · Claude
• Design a Preference Dataset for Alignment for Cross-Functional Rollout Scenario 0582LLM Fine-tuning & Evaluation · Claude Code
• Design a Preference Dataset for Alignment for Cross-Functional Rollout Scenario 1662LLM Fine-tuning & Evaluation · Claude Code
• Design a Preference Dataset for Alignment for Escalation Triage Scenario 0222LLM Fine-tuning & Evaluation · Claude Code
• Design a Preference Dataset for Alignment for Escalation Triage Scenario 1302LLM Fine-tuning & Evaluation · Claude Code
• Design a Preference Dataset for Alignment for Governance Audit Prep Scenario 0762LLM Fine-tuning & Evaluation · Claude Code
• Design a Preference Dataset for Alignment for Governance Audit Prep Scenario 1842LLM Fine-tuning & Evaluation · Claude Code
• Design a Preference Dataset for Alignment for Portfolio Prioritization Scenario 0402LLM Fine-tuning & Evaluation · Claude Code
• Design a Preference Dataset for Alignment for Portfolio Prioritization Scenario 1482LLM Fine-tuning & Evaluation · Claude Code
• Design a Preference Dataset for Alignment for Regional Launch Scenario 0942LLM Fine-tuning & Evaluation · Claude Code
• Design a Preference Dataset for Alignment for Service Reliability Review Scenario 0042LLM Fine-tuning & Evaluation · Claude Code
• Design a Preference Dataset for Alignment for Service Reliability Review Scenario 1122LLM Fine-tuning & Evaluation · Claude Code
• Design a Red-Team Evaluation SuiteLLM Fine-tuning & Evaluation · Claude
• Design a Red-Team Evaluation Suite for Integration Cleanup Steady-State OptimizationLLM Fine-tuning & Evaluation · Zapier
• Design a Task-Specific BenchmarkLLM Fine-tuning & Evaluation · Claude
• Design a Task-Specific Benchmark for Incident Prevention Migration SprintLLM Fine-tuning & Evaluation · Zapier
• Design an Eval for Tool-Use AccuracyLLM Fine-tuning & Evaluation · Claude Code
• Design an Eval for Tool-Use Accuracy for Pipeline Stabilization Steady-State OptimizationLLM Fine-tuning & Evaluation · Zapier
• Design an Evaluation for Output SafetyLLM Fine-tuning & Evaluation · Claude
• Design an Evaluation for Output Safety for Latency Reduction Design ReviewLLM Fine-tuning & Evaluation · Weights & Biases
• Design an Evaluation for Output Safety for Latency Reduction Design Review for Cross-Functional Rollout Scenario 0656LLM Fine-tuning & Evaluation · Weights & Biases
• Design an Evaluation for Output Safety for Latency Reduction Design Review for Cross-Functional Rollout Scenario 1736LLM Fine-tuning & Evaluation · Weights & Biases
• Design an Evaluation for Output Safety for Latency Reduction Design Review for Escalation Triage Scenario 0296LLM Fine-tuning & Evaluation · Weights & Biases
• Design an Evaluation for Output Safety for Latency Reduction Design Review for Escalation Triage Scenario 1376LLM Fine-tuning & Evaluation · Weights & Biases
• Design an Evaluation for Output Safety for Latency Reduction Design Review for Governance Audit Prep Scenario 0836LLM Fine-tuning & Evaluation · Weights & Biases
• Design an Evaluation for Output Safety for Latency Reduction Design Review for Governance Audit Prep Scenario 1916LLM Fine-tuning & Evaluation · Weights & Biases
• Design an Evaluation for Output Safety for Latency Reduction Design Review for Portfolio Prioritization Scenario 0476LLM Fine-tuning & Evaluation · Weights & Biases
• Design an Evaluation for Output Safety for Latency Reduction Design Review for Portfolio Prioritization Scenario 1556LLM Fine-tuning & Evaluation · Weights & Biases
• Design an Evaluation for Output Safety for Latency Reduction Design Review for Regional Launch Scenario 1016LLM Fine-tuning & Evaluation · Weights & Biases
• Design an Evaluation for Output Safety for Latency Reduction Design Review for Service Reliability Review Scenario 0116LLM Fine-tuning & Evaluation · Weights & Biases
• Design an Evaluation for Output Safety for Latency Reduction Design Review for Service Reliability Review Scenario 1196LLM Fine-tuning & Evaluation · Weights & Biases
• Design an LLM-as-Judge EvaluationLLM Fine-tuning & Evaluation · Claude
• Design an LLM-as-Judge Evaluation for Security Review Migration SprintLLM Fine-tuning & Evaluation · Weights & Biases
• Design an LLM-as-Judge Evaluation for Security Review Migration Sprint for Cross-Functional Rollout Scenario 0654LLM Fine-tuning & Evaluation · Weights & Biases
• Design an LLM-as-Judge Evaluation for Security Review Migration Sprint for Cross-Functional Rollout Scenario 1734LLM Fine-tuning & Evaluation · Weights & Biases
• Design an LLM-as-Judge Evaluation for Security Review Migration Sprint for Escalation Triage Scenario 0294LLM Fine-tuning & Evaluation · Weights & Biases
• Design an LLM-as-Judge Evaluation for Security Review Migration Sprint for Escalation Triage Scenario 1374LLM Fine-tuning & Evaluation · Weights & Biases
• Design an LLM-as-Judge Evaluation for Security Review Migration Sprint for Governance Audit Prep Scenario 0834LLM Fine-tuning & Evaluation · Weights & Biases
• Design an LLM-as-Judge Evaluation for Security Review Migration Sprint for Governance Audit Prep Scenario 1914LLM Fine-tuning & Evaluation · Weights & Biases
• Design an LLM-as-Judge Evaluation for Security Review Migration Sprint for Portfolio Prioritization Scenario 0474LLM Fine-tuning & Evaluation · Weights & Biases
• Design an LLM-as-Judge Evaluation for Security Review Migration Sprint for Portfolio Prioritization Scenario 1554LLM Fine-tuning & Evaluation · Weights & Biases
• Design an LLM-as-Judge Evaluation for Security Review Migration Sprint for Regional Launch Scenario 1014LLM Fine-tuning & Evaluation · Weights & Biases
• Design an LLM-as-Judge Evaluation for Security Review Migration Sprint for Service Reliability Review Scenario 0114LLM Fine-tuning & Evaluation · Weights & Biases
• Design an LLM-as-Judge Evaluation for Security Review Migration Sprint for Service Reliability Review Scenario 1194LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned ModelLLM Fine-tuning & Evaluation · Claude
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State OptimizationLLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Cross-Functional RolloutLLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Cross-Functional Rollout Scenario 0655LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Cross-Functional Rollout Scenario 1735LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation TriageLLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation Triage Scenario 0295LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation Triage Scenario 1375LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation Triage for Cross-Functional Rollout Scenario 0718LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation Triage for Cross-Functional Rollout Scenario 1798LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation Triage for Escalation Triage Scenario 0358LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation Triage for Escalation Triage Scenario 1438LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation Triage for Governance Audit Prep Scenario 0898LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation Triage for Portfolio Prioritization Scenario 0538LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation Triage for Portfolio Prioritization Scenario 1618LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation Triage for Regional Launch Scenario 1078LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation Triage for Service Reliability Review Scenario 0178LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Escalation Triage for Service Reliability Review Scenario 1258LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Governance Audit PrepLLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Governance Audit Prep Scenario 0835LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Governance Audit Prep Scenario 1915LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Portfolio PrioritizationLLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Portfolio Prioritization Scenario 0475LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Portfolio Prioritization Scenario 1555LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Regional Launch Scenario 1015LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Service Reliability ReviewLLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Service Reliability Review Scenario 0115LLM Fine-tuning & Evaluation · Weights & Biases
• Diagnose Overfitting in a Fine-Tuned Model for Evaluation Redesign Steady-State Optimization for Service Reliability Review Scenario 1195LLM Fine-tuning & Evaluation · Weights & Biases
• Evaluate Latency and Quality Trade-offsLLM Fine-tuning & Evaluation · Claude
• Evaluate Latency and Quality Trade-offs for Production Hardening Design ReviewLLM Fine-tuning & Evaluation · Claude
• Evaluate Model Calibration and ConfidenceLLM Fine-tuning & Evaluation · Claude
• Evaluate Model Calibration and Confidence for Production Hardening Steady-State OptimizationLLM Fine-tuning & Evaluation · Claude
• Fine-Tuning Decision AnalystLLM Fine-tuning & Evaluation · Claude Code
• Fine-Tuning Decision Analyst for Latency Reduction Backlog TriageLLM Fine-tuning & Evaluation · Weights & Biases
• LLM Evaluation Framework DesignerLLM Fine-tuning & Evaluation · Cursor
• LLM Evaluation Framework Designer for Pipeline Stabilization Pilot ValidationLLM Fine-tuning & Evaluation · Zapier
• LLM Fine-Tuning Pipeline EngineerLLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Cross-Functional HandoffLLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Cross-Functional Rollout Scenario 0597LLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Cross-Functional Rollout Scenario 1677LLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Escalation Triage Scenario 0237LLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Escalation Triage Scenario 1317LLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Exception HandlingLLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Executive ReviewLLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Governance Audit Prep Scenario 0777LLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Governance Audit Prep Scenario 1857LLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Launch ReadinessLLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Portfolio Prioritization Scenario 0417LLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Portfolio Prioritization Scenario 1497LLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Production Hardening Pilot ValidationLLM Fine-tuning & Evaluation · Claude
• LLM Fine-Tuning Pipeline Engineer for Regional Launch Scenario 0957LLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Service Reliability Review Scenario 0057LLM Fine-tuning & Evaluation · GitHub Copilot
• LLM Fine-Tuning Pipeline Engineer for Service Reliability Review Scenario 1137LLM Fine-tuning & Evaluation · GitHub Copilot
• LoRA Fine-Tuning Recipe GeneratorLLM Fine-tuning & Evaluation · Cursor
• Plan Instruction-Tuning Data MixLLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Cost Optimization Steady-State OptimizationLLM Fine-tuning & Evaluation · Claude
• Plan Instruction-Tuning Data Mix for Cross-Functional RolloutLLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Cross-Functional Rollout Scenario 0583LLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Cross-Functional Rollout Scenario 1663LLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Escalation TriageLLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Escalation Triage Scenario 0223LLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Escalation Triage Scenario 1303LLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Governance Audit PrepLLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Governance Audit Prep Scenario 0763LLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Governance Audit Prep Scenario 1843LLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Portfolio PrioritizationLLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Portfolio Prioritization Scenario 0403LLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Portfolio Prioritization Scenario 1483LLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Regional Launch Scenario 0943LLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Service Reliability ReviewLLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Service Reliability Review Scenario 0043LLM Fine-tuning & Evaluation · Claude Code
• Plan Instruction-Tuning Data Mix for Service Reliability Review Scenario 1123LLM Fine-tuning & Evaluation · Claude Code
• Plan a Cost-Aware Fine-Tuning DecisionLLM Fine-tuning & Evaluation · Claude
• Plan a Cost-Aware Fine-Tuning Decision for Automation Rollout Steady-State OptimizationLLM Fine-tuning & Evaluation · Claude
• Plan a Distillation from a Large ModelLLM Fine-tuning & Evaluation · Claude Code
• Plan a Distillation from a Large Model for Latency Reduction Steady-State OptimizationLLM Fine-tuning & Evaluation · Weights & Biases
• Plan a LoRA Fine-Tuning RunLLM Fine-tuning & Evaluation · Claude
• Plan a LoRA Fine-Tuning Run for Pipeline Stabilization Migration SprintLLM Fine-tuning & Evaluation · Zapier
• Write a Fine-Tuning Project PlanLLM Fine-tuning & Evaluation · Claude
• Write a Fine-Tuning Project Plan for Evaluation Redesign Migration SprintLLM Fine-tuning & Evaluation · Weights & Biases