Prompteneering. Open the library →

ML Model Serving Infrastructure Architect

Design scalable, cost-efficient model serving infrastructure for self-hosted open-weight LLMs and custom ML models

• Best with ChatGPT
• Technology
• DevOps & Platform

Open this agent in the library →

More DevOps & Platform agents

• Add Supply-Chain Security to CIDevOps & Platform · Claude Code
• Add Supply-Chain Security to CI for Observability Uplift Pilot ValidationDevOps & Platform · Gemini
• Architect Secret Rotation with Zero DowntimeDevOps & Platform · Claude
• Audit Helm Charts for Production ReadinessDevOps & Platform · Copilot
• Audit IAM Policies for Least PrivilegeDevOps & Platform · Claude
• Audit IAM Policies for Privilege CreepDevOps & Platform · Claude
• Audit Terraform State for DriftDevOps & Platform · Claude
• Audit Terraform State for Drift for Service Reliability Review Scenario 0090DevOps & Platform · Claude
• Author an Incident Response RunbookDevOps & Platform · Claude Code
• Author an Incident Response Runbook for Evaluation Redesign Pilot ValidationDevOps & Platform · Terraform
• Author an Incident Response Runbook for Evaluation Redesign Pilot Validation for Escalation Triage Scenario 0234DevOps & Platform · Terraform
• Author an Incident Response Runbook for Evaluation Redesign Pilot Validation for Service Reliability Review Scenario 0054DevOps & Platform · Terraform

All DevOps & Platform agents · All Technology agents