InternFlow

Company Careers ·

full-time
Top Company

Lead AI Ops Engineer

Mastercard · Gurgaon

Mastercard is a global payments technology company that enables secure simple and smart digital transactions for consumers businesses and governments across more than 200 countries. In the Lead AI Ops Engineer role you will own the end-to-end production observability of one or more AI agents tracking metrics such as accuracy latency SLA breaches and guard-rail triggers through dedicated dashboards. You will act as the first line of support triaging issues inspecting failing traces and classifying root causes like intent tool parameter or hallucination errors. Daily work includes evaluating whether the agent’s reasoning stays correct verifying that context retrieval remains current and that the learning loop is not drifting as well as monitoring API and authentication failures that could affect revenue-generating client-facing services. You will partner with AI Engineering to prioritize fixes run experiments on prompts context and routing in development validate improvements with automated and human evals and embed governance steps-approval workflows and audit logging-directly into the agent’s learning loop. The position suits candidates with experience operating production AI/ML or agentic systems strong analytical skills for drift and root-cause analysis familiarity with LLM observability concepts tracing telemetry guardrails evaluation engineering and knowledge of responsible AI practices such as PII detection access control and policy enforcement. Effective communication independent work ethic and comfort in a fast-changing environment are also required.

ai opsml observabilityagent monitoringprompt engineeringguardrail managementai governanceproduction supportdrift detectionllm evaluationapi reliability

Education

  • Level: Bachelor's degree
AI Operations

Key Skills

AI/MLObservabilityEvaluationDrift DetectionMonitoringProduction SupportLLMTracingTelemetryGovernanceComplianceResponsible AIPII DetectionAccess ControlAudit Logging

About the Role Lead AI Ops Engineer responsible for end‑to‑end production monitoring and operation of AI agents, ensuring reliability, safety and governance of AI services. Responsibilities Own production monitoring for AI agents, track metrics, KPIs, latency, SLA breaches, guardrail triggers. Provide L1/L2 production support, triage and escalation. Identify and diagnose issues using eval scores, drift alerts, trace analysis. Evaluate agent reasoning, context relevance and learning drift. Monitor post‑production reliability including API and authentication failures. Partner with AI Engineering to prioritize fixes, run prompt and routing experiments, validate improvements. Embed governance workflows, audit logging and policy enforcement into the learning loop. Requirements Experience operating production AI/ML or agentic systems with observability, evaluation and drift detection. Strong analytical skills for root‑cause analysis of intent, tool, parameter and hallucination errors. Knowledge of AI/LLM observability concepts such as tracing, telemetry, guardrails and evaluation engineering. Familiarity with governance, compliance and responsible AI practices (PII detection, access control, audit logging) is a plus. Ability to work independently and communicate production signals to AI Product and Engineering teams.

Skills for this role

AI/MLObservabilityEvaluationDrift DetectionMonitoringProduction SupportLLMTracingTelemetryGovernanceComplianceResponsible AIPII DetectionAccess ControlAudit Logging

Required skills

AI/MLObservabilityEvaluationDrift DetectionMonitoringProduction SupportLLMTracingTelemetryGovernanceComplianceResponsible AIPII DetectionAccess ControlAudit Logging

Also mentioned in the listing

ai opsml observabilityagent monitoringprompt engineeringguardrail managementai governancellm evaluationapi reliability
RoleLead AI Ops Engineer
CompanyMastercard
LocationGurgaon
Typefull-time
CompensationNot disclosed
Posted2026-10-06
DeadlineRolling

Typical process for this type of role

A general guide — the exact steps for this specific listing may vary; check the original posting for details.

  1. 1ApplicationSubmit your resume through the apply link.
  2. 2ScreeningRecruiter reviews your background against the role.
  3. 3AssessmentA technical test, assignment, or coding round, depending on the role.
  4. 4Interview(s)One or more rounds with the hiring team.
  5. 5OfferOffer letter with compensation and start date.

Before you apply

0/4

Lead AI Ops Engineer at Mastercard: frequently asked questions

Who can apply for the Lead AI Ops Engineer role at Mastercard?
The listing asks for Bachelor's degree; freshers are welcome.
What skills does the Lead AI Ops Engineer role require?
The listing highlights AI/ML, Observability, Evaluation, Drift Detection, Monitoring, Production Support, LLM, Tracing, Telemetry, Governance. Show each of these in a project or past role on your resume.
What is the salary for this role?
Mastercard has not stated compensation in the listing. Check the original posting or ask during the application process.
Is the Lead AI Ops Engineer position remote, hybrid or onsite?
The listing gives Gurgaon as the location and does not state a work mode.
What is the application deadline?
Mastercard has not listed a fixed deadline, so apply early in case the opening is filled.
How do I apply for the Lead AI Ops Engineer role?
Use the Apply button on this page. It opens the original listing on mastercard.wd1.myworkdayjobs.com, where you submit your application with the company.

More at Mastercard

Other jobs at Mastercard

See all 72 openings at Mastercard

Explore Related Placements


// similar opportunities

You might also like