AI Operations Engineer

Job Description:

• Build, test, and support AI agents and chatbots for internal business use cases
• Translate stakeholder requirements into working designs and improve solutions using feedback and usage data
• Maintain and improve production AI agents and chatbots through prompt and workflow tuning, error handling, and performance monitoring
• Identify informally deployed AI tools and migrate them to enterprise-managed, centrally hosted, access-controlled platforms
• Apply governance, authentication, and access-control standards with Cyber Security and the AI Center of Excellence
• Administer and support NeuralSeek, Claude, and Copilot platforms
• Monitor platform health, performance, and usage using Data Dog and related observability tools
• Evaluate new AI tooling and recommend adoption
• Support Model Context Protocol (MCP) server infrastructure
• Build, test, and maintain API integrations with enterprise applications and data sources
• Resolve integration issues with internal teams and vendors
• Monitor and manage token and API consumption costs, including allocation, budgeting, forecasting, and optimization
• Maintain an inventory of production AI agents, bots, and integrations
• Participate in incident response for AI outages, integration failures, and unexpected model behavior
• Support vendor management, renewals, license reconciliation, and issue escalation
• Develop training and enablement materials for business users
• Ensure compliance with AI governance, data handling, and security policies
• Document architecture, configurations, and runbooks

Requirements:

• Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent hands-on experience
• 3 to 5 years of experience in an AI, automation, integration, or DevOps/AIOps engineering role
• Practical experience building or supporting AI agents or chatbots in a business environment
• Working knowledge of REST APIs and experience building or maintaining API integrations
• Strong troubleshooting skills across applications, integrations, and infrastructure
• Ability to work independently while collaborating across IT, business, and security teams
• Familiarity with NeuralSeek, Claude, Microsoft Copilot, or comparable AI orchestration and assistant platforms is preferred
• Experience with Data Dog or similar observability and monitoring platforms is preferred
• Exposure to Model Context Protocol (MCP) or similar agent-to-system integration frameworks is preferred
• Understanding of cloud or SaaS cost management (FinOps) principles as applied to AI consumption is preferred
• Experience operating in a regulated or compliance-driven environment is preferred
• Relevant certifications are beneficial but not required

Benefits:

• 401(k) plan
• Health insurance
• Dental insurance
• Vision insurance
• Life insurance
• Paid holidays
• Vacation
• Employee negotiated discounts