Senior MLOps Engineer

Job Description

Project Description: Grid Dynamics wants to build a centralized, observable and secure platform for their ML, Computer Vision, LLM and SLM models. Grid Dynamics wants to onboard a vast number of AI agents, able to cover multiple required skills, ensuring a certain level of control and security in regards to their usage and availability. The observable platform must be vendor-agnostic, easy to extend to multiple type of AI applications and flexible in terms of technologies, frameworks and data types. This project is focused on establishing a centralized LLMOps capability where every ML, CV, AI-enabled application is monitored, observed, secured and provides logs of every activity. The solution consists of key building blocks such monitor every step in a RAG, Multimodal RAG or Agentic Platform, track performances and provide curated datasets for potential fine-tuning. Alignment with business scenarios, PepVigil provides also certain guardrails that allow or block interactions user-to-agent, agent-to-agent or agent-to-user. Also, Guardrails will enable predefined workflows, aimed to give more control over the series of LLM chains. Details on Tech Stack Job Qualifications and Skill Sets Advanced degree in Data Science, Computer Science, Statistics, or a related field Setting up Agent Mesh (LangSmith) Setting up Agent communication protocols (JSON/XML etc) Setting up message queues, CI/CD pipelines (Azure Queue Storage, Azure DevOps) Setting up integrations Langgrah, LangFuse Knowledge on Observability tool Arize-Phoenix tools Managing Agent Registry, Integrating with AgentAuth framework like Composio Setting up AgentCompute (Sandpack, E2BDev, Assistant APIs) Integration with IAM (Azure IAM, OKTA) Performing/Configuring Dynamic Orchestration and agent permissions Tech Stack Required: ML MLOPs Agent (Agent / Agent Mesh) LangFuse, LanChain, LangGraph Deployments (Docker, Jenkins, Kubernetes) Cloud Platforms: Azure/AWS/GCP We offer: Opportunity to work on bleeding-edge projects Work with a highly motivated and dedicated team Competitive salary Flexible schedule Benefits package - medical insurance, sports Corporate social events Professional development opportunities Well-equipped office