MLOps Engineer

About AI71:

AI71 is an industry leader in artificial intelligence, delivering innovative solutions that empower developers, businesses and governments to solve complex challenges. AI71 builds secure, enterprise-ready applications powered by cutting-edge technology—tailored for knowledge workers and sector-specific needs. AI71 bridges the gap between advanced AI and real-world impact. Guided by a strong commitment to research and responsibility, we create transformative solutions that drive progress and empower communities.

The Role:

As an MLOps Engineer you set the ML infrastructure and reliability strategy across AI71's platform, including how LLMs and other deep learning models are deployed, fine-tuned, and served at scale. You own architecture decisions across both SaaS and on-prem operating models, mentor engineers across teams, and drive multi-quarter ML infrastructure strategy. You are a force multiplier.

What You'll Do:

• Define ML infrastructure architecture across the platform: model deployment strategy (vLLM, Triton, or TGI), pipeline engineering (MLflow or Kubeflow), and cloud-native infrastructure across major cloud platforms (AWS, Azure, or GCP)
• Set direction for ML system reliability: monitoring, latency / throughput / availability targets, and incident response across research and production environments.
• Mentor senior MLOps engineers; raise the operational bar across multiple teams.
• Drive cross-team initiatives that improve inference performance and cost-efficiency, including distributed training frameworks (DeepSpeed, FSDP, Accelerate).
• Partner with ML researchers, product, and engineering leadership on multi-quarter ML infrastructure strategy.
• Ensure ML infrastructure scales across managed SaaS and fully air-gapped on-prem deployments.

What You'll Bring:

• 10+ years of MLOps, ML infrastructure, or machine learning engineering with history of architectural ownership.
• Proven track record architecting large-scale model deployment (including LLMs) and ML infrastructure at scale.
• Deep cloud expertise across major cloud platforms (AWS, Azure, or GCP) and strong Python proficiency
• Mentorship record — engineers you have grown now operate independently at higher levels.
• Deep comfort architecting ML systems that run in both managed SaaS and on-premises / disconnected air-gapped environments.
• Kubernetes at architectural depth — GPU scheduling, multi-tenancy, operators, and the failure modes of distributed workloads on shared clusters.
• Strong communication, stakeholder management, and decision-making skills, with a passion for building diverse, inclusive engineering teams. 

Strong Preference:

• Ownership of production reliability at platform level: SLO definition, incident command, postmortem practice, and driving reliability improvements across teams rather than services.
• Architecture-level experience with distributed training and fine-tuning at scale (DeepSpeed, FSDP, Megatron-LM), including cluster design, checkpointing strategy, and failure recovery.
• Deep GPU systems knowledge: CUDA, NCCL, interconnect topology (NVLink, InfiniBand/RoCE), and diagnosing performance and communication problems across nodes.
• Model optimization strategy at portfolio level: quantization (FP8, AWQ, GPTQ), speculative decoding, with measurable cost or latency outcomes across multiple systems.
• Experience in regulated or security-constrained environments — compliance-driven architecture, model governance, lineage, audit, and secrets management.
• On-prem / air-gap ML delivery architecture experience at scale.
• Track record maturing MLOps practice in a growing organization: standards, platform abstractions, and paved paths that outlived your involvement.
• Bare-metal GPU cluster architecture, including scheduling (Slurm or Kubernetes) and hardware lifecycle in customer or owned data centers.

Nice to Have: 

• Conference speaking, technical writing, or industry thought leadership.
• Open-source contributions to inference, serving, or ML infrastructure projects, particularly maintainer-level involvement.
• C/C++ or CUDA kernel experience for performance-critical paths.
• Arabic language skills.

Why AI71:

• Mission-Driven Work: Work on cutting-edge AI applications with a talented and passionate team, solving real-world challenges in critical sectors.
• Unparalleled Opportunity: This is a chance to innovate and solve real-world challenges using AI at a company with unique access to world-leading models and resources.
• Career Growth: We offer competitive compensation, benefits, and significant career growth opportunities as a foundational member of the team.
• World-Class Environment: Enjoy a flexible working environment and the latest tools & technologies needed to do your best work.