We are seeking a highly skilled and versatile AI Infrastructure & Systems Specialist to drive the deployment, orchestration, and management of our AI computing infrastructure. This role is critical in ensuring the smooth operation of our GPUaaS platform, optimizing AI workloads, and supporting customers in their AI adoption journey. The ideal candidate should have expertise in GPU systems, AI orchestration platforms, software engineering for AI, and technical leadership.
Key Responsibilities
GPU Systems Specialist
Deploy, configure, and manage NVIDIA H100-powered GPU servers and networking infrastructure (InfiniBand).
Optimize GPU performance for AI/ML workloads and troubleshoot hardware/software issues.
Collaborate with NVIDIA and Dell teams for system optimization and technical support.
Validate the GPU fractions, perform necessary checks and upgrades on GPU device drivers and Nvidia libraries.
Orchestration & Virtualization Specialist
Implement and manage RUN.AI, Kubernetes, and NVIDIA MIG to optimize GPU resource allocation.
Ensure seamless multi-tenant AI workload management and scaling strategies.
Automate AI/ML pipeline orchestration for efficient resource utilization.
Monitor the Services exposed via Kubernetes orchestration, enable GitOps model for the AI/ML workflows and ensure the K8s cluster works optimally.
Monitor the Cluster usage, GPU quotas, Storage utilization and build performance reports on regular basis to assess the functionality of the K8s GPU stack.
AI Software Engineer
Work with AI teams to enable model training and fine-tuning using PyTorch, TensorFlow, and RAPIDS .
Develop and optimize AI/ML workflows on high-performance computing (HPC) environments.
Integrate AI frameworks with cloud and on-prem GPU clusters .
Technical Manager
Serve as the primary technical advisor to customers, ensuring seamless AI deployment.
Conduct technical workshops, bootcamps, and onboarding sessions for users.
Collaborate with universities, enterprises, and startups to drive AI adoption.