AI Infrastructure Engineer

AI Infrastructure Engineer

  HiringMirror

  NASSAU, 11801, New York
  Full Time
  09-10-2026

 

Skills : AWS, Kubernetes, Python, PyTorch,

 

Owns the compute infrastructure that trains and serves AI models — GPU cluster management, distributed training pipelines, and inference serving at scale. A natural pivot for DevOps/backend infra engineers.

 

Job Description

 

Job Description:
Owns the compute infrastructure that trains and serves AI models — GPU cluster management, distributed training pipelines, and inference serving at scale. A natural pivot for DevOps/backend infra engineers.

Key Skills:
- Distributed systems, GPU cluster orchestration (Slurm, Kubernetes, Ray)
- Cloud infrastructure (AWS/GCP/Azure), networking, storage at scale
- Training frameworks (PyTorch Distributed, DeepSpeed, Megatron)
- Infra-as-code (Terraform), monitoring/observability tooling
- Cost and utilization optimization for large compute clusters

Experience Required:
- 4–8+ years in infrastructure/platform/DevOps engineering
- Direct large-scale distributed systems experience; ML-specific infra experience is a plus but not always required

 

Similar Jobs

Front Desk Receptionist

PuredotIndia Hospitality Services

We are looking for a friendly, professional, and customer-focused Front Desk Receptionist to join our team in Noida. The ideal candidate will be responsible for welcoming guests, managing check-ins and check-outs, handling guest queries, resolving complaints, and ensuring a smooth and positive guest experience.

  Full Time

  09-24-2026

  Utter Pradesh

RAG Or Retrieval Systems Engineer

HiringMirror

Specializes in retrieval-augmented generation architecture — building the search, indexing, and retrieval layer that grounds LLM outputs in accurate, up-to-date information.

  Full Time

  09-15-2026

  New York

Applied AI & LLM Product Engineer

HiringMirror

  Full Time

  09-15-2026

  New York

AI Research Engineer

HiringMirror

Works on pretraining and post-training of foundation models — architecture experiments, training efficiency, alignment techniques (RLHF, DPO), and scaling research, often in collaboration with research scientists.

  Full Time

  09-15-2026

  New York

Machine Learning Engineer

HiringMirror

Owns model development, training, and quality — building and improving the ML models (not just LLM wrappers) that power a product, from data pipeline to production deployment.

  Full Time

  09-15-2026

  New York