Data Engineer

Data Engineer

  HiringMirror

  BRONX, 10459, New York
  Full Time
  08-24-2022

 

Skills : Java,IT Proficiency

 

Understanding of Data storage fundamentals using S3, RDS, and DynamoDB. Hands On experience of AWS Compute Services like Glue, EMR & DataBricks and Experience with big data tools Hortonworks / Cloudera.

 

Job Description

 

Strong knowledge on Python full stack development, API integration
Strong hands on experience in API gateway, PySpark, Python, Cloudfront to write reusable, testable, and efficient code. Design and implement of low-latency, high-availability, and performant applications
Strong networking experience on AWS with VPC, Subnets, ACLs, Routing tables and Security Groups and Architecture experience with Spark, AWS and Big Data.
Understanding of Data storage fundamentals using S3, RDS, and DynamoDB. Hands On experience of AWS Compute Services like Glue, EMR & DataBricks and Experience with big data tools Hortonworks / Cloudera.
Experience with application deployment by using CI/CD.
Experience on Spark batch and streaming with Kubernetes
Design Spark batch and streaming with Kubernetes.

Strong knowledge on Linux, shell scripting
Hands on experience on Jira (Scrum/Kanban board/Ticketing)
Hands on experience in scheduling tools/UC4.
Requirement Analysis, Data Analysis/Issue Triage
Very good experience in SQL and RDMS.
Good to have - knowledge on AWS S3.
Superb communication skills with an emphasis on writing and interpreting abilities
Ability to think analytically and should be a problem solver
Negotiates and explains technical solutions to non-technical staff
Able to prioritize and execute tasks in a high-pressure environment under tight schedules
Coordinate with client and offshore team and ensure smooth delivery.

 

Similar Jobs

RAG Or Retrieval Systems Engineer

HiringMirror

Specializes in retrieval-augmented generation architecture — building the search, indexing, and retrieval layer that grounds LLM outputs in accurate, up-to-date information.

  Full Time

  09-15-2026

  New York

Applied AI & LLM Product Engineer

HiringMirror

  Full Time

  09-15-2026

  New York

AI Research Engineer

HiringMirror

Works on pretraining and post-training of foundation models — architecture experiments, training efficiency, alignment techniques (RLHF, DPO), and scaling research, often in collaboration with research scientists.

  Full Time

  09-15-2026

  New York

Machine Learning Engineer

HiringMirror

Owns model development, training, and quality — building and improving the ML models (not just LLM wrappers) that power a product, from data pipeline to production deployment.

  Full Time

  09-15-2026

  New York

AI Infrastructure Engineer

HiringMirror

Owns the compute infrastructure that trains and serves AI models — GPU cluster management, distributed training pipelines, and inference serving at scale. A natural pivot for DevOps/backend infra engineers.

  Full Time

  09-10-2026

  New York