Job Description

Position:

Junior PySpark Engineer

Description:

Job Overview:
We are seeking a Junior PySpark Engineer with strong hands-on experience in building distributed data pipelines using Apache Spark on AWS EMR. The ideal candidate is proficient in Python, has worked with Databricks, and has a solid understanding of GxP-compliant environments. This is a coding-heavy role , not DevOps or AWS administration, where you’ll contribute directly to the architecture and development of robust data solutions in a highly regulated, cloud-native environment.

Key Responsibilities:
- Design, develop, and maintain distributed ETL data pipelines using PySpark on AWS EMR
- Work within a GxP-compliant environment, ensuring data integrity and regulatory alignment
- Write clean, scalable, and efficient PySpark code for large-scale data processing
- Utilize AWS cloud services for pipeline orchestration, compute, and storage
- Collaborate closely with cross-functional teams to deliver end-to-end data solutions
- Participate in code reviews, testing, and deployment of pipeline components
- Ensure performance optimization, fault tolerance, and scalability of data workflows

Requirements:

Required Qualifications:
- 2–4 years of experience in software or data engineering with a focus on distributed systems
- Deep hands-on experience with Apache Spark, PySpark, and AWS (especially EMR)
- Experience building pipelines using Databricks required
- Strong programming skills in Python
- Solid understanding of cloud-native architectures
- Familiarity with GxP compliance and working in regulated data environments
- Proven ability to independently design and develop data pipelines (not a DevOps/AWS admin role)
- Experience with distributed computing and high-volume ETL pipelines

Benefits:

Benefits:
- Remote-based position (EST Time Zone preferred)
- 5 days a month in office
- Opportunity to work with cutting-edge technology and diverse industries
- Equal Opportunity Employer
- Inclusive, collaborative environment
- 6 months contract
- Exposure to cloud-native, large-scale projects

Job Tags

Remote job, Contract work,

Similar Jobs