Submitting more applications increases your chances of landing a job.

Here’s how busy the average job seeker was last month:

Opportunities viewed

Applications submitted

Keep exploring and applying to maximize your chances!

Looking for employers with a proven track record of hiring women?

Click here to explore opportunities now!
We Value Your Feedback

You are invited to participate in a survey designed to help researchers understand how best to match workers to the types of jobs they are searching for

Would You Be Likely to Participate?

If selected, we will contact you via email with further instructions and details about your participation.

You will receive a $7 payout for answering the survey.


User unblocked successfully
https://bayt.page.link/4DLxdwcx71gnfxdK8
Back to the job results
Other Business Support Services
Create a job alert for similar positions
Job alert turned off. You won’t receive updates for this search anymore.

Job description

Roles and Responsibilities

Big Data & Spark Development
Develop and maintain data processing pipelines using Apache Spark (PySpark & Scala)
Work with Spark DataFrames, RDDs, and Spark SQL
Implement transformations, joins, aggregations, and optimizations
Tune Spark jobs for performance, scalability, and reliability
Python & Scala Programming
Write clean, efficient, and scalable code in Python and Scala
Develop modular and reusable components
Integrate data pipelines with various applications and APIs
ETL & Data Engineering
Design and build ETL workflows for structured and unstructured data
Extract data from multiple sources (databases, APIs, flat files)
Perform data cleansing, transformation, and validation
Ensure data accuracy, consistency, and completeness
Data Platforms & Integration
Work with Hadoop ecosystem (HDFS, Hive, Spark)
Handle large datasets in data lakes and warehouses
Process data in formats like Parquet, ORC, JSON, CSV
Collaboration & Support
Work with data engineers, analysts, and business stakeholders
Troubleshoot pipeline issues and provide production support
Participate in Agile/Scrum processes
Maintain technical documentation



Additional Responsibilities

Core Skills
2-5 years of experience in Python development
Hands-on experience with Apache Spark (PySpark and/or Scala)
Strong understanding of data processing and ETL concepts
Good knowledge of SQL and relational databases



Technical Requirements

* Primary skills:Technology->Big Data - Data Processing->Spark,Technology->Java->Apache,Technology->Machine Learning->Python


This job post has been translated by AI and may contain minor differences or errors.
You’ve reached the maximum limit of 15 job alerts. To create a new alert, please delete an existing one first.
Job alert created for this search. You’ll receive updates when new jobs match.
Are you sure you want to unapply?

You'll no longer be considered for this role and your application will be removed from the employer's inbox.