Senior Data Engineer

We are seeking a highly skilled and experienced Senior Data Engineer to join our team on a part-time basis. As a Senior Data Engineer, you will be responsible for designing and developing data pipelines, optimizing data collection and flow across various data sources, and ensuring a consistent data delivery architecture throughout ongoing projects. Your expertise will play a crucial role in the efficient management of our data infrastructure.

Responsibilities:

• Design and build data pipelines from streaming and batch data sources.
  
• Load transformed data into storage and reporting structures in destinations, including data warehouse, high-speed indexes, real-time reporting systems, and analytics applications.
  
• Take an active role in coaching and developing skills for more junior team members.
  
• Migrate data among different data stores.
  
• Extract data, troubleshoot, and maintain the data warehouse.
  
• Collaborate with cross-functional teams to understand data requirements and deliver optimal solutions.
  

• 5+ years of hands-on experience in data integration solutions, particularly in the Cloudera Hadoop stack.
  
• 4+ years of experience with at least one of the following (or similar) instruments: Spark / Flink / Beam.
  
• Experience in designing and developing CDC-based data streams and building data pipelines.
  
• Strong understanding of database concepts, troubleshooting skills, and root cause analysis, with experience in designing and managing databases.
  
• Experience in infrastructure (Server, Storage, and Database) discovery, design, sizing, build, and migration.
  
• Familiarity with data archival systems, data management, and data governance concepts.
  
• Proficiency in at least one of the following programming languages: Python, Java, Scala, R, shell scripting, PL/SQL. Experience with Oracle DB and PL/SQL is a plus.
  
• Ability to automate tasks/jobs to improve efficiency.
  
• Practice unit testing and continuous integration to ensure data quality and reliability.
  

• Bachelor's degree in Computer Science, Engineering, or a related field.
  
• Strong analytical and problem-solving skills.
  
• Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
  
• Detail-oriented mindset with a focus on delivering high-quality work.
  
• Ability to adapt to a fast-paced and evolving environment.
  
• Strong commitment to continuous learning and professional development.
  

To apply for this position, please submit your resume/CV and a cover letter detailing your relevant experience and qualifications to [contact email]. Only shortlisted candidates will be contacted.

Note: This job posting is for a part-time position. The working hours and schedule will be discussed during the interview process.

We are an equal opportunity employer and value diversity in our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.