Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity. Working as an individual contributor while leading the data team
Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision-making across the organisation.
Lead and drive the team to deliver solutions on time and quality that committed.
Write unit/integration tests, contributes to engineering wiki, and documents work.
Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
Define company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models.
Work closely with all business units and engineering teams to develop a strategy for long term data engineering platform architecture
Design of data-oriented solutions (end to end) using design patterns and best market practices.
Define and implement governance, access and security policies
Ensure optimal use of resources both in cost and performance
Ensure that non-functional requirements are taken care
Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
What You Know
A minimum of 10 years of ETL and Data Engineering experience.
Experience in solutions architect or senior data engineer roles, in the design of data-intensive solutions (streaming, batch, migrations)
Experience in modern data ingestion processes (datalake, datawarehouse, lakehouse)
Experience in data governance models
Experience with relational SQL and NoSQL databases.
Experience with Azure cloud Data services
More than 8 years of experience in a Data Engineering & ETL Tools (like Teradata, Ab Initio) and Azure
Data Engineer with Azure functions and Azure Data Factory, Databricks and PySpark
Experience with object-oriented/object function scripting languages: Python, Scala, etc.
Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with unstructured datasets.
Education
Bachelor’s degree in Computer Science, Information Systems, Engineering, Computer Applications, or related field
Benefits
Health: We provide comprehensive health benefits designed specifically to meet your needs at all stages of your life. With our many options, you can find takaful coverage related to in-patient and out-patient care along with life takaful.
Parents Takaful: We provide comprehensive health benefits designed specifically for employees' parents.
Work-Life Balance: We provide optimal flexibility and choice for our employees to manage time away from work and for almost every aspect of life. Whether it’s about performing a pilgrimage, medical leave, family planning, or spending time with friends or family, our paid time-off benefit can support your lifestyle.
Incentives and Rewards: We recognize that different people have different needs, and this is why we extend our benefits beyond conventional offerings. We offer various options to help you juggle the demands of your career and life. We offer multiple ways to earn financial rewards and provide financial support programs, such as interest-free loans, multiple discount programs, one extra salary, car financing schemes, old-age benefits, and fund savings.
Development and Training Programs: We recognize the skill set and mindset our employees need to stay competitive in the marketplace and provide support through structured classroom training, study sponsorships, international trips, and multiple appreciation programs.
Team Building: We strive to create a culture where fun and work go hand-in-hand. We offer quarterly team lunches along with monthly entertainment events to ensure the workplace remains fun and productive!
Corporate Appliances: We set you up for success by providing all the tools you need to start your career with us off right. We provide a laptop with accessories, a cellular and internet device, and a power bank on a need basis only.
Office Facilities: Our office is specifically designed to support a healthy and balanced lifestyle for our employees. It offers a separate gaming room, gym facility, free lunches, an in-house vending machine, and so much more!
