, India
Job Family Group:
Information Technology (IT)
Worker Type:
Regular
Posting Start Date:
May 10, 2024
Business unit:
Projects and Technology
Experience Level:
Early Careers
Job Description:
Where you fit
The Data Engineer will be part of the Asset Information Desk. The role will focus on building and maintain data quality in the Site’s IT systems and support changes to data in those systems.
The role will be part of the extended asset team supporting the LNG Canada (LNGC) Asset. This will be a key role in the IM space and needs to grow and evolve with the asset (from the project stage to steady state operations). The key aspect for this role in the first 2-3 years is working collaboratively with the LNGC team in executing the preparatory work to meet asset startup objectives.
We are seeking an experienced and highly skilled Data Engineer to provide remote support for the LNGC Digitalization team
In this role, you will be responsible for designing, developing, and implementing scalable and secure data pipelines, as well as maintaining the performance and availability of our databases, and operationalizing data environments also to develop the data quality measuring protocols to support project to asset handover and to support the implementation of the Information Management Quality System for the asset.
What's the role?
Your primary responsibilities will be:
- Configuring Azure environments and resources to be used for data engineering
- Designing and implementing data ingestion pipelines from multiple sources using Azure Data Factory and Databricks
- Developing and maintaining data pipelines, data integrations, and data warehousing solutions
- MLOps and workflow management in GitHub, Azure and Databricks.
- Working with event based / streaming technologies (ex: SSIP) to ingest and process data
- Managing secure access to data sets for the business
- The role requires expertise in working with large volumes of structured and unstructured data & documents across multiple applications.
- Coaching and Mentoring teammates to use core cloud data warehouse tools (Azure Data Factory, Azure Databricks, Azure SQL DW, and other related technologies)
- Lead the delivery of short- and medium-term value opportunities related to data engineering scope
- Planning reasonable and realistic project timelines and obtain agreement with Asset Partners.
- Working collaboratively with the team, who are responsible for managing and delivering data and analytics solutions
- Exploring ways to enhance data quality and reliability
- Familiarity with establishing and maintaining Data Extract-Transform-Load processes and all the necessary tool and data enablers such as datalake, Altreyx ETL.
- Develop Dashboards and reports on the current status of data quality/QA-QC across the different systems aligned with the project to asset block handover sequence.
- Develop Data Quality reporting for the identified data groups together with the Data Value Owners.
- Support the maintenance of asset related data as result of Management of Change through providing data-document consistency reports and MOC process efficiency metrics.
Other back up accountabilities:
- Understand how information and data is utilized within the site or location through awareness to extract and apply the methods of these tools to Data Quality (methods and processes are listed in the Skills Section).
- Assist the team leads to standardize processes, tools, methods, procedures as directed (Ex: Improving the data quality standards and best practices).
Key Challenges and Opportunities:
- Working in a virtual environment and managing engagement across different levels of stakeholders.
- Strong proficiency in using English for both spoken and written communication.
- This will be a new role for LNGC and therefore will have some ambiguity. There will be an opportunity to leverage your expertise to recommend best practices and work autonomously.
- Sound understanding of business/process workflow and having mature mindset to deal with challenging situations.
- A self-starter leader and reliable deliverer, with very good verbal and written skills in English.
- Exposes the individual to all cultural backgrounds and organizational levels across the globe, across diverse time-zones.
-
What we need from you?
- Bachelor’s/Master’s in computer science, software engineering or related field
- Experience as a Database Administrator, ETL Developers, software engineering, back-end engineer
- Strong experience of data warehousing, ETL processes, and data modeling in Azure Stack (2+ years)
- Experience working in a Shell Data Engineering environment including Azure@Shell and DnA
- Familiarity with programming languages such as Python, SQL, and/or T-SQL
- Designing and building data transformation using Azure Data Factory, Azure Databricks, PySpark and loading into Azure SQL Database
- Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime
- Hands-on experience of building data pipelines using Databricks and scheduling Databricks jobs
- Deep development background that must include hands-on experience in Spark with Scala and Python
- Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS
- Experience with or knowledge of DEP-EIS and Shell RDL data requirements
- Competent in Shell’s Document and Data control processes for Projects
- Competent skill in data modelling
- Knowledge of asset IT systems, e.g. SAP, W-IMS, W-RCM
- Competent skill level in SQL and SQL Server
- Competent skill level in Alteryx
- Competent skill level in Powertools, PowerBI in developing graphs and dashboards that tell a complex story
- Competent skill level in SPF, SDx or AHA4P
- Experience setting up Azure Data Lake Storage using Role Based Access mechanism.
- Good exposure to relational databases and should possess good SQL skills to perform effective querying involving multiple tables and subqueries
- Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment
- Strong leadership and interpersonal skills to lead virtually and across cultures as well as to influence and coach others.
- Proficient in a source code control system such as GIT
- Ability to create required technical documentation
- Experience working with senior business stakeholders to understand the requirements and translating into actionable tasks to the team
- Experience working in various project delivery models such as Waterfall and Agile Methodology
- Excellent communication/interpersonal skills with people from all levels and from different cultural backgrounds
Optional
- Experience working with Continuous Integration and deployment tools (CI/CD)
- Experience working with structured and unstructured data including imaging & geospatial data
- Experience in Microsoft Citizen Development and the ability to operationalize data science projects.
Company Description
Shell Business Operations (SBO) is a chain of operational centers that form an integral part of Royal Dutch Shell. We influence business development for Shell globally, enabling the work of 93,000 employees in over 70 countries across the world.
An Innovative Place to Work
There’s never been a more exciting time to work at Shell. Everyone here is helping solve one of the biggest challenges facing the world today: bringing the benefits of energy to everyone on the planet, whilst managing the risks of climate change.
Our business has been built on a foundation of innovative technology and skilled employees. By providing energy to sustain people’s lives for more than a hundred years, Shell has become one of the world’s leading companies.
Join us and you’ll be adding your talent and imagination to a business with the ambition to shape the future. At Shell, everyone does their part.
An Inclusive & Progressive Place to Work
To power progress together, we need to attract and develop the brightest minds and make sure every voice is heard. Here are just some of the ways we’re nurturing an inclusive environment – one where you can express your ideas, extend your skills, and reach your potential.
- We’re creating a space where people with disabilities can excel through transparent recruitment process, workplace adjustments and ongoing support in their roles. Feel free to let us know about your circumstances when you apply, and we’ll take it from there.
- We’re closing the gender gap – whether that’s through action on equal pay or by enabling more women to reach senior roles in engineering and technology.
- We’re striving to be a pioneer of an inclusive and diverse workplace, promoting equality for employees regardless of sexual orientation or gender identity.
A Rewarding Place to Work
- Combine our creative, collaborative environment and global operations with an impressive range of benefits and joining Shell becomes an inspired career choice.
- We’re huge advocates for career development. We’ll encourage you to try new roles and experience new settings. By pushing people to reach their potential, we frequently help them find skills they never knew they had, or make career moves they never thought possible.
DISCLAIMER:
Please note: We occasionally amend or withdraw Shell jobs and reserve the right to do so at any time, including prior to the advertised closing date. Before applying, you are advised to read our data protection policy. This policy describes the processing that may be associated with your personal data and informs you that your personal data may be transferred to Shell/Shell Group companies around the world. The Shell Group and its approved recruitment consultants will never ask you for a fee to process or consider your application for a career with Shell. Anyone who demands such a fee is not an authorised Shell representative and you are strongly advised to refuse any such demand. Shell is an Equal Opportunity Employer.
