Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision-making across the organization.
Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
Write unit/integration tests, contributes to engineering wiki, and documents work.
Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
Work closely with a team of frontend and backend engineers, product managers, and analysts.
Define company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models.
Design data integrations and data quality framework.
Design and evaluates open source and vendor tools for data lineage.
Work closely with all business units and engineering teams to develop a strategy for long term data engineering platform architecture
What You Know
A minimum of 8 years of ETL and Data Engineering experience is required.
Experience with relational SQL and NoSQL databases.
Experience with Azure cloud Data services
5-8+ years of experience in a Data Engineer & ETL Tools (any one tool) role (Azure)
Data Engineer with Azure functions and Azure ADF, Databricks and PySpark
Experience with object-oriented/object function scripting languages: Python, Scala, etc.
Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with unstructured datasets.
Education
A bachelor's degree in information technology, software development management, software engineering, computer science, or a related field.
Benefits
In addition to competitive salaries and benefits packages, Nisum India offers its employees some unique and fun extras:
Continuous Learning - Year-round training sessions are offered as part of skill enhancement certifications sponsored by the company on a need basis. We support our team to excel in their field.
Parental Medical Insurance - Nisum believes our team is the heart of our business and we want to make sure to take care of the heart of theirs. We offer opt-in parental medical insurance in addition to our medical benefits.
Activities -From the Nisum Premier League's cricket tournaments to hosted Hack-a-thon, Nisum employees can participate in a variety of team-building activities such as skits, and dances performance in addition to festival celebrations.
Free Meals - Free snacks and dinner is provided on a daily basis, in addition to subsidized lunch.
