Job description
Your role As a Senior Data Engineer, you will play a pivotal role in designing, developing, and maintaining advanced and scalable data architectures primarily on the Azure Databricks platform, ensuring high quality and robustness of data assets. You will take full ownership of technical solutions, contributing significantly to the evolution and shaping of the data platform by recommending architectural improvements and challenging design choices to guarantee optimal performance and scalability. Collaborating closely with cross-functional teams including data scientists, analysts, and business stakeholders, you will help translate business needs into scalable data pipelines and reusable data products. Your responsibility extends to ensuring the delivery of production-grade, reliable, and efficient data solutions featuring best practices in data engineering, such as modular design, code reusability, and thorough testing processes. Continuous improvement will be key, as you enhance existing platform capabilities by integrating advanced features like logging, monitoring, failure recovery, and automated deployment mechanisms to facilitate smooth operations and maintenance. Mentoring junior engineers and fostering a culture of knowledge sharing, technical excellence, and collaborative problem solving will be central to your role, helping build a strong, innovative data engineering team. You will actively participate in strategic projects including large-scale platform migrations and upgrades, ensuring seamless data continuity and minimal business disruption. By leveraging your expertise, you will drive data governance standards, enforce data quality, and own testing frameworks to maintain integrity and compliance of data solutions. The role demands adaptability, as you will work in a dynamic environment dealing with cutting-edge technologies and evolving business requirements to deliver impactful data products that support critical business decisions. To succeed, you will need To thrive in this position, you should have considerable experience delivering scalable data pipelines using Azure Databricks technologies such as PySpark and SQL. You must be confident in owning full lifecycle solution delivery, from initial design through deployment to ongoing support, demonstrating hands-on expertise in production environments. Key technical competencies include strong data modeling skills, proficiency with ETL/ELT pipelines, and familiarity with multi-environment setups and CI/CD automation. Exceptional problem-solving skills, proactivity in improving systems, and effective communication with stakeholders are essential for success. It is critical to be able to challenge existing designs constructively and be decisive when assessments indicate impractical or non-scalable solutions. Experience mentoring peers and leading small to medium scale projects will greatly enhance your effectiveness in this role. In return, we offer Flexible working hours that support a healthy work-life balance. A hybrid working policy enabling you to combine the convenience of remote work with productive on-site collaboration at our modern Atlas Copco Global IT Hub. Access to state-of-the-art tools, latest technologies, and modern infrastructure to empower innovation and efficiency in your work. Opportunities to work within a continuously growing and dynamic data competence team, fostering professional development and shared expertise. Comprehensive health and wellness benefits including group healthcare insurance plans tailored to the country of employment. Inclusive and supportive organizational culture that embraces diversity and promotes sustainable productivity globally. A platform to contribute innovative ideas and participate in groundbreaking projects that influence the advancement of data engineering practices within the company. Continuous professional growth through multiple learning resources such as free access to LinkedIn Learning, regular in-house training, and external educational programs. Meaningful engagement with our corporate social responsibility efforts, including participation in initiatives like the Water for All project aimed at making a positive global impact. Experience our distinctive Swedish-rooted workplace culture, characterized by openness, transparency, and a flat organizational structure encouraging free communication across all levels. Additional perks including complimentary access to canteen facilities and transport services, enhancing your daily workplace experience. Job location Hybrid Work Model This position offers a flexible hybrid working arrangement, where you can effectively balance your time between working remotely and collaborating on-site at our state-of-the-art Atlas Copco Global IT Hub located in Hinjewadi, Pune, India. This setup fosters both independence and teamwork in a supportive environment.
This job post has been translated by AI and may contain minor differences or errors.
