Job description
Project Role : Custom Software Engineer
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills : Python (Programming Language)
Good to have skills : Java, AWS Administration
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Key Responsibilities :
Design, build, and manage robust and scalable data pipelines (batch and real-time).
Develop ETL processes to acquire, transform, and integrate data from multiple sources.
Build and maintain data warehouses, data lakes, and other storage solutions.
Optimize data systems for performance, reliability, and scalability.
Collaborate with cross-functional teams to understand data requirements and deliver solutions.
Ensure data quality, consistency, and integrity across systems.
Implement data governance, privacy, and security best practices.
Monitor and troubleshoot data pipelines and flows, ensuring high availability.
Document data architecture, flows, and system designs.
Skills needed :
Bachelor s or Master s degree in Computer Science, Engineering, Information Systems, or a related field.
Proficient in SQL and at least one programming language (Python, Java, or Scala).
Experience with ETL tools and workflow orchestration (e.g., AWS Glue, Apache Airflow, Luigi, Talend).
Hands-on experience with cloud platforms AWS, is must – Good to have –(GCP, or Azure) and services like S3, Redshift, BigQuery, or Data Factory.
Familiarity with big data tools such as Hadoop, Spark, and Kafka.
Knowledge of data modeling and warehousing concepts.
Experience with version control tools (Git) and CI/CD processes.
Strong problem-solving and communication skills.
Additional Information:
- The candidate should have minimum 5 years of experience in Python (Programming Language).
- This position is based at our Kolkata office.
- A 15 years full time education is required.
This job post has been translated by AI and may contain minor differences or errors.
