Job Description

• India

About the Role

• We are seeking a highly skilled Senior Data Engineer with expertise in Python and Airflow to join our team at Atlan. As a Senior Data Engineer, you will play a key role in driving the development and enhancement of our data management and workflow automation solutions using Python and Airflow.

What will you do?

• Lead the design, development, and implementation of Airflow packages and services
• Build and maintain the Python services related to data lineage and orchestration
• Work closely with the lineage and package team to implement the end-to-end needs of orchestration packages
• Do research and POC experiments on new orchestration and lineage-related products and libraries
• Mentor and guide junior team members, fostering a culture of technical excellence and continuous learning
• Collaborate with our orchestration partners for technical roadmap and implementation
• Contribute to open-source libraries and frameworks we use
• Work closely with design, product and Engineering Managers

What makes you a match for us?

• Strong experience as a Data Engineer with a focus on Python and Airflow.
• Proven expertise in designing and developing data pipelines and workflow automation using Apache Airflow.
• Solid understanding of data management concepts and data processing frameworks.
• Proficiency in Python programming and experience with related libraries and frameworks.
• Familiarity with database systems, both SQL and NoSQL, and experience with data modeling and database design.
• Experience in cloud platforms like AWS, Azure, or GCP is a plus.
• Strong problem-solving skills and the ability to tackle complex technical challenges.
• Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
• Passion for delivering high-quality, scalable, and reliable software solutions.
• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.