Job Description

Senior Data Engineer

Experience & Skills Fitment:

• Strong programming experience in Python
• Extensive experience with processing frameworks such as Spark, Spark Streaming, Airflow, Hive, Sqoop, Kafka etc.
• Experience with big data processing within cloud environments such as AWS S3
• Passionate about Data Privacy and Security, Data Management
• Experience building and shipping data production pipelines sourcing data from a diverse array of sources
• Understanding of measuring and ensuring data quality at scale
• Knowledge of tools to monitor and optimize performance of data pipelines
• Ability to communicate effectively with team members and business stakeholder