Job Description

Senior staff Data Engineer

Role and Responsibilities:

• Lead a team of high-potential individuals with solid backgrounds in software development.
• Opportunity to work on cutting-edge Generative AI services and software initiatives
• Lead the development of cloud and web components to ingest, process, transform, and visualize data at scale.
• Design and review scalable software architecture, ensuring it meets both current and future needs.
• Develop and optimize back-end components to enhance system responsiveness and overall performance.
• Take ownership of key product features and internal frameworks to enhance observability and system monitoring.
• Implement engineering best practices, including unit testing, continuous delivery, and code quality checks using tools like SonarQube.
• Oversee the deployment and monitoring of production-ready infrastructure, leveraging technologies such as ELK stack and Airflow.
• Drive project delivery while ensuring effective communication with key stakeholders.
• Own and manage software metrics and SLAs for multiple software services.

Requirements:

• Exposure to AWS services like Kinesis, SQS, and ASG
• Strong programming skills in Python.
• Solid fundamentals in Computer Science, particularly in object-oriented programming (OOPs), algorithms, and data structures.
• In-depth understanding of internals and schema design for various data stores (RDBMS and NoSQL).
• Experience with data warehousing solutions like Snowflake and visualization tools such as Tableau.