Job Description

Staff Data Engineer has full accountability to design and develop rich data-driven frameworks, applications and services. This role will be responsible for development of applications on the Cloud platform and migration of existing on-premise data systems and processes to the Cloud, while also engaging with the Teams navigate through Technology stack evaluation and incubation of newer Cloud technologies. Staff Data Engineer is an expert at cloud technologies, specifically AWS tools and resources, and participates in building robust data pipeline frameworks that are configurable and highly re-usable. This role will be responsible for architecting enterprise level data solutions keeping in mind future scale and SLA management with scale.

If you are that person, you'll help us continue to improve and innovate our Data Applications and Services, and we’ll help you grow!

Job Responsibilities

• Participate in the full software lifecycle (requirements, design, code, unit test, deployment, sustaining) for assigned modules
• Interact with Product Management to determine Product / Feature requirements and perform technical analysis
• Interact with Application & Analyst Teams to determine Data dependencies and perform technical analysis
• Acquire and maintain a clear understanding of the technologies used in Lytx’s products and services and help steer future technology vision
• Participate in scrum sprints with other developers, business users, and testers
• Mentor and guide junior members on the team and drive product and features development with the Team
• Collaborate with the product / program management Teams to define clear requirements
• Experience breaking down product requirements in manageable software development tasks that could be tracked
• Experience with architecture design and ability to document, publish, and evangelize architecture design to technology partners
• Practice and instill design & development best practices, re-usability concepts using frameworks, and Enterprise-wide view while designing and implementing solutions
• Understand big picture when working on product and features, ability to design enterprise level solutions focused on future growth and SLA requirements
• Other duties as assigned

Education Requirements

• Bachelor’s degree in computer science, computer information systems, or equivalent experience

Experience Requirements

• 10+ years of industry experience developing Data products and/or developing enterprise-scale Big Data solutions
• 7+ years’ experience in a senior developer role with focus in data Ingest, data processing and data publishing design
• 6+ years in design/development of high-volume high-throughput Data systems ranging from OLTP to data lake & data warehouse environments
• 5+ years of solid experience developing software products and/or developing enterprise-scale Data solutions on Cloud Platform

Technical Expertise Requirements
Languages & Tools:

• 5+ years experience with Python
• 4+ years of experience with core Java, Java springboot is preferable
• Knowledge of IAC using terraform & terragrunt

Cloud Platform

• Experience developing Data solutions on AWS platform is preferable
• Experience developing frameworks and point solutions for Data ingest, Data processing and Data publishing (AWS platform experience is preferable)
• Experience with building Streaming data solutions using Apache Kafka, Apache Flink, Apache Airflow or equivalent
• Experience with ingesting data using Kafka connect (AWS managed and/or confluent open source)
• Experience developing Data warehouse solutions on Redshift is preferable
• Experience managing and developing on big data distributed systems such as hadoop is highly preferable

Databases (RDBMS)

• Experience in SQL Server development, including high proficiency in writing and analyzing SQL/T-SQL, and developing/managing SSIS workloads is preferable
• SQL Server database performance management background is preferable
• Experience with alternate RDBMS technologies such as MySQL or PostgreSQL

Databases (no-sql)

• Experience with DynamoDB or MongoDB or Redis

Data APIs

• Experience building RESTful interfaces
• Experience building graphQL API interfaces

Ci & Cd

• Experience in an environment with continuous deployment, integration, automated testing
• Experience developing software using agile methodologies delivering solutions within bounded sprints

Production Support

• Ability to diagnose and decompose problems at the appropriate levels of the stack
• Ability to quickly resolve the problems, keeping in mind upstream and downstream systems dependencies, to bring systems to acceptable SLA levels
• Ability to perform root cause analysis (RCA) and suggest & perform system changes accordingly