Image Loading

Data Engineer II (Python, SQL, Query Optimization, DBMS)

Job Description

Scope:

The Execution Machine Learning team works closely with sales, product, and engineering teams to design and implement the next generation of retail solutions. Data Science team members are tasked with turning both small, sparse, and massive data into actionable insights with measurable improvements to the customer bottom line. They use rigorous analysis and repeatable processes to implement both black box and interpretable models.

Our machine learning platform ingests data in real time, processes information from millions of retail items to serve deep learning models, and produces billions of predictions on a daily basis

What you’ll do:

  • Design, architect, implement and help operate the Execution Machine Learning platform by
  • Observing inefficiencies, both in cost and reliability, of existing processes
  • Researching alternative solutions using custom or existing open-source technologies
  • Designing replacement processes and components
  • Implementing processes, extending, and configuring open-source components
  • Work with the DevOps and Support teams to operate platform by
  • Helping implement DevOps best practices of in-house and open-source components.
  • Ensuring smooth operation via monitoring and alerting facilities
  • Work with the data scientists to
  • Design scalable solutions for both model building and serving.

What we are looking for:

  • Bachelor’s degree in computer science is required, Masters is preferred
  • 2+ years of Python programming experience with understanding of Object-Oriented Design.
  • 1+ years working with SQL DBMS and Query Optimization; Big Query preferred.
  • 1+ years of experience working on at least one cloud environment, GCP/Azure/Snowflake.
  • Should have experience in Data Warehousing and ETL Tools.
  • 1+ Working Experience on Kafka and its integration with Cloud Services.
  • Some experience with streaming frameworks, preferably Beam on Samza/Flink/DataFlow
  • Familiarity with modern Big Data computing platforms such as Hadoop and Spark
  • Experience working with CI/CD and modern software engineering practices.
  • Some experience with Data Analysis and Visualization tools (Power BI/Tableau/Superset)
  • Good to have Supply Chain domain knowledge.

Skills

  • Python
  • Object Oriented Design
  • Data Warehousing
  • ETL Tools
  • Kafka
  • Big Data

Education

  • Master's Degree
  • Bachelor's Degree

Job Information

Job Posted Date

Nov 26, 2024

Experience

2 to 6 Years

Compensation (Annual in Lacs)

Best in the Industry

Work Type

Permanent

Type Of Work

8 hour shift

Category

Information Technology

Copyright © 2022 All Rights Reserved. Saas Talent