Image Loading

Data Engineer II

Job Description

Data Engineer II

Your Responsibilities

  • Designing, building and launching extremely efficient and reliable data pipelines to move data across a number of platforms, including Data Warehouse and real-time systems.
  • Developing strong subject matter expertise and managing the SLAs for those data pipelines.
  • Setting up and improving BI tooling and platforms to help the team create dynamic tools and reporting.
  • Assessing options and opportunities in order to provide recommendations to business partners and stakeholders.
  • Partnering with Data Scientists and business partners, like analytics teams and system administrators, to develop internal data products to improve operational efficiencies organizationally.

Here are some examples of our work:

  •  Data Pipelines - Create new pipelines or rewrite existing pipelines using SQL, Python or Spark
  •  Data Quality and Anomaly Detection - Improve existing tools to detect anomalies real time and through offline metrics
  •  Data Modeling - Partner with analytic consumers to improve existing datasets and build new ones

What We're Looking For

  • 3 to 6 years of experience in a Data Engineering role, with a focus on data warehouse technologies, data pipelines and BI tooling.
  • Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Engineering, or related technical discipline.
  • Expert knowledge of SQL and of relational database systems and concepts.
  • Strong knowledge of data architectures and data modeling and data infrastructure ecosystems.
  • Experience with enterprise business systems such as Salesforce, Marketo, Zendesk, Gainsight, etc.
  • Experience with ETL pipeline tools like Airflow, and with code version control systems like Git.
  • The ability to communicate cross-functionally, derive requirements and architect shared datasets; the ability to synthesize, simplify and explain complex problems to different types of audiences, including executives.
  • The ability to thrive in a dynamic environment. That means being flexible and willing to jump in and do whatever it takes to be successful.

What Gives You An Edge

  • Experience with Apache Kafka
  • Experience with GTM & Sales systems (ex: Salesforce, Zendesk, etc.)
  • Knowledge of batch and streaming data architectures
  • Product mindset to understand business needs, and come up with scalable engineering solutions

Skills

  • Data Engineering
  • SQL Database
  • Python
  • Spark Streaming
  • Gainsight

Education

  • Master's Degree
  • Bachelor's Degree

Job Information

Job Posted Date

Jun 12, 2023

Experience

3 to 6 Years

Compensation (Annual in Lacs)

₹ Market Standard

Work Type

Permanent

Type Of Work

8 hour shift

Category

Information Technology

Copyright © 2022 All Rights Reserved. Saas Talent