Designing, building and launching extremely efficient and reliable data pipelines to move data across a number of platforms, including Data Warehouse and real-time systems.
Developing strong subject matter expertise and managing the SLAs for those data pipelines.
Setting up and improving BI tooling and platforms to help the team create dynamic tools and reporting.
Assessing options and opportunities in order to provide recommendations to business partners and stakeholders.
Partnering with Data Scientists and business partners, like analytics teams and system administrators, to develop internal data products to improve operational efficiencies organizationally.
Here are some examples of our work:
Data Pipelines - Create new pipelines or rewrite existing pipelines using SQL, Python or Spark
Data Quality and Anomaly Detection - Improve existing tools to detect anomalies real time and through offline metrics
Data Modeling - Partner with analytic consumers to improve existing datasets and build new ones
What We're Looking For
3 to 6 years of experience in a Data Engineering role, with a focus on data warehouse technologies, data pipelines and BI tooling.
Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Engineering, or related technical discipline.
Expert knowledge of SQL and of relational database systems and concepts.
Strong knowledge of data architectures and data modeling and data infrastructure ecosystems.
Experience with enterprise business systems such as Salesforce, Marketo, Zendesk, Gainsight, etc.
Experience with ETL pipeline tools like Airflow, and with code version control systems like Git.
The ability to communicate cross-functionally, derive requirements and architect shared datasets; the ability to synthesize, simplify and explain complex problems to different types of audiences, including executives.
The ability to thrive in a dynamic environment. That means being flexible and willing to jump in and do whatever it takes to be successful.
What Gives You An Edge
Experience with Apache Kafka
Experience with GTM & Sales systems (ex: Salesforce, Zendesk, etc.)
Knowledge of batch and streaming data architectures
Product mindset to understand business needs, and come up with scalable engineering solutions