Image Loading

Staff Engineer, Infra

Job Description

The vision for the TLB team is to build data processing software that works on terabytes of streaming data in real time. Engineer the next-gen Spark-like system for in-memory computation of large time-series dataset’s – both Spark-like backend infra and library based programming model. Build horizontally and vertically scalable system that analyses trillions of events per day within sub second latencies. Utilize the latest and greatest of big data technologies to build solutions for use-cases across multiple verticals. Lead technology innovation and advancement that will have big business impact for years to come. Be part of a worldwide team building software using the latest technologies and the best of software development tools and processes.

What Success Will Look Like: 

This is an individual contributor position

  • Develop, build and maintain the stream processing, time-series analysis system which is at the heart of Conviva’s products
  • Responsible for release, deployment and scaling of Conviva platform
  • Responsible for resiliency, high availability and scaling of Conviva platform
  • Build features, enhancements and bug fixing for a CircleCI based CI/CD pipeline to be deployed as Docker containers on Kubernetes
  • Adhere to the Agile model of software development to plan, estimate and ship per business priority

Who You Are & What You've Done: 

  • 10+ years of work experience in development and release of data processing products
  • Excellent programming and debugging skill - Proficient in writing code by Shell-scripting/Python/Scala/Java that is reliable, maintainable, secure, and performant
  • Experience with big data technologies like Spark, Kafka, HDFS, Redis etc.
  • Experience with Kubernetes, Grafana, Prometheus, GitOps, Rancher, Helm, Jenkins, Vault, JFrog, Codacy, Cloudera Manager and Cloud infrastructure concepts on GCP
  • Ownership of production infrastructure. Strong understanding of the initiation, planning, execution, and monitoring of everything from minor bug fixes to massive updates.
  • Excellent communication skills. Willingness to work under pressure. Hunger to learn and succeed. Comfortable with ambiguity. Comfortable with complexity.
  • Engineering degree in software or equivalent from a premier institute.

Skills

  • Shell Scripting
  • Python
  • Java
  • Spark Streaming
  • Kafka
  • Jenkins

Education

  • Master's Degree
  • Bachelor's Degree

Job Information

Job Posted Date

Jan 10, 2024

Experience

10+Years

Compensation (Annual in Lacs)

₹ Market Standard

Work Type

Permanent

Type Of Work

8 hour shift

Category

Information Technology

Copyright © 2022 All Rights Reserved. Saas Talent