Job Description

• India Remote

Who We Are & Why We’re Hiring

Twilio powers real-time business communications and data solutions that help companies and developers worldwide build better applications and customer experiences.

Although we're headquartered in San Francisco, we have presence throughout South America, Europe, Asia and Australia. We're on a journey to becoming a global company that actively opposes racism and all forms of oppression and bias. At Twilio, we support diversity, equity & inclusion wherever we do business.

About The Job

This position is needed to help lead architecture for the Source team inside the Platform Services group. This team builds and runs the Ingestion and Processing platform. This team is building the next-gen pipeline for ingesting and processing data at a scale upwards of 1 million requests per second.

In this role you will lead a team of software engineers to partner with Product, Analytics, and Engineering teams to build products and services that enable marketers to make smart decisions about their campaigns and deliver personalized customer experiences. This role is highly strategic and is uniquely positioned to drive multiplier impacts for Twilio Segment as we continue to innovate and expand our core products. At the same time, you will get to lead an amazing team of talented software engineers to shape the future of our business.

Segment is the customer data platform (CDP) that natively supports Twilio’s communications APIs. Our vision is a unified platform that intelligently delivers the most relevant content to marketers through the best channel at every point in their lifecycle. Imagine a platform that can take the hundreds of thousands of messages entering Segment’s pipelines every second, add in a new identity graph, and overlay multiple high speed, realtime and batch databases — and you have the Platform. We’ve since built several successful products on top of the platform such as Linked Audiences, Trait Activation etc

The Source team helps us raise 9s by improving resilience. We also improve latency, throughput and scale. We partner with development teams and provide them with a world class platform to launch products.

Responsibilities

In this role, you’ll:

• Lead our Source team to build, evaluate, deploy and iterate on large scale data and pipelines.
• Design, review and build core systems that power Twilio Segment and Twilio Engage
• Partner with other engineering leads across Twilio to build world-class products
• Ensure world-class reliability, security and cost-efficiency for all the products we build
• Mentor other engineers on the team throughout their journey

Qualifications

Not all applicants will have skills that match a job description exactly. Twilio values diverse experiences in other industries, and we encourage everyone who meets the required qualifications to apply. While having “desired” qualifications make for a strong candidate, we encourage applicants with alternative experiences to also apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table!

Required

• 9+ years experience writing production-grade code in a modern programming language.
• Strong theoretical fundamentals and hands-on experience designing and implementing highly available and fault-tolerant distributed systems.
• Experience programming in one or more of the following: Go, Java, Scala, or similar languages
• Experience operating large-scale, distributed systems on top of cloud infrastructure such as Amazon Web Services (AWS) or Google Compute Platform (GCP)
• Deep understanding of architectural patterns of high-scale web applications (e.g., well-designed APIs, high volume data pipelines, efficient algorithms)
• Domain expertise in Modern Data stack with experience in developing cloud-based data solution components and architecture covering data ingestion, data processing, and data storage
• Expertise in HDFS, Spark or streaming frameworks (Kafka/Spark streaming).
• Proficiency in NoSQL data stores and in-memory data stores (Redis, Memcached)
• Have hands-on experience with container orchestration frameworks (e.g., Kubernetes, EKS, ECS)
• Experience shipping services (products) following CI/CD development paradigm.
• Have a track record of successfully leading teams and large projects or owning and building a complex system end to end
• Ability to influence and build effective working relationships with all levels of the organization
• Are passionate about enabling other developers through your leadership and driving teams to efficient decisions
• Excellent written and verbal communication skills.

Desired

• Experience in modern stream processing systems (e.g., Spark, Flink)
• Experience in message passing systems (e.g., Kafka, AWS Kinesis)
• Experience in AWS and Go