Person, Flooring, Wood, Floor, Hardwood, Furniture, Plywood, Couch, Sphere

 

Software Engineer, Real-Time Stream Processing Platform

 

Software Engineer, Real-Time Stream Processing Platform

San Francisco | California | United States

We’re looking for software engineers (across levels) to help us build and lead the next generation of stream processing platform and infrastructure at Pinterest. You’ll be working on some of the most exciting big data open source technologies (Flink, Kafka, RocksDB,, etc.), at the scale of hundreds of petabytes of data to help Pinners discover and do what they love. 

What you’ll do:

  • Improve and customize the internals of open source big data technologies, e.g. Flink, to meet our challenges at scale and actively participate in open source community
  • Build and scale stream processing frameworks and infrastructure to process petabytes-scale datasets
  • Work with internal customers on critical business use cases that rely on real-time stream processing
  • Provide thought leadership to the entire company on how real-time data should be processed and stored more reliably, quickly and efficiently at scale
  • Contribute to the team’s technical vision and long-term roadmap

What we’re looking for:

  • Experiences in one or more open-source stream processing technologies (Flink, Spark Streaming, Kafka Streams, Samza, Storm etc.)
  • Experience of building scalable infrastructure to support stream data processing to process petabytes of data
  • Proficiency in one or more programming languages (Java, Scala, Python)
  • Pluses: AWS experiences, internal knowledge or expertise of open source or related big data technologies   

#LI-KL1

Apply Now

Not You?

Thank you

Recommended Jobs

IT Ops Associate

Dublin Ireland Dublin, Ireland IT IT > IT
The IT Operations team at Pinterest solves problems in innovative and creative ways, and this role is an opportunity to have a big impact. You’ll join a team whose mission is to provide joy through frictionless support that is globally consistent....

Fullstack Engineer, Content Growth

San Francisco California United States San Francisco, California, United States Engineering Engineering > Eng
The growth team is dedicated to making Pinterest the best destination for billions of people around the world to discover and collect inspiration everyday.  We're looking for a strong candidate to work across all parts of our core product to ident...

Senior Localization Program Manager, Websites

San Francisco California United States San Francisco, California, United States International Sales and Partnerships > International
Localization at Pinterest is not just responsible for translation, but for cultural adaptation of everything related to the experience with Pinterest product, websites and marketing assets to provide Pinners with an experience that feels local. We...

Strategic Partner Manager, Nordics

Berlin Berlin Germany Berlin, Germany International Sales and Partnerships > International
We want to make sure that Pinners everytime, everywhere find content on Pinterest that helps them create a life they love. As a Strategic Partner Manager, Nordics, you will work directly with brands, publishers and creators in Sweden, Norway and D...