Software Engineer, Big Data Query Platform

Palo Alto, CA, US | San Francisco, CA, US
Regular
Engineering
1897086
Two women posing in front of a green screen.
Two women sitting at a table in a group setting.
Decorative light letters that spell PINS with a woman sitting on the floor next to them.
View of conference attendee from behind wearing a grey hat.
Decorative light letters that spell PINS.
A lush office patio with furniture overlooking a neighborhood in the city.
Various flyers for women's groups at Pinterest.
A view of Pinterest Toronto office common area.
A colorful art installation.

About Pinterest:  

Millions of people across the world come to Pinterest to find new ideas every day. It’s where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you’ll be challenged to take on work that upholds this mission and pushes Pinterest forward. You’ll grow as a person and leader in your field, all the while helping Pinners make their lives better in the positive corner of the internet.

As a software software engineer on the Big Data Query Platform, you’ll help build the next generation high-performance, efficient and secure big data query platform and infrastructure at Pinterest. You’ll be working on some of the most exciting big data open source technologies such as Presto, Spark, Parquet, Iceberg, etc. at the scale of hundreds of petabytes of data to enable thousands of Pinterest employees to move with velocity towards Pinterest’s mission. 

What you’ll do

  • Build and improve the big data query platform and infrastructure to support a reliable, secure, performant and efficient big data query capability on hundreds of PB of data.
  • Improve and customize the internals of open-source big data projects such as Spark, Presto, Parquet, Iceberg, Livy, etc to address our challenges at scale.
  • Collaborate closely with the internal big data user community on business and technical problems and provide thought leadership in building the solution.
  • Identify changing business requirements and technical challenges. Incorporate them into the team’s strategy and roadmap.

What we’re looking for:

  • 5+ years industry experience in software engineering, including 2+ years in one or more open-source big data projects such as Spark, Presto, Hive, Pig, Parquet, Iceberg, etc 
  • Building and operating a big data platform supporting large scale queries.
  • Proficiency in one or more programming languages (Java, Scala, Python)
  • Bonus points for experience with building software on AWS or expertise in other big data related open source projects. 
  • Bonus points for expertise on other data warehouse systems such as MySQL, Oracle, Snowflake, etc, in-depth knowledge on the Java virtual machine, and/or working on data privacy, security and cryptography. 

#LI-SG1

We’re growing rapidly throughout Latin America and Mexico! Check out our open positions and learn more about Pinterest’s exciting opportunities in these regions.

It all starts here.
Meet the people behind the product.