Software Engineer, Big Data Query Platform

Palo Alto, CA, US | San Francisco, CA, US
Regular
Engineering
1897086
Two women posing in front of a green screen.
Two women sitting at a table in a group setting.
Decorative light letters that spell PINS with a woman sitting on the floor next to them.
View of conference attendee from behind wearing a grey hat.
Decorative light letters that spell PINS.
A lush office patio with furniture overlooking a neighborhood in the city.
Various flyers for women's groups at Pinterest.
A view of Pinterest Toronto office common area.
A colorful art installation.

About Pinterest:  

Millions of people across the world come to Pinterest to find new ideas every day. It’s where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you’ll be challenged to take on work that upholds this mission and pushes Pinterest forward. You’ll grow as a person and leader in your field, all the while helping Pinners make their lives better in the positive corner of the internet.

As a software software engineer in the big data query platform, you’ll help build the next generation high-performance, efficient and secure big data query platform and infrastructure at Pinterest. You’ll be working on some of the most exciting big data open source technologies such as Presto, Spark, Parquet, etc. at the scale of hundreds of petabytes of data to enable thousands of Pinterest employees to move with velocity towards Pinterest’s mission. 

What you’ll do:

  • Build and improve the big data query platform and infrastructure to support a reliable, secure, performant and efficient big data query capability on hundreds of PB of data.
  • Improve and customize the internals of open-source big data projects such as Spark, Presto, Parquet, Livy, etc to address our challenges at scale.
  • Collaborate closely with the internal big data user community on business and technical problems and provide thought leadership in building the solution.
  • Identify changing business requirements and technical challenges. Incorporate them into the team’s strategy and roadmap.

What we’re looking for:

  • 2+ years Experience in one or more open-source big data projects such as Spark, Presto, Hive, Pig, Parquet, etc and 5+ years of industry experience in software engineering. 
  • Building and operating a big data platform supporting large scale queries.
  • Proficiency in one or more programming languages (Java, Scala, Python).
  • Pluses: Experience with building software on AWS. Expertise in other big data related open source projects. Expertise on other data warehouse systems such as  MySQL, Oracle, Snowflake, etc. In-depth knowledge on the Java virtual machine. Experience with the ARM architecture and AWS Graviton.

#LI-KP1

We’re growing rapidly throughout Latin America and Mexico! Check out our open positions and learn more about Pinterest’s exciting opportunities in these regions.

It all starts here.
Meet the people behind the product.