Person, Flooring, Wood, Floor, Hardwood, Furniture, Plywood, Couch, Sphere

 

Software Engineer, Big Data Query Platform

 

Software Engineer, Big Data Query Platform

San Francisco | California | United States

About Pinterest:

Millions of people across the world come to Pinterest to find new ideas every day. It’s where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. As a Pinterest employee, you’ll be challenged to take on work that upholds this mission and pushes Pinterest forward. You’ll grow as a person and leader in your field, all the while helping users make their lives better in the positive corner of the internet. We’re looking for software engineers to help us build a high-performance and efficient big data query platform and infrastructure at Pinterest. You’ll be working on some of the most exciting big data open source technologies such as Spark, Presto, Hive, Parquet, etc. at the scale of hundreds of petabytes of data to help bring Pinners the inspiration to create a life they love

What you’ll do:

  • Build and improve the batch query platform and infrastructure to support a scalable, performant and efficient big data query capability on hundreds of PB of data.
  • Improve and customize the internals of open-source big data projects such as Spark, Presto, Parquet, Livy, etc to address oru challenges at scale.
  • Collaborate closely with the internal big data user community on business and technical problems and provide thought leadership in building the solution.
  • Identify changing business requirements and technical challenges. Incorporate them into the team's strategy and roadmap.

What we’re looking for:

  • Experience in one or more open-source big data projects such as Spark, Presto, Hive, Pig, Parquet, etc.
  • Building and operating a big data platform supporting large scale queries.
  • Proficiency in one or more programming languages (Java, Scala, Python)
  • Pluses: Experience with building software on AWS. Expertise in other big data related open source projects. Expertise in other data warehouse systems such as  MySQL, Oracle, Snowflake, etc. In-depth knowledge of the Java virtual machine. 

#LI-KL1

Apply Now

Not You?

Thank you

Recommended Jobs

Software Engineer, Big Data Workflow Platform

#<JobTemplateFieldOption:0x000000000ed1bc40> Palo Alto California United States Palo Alto, California, United States Engineering Engineering > Eng
About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It’s where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspi...

Software Engineer, Analytics Platform

#<JobTemplateFieldOption:0x0000000010648808> San Francisco California United States San Francisco, California, United States Engineering Engineering > Eng
About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It’s where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspi...

Software Engineer, Real-Time Analytics

#<JobTemplateFieldOption:0x00000000108ad508> San Francisco California United States San Francisco, California, United States Engineering Engineering > Eng
About Pinterest: Millions of people across the world come to Pinterest to find new ideas every day. It’s where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspi...

Software Engineer, API Platform

#<JobTemplateFieldOption:0x0000000010a5c6d8> San Francisco California United States San Francisco, California, United States Engineering Engineering > Eng
About Pinterest: Ready to lead the evolution of a world-class API framework and development experience, backing billions of monthly pageviews on one of the planet’s most beloved products? Pinterest is taking our API framework into the future and l...