Person, Flooring, Wood, Floor, Hardwood, Furniture, Plywood, Couch, Sphere

 

Software Engineer, Big Data Query Platform

 

Software Engineer, Big Data Query Platform

San Francisco | California | United States

We’re looking for software engineers to help us build a high-performance and efficient big data query platform and infrastructure at Pinterest. You’ll be working on some of the most exciting big data open source technologies such as Spark, Presto, Hive, Parquet, etc. at the scale of hundreds of petabytes of data to help bring Pinners the inspiration to create a life they love

 

What you’ll do:

  • Build and improve the batch query platform and infrastructure to support a scalable, performant and efficient big data query capability on hundreds of PB of data.
  • Improve and customize the internals of open-source big data projects such as Spark, Presto, Parquet, Livy, etc to address oru challenges at scale.
  • Collaborate closely with the internal big data user community on business and technical problems and provide thought leadership in building the solution.
  • Identify changing business requirements and technical challenges. Incorporate them into the team's strategy and roadmap.

What we’re looking for:

  • Experience in one or more open-source big data projects such as Spark, Presto, Hive, Pig, Parquet, etc.
  • Building and operating a big data platform supporting large scale queries.
  • Proficiency in one or more programming languages (Java, Scala, Python)
  • Pluses: Experience with building software on AWS. Expertise in other big data related open source projects. Expertise in other data warehouse systems such as  MySQL, Oracle, Snowflake, etc. In-depth knowledge of the Java virtual machine. 

#LI-KL1

Apply Now

Not You?

Thank you

Recommended Jobs

Software Engineer, Big Data Workflow Platform

Palo Alto California United States Palo Alto, California, United States Engineering Engineering > Eng
We’re looking for Big data workflow/orchestration  platform engineers (across levels) to help us build and lead the next generation of ETL orchestration platform at Pinterest. You’ll be working on some of the most exciting big data open source tec...

Software Engineer, Analytics Platform

San Francisco California United States San Francisco, California, United States Engineering Engineering > Eng
You’ll design, build, support, and own Pinterest’s critical internal data tools end-to-end. Examples of these are Pinterest’s in-house ad-hoc querying IDE, A/B experiments platform, internal analytics tracking app, visual data workflow composer, J...

Software Engineer, API Platform

San Francisco California United States San Francisco, California, United States Engineering Engineering > Eng
Pinterest is looking for an experienced API engineer to help build and run our API layer. As part of our API Core Platform team, you will design, build, and operate the API layer that backs billions of monthly page views, and ensure that it’s read...

Software Engineer, Real-Time Analytics

San Francisco California United States San Francisco, California, United States Engineering Engineering > Eng
Pinterest brings millions of Pinners the inspiration to create a life they love for everything; whether that be tonight’s dinner, next summer’s vacation, or a dream house down the road. Our Real Time Analytics team owns, develops and maintains two...