Staff (Lead) Data Engineer
- Americas
- Engineering & Data
About Shopify
机会并不是均匀分布的。Shopify把s independence within reach for anyone with a dream to start a business. Since 2006, we’ve grown to over 10,000 employees and generated over $496 billion in sales for millions of merchants in 175 countries. Every 28 seconds, an entrepreneur on Shopify makes their first sale.
This is life-defining work that directly impacts people’s lives as much as it transforms your own. This is putting the power of the few in the hands of the many, is a future with more voices rather than fewer, and is creating more choices instead of an elite option.
About you
Moving at our pace brings a lot of change, complexity, and ambiguity—and a little bit of chaos. Shopifolk thrive on that and are comfortable being uncomfortable. That means Shopify is not the right place for everyone.
- Care deeply about what you do and about making commerce better for everyone
- Excel by seeking professional and personal hypergrowth
- Keep up with an unrelenting pace (the week, not the quarter)
- 在面对歧义的弹性、应变能力强and thrive on (rather than endure) change
- Bring critical thought and opinion
- Embrace differences and disagreement to get shit done and move forward
- Work digital-first for your daily work
About the role
Our Data Engineering group builds and maintains the platform that delivers accessible data to power decision-making at Shopify for millions of merchants. We’re hiring high-impact developers across teams:
The Engine group organizes all merchant and Shopify data into our data lake in highly-optimized formats for fast query processing, and maintaining the security and quality of our datasets.
The Analytics group leverages the Engine primitives to build and deliver simple and useful products that power scalable transformation of data at Shopify in batch, streaming, or for machine learning. This group is focused on making it really simple for our users to answer three questions: What happened in the past? What is happening now? And, what will happen in the future?
The Data Experiences group builds end-user experiences for experimentation, data discovery, and business intelligence reporting.
The Reliability group operates the data platform in a consistent and reliable manner. They build tools for other teams on Data Platform to leverage and encourage consistency as they champion reliability across the platform.
Qualifications
An experienced technical leader with a proven track record of delivering impactful results.
Technical engineering background in one or more areas in the next section.
Experience with technical mentoring, coaching, and improving the technical output of the people around you.
Exceptional communication skills and ability to translate technical concepts into easy to understand language for our stakeholders.
Excitement for working with a remote team; you value collaborating on problems, asking questions, delivering feedback, and supporting others in their goals whether they are in your vicinity or entire cities apart.
A Staff (Lead) Data Engineer would typically have 6-10 years of experience inone or moreof the following areas:
Experience with the internals of a distributed compute engine (Spark, Presto, DBT, or Flink/Beam)
Experience in query optimization, resource allocation and management, and data lake performance (Presto, SQL)
Experience with cloud infrastructure (Google Cloud, Kubernetes, Terraform)
Experience with security products and methods (Apache Ranger, Apache Knox, OAuth, IAM, Kerberos)Experience deploying and scaling ML solutions using open-source frameworks (MLFlow, TFX, H2O, etc.)
Experience building full-stack applications (Ruby/Rails, React, TypeScript)
Background and practical experience in statistics and/or computational mathematics (Bayesian and Frequentist approaches, NumPy, PyMC3, etc.)
Modern Big-Data storage technologies (Iceberg, Hudi, Delta)
We know that looking for a new role can be both exciting and time-consuming, and we truly appreciate your effort. Brad is an actual real live person () and is looking forward to learning more about you through your application. And remember, we want to know what you're really interested in building and why you want to build it at Shopify, so please give us as much detail on this as you'd like in the answers on the next page.
As there are multiple positions, this posting will remain live until all positions have been filled. Successful candidates can expect to hear back from us within 1-3 weeks of application.
Our belief is that a strong commitment to diversity & inclusion enables us to truly make commerce better for everyone. We encourage applications from Indigenous peoples, racialized people, people with disabilities, people from gender and sexually diverse communities, and/or people with intersectional identities. Please take a look atour Sustainability Reportsto learn more about Shopify’s commitments to our communities, and our planet.
At Shopify, we understand that experience comes in many forms. We’re dedicated to adding new perspectives to the team - so if your experience is this close to what we’re looking for, please consider applying.
#LI-REMOTE
Our belief is that a strong commitment to diversity & inclusion enables us to truly make commerce better for everyone. We encourage applications from Indigenous peoples, racialized people, people with disabilities, people from gender and sexually diverse communities, and/or people with intersectional identities. Please take a look atour Sustainability Reportsto learn more about Shopify’s commitments to our communities, and our planet.
At Shopify, we understand that experience comes in many forms. We’re dedicated to adding new perspectives to the team - so if your experience is this close to what we’re looking for, please consider applying.
The shape of a Shopify career
Ben joined Shopify as a frontline Support Advisor with no background in programming or computer science. He’s now a Director of Engineering. Spanning 10 jobs on 7 teams in 9 years, Ben’s Shopify career path has twisted and turned as he’s worked relentlessly to pursue a career as an engineer and adapted to the pace of change—all fuelled by personal and professional hypergrowth.
Ben’s growth trajectory
2014-2016
- A support advisor for 2 years
- Studied dev skills. Learnt about our API. Became first API support person. Found bugs to fix.
- Eventually became a software dev
2017-2019
- Helped launch first finance product for merchants
- Became senior dev and launched new support contact centre
- 领导一个团队作为一个开发经理
2020-2022
- Scaled a team from 4 to 60+ as a senior dev manager
- Became Director for Support and CX Engineering