Job description
Senior Data Engineer
About the Team
The Data Platform and Solutions team builds and maintains the data platform that ingests data from various data sources, transforms that data and maintains the business logic, then pushes out that data to power our reporting, our AI/ML features, our critical customer-facing applications and APIs, and fuels our GTM systems to empower CircleCI to be the premier data-driven company in the CI/CD space.
About the Role
CircleCI is seeking an experienced Data Engineer to own and further develop our data infrastructure, ingestion, and to help us build our data products. This will include data ingestion/validation/alerting, AI/ML systems, and customer-facing APIs. As the initial data engineering hire, you’ll work independently while collaborating closely with both engineering and other data teams to build robust, scalable data systems. We’re seeking someone with a voracious appetite for solving complex problems and who can innovate and collaborate with teams across CircleCI.
Key Responsibilities
- Design and implement data architectures that support efficient data flow across the organization
- Build and maintain event-based logging systems to ensure comprehensive data capture
- Establish and enforce data contracts to maintain data quality and consistency
- Optimize data infrastructure costs while maintaining performance
- Create and maintain data pipelines using modern orchestration tools
- Partner with analytics engineers to ensure data availability and reliability
- Evaluate and implement new data tools and technologies as needed
Required Qualifications
- 5+ years of experience in data engineering roles
- Strong expertise in Python and SQL
- Proven experience with modern data warehousing solutions, particularly Snowflake
- Deep understanding of database systems, including PostgreSQL
- Hands-on experience with data integration tools like Fivetran
- Knowledge of CI orchestration tools like CircleCI or dbtCloud
- Proficiency with data pipeline orchestration platforms like Apache Airflow
- Experience with modern data transformation tools, specifically dbt
- Track record of implementing event-based logging systems
- Strong background in data modeling and architecture design
Required Skills
- Self-motivated with ability to work independently
- Excellent problem-solving and analytical skills
- Strong communication abilities to work effectively with both technical and non-technical stakeholders
- Experience in implementing and maintaining data quality standards
- Proven ability to optimize data infrastructure costs
- Experience with data contract design and implementation
Preferred Qualifications
- Experience being a founding member of a data engineering team
- Background in data security and compliance
- Experience with batch and microbatch data processing systems
- Knowledge of data observability tools and practices
- Experience with GPU infrastructure management and optimization
- Familiarity with ML model versioning and experiment tracking tools
Canada Base Pay Range
$121,000—$151,000 CAD
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
About CircleCI
CircleCI is the world’s largest continuous integration/continuous delivery (CI/CD) platform, and the hub where code moves from idea to delivery. As one of the most-used DevOps tools - processing more than 3 million jobs a day - CircleCI has unique access to data on how the most effective engineering teams work, and the tools to help software companies successfully leverage the power of AI into their commercial applications. Companies like Hinge, HuggingFace, and Samsung use us to improve engineering team productivity, release better products, and get to market faster.
Founded in 2011 and headquartered in downtown San Francisco with a global, remote workforce, CircleCI is venture-backed by Base10, Greenspring Associates, Eleven Prime, IVP, Sapphire Ventures, Top Tier Capital Partners, Baseline Ventures, Threshold
Ventures, Scale Venture Partners, Owl Rock Capital, Next Equity Partners, Heavybit, and Harrison Metal Capital.
CircleCI is an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.
