Senior Data Engineer

at Spiritual Data
🇺🇸 United States - Remote
📊 Data🟣 Senior

Job description

Location: This remote position requires an overlap with US Pacific Timezone.

Who are we?

Mission

Altimate AI, founded in 2022 in San Francisco, is revolutionizing enterprise data operations through the power of AI. Our mission is to alleviate the burden on overworked and understaffed enterprise data teams by providing innovative AI-driven solutions that automate and accelerate a wide range of data tasks. Our flagship product, DataPilot, offers advanced data automation capabilities, while our new DataMates technology brings the concept of agentic AI to data operations, acting as virtual teammates for data professionals. Our solutions seamlessly fit into existing tools like VSCode, Git, and Slack, performing tasks ranging from data documentation to performance optimization.

By leveraging a proprietary framework that combines multiple language models and a custom-built knowledge graph, we enable contextually aware AI agents that integrate seamlessly into existing workflows. Our solutions, including ambient AI for continuous monitoring and optimization, are designed to meet the growing demands of data operations, business intelligence, and analytics in an era of ever-increasing data volumes. Used by thousands of users across the world, and backed by prominent investors , we’re positioned at the forefront of the AI-powered data engineering revolution.

You can read more about us in a recently published venture beat article.

Team

As a team, we are Silicon Valley veterans who previously created category-defining data and AI products loved by thousands of companies worldwide. We have experienced the journey of a small startup to IPO very closely. We have started on a similar journey again and are backed by prominent advisors and VC firms with multi-billion dollar portfolios.

What are we looking for?

We’re in search of a Senior Data Engineer who brings a passion for innovation and problem-solving, not limited to traditional data engineering. This role is for those with deep expertise in building large scale data pipelines, SQL optimization, and cloud infrastructure, excited to design and build the backbone of our AI-powered data solutions. The ideal candidate will play a crucial role in enhancing our AI capabilities, developing high-performance data systems, and integrating advanced AI using the product into thousands of data teams’ daily workflows.

Qualifications:

  • 8+ years of experience in data engineering, with a focus on building scalable data pipelines and systems

  • Strong proficiency in Python and SQL

  • Extensive experience with SQL query profiling, optimization, and performance tuning, preferably with Snowflake

  • Deep understanding of SQL Abstract Syntax Tree (AST) and experience working with SQL parsers (e.g., sqlglot) for generating column-level lineage and dynamic ETLs

  • Experience in building data pipelines using Airflow or dbt

  • [Optional] Solid understanding of cloud platforms, particularly AWS

  • [Optional] Familiarity with Kubernetes (K8s) for containerized deployments

Why you should join Altimate AI

Projects You’ll Work On:

  • Building PB Scale Data Pipelines: Building highly performant large scale data infrastructure that can scale to 100K+ jobs and handle PB scale data per day.

  • Cloud-Native Data Infrastructure: Design and implement robust, scalable data infrastructure on AWS, utilizing Kubernetes and Airflow for efficient resource management and deployment.

  • Intelligent SQL Ecosystem: Design and develop a comprehensive SQL intelligence system encompassing query optimization, dynamic pipeline generation, and data lineage tracking. Leverage your expertise in SQL query profiling, AST analysis, and parsing to create a sophisticated engine focused on query performance improvements, building adaptive data pipelines, and implementing granular column-level lineage.

Impact:

  • Innovation at the Forefront: Push the boundaries of data engineering by combining traditional techniques with cutting-edge AI technologies.

  • High Visibility: Directly affect the productivity and capabilities of global data teams, as your contributions will be crucial to the daily operations of thousands of users spread across 100s of countries.

  • Open Source Contribution: As part of our commitment to the developer community, you will contribute to our open-source initiatives, gaining recognition in the tech community.

  • Career Growth: This role is a launchpad into the rapidly advancing field of AI-powered data engineering, offering exposure to state-of-the-art technologies and generative AI applications.

What We Offer

  • Competitive salary and equity

  • Extensive professional development opportunities and resources for continuous learning

  • Dynamic and intellectually stimulating work environment with a team of talented engineers

  • Opportunities to shape the direction of the company and leave a lasting impact

How to Apply

If this sounds like the perfect role for you, we can’t wait to meet you! Apply now and let’s build something amazing together.

Share this job:
Please let Spiritual Data know you found this job on Remote First Jobs 🙏
Spiritual Data logo

Spiritual Data

  • 2 remote jobs

Benefits of using Remote First Jobs

Discover Hidden Jobs

Unique jobs you won't find on other job boards.

Advanced Filters

Filter by category, benefits, seniority, and more.

Priority Job Alerts

Get timely alerts for new job openings every day.

Manage Your Job Hunt

Save jobs you like and keep a simple list of your applications.

Search remote, work from home, 100% online jobs

We help you connect with top remote-first companies.

Search jobs

Hiring remote talent? Post a job

Frequently Asked Questions

What makes Remote First Jobs different from other job boards?

Unlike other job boards that only show jobs from companies that pay to post, we actively scan over 20,000 companies to find remote positions. This means you get access to thousands more jobs, including ones from companies that don't typically post on traditional job boards. Our platform is dedicated to fully remote positions, focusing on companies that have adopted remote work as their standard practice.

How often are new jobs added?

New jobs are constantly being added as our system checks company websites every day. We process thousands of jobs daily to ensure you have access to the most up-to-date remote job listings. Our algorithms scan over 20,000 different sources daily, adding jobs to the board the moment they appear.

Can I trust the job listings on Remote First Jobs?

Yes! We verify all job listings and companies to ensure they're legitimate. Our system automatically filters out spam, junk, and fake jobs to ensure you only see real remote opportunities.

Can I suggest companies to be added to your search?

Yes! We're always looking to expand our listings and appreciate suggestions from our community. If you know of companies offering remote positions that should be included in our search, please let us know. We actively work to increase our coverage of remote job opportunities.

How do I apply for jobs?

When you find a job you're interested in, simply click the 'Apply Now' button on the job listing. This will take you directly to the company's application page. We kindly ask you to mention that you found the position through Remote First Jobs when applying, as it helps us grow and improve our service 🙏

Apply