Lead GCP Data Engineer Architect

Job description

Description

Hello, let’s meet!

Who We Are

While Xebia is a global tech company, in Poland, our roots came from two teams – PGS Software, known for world-class cloud and software solutions, and GetInData, a pioneer in Big Data. Today, we’re a team of 1,000+ experts delivering top-notch work across cloud, data, and software. And we’re just getting started.

What We Do

We work on projects that matter – and that make a difference. From fintech and e-commerce to aviation, logistics, media, and fashion, we help our clients build scalable platforms, data-driven solutions, and next-gen apps using ML, LLMs, and Generative AI. Our clients include Spotify, Disney, ING, UPS, Tesco, Truecaller, AllSaints, Volotea, Schmitz Cargobull, and Allegro or InPost.

We value smart tech, real ownership, and continuous growth. We use modern, open-source stacks, and we’re proud to be trusted partners of Databricks, dbt, Snowflake, Azure, GCP, and AWS. Fun fact: we were the first AWS Premier Partner in Poland!

Beyond Projects

What makes Xebia special? Our community. We run events like the Data&AI Warsaw Summit, organize meetups (Software Talks, Data Tech Talks), and have a culture that actively support your growth via Guilds, Labs, and personal development budgets — for both tech and soft skills. It’s not just a job. It’s a place to grow.

What sets us apart?

Our mindset. Our vibe. Our people. And while that’s hard to capture in text – come visit us and see for yourself.

You will be:

  • designing, building and optimizing the data ingestion pipeline to reliably deliver billions of events daily in defined SLA,

  • leading initiatives to improve scalability, performance and reliability,

  • providing support for all product teams in building and optimizing their complex pipelines,

  • identifying and addressing pain points in the existing data platform; proposing and implementing high-leverage improvements,

  • developing new tools and frameworks to streamline the data platform workflows,

  • driving adoption of best practices in data and software engineering (testing, CI/CD, version control, monitoring),

  • working in close collaboration with data scientists and data analysts to help support their work in production,

  • supporting production ML workflows and real-time streaming use cases,

  • mentoring other engineers and contributing to a culture of technical excellence and knowledge sharing.

Requirements

Your profile:

  • 6+ years of hands-on experience in data engineering and large-scale distributed systems,

  • proven expertise in building and maintaining complex ETL/ELT pipelines,

  • deep knowledge of orchestration frameworks (Airflow) and workflow optimization,

  • strong GCP cloud infrastructure experience,

  • GKE experience,

  • expert-level programming in Python or Scala,

  • solid understanding of Spark internals,

  • experience with CI/CD tools (e.g., Jenkins, GitHub Actions) and infrastructure as code,

  • familiarity with managing self-hosted tools like Spark or Airflow on Kubernetes,

  • experience managing data warehouse in BigQuery,

  • strong communication skills and a proactive, problem-solving mindset,

  • very good command of English (min. C1).

Nice to have:

  • working experience with messaging systems like Kafka, Redpanda,

  • experience with real-time data streaming platforms (e.g., Flink, Spark Structured Streaming),

  • familiarity with ML platforms or MLOps workflows,

  • familiarity with Kubeflow, Valido, Looker, Looker Studio.

Work from EU and a work permit to work from EU are required.

Candidates must have an active VAT status in the EU VIES registry: https://ec.europa.eu/taxation_customs/vies/

Recruitment Process:

CV review – HR call – Technical Interview (with Live-coding) – Client Interview (with Live-coding) – Hiring Manager Interview - Decision

Share this job:
Please let Xebia Poland know you found this job on Remote First Jobs 🙏

Benefits of using Remote First Jobs

Discover Hidden Jobs

Unique jobs you won't find on other job boards.

Advanced Filters

Filter by category, benefits, seniority, and more.

Priority Job Alerts

Get timely alerts for new job openings every day.

Manage Your Job Hunt

Save jobs you like and keep a simple list of your applications.

Search remote, work from home, 100% online jobs

We help you connect with top remote-first companies.

Search jobs

Hiring remote talent? Post a job

Frequently Asked Questions

What makes Remote First Jobs different from other job boards?

Unlike other job boards that only show jobs from companies that pay to post, we actively scan over 20,000 companies to find remote positions. This means you get access to thousands more jobs, including ones from companies that don't typically post on traditional job boards. Our platform is dedicated to fully remote positions, focusing on companies that have adopted remote work as their standard practice.

How often are new jobs added?

New jobs are constantly being added as our system checks company websites every day. We process thousands of jobs daily to ensure you have access to the most up-to-date remote job listings. Our algorithms scan over 20,000 different sources daily, adding jobs to the board the moment they appear.

Can I trust the job listings on Remote First Jobs?

Yes! We verify all job listings and companies to ensure they're legitimate. Our system automatically filters out spam, junk, and fake jobs to ensure you only see real remote opportunities.

Can I suggest companies to be added to your search?

Yes! We're always looking to expand our listings and appreciate suggestions from our community. If you know of companies offering remote positions that should be included in our search, please let us know. We actively work to increase our coverage of remote job opportunities.

How do I apply for jobs?

When you find a job you're interested in, simply click the 'Apply Now' button on the job listing. This will take you directly to the company's application page. We kindly ask you to mention that you found the position through Remote First Jobs when applying, as it helps us grow and improve our service 🙏

Apply