Lead Data Engineer

๐Ÿ‡บ๐Ÿ‡ธ United States - Remote
๐Ÿ“Š Data๐ŸŸฃ Senior

Job description

Mysten Labs believes that decentralized and open protocols are the bedrock of the internet of value. This is why at Mysten Labs, we are creating foundational infrastructure to accelerate the adoption of decentralized protocols based on blockchain technologies.

The Data team is looking to hire a Staff Data Engineer to design and execute on the next iteration of our data systems. This is an exciting opportunity for someone who wants to design web3 analytics systems that run at web2 scale, reliability, and robustness. Interested candidates will have the opportunity to help define the new standards for blockchain analytics on top of the worldโ€™s premier object-centric blockchain.

This role requires a combination of high capacity hands-on individual contributor work and planning data architecture. As a Staff Data Engineer you will partner with the heads of Data and Engineering to effectively and smoothly process high-volume data in a reliable and robust way. You will get to touch all parts of the business at Mysten Labs and become the expert on data structures on the Sui blockchain.

Responsibilities:

  • Design and implement scalable ingestion pipelines with a reusable and modular framework

    • Build robust, reusable frameworks to ingest data from internal sources (e.g., Prod DBs, cloud buckets, etc) and external APIs or files (e.g., CSVs, webhooks).

    • Ensure idempotency, backfill support, and error handling in pipeline design.

  • Optimize and own data warehousing, with clear table definitions, schemas, cost efficiency

    • Architect a centralized data lake/warehouse with clear schemas and partitioning strategies.

    • Support both batch and streaming workloads, and optimize for cost and performance.

  • Enable data discoverability, usability, and governance

    • Implement or integrate data cataloging and lineage tools

    • Define naming conventions, documentation standards, and ownership metadata to make data self-serve and intuitive for data scientists, analysts, and product / GTM teams.

    • Set up a mechanism for scalable access controls (with RBAC or ABAC), PII tagging, and data obfuscation.

    • Enable approaches for data quality checks, validation pipelines, and alerting for broken or stale data

  • Develop a strong understanding of how to use on-chain and off-chain data together

Required Qualifications:

  • 5+ years experience in data engineering

  • Strong SQL and Python

  • Strong and informed opinions on data orchestrators, catalogs, governance, and testing frameworks

  • Experience combining in-house and external data

Preferred Qualifications:

  • Experience with, or interest in learning, Rust

  • Prior blockchain and cryptocurrency experience

  • Experience designing and implementing streaming data solutions

  • Experience or interest in security analytics and data for security teams

Employment is contingent upon the successful completion of a background check, which may include verification of employment history, education credentials, criminal history, and other relevant information.

Regarding the recent rash of technology job scams: Be aware that emails from genuine Mysten Labs group recruiters will always come from the @ mystenlabs.com domain or related subdomains (e.g., mystenlabs.com/careers ). Remember: you can always verify positions on our job boards at www.mystenlabs.com/careers .

Our team is remote first and we are hiring across the world. Here at Mysten Labs, youโ€™ll be joining a world-class team with tremendous growth potential as we bring the next billion users to web3. We raised a $300M Series B round from top Silicon Valley led venture funds like Jump Crypto, Andreessen Horowitz (a16z), Binance Labs, Redpoint, Lightspeed, Coinbase Ventures, Electric Capital, Standard Crypto, NFX, Slow Ventures, Scribble Ventures, Samsung Next, Lux Capital, among other investment firms and strategic partners. Come join us and build the future of web3!

Share this job:
Please let Mysten Labs know you found this job on Remote First Jobs ๐Ÿ™

Similar Remote Jobs

Benefits of using Remote First Jobs

Discover Hidden Jobs

Unique jobs you won't find on other job boards.

Advanced Filters

Filter by category, benefits, seniority, and more.

Priority Job Alerts

Get timely alerts for new job openings every day.

Manage Your Job Hunt

Save jobs you like and keep a simple list of your applications.

Search remote, work from home, 100% online jobs

We help you connect with top remote-first companies.

Search jobs

Hiring remote talent? Post a job

Frequently Asked Questions

What makes Remote First Jobs different from other job boards?

Unlike other job boards that only show jobs from companies that pay to post, we actively scan over 20,000 companies to find remote positions. This means you get access to thousands more jobs, including ones from companies that don't typically post on traditional job boards. Our platform is dedicated to fully remote positions, focusing on companies that have adopted remote work as their standard practice.

How often are new jobs added?

New jobs are constantly being added as our system checks company websites every day. We process thousands of jobs daily to ensure you have access to the most up-to-date remote job listings. Our algorithms scan over 20,000 different sources daily, adding jobs to the board the moment they appear.

Can I trust the job listings on Remote First Jobs?

Yes! We verify all job listings and companies to ensure they're legitimate. Our system automatically filters out spam, junk, and fake jobs to ensure you only see real remote opportunities.

Can I suggest companies to be added to your search?

Yes! We're always looking to expand our listings and appreciate suggestions from our community. If you know of companies offering remote positions that should be included in our search, please let us know. We actively work to increase our coverage of remote job opportunities.

How do I apply for jobs?

When you find a job you're interested in, simply click the 'Apply Now' button on the job listing. This will take you directly to the company's application page. We kindly ask you to mention that you found the position through Remote First Jobs when applying, as it helps us grow and improve our service ๐Ÿ™

Apply