Senior Chaos Engineer

at Goodnotes
🇨🇳 China - Remote
🔧 DevOps🟣 Senior

Job description

At Goodnotes, we believe that every individual holds untapped potential waiting to be unleashed. By reimagining the way we interact with information, we’re merging human creativity with the breakthrough capabilities of AI. Our renewed vision and mission drive us to create the best medium for human and AI collaboration, empowering users to explore new dimensions of productivity, creativity, and learning. Join us on this journey as we transform digital note-taking into an inspiring and innovative experience.

Our Values:

Dream big

—Be visionary, strategic, and open to innovation

Build great things

—Work in service of our users, always improving and pushing higher

Take ownership

—Take responsibility with bold decision-making and bias for action

Win like a sports team

—Be trusting and collaborative while empowering others

Learn and grow fast

—Never stop learning and iterate fast

Share our passion

—Share ideas and practice enthusiasm and joy

Be user obsessed

—Empathetic, inquisitive, practical

Do you love breaking things on purpose?

At Goodnotes, we’re building a world-class digital productivity platform used by millions globally — and we’re serious about scaling with resilience. That’s why we’re hiring our first Chaos Engineer to lead the charge in uncovering weaknesses before they become incidents.

This is a rare opportunity to define a chaos engineering program from scratch. You’ll work across all layers of our system to design controlled, creative failure scenarios — from network blackholes to gremlins and zombie services — and help build a culture of reliability through experimentation and learning.

What You’ll Be Doing

  • Define the chaos engineering strategy at Goodnotes, including tools, safety practices, and long-term roadmap.
  • Design and run fault injection experiments across mobile and backend systems, targeting failure points in user flows, APIs, and infrastructure components.to surface hidden risks.
  • Simulate real-world issues like latency spikes, dependency outages, cascading failures, and resource exhaustion.
  • Build and scale tooling for automating experiments, tracking outcomes, and improving observability.
  • Establish clear guardrails and blast radius controls to ensure experiments are safe, measured, and reversible.
  • Collaborate across engineering teams to identify critical flows, formulate hypotheses, and stress-test assumptions.
  • Facilitate resilience drills and chaos game days, driving cross-team engagement and response readiness.
  • Document findings, communicate insights, translate chaos learnings into actionable improvements, and influence our engineering teams to enact recommended changes
  • Help shape the future of the chaos engineering function — including mentoring and hiring as the team grows.

Who You Are

  • Proven experience with chaos engineering or fault injection, ideally in distributed, production-scale environments.
  • Comfortable with iOS platforms, mobile networking, and understanding how client-side failures impact backend systems. Strong experience with Swift programming.
  • Strong understanding of resilience patterns (e.g., circuit breakers, bulkheads, timeouts, retries) and system failure modes.
  • Prior involvement in incident postmortems, war games, or reliability reviews.
  • Comfortable building tools or scripts to automate chaos experiments and analyse system behavior under stress.
  • With your scientific mindset, you love forming hypotheses, testing limits, and uncovering how systems really behave at the edge.
  • You’re excited to build a program from scratch, not just join one.

Even if you don’t meet all the criteria listed above, we would still love to hear from you! Goodnotes places a lot of value on learning and development and will support your growth if needed.

The interview process:

  • Introduction: The Talent Team want to hear more about your background, what you are looking for, and why you’d like to join Goodnotes.
  • Technical screening: A timed online coding skills test.
  • Live coding & Technical interview: A live coding call with one of our engineers. This is where you get to see what it would be like working at Goodnotes as well as the chance to ask any engineering questions you may have
  • Hiring Manager interview: A call with your hiring manager. This is the person who will be managing you day to day, working on your growth and development with you as well as support you throughout your career at Goodnotes.
  • Passion presentation: A short presentation on something you are passionate about or are proud of

What’s in it for you:

  • Remote friendly
  • Flexible working hours and location
  • Medical insurance for you and your dependents
  • Great annual leave allowance
  • Meaningful equity in a profitable tech-startup
  • Budget for things like noise cancelling headphones, setting up your home office, personal development, professional training, and health & wellness
  • Sponsored visits to our Hong Kong or London office every 2 years
  • Company wide annual offsite
  • Fantastic maternity/ paternity packages and and allowances

Note: Employment is contingent upon successful completion of background checks, including verification of employment, education, and criminal records.

By submitting your application, you acknowledge that you have read and understood our Candidate Privacy Notice, which provides important information about the data we collect during the application process. You can find it here.

Share this job:
Please let Goodnotes know you found this job on Remote First Jobs 🙏

Similar Remote Jobs

Benefits of using Remote First Jobs

Discover Hidden Jobs

Unique jobs you won't find on other job boards.

Advanced Filters

Filter by category, benefits, seniority, and more.

Priority Job Alerts

Get timely alerts for new job openings every day.

Manage Your Job Hunt

Save jobs you like and keep a simple list of your applications.

Search remote, work from home, 100% online jobs

We help you connect with top remote-first companies.

Search jobs

Hiring remote talent? Post a job

Frequently Asked Questions

What makes Remote First Jobs different from other job boards?

Unlike other job boards that only show jobs from companies that pay to post, we actively scan over 20,000 companies to find remote positions. This means you get access to thousands more jobs, including ones from companies that don't typically post on traditional job boards. Our platform is dedicated to fully remote positions, focusing on companies that have adopted remote work as their standard practice.

How often are new jobs added?

New jobs are constantly being added as our system checks company websites every day. We process thousands of jobs daily to ensure you have access to the most up-to-date remote job listings. Our algorithms scan over 20,000 different sources daily, adding jobs to the board the moment they appear.

Can I trust the job listings on Remote First Jobs?

Yes! We verify all job listings and companies to ensure they're legitimate. Our system automatically filters out spam, junk, and fake jobs to ensure you only see real remote opportunities.

Can I suggest companies to be added to your search?

Yes! We're always looking to expand our listings and appreciate suggestions from our community. If you know of companies offering remote positions that should be included in our search, please let us know. We actively work to increase our coverage of remote job opportunities.

How do I apply for jobs?

When you find a job you're interested in, simply click the 'Apply Now' button on the job listing. This will take you directly to the company's application page. We kindly ask you to mention that you found the position through Remote First Jobs when applying, as it helps us grow and improve our service 🙏

Apply