Job description
About Us:
At Zyte, we eat data for breakfast and you can eat your breakfast anywhere and work for Zyte. Founded in 2010, we are a globally distributed team of over 250 Zytans working from over 28 countries who are on a mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all businesses deserve a smooth pathway to data.
For over a decade, Zyte has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. And today, the data we extract helps thousands of organizations make smarter business decisions, secure competitive advantage, and drive sustainable growth. Today, over 3,000 companies and 1 million developers rely on our tools and services to get the data they need from the web.
About the role:
You would be involved in developing our recently released SaaS offering - Zyte API, which provides a single ML-powered API to power all web data extraction use cases.. Zyte API is a distributed application written in Java, C++, Python and Nodejs components communicating via HTTP, web sockets and Apache Kafka, and orchestrated using Kubernetes.
Roles & Responsibilities:
Work on the core platform that will improve and scale the platform to achieve 100k QPS and beyond. .
Develop and troubleshoot distributed applications, write and change components implemented in Java, Scala and Nodejs and manage concerns such as scalability, transparency, failure handling, security and multi-tenancy.
Work on new features, including requirements gathering, design and implementation. You should be able to own and be responsible for the complete lifecycle of your features and code.
5+ years of experience building large scale data processing systems or high load services
Strong background in algorithms and data structures.
Strong track record in Java with 3+ years of experience.
Knowledge of networking protocols and network programming.
Strong knowledge of any event-driven (Event loop, future and reactor patterns) framework.
Strong knowledge of at least one RDBMS.
Experience working with Linux and Docker.
Good communication skills in English.
Experience of collaboration in a remote-first team.
Computer Science, other engineering degree or equivalent working experience
Bonus points for:
- Kubernetes experience
- Experience in Netty and/or Vert.x
- Knowledge of JNI
- Strong foundational understanding of functional programming paradigm and 2+ years of experience working in Erlang, Scala or Haskell.
- Experience with service chassis and template-based approaches for building and scaling services.
- Apache Kafka experience
- Understanding of web browser internals
- Knowledge of today’s cloud provider offerings: GCP, AWS, OCI etc.
- Web data extraction experience: web crawling, web scraping.
- History of open source contributions
As a new Zytan, you will:
Become part of a self-motivated, progressive, multicultural team.
Have the freedom and flexibility to work from where you do your best work.
Attend conferences and meet with team members from across the globe.
Work with cutting-edge open-source technologies and tools.
