Job description
Important Information
Location: Brazil
Job Mode: Full-time
Work Mode: Work from home
Job Summary
We are looking for a Data Engineer who has experience with data pipelines, real-time APIs, and scalable cloud infrastructure. In this role, you will work with technologies like Kotlin, Kafka/Pulsar, Azure, and Kubernetes to build reliable, high-throughput systems for data movement and access.
Responsibilities and Duties
- Design, build, and maintain ELT pipelines in Kotlin and Python that ingest and transform data from real-time sources like Kafka and Pulsar;
- Develop and maintain high-performance APIs to serve real-time data from databases, services, and caches;
- Collaborate with internal users and microservice consumers to ensure reliable access to up-to-date data;
- Architect and implement scalable solutions to handle growing traffic and data volume across services;
- Work with Azure cloud services, including Databricks, for data processing and analytics;
- Manage containerized workloads using Kubernetes, with a focus on high availability and auto-scaling;
- Participate in CI/CD, observability, and performance tuning across the platform.
Essential Skills
- Experience building ELT or streaming data pipelines;
- Strong Kotlin, Python development skills (or experience with JVM languages and willingness to learn Kotlin);
- Deep understanding of distributed systems and real-time data processing;
- Proven experience with microservices architecture and API development;
- Solid understanding of Kubernetes concepts: pods, services, autoscaling, Helm charts, etc;
- Cloud deployment experience, ideally on Azure with exposure to Databricks or similar platforms;
- Experience with Typescript is a plus.
About Encora
Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.
At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.