Job description
Important Information
Experience: +6 years
Job Mode: Full-time
Work Mode: Work from home
Job Summary
We are looking for a Data Engineer who has experience with data pipelines, real-time APIs, and scalable cloud infrastructure. In this role, you will work with technologies like Kotlin, Kafka/Pulsar, Azure, and Kubernetes to build reliable, high-throughput systems for data movement and access.
Responsibilities and Duties
- Design, build, and maintain ELT pipelines in Kotlin and Python that ingest and transform data from real-time sources like Kafka and Pulsar.
- Develop and maintain high-performance APIs to serve real-time data from databases, services, and caches.
- Collaborate with internal users and microservice consumers to ensure reliable access to up-to-date data.
- Architect and implement scalable solutions to handle growing traffic and data volume across services.
- Work with Azure cloud services, including Databricks, for data processing and analytics.
- Manage containerized workloads using Kubernetes, with a focus on high availability and auto-scaling.
- Participate in CI/CD, observability, and performance tuning across the platform.
Qualifications and Skills
- 4+ years of experience building ELT or streaming data pipelines.
- Strong Kotlin, Python development skills (or experience with JVM languages and willingness to learn Kotlin).
- Deep understanding of distributed systems and real-time data processing.
- Proven experience with microservices architecture and API development.
- Solid understanding of Kubernetes concepts: pods, services, autoscaling, Helm charts, etc.
- Cloud deployment experience, ideally on Azure with exposure to Databricks or similar platforms.
- Excellent communication skills and user-first mindset.
Tech Stack
- Languages: Kotlin, Python, SQL/Oracle
- Data Pipelines: Kafka, Pulsar
- APIs: REST
- Cloud: Azure (preferred), Databricks
- Deployment: Kubernetes, Helm, Docker
About Encora
Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services, Product Engineering & Application Modernization, Data & Analytics, Digital Experience & Design Services, DevSecOps, Cybersecurity, Quality Engineering, AI & LLM Engineering, among others.
At Encora, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
