Job Description
Lead Data Engineer
Important Information
Experience:Â more than 6 years
Job Mode:Â Full-time
Work Mode:Â Hybrid
Job Summary
Lead the design, development and optimization of scalable data pipelines and cloud-based data platforms.
Lead end-to-end data engineering initiatives leveraging Snowflake, Python and modern cloud platforms to build reliable and scalable data solutions.
Provide technical leadership within the Data Engineering team and ensure best practices across architecture, development, testing and deployment.
Responsibilities and Duties
Design, build and maintain scalable data pipelines and cloud-native analytics solutions using Snowflake and Azure services.
Develop and optimize data ingestion, transformation and processing workflows using Python and SQL.
Work with business stakeholders to understand high-value problems and translate them into data engineering tasks.
Partner with data scientists and analysts to ensure data availability, quality and usability.
Conduct code reviews and enforce engineering standards to maintain high-quality deliverables.
Monitor and improve the performance, reliability and cost efficiency of data systems.
Prototype data solutions and progress them from proof-of-concept to production.
Ensure effective collaboration across agile ceremonies, including planning, backlog refinement and feature workshops.
Qualifications and Skills
Bachelor’s/Master’s degree in Computer Science, Information Technology, or a related field.
6+ years of hands-on experience in data engineering, with exposure to cloud-based data solutions.
Strong proficiency in Python and SQL, including advanced development for ETL/ELT workloads.
Proven experience with Snowflake and cloud platforms, preferably Azure.
In-depth understanding of data modeling, structured and unstructured data, data quality and distributed data processing.
Ability to contribute to all stages of the solution lifecycle: design, infrastructure, development, testing, deployment and maintenance.
Solid understanding of cloud-native engineering principles and modern data architecture practices.
Excellent communication, collaboration and presentation skills for engaging with both technical and non-technical stakeholders.
Role-specific Requirements
Experience with modern data stack components, orchestration and CI/CD pipelines.
Experience working in agile environments and participating in collaborative engineering rituals.
Demonstrated ability to mentor, guide and influence engineering team members.
Technologies
Must have:Â Snowflake, Python, SQL, experience with modern cloud platforms
Nice to have:Â dbt, Apache Airflow, Prefect, CI/CD tools, automated testing frameworks
Skillset Competencies
Designing and maintaining scalable cloud-based data architectures
Building and optimizing ELT/ETL pipelines
Performance tuning for large-scale data processing
Orchestrating pipelines using modern workflow tools
Effective collaboration within international and virtual team environments
About Encora
Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services, Product Engineering & Application Modernization, Data & Analytics, Digital Experience & Design Services, DevSecOps, Cybersecurity, Quality Engineering, AI & LLM Engineering, among others.
At Encora, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
