Job description
About the Role:
Location: Remote
Timings: Full Time (As per company timings)
Notice Period: (Immediate Joiner - Only)
Experience: 3-6 Years
JD:
The role will leverage & enhance existing technologies in the area of Data and analytics Solutions like Power BI, Azure data engineering technologies, Teradata/Snowflake, and other Azure services.
The role will be responsible for developing and supporting IT products and solutions using these technologies and deploying them for business users
Technical Requirements:
- 3 to 6 Years of IT & Azure Data engineering technologies experience
- Prior experience in ETL, data pipelines, and data flow techniques using Azure Data Services
- Working experience in Python, Py Spark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse, and file formats like JSON & Parquet.
- Experience in creating ADF Pipelines to source and process data sets.
- Experience in creating Databricks notebooks to cleanse, transform, and enrich data sets.
- Development experience in the orchestration of pipelines
- Good understanding of SQL, Databases, and data warehouse systems, preferably Teradata
- Experience in deployment and monitoring techniques
- Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources.
- Experience in handling operations/Integration with source repository
- Must have good knowledge of Data Warehouse concepts and Data Warehouse modelling.
- Working knowledge of SNO, M, S, including resolving incidents, handling Change requests /Service requests, and reporting on metrics to provide insights.
- Collaborate with the project team to understand tasks to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data.
Non-technical requirement:
- Work with project leaders to model tables using data warehouse best practices and develop data pipelines to ensure the efficient delivery of data.
- Think and work agile, from estimation to development, including testing, continuous integration, and deployment.
- Manage numerous project tasks concurrently and strategically, prioritizing when necessary.
- Proven ability to work as part of a virtual team of technical consultants working from different locations (including onsite) around project delivery goals.
Technologies:
- Azure data factory
- Azure Data bricks
- Azure Synapse
- PySpark/SQL
- ADLS, BLOB
- Azure DevOps with CI/CD implementation.
