Job description
Job Title: Senior Data Engineer (Hybrid)
Location: Durham, NC
Duration: 12 Month
Job Description:
The client is seeking a Senior Data Engineer to lead the development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics, ensuring data accessibility, performance, and security for the Child Welfare Program.
The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Senior Synapse Data Engineer. The primary purpose of this position is to lead the development and optimization of our data pipelines, analytics solutions, and cloud-based data platforms. This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.
Key Responsibilities:
Synapse
- Design, Develop and maintain data models in Synapse to support reporting and analytics
- Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
- Analyze the source system and design the ETL data load.
- Ability to create and configure Azure Synapse Analytics workspace.
- Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform and Load data from different sources like SalesForce.
- Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
Power BI Tools
- Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.
Skills:
SkillRequired/DesiredAmountof ExperienceExperience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflowsRequired5YearsProgramming Languages: Strong proficiency in Python or Scala for data processing.Required3YearsSQL Mastery: Advanced query writing, performance tuning, and optimization.Required7YearsExperience with Data Modeling and Warehousing (star schema, snowflake schema)Required4YearsExperience with ETL/ELT processesRequired5YearsExperience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database)Highly desired4YearsFamiliarity with Event Hubs, Azure Stream Analytics, and Azure FunctionsDesired4YearsExperience with Programming and Scripting (SQL, T-SQL, and data query optimization)Desired1YearsExperience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storageDesired5YearsExperience with Power BINice to have1Years
