Job description
Overview
Topography Health is seeking a highly skilled and patient-focused Senior Data Engineer to join our dynamic team. In this pivotal role, you will be responsible for building and optimizing big data pipelines, architectures, and data sets that drive our mission to improve patient outcomes through innovative clinical research. A key focus of this role is integrating Electronic Health Records (EHR) using FHIR standards and APIs across various systems. You will leverage your expertise to enhance our existing integrations—without the need to build from scratch—facilitating seamless data flow and contributing to improved patient recruitment and data-driven decision-making in clinical trials.
As a Senior Data Engineer, you will collaborate closely with cross-functional teams—including Data Science, Product, Software Engineering, Clinical Operations, and Business Operations—to ensure robust and efficient data pipelines that are compliant with HIPAA regulations. Your experience with data pipelining, SQL, Snowflake, and familiarity with tools like Airflow and Metabase will be essential. You will foster a collaborative environment, and contribute to scaling our data infrastructure. This role is more than just technical execution; it’s an opportunity to make a significant impact on patient care and clinical research.
Key Responsibilities:
Implement and optimize integrations with Electronic Health Records (EHR) using FHIR standards and APIs.
Enhance and maintain existing EHR integrations in an EMR/EHR agnostic environment without building from scratch.
Build and optimize scalable data pipelines and architectures for extracting, transforming, and loading (ETL) data from various sources.
Ensure data pipelines are robust, efficient, and compliant with HIPAA regulations.
Perform data exploration to understand data patterns and anomalies.
Debug and resolve issues related to data inconsistencies and pipeline failures.
Work closely with Data Scientists, Software Engineers, Product Managers, and end-users such as Clinical Research Coordinators (CRCs) and Engagement Managers.
Understand and translate business requirements into technical solutions.
Participate in building and auditing our data infrastructure, including data warehouses and reporting stacks.
Utilize modern data tools like SQL, Snowflake, and Metabase; familiarity with Airflow is a plus.
Implement best practices for data security and compliance, focusing on HIPAA requirements.
Proactively identify and address security vulnerabilities within data pipelines.
Provide guidance and mentorship to junior data engineers as the team grows.
Foster a collaborative and knowledge-sharing environment.
Proactively suggest improvements to existing data processes and infrastructure.
Implement data solutions in a cost-effective manner, optimizing for performance and resource utilization.
Minimum Qualifications:
6+ years of professional work experience in healthcare data engineering
4+ years of experience with Airflow or other orchestration tool (Dagster or Prefect)
3+ years of experience with relational databases and SQL
3+ years of experience with cloud-based infrastructure
3+ years programming proficiency in Python.
3+ years of experience with any type of SQL databases
3+ years of experience with HIPAA compliance
Preferred Qualifications:
Experience with PySpark
Experience with EHR integrations using FHIR standards and APIs
Experience with Snowflake experience
Experience with Metabase
Located in NYC, NY/Madison, WI/Los Angeles, CA/Nashville, TN/San Francisco, CA
