Summary
The job is for a Senior Data Engineer at GridMatrix, a fast-growing startup specializing in digital infrastructure for cities. The role involves optimizing data pipeline and cloud infrastructure, with responsibilities including customer deployments, managing architecture for cost and performance, building pipelines for machine learning and analytics, and measuring the impact of new features.
Requirements
- AWS/enterprise cloud experience
- Experience with container orchestration technologies such as AWS EKS and Kubernetes
- Demonstrated experience with cost optimization for AWS EC2 and other AWS services
- Experience architecting and engineering streaming pipelines with AWS Kinesis/Kafka
- Experience architecting/engineering data pipelines with AWS Glue, EMR, Spark, Athena and/or Redshift
- Experience engineering MLOps pipelines with AWS Sagemaker
- Experience working with combined edge and cloud compute architectures
- Experience with CI/CD, and version control systems
- Experience building out monitoring and alerts using AWS Cloudwatch
- Experience provisioning IAM roles and security groups
- Experience provisioning VPC and subnets
- Experience with Terraform or Ansible, or working with AWS Cloudformation templates
- Working knowledge of Agile methodologies
- Proven track record of successfully handling large and complex projects with multiple working groups
- Experience defining and documenting best practices and strategies regarding application deployment and infrastructure maintenance
- Experience providing guidance, thought leadership, and mentorship to developer teams to build their competencies
Responsibilities
- Customer deployments
- Managing architecture for cost and performance
- Building pipelines for machine learning and analytics
- Measuring the impact of new features
Preferred Qualifications
- MS in mathematics, operations research computer science, engineering, data science, or equivalent work experience
- AWS Certified DevOps Engineer – Professional
Benefits
- Unlimited PTO
- 401K matching
- Medical, dental, vision, life insurance
