Job Description
Description
A Tunga client is seeking a technical developer to design and maintain reliable web scraping and data pipelines. You’ll extract data from JavaScript-rendered web pages, store and model it for time-series use cases, and run production-grade workflows with strong monitoring and deployment practices.
Requirements
Key Responsibilities
Build and maintain scrapers for dynamic (JavaScript-rendered) websites
Design and manage data storage for time-series workloads (PostgreSQL, QuestDB)
Orchestrate and schedule pipelines using Airflow (retries, backfills, SLAs)
Automate deployments and infrastructure tasks with Ansible on Linux servers
Implement monitoring/observability with Prometheus and Grafana
Write maintainable, testable code and collaborate on improvements to pipeline reliability and performance
Requirements
Strong experience with web scraping, including JS-rendered pages
PostgreSQL + time-series data handling; QuestDB experience is a plus
Airflow for pipeline orchestration
Ansible, Linux system administration, and Bash scripting
Monitoring with Prometheus + Grafana
Proficient in Python and JavaScript; basic Golang (or ability to collaborate in Go)
Nice to have:
Data warehousing/analytics foundations and applied data science exposure
Experience with TikTok Shop and/or TikTok/social platform APIs*
