Job description
We are looking for a detail-oriented and technically proficient Social Media Data Crawler to design and manage tools that automate data extraction from social media platforms such as LinkedIn, Facebook, X (formerly Twitter), Instagram, and others. The ideal candidate will have strong skills in web scraping, data analysis, and working with social media APIs. This role is vital for providing valuable data insights to support our marketing, research, and analytics teams.
Develop and maintain automated scripts and tools for extracting data from social media platforms, including LinkedIn, Facebook, X, Instagram, and more.
Ensure compliance with the terms of service and privacy policies of each platform.
Continuously monitor and troubleshoot crawling systems to ensure consistent, accurate data collection.
Analyze collected data to identify key trends, insights, and patterns aligned with business goals.
Work closely with data scientists, marketing, and research teams to deliver relevant data for their initiatives.
Optimize crawling systems for performance, scalability, and adaptability to platform changes.
Stay up-to-date with changes in social media platforms and APIs to adjust crawling strategies as needed.
Bachelor’s degree in Computer Science, Information Technology, or a related field.
Proven experience in web crawling, scraping, or data extraction from social media.
Proficiency in programming languages such as Python, Java, or similar.
Familiarity with social media APIs (e.g., LinkedIn API, Facebook Graph API, Twitter API, Instagram API).
Strong understanding of HTML, CSS, and JavaScript.
Knowledge of data privacy laws and ethical considerations related to data scraping.
Excellent problem-solving skills with keen attention to detail.
Ability to work independently and collaboratively within a team.
Preferred Skills:
- Experience with big data technologies such as Hadoop or Spark.
- Familiarity with data visualization and reporting tools.
- Understanding of natural language processing (NLP) techniques.
System Requirements
- At least 15mbps for the main internet and at least 10mbps for backup
- A desktop or laptop that has an i5 processor with at least 8 GB RAM and an i3 processor for backup
- Note: Back-ups should still be able to function when there is a power interruption
- A webcam
- Noise-canceling USB Headset
- Quiet, Dedicated Home Office
- Smartphone
Join Our Dynamic Team: Experience our fun, inclusive, innovative culture that values your unique contributions and supports your professional growth.
Embrace the Opportunities: Seize daily chances to learn, innovate, and excel. Make a real impact in your field.
Limitless Career Growth: Unlock a world of possibilities and resources to propel your career forward.
Fast-Paced Thrills: Thrive in a high-energy, engaging atmosphere. Embrace challenges and reap stimulating rewards.
Flexibility, Your Way: Embrace the freedom to work from home or any location of your choice. Create your ideal work environment.
Work-Life Balance at Its Best: Say goodbye to stressful commutes and hello to quality time with loved ones. Achieve a healthy work-life integration to perform at your best.
