Company Overview

Our client is a key player in the fast-paced and ever-evolving B2B commerce sector, committed to enhancing user experience by delivering seamless services that exceed customer expectations. Their data management team currently handles data integration for over 100 major FMCG companies across Southeast Asia.

Key Responsibilities:

• Design, develop, and maintain scalable web scraping and data extraction systems.
• Implement efficient ETL processes to integrate scraped data into internal systems.
• Monitor and optimize the performance of web crawlers to ensure reliability and accuracy.
• Troubleshoot and resolve errors in the scraping and data integration processes.
• Ensure compliance with web standards, protocols, and ethical scraping practices.
• Collaborate with cross-functional teams to align data initiatives with business goals.
• Continuously improve scraping techniques and stay updated with the latest web crawling technologies.
• Manage system administration tasks related to data pipelines and server monitoring.

Key requirements:

• Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent practical experience.
• Strong proficiency in Selenium and ETL processes.
• Hands-on experience with large-scale web scraping projects.
• Solid understanding of Linux/UNIX, HTTP protocols, HTML, JavaScript, and networking fundamentals.
• Experience with web crawling and data extraction tools.
• Familiarity with system monitoring and server administration tools.
• Experience with Pentaho (or other ETL platforms) is an added advantage.
• Strong problem-solving skills, attention to detail, and the ability to work independently and collaboratively.