We are seeking a talented and experienced WordPress Developer with expertise in web scraping to join our dynamic team. The ideal candidate will be responsible for developing and maintaining an automated system to extract car listing data from a target website and seamlessly import it into our WordPress-based platform.
Key Responsibilities:
- Design and implement a robust web scraping solution to extract comprehensive car listing data, including make, model, color, images, and other relevant details. - Develop a WordPress integration system to automatically import and update scraped data into our website. - Create a scheduling system to run the scraper at specified intervals (nightly or multiple times per day) and on-demand. - Implement logic to remove listings from the WordPress site when they are no longer available on the target site. - Ensure data integrity by preventing duplicate entries and maintaining data accuracy. - Optimize the scraping process for efficiency and scalability. - Troubleshoot and resolve any issues that arise during the scraping or import process.
### Required Skills and Qualifications:
- Proven experience in web scraping techniques and technologies (e.g., Python with BeautifulSoup, Scrapy, or Selenium). - Strong proficiency in WordPress development, including custom plugin creation and database management. - Excellent knowledge of PHP, HTML, CSS, and JavaScript. - Experience with RESTful APIs and WordPress hooks. - Familiarity with scheduling tools like cron jobs for automated tasks. - Strong problem-solving skills and attention to detail. - Ability to work independently and as part of a team. - Excellent communication skills to collaborate with team members and stakeholders.
### Preferred Qualifications:
- Experience with image processing and handling in web scraping contexts. - Knowledge of ethical web scraping practices and legal considerations. - Familiarity with version control systems (e.g., Git). - Experience with performance optimization for large datasets.
### Project Requirements:
- Develop a scraper that can extract all relevant car listing data, including images. - Create a WordPress integration that automatically imports and updates scraped data. - Implement a scheduling system for regular scraping (nightly or multiple times daily). - Develop an on-demand scraping feature for immediate updates. - Ensure the system removes listings from WordPress when they're no longer on the target site. - Implement duplicate detection and prevention mechanisms. - Optimize the entire process for efficiency and scalability.
### Important Notes:
- This is a long-term project with the opportunity to work with a UK-based company. - **Generic applications will not be considered.** Please tailor your application to this specific role and demonstrate your relevant experience. - All shortlisted candidates **MUST** attend a video interview as part of the selection process.
If you're passionate about web development, have a knack for data extraction, and enjoy solving complex challenges, we'd love to hear from you. Join our team and help build an innovative solution that bridges web scraping with WordPress functionality!
To apply, please submit your tailored application highlighting your specific experience with web scraping and WordPress development, along with your availability for a video interview.
