We are looking for an experienced ruby developer to help us build and maintain a suite of web scrapers. The project will initially be to build a few scrapers as a test, if the project is a success this will become an ongoing project.
We have a Ruby on Rails application that has a growing number of custom website scrapers for scraping news items from various media release index/show pages and turning them into RSS feeds.
There is an established process for adding scrapers to the app using mechanize, vcr and rspec. For more complex sites we may need to add new types of scrapers using puppeteer.
We use Github to manage tickets, perform code reviews and deploy scrapers to production.
Required Skills
- Ruby on Rails
- Mechanize
- Puppeteer
- Web Scraping
- Proxies
Hourly Range: $17.00-$25.00
Posted On: August 25, 2021 00:25 UTC Category: Scripting & Automation Skills:Ruby, Web Scraper, Data Scraping, Ruby on Rails
Skills: Ruby, Web Scraper, Data Scraping, Ruby on Rails Country: Australia