I need web scraper written in ruby, Web Project

Assignment Help:

Project Description:

I need a web scraper written in ruby with the subsequent features:

*Must be run from the command line

*Must be written in Ruby

*Will work with Ubuntu 12.04 LTS

*Use well supported Gems

*Must be able to identify website to be scraped

*Age of pages to be scraped (every pages that i want to scrape have a date on them)

*Must scrape all TEXT (title and body of page) and output to JSON

*Must scrape all HTML and output to JSON

*Rate limiting

Skills required:

Ruby, Data Mining, Software Architecture, Web Scraping


Related Discussions:- I need web scraper written in ruby

Prepare a form with backend database for our website, Prepare a form with b...

Prepare a form with backend database for our website Project Description: We want to integrate a form that will request users on our website to fill in that form and these da

Need google play account, Need Google play account? Requirements: - m...

Need Google play account? Requirements: - must be prepared with separate credit card - account must be from either of these countries preferably Netherlands: Ireland Au

I need backup setup on host, Project Description: This is a very easy Jo...

Project Description: This is a very easy Job: I have a backup of a site and need to install it on my Hostgator Account. Skills required and MySQL, Website Management, Web

Prepare bitcoin raffle, Prepare Bitcoin Raffle/Lottery Website Script Pr...

Prepare Bitcoin Raffle/Lottery Website Script Project Description: I want a Bitcoin raffle and lottery script to be made. Settings allow a custom ticket price, drawing times,

College, how to design web pages with html, css,javascript

how to design web pages with html, css,javascript

Setting up ubuntu server security and softwares, Setting up Ubuntu server s...

Setting up Ubuntu server security and softwares Project Description: I am seeking linux expert who can set up our first business 2 servers (1TB drive and 16GB ram) We alre

Looking for mobile developer to build apps, I am looking for a team or mobi...

I am looking for a team or mobile developer to build highly engaging, personalized experiences for our mobile users. Responsibilities Scalable mobile applications, Build high

Mobile app/facbook integration/ website with shared database, Mobile app/Fa...

Mobile app/Facbook integration/ website with shared database and location. We are a startup entertainment/music company looking to get started in the mobile app business. We are

Need website hacking security test, Need Website hacking security test P...

Need Website hacking security test Project Description:                            We have a website; we want to test the security of our website. You need to: -Try to

Need c++ multiplayer game programming project, Need C++ Multiplayer Game Pr...

Need C++ Multiplayer Game Programming Project Project Description: We are seeking an experienced C++ Game Programmer to improve clientside related aspects of MCS: Mars City S

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd