I need web scraper written in ruby, Web Project

Assignment Help:

Project Description:

I need a web scraper written in ruby with the subsequent features:

*Must be run from the command line

*Must be written in Ruby

*Will work with Ubuntu 12.04 LTS

*Use well supported Gems

*Must be able to identify website to be scraped

*Age of pages to be scraped (every pages that i want to scrape have a date on them)

*Must scrape all TEXT (title and body of page) and output to JSON

*Must scrape all HTML and output to JSON

*Rate limiting

Skills required:

Ruby, Data Mining, Software Architecture, Web Scraping


Related Discussions:- I need web scraper written in ruby

Prepare a simple crm project, Prepare a Simple CRM Project Project Descr...

Prepare a Simple CRM Project Project Description: I'm seeking a programmer to do a simple CRM custom for my needs. The libraries that should be used need to be open gpl or so

Need to rebuild server environment, Need to rebuild server environment P...

Need to rebuild server environment Project Description: We develop and operate Smartphone application.(social networking and Picture sharing) But there are problems in ser

Provide me vmware technical support, Provide me VMware Technical Support ...

Provide me VMware Technical Support Project Description: Urgent Project for VMware Technical support. VMWare ESXi 5.1 support for up gradation and migration problem. Te

I want support augmented reality app like layar/junaio, I want support Augm...

I want support Augmented Reality App like Layar/Junaio to display locations from XML Feed I am looking for a developer to build an App for iOS (iPhone/iPad) and Android that pro

Set or get settings from windows 8.1 mail app, You bet for prepare an Appli...

You bet for prepare an Application, written in vb.net or c# (Visual Studio 2010 or higher) that read and write the Settings from Windows 8.1 MAIL Application. Decencies should be j

Need a mobile apps game online builder, Mobile Apps Game Online Builder ...

Mobile Apps Game Online Builder We need a team or company who experienced in develop web application. We want a mobile apps game online builder. In this mobile game apps o

Create a dictionary using vb and microsoft access, Create a dictionary usin...

Create a dictionary using VB and Microsoft access A simple dictionary that contain video in it. The dictionary can be created using VB and database is stored in Microsoft access

Prepare a mobile app backend architecture document, Architecture documentat...

Architecture documentation required to meet some of the subsequent requirements: 1. shows the complete architecture of the system and the data flow diagram in Fig. 2. shows t

Construct a linux virtual machine to host the files, We have buy a new serv...

We have buy a new server. We would like to set it up and add our data to the new server. The job will be Build the new server with virtual server for DNS, file exchange and sharing

Exchange server client with too many emails, Exchange Server Client with TO...

Exchange Server Client with TOO MANY emails Our CEO has many emails and after migration from google mail to office 365 exchange it has caused her macbook to be almost unusable i

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd