I need web scraper written in ruby, Web Project

Assignment Help:

Project Description:

I need a web scraper written in ruby with the subsequent features:

*Must be run from the command line

*Must be written in Ruby

*Will work with Ubuntu 12.04 LTS

*Use well supported Gems

*Must be able to identify website to be scraped

*Age of pages to be scraped (every pages that i want to scrape have a date on them)

*Must scrape all TEXT (title and body of page) and output to JSON

*Must scrape all HTML and output to JSON

*Rate limiting

Skills required:

Ruby, Data Mining, Software Architecture, Web Scraping


Related Discussions:- I need web scraper written in ruby

Engineering foss-cloud (on a gentoo kvm qemu environment, Engineering FOSS-...

Engineering FOSS-Cloud (on a gentoo KVM QEMU environment Project Description: The Project: The FOSS-Cloud is Software, which allows you, to build virtualization- and cloud

Dedicated email server and software, I want Email Marketing Server for Emai...

I want Email Marketing Server for Email Blasting, price based on a month by month plan but fixed for 12 months 1) You must give me demo account with id and password to test 30 i

Xml file, I am preparing XML file/ DTD/XSLT Project Description: -Pre...

I am preparing XML file/ DTD/XSLT Project Description: -Prepare a Well-Formed XML File. - Prepare a DTD. -Use XSLT to Format Data. - Prepare your own XML file/DTD/XS

Need poker room auto seat program, Need Poker Room auto seat program Pro...

Need Poker Room auto seat program Project Description: I want a script for an online poker site. It requires to be scanning all the available tables and when the table meets

I need help in klout and twitter api, I need help in Klout and Twitter API ...

I need help in Klout and Twitter API I am seeking to gather data for about 1000 twitter accounts and their followers as well as then get the klout scores of those people for a r

Prepare a form with backend database for our website, Prepare a form with b...

Prepare a form with backend database for our website Project Description: We want to integrate a form that will request users on our website to fill in that form and these da

Help in ruby on rails developer: simple framework, Help in Ruby on Rails De...

Help in Ruby on Rails Developer: Simple Framework for Landing Pages We want an experienced Ruby on Rails programmer to create a simple framework for editing landing pages based

Need an e commerce script for wemens dress website, Need an e commerce scri...

Need an e commerce script for Wemen's Dress Website Project Description: I am looking for an e commerce script for a women's dress website. I want to be able to edit most con

Develop a financial spreading software, Am looking to develop a financial s...

Am looking to develop a financial spreading software and need assistance in the planning stages and logistics of the essential resources needed to complete this job. Looking for so

Completion of a training portal built in drupal 7.23, Completion of a train...

Completion of a training portal built in Drupal 7.23 Project Description: We have launched and prepared a password-protected training portal website on Drupal 7.23. The si

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd