I need web scraper written in ruby, Web Project

Assignment Help:

Project Description:

I need a web scraper written in ruby with the subsequent features:

*Must be run from the command line

*Must be written in Ruby

*Will work with Ubuntu 12.04 LTS

*Use well supported Gems

*Must be able to identify website to be scraped

*Age of pages to be scraped (every pages that i want to scrape have a date on them)

*Must scrape all TEXT (title and body of page) and output to JSON

*Must scrape all HTML and output to JSON

*Rate limiting

Skills required:

Ruby, Data Mining, Software Architecture, Web Scraping


Related Discussions:- I need web scraper written in ruby

Submit and revise an alcoholism training application, Submit and Revise an ...

Submit and Revise an alcoholism training application for approval to NYS office Project Description: Become familiar with old and new application requirements, revise, submit

Scraping a few websites, Scraping a few websites Project Description: ...

Scraping a few websites Project Description: Scraping data from several (simple) websites. Skills required: Web Scraping

Exchange server client with too many emails, Exchange Server Client with TO...

Exchange Server Client with TOO MANY emails Our CEO has many emails and after migration from google mail to office 365 exchange it has caused her macbook to be almost unusable i

Gravity forms set text confirmation for wordpress, Gravity Forms Set Text C...

Gravity Forms Set Text Confirmation I'm using Gravity forms on my WP site. What I want to do is this- A) In the form I have a drop down list with 3 options- 1) Longevit

Open erp training, Open erp training I will want open erp training onlin...

Open erp training I will want open erp training online with learning materials as well Skills required are ERP, PostgreSQL, Software Development, Python

Virtualization planning - design project, Project Description: Descripti...

Project Description: Description: Provide a active directory design for a medium size business (best practice) virtualized all server using xenserver. HA, redundancy, disaste

Twitter for cad, Twitter for CAD Project Description: Twitter applica...

Twitter for CAD Project Description: Twitter application GUI using twitter4j api that manages .dwg files. Code provided in java for data retrieval from twitter using hash tag

I want a xml api travel integration, I want a xml api travel integration ...

I want a xml api travel integration Project Description: 1) A complete wordpress theme for online travel booking management. 2) Some PHP pages with the same wordpress them

Cisco switch configuration, Project Description: I want someone to help ...

Project Description: I want someone to help me with the configuration for a cisco switch 24 ports - 2950 . This is just a very small job but is significant to get in contact

Xml file, I am preparing XML file/ DTD/XSLT Project Description: -Pre...

I am preparing XML file/ DTD/XSLT Project Description: -Prepare a Well-Formed XML File. - Prepare a DTD. -Use XSLT to Format Data. - Prepare your own XML file/DTD/XS

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd