I need web scraper written in ruby, Web Project

Assignment Help:

Project Description:

I need a web scraper written in ruby with the subsequent features:

*Must be run from the command line

*Must be written in Ruby

*Will work with Ubuntu 12.04 LTS

*Use well supported Gems

*Must be able to identify website to be scraped

*Age of pages to be scraped (every pages that i want to scrape have a date on them)

*Must scrape all TEXT (title and body of page) and output to JSON

*Must scrape all HTML and output to JSON

*Rate limiting

Skills required:

Ruby, Data Mining, Software Architecture, Web Scraping


Related Discussions:- I need web scraper written in ruby

Simple scenes modeling for oculus rift, Simple scenes modeling for Oculus R...

Simple scenes modeling for Oculus Rift Project Description: I am seeking simple scene modeling, with basic interaction with environment Looking for liable designer/modeler

Prepare bitcoin raffle, Prepare Bitcoin Raffle/Lottery Website Script Pr...

Prepare Bitcoin Raffle/Lottery Website Script Project Description: I want a Bitcoin raffle and lottery script to be made. Settings allow a custom ticket price, drawing times,

Html div tag, Html Div Tag Project Description: Yes hello we are seek...

Html Div Tag Project Description: Yes hello we are seeking a programmer that is looking to join our software house. The programmer must be able to do an example for us which

We need a web developer, We need a Web Developer We are Melbourne based ...

We need a Web Developer We are Melbourne based Design Agency specialising in Graphic & Web. Job Role Web Developer Remote Work Arrangement The UI/UX Developer will work

Looking for an smime consultant, Looking for an SMIME consultant to allow S...

Looking for an SMIME consultant to allow SMIME in a web application. LDAP and DNS hosted keys. Java programming background preferred but not mandatory Desired Skills Smime

I need help to recreate, Recreate, translate & simplify 2 static sites I...

Recreate, translate & simplify 2 static sites I want someone who can rebuild 2 sites- The new sites must be made in classic html & css, except for JavaScript we can't use php

Need redirect 301 script, Need redirect 301 script Project Description: ...

Need redirect 301 script Project Description: Want a little redirect 301 script... I need a 301 for being able to use meta title and description... Skills required are

Webdeveloper - ajax and php, webdeveloper , ajax, php Project Descriptio...

webdeveloper , ajax, php Project Description: We want a web developer, with hight performance on debugging for optimize software developed in ajax , with experience with face

Create app based on existing data for dog clothing sizes, Create App based ...

Create App based on existing data for dog clothing sizes We are an importer with wholesale customers. We would need you to create an app for our customers. For their web s

Change dbgrid fontstyle and colors on delphi xe2, Change DBGrid FontStyle/ ...

Change DBGrid FontStyle/ Colors on Delphi XE2+ Application Project Description: I want to Change DBGrid Colors/FontStyle on Delphi XE2+ application, so i want a code to do th

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd