Need help in file search engine crawler, PHP Web Programming

Assignment Help:

Need help in File search engine crawler

Want a web crawler to gather data on an continuous basis from different file hosting services and filter it.

1) Data will be used to provide a files search engine to users. I don't want a clone of any similar kind website but infect something better than that one.

2) Process of data get-together will be a continuous process and will be running on the servers 24x7.

3) Data must be properly filtered to erase duplicate entries and new entries of the same data should merge.

I want the crawler itself part of the websites

It has to crawl multiple websites through given xml feed. Crawler must detect all links to files on rapidshare.com, 4shared, uploading as well as all other file sharing hosts. After detection it must add those links found to some kind of database (prefer MySQL) with addition information found about file Like Meta description, size, title, date if available.

Desired Skills are PHP5, cURL, MySQL Programming


Related Discussions:- Need help in file search engine crawler

Mailing lists on internet, Another exciting aspect regarding the E-mail is ...

Another exciting aspect regarding the E-mail is that you can discover groups of people who share your interests-whether you are inclined toward games, research or astronomy. E-mail

Woocommerce and wordpress development on existing website, Woocommerce and ...

Woocommerce and wordpress extra development desirable on existing website I have a present website which I need some extra development on. It is a pretty meek custom WordPres

Needed web designer and web professional, Web Designer and Web Professional...

Web Designer and Web Professional I have a current small business website as well as need help changing it so that people can access it from a smart phone and so on. Flash, perh

Need help in a spree specialist, Spreecommerce job (RoR) Want a Spree sp...

Spreecommerce job (RoR) Want a Spree specialist Objectives- 1) To integrate the custom theme (html mark-up need) 2) Slightly change the basic Spree functionality 3)

I want one 80legs app, 80legs App, import into Wordpress I want one 80le...

80legs App, import into Wordpress I want one 80legs app. Scraps information from five different websites and imports the information into Wordpress database. Desired Skills a

We need a rent manager setting application, We need a Rent Manager setting ...

We need a Rent Manager setting application I am looking for someone who can do rent manager setting please don't waste my time I have rent manager buy from the rentmanager.com t

I need modification of a script, I need modification of a script Project...

I need modification of a script Project Description: You must enter the search module that is show in the home for all the pages Skills required are PHP, SQL

I need a help in website development, I need a help in Website development ...

I need a help in Website development I am seeking to build a website that allows users to create profiles upload content and make payment transactions. Job description- I am

Client specific url website in php, JC - Client Specific URL Website Ple...

JC - Client Specific URL Website Please respond as follows- 1) Do you FULLY understand the requirements? 2) Are you an EXPERT with Magento? 3) Do you have ANY questions

We are need of an expert drupal developer, We are need of an expert Drupal ...

We are need of an expert Drupal Developer Immediate want for developer to finish getting our site ready for public display, working out some bugs as well as getting our site fun

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd