Need help in file search engine crawler, PHP Web Programming

Assignment Help:

Need help in File search engine crawler

Want a web crawler to gather data on an continuous basis from different file hosting services and filter it.

1) Data will be used to provide a files search engine to users. I don't want a clone of any similar kind website but infect something better than that one.

2) Process of data get-together will be a continuous process and will be running on the servers 24x7.

3) Data must be properly filtered to erase duplicate entries and new entries of the same data should merge.

I want the crawler itself part of the websites

It has to crawl multiple websites through given xml feed. Crawler must detect all links to files on rapidshare.com, 4shared, uploading as well as all other file sharing hosts. After detection it must add those links found to some kind of database (prefer MySQL) with addition information found about file Like Meta description, size, title, date if available.

Desired Skills are PHP5, cURL, MySQL Programming


Related Discussions:- Need help in file search engine crawler

Magento expert wanted for a quick help, Magento Expert wanted for a quick j...

Magento Expert wanted for a quick job at ALRUG.com We are working on a new website founded on Magento for ALRUG.com, which is now located at ALRUG.com/beta running on Magento Co

Pass an arguments to a function, You can pass arguments to a function. Thes...

You can pass arguments to a function. These are variables, either strings or numbers, which are utilized inside the function. Certainly the output of the function based on the argu

Need help in changes in current pos system, Changes in Current POS system ...

Changes in Current POS system We have a POS system now working fine. We need little addon function, field as well as reports to make it more perfect We likewise want the same

Wix commerce site needs shopping backend integration, WIX commerce site nee...

WIX commerce site needs 1shopping backend integration Project Description: We sell children's furnitureRIEchildrensFurniture and want a robust backend integrated shopping car

Explain features of php, Question: (a) (i) Name four features of PHP t...

Question: (a) (i) Name four features of PHP that makes it an appropriate choice as a Web programming language. (ii) List advantages while using PHP scripting language.

Need help in house rental tracking hosted web gui and db, House Rental trac...

House Rental tracking Hosted Web GUI and DB Want a web interface program to track short term rentals of multiple vacation properties. Most information wants to be scraped twice

Seeking for a programmer ajax, Seeking for a programmer We look forward ...

Seeking for a programmer We look forward to build a relationship with somebody or a group of people to work with us on our e-commerce platform. Expertise needed- • JavaScr

Develop a new magento site, As we are establishing a new Magento site with ...

As we are establishing a new Magento site with several large extensions involved, this job is to resolve the various unexpected issues that can occur during set up and testing. As

A php website developer required for web project, A php Website developer r...

A php Website developer required for web project Need a website developer who has experienced in website development using php AWS server knowledge is plus. Desired Skills

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd