Need help in file search engine crawler, PHP Web Programming

Assignment Help:

Need help in File search engine crawler

Want a web crawler to gather data on an continuous basis from different file hosting services and filter it.

1) Data will be used to provide a files search engine to users. I don't want a clone of any similar kind website but infect something better than that one.

2) Process of data get-together will be a continuous process and will be running on the servers 24x7.

3) Data must be properly filtered to erase duplicate entries and new entries of the same data should merge.

I want the crawler itself part of the websites

It has to crawl multiple websites through given xml feed. Crawler must detect all links to files on rapidshare.com, 4shared, uploading as well as all other file sharing hosts. After detection it must add those links found to some kind of database (prefer MySQL) with addition information found about file Like Meta description, size, title, date if available.

Desired Skills are PHP5, cURL, MySQL Programming


Related Discussions:- Need help in file search engine crawler

We are developing a social network as well as marketplace, Individual Devel...

Individual Developer for charity-focused social network We are developing a social network as well as marketplace for charities and need a programmer proficient in php, mysql, c

I need help to create splash page with paypal, I need help to Create splash...

I need help to Create splash page with paypal and aweber integration Create splash page with PayPal as well as aweber integration which has YouTube video auto playing at top the

Seeking to create websites and seo, Looking to create websites and SEO (Par...

Looking to create websites and SEO (Partnership) We want a Team of Web Development, Designing as well as SEO for Profit sharing partnership. Please read the full explanation

Test links in dreamweaver, In Dreamweaver you cannot test your links; you s...

In Dreamweaver you cannot test your links; you should check your links in a browser to make sure the pages operate as you expect. 1. Press F12 to preview the page in a brow

Explain the design features of web site, Evaluate the features of the MU we...

Evaluate the features of the MU website in terms of its usability, legal requirements and ease of search by search engines. You need to make use of relevant usability evaluation te

We need developer for modifying a website, We are looking for a very skille...

We are looking for a very skilled php developer to help us make modifications to our website. Job Description- We are looking for a Web Developer. Your responsibilities- 1

We are looking for high end drupal specialist, We are looking for High End ...

We are looking for High End Drupal Specialist We are seeking to partner with an INDIVIDUAL Drupal expert with experience working on government or large multinational Drupal roll

Need help to fix virus and spam crash prevention, Need help to fix Virus an...

Need help to fix Virus and spam crash prevention Problem resurfaced with the GEG site. Site down since this morning by network solutions. Can you help us? Desired Skills are

Newbi, how use the simple aplication for web with php fron iner and mysql t...

how use the simple aplication for web with php fron iner and mysql the databse

We need help for simple php online ordering system, We need help for Simple...

We need help for Simple php online ordering system I need a basic online ordering system for restaurant which is very user friendly, both client side as well as back panel. It m

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd