Need help in file search engine crawler, PHP Web Programming

Assignment Help:

Need help in File search engine crawler

Want a web crawler to gather data on an continuous basis from different file hosting services and filter it.

1) Data will be used to provide a files search engine to users. I don't want a clone of any similar kind website but infect something better than that one.

2) Process of data get-together will be a continuous process and will be running on the servers 24x7.

3) Data must be properly filtered to erase duplicate entries and new entries of the same data should merge.

I want the crawler itself part of the websites

It has to crawl multiple websites through given xml feed. Crawler must detect all links to files on rapidshare.com, 4shared, uploading as well as all other file sharing hosts. After detection it must add those links found to some kind of database (prefer MySQL) with addition information found about file Like Meta description, size, title, date if available.

Desired Skills are PHP5, cURL, MySQL Programming


Related Discussions:- Need help in file search engine crawler

I need help to create facebook login for bigcommerce, I need help to create...

I need help to create Facebook Login for BigCommerce I'm seeking to create an app for Big Commerce to permit Facebook Login with the expectation this will grow to allow others s

I want a high quality website for apartment rental, Apartment Rental Websit...

Apartment Rental Website I want a high quality website designed for use in rental real estate. The site will be a professional advertising tool that entices new tenants to college

Customization to cs-cart, We need some customized development for CS-Cart v...

We need some customized development for CS-Cart v4 Multi-Vendor Edition. We are taking a freight company to handle delivery of the goods. Vendors only require to pack the goods

We need senior developer experienced in python & django, We need Senior Dev...

We need Senior Developer experienced in Python & Django Company Data aggregation project where we are aggregating online data from multiple sources as well as enabling companies

Html5 based txt/csv data file charter, HTML5 Based TXT/CSV Data File Charte...

HTML5 Based TXT/CSV Data File Charter In search of a web developer to create a HTML5/JavaScript based web application to import tab delimited or comma separated information from

I need help for wordpress plugin to pull facebook group post, I need help f...

I need help for Wordpress plugin to pull Facebook group posts I am seeking someone to create a custom WordPress plugin for me that will take the post feed from my closed/private

Add function in web app, Add function in web app Project Description: ...

Add function in web app Project Description: I buy simple web app from code canyon and i want to add one function to this app i want it in As soon as. Skills required are

How you are going to proceed to deploy the web site, Question: (a) A sm...

Question: (a) A small Mauritian enterprise specialized in the production of pickles would like to launch a web site allowing its customers to have access to its range of produc

Draw layout cells, In Layout view you can draw layout cells & layout tables...

In Layout view you can draw layout cells & layout tables to describe the design areas of a document. This task is easier to achieve if you prepare a sample of the page you're creat

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd