Crawler+auto Classifieds Site
I am looking for somebody who can develop a fully operational auto classifieds website, which crawls selected auto classifieds websites and stores the basic ads info.
Also users of the site can post their own ads on my site. The postings can be made by non-registered users as well.
So when somebody comes to my site, he should choose what vehicle, model, year, mileage, fuel etc. to search, then the site should return the related results from my site and the the partnering sites from which there are basic results stored.
There will be crawlers needed for 2 partner sites as well as xml parser for the 3-rd partner site.
I will provide details on the sites to be crawled additionally.
The crawlers will run as cron job to collect the data from partners and insert it into my database. The user search should be made from my database. When the users wish to see the detail information of the ad, they will be redirected to the orginal source site page containing the detail information of that auto ad.
The crawler should execute data scrapping on the new classifieds additions of the partnering sites few times a day (via cron job for example) and paste the data extracted into my database as per unified table of the searchable fields and extras.
The crawlers should also look whether the already extracted classifieds are still active in the partnering website (through link availability or something else).If the ad is not available in the partnering site, then it has to be deleted from my database.
The users of my site can subscribe to receive daily/weekly mails including the newly added cars by their specific search detail.
Looking for suggestions on script+design or script only.


