Home > MySQL, PHP, Programming > Data Grabber Website

Data Grabber Website

March 17th, 2009

Need a website that fetch/grab the data on daily basis from pricegrabber.com, idealo.de, skapiec.pl and other websites (should be able to add new websites, run it from different locations for distributed grabbing, and run based on categories selected) for sale assistance. Data would have to be matched based on a product name or sku, etc and displayed on a webpage in a row(if automatically can not be done it should be done manually).

Pages should have:
1. Manufacturer, Model, Category, Description, vendor, Lowest Price from pricegrabber (will calculate currency based on the default selected) and actual grabbed , Lowest price from idealo.de (will calculate currency chosen from the website) and actual grabbed , and Lowest price from other websites (will calculate currency chosen from the website) and actual grabbed. a) Highlight in green the price that is the lowest and in the red that is the highest. b) Remove certain vendors that have unreal prices or are untrusted. c) Show percentage of difference

2. Manufacturer, Model, Category, Description, Average Price of 5 (configurable) lowest entries from pricegrabber (will calculate currency chosen from the website and actual grabbed), Average Price of 5 (configurable) lowest entries from idealo.de (will calculate currency chosen from the website and actual grabbed), Average Price of 5 (configurable) lowest entries from from other websites (will calculate currency chosen from the website and actual grabbed).
a) Highlight in green the price that is the lowest and in the red that is the highest.
b) Ability to go over the ave. price and click on the price to go to the particular website
c) Next to prices in parenthesis put a percentage between lowest and website price.
d) All pulled data should be stored in the database for easy retrieval

3. Reporting module to Generate reports from the data stored in the database It has to be easy to integrate into a website (modular design) and have admin site to control the configuration. All parameters used should be configurable. Example i should be able to add a new column if needed. Additional website (price search engine) should be easy to add. The data grabber website should run without locking up, be fast and responsive. The design should be very simple and attractive.


Data Grabber Website

Comments are closed.
Bear