Archive

Posts Tagged ‘matching’

Simple Database Script To Remove Duplicate Listings

February 9th, 2012 Comments off

I have a database of business listings containing name, address & zip code and category

I need a simple script that will recognize duplicate listing and among the duplicate listing keep the most recently imported listing and delete the rest.

The script has to look for several things to consider a listing a duplicate.

1. matching address
2. matching business title
3. matching category

This is the method I am thinking of but surely it will be refined in testing

The script will rem…

Need Product Box And Matching Manual Design Ai

December 5th, 2011 Comments off

BOX 1000w digial / 600w digital ballast
I need a product box design. 6 side basic box, I already have brand logo photoshop files CS5. I have font file for you to use. I have the box template with all the measurement in mm.

1. background green/gray/black gradients :technology,future,space,virtual, vector…in that sort
2. will need a “seal or ribbon” icon with 5 year warranty.
3. file should be in AI CYMK high resolution.
**this same art will be used for 2 boxes different model so differe…

Need Seven 72×72 Icons For Website That Have Matching Theme

November 16th, 2011 Comments off

We require seven icons that have a matching theme. They should match one we alreadey have at tryc2.com for investment recovery. The dollar sign with leaves. If possible add a bid to make larger versions so i can use them on the actual site pages. Here are the seven additional I need.

Asset Management ( i like the current one but everyone has a hard time telling what it is)
Recycling
government
Data security
Shop (Buy assets)
Sell (Sell assets)
Software (to represent our software offerin…

Download Mp3 Files And Matching Text

September 21st, 2011 Comments off

There are 13 pages where I need the linked audio files and the matching text downloaded. I’ve attached a doc with the links – called Links.

Each link has a list of stories. Those stories link to the audio and matching text. There is a total of 1295 audios to download with the matching text.

So you would save the audio file from that page, then copy and paste the text into a word file, then save it as well with the same name as the audio file.

I have attached a sample of what I need from the very first link on the Link doc.

This is an easy job – simple work – just boring and will take some time. It’s a chance to make an easy 10 and get good feedback.

I recently had this similar job by someone – https://www.scriptlance.com/cgi-bin/freelancers/buyers.cgi?manage_project=1314684833#0 – and they completed the job in about 4 hours by automating it with a computer program they made.

I think that would work best – using a program to capture it all, then just deleting the stuff I don’t want.

I will ignore and remove high bids. If you have no feedback, you’re going to have to prove to me you can do the job before I select you – give me an example.

Payment is placed in escrow and released once I have all the files. I have over 80 perfect feedbacks here, so that shouldn’t be a problem.

Matching Buyers And Sellers Software

August 4th, 2011 Comments off

I posted a project on matching buyers and sellers but the response I got was not on what I was looking for.
I want to match buyers and sellers on my website – similar to what ScriptLance does connecting businesses with programmers. I am not looking for wheel invention.Thanks

Matching Software

July 31st, 2011 Comments off

Programmers,

I would like to create a matching website that will match borrowers’ needs with lenders that can satisfy those needs.

We need borrowers to complete fields of a form online and the software to march lenders providing similar services.

We need you to tweak any type of matching software and customize the fields to fit what our market is searching for.

We will not spend a ton of money creating this software from scratch.

The project requires you
1. find available match-maker software that is customizable
2. customize it for our logo and colors, custom search fields
3. install it, tweak it until it’s right
4. give us 90 days maintenance

Thank you!

Data Mining A Website For Price Matching

June 22nd, 2011 Comments off

I need someone to data mine a website for titles and prices and then place the information in a access database.

Data Matching

March 2nd, 2010 Comments off

Hello,

I have 10 XLS similar to the one attached. On each XLS, Column B lists a ‘Specialty’ and Column K lists several “Specialty Expertises’. There should be about 30-40 ‘Specialties’ in total across all the 50 XLS that I have. I would like to create a complete list of unique ‘Specialty Expertises’ that goes w/ each ‘Specialty’.

Please let me know if you can help!

Best,
Phaedra

Data Matching #2

March 2nd, 2010 Comments off

Hello,

I have 50 XLS files (one is attached – ‘Washington DC’) w/ ‘Medical School’ listed in Column N. These ‘Medical Schools’ in Column N are often abbreviated (for ex. instead of Georgetown University, they are listed as Gtown University or Georgetown U.).

I have a definitive list of Medical Schools that our website uses in it’s drop-down and I would like each Medical School in Column N of these 50 XLS files to match up with our definitive list. This definitive list is also attached – ‘Medical Schools for HL database’.

Please let me know if you can help.

Thank you!
Phaedra

Data Matching Appending Merge

January 30th, 2010 Comments off

I have twelve separate database marketing files. These do not all have the same fields but do have some fields in common. My goal is to compile one master database using as much of the data as possible. Accuracy is of greatest importance and I fully expect this to be a complex job. This job will not be a simple name match. It will require careful planning. On some matches it may require comparing the first few numbers of addresses and month and year of birth to another file that has the full date of birth. At time a month and year of birth and last name will be matched to another file that has last name and complete date of birth but you will also need to compare the city or zip code. As I said it is not a simple matching process. I have attached a file you can review that shows the samples of the data. Some of these are very large database as indicated in the approximate number counts.

I have a strong server you will be able to utilize to make this happen unless you prefer to use your own or own software. I can connect the data to an external drive on the server and you would need to move it as needed but because of file size it will require extensive use of the backup drive as well as the main drives.

You must have extensive experience in Data matching, appending, cleansing, deduplication, validation, and merging of data across multiple tables or data structures. The attached document shows 11 of the current databases and a 12th will be added but it is only about another million records.

To sum this up all 12 files will become one master file that includes as many data elements as possible. Some states will have data that others will not. For example there are two database, one for Oregon and one for Washington that contain data elements no other state has. Another example is there are data elements for 2/3 of the states that 1/3 do not have.

Planning is going to be a big part of this project. Please have experience in data compiling if bidding.

Thank you for your consideration.

Customer Matching Script

January 7th, 2010 Comments off

We need a buyer-seller matching system:

Buyers & sellers input specs of products/services wanted/offered, and the system matches them. Think of it as a dating service, altho’ it isn’t. Lots more details which we cannot share here.

We need a prototype demo system to interest investors.

Joomla is our platform. Almond classifieds and adsmanager don’t do the job.

IF you were to do Craigslist the ‘right’ way, how would you do it?

Magento Cart Design Tweaks

December 18th, 2009 Comments off

I own a website with approx. 17000 unique SKUs. Only 5500~ SKUs are in-stock and show on the site. need a Magento expert coder and designer who can help me tweak the layout and design of my Magento Shopping Cart especially the Category and Product landing pages for optimal customer shopping experience with speed and aesthetics in mind.

Catalog landing pages:

1. Add a more user friendly Catalog page navigation: i.e. “images per page” needs to be a drop down menu. Use matching design buttons for “sort by” or drop down. Easier to view page navigation. Need this also placed on the bottom of the catalog page
2. Retail Price and your savings information must be removed on catalog view. Takes up too much space
3. Front end: Attributes color and style in an image icon not text.
4. Front end: Attribute size needs to be displayed in better arrangement that is easier to navigate
5. order of right column must be optimized for better shopping experience.

Product landing pages

1. Need to rearrange to make the page look more symmetrical and need to also input static html (without hurting seo) to show on every product page.
2. Need to come up with some matching gif images such as wishlist, gift registry, and compare. I need more matching stylish gifs for reward points and etc.

It is very important that you are an experienced magento developer.

Must work on non-production server created on my dedicated server before going live, Must be fully approved by me first before going live. Any work performed can not alter or conflict with any working extensions.

Medical Specialities Matching

October 3rd, 2009 Comments off

We have a list of procedures and conditions (2000) and would like to match them to a list of medical specialitites (50).

We are looking for someone with a medical background, don’t bid if you don

Cms + Front End Additions

July 16th, 2009 Comments off

need a couple of pages added to admin/cms

page1: editable list of genres + editable list of labels, pagination amount, featured amount
page2: (products)add/edit/delete etc: title,artist,genre,label,description,image, 4 x urls,date

all with delete/confirm delete, no genre or label delete if associated product

front end
main page, list all latest added max feautured amount

genres dropdown, select genre and display matching with pagination
labels dropdown, select label and display matching with pagination

search page, usual search functions

date dropdown, select month/year and display matching

aswell as dropdown pages i need separate includes files which are very easy and i could probably add, just a list of all options that are also the same as in the dropdowns

i am being supplied a psd i believe for the site, i may need help possibly but i may be ok, with slicing etc when i receive it

i may have missed certain functions so you must be prepared to work alongside changes, if extensive changes i will pay extra

Politics Matching Questionnair

July 12th, 2009 Comments off

My project is to create a website with a simple clean flash interface for a questionnaire where people will be able to choose their political party for an election. It’s close to a personality test. Something between http://abcnews.go.com/Politics/Primaries/page?id=3623346 and http://saplin.com/vote2006/

There should be a secure access with paypal module. People will pay a little amount to access that website. It could be also a pay-phone code to access.

The backend (secure) application with ability to define:
- number of questions
- number of candidates = answers
- type of results on the final page

Modifying any text should be a easy process.

It should be a light script, which will not sollicite mysql to much. I think I prefer a interface with xml base for the questionnaire but final results could be sent to a mysql db.

Precision : the final payment for this script/service will be made only if the script is working correctly (tests will be made).

Mini Site Templates Design

June 18th, 2009 Comments off

Hi,
I’m looking for a web designer who can create two mini-site templates for me. The sites should include:

-Custom header/footer/background graphics
-HTML template
-Matching e-Book cover
-Matching place to load video
-Matching “Sign Up Here” graphic
-Original PSD files

Specific topics are in the online marketing niches. Please also include details on your revision policy with your bid.

Please PM samples of your work along with your bid.

thank you..
jdmunoz

Horoscope Matching Script Php

June 16th, 2009 Comments off

Hello

i need a north indian style horoscope matching script, when you put the 2 brithdates and the places, it need to create the 2 horoscopes in north indian style and do a macthing.

if you cant do this,

at least some script to create a accurate horoscope in PHP will enough.

is there anybody who can do this ?

m

Matching Script

June 14th, 2009 Comments off

I need a little script which offers the following functions:

- a simple website with formular
- user can fill out / choose some data like “male”, “32″, “friendship”
- after sending the form the script offers available matching results which has been saved before by another one
- Login needed to see full information
- possibility to bill users for full information (for once or for a membership)
- Admin-Login to create much more options to select
- Member area with saved search results and contacts
- Member area should offer personal links to facebook and so on (editable thru admin)

Most important part is to have the possibility to create more then a few search keywords (e.g. by using a category tree instead of a pull down menu)

Ocr And Data Matching Of Pdfs

June 11th, 2009 Comments off

We have a data gathering facility that scans images. These images need to be OCR’d and then a matching algorithm must be written to find data in the IMAGE to match with a database.

Please present previous experience. Project expected to occupy two weeks.

Must have Skype – PMB it with previous experience.

as usual, 33% escrow via Scriptlance.

PERL/MYSQL

Need Email Matching

June 5th, 2009 Comments off

Need someone who knows how to consistently get in the inbox of the yahoo,msn, and aol.

Xml Parser Php Script

June 2nd, 2009 Comments off

I need a php script to parse data from results of search requests similar to this:

http://www.popshops.com/v1/0yp0rj3hqei08nztbslkxco1m/products.xml?catalog_key=8dma5bktzb9bseed24byo2z3w&keywords=ipod+16gb

The results will then be displayed on our online shopping mall website (www.ShoppingMinistry.com). It should display a list of available products and allow customer to sort by name, price etc. It should also allow them to narrow the search by available parameters.

Here are more info about available parameters etc:

Request URL

http://www.popshops.com/v1/0yp0rj3hqei08nztbslkxco1m/products.xml
Required request parameters
Field Value Description
catalog_key string Unique key identifying catalog of merchants: 8dma5bktzb9bseed24byo2z3w
keywords string

A list of keywords to search across your catalog merchants.

keywords=ipod Is a basic search for products containing the keyword ‘ipod’

keywords=ipod -case is a search for products containing the keyword ‘ipod’ and NOT containing the keyword ‘case’
Optional request parameters
Field Value Description
merchant_id integer A unique PopShops merchant_id, limiting products to a single merchant
merchant_type_id integer A unique merchant_type_id limiting products to a single merchant_type.
category_id integer A PopShops category ID, limiting products to a single merchant’s category. Category ids are currently only returned in product query responses.
brand_id integer A PopShops brand_id, limiting products to a single brand
price_min decimal
10.00,19.95, etc
Price minimum product prices should not go below
price_max decimal
10.00,19.95, etc.
Price maximum product prices should not exceed
product_sort name_asc
name_desc
price_asc
price_desc Featured (default), Name (A-Z), Name (Z-A), Lowest Price, Highest Price
product_limit 1-100 Number of products to display at a time. 100 maximum.
product_offset integer Number to offset the product results by
include_deals boolean
1 or 0
Available deals can also be included in the result set that match returned products and merchants.
url_subid string Custom subid/sid to be appended in any final affiliate product urls.
Response fields
Field Description
search_results Contains all of the query responses. Attributes:

* keywords: any keywords passed in
* product_limit: any product_limit passed in
* product_offset: any product_offset passed in
* merchant_id: any merchant_id passed in
* category_id: any category_id passed in
* brand_id: any brand_id passed in
* product_sort: any product_sort passed in
* price_min: any price_min passed in
* price_max: any price_max passed in
* merchant_type_id: any merchant_type_id passed in

products Contains products matching the query parameters. Attributes:

* total_count: Total number of products matching the query parameters

product Contains an individual product. Attributes:

* name: The name of the product
* description: The description of the product
* merchant_id: The merchant_id for the merchant the product belongs to.
* large_image_url: A url for the largest sized image available for the product.
* medium_image_url: A url for a medium sized image of the product.
* small_image_url: A url for a small sized image of the product.
* merchant_price: The price offered through the merchant. Usually corresponds to the lowest price.
* retail_price: The listed retail price of the product.

price_ranges Contains price_ranges for products matching the query parameters.
price_range Contains an individual price_range. Attributes:

* max: The max dollar value in the range
* min: The min dollar value in the range
* product_count: The number of products within this price range.

merchants Contains top merchants for products matching the query parameters. In many cases the number of merchants matching the query is too many to bring back, so this will only bring back the top 50 merchant matches by product count. You may encounter results where you get a product on a page and there is no matching merchant in the merchants node.
merchant Contains an individual merchant. Attributes:

* id: A unique id for the merchant. You can pass this in as a merchant_id to filter products to this specific merchant.
* name: The name of the merchant.
* product_count: The number of products matching the query for this specific merchant.
* logo_url: If available a logo_url will be provided which is a url to small thumbnail of a logo for the merchant.
* url: If available the url will be returned, which is a landing page for this merchant.
* merchant_type_id: If the merchant belongs to a merchant_type, this will be the id for the merchant_type. This can be used to further filter products as a merchant_type_id parameter.

merchant_types Contains top merchant_types for products matching the query parameters.
merchant_type Contains an individual merchant_type. Attributes:

* id: A unique id for the merchant_type. You can pass this in as a merchant_type_id to filter products to this specific merchant_type.
* name: The name of the merchant_type.
* product_count: The number of products matching the query for this specific merchant_type.

brands Contains top brands for products matching the query parameters.
brand Contains an individual brand. Attributes:

* id: A unique id for the brand. You can pass this in as a brand_id to filter products to this specific merchant_type.
* name: The name of the brand.
* product_count: The number of products matching the query for this specific brand.

suggested_merchants If the keywords match any merchant names, or have been tagged by PopShops as belonging to a specific merchant, this node will return any merchants that may be possible matches. This node will have child merchant nodes with attributes available on normal merchant nodes.
deals Contains deals available for products,merchants, and suggested merchants matching the query. Attributes:

* restrictions: Global restrictions that apply to any deal returned.

deal Contains an individual deal. Attributes:

* name: The name of the deal.
* description: A description of the deal.
* url: The redirect url for the deal.
* image_url: If an image is available for the deal, this will be a url for that image.
* specific: This is a boolean (true/false) indicating whether the deal is specific to a product, or applies to all products from the merchant.
* start_on: The start date the deal is valid.
* end_on: The end date the deal is no longer valid.
* code: Any associated code for the deal. This is a code that would need to be used to redeem the deal.
* deal_type_ids: The deal_type id indicating what kind of deal this is.
* restrictions: Any applicable restrictions unique to this deal or merchant.
* merchant_id: A unique id for the merchant.
* merchant_type_id: The id of the merchant_type the merchant of this deal belongs to.

Categories: MySQL, PHP, XML Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Setup Sql Tables 4 Data Entry

May 13th, 2009 Comments off

You’ll be simply setting up a few simple mySQL tables for our data entry. There will be the main table and then maybe 2 or 3 “sub” tables for the data entry people. They’ll be copying and pasting Q&A type of data from an original Word document into the sub-tables. The attachment here, on p. 1 shows the exact columns and layout we want for the main table. You’ll need to figure out how you can make the “sub” tables to accomodate the Multiple Choice (MC) type questions (85% of the questions are these. This input table will be super easy) plus 1 or 2 more input tables, or subtables for the various types of Matching (MA) type questions. The latter will be the challenge or the “work” on this project, ie trying to accomodate the various types of MA questions shown in the attached document on pp. 3-10 into maybe 1 or 2 subtables.

To be considered for project award, we will need you to submit a proposed solution (keep it simple, nothing long or formal thanks) to our entry of the many MATCHING type questions (looking for an efficient solution) represented in the attached sample questions file (an example of the types of q&a we’ll be doing data entry on) so that we can see you’ve got a workable gameplan before assigning the project. Just use “mySQLdb” as pw to access the document.

This solution will probably be in the form of 1 or several data entry tables that will ultimately feed that entered data back into the main mySQL table.

Bids up to $100 can be considered for this small project. Your bid should include the words “have read”. Basic familiarity with FLEX, AIR, Flash database design, and SQLite would be great for you if you’re interested in additional related work & larger subsequent projects, though is not necessarily required here. Should be a simple project for anyone who knows mySQL well. Setup some tables, the fewer the better. Will watch for your proposed solution to the attached MA (matching) types.

Setup Sql Tables 4 Data Entry

May 13th, 2009 Comments off

You’ll be simply setting up a few simple mySQL tables for our data entry. There will be the main table and then maybe 2 or 3 “sub” tables for the data entry people. They’ll be copying and pasting Q&A type of data from an original Word document into the sub-tables. The attachment here, on p. 1 shows the exact columns and layout we want for the main table. You’ll need to figure out how you can make the “sub” tables to accomodate the Multiple Choice (MC) type questions (85% of the questions are these. This input table will be super easy) plus 1 or 2 more input tables, or subtables for the various types of Matching (MA) type questions. The latter will be the challenge or the “work” on this project, ie trying to accomodate the various types of MA questions shown in the attached document on pp. 3-10 into maybe 1 or 2 subtables.

To be considered for project award, we will need you to submit a proposed solution (keep it simple, nothing long or formal thanks) to our entry of the many MATCHING type questions (looking for an efficient solution) represented in the attached sample questions file (an example of the types of q&a we’ll be doing data entry on) so that we can see you’ve got a workable gameplan before assigning the project. Just use “mySQLdb” as pw to access the document.

This solution will probably be in the form of 1 or several data entry tables that will ultimately feed that entered data back into the main mySQL table.

Bids up to $100 can be considered for this small project. Your bid should include the words “have read”. Basic familiarity with FLEX, AIR, Flash database design, and SQLite would be great for you if you’re interested in additional related work & larger subsequent projects, though is not necessarily required here. Should be a simple project for anyone who knows mySQL well. Setup some tables, the fewer the better. Will watch for your proposed solution to the attached MA (matching) types.

Player Matching From Phpbb

May 8th, 2009 Comments off

Site has a phpbb forum with user accounts. There’s a main site that uses the is_registed and other functions of phpbb.

The main site requires code to display options to the user (drop down select boxes and checkboxes that affect each other, loaded from MySQL tables), once selected and “Find” is clicked, a suitable “group” has to be found and the user added to by their member ID, else create a new group. As well as the options of the page, other factors such as TimeZone should also be used to find the best group (group users so they are with others in the same or closest timezones). Groups have membership limits, depending on the type of group, once reached no more users can be added, the group should then be displayed to the user, pulling in a custom phpbb field of “nickname” and display as a list (with the own user’s nick at the top of the list) as well as the requirements of the group. Of the group, one member (of those who selected in the form to be considered) should be designated as the leader/host, most likely the user with the most “central/equal” timezone to the others (timezone pulled in from phpbb setting). This user to be highlighted in the list with a unique message echod to the screen and the groups options/requirements highlighted to them, while the other members receive a second message (this should called from phpbb using the lang command so that the correct language message is displayed).
The group is filled and no more users can be added, it should remain in the db table long enough for while the users are chatting (they’ll be a chat window, but this bit I can do myself), incase of the page refresh or momentary disconnect. However should expire and be removed from the database table at some point. It’s possible the user will need to search again incase a member left, or the team have been together long enough to complete the objective (very variable time, 5mins to several hours, however certainly not likely to be over 24 hours) and have split up.

A user can ONLY ever be in ONE group at ANY time. A user may select “Any” in some of the choices, this will allow a greater field of groups. However becomes a problem if a group is then generated with “Any” options.

This is for use in real time, creating instant groups of users with identical requirements for quite likely short periods of time, and must cope with users changing their minds on the search criteria, or having to leave their computer for real life reasons. It’s not for users to add to and look back at the following day (like a forum). The issue of a timeout for when a user has had to create a group for his criteria and no one else has joined for a period of time should also be considered, a user is unlikely to wait 5 minutes, if that.

At any point a user may click cancel and be removed from any group (if they’re the only member, delete the group), change their options and resubmit the find.

Options should be pre-set drop down and checkboxes loaded from mysql tables, some drop downs will affect the options in following drop downs (those should be blank and disabled initially and be of a fixed width so that when options are “loaded” into them, it does not visible “widen”). Checkboxes will also affect drop downs, such as a list of “abilities”, these affect choices available in a following drop down box, checkboxes could also be affected by a preceeding drop down box.

An administration page for adding more options to the mysql would be desired.

Initially light load, but should be designed to be as efficient and error free as possible so as more users use it there are no problems.

Neat, clearly laid out code, with comments explaining code throughout (almost every line) required please (I like to understand and learn the code myself).

There’s the possibility of future improvements being required so may help to design with expansion in mind, currently the only improvement I can think of would be a log of users previously teamed up with.

Joomla/mambo Component

April 27th, 2009 Comments off

Spell-It Mambo/Joomla component

Guest’s can select a language(*) with a spelling scheme, enter a string and as a result they get a spelling table like the following:

INPUT: hello

OUTPUT:
h hotel
e echo
l lima
l lima
o oscar

For the selected languages there are spelling tables with all special characters used in those languages like “

Mambo/joomla Component

April 17th, 2009 Comments off

Spell-It Mambo/Joomla component

Guest’s can select a language(*) with a spelling scheme, enter a string and as a result they get a spelling table like the following:

INPUT: hello

OUTPUT:
h hotel
e echo
l lima
l lima
o oscar

For the selected languages there are spelling tables with all special characters used in those languages like “

Search Matching Function

April 4th, 2009 Comments off

Need a search matching function.
Very straightforward… Neeed in 36 hrs. Only experienced programmers pls, no amatuers.

Find your course by
========= | ======== | =======
LOCATION | LEVEL | SUBJECT
========= | ======== | =======
(Dropdown or checkbox or whatever)

Create databse for filling of data, (options for locatn, level and
subject, then user can mix and match.)

After this is done, just integrate into website.

Fetching Web Data Into Epesi

April 1st, 2009 Comments off

Need a module working under EPESI custom platform. It will fetch/grab data on demand and daily basis from websites such as skapiec.pl, idealo.de, etc.
Data would have to be matched based on upc/ean, mpn, sku, product name, etc,… and displayed on a webpage with multi or single line items (if automatically can not be done it should be done manually).
The main goal is to scrape over 100 websites, rather close to 200. One scraper per website is fine as long as there is a configuration that will handle all the scrapers setting, etc.

Websites should contain:

Deliverables:
1) Complete and fully-functional working program(s) as well as complete source code of all work done.
2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables):
a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer’s environment–Deliverables must be installed by the Seller in ready-to-run condition in the Buyer’s environment.
b) For all others including software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.
3) All deliverables will be considered “work made for hire” under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder’s Seller Legal Agreement).
4) NDA

Requirements:
1. Has to work under EPESI platform located at http://sourceforge.net/projects/epesi
2. Common identification of products such as UPC/EAN, MPN, SKU. If no identification of product found it will be matched by Title.
3. Whenever possible use functions already used in the system, no overhead accepted
4. Products that are scrapped (grabbed) from price search websites should be matched as per specification
5. Products need to have price search action button next to it in WMS module as well ability to search using autocomplete function.
6. New sites to scrap should be easy to add (no more than 2 hour of work to add new site by admin) and utilize plugins
7. Sites that are already done have to be configurable in order for admin to make script corrections
8. Websites categories should be matched with categories in wms and ecommerce module, therefore with a single click desired products from a chosen category should be fetched. Action button in WMS module.
9. Multiple fetching hosts. Hosts will fetch data from multiple websites locations and place it in the same db. Master module will command slave modules how, when ,and from which website to fetch the data. Master module will tell which fetching host to use for which website. It should alternate randomly hosts and report any problems through alerter in EPESI. Active hosts will redistribute the load if there are problems with fetching. (something like load-balancing)
10. Websites categories should be indexed and saved for future fetching requests. It will have to be done periodically and if any current settings are changed send alert through EPESI to inform admin in order to make changes.
11. Implement on the fly translation in order to match categories and products info being fetched as well matching should be done base on sample of products in the category if identification at point 2 of the req. is not available.
12. Data should be stored in the database for easy retrieval as per EPESI project manager specification
14. Real-time exchange rates updates for different currencies
15. Number of entries to calculate average prices needs to be configurable
16. All Displayed columns has to be sorted.
17. When action initialized:
a)It will collect data once a day as a whole system
b)As a Category (list of products)
c)As a single product
18. Ability to add, remove columns (data)

Pages should have:
1. Manufacturer, Model, Description, vendor, Category, Lowest Price from website (will calculate currency based on the default selected) and actual lowest price, show percentage of difference between the lowest value and the website value
a) Highlight in green the price that is the lowest and in the red that is the highest.
b) Ability to click on the price to go to the particular website’s product page
c) Ability to remove vendors that have unreal prices from website or have very low ratings

2. Manufacturer, Model, Description, Category, Average Price of 5 (configurable) lowest entries from website (using the selected default currency), Average Price of 5 lowest entries using original currency, show percentage of difference between the lowest ave 5 and the highest website price
a) Highlight in green the price that is the lowest and in the red that is the highest
b) Ability to click on the ave. price to go to the particular website’s products page
c) Ability to remove vendors that have unreal prices from website or have very low ratings

3. Product Name, Description, 5 websites with the lowest prices (default currency), price range of 5 lowest websites (default currency), price range of 5 highest websites (default currency), percentage between average of 5 lowest and 5 highest website prices (default currency)
a) Ability to click on price to go to the particular website’s products page
b) Ability to remove vendors that have unreal prices from website or have very low ratings

4. Reporting module to Generate reports from the data stored in the database
a) The reporting module will have to work similar to crystal reports. I can create my own reports and the data would be populated on the website. Charting is not necessary but if it goes with reports it would be ok.
b) Products that have the highest percentage difference

It has to be easy to integrate into a website (modular design) and have admin site to control the configuration.
All parameters used should be configurable as per EPESI module administration
Additional website (price search engine) should be easy to add. The data grabber website should run without locking up, be fast and responsive.
The operation of the module has to be user friendly.

Platform:
EPESI,PHP,AJAX,JAVASCRIPT and MySQL DB

Additional questions.

UPC/EAN matching, MPN matching, SKU matching matching. IF no identification of product found it will be matched by Title.

Title matching should be automatic base on the probability…

1. If All words are present it would be 100% match.
2. If at least 2 words are matched and the rest is not it would be 75% match.
3. If 1 word is present it would be 25% match.
4. No match

The percentage of matching does not matter at this point it would have to be worked out.
The base for text matching is a Title of the product.
Point 1. “Nikon D90″ present everywhere would be 100% match
Point 2. “Nikon D90 body”, “Nikon D90 korpus”, “Nikon D90 kit” 75%
Point 3. “Nikon lens”, “Nikon flash”, “Nikon P80″ 25%
Point 4. None would be left in the repository for matching or deletion.

All 100% matches would be done without manual intervention.
The 75% matches would be shown to the end user as the best suggestion and accepted or not. If not it would have to be matched with the remaining products.
The 25% matches would be shown to the end user as the best suggestion. If not accepted it would have to be matched with the remaining products.
If products is matched it should be remembered.

Example:

Initial project will have 3 websites:

1. www.pricegrabber.com
2. www.idealo.de
3. www.skapiec.pl

Here is the sample of a page for Nikon D90 that info should be pulled and matched,
I think the best way to grab and match the data is based on categories, here is the sample of photo category:

http://cameras.pricegrabber.com/digital/Nikon-D90-Black-SLR-Digital-Body/m90725732.html/search=Nikon%20d90/st=product/sv=title
http://www.idealo.de/preisvergleich/OffersOfProduct/1124693_-d90-nikon.html

http://www.skapiec.pl/site/cat/2/comp/375159

Categories: Ajax, MySQL, PHP, Programming, SQL Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Epesi – Data – Fetching – Php

March 28th, 2009 Comments off

Need a module working under EPESI custom platform. It will fetch/grab data on demand and daily basis from websites such as pricegrabber.com, idealo.de, etc.
Data would have to be matched based on upc/ean, mpn, sku, product name, etc,… and displayed on a webpage with multi or single line items (if automatically can not be done it should be done manually).
The main goal is to scrape over 100 websites, rather close to 200. One scraper per website is fine as long as there is a configuration that will handle all the scrapers setting, etc.

Websites should contain:

Deliverables:
1) Complete and fully-functional working program(s) as well as complete source code of all work done.
2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables):
a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer’s environment–Deliverables must be installed by the Seller in ready-to-run condition in the Buyer’s environment.
b) For all others including software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.
3) All deliverables will be considered “work made for hire” under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder’s Seller Legal Agreement).
4) NDA

Requirements:
1. Has to work under EPESI platform located at http://sourceforge.net/projects/epesi
2. Common identification of products such as UPC/EAN, MPN, SKU. If no identification of product found it will be matched by Title.
3. Whenever possible use functions already used in the system, no overhead accepted
4. Products that are scrapped (grabbed) from price search websites should be matched as per specification
5. Products need to have price search action button next to it in WMS module as well ability to search using autocomplete function.
6. New sites to scrap should be easy to add (no more than 2 hour of work to add new site by admin) and utilize plugins
7. Sites that are already done have to be configurable in order for admin to make script corrections
8. Websites categories should be matched with categories in wms and ecommerce module, therefore with a single click desired products from a chosen category should be fetched. Action button in WMS module.
9. Multiple fetching hosts. Hosts will fetch data from multiple websites locations and place it in the same db. Master module will command slave modules how, when ,and from which website to fetch the data. Master module will tell which fetching host to use for which website. It should alternate randomly hosts and report any problems through alerter in EPESI. Active hosts will redistribute the load if there are problems with fetching. (something like load-balancing)
10. Websites categories should be indexed and saved for future fetching requests. It will have to be done periodically and if any current settings are changed send alert through EPESI to inform admin in order to make changes.
11. Implement on the fly translation in order to match categories and products info being fetched as well matching should be done base on sample of products in the category if identification at point 2 of the req. is not available.
12. Data should be stored in the database for easy retrieval as per EPESI project manager specification
14. Real-time exchange rates updates for different currencies
15. Number of entries to calculate average prices needs to be configurable
16. All Displayed columns has to be sorted.
17. When action initialized:
a)It will collect data once a day as a whole system
b)As a Category (list of products)
c)As a single product
18. Ability to add, remove columns (data)

Pages should have:
1. Manufacturer, Model, Description, vendor, Category, Lowest Price from website (will calculate currency based on the default selected) and actual lowest price, show percentage of difference between the lowest value and the website value
a) Highlight in green the price that is the lowest and in the red that is the highest.
b) Ability to click on the price to go to the particular website’s product page
c) Ability to remove vendors that have unreal prices from website or have very low ratings

2. Manufacturer, Model, Description, Category, Average Price of 5 (configurable) lowest entries from website (using the selected default currency), Average Price of 5 lowest entries using original currency, show percentage of difference between the lowest ave 5 and the highest website price
a) Highlight in green the price that is the lowest and in the red that is the highest
b) Ability to click on the ave. price to go to the particular website’s products page
c) Ability to remove vendors that have unreal prices from website or have very low ratings

3. Product Name, Description, 5 websites with the lowest prices (default currency), price range of 5 lowest websites (default currency), price range of 5 highest websites (default currency), percentage between average of 5 lowest and 5 highest website prices (default currency)
a) Ability to click on price to go to the particular website’s products page
b) Ability to remove vendors that have unreal prices from website or have very low ratings

4. Reporting module to Generate reports from the data stored in the database
a) The reporting module will have to work similar to crystal reports. I can create my own reports and the data would be populated on the website. Charting is not necessary but if it goes with reports it would be ok.
b) Products that have the highest percentage difference

It has to be easy to integrate into a website (modular design) and have admin site to control the configuration.
All parameters used should be configurable as per EPESI module administration
Additional website (price search engine) should be easy to add. The data grabber website should run without locking up, be fast and responsive.
The operation of the module has to be user friendly.

Platform:
EPESI,PHP,AJAX,JAVASCRIPT and MySQL DB

Additional questions.

UPC/EAN matching, MPN matching, SKU matching matching. IF no identification of product found it will be matched by Title.

Title matching should be automatic base on the probability…

1. If All words are present it would be 100% match.
2. If at least 2 words are matched and the rest is not it would be 75% match.
3. If 1 word is present it would be 25% match.
4. No match

The percentage of matching does not matter at this point it would have to be worked out.
The base for text matching is a Title of the product.
Point 1. “Nikon D90″ present everywhere would be 100% match
Point 2. “Nikon D90 body”, “Nikon D90 korpus”, “Nikon D90 kit” 75%
Point 3. “Nikon lens”, “Nikon flash”, “Nikon P80″ 25%
Point 4. None would be left in the repository for matching or deletion.

All 100% matches would be done without manual intervention.
The 75% matches would be shown to the end user as the best suggestion and accepted or not. If not it would have to be matched with the remaining products.
The 25% matches would be shown to the end user as the best suggestion. If not accepted it would have to be matched with the remaining products.
If products is matched it should be remembered.

Example:

Initial project will have 3 websites:

1. www.pricegrabber.com
2. www.idealo.de
3. www.skapiec.pl

Here is the sample of a page for Nikon D90 that info should be pulled and matched,
I think the best way to grab and match the data is based on categories, here is the sample of photo category:

http://cameras.pricegrabber.com/digital/Nikon-D90-Black-SLR-Digital-Body/m90725732.html/search=Nikon%20d90/st=product/sv=title
http://www.idealo.de/preisvergleich/OffersOfProduct/1124693_-d90-nikon.html

http://www.skapiec.pl/site/cat/2/comp/375159

Categories: Ajax, MySQL, PHP, Programming, SQL Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,
Bear