Scrape/collect Data From Web
I need an experienced developer that can code an application/utility that will do the following:
1. Scrape through the following website:
http://www.transfermarkt.co.uk/en/spieler/21175/ibisevic-vedad/aufeinenblick.html
Your application or utility should go through all of the available webpages (starting from webages no. 1 – the above link shows the webpage no. 21175) and scrape/collect the following fields/informations:
- Club /Number (Clubname, shirt number)
- 2.Club / Number (Clubname, shirt number)
- League name
- Current national player
- Name
- Date of birth
- Height
- Nationality (Nationality 1, Nationality 2)
- Position
- Position details
- Foot
- International caps
- International goals
- Contract until
- Player’s agent
- Transfer history (Season, Month/year, from, to)
- Injury history (Season, from, until, Injury)
- Youth clubs
- Additional information
- Profile picture (if available)
I will provide a screenshot explaining all data to be scraped/collected.
2. I need the data in a excel file and the data needs to be 100% accurate. I also need the excel file to record the id number of the webpage (the number in the middle of the URL – for example in the above mentioned link it is the number 21175)
I will provide a sample of the excel file.
3. Terms of the structure for the excel file:
The excel file needs to start with the id number 1 (the number in the middle of the above link) and end with the last available profile (ID number). However, some of the webpages will not contain a profile but will have a “Error: This player does not exist!” message, so that for this webpage the id and the error message need to be statetd in the excel file as well.
I’m flexible as to what technology you use in order to do this. What I want as a deliverable for this project is:
A. All data/results from the website (starting from ID 1) as an excel file.
B. The finished script/application.
C. All data/results to be 100% accurate.
Please be sure that you would be able to do this project before bidding.
It can be regular project for execellent performers. There is further data to be scraped/collected from the above mentioned website as well as to be compared weekly/monthly with the already scraped/collected data.
Payment: Escrow
