Spiders Fixed
December 12th, 2009
I had a spider running on my site and the target website
has changed and or is blocking the script.
I am looking for a strategist who can get the script running again by changing the script to read the site correctly again and to bypass some blocking if thats what it is.
We can actually run it from a server in my office on Tor or similar if it comes to that.
There are around ten or more XXXXXXXXXX.php files involved in the crawler.
It checks for boats that are offline and updates the DB accordingly. It also checks for duplicate boats and so on.
Please check PMB for initial PHP code.
Site to be crawled is here.
http://www.wintel.co.jp/boat/detail/038-1_290.html
Categories: MySQL, PHP, Script Installation fixed, PHP, Script Installation, site, spiders, spiders fixed, the script
