Archive

Posts Tagged ‘scraping tool’

Google Scraping Tool

November 7th, 2009 Comments off

We need a tool that will allow us to paste a list of keywords (into a text box, one per line) and then have that tool use the inanchor: command in Google, then scrape/return the number of results for each keyword.

For example: if you type the query inanchor:”Home Loans” into Google it will return this page

http://www.google.com/search?q=inanchor%3A%22home+loans%22&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a

This query shows that there are 16,700,000 results returned. That is the number that we need shown for each keyword in the uploaded list.

Wesite Scraping Tool

August 22nd, 2009 Comments off

hi,

I am looking for a script that will automatically scrape 3 property portal websites and place details onto my property portal site.

the 3 websites that will require to be scraped are www.rightmove dot co dot uk, www.s1homes dot co dot uk, www.lettingweb dot com. the website that i need the details to be put onto is www.lettog dot co dot uk.

The type of information required will be

agents details
property address
post code
no of bedrooms, bathrooms, garages
property type (house, flat etc)
for rent or for sale
short description
long description
price
availabilty date
all pictures

in admin section, i should be able to select when its scraped and how often (ie one or twice a day at 12am)
in admin, i also want to be able to select which agents i want to show on my site (ie if a site has 20 agents showing their properties, and i dont want agent xyz to have their properties shown on my site, then i should be able to deselect this agents properties to be scraped or saved)

Bear