Craigslist Scraper/parser
November 16th, 2009
Needs to do the follow:
1. scrape all cities in craigslist
2. harvest all posts in Gigs, Computers
3. Scrape Title, post text
4. scrape contact information for each post
4. parse that data into the following fields, Title, Post text, Contact
5. Save that data to a folder specific to the city, then post title and date
6. needs to scrape this data with targeted delays and randomly so craigslist does not ban it
Please respond if you know precisely what I am talking about and have experience scraping/parsing data.
Best,
Mr. Pines
