aggregators - How do craigslist mashups get data? -
i'm doing research work content aggregators, , i'm curious how of current craigslist aggregators data mashups.
for example, www.housingmaps.com , closed www.chicagocrime.org
if there url can used reference, perfect!
for adravage.com use combination of magpie rss (to extract data returned searches) , custom screen scraping class populate city/category information used when building searches.
for example, extract categories could:
//scrape category data $h = new http(); $h->dir = "../cache/"; $url = "http://craigslist.org/"; if (!$h->fetch($url, 300)) { echo "<h2>there problem http request!</h2>"; exit(); } //we need category abbreviations (data looks like: <option value="ccc">community) preg_match_all ("/<option value=\"(.*)\">([^`]*?)\n/", $h->body, $categorytemp); $catnames = $categorytemp['2']; //return array of abreviations if(sizeof($catnames) > 0) return $catnames; else return $emptyarray = array();
Comments
Post a Comment