We were quite a large group to start with, so we’ve ended up splitting in two. One group is working on scraping details of registered care homes, and I’m in a group working on information gathered but creating an interesting and informative visual.
Our first battle was making sure Scraperwiki could read our data so we could work with it.
First of all I uploaded to Google docs, but the comma separated values (CSV) scraper didn’t like it. Then when the spreadsheet was published as a web page, as suggested by it still wasn’t happy because it wanted to be signed into Google.
Francis Irving also suggested scraping What Do They Know, because it was Freedom of Information dat.
After much fiddling Matt managed to pull out the raw data by popping (pulling from the top of the list) and using a Python scraper.
It turned out the data we had was so unstructured it wasn’t possible to work with it.
After lunch we’re working on a different project.