May 092011

On Friday 25th March I attended the Scraperwiki Hacks and Hackers Day at BBC Scotland in Glasgow. As it turned out I was too busy taking part in the hacking to get my notes up on the day so this is a very belated “live blog” largely covering the opening and closing sections of the day. It’s also well worth looking the BBC videos of the day and the Official ScraperWiki blogging on the day.


Aine McGuire introduced the day. Hacks & Hackers Day Glasgow has been arranged by ScraperWiki, supported by BBC Scotland, the BBC College of Journalism and with prizes donated by the Guardian Open Platform.

Francis Irving was next up giving an introduction to Scraper Wiki (see also the video below)

YouTube Preview Image

Julian Todd, CTO of SraperWiki had started the site when wanting to know how his MP had voted. Other people were interested, and thus started TheyWorkForYou. Along with voting records some new data was added about divisions etc.

Continue reading »

Mar 242011

Tomorrow I am attending the ScraperWiki Hacks & Hackers Day Glasgow (#hhhglas) and thought I would gather some resources here on the blog for my own reference and for any fellow social media types who like to play around with mashing up various APIs, feeds, data etc.

ScraperWiki are the organisers for tomorrow’s events but I’m pretty new to ScraperWiki and most of my data munging experience has been with UNIX scripting and Perl (rather than Python or Ruby). I really do like the visual pseudocode experience of tools like Yahoo! Pipes but there are loads of online tools for transforming, manipulating and combining data and even Google Docs can be deceptively useful for working with data.

I gave a presentation at Haggis and Mash this year highlighting various EDINA APIs so for more information on our APIs and machine harvest-able services (not all listed below) take a look at my slides:

  • AddressingHistory API (Query 1765, 1865 and 1905 Edinburgh Post Office Directory data with geolocation info)
  • Jorum API (Access educational resources in Jorum based on collection, submitter, etc.)
  • Open Access Repository Junction APIs (information on HE and FE organisations and their repositories, mainly but not exclusively UK)
  • OpenStream API (Ordnance Survey Open Data products for UK HE – requires free registration)
  • Unlock (middleware service) lets you geocode text and placenames – you can do similar with the Data Science Toolkit

Obviously I have omitted a lot of very useful social APIs and tools like Google maps etc. I’ll try to add to this list with other (less obvious) useful APIs and tools but if you have some ideas for using any of the above or can recommend some great data or tools I should be trying out do leave a comment below.

 March 24, 2011  Posted by at 6:50 pm Social Media at EDINA Tagged with: , , , , ,  No Responses »