Tomorrow I am attending the ScraperWiki Hacks & Hackers Day Glasgow (#hhhglas) and thought I would gather some resources here on the blog for my own reference and for any fellow social media types who like to play around with mashing up various APIs, feeds, data etc.
ScraperWiki are the organisers for tomorrow’s events but I’m pretty new to ScraperWiki and most of my data munging experience has been with UNIX scripting and Perl (rather than Python or Ruby). I really do like the visual pseudocode experience of tools like Yahoo! Pipes but there are loads of online tools for transforming, manipulating and combining data and even Google Docs can be deceptively useful for working with data.
I gave a presentation at Haggis and Mash this year highlighting various EDINA APIs so for more information on our APIs and machine harvest-able services (not all listed below) take a look at my slides:
- AddressingHistory API (Query 1765, 1865 and 1905 Edinburgh Post Office Directory data with geolocation info)
- Jorum API (Access educational resources in Jorum based on collection, submitter, etc.)
- Open Access Repository Junction APIs (information on HE and FE organisations and their repositories, mainly but not exclusively UK)
- OpenStream API (Ordnance Survey Open Data products for UK HE – requires free registration)
- Unlock (middleware service) lets you geocode text and placenames – you can do similar with the Data Science Toolkit
Obviously I have omitted a lot of very useful social APIs and tools like Google maps etc. I’ll try to add to this list with other (less obvious) useful APIs and tools but if you have some ideas for using any of the above or can recommend some great data or tools I should be trying out do leave a comment below.