Tag Archive for 'rss'

Data portability allows mashup for Australian bush fire crisis

Last night in Australia, one of the states developed a series of bush fires that have ravaged communities – survivors describe it as “raining fire” that came out of no where. As I write this, up to 76 people have been killed.

Victorian AU Fires 2009
The sky is said by Dave Hollis to look how it is in the movie ‘Independence Day’

An important lesson has come out out of this. First, the good stuff.

Googler Pamela Fox has created an invaluable tool to display the bush fires in real time. Using Google technologies like App engine and the Maps API (which she is the support engineer for), she’s been able to create a mashup that helps the public.

She can do so because the Victorian Fire department supports the open standard RSS. There are fires in my state of New South Wales as well, but like other Fire Department’s in Australia, there is no RSS feed to pull the data from (which is why you won’t see any data on the map from there) It appears states like NSW do support RSS for updates, but it would be more useful if there was some consistency – refer to discussion below about the standards.

For further information, you can read the Google blog post.

While the Fire Department’s RSS allows the portability of the data, it doesn’t have geocodes or a clear licence for use. That may not sound like a big deal, but the ability to contextualise a piece of information in this case matters a hell of a lot.

As a workaround, Pamela sent addresses through the Google geocoder to develop a database of addresses with latitude and longtitude.

GeoRSS and KML
In the geo standards world, two dominant standards exist that enable the portability of data. One is an extension to RSS (GeoRSS) that allows you to extend an RSS feed to show geodata. The other in Keyhole Markup Language, which was a standard developed by Google. GeoRSS is simply modifying RSS feeds to be more useful, while KML is more like how HTML is.

If the CFA and any other websites had supported them either of these standards, it would have made life a lot more easier. Pamela has access to Google resources to translate the information into a geocode and even she had trouble. (Geocoding the location data was the most time-consuming of the map-making process.)

The lessons
1) If you output data, output it in some standard structured format (like RSS, KML, etc).
2) If you want that data to be useful for visualisation, include both time and geographic (latitude/longitude information). Otherwise you’re hindering the public’s ability to use it.
3) Let the public use your data. The Google team spent some time to ensure they were not violating anything by using this data. Websites should be clearer about their rights of usage to enable mashers to work without fear
4) Extend the standards. It would have helped a lot of the CFA site extended their RSS with some custom elements (in their own namespace), for the structured data about the fires. Like for example <cfa:State>Get the hell out of here</cfa>.
5) Having all the Fire Department’s using the same standards would have make a world of difference – build the mashup using one method and it can be immediately useful for future uses.

Pamela tells me that this is the fifth natural disaster she’s dealt with. Every time there’s been an issue of where to get the data and how to syndicate it. Data portability matters most for natural disasters- people don’t have time to deal with scraping HTML (didn’t we learn this with Katrina?).

Let’s be prepared for the next time an unpredictable crisis like this occurs.

Social media and that whole “friend” thing

Social media, is being killed not by fail whales , but social awkwardness. Facebook as a simple example – is everyone you add there really your "friend"? What’s a "friend", what ‘group’ do I put them in…it’s all very stressful. However bring into the mix social media services (sites where people collaborate, share content, discuss openly) and this stress becomes a real pain in the arse.
Twitter for example – you get alerts when people post a message. What happens when there is someone you know in real life, you are friendly with, but their Twitter stream is verbal diarrhoea? You force yourself to subscribe to them, because the social awkwardness matters more to you. Or Friendfeed, where people share links – it’s even worse. I would even go on to say it makes the service unusable.
Enter Google Reader, the tool I use to consume my online information habit. There is a feature that determines who e-mails you, and if they use Google Reader and share links, will come up along with your other subscriptions. It’s become such a valuable thing for me, that I now focus my attention on clearing items there ahead of my other few dozen subscriptions. The reason being, it’s the benefit of social media services without the social awkwardness.
Take Chris Saad, who was on my list. I didn’t like the things he shared – movie reviews – so I hid him. Up until now when a Google blog search will notify him (I expect him to find this and respond within 6 hours of posting this – watch!), he probably didn’t even know. However, if I was to unsubscribe from him on something like Twitter – he’d work it out – and say "dude, what’s the deal?". Because an inherent value of social media is that it’s collaborative communication; it’s just that too much communication from too many people can become more noise than signal.
This new age of mass collaboration is a massive thing, that I don’t think even the early adopters driving it, realise what’s happening. It’s the future of media – the fact people I know and trust will suggest articles, is the same human-powered recommendations the mass media have been doing -but so much more efficient, relevant and better.
And yet, Google Reader in its simplicity does it best – it’s almost like a secret. Mike Cannon-Brookes probably doesn’t even realise I track his shared links, but I love them because he reads a lot of RSS feeds on diverse subjects that interest me. Likewise, Kate Carruthers has such a diverse reading list I feel like I can whittle down my RSS subscriptions which stress me from having too much, and just get fed from her the good stuff.
Am I showing up in their field? Who knows. And quite frankly, who cares. I know I do for Brady Brim De-Forest, because he’s re-shared stuff I shared that I doubt he subscribes to (at least then). But that doubt detracts the fact it doesn’t matter. It’s a secret club – I go about clicking the "share" button for good content I come across, thinking perhaps someone follows them and would appreciate it. There’s no feedback mechanism, other than seeing other people encouraged to do the same. And this is the first time I’ve ever discussed the club openly. I think it exists. Maybe it doesn’t. But damn, it rocks.

Liako is everywhere…but not here

Life’s been busy, and this blog has been neglected. Not a bad thing – a bit of life-living, work-smacking, exposure to new experiences, and active osmosis from the things I am involved in – is what makes me generate the original perspectives I try to create on this blog.

However to my subscribers (Hi Dad!), let this post make it up to you with some content I’ve created elsewhere.

You already know about the first podcast I did with the Perth baroness Bronwen Clune and the only guy I know who can pull off a mullet Mike Cannon-Brookes of Atlassian . Here’s a recap of some other episodes I’ve done:

  • Episode two: ex-PwC boy Matthew Macfarlane talks to current PwC boy myself and Bronwen, in his new role as partner of a newly created investment fund Yuuwa Capital. He joined us and told us about what he’s looking for in startups, as he’s about to spend $40million on innovative startups!
  • Episode three: marketing guru Steve Sammartino , tells us about building a business and his current startup Rentoid.com
  • Episode four: experienced entrepreneur Martin Hosking shares us lessons and insight, whilst talking about his social commerce art service Red Bubble .
  • Episode five: “oh-my-God-that-dude-from-TV!” Mark Pesce joins us in discussing that filthy government filter to censor the Internet
  • Episode six: ex-Fairfax Media strategist Rob Antulov tells us about 3eep – a social networking solution for the amateur and semi-professional sports world.

I’ve also put my data portability hat on beyond mailing list arguments and helped out a new social media service called SNOBS – a Social Network for Opportunistic Business women – with a beginners guide to RSS . You might see me contribute there in future, because I love seeing people pioneer New Media and think Carlee Potter is doing an awesome job – so go support her!

Over and out -regular scheduling to resume after this…