award for art of cartography

The Ordnance Survey in collaboration with the British Cartography Society, have announced an award, the OS OpenData award, for work that spans art and cartography, using the hard data supplied in OS OpenData but combined with the flair of the creative individual.

The award celebrates the fact that “The creation of maps is a fusion of art, design, science and IT …”, reflecting some of the issues I’ve raised myself in recent posts such as “flowing cities – beauty in bits and buildings“, “maps in textiles“, and “Stilgoe on why precision is not always best” as well as general awareness of the importance of non-standard maps.

talking about Wales from south to north

Killington ReservoirI’m heading down south, for last trip before the walk, taking in five talks about the walk, from Southampton to Aberdeen, with Birmingham, Brunel and Birmingham between! I’ve also got meetings discussing it at Cardiff and Inverness, not to mention time at Talis and my future sun-in-law’s stag do!

Last night I stayed at the Days Inn at Killington Lake, near Kendal on the M6. It is rather cheaper than the hotel at Westmorland Services near Tebay (definitely the best motorway services in the country!), but as a view to wake up to may actually beat it.

Talk timetable

The talks are  all called ‘Treading Technology” with similar abstract to the first talk I gave in Swansea last autumn … although updating the slides a bit.

Mon, 18 Feb, 3pm, HCI Centre, University of Birmingham, (location G26 in Mech. Eng.)

Thurs. 21st Feb, DISC, Brunel University, London

Mon, 25th Feb, EECS, Uni. of Southampton

Wed, 27th Feb, Horizon, University of Nottingham

Thurs, 28th Feb, dot.rural, University of Aberdeen

I’ll also call into Ramblers Cymru and Cardiff School of Art and Design on Friday 22nd and University of Highlands and Islands on Friday 1st March, so if you are near any of these locations and fancy a chat, or dropping into one of the talks, give me a shout.

Stilgoe on why precision is not always best

Good article “You can have too much precision” on Guardian Geography blog by Jack Stilgoe picking up similar themes to my recent blogs on maps and mapping:

“The search for precision is a defining feature of scientific reductionism. But as our maps and models become more sophisticated, there is a danger that we lose track of why we have them.”

The text starts off looking at maps, including the Borges 1-1 map, but then applies this to climate science asking whether exactitude is more important than communication.

(cc) loronet@Flickr

Incidentally, if you don’t know the Borges story, it is repeated in the above post and basically is about the end of geography in mythical land due to the desire for ever and ever more exact maps, that are eventually the same size as the land being mapped.  The story ends:

In the deserts of the west, there are tattered ruins of that map, inhabited by animals and beggars

I have often thought that this would make a wonderful art project1, to literally make ragged fragments of 1-1 map and leave them in the locations they represent.  Anyone care to join me in this sometime (after the walk!), something you do in different places, sort of distributed-flashmob-like.

  1. Maybe my fascination with this is inspired in part by the 1966 television series “The Master“.  Two children are stranded at a secret base inside Rockall where an ancient scientist plans to take over the world. Deep in the heart of the base there is a chamber containg a huge map (not life sized, but BIG) where, at one stage, a minion is zapped to a charred patch by a giant laser.  The series was based on the novel “The Master: An adventure story” by T.H. White, but the episodes of the black-and-white TV series are now sadly lost.   [back]

flowing cities – beauty in bits and buildings

Flowing CityI have written quite a lot about the use of local maps that emphasise the identity of an individual or of a place.  However, there are also incredibly creative uses of maps that are more in the Cartesian tradition, combining geospatial data and digital mapping to creative visualisations that may be informative, subversive, beautiful and, at their best, all three at once.

As part of her master’s studies Margarida Fonseca has created Flowing City,  a stunning collection of visualisations of urban data1. From routes of Beijing cabbies, to galvanic skin response in Greenwich, and social network language in Milan, the examples Margarida has collected show the amazing ways different projects and individuals are remixing their own data, or publicly available data in order to make the often unseen patterns around us visible.

Urban computing with taxicabsGreenwich Emotion MapMaps of Babel

Many of the projects are by university research groups, but I’m also aware of many basic, but often transformative uses of data by simply mixing open data with Google maps or other similar technologies.  I’m wondering what it would be like if visualisations such as those found in Flowing City could be in the hands of every community group, urban or rural: campaigning for better transport, understanding education needs, preparing for floods.  But while pondering that I have downloaded a copy of Margarida’s thesis.

So, just browse the Flowing City site, compare with the Maps in Textiles I posted about a week ago: art and technology, the Cartesian and the idiosyncratic, may be not so far apart.

  1. Thanks @aquigley for sharing this link on Twitter. [back]

roots – how do we see ourselves spatially

I was looking through my blog and came upon the following post from 2011, which I’d forgotten about.  It seemed particularly relevant given my focus on both local maps and more personal maps such as Esther’s map in “maps of the imagination“. So I’ve reproduced it here.

Copy of “roots – how we see ourselves spatially” original post on my personal blog 2/11/2013

I was just reading the chapter on Benedict Anderson in “Key Thinkers on Space and Place1. Anderson forged the concept of a national imagination, the way nations are as much, or more, a construct of socio-cultural imaginings than physical topography or legal/political sovereignty.

However, this made me wonder whether this conception itself was very culturally specific, to what extent do people relate to nation as opposed to other areas.

I was reminded particularly of a conversation with, the much missed, Pierro Mussio. He explained to me the distinct nature of Italian cultural identity, which tends to focus on regional and local identity before national identity, partly because Italy itself is quite young as a nation state (a mere 150 years in a country which sees itself in terms of millennia). There is even a word “campanilismo”, which is literally relating to the “bell tower” (campanile) in a town, meaning one’s primary loyalties lie to that bell tower, that town, that community.

How do you see yourself? Are you British or Geordie, French or Parisian, American or New Yorker?

I know I see myself as ‘Welsh’. Wales is part of Britain, but my Britishness is secondary to Welshness. I was born and brought up in Bangor Street, Roath Park, Cardiff, but again while the street, area and city are foci of nostalgia, it is the Welshness which seems central. For Fiona she is Cumbrian (rather than Wetheral, English or British), Steve who is visiting is British, but says his brother would say Scottish, despite both having spent equal amounts of time in Scotland whilst growing up and since.

I asked people on Twitter and got a variety of answers2, most quite broad:

“I always think English rather than British but I don’t have a more specific area to identify with.”

“I think I primarily think of myself as both “Brit” & “northerner”. Lancastrian when differentiating myself from Yorkshire lot!”

“in decreasing granularity I’m a Devoner (south, of course!), west country-er, English, British, European, World-ean.”

Some less clear:

“I’m confused specially. I am Coloradan and American by birth, but feel more at home in England, and miss Scotland.”

“ooh, complicated. I’m British but not English. that’s as specific as I get.”

The last perhaps particularly interesting in its focus on what he is not!

Obviously the way we see ourselves varies.

The choice of a ‘level of granularity’ for location reminds me a little of the way in which we have some sort of typical level in a classification hierarchy (I think Lakoff writes about this); for example you can say “look at that bird”, but not “look at that mammal”, you have to say “look at that dog” or “look at that cat”. This also varies culturally including subcultures such as dog breeders – saying “look at that dog” in Crufts would hardy sound natural.

Some cities have specific words to refer to their natives: Glaswegian, Geordie, Londoner; others do not – I was brought up in Cardiff, but Cardiffian sounds odd. Does the presence of a word (Cumbrian, Welsh) make you more likely to see yourselves in those terms, or is it more that it is that, where cities have forged a strong sense of belonging, words naturally emerge … I sense a Sapir-Whorf moment!

Now-a-days this is even more contested as loyalties and identities can be part of networked communities that cut across national and topographical boundaries. In some way these new patterns of connection reinforce those focusing on human relations rather than physical space as defining countries and communities, but of course in far newer ways.

However, it also made me think of those parts of the world where there are large numbers of people with problematic statehood. There is how we see ourselves and how states see us. We tend to define democracy in terms of citizenship, and laud attempts, such as the Arab Spring, that give power to the people … but where ‘people’ means citizens. In Bahrain the Shite majority are citizens and therefore their views should be considered in terms of democracy, whereas the migrant workers in Libya fleeing the rebels in the early days of the recent Libyan war, or the Palestinians in Kuwait during the first Gulf War were not citizens and therefore marginalised.

Defining citizenship then becomes one of the most powerful methods of control. This has been used to powerful effect in Estonia leaving some who had lived the country for fifty years effectively stateless, and, while not leaving people stateless, in the UK new rules for electoral registration could leave up to 10 million, principally the young and the poor, voteless.

In the days of the nation state those with loyalties not tied to geography have always been problematic: Gypsies, Jews before the establishment of Israel, the various Saharan nomad trades. Many of these have been persecuted and continue to suffer across the world, and yet paradoxically in a networked world it seems possible that pan-national identity may one day become the norm.

  1. I’ve got 1st edition, but 2nd edition recently come out.[back]
  2. Many thanks for those who Tweeted responses.[back]

Maps in Textiles

Fiona pointed me to the wonderful web site of Valerie S. Goodwin, who creates quilts based on maps of real places and cartographic themes – stunning.

    

She also has a page listing other map-inspired artists, I visited a few and they were a joy too.  It is interesting that just as anodyne Google mapping is taking over the web, artists are reclaiming the medium and creating vibrant and individual images of real and imagined places.

Workflowy as CMS

Although this is a WordPress blog, the bookshelf section I added last week is generated from a Workflowy list that Fiona created. Now Workflowy is a collaborative list-making web application, not a CMS or database, and yet effectively we are using it as exactly that.

While at first this seems odd, in fact it is:

  1. practically useful – we now have an automated workflow
  2. good from an interaction design perspective – Fiona is using an interface of her choice and with which she is familiar
  3. interesting academically – as an example of semi-structured data integration

With a gathering library of both existing books relevant to the walk and new presents at Christmas, I had been meaning for some time to share them on-line; not difficult, just needing time to collate details, scan covers, etc..  So, a few weeks ago I gathered together a pile of books, and then Fiona went through them scanning the covers and typing up details.  We had been using Workflowy to share a to-do list for the walk as Fiona has become a great Workflowy fan1. It was quite natural therefore for Fiona to simply type the book details into the shared Workflowy list as sub-items under the ‘list’ task.

Having gathered these details, the next steps on the to do list were:

  • design web page (together)
  • populate web page (Fiona)

However, I realised that once the information had been copied into a web page if there were new books or edits, then either Fiona would have to do everything new straight into the web page, or try to keep her list and the web page in sync by hand. Perhaps we could use a more dedicated bibliographic tool such as Mendeley, Zotero or LibraryThing, but why use another interface when Fiona was already using one she was clearly comfortable with?

So, no new interface, no re-editing of data into a different system, no keeping web page and list views consistent by hand, instead the relevant portion of the Workflowy list is exported, copied into a Dropbox text file and then a web-based processor picks up the data from the Dropbox file and transforms it live into the bookshelf web page on this site.  Fiona only ever edits the list and has to do the initial copying into the Dropbox file, and then everything else is automatic.

In fact one of the research agendas I have during the walk is data integration; trying wherever possible to link together existing data sources, or where I am creating new data or new applications, to make them linkable, reusable, etc.  I have noted with interest existing applications that follow these principles, for example, Social Hiking for linking together social media as a record of expeditions, and PlaceBooks that allow the collection of different sources to make mini mobile guides to areas.

  

I am also interested in the use of semi-structured data, using data the ways people naturally enter it rather than force them to use some sort of standard format. For example, the HCI Book 3rd edition site is generated by using hidden web pages edited using Dreamweaver templates, but then stripping the data back out of those templates to be remixed in different ways on the site (e.g. showing exercises collected in a section of their own, but also under each chapter).

In the last few years I’ve also looked at extracting structured data from CSV and spreadsheet files and point and click ways to create semantic ‘screen scrapers’ for web pages.  Indeed the BookNotes mini-app that I will be using to share book reviews and personal page-by-page notes is also based on lightly annotated plain text files placed in Dropbox2.

Traditionally computing has created interfaces and asked people to use them, effectively adapting themselves to the system.  User-centred design tries to ensure that these interfaces are designed around the users’ understanding and often based on their existing work practices.  Where there is semi-structured data already, we have the ultimate end-point of this, to simply use the existing formats that people have evolved for themselves and let the computer do the work to transform them into formats useful for automatic processing.

So, this was an opportunity to practice what I preach (!), if Fiona chose to put data into Workflowy, than that should be the ‘golden data’ and everything else flow from that.

So … a couple of hundred lines of code later, it works!

There was one small change to the raw data format to make it parsable: Fiona had used commas to separate title, author, publisher, etc., perfectly human readable, but some titles and publishers had commas in them, so this was changed to ‘;’.  Also ‘blank’ fields were denoted by using ‘;;’  Otherwise everything was parsed exactly as Fiona had originally entered it, giving the page as it appears now.  If more books are added, or edits made, all that is needed is to re-export the list to the Dropbox file and everything else is automatic.

Basically there are four stages:

stage 1 parse workflowy

Workflow allows lists to be exported either as formatted HTML or plain text.  The plain text format was sufficient, and this is pasted into the shared Dropbox file.

A share URL can be obtained for the file and this is used to configure the first stage. This is then parsed (approx 100 lines of code) to generate an internal data structure, shown below formatted as JSON.

[{
    "title": "list (Fiona)",
    "note": [],
    "children": [{
        "title": "set 1 walking philosophical",
        "note": [],
        "children": [{
            "title": "A Field Guide to Getting Lost; Rebecca Solnit; 
Canongate; 2006; 9781841957456",
            "note": []
        }, {
            "title": "The Wild Places; Robert Macfarlane; Granta Books; 
2008; 9781847080189",
        ...

stage 2 parse book list

Stage 1 is completely generic, books and sections are just items.  The next stage further parses this to create lists of books. The presence of ‘children’ (sub-items) is used to decide the difference between a section and a book, and then the title line of each book entry is split on the semi-colons.  There is a little tidying of the title for items with ‘(DVD)’ (i.e. media is not a book!) and to split the main title from subtitles (before and after the first ‘:’, ‘-‘ or ‘(‘), and a ‘slug’ is obtained from the main title to match with the image file names.

The code for this is approximately another 100 lines.  The result of this phase is a book specific data structure:

{
  "books": [],
  "sections": [{
    "title": "walking philosophical",
    "note": [],
    "books": [{
      "title": "A Field Guide to Getting Lost",
      "format": "book",
      "author": "Rebecca Solnit",
      "publisher": "Canongate",
      "date": "2006",
      "isbn": "9781841957456",
      "slug": "afieldguidetogettinglost",
      "slugpath": "set_1_walkingphilosophical\/afieldguidetogettinglost",
      "isbn13": "9781841957456",
      "isbn10": "1841957453",
      "note": []
    }, {
      "title": "The Wild Places",
      "format": "book",
      "author": "Robert Macfarlane",

stage 3 format book list

It is then a simple matter to format the book data structure as HTML:

stage 4 embed book list

Finally the HTML is embedded into the WordPress post using a shortcode:

[embedurl url='https://alandix.com/exec/alanwalkswales/parse-workflowy.php?
url={dropbox url}&format=innerhtml' class='embedbooklist' /]

bells and whistles

There are a few extra elements.  If a 13 digit ISBN is provided an equivalent 10 character form is created where it exists; this is in order to be able to generate Amazon links.

Also books can have notes added (see “She Won’t Get Far Her Bag’s Too Heavy” on the bookshelf) using Workflowy’s standard feature to add notes to any item.  If any of the lines in the note have a special code (:tag:), then this is added to the fields in the book’s JSON data structure.  This means that extra bits of structured data can be added as required (for example, if we wanted to point to an external cover image).  In particular the Workflowy note for “She wont get far …” is as follows:

Wonderful romp of a book … although at 1 mile an hour in the early stages, not necessarily a physical romp! A plain speaking northern lass, sets out on the South West Path, never intending to travel the whole way round – makes me feel well planned.
:booknotes: http://www.meandeviation.com/booknotes/note/ewv5OlmRBfKgMjaLX7exsA
:isbn10: 1466219416

Note as well as the text of the note the extra tag with the url of my BookNotes for the book.

and now …

It probably didn’t take longer to code this up than it would have to copy the data into a web page and edit it, but even if it did take a little longer3, now I know that the book list data can be manipulated any way I like 🙂  In addition, the first stage will work if there are any other kinds of information that fits nicely into Workflowy’s hierarchical structure; I am sure we will reuse it. And the Workflowy folk say that an API will happen sometime, so maybe everything will be a list!

But of course I’m already looking at the stage 2 and 3 code and thinking, that is basically JSON transformation and formatting, surely that could be made more declarative and generic, maybe the whole pipeline could be made reusable as a tool.

Certainly I’ll make the stage 1 Workflowy to JSON part available if anyone else would like to use Workflowy as CMS … watch this space

  1. Workflowy is a ‘just’ an outliner / list editor, and yet does this simple job remarkably well.  I wasn’t a PC user at the time, but I’m pretty sure one of the successful features of Norton Sidekick in the late 1980s was exactly a mini-outliner, but can’t find anything on the web about it — obviously too long ago![back]
  2. See “Designing APIs and Designing Value for an Education Graph” for more on the design of BookNotes[back]
  3. Yea, and I guess it probably it did, but that’s what geeks do![back]