There are now just two weeks to go until ‘Documenting Performance’, our exploratory, interdisciplinary symposium on the concept of performance as a document, and the ideas, theories and practices around the documentation of performance. We are hoping that our initial event will spark further interest to form a longer term project, which we are calling DocPerform.

My initial feelings are positive, as for this event, both the response to our call for papers (27 abstracts, and I had to turn another couple away after the deadline) and the number of registered attendees (75) has been stunning. The event is now sold out, but we are running a wait-list so please email me [lyn@city.ac.uk] if you would like to come but have been unable to secure a ticket. If you are holding a ticket that you know you will not use, please cancel via Eventbrite, so someone else can join us.

We would like to say a very big ‘thank you!’ to everyone who has sent us ideas, and registered for the event. It was hard to make a choice about which papers to include, but I hope that everyone will agree that our Programme, showing the range of approaches to how we currently understand performance as a document, is pretty good! We are very excited about the day, and look forward to meeting new colleagues interested in documents and documentation.

My original idea was to host a series of seminars within our research centre, (Centre for Information Science) to examine how the conceptual view of the document is developing in the 21^st century. The question of what is / is not a document is considered in work of Otlet, La Fontaine, Briet, Buckland, Lund, Latham, Gorichanaz, Robinson and other writers within the field of library and information science, with the earliest papers having been  written at the start of the 20th century.  The obvious and fascinating question would be ‘what next’? I subsequently felt, however, that it would be helpful to take a step back, and to consider whether any unifying perspective could be applied to the increasing number of entities already extant upon the documentary landscape. Such a framework would be valuable to any discipline concerned with the organisation and preservation of its domain output, and could also be used to help formulate understanding of future document types, real or conceptual.

My working draft of such a framework is shown at the end of this post. Several colleagues contributed to my ideas, and I would like to mention them briefly as part of the background to our forthcoming event.

When my friend and colleague Prof Adrian Cheok joined City for a brief period, a few years ago, I was inspired by his work on the multisensory internet, (transmitting the sensations of taste, smell and touch in addition to sound and vision via the network), and this, plus developments in pervasive computing, wearable technology, human-computer interfaces and virtual reality, brought to mind the idea of the library as the ‘Experience Parlour’. I came across this idea in The Library of the Future, a book by Bruce Shuman, written in 1989. In his series of scenarios for the future library, he suggested one where reading a good book meant actually living, or experiencing it. I wondered if this form of immersive document was one possible future for documents, and consequently for libraries and other cultural, collection orientated institutions.

Whilst science fiction provides us with many depictions of immersive documents, (for example the holosuite in the Star Trek universe), at the present time fully-immersive documents, wherein the reader perceives a scripted unreality as reality, do not exist. However, many of the entities to which we refer as documents offer the reader a partially-immersive, or complex, experience. These documents provide the reader (broadly interpreted to include related terms player, participant, viewer, audience member) with a compelling and realistic world, but one which is delineated to varying extents from actual reality. The reader knows that they, and the document with which they are engaging, are a part of the real world (for want of a better phrase). This is in contrast to the experience delivered by fully immersive-document (as yet theoretical) where the reader cannot distinguish between the unreality and reality, and the interface between human and computer is invisible and frictionless.

A series of encounters over the past 3 years provided insight for developing a framework to help us understand what partially-immersive documents might be, and how they could relate to other documents.

Videogames

In June 2014, Adrian invited me to a seminar on the history of video games at the Daiwa Foundation. The enthusiasm with which players spoke of their interaction with early games indicated how strongly they identified with and enjoyed the ‘unreal’ worlds of the game. Whilst some games offered realistic environments, others offered clearly computer-generated spaces, yet the players still engaged time after time. Video games are an example of partially-immersive documents. They provide the ‘reader’ with a compelling world, but one which is clearly separate from reality. Even the most enthusiastic player knows the game world is constructed.

The playing of historical games was not the only point for consideration during the seminar; the issue of preservation was paramount, and discussion turned towards which characteristics of the games needed to be preserved. The list went beyond saving a copy of the software (computer program), conservation of its associated hardware or simulations of now-extinct computer operating environments, to ensuring that feelings, such as elation, despair, desire to win, anxiety, happiness or nostalgia, all possibly experienced by the player during the game, could also be guaranteed. The question then became more complex; are we attempting to preserve an historical game to be played afresh in a contemporary time, or are we attempting to preserve something more, by including something of the past environment, and even the experience/feelings of the player or players?

So, if we intend to record and preserve ‘experience or feelings’, do we mean that we are attempting to ensure that (re)playing the preserved game will generate the same sorts of feelings that were invoked generally in previous times, (when socio-cultural norms may have been very different) or are we attempting to reconstruct individual experiences of a game, exactly as they happened on a previous occasion, so that somehow the players or readers feel exactly the same as they did during a previous, specific occasion (for example the excitment of completing a level, or of a winning goal). If this latter reconstruction were technologically possible, it should also be possible to experience a game from the viewpoint of someone else, by replaying (and experiencing) their memory track, alongside the game timeline.

Experience is hard to define, and even harder to code for access and reuse. This level of enhancement to partially-immersive documents remains theoretical, but it is possible to imagine that a layer of ‘experience’, general or personal,  could be added to complex, or partially-immersive document formats. The concept of adding experience or feelings to a document, or record of a document (documentation), introduces the need for us to consider who the document or documentation is for. Whose point of view are we recording? Who are we thinking will access and use the record? In theory, a record could be made of every individual experience of every individual document, including the perspective creator(s) or author(s).

These concepts are reflected in recent developments in journalism, where 360 degree recording is used to film documentaries. The realistic, ‘immersive’ nature of these films enhances emphathy from the viewer, evoking feelings similar to those felt by those present at the time the recorded events took place.  See: Virtual Reality, 360 Video and the Future of Immersive Journalism, by Zillah Watson, 1st July 2015.

At this stage then, we have the concept that video games, or simple copies of video games are partially-immersive documents,  but that complex copies or recordings could also offer an additional layer of general ambience/sentiment, or personally specific thoughts and feelings. These enhanced copies, also partially-immersive documents, would be considered new documents in their own right, although associated with the original video game.

Interactive Narratives

At around the same time that I encountered the video games enthusiasts, I became aware of the convergence of video games with interactive fiction. These latter digital documents, which increased in popularity and number with the ready availability of consumer technologies such as smart phones and tablets, attempt to engage the reader by allowing input to, or participation in, the script. They offer interactive engagement across a range of platforms, and can reach out to the reader via texts, emails and phone-calls. Innovative software such as that which reads emotion from facial expressions can be used to tailor interactive fiction to the individual reader. The difference between an interactive fiction and a game is hard to specify, although one distinction I came across suggested that although many games have a narrative aspect to them, this is not required.

Interactive fictions are also partially-immersive documents, proferring experiences which are distinguishable from reality, yet which offer varying degrees of participation and immersion in compelling, unreal worlds. Like the worlds of video games, interactive narratives could be recorded with the intent to evoke time, place or other context specific feelings, or indeed the feelings or experiences from a given player at a given instance.

Documentation

Technologies which underpin partially-immersive (and perhaps eventually fully-immersive) documents such as video games and interactive fictions, can also be used to record, archive and preserve them. The most straightforward way to think of this is when making a copy of the unused software. In some ways, identical copies of video games or interactive fictions can be considered as documents which are the same as the originals; compare with FRBR‘s ‘manifestation’ level for books, where the copies differ only at ‘item’ level. If we are thinking, however, also to record the ‘experience’ of the player or ‘readers’, then in the addition of layers of information to the original computer programs we may be creating related, yet new documents. Documents which contain a level of immersion, (experience, feelings) associated with a given time or place, or reader, player, or creator.

Video games and interactive narratives can be considered to possess temporality. They arguably exist only whilst they are being ‘read’ or ‘played’. There is the question of whether the video game or the interactive narrative exists because its computer program is present on some kind of storage media, or whether it only exists when being played.

In contrast, a book or paper (probably also an audio record, or work of art), may be considered to exist as long as its physical form is extant, irrespective of whether or not someone is ‘reading’ it.  Yet we should also consider electronic books, digital audio files and digital art. Is ‘bookness’ then, a separate characteristic from representative media? Does a physical book only exist if someone is reading it? This is not a usual interpretation of a book, nor of a record or work of art. But the idea is important, firstly that the work exists as a separate entity from the physical, document-container, and secondly that thoughts, experience and memories can be added as an extra layer, at least theoretically. These additions then forge a new, albeit related, document.

If we consider then, that as a book is read by a reader, the reader is to some extent immersed in the book, the experience, thoughts and memories of the reader could, in theory, be recorded and stored in some format. Thus documents which we think of as physical or analogue can offer an immersive dimension,  although the participatory level would be considered rather less than that offered by a video game or interactive fiction. ‘Choose your own ending’ fictions might be considered to offer the most participation, for what we usually understand as a book.

The concept of analogue documents, in the spectrum leading to digital, partially-immersive and immersive documents is important, and needs to be part of any framework for understanding partially-immersive and immersive documents.

Immersive Theatre

The increasing popularity in London and other cities for immersive and participatory theatre brought performance to out attention, and to the mix of partially-immersive documents.

Performances proffer parallels with video games and interactive narratives, as they only exist for a given amount of time, and unless one counts their documentary containers, such as the written script, or computer programme and data records, they are intangible forms of document. With some similarities to a computer game or narrative, a performance can be replayed endlessly, as long as the performers are willing. The performance is experienced afresh each time, by new ‘readers’. However, like video games and interactive narratives, a performance can offer varying degrees of participation, and feelings of immersion. The memories and experience of a performance can be recorded and archived, from whatever viewpoint.

Several of my students were/are fans of immersive theatre, attending shows such as Punchdrunk’s ‘The Drowned Man’ and Thomas Otway’s ‘Venice Preserv’d’ several times over. I was invited to go along to a performance of Venice Preserv’d’ where I witnessed first hand the desire of the audience to participate in the show; they readily and willingly suspended reality to a significant extent. Again I thought of documentation, and how a performance could be regarded as a document being ‘read’ by the audience. To some extent, all performance is interactive/participatory, as the audience is reacting internally to the show even if they are sitting as passive observers. Some performance, however, offers the audience higher levels of interactivity, from singing along with the cast, to joining the actors for part of the show, and participating in the performance. Varying degrees  of participation in temporal events, also offered by video games and interactive fiction, are traits of partial-immersion, and a performance could therefore also be considered as a partially-immersive document. The boundaries of ‘what is a performance’ is a valuable discussion, but left for another occasion.

In the case of  performance, this raises the (unoriginal) question, that if the performance itself is a document, is documentation (recording) of a performance yet another document? And a further, also unoriginal question, does the documentation intended to reconstruct a performance actually create yet another performance? Would it be possible to recreat exactly a performance from the viewpoint of a ‘reader’ or audience member, in the same way as for recreating the exact experience of playing a video game at a particular time and place? We can consider too, the recording of a performance from the perspective of the creator, or of a performer.

When preserving or recording a performance then, are we documenting just the performance per se, or also the thoughts, feelings, and interactions of members of the audience? Should we attempt to garner something from the actors in each performance to improve the validity of the record? A performance is clearly more than something that can be represented by a script, photographs or a video recording. It is necessary, when documenting performance, to say something about temporality and participation (new to me, but of course unoriginal from other disciplinary viewpoints). We must distinguish between a record of somthing which is intended to be experienced for the first time by a reader, and a record which includes something of how it felt to have participated on a previous occasion. The embedding of thoughts and feelings within any sort of document has yet to be fully explored concepetually, as well as technologically.

Fandom

In September 2013, Ludi Price joined the Centre for Information Science as my research student, beginning her PhD on the information behaviour of cult media fans. Our work lead me to appreciate and consider the art of cosplay as a kind of performance, and thus a form of partially-immersive document. Clearly, there are links between cosplay and participatory theatre, and the question of should anything of this be documented, and if so how, appeared again.

Dance

Adrian invited Ludi and I to a talk he had arranged by the artist Choi Ka Fai, who was interested in recording patterns of the electrical signals which generate muscle contractions (is the body itself the apparatus for remembering cultural processes?). His idea was to attempt to record the movement of dancers, and to play them back on another dancer, to see if movement could be recorded and transmitted. If this were ever possible, it would allow one person to almost become another, experiencing not just a recording of a performance, but what it felt like to be part of it. This could in theory be one of the experiential layers added to the concept of the immersive or complex document, but the work so far remains experimental.

Immersive Documents

By this time, I had published two short papers on the concept of the multisensory, immersive document. Sarah Rubidge, Professor Emerita (Dance) at University of Chichester, came across these papers and subsequently contacted me. Sarah had been developing immersive, choreographic installations for two decades, and was interested in how to document such participatory experiential works beyond using words and photographs. Sarah’s ideas of using 360 degree camera recording or virtual reality to represent these forms of performance art were similar to my own ideas; that technologies such as VR, together with multisensory rather than merely multimedia recording, might allow us to more accurately document the experiential nature of performance and related works for future scholars, students and historians.

For the moment however, the work remains conceptual, as although 360 degree recording improves the visual experience of the record, multisensory recording, especially that related to the sensation of movement, is in its infancy.

Clearly if we could make a complete, multisensory recording of a performance, the recorded document could be read either to experience the work for the first time, or to experience it again as either yourself on a previous occasion, or as someone else.

Sarah also suggested that I attend the Digital Echoes Symposium at C-DaRE, the dance research group at Coventry University. Here I met several dancers and researchers, who were interested in the documentation and archiving of dance. One of these participants was PhD researcher Rebecca Stancliffe, who introduced me to a project called Synchronous Objects, where dance movements were converted into data, then into other objects for visual representation. Rebecca had found the work of Paul Otlet, and was working on the concept of what is a document from the discipline of dance, totally unrelated to LIS. The day was fascinating, and I learnt about new things to document, such as body memory, in addition to audience recollections and dancer insights. The way dancers perceive a performance, their work, is totally different from how traditional documentalists think of it.

Performance Art

Over the summer of 2016, I attended a course at the Tate Modern on Framing the Performance, led by Georgina Guy. Georgina led the class for four, weekly sessions, in which a group of us considered how Tate had displayed and documented a range of performance art installations. We were invited as a class to consider what we needed to know about a work, in order to store, archive, preserve, access, use and ultimately understand it. A fascinating field.

Data

My most recent encounter with partially-immersive documents came as I was preparing for one of my own classes, a session for a module called Data Information Technologies and Applications. The theme was data. In thinking about how to demonstrate data, I came across several artists whose work used a data input to bring into being a constantly changing visual artwork. See for example: http://www.worldprocessor.com/ . Participation then, does not only imply human input, but also that of data.

Interdisciplinarity

Alongside all of this, I undertook some further literature reviews, looking for work relating to documents, and documentation of performance, but from outside the LIS discipline. There was plenty. Performance artists from all fields, theatre, dance, music, performance art, were all represented in the literature on documenting performance. All these previously unimagined colleagues working on documents and documentation from a completely different background to LIS. I started to think about an event to bring the two cohorts together. On mentioning my interest to a friend, Tia Siddiqui, she put me in touch with a colleague of hers, from Rose Bruford college, Joseph Dunne, who had a background in performance, but who was also interested in documentation. I told Joe my idea of a symposium for both LIS and Theatre and Performance advocates, to share ideas on how performance can be regarded as a document, and how we can best record and preserve such partially-immersive entities for reuse if and whenever necessary.

Joe agreed to work with me on the idea, and our first collaborative outcome is this symposium ‘Documenting Performance’. The event sits within the wider consideration of the document by researchers at the Centre for Information Science, and specifically considers performance, although that is not to say video games, interactive fiction and other examples of partially-immersive documents such as performance art or information art do not warrant attention, but perhaps for another day.

Pulling all of these threads together, I think we can understand a partially-immersive document as one which affords the reader a compelling and engaging environment, for which the boundaries between reality and the imaginery, scripted world are blurred. These documents offer the reader a level of immersion and of participation. Such documents present in varied media formats, and some of their characteristics may overlap with those of fully-immersive documents. Partially-immersive documents are interesting, because they already exist, and because of the questions they raise in respect of description and indexing, recording, access, preservation and use. They push at the boundaries of traditional documentation and demand that we reconsider our definition of documents in the age of VR, AR and mixed reality. Documentalists need to embrace the characteristics of participation and experience in our work, if we wish to fully maintain the 21st century record of humanity.

Perhaps the most interesting aspect of performance as a document is the capture and recording of the thoughts and feelings of those participating, whether as reader, (audience member), performer or creator, alongside the more usual physical representations such as a script, or a video. Understanding and rendering of this immersive/participatory layer is arguably what will allow us to move forward in the documentation of performance, in that it will move us closer to the construct of an acutal performance from a given viewpoint, so that we can offer a reader a more perfect copy of an original experience.

A (Draft) Unifying Perspective for Documents

It is perhaps helpful at this stage to construct a unifying perspective which includes all documents, encompassing also those which are neither partially- nor fully-immersive. I think we need two further categories: physical/analogue documents, and digital documents. The latter category being comprised of counterparts to the physical entities, and also of born-digital works.

As a starting point for discussion, we now have a unifying framework comprising four categories of documents:

physical/analogue

digital

partially-immersive/complex

fully-immersive

Exact definitions of these categories, and the identification of any overlaps or non-sensical implications needs further work. It is likely that the definitive placement of a given type of document within any given category will be problematic, as the interpretation of a document type will suject to context and viewpoint.

At first glance, the main categories seem self-evident. We can, for example, notice two main, straightforward ways in which physical or digital documents may be differentiated from paritally-immersive or immersive works.

Firstly, they are stable documents which do not change. That is, that a physical book remains the same book over time, as does a digital text, or artwork. No input or participation from the reader is anticipated, or even possible, so the work remains as it was originally created, unaffected by input or participative interaction.

Secondly, physcial/analogue or digital documents do not possess temporal characteristics, apart from those associated with the natural decay which affects all material objects. In contrast to a performance or an exhibition for example, which reach an end point beyond which, arguably, they no longer exist.

The straightforward delineation between the categories of documents becomes subtly problematic however, if we think more closely about the concepts implied by the axes of characterisation. Although the book (physical or digital) demands no active participation, are we not participating by the mere act of reading and construction of the bookish world in our minds? When we refer to a document as a physical entity, are we not implying the container, in contrast to the idea, the informational content, or the ‘bookness’?

Consider also temporality. Is it possible, for example, that the interpretation of a text changes as the reader ages? Is the document or painting encountered as a child the same as that encountered by the same person, but in adult life?

Whilst further thought is necessary, we can suggest that within each of the four categories of documents,  further characterisation can be made by placing every document at a point along each of four axes:

temporality: the document exists for a limited time

tangibility: the extent to which the document has a material form

degree of input or participation required: the extent to which interaction is afforded

immersion: the extent to which reality is suspended

The exact understanding of, and the scale or values for these axes are as yet undefined. How does participation relate to immersion? One can surely be immersed in a document, whilst remaining un-participative. There is unquesionably more work to be done to understand the nature of documents and the processes of documentation, and the draft framework above is suggested as a tool with which we can  elucidate and explore concepts at a more specific level.

DocPerform

This symposium, focusing on performance, is a part of this work. It is the first of the documentation events at City, although it has grown into a collaborative event, somewhat larger than I originally envisaged.

The symposium is divided into three sessions. Firstly, we look at some existing projects in key memory institutions. Secondly, we examine less traditional aspects of performance which we could try to document, and finally we consider some newer types of performance and ways to understand what we should be documenting. We hope that you enjoy the day, and that it will encourage learning and cooperation from both fields of LIS and Theatre and Performance.

Note: This post was updated on 9/1/17 by LR