Over the last year I have taken thousands of photographs whilst observing students and tutors from Edinburgh University's Architecture programme. At the beginning of this exercise I was mostly interested in recording what took place directly around assessment: preparing the portfolio, presenting work in a review exercise, practices around marking and moderation. Over time though I have sought to capture a broader range of phenomena as I have looked towards sociomateriality as the critical lens for my Doctoral research. From initially focusing on the meaning making rituals of students and tutors around assessment, I have instead been looking to the ways that knowledge construction in the Architecture studio is a more complex entanglement of human, technological and other material interests. Or as Fenwick and Landri describe in their work around sociomaterial assemblages in education:
If I was initially guilty of viewing assessment in an overly simplistic way, as a fairly clear-cut exchange between student and tutor, sociomaterial critiques of education have instead encouraged me to examine the messy reality of what takes in and around the classroom, where 'learning is embedded in action and emerges through practice, processes that produce the objects and characteristics of educational events.’ (Knox and Bayne 2013). In this way assessment can be seen as a performance that depends on the student and tutor, but also looks to the role of curriculum, technology, sound, light, clothing and other visible and invisible actors within an evolving pattern of materiality (Fenwick et al 2011:8).
What this has meant in practice is that, as well as continuing to photograph students and tutors in the Architecture studio, I have pointed my camera down at the floor and upwards to the ceiling. I have crawled under desks and balanced on chairs. I have photographed and recorded the sounds of ventilation shafts, data projectors, corridor conversation. I have attracted troubled glances from students unfamiliar with my research. Without having yet commenced my analysis of the gathered data, a recurring theme to emerge from my photographs and also my written field notes, is the way that food and drink seem to be an integral part of what takes place in the studio. Alongside the more recognisable tools of the architecture student we find snacks: pencils next to a packet of peanuts; chocolate alongside cardboard; Rhino with Red Bull.
click on image to enlarge
Through the image above I have tried to show how my field notes and photographs resonate with some of the principle ideas around sociomateriality within education, in this case echoing work by Gourlay and Oliver (2014) where they offer a sociomaterial account of digital literacy practices:
For the purpose of further illustration I have included below a small selection images which would seem to reiterate Gourlay and Oliver's call to remain alert to the way that our use of digital resources in education, for instance around assessment, is always and inevitably entangled with a much broader range of resources, influences, limitations and opportunities beyond the interests of the assignment task.
click on images to enlarge
Digital sociomaterial journaling
Camera, recorder, scissors, brush: ethnography in a pop-up exhibition
Architecture, multimodality and the ethnographic monograph
The Assessment, Learning and Digital Education course, part of the MSc in Digital Education at Edinburgh University, sets out to explore how assessment is rapidly evolving in ways that exploit developments in digital technology and pedagogy. I'm glad to be a part of the course team, working with Clara O'Shea, Dai Hounsell and Tim Fawns. My major input to the course concerns multimodal assessment in digital contexts. Through the use of course readings, a discussion forum and an online seminar we explore ideas around digital literacies (see for example Lea & Jones 2011), the problematic nature of authorship (see for example Bayne 2006) and what happens when we newly introduce digital multimodal assessment into summative assessment (see for instance Adsanatham (2012) and De-Palma & Alexander (2015)). The recently re-designed assignment for this section of this course is a scenario-based activity where students are challenged to think critically about the conditions that support or exist in opposition to the introduction of richly digital multimodal assessment: I'm really looking forward to seeing what happens when students step into the tutor's shoes to advise colleagues on how to make digital multimodal approaches attractive and viable within the summative assessment setting!
For the recent online seminar, I took the approach that where we look to introduce richly multimodal assessment into courses or programmes that have been particularly essay-centric or language-based, we might find it helpful to look to existing approaches from colleagues in other parts of the campus, particularly within what we might call the creative disciplines. Within the seminar I talked about my own research where, for the last year, I have been undertaking an ethnographic study of meaning-making practices around assessment in Architecture. This research is already described elsewhere on this blog therefore I'll make do here with sharing my seminar slides, which interweave some of my observations from the Architecture studio, with the literatures around assessment and feedback, multimodal assessment and digital literacies.
What follows is a short video that gathers together images and sounds I collected around a pop-up exhibition by second year Architecture students. As I have explained elsewhere on this blog, I currently spend every Friday in the Edinburgh School of Architecture and Landscape Architecture where I observe students and tutors as they participate in teaching, learning and assessment. This ties in with my Doctoral research into multimodal assessment across the disciplines.
Across five hours last Friday (14 October) I made dozens of sound recordings and took hundreds of photographs as students set up the gallery, arranged models for display and finally attended an exhibition of their own work, where they were joined by tutors and other members of the architecture school. The work on display comprised more than 2000 models constructed over the first five weeks of the Architectural Design course. Situating myself in the gallery for the afternoon I was able to observe the small archipelago of buildings sprawl into a city-in-miniature, with a broad panorama of approaches and imagination on display. The quality of work can be seen within the images in the video, but is also heard in the excited laughter during the exhibition of work: listen carefully and you might hear a student expressing how proud she is of what the group had achieved.
Through the gathering of aural and visual data I wanted to make a record of the pop-up exhibition that would inform my research: a piece of video ethnography to represent what would have been hard to achieve through written description or images-in-isolation. In the unrehearsed setting of the pop-up exhibition however I was thrust into the role of general exhibition helper. As I swept the floor and cut display paper down to size I gained a better appreciation of what was taking place than would have possible had I sat on the outskirts. If the ethnographer’s main instrument is him- or herself, in this instance it was accompanied by camera and audio recorder, brush and scissors.
Architecture, multimodality and the ethnographic monograph
Looking beyond photos: the Architectural site visit
Listening to the street
For the duration of this semester I am spending every Friday in the Edinburgh School of Architecture and Landscape Architecture, observing students and tutors involved in an undergraduate course in Architectural Design. This ethnographic study mirrors my fieldwork in an American History course where I'm observing tutorials and lectures, all in support of my Doctoral research into multimodal assessment across the disciplines.
Each visit to the Architecture School begins a little before 9am with a meeting of the course tutors. They discuss teaching, assessment and other aspects of the course. There is coffee, conversation and a passionate commitment to subject and students. After that the tutors make their their way to the design studio to meet with their groups. The studio occupied by these second year undergraduates achieves the effect of feeling subterranean without in fact being below ground: as one of tutors ruefully put it when attempting to sell the space to her group: "There's a window at the far end - make sure you all get a chance to look out of it." From the uneducated perspective of the observer, the creativity and imagination demonstrated in the models, sketches and other examples of student work sits in stark contrast to the seemingly drab and claustrophobic studio space in which they are constructed or displayed. It is something of a relief then that studio time is interrupted by excursions out of the Architecture building. So far this has included a visit to the Fruitmarket Gallery to see an exhibition by Damian Ortega ("To get you to really think about how you present your work in the studio" as a tutor introduced the exercise) and more recently by a site visit to King Stables Road in the heart of Edinburgh.
The purpose of the visit to King Stables Road was to introduce students to the site for the architecture school they will design for their assessment exercise this semester. The group I followed were encouraged to spend time experiencing the environment that will be central to their thinking in the coming weeks and months. As we assembled in the shadow of Edinburgh Castle, the tutor encouraged the group to go beyond merely taking photos and to include time for discussing and reflecting upon what they experienced, in order that they would be able to make a visual, emotional response to the site ahead of the following week's tutorial. For the purpose of my own research I used my iPhone to gather some of the sights and sounds of the exercise, as the group navigated its way around the puddles, discarded wine bottles and polystrene takeaway detritus of King Stables road. I have collected the recorded images and sounds together within this short video:
While the video does the intended job of providing me with a record of the site visit, what it fails to do is adequately take account of the wider experience of the excursion, or the atmosphere in that particular corner of the city. This would seem to echo the tutor's instruction for students to talk and think about their surroundings, rather than rapidly traversing the site whilst gathering photos for later consumption. This emphasis on critical reflection-whilst-walking reminds me of the work of Dicks et al. (2006) where they introduced and critically considered the possibility of multimodal ethnography. Drawing on research where they investigated communication and meaning-making within a Science visitor centre, the authors reflected on the opportunities and limitations of gathering visual data, including photographs and video recordings. While these digital visual approaches were able to go beyond what it was possible to record using conventional field notes, they were insufficient in themselves to take account of movement and the materiality of a space. In response, the authors took to walking through the Science visitor centre in order to experience its ‘physical flow’ and ‘living, material, kinetic environment’ (2006:87).
As the architecture group made its way around the perimeter of the King Stables Road site all of the dozen students took photographs to a greater or lesser degree. In some cases this was augmented by making sketches, peering over walls and pausing to point out different aspects of the site. On another occasion around half of the group stopped for several minutes to variously take in the scene and enter into conversation. In this instance (which is seen and heard in the final photos in my short video), I would suggest that the students went beyond the gathering of photos to think about constructing meaning in-the-moment. Their gathering of photographic representations of the site was interspersed with discussion and then moments of silence as they seemed to reflect on what they could see, hear and feel around them. Perhaps the conclusion to draw here is that although photographs and video recordings provide a useful way of representing particular qualities of our surroundings, they cannot do justice to the sensation of being hit by water dripping from an overhead archway, or of the distinct aroma of last night's discarded take away and tonic wine.
Dicks B, Soyinka B and Coffey A (2006) Multimodal ethnography. Qualitative Research 6(1): 77-96.
Multimodal dérive in Amsterdam
Listening to The Street
Drawing to a close my recent study of the meaning-making practices of Architecture students, I’m about to make a final visit to the Edinburgh School of Architecture and Landscape Architecture to share the findings of my ethnographic research. It also gives me a chance to observe tutors as they work as a team evaluating the quality of the completed library project portfolios that students have spent the term working on. My invitation this evening has come from Douglas Cruikshank who generously let me spend time observing students and tutors as they participated in a second year course in Architectural Design.
I haven’t been quite sure how to pitch my presentation this evening, so I’m going to try and do three things. First of all I’m going to draw on my fieldwork report (my ethnographic study was partly a requirement of a course in Ethnographic Fieldwork that I commenced in January) where I argued that students and tutors enact power in the studio through the conscious use of space and silence. Second I’m going to use the visit as an opportunity to test out some ideas around multimodal meaning making in assessment, which directly aligns with the interest of my Doctoral research. Third, I’m going to try and give something more tangible back to the tutor team by discussing how the pedagogical approaches that I observed over the last three months sit in relation to what we might see as ‘best practice’ around assessment and feedback. Here are my slides:
To begin, I should make clear that it was never the intention of my research to critique the practices of tutors, or wider course design or delivery within the Architecture programme. Nevertheless, in the spirit of the ethnographer returning to the field site to share findings that might be important or of interest to his or her participants, I think it’s important to spend a little of bit talking about what I’ve seen. At the same time, this is neither a hardship nor a situation that I need to approach with trepidation, not least as there’s a very positive story to tell. Whether through intentional course design, intuition or luck (although I doubt that), the teaching approaches I have observed during the Architectural Design course would seem to sketch a representative picture of many of the strategies we associate with ‘best practice’ around assessment and feedback.
To illustrate this point, I’ve taken the example of the Review Lite, an approach used within the Architectural Design course to replace the intimidating and counter-productive ‘crit’ that has traditionally featured in visually-oriented creative programmes. Using an image I took during the Review Lite exercise I have attempted to show how ongoing tutor feedback, opportunities for experimentation, considering student attitudes, exposure to the work of peer, offering guidance on what represents high quality work - and other strategies - all come together to construct what would seem to on paper (and in my observed experience) to be a formative assessment experience that was highly conducive to learning.
Mapping the assessment and feedback literature on 'best practice' against the Review Lite exercise
Between January and March this year I spent time in Edinburgh University’s Architecture School, observing a second year Architectural Design course. Over ten weeks I observed students and tutors involved in an assignment concerned with the design of a library. My interest was in learning how meaning was constructed and conveyed within a creative degree programme. In particular I wanted to gain insights into the ways that tutors and students approached an assessment exercise where work would be conveyed across a range of resources.
Now that my ethnographic fieldwork has drawn to a close I have been invited to return to the Architecture School to share my findings. This has prompted me to spend some time thinking about what my experiences in the Architecture studio have to say about the relationship between multimodality and assessment and feedback within a creative setting. Looking back over my field notes and gathered photographs I have identified six themes which seem to stand out as being suggestive of the character of assessment and feedback in the Architecture Studio, as follows:
A recurring feature of the Architectural Design course saw students being encouraged to explore relevant themes through drawings and models, which they would then bring to class each week. These artefacts would form the basis of tutorial discussion, where tutors and students would reflect upon the ideas being conveyed through the work. The environment was supportive and students were encouraged to use the preparation of these models and drawings as a way of experimenting conceptually with the design of their library building. At the same time, part of this experimentation pushed students to develop and refine their practical skills: my field notes describe how Maria had been investigating what happened to resin at high temperatures (it burned) and that Ellen had been exploring shape through the use of candle wax. Yet even at this formative stage there was encouragement from tutors towards nicely rendered sketches, polished architectural plans and accurate models: conceptual work and quality of finish. In this setting ‘risk free experimentation' did not mean ‘carefree’: students were encouraged to be ambitious and to bring new ideas and approaches to class, but that their creative energy should be directed towards the the acquisition of understanding and technique which would support their final coursework. This included thinking about the combination of resources that would be most suited to the ideas they wished to convey.
This encouragement to be experimental was supported by feedback from tutors that was supportive and made use of dialogue that was in tune with the wider meaning-making rituals of Architecture. By 'In character' feedback I am suggesting that tutors engaged in a dialogue which displayed a symmetry with the approaches and artefacts that were the subject of discussion in class.
For instance, when Jack (tutor) wanted to suggest an alternative way for visitors to circulate through Han's proposed library, he sketched directly onto his architectural drawings. Similarly, when Akiko (tutor) wanted Karen to think more deeply about the use of light in her proposed library, she took a pair of scissors and cut through her model to create a cross section that we could all peer into. In each case (and many other similar examples) this was accompanied by an oral commentary. Ideas were constructed and deconstructed using the same techniques for creating and conveying meaning - sketching, modelling, speaking - that students had used to develop their work and will be expected to use in Architectural practice. In the Architecture studio feedback is multimodal as well as in concert with the subject matter and the audience’s needs.
From my fieldnotes, meaning was constructed and conveyed through: resin, acrylic, balsa wood, wire, wax, clay, plaster, card, wood, metal. Ink, paint, graphite. Ribbon, wool, netting. Light bulbs and scale plastic figurines. Hand-drawn sketches and computer-aided designwork. Photographs and architectural plans. Gesture, posture, eye contact. Voice. Space and silence. Printed type. Not all at the same time, yet always simultaneously drawing on a wide range of different resources (and more often than not, with words-on-page limited to playing a functional, descriptive role: ‘Scale 1:50’, ‘Elevation’). In the architecture studio meaning is constructed and conveyed in an array of richly multimodal ways, which in turn affects how tutors approach the task of marking assignments.
Compared to 'essayistic’ assessment, the rich multimodality of the Architecture portfolio places a greater emphasis on acts of interpretation, rather than more straightforward measurements of quality. Although the marking of a conventional written essay requires the tutor to interpret what is being verbally conveyed, the existence of longstanding conventions around linearity, voice, argument and evidence lend a structure for evaluating the quality of ideas. The portfolio however draws on a combination of resources which speak with a less well articulated language (or indeed, range of languages). And whereas the essay has a pre-fixed format, the tutor evaluating a portfolio is challenged to interpret meaning from a collage of different materials, as the student composer has more freedom to bring her individual interests and talents to the fore. The tutor has to take account of how the different resources come together in concert or collision to create meaning. With a greater attention to freedom and interpretation, it is easy to see why tutors might not wish to work alone when it comes to evaluating and grading coursework...
During the Review Lite exercise, students were divided into groups of three and then asked to circulate around the studio, reflecting on the designs being put forward by their peers. They jointly examined and discussed the ideas presented across the sketches and plans on display, before agreeing what they liked about the work and where they felt there was room for improvement. When it comes to assessing the final portfolios, tutors will work in pairs, moving around the studio and discussing how the presented artefacts sit in relation to the brief. In each of these examples the quality of ideas and work on display is evaluated through collaborative discussion between students or tutors. Through conversation and negotiation tutors arrive at an agreed position on how the collected models, sketchbooks and architectural drawings combine to address the assignment brief, followed by the grade that the work merits. When there is a high level of freedom in the representational form of the portfolio (for instance in the selection and use of materials and how they are configured in relation to each other) there would seem to be value in tutors working collaboratively to interpret and evaluate this highly multimodal work.
As well as providing room for experimentation and opportunities for dialogue, the high level of student-tutor interaction during the Architectural Design course also seems to plays an important role when it comes to grading the student's overall work. Whereas in many subject areas, and particularly those which heavily privilege verbal communication, marking looks at the submitted work in a form of isolation or separation, a different approach exists in Architecture. In order to account for the learning that has taken place it is necessary to consider how students have approached the preparation of their work, the decisions they have taken and the paths they have followed. The normal university conventions surrounding anonymous marking are waived as tutors necessarily take account of the process as well as the final portfolio that is submitted for assessment. As one tutor described to me, the sketchbook can often be more revealing of the work undertaken and progress made by the student, than the curated final portfolio. If architectural drawings offer an incomplete picture of the learning that has taken place, the time spent together in class affords the opportunity to reflect on process as well as the final product. If we accept that meaning is socially constructed and shaped by cultural circumstances and personal histories, it would seem to make sense for tutors look to evaluate the quality of the work within, as opposed to isolated from, that situation in which it was produced.
The six themes that I have described here represent an early attempt on my part to think about the relationship between multimodality and assessment & feedback within the Architecture Studio. Looking to the future I think it would be helpful to investigate whether the same approaches are a feature of other creative degree programmes. Before I do that however I will be sharing these findings when I return to the Architecture School next week. It will be interesting to see whether the Architectural Design tutors recognise the picture I have sketched of the meaning-making rituals that take place in their studio.
With thanks to Douglas Cruikshank and the tutors and students within the Edinburgh School of Architecture and Landscape Architecture. Photographs were taken with the consent of the featured students and tutors. Pseudonyms have been used in the place of student names.
Following a path which deviates from the central interest of my Doctoral research, I’m spending a bit of time this afternoon drafting a paper for the Vizualising the Street conference in Amsterdam this June. The conference is being hosted by the Amsterdam School for Cultural Analysis (ASCA) Cities Project and will explore the impact of contemporary practices of image-making on the visual cultures of the street. Along with my colleagues Jeremy Knox and Michael Sean Gallagher I will be arguing that in order to better understand the city we need to pay greater attention to the aural character of our environment. This isn’t about disregarding the visual, but instead asking what happens when we consider sound alongside sight, and what implications this has for our ability to ask questions about our relationship with the city.
That the aural character of urban space is under-considered is made loud and clear by Trevor Cox, Professor of Acoustic Engineering at the University of Salford. In Sonic Wonderland: A Scientific Odyssey of Sound, Cox proposes that:
The position Cox takes is built upon a career working as an acoustician, often attempting to understand and remedy the sonic deficiencies of spaces such as lecture theatres and grand concert halls. Amongst other things that we can take away from his work is that urban space both affects, and is affected by, sounds that reverberate between and within structures. I recently saw this point illustrated during a visit to Edinburgh University’s Architecture school where I observed students working on the design of a library building. Asked by the tutor to share their thoughts from a recent field trip to Rome, most of the group drew on notes to offer descriptive accounts of what they had seen. In contrast, one student, Alex, held his phone aloft and played two audio recordings he had made whilst walking the length of the prospective library sites. As he did this he provided a spoken commentary describing the changing nature of the soundscape as church bells came to the fore before being replaced by the bustle of a street market. This prompted us to consider how the library building might work in concert with the aural material of the city.
Still in Italy, in his essay Recording the City: Berlin, London, Naples, sound artist and composer BJ Nilsen describes how sound recordings provide us with high levels of detail whilst helping us to travel back to the field site.
Returning to the Visualizing the Street conference, the paper I am writing just now requires that Michael, Jeremy and I arrive a day ahead of the conference in order to get lost in Amsterdam, just as Nilsen describes in his wander around the pescheria in Naples. The route we choose to navigate through Amsterdam will certainly be influenced by the sights that grab our interest, however we’ll also have an ear closely tuned to the sounds coming from the courtyards, canals and cafes that we encounter as we attempt to draw meaning from the streets of Amsterdam.
Cox, T. (2004) Sonic Wonderland: The Science of the Sonic Wonders of the World. London: Vintage Books. pp. 16-77
Nilson, B.J. (2014). Recording the City: Berlin, London, Naples. In The Acoustic City, Gandy, M. and Nilson, B.J. (Eds). Berlin: Jovis Verlas. pp. 57-58.
EC1: Sights and Sounds
Architecture, multimodality and the ethnographic monograph
The Sights & Sounds of Portsmouth & Southsea
Over the last six weeks I have been undertaking participant observation in the Edinburgh School of Architecture and Landscape Architecture (ESALA) as I have sought to understand how students construct and convey meaning through their design work. This exercise is the subject of an assignment I am completing for an Ethnographic Fieldwork course, whilst at the same time being of direct interest to my Doctoral research where I am investigating multimodal assessment in higher education.
During each visit I spend time observing students as they work on the design of a library building. For the most part my notes have been in ‘text’ form (typed onto my laptop), supported by photographs of models, sketches and other examples of student work. These fieldnotes have worked up to a point, however they haven’t managed to recreate the atmosphere in the design studio: they are muted both figuratively and literally.
On my most recent visit to the design studio last Friday, I decided to complement the gathering of words and images, with sounds. To do this, I walked the length of the studio (and then back again) recording sound through the voice memo function on my phone. I wasn’t interested in recording full conversations, but was instead keen to capture the traces of laughter, music, dialogue and other sounds which contribute to the ambient personality of the studio. The subsequent task of ‘writing up’ my notes later the same day also called for a different approach from normal, as I pulled together a short video combining a representative range of audio and images, juxtaposed with extracts from my typed notes. This is what I came up with:
I think the orchestration of images, sounds and words has enabled me to represent the colour and vibrancy of the architecture studio in a way that I wasn’t previously able to achieve. I think this multimodal approach to data gathering and representation offers something different to the conventional monograph with its heavy privileging of words on page. That said, gathering and interpreting visual and aural data presents its own challenges - both practically and critically - and we should remember that photographs and sound recordings are neither neutral nor an accurate recreation of reality. Nevertheless, in light of Architecture’s interest in a wide range of semiotic materials, I wonder whether an ethnographic approach which pays due attention to the aural and visual, is a more apt way of investigating how knowledge is constructed and conveyed in the design studio.
A creative approach to demonstrating success
Urban flânerie as multimodal autoethnography
I am an ESRC-funded Doctoral student in the Centre for Research in Digital Education at The University of Edinburgh.