Multimo

Researching multimodal discourses

Overview

One of the central features of digitally mediated communication is the incorporation of a variety of media types, histories, practices and genres as multimodal discourse. Such discourse draws on a range of disciplinary and interdisciplinary intersections and their traditions. While together these intersections may comprise a convergence of diverse contexts and contents, as digitally articulated communication they present different combinations, potentials and challenges.

Understanding how such a combinatorial discourse is constructed depends largely on how information systems design, communication design, and the contexts of social and cultural construction and use intersect. Such intersections offer potentially new forms and modes of articulation. Such articulation occurs principally via electronically linked screenspaces, not all of which are desktop monitors. MULTIMO investigates these by and through collaborative design.

MULTIMO includes the following projects:

• DesignEd
• Docudancing
• Extended+
• Fornem
• Karakuri
• Tapet

Aims

MULTIMO is designed to further the stategic investment in ICT related research at InterMedia and aim to develop interdisciplinary knowledge on methods for inquiry into multimodal multimediated discourse. We draw on production-based research and text based analysis, institutional change processes and curricular designs to realise these changes. Through a broad participatory approach to design as both process and product, MULTIMO investigates ways in which multimodal discourse may be made, mediated and analysed. Across the MULTIMO project, attention is to the spatial design of screen based generation and analysis of learning resources and modes of communication. Processes of improvising, devising, iterating and critical reviewing are incorporated into a process based approach to discourse and design. This approach allows for the investigation of digital discourses in-the-making. These methods are applied to both construction and documenting the shaping of ICTs as multimodal, multimediated communication. InterMediaLab (led by Ole Smørdal) is central to the design and implementation of the project.

Concepts

Multimodality is the core concept in MULTIMO. In terms of KIM, this concerns media and modes of discourse in electronic domains. MULTIMO draws on a range of concepts, theories and practices on multimodality. These include: integrated production based design (information systems, inter/disciplinary content, communication design); Actor Network Theory, Activity Theory, multimodal discourse theories, research on visualisation, participatory and adaptive design, performativity and practice-based research. Our main concern is with the modes and means of articulation. This articulation is primarily connnected to collaborative design processes but also to selected use by audiences and participants. Interdisciplinary analysis is key to positioning MULTIMO design practice and development as multimodal research.

Methods

A variety of methods are employed within and across the varius projects under MULTIMO. Experimental, collaborative and participatory design research approaches are used.

Publications & presentations

These are listed under each of the member projects (to your right) and grouped as a whole belwo with categories.

The main publication is:

Morrison, A. (in press). (Ed.) Inside Multimodal Composition. Hampton Press: Creshill NJ. 15 chapters. c. 450 pages. To see Contents.

Morrison, A. (in press). ‘Border crossings & multimodal composition in the arts’. In Morrison, A. (Ed.) Inside Multimodal Composition. Hampton Press: Cresskill NJ.

Morrison, A. (2005). ‘Border crossings and multimodal composition in the arts’. IJEDICT Vol 1 No 2.

Morrison A, Deacon A. & Stadler, J. (2005). ‘Designs for learning about film spectatorship’. In the Making. Proceedings of Nordic Design Research Conference. Copenhagen. 29 May–1 June. (See: Proceeedings, section on Design Education).

Pierroux, P. (in press). 'Guiding meaning on guided tours: narratives of art & learning in museums'. In Morrison, A. (Ed.) Inside Multimodal Composition. Hampton Press: Creskill NJ.

Publications on rhetoric, interfaces and research:

Liestøl, G. (in press). 'PowerPoint beyond hardware and software'. In Morrison, A. (Ed.) Inside Multimodal Composition. Hampton Press: Creskill NJ.

Fagerjord, A. (in press). 'Multimodal polyphony: analysis of a Flash documentary'. In Morrison, A. (Ed.) Inside Multimodal Composition. Hampton Press: Creskill NJ.

Morrison, A. & Skjulstad, S. (in press). ‘Mediating hybrid design: imaginative renderings of automotive innovation on the Web’. In Morrison, A. (Ed.) Inside Multimodal Composition. Hampton Press: Cresskill NJ.

Morrison, A. & Westvang, E. (in progress). ‘Interface rhetorics.’ To be submitted to Kairos. Draft version (not for citation).

Morrison, A. (2005). ‘Inside the rings of Saturn’. Special issue on the influence of Gunther Kress’ work. Computers and Composition. Vol. 22. No 1. 87-100.

Skjulstad, S. &  Morrison, A. (2005). ‘Movement in the interface.’ Computers and Composition. Vol. 22, No. 4. 413-433.

Skjulstad, S. (in press). 'What are these? Designers’ websites as communication design'.  In Morrison, A. (Ed.) Inside Multimodal Composition. Hampton Press: Creskill NJ.

Skjulstad, S. (2007a). ‘Clashing constructs in Web design’. In Melberg, A. (Ed). Aesthetics at Work. Unipub: Oslo. 81-103.

Skjulstad, Synne. (2007b forthcoming). ‘Communication design and motion graphics on the Web’. Journal of Media Practice.

Vagle, W. (in press). 'In the beginning there was only electricity, together with words, music and sounds'. In Morrison, A. (Ed.) Inside Multimodal Composition. Hampton Press: Creskill NJ.

Deacon A, Morrison A. & Stadler J 2005. ‘Designing for learning  through multimodal production:  film narrative and spectatorship in Director’s Cut’ IJEDICT Vol 1 No 1.

Morrison, A. 2004. ‘Artful  roles in blended learning: reflections on collaborative digital  arts and Zimbabwe’.  Paper presented at E/merge 2004. Blended collaborative learning in southern Africa. Online conference. Full  paper & presentation.

Related presentations:

Morrison, A. & Westvang, E. 2004. ‘Interface rhetoric.’ Designing Design Seminar Series. Research Mediation: Out of Composition. InterMedia, University of Oslo. 29 October.

Morrison, A., Skjulstad, S., & Smørdal, O. (2004). ‘Choreographing augmented space’. Proceedings of FutureGround International Conference 2004. Vol 2. Design Research Society/Faculty of Art and Design, Monash University: Melbourne. CD-ROM.

Stuedahl, D., Smørdal, O. & Morrison, A. (2004). 'Articulating knowledge from the Vikings to the digital age'. Proceedings of FutureGround International Conference 2004. Vol 2. Design Research Society/Faculty of Art and Design, Monash University: Melbourne. CD-ROM.

Skjulstad, S. 2004. Ballectro'. Designing Design Seminar Series. Research Mediation: Out of Composition. InterMedia, University of Oslo. 29 October.

Skjulstad, S. 2004. ”Flashback”: tracing developments from electronic paper to dynamic environments in the software Flash’. Paper presented at Future Ground Conference 2004, Melbourne Australia, 17-21 November. (Also in refereed proceedings)

Skjulstad, S. 2004. Ballectro'. Designing Design Seminar Series. Research Mediation: Out of Composition. InterMedia, University of Oslo. 29 October.

Westvang, E. 2004. Polarfront'. Designing Design Seminar Series. Research Mediation: Out of Composition. InterMedia, University of Oslo. 29 October.

Westvang, E. 2004. The Grey Data: linking links, politics and social software’. Designing Design Seminar Series. Interaction and Interface: Social Software. InterMedia, University of Oslo. 9 December.

Wiika, Ø. 2004. E-formats'. Designing Design Seminar Series. Concepts & Methods: finding frames. InterMedia, University of Oslo. 22 October.

Research blog (Docudancing project):

Docudancing: a weblog documenting the project Life & Death - Choreography in Context

Art installation (Tapet project):

Sem, I. & Havnør, M. 2007. Grenseflater. Commissiond piece for ITU 2007 Conference.

Related master's theses:

Havnør, Martin. 2006. A Conceptual Framework for Development Iterations of Digital, Interactive Art; System Response Patterns and Multi-Narrative Temporal Data Based Presentation. Unpublished Master’s thesis. Department of Informatics: University of Oslo.

Sem, Idunn. 2006. Practice-based Method. Exploring Digital Media through the Dynamics of Practice, Theory, and Collaborative, Multimedia Performance. Department of Media and Communication. University of Oslo: Oslo.