Elsevier

Computers & Education

Volume 54, Issue 2, February 2010, Pages 462-478
Computers & Education

A quantitative multimodal discourse analysis of teaching and learning in a web-conferencing environment – The efficacy of student-centred learning designs

https://doi.org/10.1016/j.compedu.2009.08.030Get rights and content

Abstract

This paper presents a quantitative approach to multimodal discourse analysis for analyzing online collaborative learning. The coding framework draws together the fields of systemic functional linguistics and Activity Theory to analyze interactions between collaborative-, content- and technology-related discourse. The approach is used to examine how the task subject matter, the activity design, and the choice of interface affected interaction and collaboration for a computing course conducted in a web-conferencing environment. The analysis revealed the critical impact of activity design on the amount and type of discourse that transpired. Student-centred designs resulted in over six times more student discourse as compared to teacher-centred designs and created a learning environment where students took greater ownership over the tasks and contributed more to the content-based discussion. The paper also incorporates a rationale for the approach to coding and a reflection on its efficacy for discourse analysis in technology-based learning environments.

Introduction

Studying computer-mediated communication facilitates understanding of communication patterns, forms, functions, conventions and subtexts, which can in turn engender an understanding of how people derive meaning within such contexts (Naidu & Jarvela, 2006). Recent emphasis in technology-based learning has shifted from a focus on more passive and individual learning of content to explore more student-centred and collaborative approaches to learning (Conole, 2007). However the use of networked technologies to enable collaborative learning provides no guarantee of improved outcomes, prompting the need for research to understand the factors that underpin their effective use (Naidu and Jarvela, 2006, Suthers, 2006).

Many contemporary online learning environments afford multimodal collaboration. For instance, web-conferencing systems such as Adobe Connect Meeting (Adobe Systems Inc., 2009), Elluminate Live (Elluminate Inc., 2009) and Wimba Classroom (Wimba Inc., 2009) offer a wide array of modalities for facilitating interaction and co-construction of knowledge, making these rich environments for studying collaborative learning. In such environments a multimodal discourse analysis methodology is useful in order to account for the multiple channels of communication being used. Analyzing a subset of collaborative modalities can lead to an incomplete understanding of how meaning is being made (Jewitt, 2006).

However there is a sparse literature about how multimodal collaborative learning environments are being used to facilitate learning. For instance, a search of the ERIC database as at 26th of August 2009 returned 31 references with the term “web-conferencing” in any field. However all but four of these were using the term to refer to more generic online collaboration (for instance using discussion boards) or only tangentially referred to the use of fully fledged web-conferencing systems. Only one of these papers proposed any recommendations for the way in which such systems are operated (Reushle & Loch, 2008). None of the articles had applied a systematic approach to researching the interactions of web-conferencing participants.

This study utilizes a quantitative multimodal discourse analysis approach to investigate the following research question:

How do the interface design, task type and activity design influence the amount and type of collaboration that occurs during learning episodes conducted in a web-conferencing environment?

By performing intertextual analysis between individual learning episodes, global results and learning design results were able to be derived. The quantitative approach provides a more objective means to detect and quantify cause-and-effect relationships, which can be used to complement established interpretivist multimodal discourse analysis approaches (Jewitt, 2006, Kress et al., 2001). The coding framework that will be demonstrated uniquely integrates Engeström’s (1987) Activity Theory framework with Halliday’s (1985) systemic functional linguistics.

Section snippets

Student-centred collaborative learning in online environments

The multimodal discourse analysis that will be described in this paper provides a means for examining the effect of more student-centred and collaborative pedagogies. The lack of interaction that online students have with their peers and teachers in distance courses is considered one of the major downsides of distance education (Perez Cereijo, 2001) and can significantly impact upon students’ satisfaction rating of their online courses (Chang & Smith, 2008). Increasing the level of student

The context

This study analyzed the in-class contributions and interactions of 26 students enrolled across three semesters of an online Graduate course in Information Technology at Macquarie University. Students were graduates from disciplines other than computing who wished to extend their Information Technology knowledge and skills. Of these students eleven were enrolled in 2005 Semester 2, eleven in 2006 Semester 1, and four in 2006 Semester 2. Students varied in age from 25 through to 56 years old, and

Results

The multimodal discourse analysis enabled results to be produced on several levels, including:

  • (1)

    Within learning episode results – findings relating to collaborations within a learning episode based on the learning design that was implemented.

  • (2)

    Global results – summaries of the entire dataset that serve to characterize teaching and learning collaborations across all 24 learning episodes.

  • (3)

    Learning design results – results stemming from considering how the dimensions of variation (interface, task type

Discussion

The quantitative multimodal discourse framework enables a profile of individual learning episodes to be developed, that can then be used to compare and contrast lessons conducted in multimodal learning environments. The approach also allows global results to portrayed and quantitative analysis to be performed in an attempt to measure the impact of independent variables upon collaboration. Significant results signaled important features of the data that could then be scrutinized using

Conclusion

In this implementation the multimodal discourse analysis approach provided a quantification of the extra contribution afforded by adopting student-centred learning designs in the web-conferencing environment, with a more than six fold increase in contribution as compared to teacher-centred approaches. Given that student interaction in online learning environments has been found to positively affect student achievement (Gao, 2001, La Pointe and Gunawarndena, 2004, Stavredes, 2002) and

References (59)

  • M. Bower

    Discourse analysis of teaching computing online

    Computer Science Education

    (2009)
  • S.-.H.H. Chang et al.

    Effectiveness of personal interaction in a learner-centered paradigm distance education class based on student satisfaction

    Journal of Research in Technology in Education

    (2008)
  • Cheng, C. S., & Beaumont, C. (2004). Evaluating the effectiveness of ICT to support globally distributed PBL teams. In...
  • D. Churchill

    Teachers’ private theories and their design of technology-based learning

    British Journal of Educational Technology

    (2006)
  • R.C. Clark

    Multimedia learning in e-courses

  • G. Conole

    Describing learning activities – Tools and resources to guide practice

  • Elluminate Inc. Elluminate Live web collaboration software. (2009). <http://www.elluminate.com> Retrieved...
  • Y. Engeström

    Learning by expanding: An activity theoretical approach to developmental research

    (1987)
  • Gao, T. (2001). The effects of different levels of interaction on the achievement and attitudes of college students in...
  • C. Greenhow et al.

    Using activity-oriented design methods to study collaborative knowledge-building in e-learning courses within higher education

    Computer-Supported Collaborative Learning

    (2007)
  • C. Gunawardena et al.

    Analysis of a global online debate and the development of an interaction analysis model for examining social construction of knowledge in computer conferencing

    Journal of Educational Computing Research

    (1997)
  • K. Gwet

    Kappa statistic is not satisfactory for assessing the extent of agreement between raters

    Statistical Methods for Inter-Rater Reliability Assessment

    (2002)
  • M.A.K. Halliday

    An introduction to functional grammar

    (1985)
  • M.A.K. Halliday

    Things and relations – Regrammaticising experience as technical knowledge

  • F. Henri

    Computer conferencing and content analysis Collaborative learning through computer conferencing: The Najaden papers

    (1992)
  • S.C. Herring

    Computer-mediated discourse analysis: An approach to researching online behavior

  • J. Hollan et al.

    Distributed cognition: Toward a new foundation for human–computer interaction research

    ACM Transactionson Computer–Human Interaction

    (2000)
  • C. Jewitt

    Technology, literacy and learning – A multimodal approach

    (2006)
  • D.H. Jonassen

    Learning as activity

    Educational Technology

    (2002)
  • Cited by (46)

    • Learning and instruction in the hybrid virtual classroom: An investigation of students’ engagement and the effect of quizzes

      2020, Computers and Education
      Citation Excerpt :

      ; Blackboard), WolfVision and WebEx Collaboration Suite (Cisco Systems). Bower and Hedberg (2010) noted that in general such these platforms entails the following features: i.e. presentation delivery, screen-sharing, webcam, text-chat, whiteboard, file upload/download, polling, attendee list, and notepad. As described in the section on technological challenges, the loss of visual and audible cues often remain a struggle in previous studies.

    • A mixed methods study of graduate students' self-determined motivation in synchronous hybrid learning environments

      2016, Internet and Higher Education
      Citation Excerpt :

      ; Blackboard Inc., 2014), and WebEx Collaboration Suite (Cisco Systems Inc., 2014). Despite the wide array of vendors offering synchronous delivery solutions, Bower and Hedberg (2010) noted that each platform offers similar features: Presentation delivery — PowerPoint presentations or general documents

    View all citing articles on Scopus
    1

    Tel.: +61 2 98509894; fax: +61 2 98508674.

    View full text