Skip to main content
Top
Published in: Journal of Science Education and Technology 2/2016

09-11-2015

Podcasts on Mobile Devices as a Read-Aloud Testing Accommodation in Middle School Science Assessment

Authors: Don McMahon, Rachel Wright, David F. Cihak, Tara C. Moore, Richard Lamb

Published in: Journal of Science Education and Technology | Issue 2/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The purpose of this study was to examine the effect of a digitized podcast to deliver read-aloud testing accommodations on mobile devices to students with disabilities and reading difficulties. The total sample for this study included 47 middle school students with reading difficulties. Of the 47 students, 16 were identified as students with disabilities who received special education services. Participants were randomly assigned to three experimental testing conditions, standard administration, teacher-controlled read-aloud in traditional group delivery format, and student-controlled read-aloud delivered as a podcast and accessed on a mobile device, and given sample end-of-year science assessments. Based on a factorial analysis of variances, with test conditions and student status as the fixed factors, both student groups demonstrated statistically significant gains based on their testing conditions. Results support the use of podcast delivery as a viable alternative to the traditional teacher-delivered read-aloud test accommodation. Conclusions are discussed in the context of universal design for learning testing accommodations for future research and practice.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference American Educational Research Association (AERA), American Psychological Association (APA), the National Council on Measurement in Education (NCME) (1999) Standards for educational and psychological testing. AERA, Washington American Educational Research Association (AERA), American Psychological Association (APA), the National Council on Measurement in Education (NCME) (1999) Standards for educational and psychological testing. AERA, Washington
go back to reference Beddow PA, Elliott SN, Kettler RJ (2009) Test accessibility and modification inventory (TAMI) accessibility rating matrix. Vanderbilt University, Nashville Beddow PA, Elliott SN, Kettler RJ (2009) Test accessibility and modification inventory (TAMI) accessibility rating matrix. Vanderbilt University, Nashville
go back to reference Bolt SE, Thurlow ML (2007) Item-level effects of the read-aloud accommodation for students with reading disabilities. Assess Eff Interv 33(1):15–28CrossRef Bolt SE, Thurlow ML (2007) Item-level effects of the read-aloud accommodation for students with reading disabilities. Assess Eff Interv 33(1):15–28CrossRef
go back to reference Buzick H, Stone E (2014) A meta-analysis of research on the read aloud accommodation. Educ Meas Issues Pract 33(3):17–30CrossRef Buzick H, Stone E (2014) A meta-analysis of research on the read aloud accommodation. Educ Meas Issues Pract 33(3):17–30CrossRef
go back to reference Carlsson F, Mørkbak MR, Olsen SB (2012) The first time is the hardest: a test of ordering effects in choice experiments. J Choice Model 5(2):19–37CrossRef Carlsson F, Mørkbak MR, Olsen SB (2012) The first time is the hardest: a test of ordering effects in choice experiments. J Choice Model 5(2):19–37CrossRef
go back to reference Cline F, Cook LL, Stone E (2008) An examination of differential item functioning on grade 5 math and science assessments for students with disabilities. Paper presented at the 2008 Annual Meeting of the American Educational Research Association, New York, NY Cline F, Cook LL, Stone E (2008) An examination of differential item functioning on grade 5 math and science assessments for students with disabilities. Paper presented at the 2008 Annual Meeting of the American Educational Research Association, New York, NY
go back to reference Cohen J (1988) Statistical power analysis for the behavioral sciences. Erlbaum, Hillsdale Cohen J (1988) Statistical power analysis for the behavioral sciences. Erlbaum, Hillsdale
go back to reference Cook LL, Eignor DR, Steinberg Y, Sawaki Y (2008) Using factor analysis to compare the internal structure of a state standards-based math assessment. Paper presented at the 2008 Annual Meeting of the American Educational Research Association, New York, NY Cook LL, Eignor DR, Steinberg Y, Sawaki Y (2008) Using factor analysis to compare the internal structure of a state standards-based math assessment. Paper presented at the 2008 Annual Meeting of the American Educational Research Association, New York, NY
go back to reference Cormier DC, Altman J, Shyyan V, Thurlow ML (2010). A summary of the research on the effects of test accommodations: 2007–2008. (Technical Report 56). National Center on Educational Outcomes, Minneapolis, MN Cormier DC, Altman J, Shyyan V, Thurlow ML (2010). A summary of the research on the effects of test accommodations: 2007–2008. (Technical Report 56). National Center on Educational Outcomes, Minneapolis, MN
go back to reference Dawson L, Venn M, Gunter PL (2000) The effects of teacher versus computer reading models. Behav Disord 25(2):105–113 Dawson L, Venn M, Gunter PL (2000) The effects of teacher versus computer reading models. Behav Disord 25(2):105–113
go back to reference Dolan RP, Rose DH (2000) Accurate assessment through universal design for learning. J Spec Educ Technol 15(4):47–51 Dolan RP, Rose DH (2000) Accurate assessment through universal design for learning. J Spec Educ Technol 15(4):47–51
go back to reference Dolan RP, Hall TE, Banerjee M, Chun E, Strangman N (2005) Applying principles of universal design to test delivery: the effect of computer-based read aloud on test performance of high school students with learning disabilities. J Technol Learn Assess 3(7):3–31 Dolan RP, Hall TE, Banerjee M, Chun E, Strangman N (2005) Applying principles of universal design to test delivery: the effect of computer-based read aloud on test performance of high school students with learning disabilities. J Technol Learn Assess 3(7):3–31
go back to reference Elbaum B (2007) Effects of an oral testing accommodation on the mathematics performance of secondary students with and without learning disabilities. J Spec Educ 40(4):218–229CrossRef Elbaum B (2007) Effects of an oral testing accommodation on the mathematics performance of secondary students with and without learning disabilities. J Spec Educ 40(4):218–229CrossRef
go back to reference Farmer ME, Klein R, Bryson SE (1992) Computer- assisted reading: effects of whole-word feedback on fluency and comprehension in readers with severe disabilities. Remedial Spec Educ 13(2):50–60CrossRef Farmer ME, Klein R, Bryson SE (1992) Computer- assisted reading: effects of whole-word feedback on fluency and comprehension in readers with severe disabilities. Remedial Spec Educ 13(2):50–60CrossRef
go back to reference Fletcher JM, Francis DJ, Boudousquie A, Copeland K, Young V, Kalinowski S, Vaughn S (2006) Effects of accommodations on high stakes testing for students with reading disabilities. Except Child 72(2):136–150CrossRef Fletcher JM, Francis DJ, Boudousquie A, Copeland K, Young V, Kalinowski S, Vaughn S (2006) Effects of accommodations on high stakes testing for students with reading disabilities. Except Child 72(2):136–150CrossRef
go back to reference Flowers C, Kim D, Lewis P, Davis CA (2011) A comparison of computer-based testing and pencil-and-paper testing for students with a read-aloud accommodation. J Spec Educ Technol 26(1):1–12CrossRef Flowers C, Kim D, Lewis P, Davis CA (2011) A comparison of computer-based testing and pencil-and-paper testing for students with a read-aloud accommodation. J Spec Educ Technol 26(1):1–12CrossRef
go back to reference Fuchs LS (1999) Curriculum-based measurement: updates on its application in standards-based assessment systems. Council for Exceptional Children, Charlotte Fuchs LS (1999) Curriculum-based measurement: updates on its application in standards-based assessment systems. Council for Exceptional Children, Charlotte
go back to reference Haladyna TM, Downing SM (2004) Construct-irrelevant variance in high-stakes testing. Educ Meas Issues Pract 23(1):17–27CrossRef Haladyna TM, Downing SM (2004) Construct-irrelevant variance in high-stakes testing. Educ Meas Issues Pract 23(1):17–27CrossRef
go back to reference Hebert BM, Murdock JY (1994) Comparing three computer-aided instruction output modes to teach vocabulary words to students with learning disabilities. Learn Disabil Res Pract 9(3):136–141 Hebert BM, Murdock JY (1994) Comparing three computer-aided instruction output modes to teach vocabulary words to students with learning disabilities. Learn Disabil Res Pract 9(3):136–141
go back to reference Hogarth RM, Einhorn HJ (1992) Order effects in belief updating: the belief-adjustment model. Cogn Psychol 24(1):1–55CrossRef Hogarth RM, Einhorn HJ (1992) Order effects in belief updating: the belief-adjustment model. Cogn Psychol 24(1):1–55CrossRef
go back to reference Hollenbeck K, Rozek-Tedesco MA, Tindal G, Glasgow A (2000) An exploratory study of student-paced versus teacher-paced accommodations for large-scale math tests. J Spec Educ Technol 15(2):29–38 Hollenbeck K, Rozek-Tedesco MA, Tindal G, Glasgow A (2000) An exploratory study of student-paced versus teacher-paced accommodations for large-scale math tests. J Spec Educ Technol 15(2):29–38
go back to reference Individuals with Disabilities Education Improvement Act, 20 U.S.C. §1400 (2004) Individuals with Disabilities Education Improvement Act, 20 U.S.C. §1400 (2004)
go back to reference Johnstone CJ, Altman J, Thurlow ML, Thompson SJ (2006) A summary of research on the effects of test accommodations: 2002 through 2004. (Technical Report No. 45). National Center on Educational Outcomes, Minneapolis, MN Johnstone CJ, Altman J, Thurlow ML, Thompson SJ (2006) A summary of research on the effects of test accommodations: 2002 through 2004. (Technical Report No. 45). National Center on Educational Outcomes, Minneapolis, MN
go back to reference Ketterlin-Geller LR, Alonzo J, Braun-Monegan J, Tindal G (2007a) Recommendations for accommodations: implications of (in)consistency. Remedial Spec Educ 28(4):194–206CrossRef Ketterlin-Geller LR, Alonzo J, Braun-Monegan J, Tindal G (2007a) Recommendations for accommodations: implications of (in)consistency. Remedial Spec Educ 28(4):194–206CrossRef
go back to reference Ketterlin-Geller LR, Yovanoff P, Tindal G (2007b) Developing a new paradigm for conducting research on accommodations in mathematics testing. Except Child 73(3):331–347CrossRef Ketterlin-Geller LR, Yovanoff P, Tindal G (2007b) Developing a new paradigm for conducting research on accommodations in mathematics testing. Except Child 73(3):331–347CrossRef
go back to reference Kincaid JP, Fishburne RP, Rogers RL, Chissom BS (1975) Derivation of new readability formulas (Automated Readability Index, Fog Count, and Flesch Reading Ease Formula) for Navy enlisted personnel. (Research Brank Report 8-75). Chief of Naval Technical Training, Naval Air StationMemphis, Millington, Tenn Kincaid JP, Fishburne RP, Rogers RL, Chissom BS (1975) Derivation of new readability formulas (Automated Readability Index, Fog Count, and Flesch Reading Ease Formula) for Navy enlisted personnel. (Research Brank Report 8-75). Chief of Naval Technical Training, Naval Air StationMemphis, Millington, Tenn
go back to reference Laitusis C, Buzick H, Stone E, Hansen E, Hakkinen M (2012) Literature review of testing accommodations and accessibility tools for students with disabilities. Educ Test Serv, Princeton Laitusis C, Buzick H, Stone E, Hansen E, Hakkinen M (2012) Literature review of testing accommodations and accessibility tools for students with disabilities. Educ Test Serv, Princeton
go back to reference Lamb RL, Annetta L (2013) The use of online modules and the effect on student outcomes in a high school chemistry class. J Sci Educ Technol 22(5):603–613CrossRef Lamb RL, Annetta L (2013) The use of online modules and the effect on student outcomes in a high school chemistry class. J Sci Educ Technol 22(5):603–613CrossRef
go back to reference Lamb RL, Annetta L, Meldrum J, Vallett D (2012) Measuring science interest: Rasch validation of the science interest survey. Int J Sci Math Educ 10(3):643–668CrossRef Lamb RL, Annetta L, Meldrum J, Vallett D (2012) Measuring science interest: Rasch validation of the science interest survey. Int J Sci Math Educ 10(3):643–668CrossRef
go back to reference Lamb RL, Vallett D, Annetta L (2014) Development of a short form measure of science and technology self-efficacy using Rasch analysis. J Sci Educ Technol 23(5):641–657CrossRef Lamb RL, Vallett D, Annetta L (2014) Development of a short form measure of science and technology self-efficacy using Rasch analysis. J Sci Educ Technol 23(5):641–657CrossRef
go back to reference Landau S, Russell M, Gourgey K, Erin J, Cowan J (2003) Use of the talking tactile tablet in mathematics testing. J Vis Impair Blind 97(2):85–96 Landau S, Russell M, Gourgey K, Erin J, Cowan J (2003) Use of the talking tactile tablet in mathematics testing. J Vis Impair Blind 97(2):85–96
go back to reference Li H (2014) The effects of read-aloud accommodations for students with and without disabilities: a meta-analysis. Educ Meas Issues Pract 33(3):3–16CrossRef Li H (2014) The effects of read-aloud accommodations for students with and without disabilities: a meta-analysis. Educ Meas Issues Pract 33(3):3–16CrossRef
go back to reference McCullough CS (1995) Using computer technology to monitor student progress and remediate reading problems. Sch Psychol Rev 24(3):426–439 McCullough CS (1995) Using computer technology to monitor student progress and remediate reading problems. Sch Psychol Rev 24(3):426–439
go back to reference McKevitt BC, Elliott SN (2003) Effects and perceived consequences of using read-aloud and teacher-recommended testing accommodations on a reading achievement test. Sch Psychol Rev 32(4):583–600 McKevitt BC, Elliott SN (2003) Effects and perceived consequences of using read-aloud and teacher-recommended testing accommodations on a reading achievement test. Sch Psychol Rev 32(4):583–600
go back to reference Meloy L, Deville C, Frisbie DA (2002) The effect of a read aloud accommodation on test scores of students with and without a learning disability in reading. Remedial Spec Educ 23(4):248–255CrossRef Meloy L, Deville C, Frisbie DA (2002) The effect of a read aloud accommodation on test scores of students with and without a learning disability in reading. Remedial Spec Educ 23(4):248–255CrossRef
go back to reference Messick S (1989) Validity. In: Linn RL (ed) Educational measurement. Macmillan, New York Messick S (1989) Validity. In: Linn RL (ed) Educational measurement. Macmillan, New York
go back to reference No Child Left Behind Act of 2001, Pub. L. No. 107-110, 115 Stat.1425 (2002) No Child Left Behind Act of 2001, Pub. L. No. 107-110, 115 Stat.1425 (2002)
go back to reference Rose DH, Meyer A (2002) Teaching every student in the digital age: universal design for learning. Association for Supervision and Curriculum Development, Alexandria Rose DH, Meyer A (2002) Teaching every student in the digital age: universal design for learning. Association for Supervision and Curriculum Development, Alexandria
go back to reference Schörgendorfer A, Madden LV, Bathke AC (2011) Choosing appropriate covariance matrices in a nonparametric analysis of factorials in block designs. J Appl Stat 38(4):833–850CrossRef Schörgendorfer A, Madden LV, Bathke AC (2011) Choosing appropriate covariance matrices in a nonparametric analysis of factorials in block designs. J Appl Stat 38(4):833–850CrossRef
go back to reference Steinberg J, Cline F, Sawaki Y (2008) Examining the factor structure of a state standards-based assessment of science for students with disabilities. Paper presented at the 2008 Annual Meeting of the American Educational Research Association, New York, NY Steinberg J, Cline F, Sawaki Y (2008) Examining the factor structure of a state standards-based assessment of science for students with disabilities. Paper presented at the 2008 Annual Meeting of the American Educational Research Association, New York, NY
go back to reference Strangman N, Dalton B (2005) Using technology to support struggling readers: a review of the research. In: Edyburn D, Higgins K, Boone R (eds) Handbook of special education technology research and practice. Knowledge by Design Inc, Whitefish Bay, pp 545–569 Strangman N, Dalton B (2005) Using technology to support struggling readers: a review of the research. In: Edyburn D, Higgins K, Boone R (eds) Handbook of special education technology research and practice. Knowledge by Design Inc, Whitefish Bay, pp 545–569
go back to reference Temple C (2007) The effects of interactive read-alouds on the reading achievement of middle grade reading students in a core remedial program. (Doctoral dissertation). Retrieved from Dissertation Abstracts International. (Accession Order No. 3287381) Temple C (2007) The effects of interactive read-alouds on the reading achievement of middle grade reading students in a core remedial program. (Doctoral dissertation). Retrieved from Dissertation Abstracts International. (Accession Order No. 3287381)
go back to reference Thurlow ML, Thompson SJ, Lazarus SS (2006) Considerations for the administration of tests to special needs students: accommodations, modifications, and more. In: Downing SM, Haladyna TM (eds) Handbook of test development. Lawrence Erlbaum, Mahwah, pp 653–673 Thurlow ML, Thompson SJ, Lazarus SS (2006) Considerations for the administration of tests to special needs students: accommodations, modifications, and more. In: Downing SM, Haladyna TM (eds) Handbook of test development. Lawrence Erlbaum, Mahwah, pp 653–673
go back to reference Tindal G, Heath B, Hollenbeck K, Almond P, Harniss M (1998) Accommodating students with disabilities on large-scale tests: an experimental study. Except Child 64(4):439–450 Tindal G, Heath B, Hollenbeck K, Almond P, Harniss M (1998) Accommodating students with disabilities on large-scale tests: an experimental study. Except Child 64(4):439–450
go back to reference VanGetson GR, Thurlow ML (2007) Nearing the target in disaggregated subgroup reporting to the public on 2004–2005 assessment results. (Technical Report 46). National Center on Educational Outcomes, Minneapolis, MN VanGetson GR, Thurlow ML (2007) Nearing the target in disaggregated subgroup reporting to the public on 2004–2005 assessment results. (Technical Report 46). National Center on Educational Outcomes, Minneapolis, MN
go back to reference Winter PC, Kopriva RJ, Chen C-S, Emick JE (2006) Exploring individual and item factors that affect assessment validity for diverse learners: results from a large-scale cognitive lab. Learn Individ Differ 16(4):267–276CrossRef Winter PC, Kopriva RJ, Chen C-S, Emick JE (2006) Exploring individual and item factors that affect assessment validity for diverse learners: results from a large-scale cognitive lab. Learn Individ Differ 16(4):267–276CrossRef
Metadata
Title
Podcasts on Mobile Devices as a Read-Aloud Testing Accommodation in Middle School Science Assessment
Authors
Don McMahon
Rachel Wright
David F. Cihak
Tara C. Moore
Richard Lamb
Publication date
09-11-2015
Publisher
Springer Netherlands
Published in
Journal of Science Education and Technology / Issue 2/2016
Print ISSN: 1059-0145
Electronic ISSN: 1573-1839
DOI
https://doi.org/10.1007/s10956-015-9591-3

Other articles of this Issue 2/2016

Journal of Science Education and Technology 2/2016 Go to the issue

Premium Partners