nach oben

Technology, Knowledge and Learning

Erschienen in:

01.10.2011

Computing the Average Square: An Agent-Based Introduction to Aspects of Current Psychometric Practice

verfasst von: Walter M. Stroup, Thomas Hills, Guadalupe Carmona

Erschienen in: Technology, Knowledge and Learning | Ausgabe 3/2011

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

This paper summarizes an approach to helping future educators to engage with key issues related to the application of measurement-related statistics to learning and teaching, especially in the contexts of science, mathematics, technology and engineering (STEM) education. The approach we outline has two major elements. First, students are asked to compute an “average square.” Second, students work with an agent-based simulation that helps them to understand how aspects of the central limit theorem might be integrated into a much larger conversation about the appropriateness, or validity, of current psychometric practices. We are particularly interested in how such practices and interpretive frameworks inform the construction of high-stakes tests. In nearly all current high-stakes test development, tests are thought of as being built-up from individual items, each of which has known statistical properties. The activity sequence outlined in this paper helps future educators to understand the implications of this practice, and the sometimes problematic assumptions it entails. This instructional sequence has been used extensively as part of a core course in a university-based certification program in the United States (UTeach) recognized for its innovative approaches to developing a new generation of secondary STEM educators.

Nächster Artikel Design of Interactive Diagrams Structured Upon Generic Animations

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Of course other similar network tools can be used. We’ve also found the activity works well with students making a white-board sized histogram using adhesive notepads (e.g. Post-It™ Notes) with the value written on the front-facing side and the computing method written on the back.

There is not a sense in which this shortcoming in the use of this average might be appreciably improved by having a larger sample or by carrying out many more trials.

We set aside for now issues related to replacement. Humorously, one of our student suggested this aspect of the model might represent students who would freely elect to retake the course, “just for the fun of it,” in subsequent semesters.

In the history of intelligence research, the ascription of significance to the emergence of distinct “bell curves” has given rise to some rather incendiary racist claims (c.f., Herrnstein and Murray (1994).

Such relative ordering of responses “better … characterized” as reflecting “discrete classes or types of understanding” is discussed in a book titled Knowing What Students Know published by the National Research Council (NAP 2001, p. 126) as an instance of an ordered latent class model (p. 127). Using this kind of model, each class or mode of response “can be viewed as a point on a continuum” of performance (p. 127) or as a “quantitative parameter” reflecting a relative “degree of proficiency” (p. 151). At an even more basic level, simple dichotomous coding (“1” for a correct response and “0” for any of the wrong responses) also does exactly this (and most item response theory also assigns fine-grain significance to expected values between 0 and 1 for students of varying abilities). Mitchell (2009) discusses this move to assign such quantitative significance as the “psychometricians’ fallacy” that he says “occupies a central place in the paradigm of psychometrics” and consists of the tendency to conclude “that an attribute is quantitative from the premise that it is ordinal.”

Bandura, A. (1986). Social foundations of thought and action. Englewood Cliffs, NJ: Prentice-Hall.

Bransford, J. D., Brown, A. L., & Cocking, R. R. (Eds.). (2000). How people learn. Washington: National Academy Press.

Bruner, J. S., Goodnow, J., & Austin, G. A. (1956). A study of thinking. New York: Wiley.

diSessa, A. (1993). Towards an epistemology of physics. Cognition and Instruction, 10(2–3), 105–225.CrossRef

diSessa, A. (2000). Changing minds: Computers, learning, and literacy. New York: MIT Press.

Duckworth, E. (1987). The having of wonderful ideas. New York: Teachers College Press.

Garfield, J. (2002). The challenge of developing statistical reasoning. The Journal of Statistics Education [Online] 10(3). http://www.amstat.org/publications/jse/v10n3/garfield.html.

Halloun, I., & Hestenes, D. (1985). The initial knowledge state of college physics students. American Journal of Physics, 53, 1043–1055.CrossRef

Heidelberger, M. (1987). Fechner’s indeterminism: From freedom to laws of chance. In L. Kruger, L. Daston, & M. Heidelberger (Eds.), The probabilistic revolution (Vol. 2). Cambridge, MA: MIT Press.

Herrnstein, R. J., & Murray, C. (1994). The bell curve: Intelligence and class structure in American life. New York: Free Press.

Hills, T. (2003). Central limit theorem simulation. http://generative.edb.utexas.edu/projects/esmi/esmiapplets/applets21/centrallimittheorem.html.

Hills, T., & Stroup, W. (2004). Cognitive exploration and search behavior in the development of endogenous representations. Presentation and paper presented to the Annual meeting of the American Educational Research Association. San Diego, CA.

Hills, T., & Stroup, W. (2008). Exploring the central limit theorem further. http://generative.edb.utexas.edu/clt/Exploring_the_CLT_further_v01.

Holldobler, B., & Wilson, E. O. (1990). The ants. Cambridge, MA: The Belknap Press of Harvard University Press.

Mitchel, J. (2009). The psychometricians’ fallacy: Too clever by half? British Journal of Mathematical and Statistical Psychology, 62, 41–55.CrossRef

Nicoll, G., Francisco, J., & Nakhleh, M. A. (2001). Three-tier system for assessing concept map links: A methodological study. International Journal of Science Education, 23, 863–875.CrossRef

Novak, J. D., & Gowin, D. B. (1984). Learning how to learn. Cambridge: Cambridge University Press.

Pelosi, M. K., & Sandifer, T. M. (2003). Elementary statistics: From discovery to decision. Hoboken, NJ: Wiley.

Pham, V. (2009). Computer modeling of the instructionally insensitive nature of the Texas assessment of knowledge and skills (TAKS) exam. Unpublished Dissertation, The University of Texas at Austin.

Piaget, J. (1967). Biology and knowledge. Chicago: University of Chicago Press.

Piaget, J. (1970). The Child’s conception of movement and speed. New York: Basic Books, Inc. (Original work published in 1946).

Posner, G. J., Strike, K. A., Hewson, P. W., & Gertzog, W. A. (1982). Accommodation of a scientific conception: Toward a theory of conceptual change. Science Education, 66, 211–227.CrossRef

Reid, A., & Petocz, P. (2002). Students’ conceptions of statistics: A phenomenographic study. Journal of Statistics Education, 10(2). Online at: www.amstat.org/publications/jse/v10n2/reid.html.

Stroup, W. M. (1994). What the development of non-universal understanding looks like: An investigation of results from a series of qualitative calculus assessments. Technical report no. TR94-1. Cambridge, MA: Harvard University, Educational Technology Center.

Stroup, W. M. (1996). Embodying a nominalist constructivism: Making graphical sense of learning the calculus of how much and how fast. Unpublished doctoral dissertation, Harvard University, Cambridge, MA.

Stroup, W. (2009a). What Bernie Madoff can teach us about accountability in education. Education Weekly, 28, 22–23.

Stroup, W. (2009b). What it means for mathematics tests to be insensitive to instruction. Plenary Address delivered at the Thirty-First Annual Meeting of the North American Chapter of the International Group for the Psychology of Mathematics Education. Available at: participatorylearning.org.

Stroup, W. M., & Wilensky, U. (2000). Assessing learning as emergent phenomena: Moving constructivist statistics beyond the bell curve. In A. E. Kelly & R. Lesh (Eds.), Handbook of methods for research in learning and teaching science and mathematics (pp. 877–911). Dordrecht: Kluwer.

Stuart, H. A. (1985). Should concept maps be scored numerically? European Journal of Science Education, 7, 73–81.CrossRef

Swijtink, D. (1987). The objectification of observation: Measurement and statistical methods in the nineteenth century. In L. Kruger, L. Daston, & M. Heidelberger (Eds.), The probabilistic revolution, (Vol. 2). Cambridge, MA: MIT Press.

Vygotsky, L. S. (1962). Thought and language. Cambridge, MA: MIT Press.CrossRef

Wilensky, U. (1993). Connected mathematics: Building concrete relationships with mathematical knowledge. Unpublished doctoral dissertation, Massachusetts Institute of Technology, Cambridge, MA.

Wilensky, U. (1995). Paradox programming and learning probability: A case study in a connected mathematics framework. Journal of Mathematical Behavior, 14(2), 231–280.CrossRef

Wilensky, U. (1999). NetLogo. http://ccl.northwestern.edu/netlogo . Center for connected learning and computer-based modeling. Evanston, IL: Northwestern University.

Wittgenstein, L. (1953/2001). Philosophical investigations. Oxford: Blackwell, Part II, §xi.

Titel: Computing the Average Square: An Agent-Based Introduction to Aspects of Current Psychometric Practice
verfasst von: Walter M. Stroup
Thomas Hills
Guadalupe Carmona
Publikationsdatum: 01.10.2011
Verlag: Springer Netherlands
Erschienen in: Technology, Knowledge and Learning / Ausgabe 3/2011
Print ISSN: 2211-1662
Elektronische ISSN: 2211-1670
DOI: https://doi.org/10.1007/s10758-011-9187-9

Premium Partner

Marktübersichten

Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.

Zur Marktübersicht