Teach Reading, Not Testing: Best Practice in an Age of Accountability
Publication Year: 2012
Teaching IS rocket science—and you are the pilot!
Teach Reading, Not Testing reinforces what teachers already know–test preparation worksheets and drill-and-kill activities do not make children into lifelong readers. The authors' conscientious approach to reading instruction combines an insider perspective on the development of high-stakes tests with classroom experience in achieving successful reading outcomes at the elementary and secondary levels. Their research-based methodology, building on teachers' expertise about best practice, is based on five key components:
Aligning instruction to the state or national core standards; Using formative assessment; Connecting units to real-world contexts; Motivating students effectively; Holding on to best practice in literacy instruction
Included are end-of-chapter quizzes and real-life scenarios, plus a full chapter on teaching literacy with special populations. Readers will find helpful solutions for teaching ...
- Front Matter
- Back Matter
- Subject Index
- Chapter 1: Conducting an Alignment Study
- Conducting an Alignment Study
- What is Alignment?
- Teaching to the Test: Just Say No
- Key Points to Remember
- End-of-Chapter Quiz
- Chapter 2: Using Formative Assessments
- What does Formative Mean?
- How are the Scores of Test Takers Analyzed?
- Differentiated Instruction
- Tests as a Snapshot: The Jacuzzi Metaphor
- Test Quality and District Assessments
- End-of-Chapter Quiz
- Chapter 3: Struggling Readers
- Accommodations versus Modifications
- Modifications and High-Stakes Tests: Alternative Assessments
- Accommodations and High-Stakes Tests
- Assistive Technology (AT)
- Response to Intervention (RTI)
- Differentiated Instruction (DI)
- English Language Learners (ELLs)
- End-of-Chapter Quiz
- Chapter 4: Attitude and Motivation
- Motivation Research
- Goal Setting
- What to do if Your Principal Wants to Use Pizza Parties to Bribe Students
- The Use of Practice Tests: Preparation or Motivation?
- Test Preparation: Analyzing Tests as a Reading Genre
- Communication with Stakeholders
- End-of-Chapter Quiz
- Chapter 5: Engaged Independent Reading
- Connect Your Reading Units to Real-World Contexts
- Teaching Students to Read for Pleasure
- Reading at Home: W.E.I.R.D.
- What's the Deal with Boys?
- Literature Circles and Book Clubs: What is Normal in the Real World?
- Best Practice for Book Clubs
- End-of-Chapter Quiz
- Chapter 6: Best Practice
- What do Quality Inservices Look Like?
- Theory and Practice at the Elementary Level: Best Practices Primer
- Know What Works for You
- End-of-Chapter Quiz
- Chapter 7: Implications for Your Teaching and beyond
- Holding Your Ground
- Test Misuse in the Early Days of Testing
- The Need for a Supportive Principal
- No More Teaching to the Test
- Next Steps
- Final Thoughts
Copyright © 2012 by Corwin
All rights reserved. When forms and sample documents are included, their use is authorized only by educators, local school sites, and/or noncommercial or nonprofit entities that have purchased the book. Except for that usage, no part of this book may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage and retrieval system, without permission in writing from the publisher.
All trade names and trademarks recited, referenced, or reflected herein are the property of their respective owners who retain all rights thereto.
Printed in the United States of America
Library of Congress Cataloging-in-Publication Data
Teach reading, not testing: best practice in an age of accountability/Liz Hollingworth and Hilleary M. Drake; foreword by W. James Popham.
Includes bibliographical references and index.
ISBN 978-1-4129-9773-7 (pbk.)
1. Reading (Elementary) 2. Motivation in education. I. Drake, Hilleary M. II. Title.
This book is printed on acid-free paper.
11 12 13 14 15 10 9 8 7 6 5 4 3 2 1
A SAGE Company
2455 Teller Road
Thousand Oaks, California 91320
Fax: (800) 417-2466
1 Oliver's Yard
55 City Road
London EC1Y 1SP
SAGE Pvt. Ltd.
B 1/I 1 Mohan Cooperative Industrial Area
Mathura Road, New Delhi 110 044
SAGE Asia-Pacific Pte. Ltd.
33 Pekin Street #02-01
Far East Square
Acquisitions Editor: Carol Chambers Collins
Associate Editor: Megan Bedell
Editorial Assistant: Sarah Bartlett
Project Editor: Veronica Stapleton
Copy Editor: Janet Ford
Typesetter: C&M Digitals (P) Ltd.
Proofreader: Dennis W. Webb
Indexer: Terri Corry
Cover Designer: Scott Van Atta
Permissions Editor: Adele Hutchinson
Foreword: Teachers’ Pets or Teachers’ Frets?[Page vii]
Educational Tests: Are they teachers’ pets or, these days, are they teachers’ frets? Putting it more prosaically, should today's teachers regard tests as the friends or enemies of their instruction efforts? This seemingly simple question, more potent than it first appears, requires a far-from-simple answer. Yet, providing a practical answer to the pet/fret puzzle is the central premise of an exciting new book about reading instruction by Liz Hollingworth and Hilleary Drake. Honestly, who could imagine a more propitious moment for a book about the teaching and the testing of reading to rumble onto our educational stage?
Let's face it, when it comes to the way most teachers currently view externally imposed educational tests, this could surely be characterized as “the worst of times.” Most teachers view large-scale educational tests—particularly those tests linked to federal or state accountability programs—as downright nuisances or worse. There's not the slightest hint that today's test-dominated schooling somehow can also be regarded as “the best of times.”
Droves of teachers now regard accountability tests as a bona fide blight on their educational landscapes. Externally imposed, most high-stakes exams are seen to constrain the curriculum, transform teaching into test-preparation, and remove much of the genuine joy that should be found in our classrooms. No, today's accountability tests do not rank high on most teachers’ popularity parades.
It is against this pervasive, profoundly negative backdrop that Hollingworth and Drake have set out to suggest how externally imposed accountability tests could have a positive impact on elementary teachers’ reading instruction. These two authors have, clearly, chosen a potentially sour cherry on which to chew. But, as will become clear while reading the Hollingworth-Drake book, there are magic classroom moments when, [Page viii]if teachers truly understand what's going on with the external tests being used, results of those tests can spur a teacher to adopt the sorts of instructional choices likely to benefit students.
At first glance, this seems to be a book about how to teach reading. But a closer look will reveal that it's a book about how to teach reading while dodging the adverse impact of inappropriate large-scale testing. Indeed, the book is peppered with suggestions about how to pick up positive payoffs from typical standardized reading tests. It's a book, in short, about how to use external tests as effectively as possible to enhance students’ reading skills.
In the book's early pages, the authors tell us they want their book to (1) provide teaching tips for elementary reading classrooms, (2) ensure that all students are prepared for high-stakes reading tests, and (3) show teachers how to supply such test-preparation without “teaching to a test.” Those are three laudable aspirations. But you'll also see another significant theme slithering in and out of the book's chapters. Hollingworth and Drake, you see, want young children to love reading.
That's right, these authors recognize not only the necessity for today's students to read—in school and once school is over—but also the immense pleasure that reading can bring to anyone who reads with reasonable comprehension. The book frequently reminds teachers how important it is to have students enjoy the act of reading. Whether children are reading a hardback book, a laptop computer screen, or the words wafted to them by tomorrow's next-generation electronic device—reading should gratify the reader. And, regrettably, readers’ gratification cannot be taken for granted. It, as with many covert variables, needs to be assessed.
Perhaps, if we put as much assessment energy into measuring students’ attitudes toward reading as we put into measuring students’ ability to spot a paragraph's main idea, we'd stimulate more teachers to engender positive reading attitudes along with higher test scores. We do, in truth, measure what we treasure. But if we only yammer about getting students to groove on reading, and never get around to actually assessing students’ attitudes toward reading, then we send a strikingly clear message that students’ attitudes toward reading really aren't important.
Hollingworth and Drake make a sincere effort to strip away the mystery from how large-scale reading tests are born. What few teachers recognize is that the most fundamental steps in the creation of an accountability test in reading are not remarkably different from what takes place when a teacher creates a classroom test of reading. Although reading tests typically emerge from big-box measurement companies—often behind closed doors—there's little going on when high-stakes reading tests are built that's incomprehensible to most teachers.[Page ix]
This new book is loaded with practical suggestions regarding how elementary teachers can do a niftier job with their reading instruction. Of particular merit is the authors’ early-on treatment of alignment. This is because their analysis of the necessary match among curricular aims, classroom instructional activities, and high-stakes achievement tests sets the stage for their subsequent recommendations regarding how to avoid “teaching to the test.” Indeed, one of the book's continuing themes revolves around how teachers can help students score well on externally required accountability tests without those teachers’ turning their classrooms into test-preparation factories.
Co-authored books often feature a pair of collaborating professors or, perhaps, two in-the-trenches teachers. In this book, however, we encounter a delightful blend of one university academic and one K-12 classroom teacher. It is clear that the assessment and instructional views of these two friends has, on occasion, been sharpened by the career experiences of their co-author. The result is a readable account of how teachers of reading can go about their work in a way that external tests can become, if not a flat-out friends, at least not lasting enemies.Emeritus ProfessorUniversity of California, Los Angeles, [Page x]
Liz and Hilleary met in August 2002 in a graduate class on Educational Measurement and Evaluation at the University of Iowa, just as the No Child Left Behind Act was becoming law. In that class, we sat alongside teachers, school counselors, and future psychometricians to learn about the promises and limitations of testing.
Since then, as reading teachers, we have watched with wonder and dismay as our colleagues have struggled with the pressures of the accountability movement.
This book is written using stories from both of our classrooms. We know for sure that standardized reading tests are designed to measure a student's ability to read. What confuses us is how educators confuse test preparation with content knowledge. We hope this book helps reading teachers sort through the differences.
The idea for this book stems from an article by Liz that was published in The Reading Teacher (Hollingworth, 2007), titled “Five Ways to Prepare for Standardized Tests Without Sacrificing Best Practice.” For the success of that article, we thank our friend and colleague, Janet Smith, a writing teacher for at-risk high schoolers and an excellent test editor.
Thank you to the fifth graders at Rendezvous Elementary in Riverton, Wyoming, for helping us think through some of our ideas from a kid-perspective.
A big thank you to Jim Stachowiak in the Iowa Center for Assistive Technology Education and Research (ICATER) lab for reading an early draft of Chapter 6, and for teaching the University of Iowa students every semester about the newest technologies to accommodate students with special needs.
We would also like to thank our colleagues at Iowa Testing Programs for welcoming us both into the educational measurement and statistics community, despite our literacy backgrounds and aversion to statistics and graphing calculators. We especially appreciate the coaching from [Page xii]Professor Timothy Ansley, Director of the Iowa Tests of Educational Development, who likes to joke at inservices with teachers that he's starting to feel like test development has become the Dark Side of the Force. Thank you to Dr. Gayle Babbitt Bray, Senior Reading Editor for the Iowa Tests of Basic Skills, for teaching us how to craft elegant reading tests.
Despite the help from friends and colleagues, the ideas and opinions expressed in this book are ours alone and should not be interpreted as any official statement or position of Iowa Testing Programs or the University of Iowa.
Liz would like to dedicate this book to the late Professor Albert N. Hieronymus, friend and former Director of the Iowa Basic Skills Testing Program from 1948 to 1987. Having been a classroom teacher himself, Al understood the value and importance of teachers (considering he met his wife when they were teaching together, and that several of his children and grandchildren grew up to be teachers and professors), and he envisioned the Iowa tests first and foremost as a tool to help teachers better meet the needs of their students. Al is a role model for the ways faculty in a college of education can impact public schools in a positive way through their research, teaching, and service.
Hilleary would like to dedicate this book to Mrs. Donna Kuhlman, her eighth-grade English teacher at Canyon Junior High School. Mrs. Kuhlman saw early on in the testing craze in Texas in the early 1990s that she needed to protect her curriculum, her instructional time, and her students from the frenzy of test preparation. She was a motivating, challenging, and inspiring educator who refused to succumb to the pressures of test preparation. She knew that her students deserved and were capable of so much more than just the minimum to pass the test. Thank you Mrs. Kuhlman, as both a student and now a teacher, for believing there was no better test preparation than fabulous teaching. You were (and still are!) so right.Publisher's Acknowledgments
Corwin gratefully acknowledges the contributions of the following reviewers:
- Kelly Aeppli-Campbell, K-12 Reading Supervisor
- Escambia County School District
- Escambia, FL
- Norma Barber, English Teacher
- Ukiah School District 80R
- Ukiah, OR
- Janice C. Brunson, Elementary Literacy Coordinator
- Stafford County Public Schools
- Stafford, VA
- Lorenza Lara, Secondary Literacy Coordinator
- Department of Teaching and Learning
- Denver Public Schools
- Denver, CO 80203
- Paula J. Leftwich, Senior Director, K-12 Curriculum and Instruction
- School District of Polk County
- Jim Miles Professional Development Center
- Lakeland, FL
- Sandy Moore, English Teacher
- Coupeville High School
- Coupeville, WA
- Kay Teehan, Literacy Coach/Media Specialist
- Bartow Middle School
- Bartow, FL
- Kristina Turner, English Teacher
- T.L. Hanna High School
- Anderson, SC
- Robert H. Williams, Jr., Associate Professor of English
- Editor, Virginia English Bulletin
- Radford University
- Radford, VA
About the Authors
Resource A: Answers to Quizzes[Page 105]
These Quizzes are designed to get you and your colleagues talking about best practice. If you want to assign yourself points, then give yourself 5 points if you said D, 4 points if you said E, 3 points for B, 2 points for C, and if you said A, then you don't get any points at all, because that was the worst answer! It's very possible that capitalization exercises will help fill the holes in Mrs. Brown's lesson plans. Once you have conducted your alignment study and had a team consultation with the other teachers in your area, you should have enough background information to analyze the data from the high-stakes test. Giving students practice items is not the same as teaching them the content.
These end-of-chapter quizzes are designed to get you talking with your colleagues. There are no right answers. When a school administrator like Mr. Clinton institutes a buildingwide initiative like this, he or she usually has decided that the way the teachers have been doing their job needs to be updated. In a case like this, the most open, mature, and collegial answer is B. Similarly, if you teach older students in an elementary building, you have a responsibility to advocate for their developmental needs. This includes asking the administration to consider option D, because baby work for older kids will get you nowhere. The teacher who answered A may be really frustrated with his or her job. Try to be supportive of district-wide school improvement initiatives until you have enough information to know how they are going to affect classroom practice. However, you may [Page 106]be in a building where the principal introduces a new initiative every semester. In that case, the best answer for you is to offer a gentle challenge to the principal in the form of C. If you answered E, you are not open to change. This might be because you are the only person in the building preserving best practice! In that case, the answer for you sadly just may be F.
This is actually a true story. My student, Joe, tried every single one of these during the course of his exam. Joe couldn't get the Dragon software to work well, so he became frustrated. After a half hour of trying to get it to work, he asked for help in the office. The school secretary was happy to type for him, but Joe wasn't used to dictating his thoughts to a live person. As a result, after about half an hour, he became discouraged at the quality of the work he was providing. By the time I stuck my head in to the office to see how he was doing, Joe had asked the secretary to leave and was typing with his left hand. He was visibly angry. At that point, I told Joe to just stop and tell me in his own words what he thought the answers were to the items. It took a lot longer to test him orally, but it turned out he really knew his stuff. The incident made me think about UDL, Universal Design for Learning, and asking students to write essays to demonstrate social studies knowledge. The next year, I had choices for a final project that included a written essay, as well as other end-of-course products that would let students demonstrate their learning, such as an interactive map using PowerPoint or to using the flip phone to make a movie reenacting an event from our history lessons.
Your school context is really going to affect how you handle this. Ideally, you should have an open relationship with your school administration, a relationship that allows for a conversation about the ways new initiatives are measured for efficacy. Some mix of D and E would be the best. If you decide that you are going to fully participate with this motivation program, in an effort to help your principal get the best data possible from this exercise, then your best answer is C. B is sort of a cop-out version of C. If you are going to participate, then go for it. The worst thing you can do is A, undermining the program before it even has a chance to get off the ground.[Page 107]
What is the purpose of your book clubs? Hopefully, your main objective is to provide students opportunities to engage in real-life reading activities. Of course, all of us have had a few students who, for whatever reason, needed to be split up to get any work done. But if it is at all possible, some combination of A and B would be the best answer to this scenario. Read the book titles, give the book talks, and then let the students choose what group they want to be in using whatever criteria they want, just as adults do—and maybe the girls just want to be with their friends. I often read books that excited friends give me, even if I might not think I will like the book. Remember: the goal is to encourage a lifelong love for reading.
Resource B: Five Ways to Teach Vocabulary[Page 109]
- Read, read, read! Most vocabulary words are learned from context. The more words you're exposed to, the better vocabulary you will have.
- Improve your context skills. Research shows that the vast majority of words are learned from context. To improve your context skills, pay close attention to how words are used. Get in the habit of looking up words you don't know. If you have a dictionary program on your computer, keep it open and handy. Use a thesaurus when you write to find the word that fits best.
- Practice, practice, practice! Learning a word won't help very much if you promptly forget it. Research shows that it takes from ten to twenty repetitions to really make a word part of your vocabulary. It helps to write the word—both the definition and a sentence you make up using the word—on an index card that can be reviewed later. As soon as you learn a new word, start using it. Review your index cards periodically to see if you have forgotten any of your new words.
Make up as many associations and connections as possible. For example, the word BUFFOON can be made to look like a clown, which is a synonym:[Page 110]
- Play with words. Have word games in your classroom for your students to use in free time. Some favorites are Scrabble, Boggle, Apples to Apples, Balderdash, Bananagrams, word searches, and crossword puzzles.
General Glossary of Assessment Terms[Page 111]
Accommodation: A change in the way a test is administered to students with special needs. In general, students are assessed on the same tests and the same curriculum material as the rest of the students. An example of an accommodation would be to allow extra time on an unspeeded (untimed) test or a quiet place with few distractions to take a test.
Accountability: Being responsible for one's actions within an educational system.
Achievement test: An assessment that measures what students know and are able to do in a curricular area.
Alignment: When what is being taught is aligned with what is being tested. Alignment can be reported as a matter of the degree to which a curriculum's scope and sequence matches a testing program's evaluation measures. Similarly, alignment can refer to the degree to which a teacher's instruction matches the given curriculum.
Aptitude test: An assessment that measures a student's ability to learn or acquire a certain skill or ability.
Assessment: Any method or procedure used to gather information about behaviors. Qualitative assessments use verbal descriptions of behaviors while quantitative assessments yield numerical estimates, or measurements.
Assistive technology: A device or service that may be used by a person with a disability to perform specific tasks, improve functional capabilities, and become more independent.
Authentic assessment: Assessment of student learning within the context of real-life problems and situations.[Page 112]
AYP: Adequate yearly progress. AYP is a diagnostic tool that determines how schools need to improve and where financial resources should be allocated.
Best practice: Curriculum instruction and assessment that can be supported by quantitative and qualitative research.
Bias: When a difference in test scores can be attributed to demographic variables like gender, ethnicity, or socioeconomic status.
Competency test: An assessment that measures whether or not a student has the minimum skills and knowledge in—for example, a driver's test.
Criterion referenced: Scores are reported as skills mastery, either as pass or no pass, for a level of performance on a skills continuum. A score depends on a preestablished standard or criterion.
Cut scores: Also known as a passing score or passing point. A single point on a score continuum that differentiates between classifications along the continuum. The most common cut score, which many are familiar with, is a score that differentiates between the classifications of pass and fail on a professional or educational test.
Differentiated instruction: Providing students with different approaches to acquire new material regardless of level of ability.
Disaggregate: Test scores can be analyzed either aggregated (as a big group, such as a district) or disaggregated, broken down into smaller chunks called subgroups and special populations (such as race, ethnicity, free and reduced lunch, etc.). NCLB requires schools to compare the scores of certain populations of students against one another to examine achievement gaps.
Enacted curriculum: The content actually taught by teachers and studied by students. It might stand in contrast to the intended curriculum.
Epistemology: The study of the acquisition of knowledge, the social reproduction of selected knowledge, and the consequences of the acquisition and use of knowledge.
ESEA: An acronym for the Elementary Secondary Education Act 1965. Authorizes funds for professional development, instructional materials, resources to support educational programs, and parental involvement. The Act was originally authorized through 1970; however, the government has reauthorized the act every five years since its enactment. The current reauthorization of ESEA is the No Child Left Behind Act of 2001.[Page 113]
Face validity: Whether or not a test looks like it measures what it says it is measuring.
Formative assessment: Provides feedback about errors and misunderstandings of a lesson. Usually used by classroom teachers to make adjustments to teaching, to adapt lessons, and to individualize instruction.
Grade equivalent: A score that indicates the performance level of a student on a norm-referenced test in terms of grade level and month: for example, 3.5 (third grade, fifth month).
Growth model: A way of measuring student achievement goals by measuring students’ progress from year to year.
Horizontal alignment: The degree to which an assessment matches the corresponding content standards for a subject area at a particular grade level.
Individualized education program (IEP): Students who receive special education and related services will have an IEP that is created by a team of teachers, administrators, parents, and often the student to make sure that the educational program is designed to meet the student's unique needs.
Intended curriculum: For K-12 education, the intended curriculum is captured most explicitly in state content standards—statements of what every student must know and be able to do by some specified point in time. It may stand in contrast with the Enacted Curriculum.
Interrater reliability: The extent to which two different people obtain the same result when using the same instrument to measure a student's achievement. Interrater reliability indices are expressed as a decimal from 0 to 1, with scores closest to 1 considered to be high.
Learning progressions: The sequence set of subskills a student will learn in a given unit of study.
Lexiles: A reliability score created by MetaMetrics, a company in North Carolina. Lexile scores often appear on score reports for high-stakes tests created for NCLB reporting purposes.
Modifications: A change to the curriculum when the goals or expectations are beyond the student's level of ability. The assessments for students with a modified curriculum will be fundamentally different from those of the rest of the class.
Multiple measures: Because no one test can ever tell you everything you would want to know about a student's knowledge, ability, or aptitude, [Page 114]educators use more than one piece of information to assess what a student knows and is able to do. Multiple measures include classroom assessments, portfolios, projects, and so on.
NAEP: An acronym for the National Assessment of Educational Progress (NAEP) is an assessment given to a nationally representative sample of school children in the United States to measure what students know and can do in mathematics, reading, and science for Grades 4, 8, and 12. The NAEP is created by the Institute for Educational Sciences (IES), a division of the U.S. Department of Education (created in 2002). The IES currently has contracted out the test development process to Educational Testing Service (ETS) in New Jersey.
No Child Left Behind (NCLB): An acronym for the legislation that was passed in 2001 in the United States that mandated that every state develop a set of standards for teaching math, reading, and science and have a system of assessment in place to measure student achievement and hold low-performing schools accountable for chronic poor performance.
Norm referenced: Compares examinee performance to the average performance of others in an identified reference group.
Performance assessment: Requires the demonstration of skill in applied, procedural, or open-ended settings. Performance assessments can be used to ask students to use knowledge from several areas to produce something.
Portfolio assessment: A collection of student work that reflects growth and breadth and includes student reflections.
Psychometrician: An expert in the theory and technique of educational and psychological measurement, which includes the measurement of knowledge, abilities, attitudes, and personality traits. A psychometrician holds expertise in the research and development of measurement instruments like questionnaires and tests.
Raw score: Score on an assessment before any statistical transformations have been made, such as the number correct.
Readability: A rough estimate of the reading skill required to read a text, usually presented as a grade level.
Reliability: The consistency of test scores on different items that cover the same skills or the consistency of an instrument by raters or observers.
Response to Intervention (RTI): An educational process that evaluates how well students respond to academic instruction, and then uses those student responses to guide educational decisions.[Page 115]
Scale score: Raw test scores are mapped onto a more meaningful and interpretable scale.
Standard setting: An official research study conducted by an organization that sponsors tests to determine a cut score for the test. To be legally defensible and meet the Standards for Educational and Psychological Testing, a cut score cannot be arbitrarily determined, it must be empirically justified. For example, the organization cannot merely decide that the cut score will be 70% correct. Instead, a study is conducted to determine what score best differentiates the classifications of examinees, such as competent vs. incompetent. Standard-setting studies are often performed using focus groups of five to fifteen subject matter experts that represent key stakeholders for the test. For example, in setting cut scores for educational testing, experts might be instructors familiar with the capabilities of the student population for the test.
Standardized: When tests are administered in a uniform manner in all schools. It is particularly important for the administrations to be standardized, if the scores from students are going to be compared against one another.
Standards: A body of subject matter content that is usually legally mandated and predetermined by a state department of education. Also conceptual or factual criteria representing knowledge, skills, or attitudes that are established by an authority.
Standards-based test: An assessment designed to measure student achievement in a content domain that is described by content standards.
Stanines: A 1 to 9 scale of percentages used to rank student performance on a standardized test to the performance of other students.
Summative assessment: A cumulative assessment that summarizes the accumulation of knowledge to that point. Can be used to grade student achievement in a course.
Think-aloud strategies: Students are asked to say out loud what they are thinking when they are reading so that the teacher can observe what is going on in the student's head when he or she reads. This can also be reversed, by the way, as a teaching strategy. Try to do a think aloud to model making meaning from a text with your students so they can see what skilled readers do.
Universal design for learning: An approach to designing assessments to make them accessible to the broadest spectrum of students. For example, a test might use only two colors to be sure that the design of the items does not inadvertently penalize students who are color blind.[Page 116]
Validity: The appropriateness, meaningfulness, and usefulness of the inferences that can be made from a test's scores. Validity in assessment refers to the extent to which test scores or responses measure the attributes they were intended to measure.
Vertical alignment: The alignment of different parts of an entire education system—from grade to grade—reflects the logical consistent order for teaching the content in a subject area.
References[Page 117]2008). Classification system for English language learners: Issues and recommendations. Educational Measurement: Issues and Practice, 27(3), 17–31.http://dx.doi.org/10.1111/j.1745-3992.2008.00125.x(2007). Understanding and using reading assessment K-12. Newark, DE: International Reading Association.(2001). What really matters for struggling readers: Designing research-based programs. New York, NY: Longman.(2006). What really matters for struggling readers: Designing research-based programs ((2nd ed.). Boston, MA: Pearson Education.1992). Classrooms: Goals, structures, and student motivation. Journal of Educational Psychology, 84(3), 261–271.http://dx.doi.org/10.1037/0022-06126.96.36.1991(1988). Growth in reading and how children spend their time outside of school. Reading Research Quarterly, 23(3), 285–303.http://dx.doi.org/10.1598/RRQ.23.3.2, , & (1998). In the middle: New understanding about writing, reading, and Learning. Portsmouth, NH: Boynton/Cook.(2004). Aligning curriculum, standards, and assessments: Fulfilling the promise of school reform. University of California, Los Angeles: National Center for Research on Evaluation, Standards, and Student Testing.(1996). The canon debate, knowledge construction, and multicultural education. In J.Banks (ed.), Multicultural education, transformative knowledge & action: Historical and contemporary perspectives, (pp. 3–29). New York, NY: Teachers College Press.(1993). Ideas a literature can grow on: Key insights for enriching and expanding children's literature about the Mexican-American experience. In V.Harris (ed.), Teaching multicultural literature in Grades K-8 (pp. 37–53). Norwood, MA: Christopher-Gordon., , & (1993). A teachers’ introduction to reader-response theories. Urbana, IL: National Council of Teachers of English.(2007). Best practices in professional development for improving literacy instruction. In L.B.Gambrell, L.M.Morrow, & M.Pressley (eds.). Best practices in literacy instruction (, & (3rd ed.), (pp. 373–394). New York, NY: Guilford Press.2003). Aligning tests with states’ content standards: Methods and issues. Educational Measurement: Issues and Practice, 22(3), 21–29.http://dx.doi.org/10.1111/j.1745-3992.2003.tb00134.x, , & ([Page 118]2003). Assessment for learning: Putting it into practice. Berkshire, England: Open University Press., , , , & (2004). Working inside the black box: Assessment for learning in the classroom. Phi Delta Kappan, 86 (1), 8–21., , , , & (1998a). Assessment and classroom learning. Assessment in Education, 5(1), 7–74.http://dx.doi.org/10.1080/0969595980050102, & (1998b). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 80(2), 139–148., & (1956). Taxonomy of educational objectives: The classification of educational goals, by a committee of college and university examiners. Handbook 1: Cognitive domain. New York, NY: Longman., & (1991). Fly away home. (R.Himler Illustrator). Boston, MA: Houghton Mifflin.(1998). Multiple definitions of multicultural literature: Is the debate really just “ivory tower” bickering?The New Advocate, 11(4), 311–324.(1994). Multicultural literature for children: Towards a clarification of the concept. In A.H.Dyson & C.Genishi (eds.), The need for story: Cultural diversity in classroom and community (pp. 57–71). Urbana, IL: National Council of Teachers of English., & (1994). Reinforcement, reward, and intrinsic motivation: A meta-analysis. Review of Educational Research, 64(3), 363–23., & (2005). Achievement-based rewards and intrinsic motivation: A test of cognitive mediators. Journal of Educational Psychology, 97(4), 641–655.http://dx.doi.org/10.1037/0022-06188.8.131.521, , , & (1983). Stages of reading development. New York: Harcourt Brace.(1992). Predicting growth in reading ability from children's exposure to print. Journal of Experimental Child Psychology, 54(1), 74–89.http://dx.doi.org/10.1016/0022-0965%2892%2990018-2, & (2006). Addressing test anxiety in a high-stakes environment: Strategies for classrooms and schools. Thousand Oaks, CA: Corwin., & (1999, November). Critical literacies: Negotiating powerful and pleasurable curricula—How do we foster critical literacy through English language arts? Paper presented at National Council of Teachers of English Annual Convention, Denver, CO.(2001). Critical literacies and local action: Teacher knowledge and a “new” research agenda. In B.Comber & A.Simpson (eds.), Negotiating critical literacies in classrooms (pp. 271–282). Mahwah, NJ: Lawrence Erlbaum.(1986). “Objective measures of writing ability.” In Greenbert, K.L. and Slaughter, V.B. (eds.), Notes from the National Testing Network in writing. New York: The City University of New York Instructional Resource Center.(1992). Reader stance: From willed aesthetic to discursive construction. In J.Many & C.Cox (eds.), Reader stance and literary understanding, (pp. 49–71). Norwood, NJ: Ablex.(1994). Balancing reader response and cultural theory and practice. In B.Corcoran, M.Hayhoe, & G.Pradl (eds.), Knowledge in the making: Challenging the text in the classroom, (pp. 3–23). Portsmouth, NH: Boynton/Cook.(Council of Chief State School Officers. (1999). Student motivation: A statement of the Council of Chief State School Officers from http://events.ccsso.org/content/pdfs/student_motivation.pdf[Page 119]1997). Critical literacy in the elementary classroom. Language Arts, 74(6), 438–445.(2001). Literature circles: Voice and choice in book clubs & reading groups ((2nd ed.). New York, NY: Stenhouse.1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125 (6), 627–668.http://dx.doi.org/10.1037/0033-2909.125.6.627, , & (1999). Motivation for higher-order learning. New Directions for Teaching and Learning, 78, 27–35.http://dx.doi.org/10.1002/tl.7803(1999). Hooray for diffendoofer day. [Published posthumously by J. Prelutsky & L. Smith]New York, NY: Knopf.(Eco-Libris. (n.d.). Some facts about the book publishing industry. Retrieved from http://www.ecolibris.net/bookpublish.asp1999). Introduction. In C.Edelsky (ed.), Making justice our project: Teachers working toward critical whole language practice, (pp. 1–6). Urbana, IL: National Council of Teachers of English Education.(1997). Negotiating the meaning of difference. In T.Rogers & A.Soter (eds.), Reading across cultures: Teaching literature in a diverse society, (pp. 131). New York, NY: Columbia University Teachers College Press.(1999). Rethinking the role of multicultural literature in literacy instruction. The New Advocate, 12(3), 259–276., , & (2001). Iowa tests of educational development. Itasca, IL: Riverside., , , & (2009). What every elementary teacher needs to know about reading tests from someone who has written them. Portland, ME: Stenhouse.(1963). The question of abuses in the use of aptitude and achievement tests. Theory Into Practice, 2(3), 199–204.http://dx.doi.org/10.1080/00405846309541863(1996). Assessment and instruction of culturally and linguistically diverse students with or at-risk of learning problems: From research to practice. Boston, MA: Allyn & Bacon., , & (2002–2003). Test review of the DIBELS: Dynamic Indicators of Basic Early Literacy Skills (, , , , , & (5th ed.). From R.A.Spies & B.S.Plake (eds.), The sixteenth mental measurements yearbook [Electronic version]. Retrieved from the Buros Institute's Test Reviews Online website: http://www.unl.edu/buros2006). A critical review of DIBELS. In K.S.Goodman (ed.), The truth about DIBELS: What it is, what it does, (pp. 1–39). Portsmouth, NH: Heinemann.(1990). Academic intrinsic motivation in young elementary school children. Journal of Educational Psychology, 82(3), 525–538.http://dx.doi.org/10.1037/0022-06184.108.40.2065(2000). The conspiracy of ignorance: The failure of American public schools. New York, NY: HarperCollins.(2007). Reading motivation and reading comprehension growth in the later elementary years. Contemporary Educational Psychology, 32(3), 282–313.http://dx.doi.org/10.1016/j.cedpsych.2006.05.004(2000). Engagement and motivation in reading. In M.L.Kamil, P.B.Mosenthal, P.D.Pearson, & R.Barr (eds.), Handbook of reading research (Vol. 3), (pp. 403–422). Mahwah, NJ: Lawrence Erlbaum., & (1997). Reading multiculturally. In V.Harris (ed.), Using multiethnic literature in the K-8 classroom, (pp. 233–256). Norwood, MA: Christopher-Gordon.([Page 120]2003). Testing and motivation for learning. Assessment in Education: Principles, Policy & Practice, 10(2), 169–207.http://dx.doi.org/10.1080/0969594032000121270, & (1997). Assessment and learning: Differences and relationships between formative and summative assessment. Assessment in Education: Principles, Policy & Practice, 4(3), 365–379.http://dx.doi.org/10.1080/0969594970040304, & (1994). No invitations required to share multicultural literature. Journal of Children's Literature, 20(1), 9–13.(1996). Continuing dilemmas, debates and delights in multicultural literature. The New Advocate, 9(2), 107–122.(2000). Supporting critical conversations in classrooms. In K.M.Pierce (ed.), Adventuring with Books, (pp. 507–554). Urbana, IL: NCTE.(2000). Strategies that work: Teaching comprehension to enhance understanding. Portland, ME: Stenhouse., & (2007). Formative assessment: What do teachers need to know and do?Phi Delta Kappan, 89(2), 140–145.(2007, December). Five ways to prepare for standardized tests without sacrificing best practice. The Reading Teacher, 61(4), 339–342.http://dx.doi.org/10.1598/RT.61.4.7(2010). Pizza parties, pep rallies, and practice tests: Strategies used by high school principals to raise percent proficient. Leadership and Policy in Schools, 9(4), 1–17.http://dx.doi.org/10.1080/15700760903342376, , & (2001). Iowa tests of basic skills, forms A, B, and C. Itasca, IL: Riverside., , & (2003). The Iowa tests interpretive guide for teachers and counselors. Itasca, IL: Riverside Publishing., , , , , ,… (2003). High-stakes testing and students: Stopping or perpetuating a cycle of failure?Theory Into Practice, 42(1), 30–41.http://dx.doi.org/10.1207/s15430421tip4201_5(2008). Reading tests as a genre study. The Reading Teacher, 62(1), 69–73.http://dx.doi.org/10.1598/RT.62.1.8(1997). Walking our talk: Between reader response and responsibility in the literature classroom. English Education, 29, 272–297., & (Individuals With Disabilities Education Act (IDEA), 20 U.S.C. §§ 1400 to 1491 (1997). Retrieved from http://idea.ed.gov/1999). The impact of high-stakes testing on teachers and students in North Carolina. Phi Delta Kappan, 81 (3), 199–203., , , , , & (2005). Dynamic Indicators of Basic Early Literacy Skills (DIBELS): A tool for evaluating student learning?Journal of Research in Childhood Education, 20(2), 75–90.http://dx.doi.org/10.1080/02568540509594553, & (2001). Exploring the impact of a high-stakes direct writing assessment in two high school classrooms. Research in the Teaching of English, 35(3), 344–393., & (2000). The case against standardized testing: Raising the scores, ruining the schools. Portsmouth, CT: Heinemann.(1996). To Stingo with love: An author's perspective on writing outside one's own culture. The New Advocate, 9(1), 1–7.(2000). Critical literacy: Enlarging the space of the possible. Primary Voices K-6, 9(2). 3–7. (2000). Critical issues: Limits of identification: The personal, pleasurable, and critical in reader response. Journal of Literacy Research, 32(2), 253–266., & ([Page 121]2002). Taking on critical literacy: The journey of newcomers and novices. Language Arts, 79(5), 382–392., , & (1970). The Iowa testing programs—A retrospective view. Education, 81 (1), 7–23.(2002). Building a practically useful theory of goal setting and task motivation: A 35-year odyssey. American Psychologist, 57(9), 705–717.http://dx.doi.org/10.1037/0003-066X.57.9.705, & (2008). Identifying academically gifted English-language learners using nonverbal tests: A comparison of the Raven, NNAT, and CogAT. Gifted Child Quarterly, 52(4), 275–296. (Research Paper of the Year Award from the National Association of Gifted Children).http://dx.doi.org/10.1177/0016986208321808, , & (1994). The social construction of literacy in the primary school. New York, NY: Macmillan.(1997). Critical literacy and the question of normativity: An introduction. In S.Muspratt, A.Luke, & P.Freebody (eds.), Constructing critical literacies: Teaching and learning textual practice (pp. 1–18). Cresskill, NJ: Hampton Press., & (2001). Making community texts objects of study. In H.Fehring & P.Green (eds.), Critical literacy: A collection of articles from the Australian literacy educators’ association, (pp. 112–123). Newark, DE: International Reading Association., , & (2001). The adverse impact of high stakes testing on minority students: Evidence from 100 years of test data. In G.Orfield & M.Kornhaber (eds.), Raising standards or raising barriers: Inequality and high stakes testing in public education (pp. 85–106). New York, NY: The Century Foundation., & (2000). Research on response to literature. In M.L.Kamil, P.B.Mosenthal, P.DavidPearson & R.Barr (eds.), Handbook of reading research (Vol. 3, pp. 381–02). Mahwah, NJ: Lawrence Erlbaum.(1999/2000). Initiating literature circles in a first-grade bilingual classroom. The Reading Teacher, 53(4), 270–281., & (1997). Learning to read, reading to learn; or engaging in critical pedagogy. Children's Literature Association Quarterly, 22(3), 126–132.(2002). Reflective teaching in the panic of high-stakes testing. English Education, 34(2), 164–168.(1997). Critical literacy in the classroom: The art of the possible. New York, NY: Routledge.(National Institute of Child Health and Human Development. (2000). Report of the National Reading Panel. Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction (NIH Publication No. 00-4769). Washington, DC: Government Printing Office.National Reading Panel. (2000). Teaching children to read. Retrieved from http://www.nationalreadingpanel.org./Publications/summary.htm1992). Affirming diversity: The sociopolitical context of multicultural education. New York, NY: Longman.(2003). The pleasures of children's literature ((3rd ed.). Boston, MA: Pearson Education.1993). Teaching literature as cultural criticism. English Quarterly, 25(1), 19–25.([Page 122]1999). Student motivation and epistemological beliefs. New Directions for Teaching and Learning, 78, 17–25.http://dx.doi.org/10.1002/tl.7802, & (1983). The Iowa testing programs: The first fifty years. Iowa City: University of Iowa.(1972). Development and learning. In C.S.Lavattelly & F.Stendler (eds.), Reading in child behavior and development. New York, NY: Harcourt Brace Janovich.(2005). Classroom assessment ((4th ed.). Boston, MA: Pearson Education.2008). Transformative assessment. Alexandria, VA: Association for Supervision and Curriculum Development.(2005). Assessing culturally and linguistically diverse students. New York, NY: Guilford Press., , & (2006). The lightning thief (Percy Jackson and the Olympians, Book 1). New York, NY: Miramax.(2001). The grasshopper and the ant: Motivational responses of low-achieving students to high-stakes testing. Educational Evaluation and Policy Analysis, 23(3), 197–227.http://dx.doi.org/10.3102/01623737023003197, & (1982). The literary transaction: Evocation and response. Theory Into Practice, 21, 268–277.http://dx.doi.org/10.1080/00405848209543018(1995). Literature as exploration ((5th ed.). New York, NY: Modern.2003). Imperfect matches: The alignment of standards and tests. [Paper commissioned by the Committee on Test Design for K-12 Science Achievement]. Washington, DC: National Research Council, Center for Education.(2008). Motivation in education: Theory, research, and applications (, , & (3rd ed.). Upper Saddle River, NJ: Pearson Education.1999). Young adult literature and the new literary theories: Developing critical readers in middle school. New York, NY: Teachers College Press.(1996). Crash. New York, NY: Random House. Standards for Educational and Psychological Testing. (1999). Washington, DC: American Educational Research Association., (1999). Evaluating classroom assessment training in teacher education programs. Educational Measurement: Issues and Practice, 18(1), 23–27.http://dx.doi.org/10.1111/j.1745-3992.1999.tb00004.x(2002). Assessment crisis: The absence of assessment FOR learning. Phi Delta Kappan, 83 (10), 758–765.(1997). Multicultural literature and the politics of reaction. Teachers College Record, 98(3).(1977/1955). Measurement and evaluation in psychology and education. (, & (4th ed.). New York, NY: John Wiley.2003). Differentiation in practice: A resource guide for differentiating curriculum Grades 5–9. Alexandria, VA: Association for Supervision and Curriculum Development., & (U.S. Department of Education, the National Commission on Excellence in Education (1983). A Nation at Risk: The Imperative for Educational Reform. Washington, DC: Government Printing Office.U.S. Department of Education. (2007). Policy and program studies service report highlights: State and local implementation of the No Child Left Behind Act. Retrieved from http://www.ed.gov/rschstat/eval/disadv/nclb-accountability/index.html[Page 123]2008). Test driven: High-stakes accountability in elementary schools. New York, NY: Teachers College Press., , , , & (2001). Constructing a critical curriculum with young children. In B.Comber & A.Simpson (eds.), Negotiating critical literacies in classrooms (pp. 55–66). Mahwah, NJ: Lawrence Erlbaum.(2003). Getting beyond “I like the book”: Creating space for critical literacy in K-6 classrooms. Newark, DE: International Reading Association.(Verhoeven, L., & Snow, C. (eds.). (2001). Literacy and motivation: Reading engagement in individuals and groups. Mahwah, NJ: Lawrence Erlbaum.1978). Mind in society: The development of higher psychological processes. Cambridge, MA: Harvard University Press., (1999). Alignment of science and mathematics standards and assessments in four states. Available from ERIC Document Service. (ED440852)(2002). Depth-of-knowledge levels for four content areas. Available online at http://www.providenceschools.org/media/55488/depth%20of%20knowledge%20guide%20for%20all%20subject%20areas.pdf(1999). The right to write: Preservice teachers’ evolving understandings of authenticity and aesthetic heat in multicultural literature. Research in the Teaching of English, 34(1), 130–184., , & (1998). Outrageous viewpoints: Teachers’ criteria for rejecting works of children's literature. Language Arts, 75(4), 287–295.(1997). Taking children's literature seriously: Reading for pleasure and social change. Language Arts, 74(6), 446–453.([Page 124]