Do not think about, write about or deal with human behavior without determining the effects of incentives.
Here is an updated list for documents, most available online, in support of Direct Instruction. In the jurisdiction where I live, where the arrogance of the government education “experts” is only matched by their incompetence. Direct Instruction cannot be used. There are two good (note use of sarcasm) reasons for this. The first is that only textbooks published in Ontario may be used in Ontario because, as we all know, the purpose of education is to support textbook publishers. The second is that Direct Instruction is the absolute opposite of the litany of fads taught in schools of education because, as we all know, government experts are always right.
Reviews supporting Direct Instruction programs (with updated links)
Kerry Hempenstall
How does one make judgements about which literacy programs/approaches
deserve respect and implementation? One can go to the primary sources
(original research), though this may be very time-consuming, or one may
feel unable to critically evaluate research merit. An alternative is to
examine reviews and the findings by respected sources.
One focus involves whether particular programs incorporate the
components considered crucial by relevant authorities. That is, is the
approach in question theoretically plausible? Does it have the
recommended elements to enable it to succeed?
How does Direct Instruction stack up theoretically?
The National Reading Panel (2000) issued a now famous report consequent
upon a Congressional mandate to identify skills and methods crucial in
reading development. The Panel reviewed more than 100,000 studies
focusing on the K-3 research in reading instruction to identify which
elements lead to reading success.
From a theoretical perspective, each of the National Reading Panel
(2000) recommended foci for reading instruction (phonemic awareness,
phonics, fluency, vocabulary, comprehension) is clearly set out and
taught in Direct Instruction literacy programs. An examination of the
program teaching sequences in, for example, the Reading Mastery and
Corrective Reading texts attests to their comprehensive nature.
However, these necessary elements are only the ingredients for success.
Having all the right culinary ingredients doesn’t guarantee a perfect
soufflé. There are other issues, such as what proportion of each
ingredient is optimal, when should they be added, how much stirring,
heating, cooling is necessary? Getting any of these requirements wrong
leads to sub-optimal outcomes.
So, it is with literacy programs. “Yet there is a big difference between
a program based on such elements and a program that has itself been
compared with matched or randomly assigned control groups” (Slavin,
2003). Just because a program has all the elements doesn’t mean that it
will be effective necessarily. Engelmann (2003) points to the logical
error of inferring a whole based upon the presence of some or all of its
elements. If a dog is a Dalmatian, it has spots. Therefore, if a dog has
spots, it is a Dalmatian (Engelmann, 2003). In this simile, the
Dalmatian represents programs known to be effective with students. It is
possible to analyse these programs, determine their characteristics, and
then assume incorrectly that the mere presence of those characteristics
is sufficient to ensure effectiveness. Engelmann is thus critical of
merely “research-based” programs, that is, programs constructed only to
ensure each respected component is somewhere represented. He points out
that this does not guarantee effectiveness.
So for a true measure, we must look also for empirical studies to show
that a particular combination of theoretically important elements is
indeed effective.
The vital question then becomes: Has a particular program demonstrated
replicated effectiveness? For what populations?
"The program know as DI (or capital D, capital I) puts all of [the
features of 'di'] into an explicit package. It’s a more structured
version of di that’s been field tested. DI has taken the basic
principles of di and applied them in explicit lessons to various aspects
of curriculum at different levels. It includes programs to teach
reading, math, and science. And because its lessons are written out
(‘scripted’ or manualized), it’s more consistent from teacher to
teacher. DI has simple eaten the lunch of other instructional approaches
in field tested and therefore is a best-practices example of the
superiority of a scientifically based instruction program. And yet, …
it hasn’t been declared by the federal government to be any better than
the competition, much of which is unmitigated hogwash.!"
Kauffman, J. M. (2010). The tragicomedy of public education: Laugand crying; thinking and fixing. Verona, WS: Attainment. ISBN 1578616824
________________________________________
Hattie examines meta-analyses of research studies relating to student
achievement, and concludes that Direct Instruction is highly effective.
No other curricular program showed such consistently strong effects with
students of different ability levels, of different ages, and with
different subject matters. …
“One of the common criticisms is that Direct Instruction works with very
low-level or specific skills, and with lower ability and the youngest
students. These are not the findings from the meta-analyses. The effects
of Direct Instruction are similar for regular (d=0.99), and special
education and lower ability students (d=0.86), higher for reading
(d=0.89) than for mathematics (d=0.50), similar for the more low-level
word attack (d=0.64) and also for high-level comprehension (d=0.54), and
similar for elementary and high school students .The messages of these
meta-analyses on Direction Instruction underline the power of stating
the learning intentions and success criteria, and then engaging students
in moving towards these. The teacher needs to invite the students to
learn, provide much deliberative practice and modeling, and provide
appropriate feedback and multiple opportunities to learn. Students need
opportunities for independent practice, and then there need to be
opportunities to learn the skill or knowledge implicit in the learning
intention in contexts other than those directly taught” (pp. 206-7).
Hattie, J. A.C. (2009). Visible learning: A synthesis of over 800
meta-analyses relating to achievement. London and New York: Routledge.
________________________________________
Corrective Reading, a remedial small group form of Direct Instruction,
has strong evidence of effectiveness (Slavin, 2009, Best Evidence
Encyclopedia)
Slavin, R.E., Lake, C., Davis, S., & Madden, N. (2009, June) Effective
programs for struggling readers: A best evidence synthesis. Baltimore,
MD: Johns Hopkins University, Center for Data-Driven Reform in
Education. http://www.bestevidence.org/word/strug_read_Jul_07_2009.pdf
________________________________________
Reading First focuses on core reading programs in grades K-3. There are
only two programs widely acknowledged to have strong evidence of
effectiveness in this area: Success for All and Direct Instruction.
Slavin, R.E. (2007). Statement of Robert E. Slavin, Director Center for
Data-Driven Reform in Education. Committee on Appropriations
Subcommittee on Labor, Health and Human Services, Education, and Related
Activities. Hearings on Implementation of No Child Left Behind. March
14, 2007. Retrieved March 16, 2007, from
http://www.ednews.org/articles/8996/1/Statement-of-Robert-E-Slavin-Director-Center-for-Data-Driven-Reform-in-Education/Page1.html
________________________________________
"The evidence is pretty much overwhelming," said Prof Steve Dinham, the
Australian Council for Educational Research research director for
teaching, learning and leadership. "Direct instruction and explicit
teaching is two to three times more effective than inquiry-based
learning or problem-based learning."
Smith, B. (2008). Results back principal’s return to instruction. The
Age, 10 May, p.8.
________________________________________
”Research conducted over the past thirty years has provided considerable
evidence to support the efficacy of direct instruction programs in
primary schools. Recent meta-analyses of intervention research have
found that techniques associated with direct instruction are among the
most effective teaching practices for improving academic achievement,
particularly for students with learning difficulties (e.g., Borman et
al., 2003; Forness, Kavake, Blum & Lloyd, 1997). … There is substantial
evidence relating the use of direct instruction in the development of
phonemic awareness and phonological knowledge, vocabulary knowledge and
word recognition (e.g., Foorman, Francis, Fletcher, SchatscMehta, 1998; Munro, 1997, 1998, 1999, 2000a,b; Rohl, 2000; Rohl & Pratt,
1995; Swanson, 1999; Wright & Jacobs, 2003). … Support also has been
found for the benefit of direct instruction in the teaching of reading
comprehension (e.g., Foorman et al., 1998; Gardill & Jitendra, 1999;
Swanson, 1999; Gersten & Carnine, 1986; Vallecorsa & de Bettencourt,
1997)”.
National Inquiry into the Teaching of Literacy (2005). Teaching reading
- A review of the evidence-based research literature on approaches to
the teaching of literacy, particularly those that are effective in
assisting students with reading difficulties. Australian Government:
Department of Education, Science and Training. Retrieved November 1,
2007, from www.dest.gov.au/nitl/documents/literature_review.pdf.
________________________________________
“On average, when the Corrective Reading program was coupled with
repeated reading lessons, findings reflected a large effect (M ES =
1.52) for students with disabilities (i.e., Gregory et al., 2005; Strong
et al., 2004). In these two investigations, essentially, all students
improved on their reading fluency, and results were varied with regard
to performance on answering comprehension questions. … Although more
research comparing whole-word to phonic instruction is needed with
adolescent populations, one study suggested that adolescents who were
taught phonic analysis skills were better able to transfer their skills
when they encountered words that were novel to them (ES = 1.30 on
pseudoword reading), contrary to those adolescents who received either
whole-word reading skills or no specialized instruction (i.e.,
Bhattacharya & Ehri, 2004)”.
“Students who have not acquired some degree of reading decoding and
fluency skills by middle school are at a disadvantage, as they are
increasingly expected to extract and synthesize information from content
area texts (Biancarosa & Snow, 2004; Santa, 2006). Moreover, “students
who lack sufficient fluency entering into the middle grades are not
likely to find much instructional support for their difficulties”
(Rasinksi et al., 2005, p. 26)”.
Joseph, L. M., & Schisler, R. (2009). Should adolescents go back to the
basics?: A review of teaching word reading skills to middle and high
school students RASE TL & LD. Remedial and Special Education, 30(3),
131. Retrieved from
http://search.proquest.com/docview/236328142?accountid=13552
________________________________________
"For example, Direct Instruction (DI), a behaviorally oriented teaching
procedure based on an explicit step-by-step strategy (ES=.93) is
six-and-one-half times more effective than the intuitively appealing
modality matched instruction (ES=.14) that attempts to capitalize on
learning style differences. Students with Specific Learning Disabilities
who are instructed with DI would be better off than 87% of students not
receiving DI and would gain over 11 months credit on an achievement
measure compared to about one month for modality matched instruction."
Kavale, K. (2005). Effective intervention for students with specific
learning disability: The nature of special education. Learning
Disabilities, 13(4), 127-138.
________________________________________
“Across varying contexts, Direct Instruction, the Comer School
Development Program, and Success for All have shown robust results and
have shown that, in general, they can be expected to improve students’
test scores. These three models stand out from other available
comprehensive school reform (CSR) designs by the quantity and
generalizability of their outcomes, the reliable positive effects on
student achievement, and the overall quality of the evidence. … These
clear, focused, and well-supported school-based models of improvement
are in stark contrast to top-down direction and flexibility for
educational reform”.
Borman, G. (2007). Taking reform to scale. Wisconsin Center for
Educational Research Retrieved February 4, 2007, from
http://www.wcer.wisc.edu/news/coverstories/taking_reform_to_scale.php
________________________________________
The American Institutes for Research (2006) reviewed 800 studies of
student achievement and of the 22 reform models examined, Direct
Instruction and Success for All received the highest rating for quality
and effectiveness. CSRQ Center Report on Elementary School Comprehensive
School Reform Models
http://www.air.org/focus-area/education/index.cfm?fa=viewContent&content_id=635
________________________________________
“There is ample empirical evidence that the Direct Instruction programs
have succeeded with a wide range of learners. This has been recognised
by diverse groups, for example, the US Government’s acceptance of the
Direct Instruction model as one eligible for funding. The US Department
of Education allocates enormous amounts for the implementation of
replicable, research based school reform models. Its approved list
includes Direct Instruction programs. Direct Instruction programs have
also been acknowledged as having the exemplary research base required
under the recent USA Reading First Act, 2001 (Manzo & Robelen, 2002).”
Manzo, K., & Robelen, E. (2002, May 1). States unclear on ESEA rules
about reading. Education Week online. Retrieved February 14, 2003.
www.edweek.org/ew/articles/2002/05/01/33read.h21.html
________________________________________
Major reviews of the primary research can provide additional surety of
program value. In a Department of US Education meta-analysis,
Comprehensive School Reform and Student Achievement (2002, Nov), Direct
Instruction was assigned the highest classification: Strongest Evidence
of Effectiveness, as ascertained by Quality of the evidence Quantity of
the evidence, and Statistically significant and positive results. “Its
effects are relatively robust and the model can be expected to improve
students’ test scores. The model certainly deserves continued
dissemination and federal support”
Borman, G.D., Hewes, G.M., Overman, L.T., & Brown, S. (2002).
Comprehensive School Reform and Student Achievement.
http://www.csos.jhu.edu/crespar/techReports/Report59.pdf
________________________________________
Power4Kids
http://www.haan4kids.org/power4kids/CTRG%20ex%20summary.4.3.06.doc
Following the successful models of rigorous medical science, the
Power4Kids reading study will be a landmark in education ~ a
large-scale, randomized, controlled, longitudinal field trial. It is the
second largest study of its kind ever to be conducted in public schools.
It is designed to provide conclusive evidence of the effectiveness of
quality remedial reading programs, along with determining common
learning profiles of students and the best targeted-intervention for
each profile. Regardless of the reason a child struggles to learn to
read, Power4Kids will provide the information and winning models of how
to close the reading gap in our schools. Four (4) highly effective
remedial reading programs have been awarded a position in the study by
virtue of their scientifically-based evidence of effectiveness. The
programs are:
Corrective Reading, Failure Free Reading, Spell Read P.A.T., Wilson
Learning Program
________________________________________
The Council for Exceptional Children provides informed judgements
regarding professional practices in the field. The Direct Instruction
model was judged by the Editorial Committee to be well validated and
reliably used. http://www.teachingld.org/ld_resources/alerts/2.htm
________________________________________
Direct Instruction is the only model to be recommended by American
Federation of Teachers in each of their reviews. American Federation of
Teachers (1999). Building on the best: Learning from what works.
Seven Promising Reading and English Language Arts Programs "When this
program is faithfully implemented, the results are stunning." (g. 9).
http://www.eric.ed.gov/ERICWebPortal/contentdelivery/servlet/ERICServlet?accno=ED421695).
Four Promising Schoolwide Academic Programs
http://www.eric.ed.gov/PDFS/ED421559.pdf
Five Promising Remedial Reading Intervention Programs
(http://www.eric.ed.gov/PDFS/ED445315.pdf).
______________________The report Bringing Evidence Driven Progress to Education: A Recommended
Strategy for the U.S. Department of Education (2002) reports Direct
Instruction as having strong evidence for effectiveness.
http://www.eric.ed.gov/PDFS/ED474378.pdf
________________________________________
The Center for Education Reform (2003) nominated DI among its “Best
Bets”.
“Strong, proven education programs for kids – programs that demonstrate
success for more than just a handful of students”
McCluskey, N. (2003). Best bets: Education curricula that work. Center
for Education Reform. Retrieved 11/5/2004 from
www.edreform.com/_upload/bestbets.pdf
________________________________________
Better by design: A consumers’ guide to schoolwide reform: A report from
the Thomas B. Fordham Foundation supports the Direct Instruction model
as a viable approach to schoolwide reform
http://www.edexcellence.net/publications-issues/publications/betterbydesign.html
________________________________________
Reading Programs that Work: A Review of Programs for Pre-Kindergarten to
4th Grade
This independent review included Direct Instruction among six
school-wide effective reading models (Schacter, 1999)
http://www.mff.org/publications/publications.taf?page=279
________________________________________
Corrective Reading: Decoding and Corrective Reading: Comprehension are
among the programs adopted by the California State Board of Education in
1999, after it abandoned the Whole Language model.
http://www.cde.ca.gov/be/ag/ag/yr10/documents/jan10item20a1.doc
________________________________________
Marilyn Jager Adams, author of a major text on reading: “Beginning to
read: Thinking and learning about print” commented on Direct Instruction
thus "The research is irrefutable."
________________________________________
The two best known examples of sound research-based practices coming to
scale are Direct Instruction (Carnine, Silbert, & Kameenui, 1997) and
Success for All (Slavin, Madden, Dolan, & Wasik, 1996).
Foorman, B.R., & Moats, L.C. (2004). Conditions for sustaining
research-based practices in early reading instruction. Remedial and
Special Education, 25, 51-60.
________________________________________
From renowned researcher on effective teaching, Barak Rosenshine,
“Reading Mastery is an extremely effective program for teaching
decoding to all children. The mean score for 171 students across six DI
schools, who began the program in kindergarten and who remained in the
program for four years was at the 49th percentile. I think this is a
wonderful finding” (Rosenshine, 2002).
________________________________________
Adams & Englemann’ (1996) meta-analysis resulted in an effect size of
0.69 for the 44 acceptable comparisons involving the Direct Instruction
program Reading Mastery. Across DI programs, the average effect size for
173 comparisons was 0.87. In White’s 1988 DI meta-analysis involved
learning disabled, intellectually disabled, and reading disabled
students, the average effect size for Direct Instruction programs was
.84. A similar meta-analysis of the effectiveness of the whole language
approach to reading found an effect size of only 0.09 (Stahl & Miller,
1989). An effect size of 1 means a gain of 1 standard deviation –
equivalent of a year’s progress (0.8 is a large effect size, 0.5-0.8 is
a medium effect size, and less than .5 is a small effect size).
Adams, G., & Engelmann, S. (1996). Research on Direct Instruction: 25
years beyond DISTAR. Seattle, WA: Educational Achievement Systems.
________________________________________
2004 Florida Center for Reading Research aims to disseminate information
about research-based practices related to literacy instruction and
assessment for children in pre-school through 12th grade. Its Director
is well known researcher, Joe Torgesen.
“The instructional content and design of Corrective Reading is
consistent with scientifically based reading research” (p.4).
Torgesen, J. (2004). SRA Corrective Reading. Florida Center for Reading
Research. Retrieved 16/1/2005 from
http://www.fcrr.org/FC________________________________________
Sally Shaywitz does recommend the REACH System (Corrective Reading,
Spelling Through Morphographs, and R&W) for "dyslexic" children in her
much publicised book The Brain and Dyslexia.
________________________________________
In the Oregon Reading First Center Review of 9 Comprehensive Programs
2004 Reading Mastery was ranked number 1.
To be considered comprehensive, a program had to (a) include materials
for all grades from K through 3; and (b) comprehensively address the
five essential components of the Reading First legislation.
Program Title
1 Reading Mastery Plus 2002
2 Houghton Mifflin The Nation’s Choice 2003
3 Open Court 2002
Others:
Harcourt School Publishers Trophies 2003
Macmillan/McGraw-Hill Reading 2003
Scott Foresman Reading 2004
Success For All Foundation Success for All
Wright Group Literacy 2002
Rigby Literacy 2000
Curriculum Review Panel. (2004). Review of Comprehensive Programs.
Oregon Reading First Center. Retrieved 16/1/2005 from
http://oregonreadingfirst.uoregon.edu/inst_curr_review_core.html
________________________________________
DI for English language learners
The beginning reading programs with the strongest evidence of
effectiveness in this review made use of systematic phonics – such as
Success for All, Direct Instruction, and Jolly Phonics (Slavin & Cheung,
2003)
Slavin, R.E., & Cheung, A. (2003). Effective reading programs for
English language learners: A best-evidence synthesis. Center for
Research on the Education of Students Placed at Risk.
www.csos.jhu.edu/crespar/techReports/Report66.pdf
Cheerio and ttfn,
Grant Coulson
Cui Bono–Cherchez les Contingencies