Documentation, Evaluation, and Independent Studies | |
The Yale-New Haven Teachers Institute and the Yale National Initiative regard both internal and external evaluation of their principles, practices, and results to be of the utmost importance. For more than a quarter of a century the Yale-New Haven Teachers Institute has arranged for, and learned from, both internal and external evaluations. The National Demonstration Project and the Preparation Phase of the Yale National Initiative have continued that process of multiple evaluation. The internal evaluations, based in part upon observations in site visits and conferences, the results of questionnaires, published curriculum units, and Annual Reports from participating Institutes, have been embodied in Annual Reports to the funding organizations. They have been supplemented by external evaluations of several kinds.
The Wallace Foundation commissioned an external evaluation of the National Demonstration Project conducted by Policy Studies Associates. As part of its research and planning, the Pittsburgh Teachers Institute commissioned an evaluation, using focus groups, carried out by Allyson Walker, of Cornerstone Evaluation Associates, and Janet Stocks, Director of Undergraduate Research at Carnegie Mellon University. As part of its research and planning, the Houston Teachers Institute commissioned a massive evaluation, using focus groups, interviews, surveys, and both quantitative and qualitative analysis, carried out by Jon Lorence and Joseph Kotarba of the Department of Sociology, University of Houston, and a further evaluation, based on interviews and observation of teaching, by Paul Cooke, Director of the Institute. The Yale-New Haven Teachers Institute also commissioned an evaluation of the entire National Demonstration Project, carried out by Rogers M. Smith of the Department of Political Science, University of Pennsylvania, and his research assistants, that was based primarily on analyses of Fellows' questionnaires and of the survey of the use of curriculum units by Fellows and non-Fellows. |
For more than a quarter of a century the Yale-New Haven Teachers Institute has arranged for, and learned from, both internal and external evaluations.
|
Though differing in their procedures and to some extent in their detailed results, these evaluations lend support to a number of important conclusions. At all four sites, there were positive results similar to those that had been obtained in New Haven over many years. Both Policy Studies Associates and Rogers M. Smith concluded that the National Demonstration Project had "succeeded in reaching its goal" of replication of the Yale-New Haven model within a relatively short period of time in four sites that are considerably larger than New Haven. Overall, new Institutes involved roughly 900 teachers and 60 college or university faculty members in 75 seminars over the course of the Project. Smith noted that these seminars produced results that were remarkably similar to each other and to experiences in New Haven, and markedly better than those reported by most existing forms of professional development. These results occurred despite significant demographic differences among the cities. The major variations, according to Smith, could be correlated with structural departures from National Demonstration Project guidelines and with certain administrative difficulties in the partnering districts and institutions of higher education. | |
As Smith pointed out, recent research indicates that the single most important factor in student performance is teacher quality. The consensus of researchers and teachers is that many existing forms of professional development are cursory, dreary exercises that leave teachers bored and resentful, not informed or inspired. The approach of the Yale-New Haven Teachers Institute, however, significantly strengthens teachers in all five of the major dimensions of teacher quality: it helps to produce teachers who really know their subjects; who have good basic writing, mathematics and oral presentation skills; who expect their students to achieve; who are enthusiastic about teaching; and who can motivate all children to learn.
According to Smith's analysis, teachers in the new Institutes chose to participate out of desires to improve themselves in exactly these areas. At each site, teachers participated out of desires to obtain curriculum suited to their needs, to increase their mastery of their subjects, and especially to obtain materials to motivate their students. According to the research in Pittsburgh, moreover, teachers "find the Institute to be the best professional development they ever had" because its seminars increase their knowledge, emphasize content, not pedagogy, have direct applicability to their classrooms, encourage them to be creative, and are spread over sufficient time to allow them to master the content. The Pittsburgh teachers also reported that they were attracted to the Institute by the independence they enjoyed in suggesting seminar topics and then selecting those seminars in which they would participate without regard to the subject or grade levels at which they taught. According to the research in Houston, the Institute program "cultivates a significant increase in skill level for those many Fellows who were never really trained earlier in the design and implementation of a very workable, thought-out, substantively well-informed curriculum unit." Teachers therefore "take ownership of big corners of the fields of knowledge in which they labor and take that possession over to their students." |
Smith found that the approach of the Yale-New Haven Teachers Institute significantly strengthens teachers in all five of the major dimensions of teacher quality.
|
According to Smith, ninety-five percent of all participating teachers rated the Institute seminars "moderately" or "greatly" useful. Similar percentages said the seminars increased their knowledge, improved their skills and morale, and raised their expectation of students. Both teachers and principals who participated in the Pittsburgh study reported that the Institute experience boosts teachers' positive attitudes toward teaching and learning because: it excites teachers about learning and their excitement is transferred to their students; it enhances teachers' self-image and sense of direction; it augments teachers' sense of professionalism; it encourages collaboration among teachers; and it provides teachers with a network of resources. Smith also found that the Institutes served to foster teacher leadership, to develop supportive teacher networks, to heighten university faculty commitments to improving public education, and to foster more positive partnerships between school districts and institutions of higher education. |
Ninety-five percent of all participating teachers rated the Institute seminars useful.
|
The Houston study concludes on the basis of interviews with Fellows, a survey, and observation of students "that students of HTI Fellows benefit from instruction informed by solid scholarly values, not simply bureaucratic curriculum requirements." It indicates also that "students benefit from the presence of teachers who can serve as role models of intellectualism, commitment, and excellence." | |
According to Smith, after teaching their curriculum units, two-thirds of all participants rated them superior to all other curriculum they had used. Roughly sixty percent of all participants rated student motivation and attention as higher during these units, producing substantially greater content mastery. The teachers and principals who participated in the Pittsburgh study also reported that the students learned new ways of thinking, questioned what they read and saw, made connections among various subjects, eagerly learned content set within a familiar context, and acquired and implemented research skills modeled by the teachers. These curriculum units, as Smith noted, emphasized teacher-led discussion, writing exercises, activities designed to strengthen speaking, listening, vocabulary, reasoning skills, and mathematics skills. The research in Houston indicated that "all categories of students benefit from teachers who have completed a Houston Teachers Institute seminar: skilled and unskilled; English speaking and ESL; Anglo and minority; and gifted, mainstreamed, or special education students."
All four studies do suggest that it would be fruitful to engage in yet further research concerning ways of assessing student learning in classes where Institute units have been taught. The Wallace Foundation, in supporting the National Demonstration Project, had explicitly excluded such research because of its firmly grounded belief that the most significant factor in producing increased student learning is teacher quality. And with regard to that factor, the more detailed studies in Pittsburgh and Houston confirm and extend the positive conclusions that have been reached by Policy Studies Associates and by Smith in their analyses of the National Demonstration Project. |
"After teaching curriculum units, two-thirds of all participants rated them superior to all other curriculum they had used."
--Rogers M. Smith
|
According to the report from Policy Studies Associates, there is "clear evidence of important accomplishments, reflected in the number of seminars provided in the institutes, the number of Fellows who participated in these seminars, and the number of curriculum units the Fellows produced." It stated further:
Large majorities of Fellows were unequivocal in saying that their experience in the institutes, especially the preparation of a curriculum unit, gave them a real sense of accomplishment and re-kindled their excitement about learning. As one Fellow put it: "To be teachers, we must also be learners." When asked in interviews to compare their experience in the institutes with their experience in other kinds of professional development, teachers agreed that the institutes are vastly superior. |
"Large majorities of Fellows were unequivocal in saying that their experience in the institutes gave them a real sense of accomplishment and re-kindled their excitement about learning."
--Policy Studies Associates
|
The report by Rogers M. Smith concluded: | |
No single program can overcome the enormous obstacles to educational achievement faced by economically disadvantaged students, usually from racial, ethnic, and linguistic minorities, in large American cities today. But if recent researchers are right to contend that the single most important factor in student achievement is teacher quality, and if quality teachers are indeed knowledgeable, skilled, and enthusiastic, with high expectations for their students and the means to motivate students to reach those expectations, then the National Demonstration Project provides strong evidence for the value of the Teacher Institute approach. | |