Evaluation Plan, a goal-based evaluation plan of the STEMTEC Project, was
presented to the STEMTEC Principle Investigators in January 1999. The
Comprehensive Plan describes approaches to the project evaluation for each
the goals contained in the STEMTEC Strategic Plan. Because of time and
constraints the project evaluation outlined in the Comprehensive Plan had
limited to focus on two essential elements of the Project, faculty
and teacher enhancement. Plans for faculty development and teacher
are contained in Goals 2, 3, 4
the Strategic Plan.
The 1999 - 2000
evaluation activities will focus on documentation of all STEMTEC activities,
formative evaluation of faculty development and pre-education activities and
planning and developing instrumentation for the faculty development and
pre-education summative evaluation.
NSF goals for the CETP the summative evaluation will be consistent with
collecting data that answers the following question posed by Norman
Division Undergraduate Education, National Science Foundation.
evidence exists that the changes instituted as part of the Collaboratives
indeed resulted in a substantial increase in the number of students who know
more, are more competent at teaching mathematics and the sciences using the
mathematics and science standards as a guide, and employing the new
will be on the degree to which students in STEMTEC courses and the
program have developed the understanding of science and mathematics and
recommended pedagogical practices necessary for competent teaching.
evaluators have oversight for all STEMTEC evaluation activities and
Formative, Summative and Documentation Activities;
Formative Evaluation Plans Conducted by PIs for project activities
development, pre-education, and outreach workshops;
Review Sampling Procedures, Instrumentation, and Data Collection Methods for Evaluation Activities Conducted by PIs
Reports of Evaluations conducted by Pis:
Evaluators have primary responsibility for:
Implementation of a Plan for Monitoring the Development of STEMTEC
Content(Science, Mathematics) and Pedagogical Content Knowledge;
Design and Implementation a Plan for Monitoring the Development of Faculty
and Implementation of Recommended Strategies for teaching Science
the Evaluation Principal Investigator (Allan Feldman), Staff, and Graduate
Research Assistants responsible for evaluation include
Liaison with External Evaluators;
Managing the work of Staff and Graduate Research Assistants;
Logistics Associated with the Administration of Surveys
Data Entry and Statistical Analysi
Feldman has Primary Responsibility for
Report on the Faculty Survey; and the
Evaluation of the Faculty
John Clement has Primary Responsibility for the
|External Evaluators:||Champagne and OíConnor|
|STEMTEC Evaluation:.||Allan Feldman|
|STEMTEC Researcher:||John Clement|
|STEMTEC Evaluation Staff:||Greta Shultz|
|Student Research Assistants:||Brenda Capobianco, Samia Kahn|
Provide feedback to PIís about the status of faculty
understanding of the STEMTEC mission, individual faculty goals as
relate to [ scientific,
mathematical, or technological] literacy and perception, understanding and
degree of implementation of recommended pedagogical strategies.
Sample: All faculty teaching STEMTEC
Courses in the Fall 1999.
Project in the context of the NSF Program Collaboratives for Excellence in
Teacher Preparation (CETP)
Question: What is the
Understanding of the CETP Programís Purpose and STEMTECís Purpose and
goals and expectations for students defined in terms of the studentsí future
occupations and responsibilities as citizens.
Question: How do faculty
expectations for the preparation of teachers differ from their expectations
[scientists, mathematicians, engineers], persons in other professions [law,
civil service, politics, ...]?
views on [ scientific,
mathematical, or technological] literacy
What is the faculty understanding of [scientific, mathematical,
technological] literacy as it pertains to the preparation of teachers in the
discipline they will teach?
perception, understanding and degree of implementation of recommended
What is the faculty understanding of and degree of implementation of
[group work, inquiry, and alternative assessment] they pertains to the
preparation of teachers in the discipline they will teach?
students and faculty perceptions of the degree of implementation of
Sample: All faculty teaching ďSTEMTECĒ
courses and all students in STEMTEC courses.
What are faculty and student reports on the implementation of
pedagogical practices? How do faculty and student perceptions of the
implementation of recommended pedagogical strategies correlate?
1999 Evaluation Time Line
Line is divided into two parts. The first, labeled Time Line Through
2000 details work to be completed by the end of February 1999. The second
labeled Time Line Through March 1990 describes evaluation activities that
continue through March 2000 and beyond.
highly collaborative are italicized.
the primary the responsibility of the external evaluators are bolded.
the primarily the responsibility of STEMTEC Principle Investigators and
are in normal type.
Click here for the time line