STEMTEC EVALUATION PLAN 1999-2000

(October 1999)

The Comprehensive Evaluation Plan, a goal-based evaluation plan of  the STEMTEC Project,  was  presented to the STEMTEC Principle Investigators in January 1999. The Comprehensive Plan describes approaches to the project evaluation for each of the goals contained in the STEMTEC Strategic Plan. Because of time and resource constraints the project evaluation outlined in the Comprehensive Plan had been limited to focus on two essential elements of the Project, faculty development and teacher enhancement. Plans for faculty development and teacher enhancement are contained in Goals  2, 3, 4 of the Strategic Plan.

The 1999 - 2000 evaluation activities will focus on documentation of all STEMTEC activities, formative evaluation of faculty development and pre-education activities and planning and developing instrumentation for the faculty development and pre-education summative evaluation.

Consistent with the NSF goals for the CETP the summative evaluation will be consistent with collecting data that answers the following question posed by Norman Fortenberry, Division Undergraduate Education, National Science Foundation.

What evidence exists that the changes instituted as part of the Collaboratives have indeed resulted in a substantial increase in the number of students who know more, are more competent at teaching mathematics and the sciences using the mathematics and science standards as a guide, and employing the new technologies available?

 The focus will be on the degree to which students in STEMTEC courses and the pre-education program have developed the understanding of science and mathematics and recommended pedagogical practices necessary for competent teaching.

 Responsibilities of External Evaluators

The external evaluators have oversight for all STEMTEC evaluation activities and will:

 External Evaluators have primary responsibility for:

 

Responsibilities of STEMTEC Principle Investigators and Staff

Responsibilities of the Evaluation Principal Investigator (Allan Feldman), Staff, and Graduate Research Assistants responsible for evaluation include

Allan Feldman has Primary Responsibility for

 John Clement has Primary Responsibility for the

  

Responsible Individuals                                         

External Evaluators:   Champagne and OíConnor
STEMTEC Evaluation:. Allan Feldman
STEMTEC Researcher:  John Clement 
 STEMTEC Evaluation Staff: Greta Shultz
 Student Research Assistants: Brenda Capobianco, Samia Kahn

             

Fall 1999 Work Plan

Faculty Interviews/Observations/Survey

Formative

Purpose:                Provide feedback to PIís about the status of faculty  understanding of the STEMTEC mission, individual faculty goals as they relate to  [ scientific, mathematical, or technological] literacy and perception, understanding and degree of implementation of recommended pedagogical strategies.

Sample: All faculty teaching STEMTEC Courses in the Fall 1999.

 

Interview

The STEMTEC Project in the context of the NSF Program Collaboratives for Excellence in Teacher Preparation (CETP)

Research Question: What is the Faculty Understanding of the CETP Programís Purpose and STEMTECís Purpose and Mission?

 Faculty goals and expectations for students defined in terms of the studentsí future occupations and responsibilities as citizens.

Research Question: How do faculty expectations for the preparation of teachers differ from their expectations for [scientists, mathematicians, engineers], persons in other professions [law, civil service, politics, ...]?

 Faculty views on  [ scientific, mathematical, or technological] literacy

Research Question:                What is the faculty understanding of [scientific, mathematical, technological] literacy as it pertains to the preparation of teachers in the discipline they will teach?

 

Faculty perception, understanding and degree of implementation of recommended pedagogical strategies.

Research Question:                What is the faculty understanding of and degree of implementation of [group work, inquiry, and alternative assessment] they pertains to the preparation of teachers in the discipline they will teach?

 

Student/Faculty Surveys

Formative

Congruence of students and faculty perceptions of the degree of implementation of recommended pedagogical practices.

Sample: All faculty teaching ďSTEMTECĒ courses and all students in STEMTEC courses.

 

Research Questions:                What are faculty and student reports on the implementation of recommended pedagogical practices? How do faculty and student perceptions of the implementation of recommended pedagogical strategies correlate?

 


Fall 1999 Evaluation Time Line

The Evaluation Time Line is divided into two parts. The first, labeled Time Line Through February 2000 details work to be completed by the end of February 1999. The second part, labeled Time Line Through March 1990 describes evaluation activities that will continue through March 2000 and beyond.

 

Activities that are highly collaborative are italicized.

Activities that are the primary the responsibility of the external evaluators are bolded.

Activities that are the primarily the responsibility of STEMTEC Principle Investigators and Staff are in normal type.

 

Click here for the time line