Program Evaluation

The primary purpose of the Training Program evaluation is to measure the extent to which program goals and objectives are met. Our multi-faceted evaluation complements discipline-specific assessments of CPCTP trainees conducted by departmental faculty who provide course work, act as preceptors, and direct research experiences. We have conducted annual CPCTP evaluation since the program’s inception in 1988.

The CPCTP’s specific Program Objectives are to give trainees
:

  • Opportunities to participate in cancer prevention and control research
  • Ample funding and other support for their educational needs
  • A wide range of multidisciplinary training experiences
  • Faculty and Directors that are accessible and provide ample guidance yet latitude in selecting research topics and careers
  • Trainee interaction. Our evaluation plan measures how well the program meets its goals 

It involves the following four components:

  • Quarterly trainee progress reports
  • An annual program review involving group discussion and a written quantitative and qualitative survey, in which current trainees evaluate how well the Program’s administrative, research, educational, and advising functions meet their interdisciplinary research training goals and needs
  • Written and face-to-face exit interviews when the trainees complete CPCTP support
  • Follow-up of former trainees to monitor their career choices and research productivity Trainee Progress Reports


The Annual Program Evaluation:

The CPCTP Directors hold a program review meeting each year for the current trainees. The meeting is held in a two-part session. In the first part, the trainees and Directors discuss the program’s progress and plans for the future, and the trainees update each other on their progress (as they do quarterly). In the second part, trainees participate in a focus group with evaluative questions related to various program goals and components. They also complete an anonymous quantitative and qualitative questionnaire, followed by another discussion related to key issues. A narrative reduction is performed to abstract main points and is given to program leaders and the advisory board who review, discuss, and respond to the issues raised in the report. The written questionnaire assists the Directors to understand the program’s dynamics and to implement enhancements. From 1993 to 2000, we used the same instrument, with 17 assessment items, and in 2001 we added two additional assessment items. The survey also asks trainees to indicate what they like best and least about the program and what specific recommendations they have to improve it. These comments are used to help explain the scores for the assessment items and to develop a list of needed improvements. Based on trainee comments, the evaluation team recommends program modifications and enhancements to improve the program.

Since 1993, the trainees have given the program progressively higher scores in terms of its focus and its administrative, research, educational, and advising functions. Each assessment item relates to a specific program objective and trainees rate each item on a 5-point scale from 5 (Superlative) to 1 (Failure), with 3 being Adequate. The below table is a review of data for years 2008-2013. (Note: The stipend/salary issue is one beyond our ability at UAB to modify due to NIH limitations).

CPCTP Annual Program Evaluation Results (Rank) – Mean Scores

 2008

2009

2010

2011

2012

2013

All Years

Availability & accessibility of CPCTP leaders

 5.00

4.82

4.79

4.50

 4.88

4.73

4.79 

Overall quality of the Cancer Prevention & Control Training Program

 5.00

4.82

4.86

4.57

 4.94

4.82

 4.84

Fairness of policies & procedures

 5.00

4.64

4.64

4.36

 4.88

4.82

 4.72

Flexibility to pursue training & career goals

 5.00

4.73

4.64

4.64

 4.94

4.82

 4.80

Availability/accessibility of your mentors & faculty

 4.86

4.73

4.64

4.43

 4.82

4.64

 4.69

CPCTP focus on cancer prevention & control

 4.71

4.91

5.00

4.43

 4.94

4.91

 4.82

Opportunities for ongoing research

 5.00

4.55

4.71

4.29

 4.94

4.55

 4.67

Interdisciplinary research & training focus

 4.71

4.55

4.64

4.29

 4.94

4.82

 4.66

Environment fosters interdisciplinary training & research

 5.00

4.27

4.71

4.36

 4.71

4.73

 4.63

Quality of the mentoring

 5.00

4.36

4.50

4.43

4.76

 4.45

 4.58

Adequacy of didactic instruction.

 4.57

4.73

4.57

4.21

4.76

 4.82

 4.61

Adequate selection of training experiences

 4.43

4.55

4.64

4.43

4.88

 4.55

 4.58

Guidance in identifying research topics

 4.57

4.27

4.57

4.36

4.76

4.09 

 4.44

Adequacy of career guidance by Director/Co-Director(s)

 4.71

4.36

4.50

4.14

4.41

 4.45

 4.43

Amount of funding & support for your research

 4.71

4.64

4.14

4.29

4.59

 4.36

 4.46

Helpfulness of UAB cancer seminars

 4.14

4.27

4.69

4.38

4.53

4.18

 4.37

Financial support for travel & conferences

 4.43

4.45

4.43

3.86

4.53

4.45

 4.36

Interactions with trainees from other departments

 4.71

3.91

4.57

3.86

4.47

4.36

 4.31

Career guidance from your mentors & faculty

 4.43

4.00

4.57

4.14

4.76

4.55

 4.41

Helpfulness of CPCTP website

 4.00

4.17

4.00

3.31

4.47

4.45

 4.07

Amount & duration of your stipend salary

 3.71

3.73

2.93

3.21

4.41

4.09

 3.68