Instructional Technology
Conference 2005
Proposal #20
Title: Evaluating Graduate Programs Using Web Based Survey of Alumni
Name: Barbara Mullins Nelson, Ph.D., Douglas G. Scarboro, Raj Manickavasagam
Audience Level: Not Specified
Audience: : Faculty, Program Administrators, Deans, Department Chairs, Instructional Technology Specialists
Length: One Hour
Abstract:
Evaluating instructional design was the starting point for improving the masters and doctoral programs in Higher and Adult Education at the University of Memphis . Motivation for the project was the impending SACS
accreditation. A survey was developed to ask alumni to assess courses,
competencies developed, and the career impact of attaining their degree at
the University. This session will overview the process of developing,
implementing and evaluating results of an electronic survey.
Description:
Motivation for the project was upcoming SACS accreditation. Preliminary research was conducted to identify survey instruments used by similar
academic programs. Paper and pencil surveys were deemed no longer
appropriate since one of the competencies our program builds is technological literacy. However, they were a useful starting point. A
faculty/student team developed a paper survey instrument adapted from
similar instruments used at four other universities. A graduate student in
information systems joined the team to help us translate the survey into
electronic format using Brio software. The software did not allow an exact
replica of the paper version. After several tries an agreeable format was
achieved. Two versions were developed; one for the masters degree students
and the other for doctoral degree students. Students who were near graduation agreed to pilot test the survey and provide feedback for us. As
a result of the pilot tests several changes were made.
Letters were mailed via US mail to all graduates of the program inviting them to log onto the web site where they could evaluate the program. The response rate for masters graduates was 28%. The response rate for doctoral students was 35%.
Data analysis was conducted in BRIO software with assistance of personnel inU of Memphis data warehouse.
Session Type: Panel Discussion
Contact information/affiliation:
Barbara Mullins Nelson, Ph.D.
The University of Memphis
Higher and Adult Education
315 Browning Hall
Memphis , TN 38111
Douglas G. Scarboro
Graduate Student
University of Memphis
318 Browning Hall
Memphis , TN 38152
Raj Manickavasagam
Systems Programmer
University of Memphis
308 Scates Hall
Memphis , TN 38152
Equipment: Laptop projector, projector screen, laser pointer, PC with internet access connected to projection screen.