Sakai Pilot News Blog » Assessments

Assessments

The purpose of the Sakai Pilot was to evaluate the efficacy of Sakai to meet our campus needs for teaching, learning, research, outreach, and administrative work flows. The final report was published on October 15, 2009.

UNC SAKAI PILOT EVALUATION FINAL REPORT (3.2 MB; PDF)
The 74-page PDF provides a wealth of data collected during Fall 2008 and Spring 2009. Below is a 15-slide summary. You may find the faculty video interviews useful, too.

You are also invited to view:

The Sakai Action Group pilot success criteria were independent of participants’ evaluation and were as follows:

  1. A structured, systematic pilot based on sound project management principles 
is implemented and completed during the specified timeframe.
  2. Participants represent a variety of stakeholders and/or types of activities 
(i.e., teaching, research, outreach, organizations, committee work, etc.)
  3. A formal data collection plan is implemented with the purpose of ensuring data 
validity and reliability across pilot courses and sites.
  4. Within two months of the pilot’s conclusion a formal written evaluation is submitted to 
campus leadership with conclusions and recommendations based on the data collected.

Data collection survey instruments

    Online surveys using Qualtrics software were administered to instructors, students, and project site members in Fall 2008 and Spring 2009. Formative assessment surveys were based on the annual CTools surveys distributed at the University of Michigan, and currently in use at a variety of Sakai institutions.

    The UNC Sakai pilot assessments adapted the CTools survey instruments to include a small subset of questions.  Separate survey instruments are developed for instructors and students. In addition, an instrument targeted specifically to project site collaborators was developed based on CTools questions appropriate to this audience.

    Instructor survey instrument (PDF)
    Student survey instrument
    Project site member instrument