TLT Group Image

Evaluation of Pilot Tests

TLT Group Image
 

 

Examples of TLT/Flashlight Services

Technology staff continually need to pilot test new software or services, sometimes developed internally, sometimes by vendors: a new communications utility, a new way of offering support, a new educational software package, a new classroom design...

But even after such a test, it may not be obvious whether the software/service is valuable - for what purposes can the software/service best be used? how much should the institution invest in the future? Are there particular problems that need to be fixed first? That's where evaluation comes in.

TLT/Flashlight consultants can help you design evaluations that can help you decide whether and how much to invest in a product or service in the future.    Some of these projects are relatively small scale (from hours to a few days to assist in evaluation design) while others are major external evaluations.

Examples of TLT Group work:

  • Purdue University – help design evaluation of pilot test of Macromedia Breeze. Steve Ehrmann interviewed local staff, and then drafted an evaluation plan and instruments.  
  • Case Western Reserve University – help design evaluation of university-developed system for digitizing and annotating lectures. (2 days)
  • Gettysburg College: plan an evaluation of CNAV, an institutional portal developed in 1997.  Steve Ehrmann interviewed faculty and staff and designed an evaluation plan.
  • Wiley publishing – advise on the design evaluation of pilot test of eGrade Plus, an online service and product that complements textbooks. Includes online grading of quizzes and other forms of homework support.
  • The Survivors of the Shoah Visual History Foundation: External evaluation of Mellon-funded Internet II project to pioneer campus use of video testimonies of Holocaust survivors.  We worked with Rice, the University of Southern California, and Yale.
 


TLTG logo

Contact us | Partners | Dangerous Discussions | TLTRs | FridayLive! | Consulting | 7 Principles | LTAs | TLT-SWG | Archives | Site Map | Home