Program Evaluations - Flashlight Examples

 

Flashlight Online log-in l About Flashlight Online l Handbook and Other Materials l ARQ l
F-LIGHT l Training, Consulting & External Eval.l Student Course Evaluation l FAQ

  Keynotes, Workshops, ...Contracts and GrantsEducation for Assessment l Program Evaluation l  Help with Self-Studies
Options for First Consulting Visit l TLT Group Services Home Page

Program evaluation, done the right way, is a constructive tool for guiding initiatives as well as for documenting their outcomes: increasing the chances of success, reducing risks, helping control costs and reduce burdens on staff.

The TLT Group’s Flashlight Program is well-known for its expertise in evaluation of grants, programs, and services.  This consulting work can range from an hour (e.g., suggesting a plan) to many weeks of effort: designing studies, developing surveys and interview guides, gathering data, analysis, developing recommendations.  We can also apply a unique and new powerful strategy to program evaluation: the matrix survey

Examples of past TLT Group program evaluations:

  • Massachusetts Institute of Technology: year-long external evaluation of the $25 million MIT iCampus program, funded by Microsoft.  iCampus developed educational web services and software that can be shared with, and modified by, other institutions.  The TLT/Flashlight study focused on factors affecting whether these projects were adopted and adapted by other faculty, at MIT and around the world.  [Click here to see their response to our study.]

  • Oregon State University - support for their evaluation of their course management system's impact.

  • Morton College - external evaluation of Title V grant

  • Indiana University Purdue University Indianapolis - support for their formative evaluation of ePortfolio initiative.

  • Old Dominion University: formative evaluation for a training program about other cultures, for the U.S. Navy.

  • CREOLE (Creating Optimum Learning Environments) Project on faculty development, led by Florida Community College at Jacksonville, Virginia Tech, PBS, and 35 community colleges.

  • Joliet Junior College -evaluation of Joliet's distance learning operation and associated elements of faculty support.

  • Minnesota Private Colleges Council. External evaluation of a three-state project fostering information literacy through increased use of online library resources (JSTOR). Project funded by Mellon and Bush Foundations.

  • St. Edward’s University – external evaluation of multi-year grant to prepare teachers to use technology in their teaching (PT3 grant). 

  • St. Edward's University - follow-up survey of students in St. Edward's adult education program, New College, and the Center for Professional and Graduate Studies on their experience with and views on online courses. 

  • Visible Knowledge Project, Georgetown University.   The Visible Knowledge Project (VKP) worked to improve the quality of college and university teaching by focusing on both student learning and faculty development in technology-enhanced environments. Steve Ehrmann, Director of the Flashlight Program, provided evaluative consulting to VKP over the life of the project.

For some more ideas about how we approach the evaluation of grant-funded technology projects, take a look at this chapter on the Flashlight Approach and this chapter on "How (not) to Evaluate a Grant-Funded Technology Project", both from the Flashlight Evaluation Handbook.

 

One Columbia Avenue,
Takoma Park, Maryland 20912
Phone
: 301.270.8312/Fax: 301.270.8110  

To talk about our work
or our organization
contact:  Sally Gilbert

Search TLT Group.org

Contact us | Partners | TLTRs | FridayLive! | Consulting | 7 Principles | LTAs | TLT-SWG | Archives | Site Map |