ARQ - Evaluating the Program

 

Flashlight Online log-in l About Flashlight Online l Handbook and Other Materials l ARQ l
F-LIGHT l Training, Consulting & External Eval.l Student Course Evaluation l FAQ

These materials are for use only by institutions that subscribe to The TLT Group, to participants in TLT Group workshops, and to invited guests. The TLT Group is a non-profit whose existence is made possible by their subscription and registration fees. if your institution is not yet among our subscribers, we invite you to join us, use these materials, and help us continue to improve them!

(under construction; suggestions appreciated!)

If you're considering adapting ARQ as part of a program to help faculty gather evidence from their students in order to improve teaching and learning with technology, you may also want to consider how to evaluate the program.  (To see a summary of the Flashlight Approach, click here; the ARQ materials would be the 'stuff' referred to in that summary.)

One strategy would be to study how faculty learn from their students generally.  You could ask the extent to which they agree or disagree with various descriptions of how some faculty teach each week. For example,

"These statements describe ways in which some faculty teach. Please indicate the extent to which you agree that each statement describes how you have been teaching over the last two weeks:

  • When I lecture, I usually follow a plan I lay out before class

  • I'm the expert. I rarely see a need to ask students questions, other (of course) than questions that tell me how well they understand the material in the course.

  • As I teach, I watch student expressions carefully and every few minutes alter what I'm doing in response to what I see in their faces.

  • In the last two weeks, I've given students at least one survey in which I asked their about their experiences with some element of my class.

Other questions in such a survey would ask about their experience with various faculty support services, including ARQ.

Analyzing the data: you might do this survey once a year, with all faculty or with a sample of faculty. It could be useful to see a) whether faculty learn from their students' experiences with course activities and materials, b) how faculty learn, c) whether faculty support services such as ARQ are influencing how they learn, d) what suggestions faculty members have about how to make such services more accessible, rewarding and effective.

[If you would find such a survey useful and want to develop one with us, and if your institution is a TLT Group subscriber, please contact us!]

- Steve Ehrmann, Director, The Flashlight Program
ehrmann @ tltgroup.org

One Columbia Avenue,
Takoma Park, Maryland 20912
Phone
: 301.270.8312/Fax: 301.270.8110  

To talk about our work
or our organization
contact:  Sally Gilbert

Search TLT Group.org

Contact us | Partners | TLTRs | FridayLive! | Consulting | 7 Principles | LTAs | TLT-SWG | Archives | Site Map |