ARQ: Evaluating Brief Hybrid Workshops

 

Handbook and Other Materials l Asking the Right Questions (ARQ) l Training, Consulting, & External EvaluationFAQ

 ARQ Home Page l ARQ Modules l Brief Hybrid Workshop Home Page

A Brief Hybrid Workshop usually runs 5-15 minutes, has a variety of materials (e.g., eClips - multimedia materials; handouts; resources for further inquiry; and includes interaction and active learning for the participants.  This ARQ module, itself a brief hybrid workshop, is designed for developers, to help them devise evaluation plans for their workshops. 


Guidelines for facilitators

Introduction: This workshop has three elements, as you'll see in the eClip: feedback during a workshop; feedback as the workshop ends or shortly thereafter; and evaluation of a program of brief hybrid workshops. You may well want to do only the first one or two elements, in which case stop the eClip when it gets to the program evaluation slide.

Options: The Flashlight Online template explained in the eClip is quite short, in order to maximize response rates. You have the option of creating a different template and an eClip to explain it: a survey template that seeks more detailed feedback (e.g., about the eClip, about the activity, about the readings, about the respondent's sense of whether this is an important topic, about the respondent's expectations of using what's been learned in the workshop.) If you do so, please share your new materials with ARQ; we may want to add them to this page.

Publicizing your workshop: Find participants who have developed, or who are developing, brief hybrid workshops for faculty or students.  Text for an announcement: "No one makes a perfect workshop the first time out, especially if you hope that others can use your materials, too. This brief workshop on evaluation explains several ideas, and a survey template, you can use to get feedback for improving your materials and skills. To prepare for the workshop, go to this web page and watch the 4 minute eClip. If you have time, take a look at the other materials as well."

Preparations:
Print copies of the Flashlight Online pdf
Using the template (you can change it if you like), create a feedback form for this workshop. Decide whether people should respond on paper or online.

Guidelines for participants
Watch the eClip about the workshop (#1 in the right hand column on this page) before the workshop if possible.
Come prepared to critique the Flashlight Online template

Activities
1. Watch video if necessary
2. Do a 'muddy points' exercise about the video and discuss.
3. Look at the pdf of the Flashlight Online template. Consider the tradeoff between fewer questions (more responses) and more questions (get those who do respond to talk about what you most need to hear, in order to improve your workshop. How would you modify the template?  Think about this alone (2-3 minutes) and then compare notes with a colleague.
4. (Optional): discuss how to evaluate the institution's program of brief hybrid workshops.
5. Fill out a Flashlight Online survey about this workshop.



eClips

1. YouTube eClip explaining the workshop ideas
2.  eClip demonstrating how to use and modify the template in Flashlight Online (not yet produced)
3.  eClip from a previous participant in this workshop talking about how s/he used what s/he learned in the workshop



Accessibility Options
(not yet produced)



Other Resources
Handout (pdf of the Flashlight Online template)

What's Next?

Immediate Next Steps

  1. Develop a survey for your own workshop.  The Flashlight template is available in Flashlight Online 1.0 as template ZS70018 (Flashlight: Evaluating a Workshop). Or you can use these questions with another survey tool.
  2. Pretest your survey with 1-3 people. Decide whether, as written, the survey a) produces information you and future facilitators could use to improve your workshop, b) is short enough and appealing enough so that most people would respond.
  3. Write a description or create a brief eClip (e.g. 1-2 minutes) describing what you've done, if you think others might like to do this too. Start by describing your feelings about creating surveys before you took this workshop, then say what you learned from your own survey, and whether you think others might benefit from learning to do such surveys
  4. If you have colleagues who might be interested, get a few together and run this workshop yourself.

Later Steps

If your institution is using brief hybrid workshops systematically as part of its strategy for engaging more faculty, and improving teaching institution-wide, it's important to gather evidence so you can track and improve faculty engagement.  If you'd like The TLT Group to develop more materials in this area, or to provide some consulting help, please get in touch!

Future Activities, Additional Resources

Watch this space. We'll periodically add new eClips and new Flashlight templates.

 

 

PO Box 5643
Takoma Park, Maryland 20913
Phone
: 301.270.8312/Fax: 301.270.8110  

To talk about our work
or our organization
contact:  Sally Gilbert

Search TLT Group.org

Contact us | Partners | TLTRs | FridayLive! | Consulting | 7 Principles | LTAs | TLT-SWG | Archives | Site Map |