Matrix Surveys with Flashlight Online 2.0

 

Handbook and Other Materials l Asking the Right Questions (ARQ) l Training, Consulting, & External EvaluationFAQ

 

Let's begin with a situation. An instructor (or instructors) want to gather student feedback about several features of their courses, including online discussion (which occurs in only some courses) and face-to-face (f2f) discussion (ditto). Question Group 1 will go to all courses, question group 2 (online discussion) to some, and question group 3 (f2f discussion) to some courses. 

The author(s) create their question groups and their respondent pools (a respondent pool is a group of people who all receive the same questions; in this case a respondent pool is a course). For each respondent pool and for each question group, the author(s) can add metadata. 

Metadata (information about data) in Flashlight Online 2.0 has two components: a key and a value for that key. In our example, the key might be "activity" and some of the values for that key might be "online discussion" and "f2f discussion." 

Rules for creating metadata:
Key
an alphanumeric string (spaces allowed, case sensitive) to describe the class of values being represented (can not contain these 3 characters: "{" "}" ":" )
Value
an alphanumeric string (spaces allowed, case sensitive) that is the value being represented.

To create a matrix survey, an author:

  • Creates two or more question groups. One or more of those would be assigned some metadata
    (e.g., "activity:online discussion")   [Notice that there are no blank spaces between the key, the colon, and the value)
  • Creates two or more respondent pools.  One or more of those would be assigned some metadata
    (e.g., "activity:online discussion")

If a question group has no metadata, then people in all the respondent pools will see it. 

The result might look like this:

Question Groups

 

Respondent Pools

Question Group 1

(no meta data)

Question Group 2 on online discussion

(activity:online discussion)

Question Group 3 on f2f discussion

(activity:f2f discussion)

Workshop 1

(no meta data)

X

 

 

Workshop 2

(activity:online discussion)

X

X

 

Workshop 3

(activity:online discussion)

(activity:f2f discussion)

X

X

X

Workshop 4

(activity:f2f discussion)

X

 

X

Workshop 1 has no metadata so its students only get question group 1 (which also has no metadata).

Workshop 2 has metadata (activity:online discussion), so its students see question group 1 (no metadata so it's a 'universal donor') and question group 2 about online discussion.

Workshop 3 has two lines of metadata: "activity:online discussion" and "activity;f2f discussion" so it gets all three groups of questions.

Workshop 4's metadata ("activity:f2f discussion") matches that for question group 3, so its students get those questions plus the questions from Group 1.

To see how these metadata are actually entered for question groups and respondent pools in Flashlight Online 2.0, click here (apologies for the low resolution of YouTube!)

 

PO Box 5643
Takoma Park, Maryland 20913
Phone
: 301.270.8312/Fax: 301.270.8110  

To talk about our work
or our organization
contact:  Sally Gilbert

Search TLT Group.org

Contact us | Partners | TLTRs | FridayLive! | Consulting | 7 Principles | LTAs | TLT-SWG | Archives | Site Map |