17 June 2006

What should we ask in an online tutorial evaluation form?

Quote of the week - "The less you know, the more you think you know, because you don't know you don't know." -- Ray Stevens

What should we ask in an online tutorial evaluation form?
1. Questions may vary depending on purpose, but it’s ideal to establish a picture of the respondents, how much do you want to know about the users: ages, sex, year of study, have they used an online tutorial before,
2. Look at content and determine if there are specific sections or aspects you want feedback about.
3. Do you want feedback about the ‘look’, ‘feel’ and ‘ease of use’?
4. Include instructions about how to complete evaluation and the purpose of the evaluation
5. Build a ‘thank-you’ in to acknowledge respondent’s time

Please take a moment to complete the evaluation form. Your feedback is valuable as it helps us to improve the online services we offer.
1. What is your current status?
* First year * Second year * third year * Honours * Graduate Diploma (etc)

2. How many times have you received library training room instruction at this University?
*1st time *2nd time *3rd time *4th time or more

3. Have you received library instruction at another institution? *no * yes If yes, where?

4. This tutorial will help me complete my course assignment.
*Strongly Agree *Agree *Disagree *Strongly Disagree

5. This tutorial will help me do research in other classes.
*Strongly Agree *Agree *Disagree *Strongly Disagree

1. Tell us one thing that you learned from this tutorial.

2. Was there anything that you think should have been covered, but was not?

3. Are there any sections which you would like expanded? Please be specific.

4. What parts of the tutorial were most useful?

5. Were there any parts of the tutorial which confused you. If yes, which parts. Please be specific.

1. The tutorial is well structured and logical:

*Strongly Agree *Agree *Disagree *Strongly Disagree

2. I found it easy to find my way through the tutorial

*Strongly Agree *Agree *Disagree *Strongly Disagree

Any other suggestions?

* Nothing, because it’s all bad. (Why evaluate in the first place?)
* Put it in a “staff only” report, which seems a waste of time
* Put it on the website or tutorial so everyone can see what others have to say.
* Use it to ‘improve’ the tutorial. Will you add the feedback to a database? When will you act on the feedback, once 5 students say the same thing, or 10 students?

I draw on my experience with surveys as well as other sources for my ‘posts’. I would like to acknowledge the following websites as sources of content for the evaluation form and principles of surveys discussed in this post:

07 June 2006

How do you integrate information literacy into Faculties that offer ‘structured’ programs?

Quote this Post - “Begin—to begin is half the work, let half still remain; again begin this and thou wilt have finished.” ~ Decimus Magnus Ausonius

How do you integrate information literacy into Faculties that offer ‘structured’ programs?
So, you have an opportunity, now it’s down to planning and doing:
Planning with Faculty staff in ‘structured’ programs:
1. Use your University Teaching and Learning philosophy as a guide
2. Does your library have a Teaching and learning framework and plan?
3. Do you know the Infolit Standards for your University Council, or have a library organisation which has endorsed infolit standards.ie. In Australia we use the Information literacy Standards endorsed by the Council of Australian University Libraries & Australian and New Zealand Institute for Information Literacy (ANZIIL) known as the ANZ Information literacy framework http://www.caul.edu.au/info-literacy/
4. Use this as your framework, look at the learning outcomes, decide which year to introduce each competency or standard, I prefer competency, (may vary depending on discipline), keep in mind that it is a ‘framework’ and there may be gaps between competencies and learning outcomes, also it is limited in providing a framework for assessment.
5. When choosing infolit course content, writing learning outcomes and assessment grids, be sure to make sure there are no gaps, work backwards from assessment (all of the competencies & outcomes you are going to assess, then choose content and then choose learning outcomes). This will ensure that you are not assessing anything that hasn’t been covered and that you are assessing real learning outcomes.
6. You will need TIME, plenty of butchers paper, or use MS Powerpoint to Storyboard your ideas, or MS Excel to ‘spreadsheet’ plan if you like this method. I have the Australian Standards compiled in an excel file, completed in March this year. If you would like to use this gratis, please contact me.
7. Are there any online course management tools which you can use to facilitate the ‘incorporating’ of the infolit competencies week by week with course content. Tools such as Blackboard have been used by some Australian universities. This tool has the facility to include ‘tests’ week by week to see how the students are going.
8. Create a pool or ‘database’ of online assessment questions – use all of your teaching team librarians to do this; give each person a standard, or criteria and ask for six different quiz questions and answers. Ensure that you ‘log’ these in some central database in the library, so all librarians can ‘use’ these at anytime in infolit planning. For example: Standard 2.2 Constructs and implements effective search strategies:
Which boolean operator do you use to ‘combine’ terms and narrow results:
[AND ] [ OR ] [ NOT ]

9. Does your library have an online tutorial which is based on the Information literacy standards? Can it be ‘linked’ to from within online course management programs such as Blackboard, or are portions of it suitable – this is the beauty of a ‘modularised’ online tutorial.
10. Some institutions use the term ‘Workbook’ when incorporating infolit into curriculum and this usually is associated with ‘implanted’ infolit, and while better than nothing is not the ideal method. If you find that a separate module is what you are offered, call it something ‘inspiring’ rather than a workbook. How about “Information Competency Module” or “Information Research Basics” or something else that inspires learning, or ‘Information Highway module’ or ‘Information Research Module’. Get those creative juices flowing!
11. The beauty of structured programs is that you can ‘stage’ or introduce at different year ‘levels’ the different information competencies to form an information competency scaffold tailored to your discipline. Information scaffold was coined by Brabazon, Tara (2004).
"Bachelor of Arts (Google): Graduating to information literacy," Keynote Paper, IDATER on-line conference on e-learning in Science and Design Technology, Loughborough University, August 2004 (URL: http://www.lboro.ac.uk/departments/cd/docs_dandt/research/ed/elearning/Lead%20papers/BrabazonPDF.pdf)

I personally like the term - Information Competencies Scaffold. What do you call it at your institution?