Sunday, September 28, 2014

Procedures for Educative Assessment

IDEALA - Week 2 Activity - Part 1

In week 1, I established learning goals for my credit course, Library 1A: Introduction to Library Research.  As a reminder, my main learning goal is:

"A year (or more) after this course is over, I want and hope that students will confidently and capably find and use a variety of sources of information in order to understand their research interests and provide answers and solutions to their research questions and problems."

1.  Forward-Looking Assessment

Option 1:


Imagine that you are enrolled in a college course, in which the professor requires you to engage in a debate about a problem that impacts college students, such as exploitation of college athletes.  To win the debate, you must convince your audience (professors and classmates) that your understanding of the problem is strong and your potential solution is realistic.  Your description of the problem and solution must be based on scholarly sources of information.

Option 2:

Imagine that a good friend regularly drinks excessive amounts of alcohol.  Unfortunately, she has not listened to you when you suggest that she needs help.  Write a letter to your friend about the problem of alcoholism among college students.  In order to gain her attention, be sure to identify current research studies on this problem.  Summarize what you read, identify the authority of the sources, and explain how they relate to her problem.  End your letter with suggestions for where your friend can get help for her problem.

2.  Criteria & Standards

Finds Scholarly Source:

  • Acceptable: Finds a journal article; Weakly connects source to research topic
  • Exceptional: Finds a journal article; Strongly connects source to research topic
Summarizes Source:
  • Acceptable: Summarizes the source in complete sentences; identifies the main point
  • Exceptional: Summarizes the source in complete sentences; identifies the main point and sub-points; identifies argument found in the source
Evaluates Authority of Source:
  • Acceptable: Identifies the authors' background and credentials; Connects authors' credentials to the research topic
  • Exceptional: Identifies the authors' background and credentials; Connects authors' credentials to the research topic; Identifies possible bias based on the authors' credentials or vocabulary
Describes Relevance of Source:
  • Acceptable: Indicates the source is relevant to research question; Identifies how the source helps answer question
  • Exceptional: Indicates the source is relevant to research question; Identifies how the source helps answer question; Identifies gaps that are not answered by this source

3.  Self-Assessment

Group Assessment:
In class, students can work in groups of 2-3 to identify strengths and weaknesses in each others' work.

Individual Assessment:
Students apply the professor's standards and criteria to their own work.  If they rate their performance low in any criteria, they should reflect on what aspects of the standards are unclear to them.

4.  "FIDeLity" Feedback

Frequent:

  • Give individual and group work in class.
  • Assign similar work as homework.
Immediate:
  • Grade and return work promptly (by the next class period).
Discriminating:
  • Develop rubrics for standards and criteria for homework. 
  • Discuss the assignment, standards, and criteria with students.  
  • Provide examples of tasks in class and post examples online for students to review at home as needed.
Loving:
  • Identify strengths in my students' work.  
  • Focus grading on one standard, rather than on all standards, so that students can develop at least one standard well. 

5 comments:

  1. Hi Emily,
    This is fantastic, so thorough--I particularly admire your table of learning outcomes/teaching activities, which will be helpful to you and your students both! I'm a big fan.
    I think your assessment ideas are great, and I wondered if I could offer one suggestion for a tweak for your forward-thinking assessments. You've done a fantastic job of finding situations that are real, high-stakes challenges college students might actually face. I would just suggest that we consider rhetorical situation in lots of detail when we work on forward-thinking assessments. I'm not sure, for example, that a college student would confront a heavy-drinking friend with research studies (this seems like a slight mismatch between the audience, the purpose, and the context). It's not that students aren't a great audience for scholarly articles and research studies, but in this highly emotionally charged context, it seems like the scholarly studies might be most useful as preparation for the student doing the intervention (she might want to read up on the scholarly literature for intervention techniques and then put them into practice). Does that make sense? I mention this only because I think rhetorical situation is a big consideration in scenario-building (to make the scenarios as realistic as possible). I also think, though, that the overall scenarios you've created for these forward-thinking assessments are really brilliant and will hopefully help students get very invested in the skill set you're teaching.

    ReplyDelete
  2. Emily,

    I found your forward-thinking assessments to be quite relevant to college aged students. While I agree with sarahlair that students might not use research studies when confronting a peer with an alcohol problem, I do believe that you are providing an opportunity for them to think outside of the box. This type of assignment would show students that research skills are not only important when they are writing a paper for school, but can be used in many real-life situations. Every time they are required to make an important decision, research skills will help them to gather the facts and data to help them make that decision. This is probably something they are already doing without even realizing it. By presenting students with this kind of real-life scenarios, you are proving how important and relevant good research skills are in all areas of their lives.

    ReplyDelete
  3. ^Yes times 100. I'm sorry if I didn't make that clear: I think the real-world component of your forward-looking assessments is just key and will prove terrifically effective. My suggestion is truly intended as a tweak, to make the task as "authentic" as possible--but I think it's just so great to have students apply research skills to a realistic, high-stake situation they might actually encounter next week. Brava!

    ReplyDelete
  4. Hi sarahlair and Donna DeLuca! Thank you both for reading my post and offering comments. I truly struggled with the forward-thinking assessment. Alcoholism is definitely a heavy topic. I worry that I may minimize its severity by suggesting that an 18-year-old could help her peer solve this problem.

    Before I started my current credit course, I polled my 20-year-old nephew and 18-year-old niece about what interests their peers these days. Their answers included:

    financial problems
    substance abuse
    relationship problems / abuse
    eating disorders

    At the moment I am doing a "take a stand" project where students pick a problem that interests them and find a solution to this problem. This semester students have chosen Internet censorship, cults, fitness, elephants, teen pregnancy, and sports injuries. I will continue to seek the perfect "forward-thinking assessment."

    ReplyDelete
  5. Hi Emily,

    I'm a little late commenting - but I wanted to chime in an also congratulate you on great forward-thinking assessment! While substance abuse is a tough topic for an 18 year old - this is still a compelling (and relevant) topic to explore. There are definitely ways to re-frame the scenario that might not be so heavy. (Perhaps an information campaign on their dorm floor? Or maybe they are creating campus awareness posters to display on the campus bus system?) I think what you really captured well is pairing the assignment with students' interests. I have used marijuana as a topic in one-shots in the past - and you wouldn't believe how quickly everyone woke up and started paying attention. Controversial topics are great for engagement! Great job! I really enjoy your posts.

    Rebecca

    ReplyDelete