As Reference and Instructional Services Librarian, a significant percentage of my work focuses on assessment. One of my favorite classes to teach as the social science liaison is Communication Studies 152: Civic Engagement through Public Communication. Throughout the semester students produce a series of informative, persuasive, and group speeches. Instructors encourage students to speak about topics that not only interest them, but that also engage with the current civic discourse.
Because topics generally focus on current issues, sources run the gamut from open web sources to scholarly articles. Most speeches utilize an array of government statistical sources, local newspaper articles, and scholarly, peer-reviewed material. On top of this breadth lies the fact that a majority of COM 152 students are freshmen, many of whom have never been exposed to college-level research or library databases. This leaves 50 minutes to teach students the information cycle, the difference between scholarly and popular, how to effectively use databases (and a wide variety of them, since topics can fall under any discipline), and how to critically evaluate the information they find. A daunting task, but one that instruction librarians regularly face.
Working with course instructors, information literacy librarians make tough decisions about what to teach and what not to teach on a daily basis. Creating clear, relevant, and measurable learning outcomes helps us prioritize and focus our learning objectives. Assessing these outcomes illustrates if students learn what we teach. We then close the assessment loop by using the results to inform our future teaching. But what do we do if the results continue to show students aren’t grasping a particular concept? We can incorporate different teaching techniques. We can ensure we’re teaching to various learning styles. We can develop different active learning exercises. In sum, we go back to the drawing board. We don’t give up. But how often do we take a step back and ask ourselves, “Is this a skill a students (still) need? Do we need to move on and focus our attention elsewhere?” After all, time is precious and we may be letting one piece distract us from the greater puzzle.
This spring I piloted a pre- and post-test assessment piece in four of the sections of COM 152. I learned a lot about the effectiveness of my teaching and how students conceptualize some of the material. The tests also revealed that students repeatedly failed to grasp the difference between keywords and subjects. A handful of conclusions can be drawn from the results, but I began to wonder if this was an essential skill for students in this course to master. A large portion of students’ sources (for better or worse) come from open web sources and newspapers, both of which typically do not use controlled vocabulary and often allow for full text searching. Recognizing the difference between subjects and keywords might prove useful when searching for scholarly articles or using the catalog, but since sources need to be within the past 5 years, students often ignore the catalog and their scholarly sources trend toward broad pieces on general issues.
Through working with students one-on-one in research consultations, I think students often discover controlled vocabulary serendipitously. They’ll search a database and begin to look through the records. They notice that within each record are hyperlinked terms that often reflect their initial keyword search. Since Millennials are so accustomed to URLs, they’ll click on the subject term and realize that the database has now returned more relevant records. Some students will ask why it happened, while other students don’t care why it happened but realize that they’ve “done something right.” They begin to notice the database limiters. Serendipity.
Is it possible to quantify which learning method is more valuable – learning within the classroom or learning by doing? Are the two separate? I can create active learning exercises that incorporate this same process, but the activity is divorced from the students’ point of need. Or is this all irrelevant? Knowing the difference between controlled vocabulary and keywords is a lower order skill. Should my efforts focus on higher order information literacy skills? Is this possible without knowing the difference between keyword searching and controlled vocabulary?
I believe it is possible. Teaching the difference between keywords and subjects may be a traditional learning objective, but its time may have run out. In an increasingly digital educational landscape where information overload is almost inevitable, this is one piece that I’m growing increasingly comfortable removing from the puzzle.