Choosing the Right Methods of Data Collection
What kinds of data can I (and should I) collect?
by Colleen M. Kuusinen, Assistant Director for SoTL
If the first question you're asking yourself is, "Should I use qualitative or quantitative methods?" you may be skipping some important questions. Check out our "Getting Started" page to review these types of research questions.
You have likely considered final, or summative, assessments (assignments) in your course: exams, papers, presentations or other final products that students typically produce towards the end of your course. These are fine sources of data--keep in mind, however, that these assignments may represent the synthesis of different skills and forms of knowledge beyond the scope of your SoTL study. Think about formative assessments that you can use to collect data on how and what students are learning as your study progresses:
- Selected questions from an exam or standardized assessment measure
- Classroom Assessment Techniques, or CATs, a form of active learning
- Evidence of student thinking: Observation of students (recorded as field notes), audio recordings of student group work, think-alouds
- Instructor reflections: Your own written reflections on student learning and how that relates to your instruction
- Student self-report of learning: Interviews or focus groups with students (current or past), surveys. The UGA-CTL conducts mid-semester formative evaluations (MSFEs) each semester than can constitute data for a SoTL study. This means we can collect and synthesize data for you!
If you have a more exploratory SoTL study, qualitative measures such as case studies, interviews, and focus groups tend to be more useful for these studies.
- This brief yet informative guide from the Vanderbilt University Center for Teaching talks a little about direct vs. indirect evidence of learning and breaks down qualitative and quantitative sources of data.
- In addition, this 2005 article from Dan Bernstein and Randy Bass discusses the limitations of just using graded work, especially for uncovering the "intermediate processes" of student learning.
Once you've identified some methods you might want to try, remember to search the literature for other SoTL scholars who've used those methods. In addition, here are some resources when you're ready to dive deeper:
- Social Science Research Methods Knowledge Base
- Social Science Research: Principles, Methods, and Practices (free, open access textbook)
- Finding Pre-existing Questionnaires and Instruments (always recommended above creating your own)
- UGA offers all faculty and graduate students a free account with Qualtrics, an online survey development tool
- Guidance for Creating Likert Scales
- AAC&U's VALUE (Valid Assessment of Learning in Undergraduate Education) rubrics for assessing written work