Article Summary: Chen et al. (2018) Computer Supported Collaborative Learning in 3 Meta-Analyses

Motivation 

To examine the factors that make computer supported collaborative learning (CSCL) environments effective. I’ll admit that the authors refer to this paper as a single meta-analysis, but I’d argue they’ve really done three meta-analyses with subsets of the same (large) set of papers. At the very least, I hope the amount of work that the authors put in isn’t the new standard for completing a meta-analysis.

Three research questions for CSCL

The authors chose to examine the following three research questions simultaneously based on the same set of papers because the efficacy of CSCL environments involves multiple, interrelated factors and can be compared to multiple, valid control groups. CSCL researchers manipulate only a subset of these factors in each study to determine the efficacy of specific interventions. While this controlled approach is scientifically sound, it means that a single study cannot compare CSCL environments to a range of possible alternatives. Therefore, the authors simultaneously considered 356 papers that included 425 studies to determine which features of CSCL are more effective compared to which alternatives.

Continue reading

Helpful vs Unhelpful Responses When Someone Says They’ve Been Offended

This week in both my personal academic community and in the larger academic community, I saw people speaking publicly about behaviors that offended them. After reading the comments on both instances, I noticed a trend in what was helpful and not helpful. Instead of my usual article summary, I wanted to write a summary of my observations.

This week on academic Twitter, we saw this tweet.

too young to be a professor

I get this comment about once a semester (or way more if you count undergrads who email me starting with, “Hey Lauren,”), and I always find it offensive. I want to extra-emphasize that this is a comment that strangers make, and it has nothing to do with my personal qualifications. Instead, it reminds me that I belong to an underrepresented group in my profession and that regardless of our qualifications, some people find it strange that young women are professors. Continue reading

Book Summary: Biggs & Collis (1982) Evaluating the Quality of Learning – SOLO Taxonomy

Motivation

Provide a framework for more consistent, qualitative evaluation of student responses to open-ended questions that can be used in many disciplines to determine the degree to which a student has mastered a learning objective.

Part 1: Structure of the Observed Learning Outcome (SOLO) Taxonomy

The SOLO taxonomy was designed based on student responses to open-ended questions in many disciplines. The taxonomy has 3 dimensions:

  1. Capacity: the pieces of information required to produce the response, ranging from low (i.e., only the information in the question and one relevant piece of information) to high (i.e., the question, multiple pieces of relevant information, interrelations among information, and abstract principles are included in response)
  2. Relating operations: the relationship between the question and response, ranging from illogical (e.g., tautologies), to question-specific information only (i.e., answers the question without relating to principles or concepts), to information that generalizes beyond the specific question (i.e., relating response to abstract principles and concepts).
  3. Consistency and closure: the consistency between information provided and the conclusion that the student comes to, ranging from not answering the question, providing inconsistent evidence or jumping to conclusions, to consistent evidence and multiple conclusions based on relevant possible alternatives.

Continue reading

Article Summary: Margulieux et al. (2019) Review of Measurements in Computing Education Research

50 free eprints are available at this link. If the free eprints run out, please contact me, lmargulieux@gsu.edu.

Motivation 

To review the variables that computing education researchers measure and how they measure them. The particular aim of this review was to highlight areas for improving standardization in the field so that we can more easily make comparisons among projects when appropriate. The review favors quantitative data analysis (as standardization is antithetical to the goals of much qualitative data analysis) but considers the important contribution that qualitative data makes.

Measurement versus data 

The first section of the paper is a short primer of often misunderstood concepts in measurement. It is intended for only readers who never had formalized measurement training or who want to check their understanding. The section explains common mistakes or questionable data analysis methods the authors have seen while reviewing, like using the split-mean method or difference/gain scores. For the purpose of a summary, I’ll focus on only the most fundamental point–measurement is not always the same as data. A researcher can use a qualitative measurement to create quantitative data, e.g., by asking a students to write programs (qual measurement) and giving them numeric grades (quant data). Similarly, a researcher can measure continuous data, such as a numeric grade from 0-100, and record ordinal-level data, such as a letter grade from A to F. This difference is important because researchers need to consider the data transformations that occur after measurement to use the correct analysis tools/tests and draw valid conclusions.

Continue reading

Article Summary: Wood et al. (1976) Role of Tutoring in Problem Solving

Motivation

Explore the nature of the scaffolding process in which someone with more experience helps someone with less experience to complete a task that the less experienced person would not be able to complete on their own.

Key Elements of Scaffolding

Wood et al. argue that scaffolding is an essential part of human learning for a large range of tasks, such as communication and movement, but focuses on problem solving and higher-order skill acquisition. Within this focus, scaffolding

  • is provided in a social context by an expert, instructor, or person with more experience to a novice or person with less experience
  • is individualized to the learner yet likely follows a common structure among learners
  • enables the novice to “solve a problem, carry out a task, or achieve a goal which would be beyond his unassisted effort” (p.90)
  • allows the learners to complete as much of the task themselves as possible (i.e., the expert does not model the complete task for the novice to observe and imitate)
  • controls the parts of a task or reduces a problem solving space that would inhibit the novice’s success so that the novice can focus on components within his capability.

Wood et al. hypothesize that scaffolding helps learners to master a task more quickly.
Continue reading

Article Summary: Stürmer et al. (2018) Relationship Building for Higher Distance Education

Motivation

To evaluate the effects of the fast-friendship procedure on social integration and retention in an online college course.

Combating Challenges of Online Education with Social Integration

Though online education has flexibility and accessibility benefits, it also has significant challenges. Online learners must be more self-organized and self-regulated than face-to-face learners, and they face increased social isolation. Moreover, online learners must have high digital literacy and manage several technical tools that may not be integrated, either technologically or curricularly. These challenges are often harder to overcome for non-traditional students, who likely have significant professional and familial obligations, and for students from underrepresented groups, who are often first-generation college students and/or from low socioeconomic status families (implying less access to tech growing up, poorer preparation for college during K-12 education, and higher likelihood of holding a job during college)—the very students who many hope online education would help the most. These challenges can become impassable barriers, leading to low academic performance and high dropout rates. Continue reading

Article Summary: Kolluri (2018) Advanced Placement: The Dual Challenge of Equal Access and Effectiveness

Motivation

To review the literature on the Advanced Placement (AP) program to determine whether it is reaching both its historical goal of equipping advanced students with college-level skills and credit and its more recent goal to serve students from marginalized backgrounds.

The History and Evolution of AP

Over 50 years ago, the AP program began as a collaboration between elite private schools and universities to provide advanced high school students will opportunities to engage in college-level curriculum and, thus, develop college-level knowledge skills and earn college credit. As college degrees became more common, AP expanded its audience, especially with the goal of serving students who are underrepresented on college campuses. Therefore, AP aims to provide both college-level curriculum for advanced students and equal access to under-served students. While advanced students and under-served students are by no means mutually exclusive, the school and community systems in which they tend to learn are often different. Continue reading