Andrés Lucero

Hardhats & Bungaloos · Crowdsourcing

Feedback is an important aspect of design education, and crowdsourcing has emerged as a convenient way to obtain feedback at scale. However, there are not many deep investigations into students' expectations and perceptions of crowdsourced feedback.

We investigate how crowdsourced design feedback compares to peer design feedback within a design-oriented HCI class. We also examine the perceived monetary value of crowdsourced feedback. Students preferred peer feedback as it was more useful, fair, effective, and actionable. Additionally, students’ monetary valuation of the crowdsourced feedback revealed quality, relevancy, effort, and helpfulness as important factors that shape the value of the feedback for students. We provide suggestions for teachers in HCI and other researchers interested in crowd feedback systems on using crowds as a potential complement to peers.

Publications