Re: Evaluation
What does it mean to evaluate and what are the tools we can use? — A reflection from an interaction design student.
Evaluation occurs all the time; from the first idea that arises spontaneously to the evaluation of how a project turned out. Through evaluating our work from the beginning on, we are able to quickly test whether or not we are moving in the right direction with our designs. We can quickly assess the usability, usefulness, engaging level and motivation. However, when conducting evaluation we have to be aware that it can be challenging to remain objective due to our own individual interpretations resulting in biases.
In class, we summarized some tools that can be used for evaluation.
- Interviews/User Testimonials
- Survey/Questionnaire
- Cultural Probes
- Bodystorming
- Ethnographic Video
- Desirability Testing
- Think Aloud Protocol
- Storytelling
- Related Works
- Mentors/Peers
In the paper, “Staying Open to Interpretation: Engaging Multiple Meanings in Design and Evaluation”, Phoebe Sengers and Bill Gaver talk about how different, interpretations of a system can be taken advantage of. The paper suggests that shifting from only designing for a single, correct way of interpreting a system, to specifically designing for multiple interpretations may bring forth richer, more personally meaningful interpretations.
Personally, I think it is interesting to challenge the notion of single-use to and design for clear usability yet letting the user decide of its usefulness.
Especially in regards to our interaction design process class, even though our card game is supposed to be a tool for designers to build trust with their target audience during field research, it can be used for different circumstances as well. It might be worth trying out the external evaluator if there was more time, in order to hear an account from a different perspective.
