Feedback: the Ultimate Frenemy

Imagine a working environment where your most critical project stakeholders are unpaid, undereducated and don’t speak your language. These are the challenges I love about public health and about working abroad.

We’re hosting another community volunteer meeting during my visit, and I’ve been playing around with different ideas on how to get the most valuable feedback from each of them.

Letting people speak up and having open dialogue during my last visit was insightful, and it lets people ‘piggy back’ off of one another’s thoughts, which is great. But I’m not confident enough that it can represent each volunteer’s experience. To do an evaluation I really need all of them to provide feedback.

So I’m trying to design a survey they can all take at once, which would be really simple if everyone was literate.

Traditional Likert Scale

To make sure everyone can complete the survey successfully I want to make a ‘visual’ likert scale. The challenge here is how to illustrate the values on the scale without assigning other implied values, impacting how the volunteers respond to the questions.

one example of a visual scale, esp valuable when you need to communicate with someone who speaks another language

I thought about using thumbs up and thumbs down icons–but then what goes in the middle? I spent more time studying ‘thumbs sideways’ graphics than I’d like to admit. Will the volunteers avoiding giving us a thumbs down if they think it’s not what we want to hear? Same goes for smileys vs frowns or red, yellow, green bubbles. I’m thinking the latter might be the best option.

I did some research and there are some other thoughtful ways to get this kind of information from people who can’t read a written survey, but they are time intensive.

In one study I found, the survey respondents were given ten beans, and split them into two areas based on the likelihood they thought they were HIV+. So someone who knew they had HIV would put all 10 beans in the designated ‘affirmative’ spot, zero beans (all in the other area) if they were 100% sure they did not, and any split in between to establish different levels of uncertainty.

One big constraint here is time. We know this is the best opportunity to get ahold of the most respondents, and we don’t have all day to sit down with them individually to get this kind of information.

The more I learn about public health projects and research, the more I start to understand where compromise is necessary and where to push the envelope. New needs arise while executing one project, and these ideas and opportunities sprout up constantly. One could design (and probably fund) an entirely separate project just for designing a graphical likert scale, and it could have a big impact if it were a good replacement for the written one. We’ve all seen those pain scales–a heavily adopted measurement and communication tool that someone saw the need for and made it happen.

I believe the positive psychology description of this project would be “opportunity rich.” Having the space to explore where our resources are invested, with so many opportunities available, is exciting and scary, but mostly the former.

Zikomo as always, for following along!