User testing

[denesnori]

My ideas on user testing.

Part 1: questions for user testing:

• Please suggest more questions :)
• and tell which questions are inappropriate/badly worded?

Part 2:I think we need to give them some introduction what we want to achieve with the app on the long run.

• My intro is supposed to be just a starting point. I am sure it is badly worded..etc.
• Please feel free to edit it
• I am not sure whether I managed to stay objective in the introduction/ I am sharing too much info with them.

User testing

Testing notes

What do we want to find out?

• Is there a clear call to action on the landing page?
• Is there a clear journey through the app?
• Are there any pain points? Is anything unclear?
• Does the interface inspire confidence?
• (Is it enough to add the icons just on the depression page? Do the they have trouble rememembering what the icons stand for?)
• Is there an functionality you would love to see in the app? (E.g. We know that we lack "the save the most important questions option" at the moment)

INTRO FOR TESTERS

This is what we should tell them before we begin testing. Just include this info in the email when we share the link to the MVP. This intro should be objective, but it should give them context about the app.

We built a website that encourages clinicians and patients to make a shared decision about the treatment that the patient will receive. Our product owners worked closely together with clinicians and collected the most common questions that patients ask about their treatment options. The goal is to give unbiased information on their treatment options. The currently used decision aid/grid can be overwhelming for young patients, so to avoid it we introduce them to the information in a step by step manner.

The target audience is young patients aged 12-18. Children born in the digital age are used to animations, interactive technologies to capture their attention we introduced an interactive option. For young adults or parents we have another option, where we focus purely on sharing information.
During the design sprint we worked with the data collected on depression.

[rosatown]

Hi Nori,

This is great. Thanks so much for sending these questions over -- I will send this out to our young people today to get some feedback.

Just a quick clarification question -- what do you mean by "pain points"? Like things that are difficult to get through or understand on the app? As far as wording goes, I was thinking something like this:

•Is it clear what to do on the first page?
•Is there a clear journey through the app?
•Is there anything that is difficult to do on the app? Is anything unclear?
•Do you feel confident using the app?
•What do you think about the icons for the different types of treatment? Should they be labelled or is it easy to remember what they are?
•Is there something else you wish the app could do? (E.g. We know that we lack "the save the most important questions option" at the moment)

A few other potential questions:

How did you find using the app?
What feelings did the app bring up for you, if any?
Is there anything about the app that made you feel uncomfortable? If so, what?
Would you recommend an app like this to your friends if they were thinking about treatment for depression? Why or why not?
Were any of the icons unclear or confusing?
How helpful do you think this app would be in helping you to choose a treatment option for depression? (not helpful, somewhat helpful, very helpful?)
Would you feel comfortable using this app on your own? Why or why not?

[rosatown]

And for the intro, here's a slightly reworded version:

The "Your Decision" app (currently available as a website prototype) aims to encourage young people, their parents/carers and clinicians to make a shared decision about treatment for depression. The app is intended for use during clinical assessment session in CAMHS when young people and their families are first seeking treatment or support for depression.

The researchers who helped to develop this app have worked closely with clinicians and young people to collect the most commonly asked questions about treatment. The goal of this app to give unbiased information on all of the evidence-based treatment options for depression, while allowing the presentation of this information to be tailored to the individual so that it is not overwhelming.

The target audience of this app is young people aged 11-18 who are seeking treatment or support for depression. We use animations and interactive technologies to capture the attention of young people. For young adults or parents, we have created another option with the focus of purely sharing information. This information was adapted from a paper-based version of this decision aid during the design sprint portion of the Anna Freud Hackathon. We are now seeking feedback from potential users of the app to continue to improve its design.

[njsfield]

Hi @rosatown,

Thanks for your input here :) we're happy with the reworded introduction you've suggested and the questions too, I would only suggest removing the open-ended How did you find using the app? and What feelings did the app bring up for you, if any? questions, in case users find it difficult to word their answers. But the more feedback the better, so it's up to you:)

[njsfield]

For testing purposes I will also add an additional prompt at the end of the interactive demo to alert users that the demonstration has ended.

[njsfield]

@rosatown @DHayes1987 if you were to request Users to demo the site on a modern browser (like Chrome), would it be okay to ask the following three questions-

• What devices do you own? (*e.g "iphone 5, macbook air", "samsung galaxy s7, chromebook")
• (If more than one device) what device would you use most to browse websites?
  and
• What browser would you usually use? (Chrome/Safari/IE/Microsoft Edge/Firefox/Other) ?

This would give us great feedback about the technology our users may use and the range of browsers we should aim to support during development

[denesnori]

It is really good point and highly important. :)

[rosatown]

That's great @njsfield about the popup -- I will add the questions about the browser to our Survey Monkey survey about the app and try to get some more people to complete it shortly!

[rosatown]

Here's our current survey monkey survey -- please feel free to send this link around to anyone you think would complete the survey. :)

https://www.surveymonkey.co.uk/r/YSGV9JG