PBS Kids Summit: Lessons From Usability Testing

1. PBS KIDS LOG-IN


Testing – in 2005 launched first log-in system. Focused on 6-8 year olds. Main take-away was that a lot of 6 year olds didn’t even understand what ‘creating an account’ even was. That has to be explained to them.

Originally asked for kids email address etc and there were too many steps.

Last year when they were looking to do even more customization set out to re-design. Main UI takeaways:

-- Old Version --
- old sign up was too boring too detailed.
- The look and feel was totally different to the game they were just on.
- If there was an error (eg existing username) the whole form would be reset and there was only a red arrow. Very frustrating user experience.
- Secret question password retrieval – most kids didn’t even know it was a drop down, so only ever used the default question (pet’s name)

-- New Version --
- kids in 2010 KNOW what accounts are these days! Social media prominence has changed the understanding for young kids of what an account is.
- Technology caught up so they could do a ‘lightbox’ – do you could see the page you were on underneath.
- Now only three steps.
- You also get audio so you don’t need to read. Every screen tells you what to do.
- They now SUGGEST usernames if you can’t find a unique
- They now SUGGEST passwords
- You get a password second confirmation field.
- Have a visual code instead of a ‘secret’
- Allow to PRINT password and USERNAME out (or prompt to write down in a safe place)


2. PBS KIDS GO! VIDEO PLAYER UI

Tested prototype found:
- Ratings was something for 1 -5 stars was too complicated for kids. Kids ended up choosing 1 or 5 (love it or hate it)
- Thumbnails weren’t enough for kids. They wanted to know duration, name of clip, what it was about. Didn’t want to mouse over to get this info
- They didn’t know what the word PLAYLIST was. Associated with music.
- Some buttons that were important but just had words to identify weren’t used at all – eg. Highest rated, full length (kids didn’t know what these things meant)

Changes made:
- turned the word PLAYLIST to CHANNELS (there was a concern about this term but kids figured this out more quickly)
- integrated the blue buttons better (so ‘highest rated’ became ‘top ten’
- added scrolling wheel of all shows – so it was really easy to get to your favorite show easily.
- Added PREVIOUS and NEXT arrows next to PLAY BUTTON – works well especially for Pre-K users.
- Integrated log-in. Now when you rate something, you also add it to oyur favorites list.

PRE-K VIDEO PLAYER UI
- This player had younger audience considerations
- All characters must be instantly visible.
- Didn’t worry so much about themes, that is for parents
- Made parent links less visible. Focused on simple, relevant to preschooler buttons only.
- Don’t design anything assuming a parent is monitoring them
- In testing the ‘more’ button didn’t work as it was boring and kids can’t read! So all characters needed to be present on the one page.
- Parents weren’t noticing the parents bar they made for them.
- Kids were unclear how many videos were there – because there were only 8 thumbnails - kids thought there were only 8 videos.
- There’s a pause button but they don’t ever really pause it because they just watch a video then leave or watch the next one!

So they
- brightened up the parents buttons more.
- The MORE button became a VISUAL ‘more’ button
- Added a ‘kachunka’ bucket on the left to show depth of content




3. AUGMENTED REALITY
Testing results (general thoughts):
- Games like the PSP AR game (with a pet) kids had trouble holding and keeping marker in the frame. Annoying if the games reset once you come back to it.
- Holding mobile devices is heavy for kids.
- Holding something up to a webcam was frustrating for kids – paper flops, arms get tired, and technology is not forgiving.
- Kids really liked seeing themselves on screen.
- Things where you don’t have to hold or do anything much is cool
- Kids weren’t really wowed by this technology! Only adults really thought it was cool.
- PSP iPad game was more fun when it was a normal game and not AR.
- The most engaging things were customizing characters
- Seeing yourself on the camera.
- If the game makes you look like you are part of it it’s a big plus.


4. iPAD VIDEO PLAYER

Testing
- Wanted some kids who had never used an iPad before.
- Wanted to make it very familiar to the website interface, but also easy to use for kids who don’t use PBS Kids
- Even kids who hadn’t done touch screen before just knew what to do immediately. Wanted to keep the parents away!
- If you swipe a ‘blue’ eye a parents bar appears.
- Gestures were kept simple – tap, flick.
- Kids would press and hold. Wouldn’t do anything and waited for them to let go.
- Realized the pause, next and previous were treating it as buttons. So made things that are to be pressed LOOK and BEHAVE like buttons.
- Visually make it clear sliders can slide.
- Playlists were hidden, so a ‘browse’ button (text) for parents to use that slid out. This worked and didn’t bother the kids.