Spotify Usability Report - COM 560: Interactive Media Strategies Oct. 19, 2012
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
Spotify Usability Report Jake Amberg, Alan Buck, Alexandra Porter, Dioni L. Wise Elon University COM 560: Interactive Media Strategies Oct. 19, 2012 1
EXECUTIVE
SUMMARY
Spotify
is
a
music
streaming
computer
application.
Spotify’s
user
interface
strongly
encourages
the
formation
of
music
playlists
that
can
be
created
from
imported
.mp3
files
already
on
the
computer
or
songs
found
in
the
application’s
music
database.
These
playlists
can
be
shared
both
to
specific
individuals
and
large
groups
through
social
networking
services,
such
as
Facebook,
Tumblr
and
Twitter.
A
recent
report
said
more
than
15
million
Facebook
members
used
the
service.
This
usability
test
was
designed
to
examine
the
effectiveness
of
sharing
playlists
between
social
media
users.
Eleven
participants
were
tested
for
this
study.
Participants
included
a
sample
of
primarily
Spotify
novices
with
ranging
computer
literacy,
and
one
Spotify
power
user.
Surveys
captured
Internet
usage
and
time
spent
listening
to
music,
along
with
social
media
preferences.
Recording
equipment
captured
task
completion.
Tasks
included:
• Log
into
Spotify
with
a
Facebook
account
• Create
and
name
a
playlist
• Add
five
songs
to
the
playlist
• Send
the
playlist
to
a
Facebook
friend
The
study
participants
said
the
social
function
was
easy
to
use,
but
held
little
desire
to
use
Spotify
again.
• Four
out
of
11
people
said
they
were
very
unlikely
to
use
Spotify
again.
2
• On
average,
participants
gave
the
ease
of
navigation
a
neutral
rating
(3.27
out
of
5
on
satisfaction).
• On
average,
participants
thought
Spotify
was
useful
to
share
music
(3.82
out
of
5
on
satisfaction).
INTRODUCTION
New
websites
and
applications
to
experience
and
share
music
are
becoming
more
popular
with
the
advent
of
new
business
models
for
the
recording
and
music
industry.
While
Apple’s
iTunes
has
been
the
most
dominant
application
used
traditionally,
new
applications
have
started
to
compete
with
it.
Spotify
is
one
of
those
applications
whose
user
base
continues
to
grow
and,
as
of
August
2012,
has
15
million
registered
users.
Although
the
majority
of
new
music
applications
and
sites
allow
users
to
make
playlists,
it
is
the
social
function
of
Spotify
that
makes
it
stand
out.
Users
can
browse
music
by
artist,
album,
genre,
playlist
or
record
label,
as
well
as
by
searching
directly
for
songs.
They
can
make
a
playlist,
name
it
whatever
they
want,
and
then
share
it
via
social
networking
services,
such
as
Facebook,
Tumblr
or
Twitter.
Spotify
is
used
to
stream
music,
play
local
music
files
and
create
playlists
of
favorite
music.
While
there
is
an
application
for
smartphones
and
tablets,
we
studied
Spotify’s
downloadable
version
for
a
desktop
or
laptop
computer.
The
main
interface
includes
three
sections.
The
left
sidebar
includes
the
main
navigation
and
the
list
of
playlists.
The
middle
section,
which
comprises
about
75
percent
of
the
screen,
is
the
main
content
area
that
changes
based
upon
the
users’
selection
in
the
3
navigation
bar.
The
right
sidebar
shows
recent
activity
from
Facebook
friends.
The
very
bottom
of
the
interface
controls
music
playback.
This
usability
study
solely
focuses
on
a
few
aspects
of
the
interface:
the
song
searching
functions,
the
playlist
creation
tool
and
the
social
network
sharing
function.
Objectives
The
objectives
of
this
test
are
(1)
to
test
the
ease
and
efficiency
of
organizing
content
into
a
playlist
to
share
with
Facebook
friends
and
(2)
see
how
successful
Spotify’s
social
network
sharing
function
is.
The
test
evaluates
the
users’
ability
to
complete
four
tasks:
log
into
Spotify
using
a
Facebook
account,
create
and
name
a
new
playlist,
add
five
songs
from
different
artists
to
that
playlist,
and
share
that
playlist
with
a
Facebook
friend.
Participants
directly
interacted
with
the
application
navigation,
search
bar,
“New
Playlist”
function
and
“Send
to
Friend”
function.
METHODS
Participants
Eleven
people
with
varying
media
usage
participated
in
this
study.
The
mean
age
of
the
participants
was
35.
The
youngest
participant
was
16;
the
oldest,
61.
Six
of
the
11
participants
were
male.
Three
people
were
students
(1
high
school,
2
college).
Results
from
the
pre-‐survey
helped
assess
the
participants’
music
listening
and
social
media
preferences.
Only
two
of
the
participants
said
they
did
not
use
any
of
the
eight
listed
options
for
listening
to
music
on
a
computer
(See
Appendix
9).
4
Five
participants
said
they
use
iTunes
the
most.
Three
participants
used
Pandora
the
most.
Only
three
of
the
participants
said
they
were
either
somewhat
familiar
or
very
familiar
with
Spotify
before
participating
in
this
usability
test.
In
regards
to
social
media,
10
of
the
11
participants
used
social
networking
services.
Those
10
participants
all
used
Facebook.
Context
of
Interface
Use
In
Test
The
usability
study
was
comprised
of
three
parts,
a
pre-‐test
questionnaire
(See
Appendix
1),
a
task
list
(Appendix
2)
and
a
post-‐test
questionnaire
(Appendix
3)
.
The
pre-‐test
survey
evaluated
participant’s
music
listening
activity
online
and
social
media
preferences.
Most
Spotify
users
would
the
application
on
their
personal
computer
at
various
times.
Participants
completed
the
study
on
personal
computers
in
a
home
or
office.
They
completed
four
tasks:
• Log
into
Spotify
with
a
Facebook
account
• Create
and
name
a
playlist
• Add
five
songs
to
the
playlist
• Send
the
playlist
to
a
Facebook
friend
These
tasks
were
selected
to
test
the
ease
and
efficiency
of
organizing
content
into
a
playlist
and
sharing
a
playlist
with
Facebook
friends.
The
post-‐test
survey
evaluated
the
participants’
overall
opinion
and
attitudes
towards
the
Spotify
application.
5
Test
Administrator
Tools
Participants
took
both
the
pre-‐
and
post-‐test
questionnaires
on
Survey
Monkey.
This
website
analyzed
the
results
of
the
surveys.
During
the
testing
session,
the
Silverback
application
recorded
the
users’
actions
and
their
mouse
clicks
on
the
computer
screen.
The
investigators
later
annotated
and
exported
the
videos
on
Silverback.
Procedure
To
begin
the
test
session,
the
investigators
briefed
11
participants
by
reading
from
a
script
to
ensure
each
participant
was
given
the
same
instructions.
Investigators
also
asked
users
to
sign
a
consent
form
to
allow
filming
and
to
ensure
they
understood
the
parameters
of
the
test.
Investigators
began
the
test
session
by
administering
a
pre-‐test
questionnaire
created
on
Survey
Monkey.
Next,
the
investigator
launched
the
Silverback
application
on
a
laptop
to
record
the
users’
actions
on
Spotify.
Users
followed
specific
directions
to
complete
four
tasks:
log
into
Spotify
with
Facebook,
create
and
name
a
playlist,
add
five
songs
to
the
playlist,
and
send
the
playlist
to
a
Facebook
friend.
The
investigators
created
a
Facebook
account
for
the
usability
test
ahead
of
time
so
all
participants
would
use
the
same
account
for
the
testing
session.
Study
participants
were
not
given
a
time
limit,
but
investigators
recorded
their
completion
times
and
error
rates.
Investigators
did
not
answer
users’
questions
or
help
them
during
the
test
session.
Also,
the
instructions
did
not
provide
6
specifics
on
how
to
complete
the
tasks.
After
the
participants
completed
the
tasks,
the
investigators
stopped
recording
on
Silverback
and
closed
the
Spotify
application.
The
user
then
completed
a
post-‐test
questionnaire
on
Survey
Monkey.
All
users
were
tested
on
MacBook
Pros.
Participants
were
tested
individually
with
at
least
one
investigator
present
for
the
duration
of
the
testing
session.
The
users
were
not
compensated
for
their
participation.
RESULTS
APPENDIX 2
Summary Table of Performance Results Across All Tasks
Log In Familiarize Create & Add Share Total
With Name Five Playlist to Test
Interface Playlist Songs Facebook Time
To Friend
Playlist
No. of 11 11 10 10 10 10
Participants
Who
Completed
Task
Shortest 19s 0s 4s 16s 38s 78s
Time (0:19) (0:00) (0:04) (0:16) (0:38) (1:18)
Longest 75s 80s 716s 353s 107s 960s
Time (1:15) (1:20) (11:56) (5:53) (1:47) (16:57)
Average 35.8s 26.5s 91.6s 203.3s 63.4s 407.1s
Time (Mean) (0:35) (0:26) (1:31) (3:23) (1:03) (6:47)
Median 30s 17s 17.5 206.5 55.5s 367.5s
(0:30) (0:17) (0:17) (3:26) (0:55) (6:07)
Standard 18.4s 24s 220.2 85.4 23.9s 224.2s
Deviation (18) (0:24) (1:40) (1:25) (0:s23) (3:44)
7
Summary
Table
of
Performance
Results
Across
All
Tasks
250
200
150
Median
time
(in
seconds)
Mean
Time
(in
seconds)
100
S.D.
(in
seconds)
50
0
Task
1
Task
2
Task
3
Task
4
Performance
Results
The
time-‐based
statistics
indicate
that
there
is
a
correlation
between
their
overall
test
time
and
participants’
familiarity
with
Spotify
or
other
online
music
services.
Time
efficiency
was
measured
by
recording
how
long
it
took
each
participant
to
complete
each
of
the
four
tasks:
logging
into
Spotify,
creating
and
naming
a
playlist,
adding
songs
to
the
playlist,
and
sharing
the
playlist
to
a
Facebook
friend
(Appendix
2).
The
three
users
who
said
they
used
other
online
music
services,
such
as
iTunes,
and
were
somewhat
familiar
or
very
familiar
with
Spotify
posted
the
fastest
total
test
times
(319
seconds
(5:19);
299
seconds
(4:59);
78
seconds
(1:18)).
On
the
contrary,
the
user
who
said
she
only
listened
to
online
radio
stations
and
was
not
at
all
familiar
with
Spotify
posted
the
slowest
total
test
time
of
960
seconds
(16:57).
8
The
majority
of
the
test
participants
(9
out
of
11)
were
able
to
complete
all
four
tasks
correctly
(Appendix
6).
One
person
quit
the
study
after
completing
the
first
task.
This
participant
was
not
able
to
adjust
to
the
interface
and
name
the
playlist
recently
created.
Another
participant
added
five
songs
to
the
playlist,
but
each
song
was
not
from
a
different
artist.
On
average,
each
participant
made
2
errors
(Appendix
7)
and
requested
6.1
hints
or
prompts
while
completing
the
tasks
(Appendix
8).
The
errors
were
categorized
by
each
of
the
four
tasks.
Results
indicated
that
participants
had
more
problems
creating,
naming
and
adding
songs
to
playlists
than
they
did
with
logging
into
Spotify
and
sharing
playlists
to
a
Facebook
friend.
Of
the
22
errors,
16
were
made
when
creating
or
naming
the
playlist
(9)
and
adding
songs
to
the
playlist
(7).
Type
of
Error
Error
with
Error
in
Error
in
Error
in
Total
Logging
In
Creating/
Adding
Songs
Sharing
Number
of
Naming
to
Playlist
Playlist
Errors
Playlist
with
Facebook
Friend(s)
TOTAL
2
9
7
4
22
Figure
1.
Number
of
errors
made
by
category.
Full
results
(Appendix
7)
When
users
create
a
new
playlist,
its
name
is
highlighted.
Many
users
did
not
understand
that
they
needed
to
type
into
the
highlighted
text
field
to
change
the
name
of
the
playlist.
If
a
user
does
not
immediately
name
the
playlist,
then
it
disappears.
One
user
repeatedly
created
a
new
playlist,
which
disappeared
because
she
did
not
understand
how
to
change
its
name.
This
suggests
that
Spotify
needs
to
provide
more
visible
instructions
on
how
to
name
the
playlist.
In
regards
to
adding
songs
to
playlists,
users
either
dragged
songs
to
the
wrong
playlist
or
dragged
each
song
to
“New
Playlist”,
therefore,
creating
a
separate
playlist
for
each
song.
9
Users
asked
investigators
for
hints
or
searched
the
Spotify
interface
for
prompts
when
they
encountered
obstacles.
The
participants
needed
70
hints
or
prompts,
which
were
divided
into
three
categories.
The
participants
most
often
asked
the
study
investigators
questions
(50).
However,
one
participant
asked
33
of
those
questions.
Performance
data:
Number
of
hints/prompts
needed
by
category
Type
of
Hint/
Ask
Tester
Read
Spotify
Hover/
Total
no.
of
Prompt
Questions
Instructions
for
Click
Spotify
Hints/
Adding
Songs
to
Buttons
for
More
Prompts
Playlist
Details
TOTAL
50
8
12
70
Figure
2.
Number
of
hints/prompts
needed
by
category.
Full
results
(Appendix
8)
Satisfaction
Results
Results
from
the
post-‐test
questionnaire
were
used
to
analyze
the
participants
overall
opinion
and
attitudes
towards
the
Spotify
application
(See
Appendices
10,
11,
12).
The
satisfaction
results
indicated
that
participants
found
Spotify
useful
to
share
music.
The
average
rating
for
Spotify’s
usefulness
was
3.82,
which
marks
a
good
experience,
on
the
1-‐5
Likert
scale.
The
results
also
revealed
a
slight
contradiction
in
user
opinion.
Despite
marking
a
high
rating
for
their
overall
experience
using
Spotify,
the
participants
gave
a
neutral
rating
for
their
likeliness
to
use
the
application
again.
The
average
rating
for
overall
experience
using
Spotify
was
3.82.
When
asked
“How
likely
are
you
to
use
Spotify
after
this
study?”,
participants
averaged
a
rating
of
2.73.
10
Results
of
Post-‐Survey:
App
Satisfaction
5
4.5
4
3.5
Ease
of
Navigation
3
Familiarity
with
App
2.5
Overall
Experience
with
App
2
Likeliness
to
Use
App
1.5
1
Usefulness
of
App
0.5
0
Mean
Rating
When
rating
the
specific
tasks,
the
participants
found
one
task
the
most
difficult
–
finding
five
songs.
On
the
Likert
scale,
the
participant’s
average
rating
was
3.36.
The
three
other
tasks
were
given
the
identical
rating
of
3.64.
This
indicated
that
creating
and
naming
a
playlist,
adding
five
songs
to
populate
the
playlist
and
sharing
that
playlist
are
relatively
easy
tasks.
In
general,
users
must
search
for
songs
–
the
difficult
task
–
before
they
can
complete
the
subsequent
tasks
they
deemed
easier.
11
Results
of
Post-‐Survey:
Ease
of
Tasks
5
4.5
4
3.5
3
Ease
of
Task
1
2.5
Ease
of
Task
2
2
Ease
of
Task
3
1.5
Ease
of
Task
4
1
0.5
0
Mean
Rating
SUGGESTIONS
FOR
DESIGN
From
the
test
results,
it
was
determined
that
Spotify
should
improve
its
design
by
providing
more
feedback
and
more
clear
instructions
for
playlist
creation.
Many
participants
wanted
a
better
feedback
system
from
Spotify
when
adding
songs
to
the
playlist
and
sharing
the
playlist
to
a
Facebook
friend.
For
example,
after
participants
added
songs
by
either
dragging
it
to
or
right
clicking
and
selecting
“Add
to”,
they
had
to
click
inside
their
playlist
to
see
if
the
action
occurred.
Also,
study
participants
wanted
to
receive
a
notification
when
they
successfully
sent
the
playlist
to
their
Facebook
friend.
This
study
suggests
that
Spotify
implement
a
system
that
clearly
notifies
users
when
they’ve
accomplished
those
tasks.
For
example,
users
should
hear
a
sound,
see
an
animation
or
see
a
pop-‐up
message.
When
users
create
a
new
playlist,
its
name
is
highlighted.
Many
users
did
not
understand
that
they
needed
to
type
into
the
highlighted
text
field
to
change
the
12
name
of
the
playlist.
If
a
user
does
not
immediately
name
the
playlist,
then
it
disappears.
One
user
repeatedly
created
a
new
playlist,
which
disappeared
because
she
did
not
understand
how
to
change
its
name.
This
suggests
that
Spotify
needs
to
provide
more
visible
instructions
on
how
to
name
the
playlist.
TEST
IMPROVEMENTS
The
investigators
could
clarify
one
item
in
the
task
list.
The
task
read:
“Please
add five songs from different artists to the playlist.”
The
investigators
intended
for
participants
to
find
one
song
each
from
five
different
artists.
A
few
participants,
however,
inferred
that
they
needed
to
find
five
songs
from
more
than
one
artist,
not
necessarily
from
five
different
artists.
Of
the
10
participants
that
completed
that
task,
nine
of
them
completed
it
correctly
and
as
the
investigators
intended.
To
eliminate
confusion,
the
task
could
be
rewritten
as
follows:
“Please
add
one
song
each
from
five
different
artists
to
the
playlist
for
a
total
of
five
songs.”
Also,
the
test
methods
did
not
control
for
the
users’
desktop
preferences.
All
of
the
tests
were
conducted
on
MacBook
Pros,
with
which
some
of
the
users
have
little
to
no
experience.
Some
of
the
users’
times
for
completing
tasks
could
have
been
affected
by
their
unfamiliarity
with
Macs.
Future
studies
could
be
conducted
in
an
environment
in
which
users
can
pick
their
most
preferred
computer,
for
example
a
Mac
or
a
PC
desktop.
The
investigators
could
have
used
the
Survey
Monkey
tool
more
effectively
to
gather
the
users’
opinions.
Some
of
the
pre-‐
and
post-‐test
questionnaires
included
13
questions
that
required
people
to
answer
even
if
they
could
not
pick
an
answer
that
was
applicable
to
them.
This
issue,
however,
did
not
affect
the
performance
data.
CONCLUSION
The
objectives
of
this
study
were
to
test
the
ease
and
efficiency
of
organizing
content
into
a
playlist
and
sharing
a
playlist
with
Facebook
friends.
The
overall
goal
was
to
see
how
successful
Spotify’s
social
network
sharing
function
is
based
on
the
aforementioned
tasks.
Participants
directly
interacted
with
the
application
navigation,
search
bar,
“New
Playlist”
function
and
“Send
to
Friend”
function.
Results
indicated
that
participants
had
more
problems
creating,
naming
and
adding
songs
to
playlists
than
they
did
with
logging
into
Spotify
and
sharing
playlists
to
a
Facebook
friend.
Despite
marking
a
high
rating
for
their
overall
experience
using
Spotify,
the
participants
gave
a
neutral
rating
for
their
likeliness
to
use
the
application
again.
Overall,
users
said
Spotify
was
useful
for
sharing
music
via
social
networking
services.
14
APPENDIX 1
Pre-Test Questionnaire
1.
Please
write
your
first
name
for
the
investigators'
use
only.
Your
answers
will
remain
anonymous.
2.
Do
you
listen
to
music
on
your
computer?
o Yes
o No
3.
What
tools
do
you
use
to
listen
to
music
on
your
computer?
SELECT
ALL
THAT
APPLY.
o iTunes
o Last.fm
o MySpace
o Pandora
o Rhapsody
o Songza
o Spotify
o YouTube
o Other:
_______
4.
Which
tool
do
you
use
the
most?
SELECT
ONLY
ONE.
o iTunes
o Last.fm
o MySpace
o Pandora
o Rhapsody
o Songza
o Spotify
o YouTube
o Other:
_______
5.
How
many
hours
a
day
on
average
do
you
listen
to
music
on
your
computer?
6.
Do
you
use
social
networking
services?
o Yes
o No
7.
Which
social
networking
services
do
you
use?
SELECT
ALL
THAT
APPLY.
o Facebook
o Google
Plus
o LinkedIn
o MySpace
o Pinterest
o Tumblr
15
o Twitter
o Other:
_______
8.
How
many
hours
a
day
on
average
do
you
spend
on
social
networking
services?
APPENDIX 2
Task List
Thank
you
for
participating
in
our
study.
Please
follow
these
instructions
carefully.
1. Please
take
the
pre-‐survey
questionnaire
on
Survey
Monkey.
2. Sign
in
to
Spotify
using
the
Facebook
account
of
“Aloni
Ambuck”
using
the
following
email/username
and
password:
1. Email/Username:
com560test@gmail.com
2. Password:
com560test
3. If
you
are
a
new
user,
take
a
minute
to
familiarize
yourself
with
the
interface.
4. Please
create
a
playlist
and
name
it
anything
you
would
like.
5. Please
add
five
songs
from
different
artists
to
the
playlist.
6. Please
share
the
playlist
on
Facebook
to
any
of
Aloni’s
friends,
such
as
Alexandra,
Alan,
Dioni
or
Jake,
and
write
a
message
of
your
choosing.
7. Please
take
the
post-‐survey
questionnaire
on
Survey
Monkey
about
your
experience
using
Spotify.
Thank
you
for
your
time
and
participation!
16
APPENDIX 3
Post-Test Questionnaire
1.
Please
write
your
first
name
for
the
investigators'
use
only.
Your
answers
will
remain
anonymous.
2.
I
found
it
easy
to
create
and
name
the
playlist.
1
2
3
4
5
Strongly
¢ ¢ ¢ ¢ ¢ Strongly
Disagree
Agree
3.
I
found
it
easy
to
find
five
songs.
1
2
3
4
5
Strongly
¢ ¢ ¢ ¢ ¢ Strongly
Disagree
Agree
4.
I
found
it
easy
to
add
those
fives
songs
to
the
playlist.
1
2
3
4
5
Strongly
¢ ¢ ¢ ¢ ¢ Strongly
Disagree
Agree
5.
I
found
it
easy
to
share
the
playlist
to
a
Facebook
friend.
1
2
3
4
5
Strongly
¢ ¢ ¢ ¢ ¢ Strongly
Disagree
Agree
6.
I
was
able
to
successfully
complete
all
the
tasks.
1
2
3
4
5
Strongly
¢ ¢ ¢ ¢ ¢ Strongly
Disagree
Agree
7.
I
found
the
application
easy
to
navigate.
1
2
3
4
5
Strongly
¢ ¢ ¢ ¢ ¢ Strongly
Disagree
Agree
8.
How
familiar
were
you
with
the
Spotify's
interface
before
participating
in
this
study?
1
2
3
4
5
Not
at
all
¢ ¢ ¢ ¢ ¢ Very
Familiar
Familiar
17
9.
How
many
hours
per
day
on
average
do
you
use
Spotify
to
play
music?
(Write
"N/A"
if
this
is
not
applicable
to
you.)
1
2
3
4
5
Not
at
all
¢ ¢ ¢ ¢ ¢ Very
familiar
Familiar
10.
Do
you
pay
for
Spotify
Premium?
o Yes
o No
o I
did,
but
I
do
not
any
longer.
o I
don’t,
but
I
intend
to
in
the
near
futures.
11.
Do
you
share
your
Spotify
playlists
via
social
networking
services?
o Yes
o No
Why
or
why
not?
12.
If
yes,
with
which
social
networking
services
do
you
share
your
playlists?
SELECT
ALL
THAT
APPLY.
o Facebook
o Twitter
o Tumblr
o Spotify
friend
o Make
playlist
public
within
Spotify
o Other:
______
13.
What
percentage
of
your
playlists
do
you
estimate
that
you
share
via
social
networking
services?
(Ex.
1
out
of
5
or
20%)
14.
Rate
your
overall
experience
using
Spotify
during
this
study.
1
2
3
4
5
Very
poor
¢ ¢ ¢ ¢ ¢ Very
good
experience
experience
15.
Why
did
you
rate
your
experience
this
way?
16.
How
likely
are
you
to
use
Spotify
after
this
study?
1
2
3
4
5
Not
very
¢ ¢ ¢ ¢ ¢ Very
likely
Likely
17.
Spotify
is
a
useful
way
to
share
music.
18
1
2
3
4
5
Strongly
¢ ¢ ¢ ¢ ¢ Strongly
Disagree
Agree
18.
Describe
anything
that
was
difficult
to
understand
or
use
in
the
application.
19.
What
is
your
age?
20.
Are
you
a
student?
o Yes
o No
21.
If
yes,
what
year?
______
What's
your
field
of
study?
_________
22.
Are
you
employed?
o Yes
o No
23.
If
yes,
what's
your
occupation?
19
APPENDIX 4
Performance data: Full times of task completion per participants (in seconds)
Log In Familiarize Create & Add Share Total
With Name Five Playlist to Test
Interface Playlist Songs Facebook Time
To Playlist Friend
User 1 23s 16s 4s 208s 68s 319s
(0:23) (0:16) (0:04) (3:28) (1:08) (5:19)
User 2 33s 26s 41s 269s 59s 428s
(0:33) (0:26) (0:41) (4:29) (0:59) (7:08)
User 3 31s 9s 16s 220s 107s 383s
(0:31) (0:09) (0:16) (3:40) (1:47) (6:23)
User 4 45s 48s 23s 353s 46s 515s
(0:45) (0:48) (0:23) (5:53) (0:46) (8:35)
User 5* 75s 80s 2:86s*
(1:15) (1:20) (4:46)
User 6 65s 24s 66s 202s 52s 354s
(1:05) (0:24) (1:06) (3:22) (0:52) (5:54)
User 7 30s 8s 17s 205s 45s 299s
(0:30) (0:08) (0:17) (3:25) (0:45) (4:59)
User 8 21s 17s 18s 184s 102s 355
(0:21) (0:17) (0:18) (3:04) (1:42) (5:55)
User 9 24s 12s 10s 225s 47s 380s
(0:24) (0:12) (0:10) (3:45) (0:47) (6:20)
User 10 19s 0s 5s 16s 38s 78s
(0:19) (0:00) (0:05) (0:16) (0:38) (1:18)
User 11 28s 52s 716s 151s 70s 960s
(0:28) (0:52) (11:56) (2:31) (1:10) (16:57)
Mean 35.8s 26.5s 91.6s 203.3s 63.4s 407.1s
Time (0:35) (0:26) (1:31) (3:23) (1:03) (6:47)
* Did not complete usability test.
20
APPENDIX 5
Summary Table of Performance Results Across All Tasks
Log In Familiarize Create & Add Share Total
With Name Five Playlist to Test
Interface Playlist Songs Facebook Time
To Friend
Playlist
No. of 11 11 10 10 10 10
Participants
Who
Completed
Task
Shortest 19s 0s 4s 16s 38s 78s
Time (0:19) (0:00) (0:04) (0:16) (0:38) (1:18)
Longest 75s 80s 716s 353s 107s 960s
Time (1:15) (1:20) (11:56) (5:53) (1:47) (16:57)
Mean 35.8s 26.5s 91.6s 203.3s 63.4s 407.1s
Time (0:35) (0:26) (1:31) (3:23) (1:03) (6:47)
Median 30s 17s 17.5 206.5 55.5s 367.5s
Time (0:30) (0:17) (0:17) (3:26) (0:55) (6:07)
Standard 18.4s 24s 220.2 85.4 23.9s 224.2s
Deviation (18) (0:24) (1:40) (1:25) (0:s23) (3:44)
APPENDIX 6
Performance data: Number of errors, number of hints and task completion rate
Number of Number of Hints Number of % of Tasks
Errors & Prompts Tasks Completed (Out
Participants Completed (Out of 100%)
Need of 4)
User 1 1 2 4/4 100%
User 2 1 7 4/4 100%
User 3 4 10 4/4 100%
User 4 1 4 4/4 100%
User 5* 2 5 1/4 25%
User 6 2 1 4/4 100%
User 7 1 1 4/4 100%
User 8 0 0 4/4 100%
User 9 0 0 4/4 100%
User 10 1 1 4/4 100%
User 11 9 36 3/4 75%
Average 2.0 6.1APPENDIX 7
Performance data: Number of errors made by category
Type of Error Error with Error in Error in Error in Total
Logging In Creating/ Adding Songs Sharing Number of
Naming to Playlist Playlist Errors
Playlist with
Facebook
Friend(s)
User 1 1 1
User 2 1 1
User 3 3 1 4
User 4 1 1
User 5* 1 1 2
User 6 1 1 2
User 7 1 1
User 8 0
User 9 0
User 10 1 1
User 11 7 1 1 9
TOTAL 2 9 7 4 22
* Did not complete usability test.
APPENDIX 8
Performance data: Number of hints/prompts needed by category
Type of Hint/ Ask Tester Read Spotify Hover/ Total no. of
Prompt Questions Instructions for Click Spotify Hints/
Adding Songs to Buttons for More Prompts
Playlist Details
User 1 1 1 2
User 2 2 1 4 7
User 3 3 7 10
User 4 3 1 4
User 5* 5 5
User 6 1 2 3
User 7 1 1 2
User 8 0
User 9 0
User 10 1 1
User 11 33 3 36
TOTAL 50 8 12 70
* Did not complete usability test.
22
APPENDIX 9
Full Results of Pre-Survey
Do you What Which How Do you Which How many
listen to tools do service many use social social hours a
music on you use do you hours a networkin networkin day on
your to listen use the day on g sites? g sites do average
computer to music most? average you use? do you
? on your Select do you Select all spend on
computer only listen to that apply. social
? Select one. music on networkin
all that your g sites?
apply. computer
?
U1 Yes iTunes, iTunes 1 Yes Facebook, 1
Pandora, Google
Other: Plus,
and I go to Tumblr,
radio Twitter
websites
and
stream
directly
U2 Yes iTunes, iTunes, 2 Yes Facebook, 2
Last.fm, Rdio Google
MySpace, Plus,
Pandora, LinkedIn,
YouTube, MySpace,
Other: Pinterest,
Rdio is my Tumblr,
preferred Twitter,
method Rdio
U3 Yes iTunes, iTunes 0-1 Yes Facebook, 0-1
Pandora LinkedIn,
Twitter
U4 Yes YouTube YouTub 1 Yes Facebook, 3
e Twitter
U5 No N/A N/A 0 No N/A 0
*
U6 Yes iTunes, Pandora 1 Yes Facebook 5
Pandora LinkedIn
Pinterest
Twitter
U7 Yes iTunes Pandora 3 Yes Facebook 4
Pandora Tumblr
YouTube Twitter
U8 Yes iTunes iTunesYouTube LinkedIn
U10 Yes iTunes iTunes 2 Yes Facebook 1
Last.fm
Spotify
YouTube
U11 Yes Other: Other:APPENDIX 11
Results of Post-Survey: Part 2
How many Do you pay Do you If yes, via which What percentage
hours per for Spotify share your social of your playlists
day on Premium? Spotify networking do you estimate
average do playlists via sites do you that you share
you use social media share your via social
Spotify to networking playlists? networking
play music? sites? Select all that services?
apply.
U1 0 (N/A) No No. N/A 0 (N/A)
U2 0 No No. I don’t N/A. Don’t have 0
have Spotify. Spotify.
U3 0 No No N/A 0
U4 0 No No N/A 0
U5* 0 No No N/A. Don’t use 0
Spotify at all.
U6 0 No No None 0
I prefer to
use Pandora
or YouTube
U7 0 No No N/A 0
U8 0 No No. I don’t Facebook 0
use Spotify
U9 0 No No N/A Don’tuse 0
Spotify
U10 2 Yes No, “Let Make playlist Most (over 50%)
those public within of my playlists are
suckers find Spotify public on Spotify,
their own but none of them
music.” are shared
through any other
social network.
U11 N/A No N/A N/A N/A
* Did not complete usability test.
25
APPENDIX 12
Results of Post-Survey: Part 3
Why did Describe What Are If yes, If yes, Are you If yes
you rate anything is you a what what employe what’s
your that was your student year? field of d? your
experien difficult age? ? study? occupation
ce this to ?
way? understa
nd or use
in this
applicatio
n.
U1 It has a Where to 37 No N/A N/A Yes I’m your
poor find professor.
user songs
interface. online to
add to
playlist.
U2 I enjoy It should 36 No. N/A N/A Yes Instructor
the idea have
and the been
service easier to
but it figure out
isn't the how to
most add
user songs. I
friendly was
looking
for a
giant
button
"add
song"
U3 Seems Took me 43 No. N/A N/A Yes Professor
like a a minute
good app to figure
for out how
listening to share
to and my
sharing playlist.
music
with
others. I
have it
on my
computer
; just
haven't
used it!
26
U4 It was Finding 18 Yes. Fresh Biolog Yes Stocker
neither the music man y
difficult
nor easy
U5* i don't All of it. 50 No. N/A N/A Yes Retail
know
what i
am
doing.
U6 A little no 23 Yes Gradu no n/a n/a
difficult answer ate
figuring
out how
to initially
add
music to
the
playlist
U7 It was It was 16 Yes 11th no n/a n/a
simple easy to Grade
and easy understa
to nd
understa because
nd it is
similar to
iTunes
which I
use
frequentl
y
U8 This was Nothing 30 No N/A N/A Yes Software
my first really. Sales
time
using
Spotify. It
took me
a second
to find
out
where to
search
for the
songs,
but once
I was
familiar
with it, it
was very
27
easy to
use.
U9 I enjoy had 38 No N/A N/A Yes Videograp
music trouble her
and think sharing,
it's an but that
easy way was
to share because
music to it wasn't
my under my
friends Faceboo
k user
name
U10 I like Nothing 36 No N/A N/A Yes Retail
spotify. was Manager
difficult.
U11 Had Locating 61 No N/A N/A No N/A
difficulty where to
getting name a
started new
with playlist
creating a
new
playlist
* Did not complete usability test.
28
You can also read
