Comparative Study of Usability Evaluation Methods on a Hyper Casual Game

Abstract

There are many usability evaluation criteria proposed in the past, and each has different limitations. To find the best usability evaluation method for a hyper-casual game, we present a comparative study on three usability evaluation methods; Concurrent Thinking Aloud (TA), Retrospective Think Aloud (RTA), and Interviewing. We test each method with 30 students by comparing the number of problems detected, experimenting time, and analysis time. We found that RTA found 80% of usability problems by experimenting with 14 participants. TA needed about 24 participants to find the number of problems. However, even if we experiment the interviewing method with 30 students, we find only 64.70% of problems. Although the interviewing is not useful in finding the maximum number of usability problems, we find that it takes the minimum time to operate. RTA required the longest experimenting time, and TA required the longest analysis time.