Comparison of Auditory and Visual Short-Term Memory Capabilities using a Serious Game Application

Abstract

A comprehensive serious game application has been designed and implemented to examine the capacity and effective- ness of short-term auditory and visual memory, otherwise known as working memory in human subjects. Participants engaged in an adaptation of the well-known paired association game that entails turning over cards and recalling their placement within a 2D matrix structure of various resolutions. Each trial introduced either visual icons (vision only condition) or auditory objects (audio-only condition). User performance was evaluated through a detailed statistical analysis focusing only on the highest 6x8 resolution condition in the application. Findings suggest that visual memory did not conclusively outperform auditory memory in the context of this game. However, within the scope of auditory stimuli, familiar iconic sounds, such as excerpts of speech and commonplace sounds, were recalled more effectively than unfamiliar, synthetic sounds like parametric waveforms. Furthermore, performance appeared to be influenced by demographic factors, with male and younger subjects yielding superior results.