On the Cultural-Psychological Analysis of Human-App Interaction

Mental Health Subject Norms in Visual Presentation and Practical Appropriation

Abstract

Smartphone apps are a central arena of our digital everyday lives. Today, apps that explicitly address mental health, feelings and well-being are widespread. This means that decidedly psychological topics are being negotiated in the medium of apps. But how can the interaction between humans and apps be understood in a cultural-psychology frame – and how can it be empirically investigated from such perspective? To analyze how meaning is conveyed resp. constituted in this medium, we first examine the distinct media levels of apps: They function as image media with graphical user interfaces or touchscreens. They contain images (graphics, photos, icons, etc.) as well as visual symbol systems (text and numbers). They are also interactive, responsive programs that require input from users and generate feedback output. Our analysis of the mood tracking app Daylio, which we focus on subject norms, demonstrates how these modalities are intertwined. A separate empirical approach is required to determine whether and how these media-based meaning systems gain relevance in the hands of real users. To this end, we analyze two user interviews. The results indicate that to effectively reconstitute the practical interaction between people and apps as an interactive and meaningful process requires considering both sides. This provides a framework for comprehending the relationship towards oneself and the world, as conveyed by media.