Page 104 - AC-2-4

Arts & Communication

ARTICLE
Communicating the dialog between painting

and music with a mobile application

1
1,2
Maria Vayanou * , Angeliki Chrysanthi 3 , Eirini Pirpasou
Angeliki Antoniou 4 , and Akrivi Katifori 2
1 Content Management in Culture P.C., Athens, Greece
2 Department of Informatics and Telecommunications, Faculty of Science, National and Kapodistrian
University of Athens, Athens, Greece
3 Department of Cultural Technology and Communication, School of Social Sciences, University of
the Aegean, Mytilene, Greece
4 Department of Archival, Library and Information Studies, School of Administrative, Economics and
Social Sciences, University of West Attica, Egaleo, Greece

Abstract
Contemporary visual artists often collaborate with musicians and composers to
enrich their artworks and provide multisensory viewing experiences by leveraging
the power of digital technology. In this paper, we present our approach to follow
in their footsteps by creating a mobile application that provides “mixed-media
interpretations” for a variety of visual artworks and music pieces, spanning over
different time eras, with the objective to reflect the creative dialog and multifaceted
interaction between their creators through time. Targeting the broader public, we
attempt to capture a variety of interconnections between works of visual arts and
*Corresponding author: music that may be of interest and are comprehensible to people with varying levels
Maria Vayanou
(vayanou@di.uoa.gr) of knowledge on art or music, including not only inspirational but also personal and
social relationships among the artists. We provide a six-layered conceptual model
Citation: Vayanou M, Chrysanthi A, to ease the description of the content produced to that end while reporting several
Pirpasou E, Antoniou A, Katifori A.
Communicating the dialogue concrete examples. Then, we focus on how to communicate and digitally mediate the
between painting and music intertwined and often intricate interconnections in a concise way, proposing a “three-
with a mobile application. Arts & act” story scheme to progressively display short narratives on screen, combined with
Communication. 2024;2(4):2367.
doi: 10.36922/ac.2367 music reproduction on the mobile device. Finally, we explore the potential of the
proposed approach through a user study with 15 participants and report a series of
Received: December 4, 2023
promising key findings, whereas also discussing future directions and pointing out
Accepted: February 19, 2024 open issues.
Published Online: October 22, 2024
Copyright: © 2024 Author(s). Keywords: Art; Music; Cultural experience; Mobile devices; Digital technologies
This is an Open-Access article
distributed under the terms
of the Creative Commons
AttributionNoncommercial License,
permitting all non-commercial use, 1. Introduction
distribution, and reproduction in any
medium, provided the original work The relationship between visual arts and music has been widely explored by artists,
is properly cited. composers, and scholars, and several comparative theories and related typologies have
1,2
Publisher’s Note: AccScience been developed. These theories are typically leveraged within the artistic circles for a
Publishing remains neutral with variety of purposes. For instance, musicians who are non-experts in visual arts may use
regard to jurisdictional claims in
published maps and institutional them as guides to understand an artwork, or even attempt to translate it into music, and
affiliations.*Corresponding author: vice versa for the artists. 1

Volume 2 Issue 4 (2024) 1 doi: 10.36922/ac.2367