Combining music and visual art: A workshop with the Apollo Youth Panel at the Irish Museum of Modern Art (IMMA)

Following Polifonia’s successful Dom Tower excursion (ORGANS pilot) and Haptic Device workshops (ACCESS pilot), Polifonia again invited music lovers to come and explore music in relation to (art) history. Paul Mulholland (leader WP5) invited the Apollo Youth Panel to try out the Deep Viewpoints app with an exhibition at the Irish Museum of Modern Art.

7 April 2023

Following Polifonia’s successful Dom Tower excursion (ORGANS pilot) and Haptic Device workshops (ACCESS pilot), Polifonia again invited music lovers to come and explore music in relation to (art) history. Paul Mulholland (leader WP5) invited the Apollo Youth Panel to try out the Deep Viewpoints app with an exhibition at the Irish Museum of Modern Art.

What might a painting sound like? What might a piece of music look like? Does listening to music while looking at an artwork change what you see and what you hear?

These were some of the questions explored in a workshop at the Irish Museum of Modern Art (IMMA) with the Apollo Youth Panel from the National Gallery of Ireland. 

The workshop started with a visit to the Kevin Mooney exhibition which, through a series of paintings, imagines the missing visual culture of Ireland lost to history due to poverty, famine and mass migration. The panel investigated how listening to different pieces of music while looking at the same painting drew your attention to different aspects of the painting and made associations to different features of the music such as its tempo, mood and genre.

The panel then used a museum app, called Deep Viewpoints, to explore a set of scripts developed by musicologist Naomi Barker uncovering different connections between works in the IMMA collection and pieces of music from the classical to the contemporary. Deep Viewpoints, originally developed in the H2020 SPICE project to support slow looking at visual art, has since evolved to support looking and listening across visual art and music.

Finally, the panel used Deep Viewpoints to create their own scripts spanning the musical and the visual, proposing their own soundtrack to the Kevin Mooney exhibition.

The workshop sparked many interesting conversations and showed how music and visual art can work together to enhance what you see and what you hear.

The workshop shed light on two research questions of relevance to the interfaces being developed in WP5. First, the workshop revealed ways in which visual representations can help music listeners to understand and describe what they hear, for example, by selecting an image that matches the mood of the song, or using an image to help you focus on the tempo of the music. Second, the workshop demonstrated new ways in which people can socially support each other in understanding music, for example, by making and sharing new associations between pieces of music and other artforms, or creating educational activities that guide the listening experience. 
Paul Mulholland said “Polifonia is developing large knowledge graphs that make connections across European music. In the workshop we learned more about how interfaces can be used to support the music listening experience and build a social layer to the knowledge graph in which people can develop and share their own interpretations of music.”

About WP5 Human Interaction with Musical Heritage
The aim of WP5, led by Paul Mulholland (OU), is to research and develop highly interactive inter-operable user interface tools to allow scholars, musicians and other consumers of musical content and knowledge to access, engage with, explore and reuse the resources.

Image Credits: Installation view Kevin Mooney, Revenants, IMMA, Dublin. Photo: Ros Kavanagh.

Recent News

Polifonia is known for its strong links with academia and is pleased to present some highlights in its involvement in research and associated conferences.

Polifonia is known for its strong links with academia and is pleased to present some highlights in its…

29 February 2024

In 2024, Paul Mulholland, Naomi Barker and Paul Warren (The Open University, U.K) are continuing their experiment investigating how different kinds of music influence the appreciation of an artwork; and to what extent the same kind of sense-making processes are used when viewing artwork and when listening to music. To do this, the researchers are looking for more participants. They have now automated the process so that participants can complete the experiment online without the involvement of an experimenter.

Music instrument with music notes on white background illustration In 2024, Paul Mulholland, Naomi…

17 January 2024

During the last project meeting, the Polifonia consortium extensively discussed how to foster the impact of the project in academia and beyond. How to make the output of Polifonia sustainable after the lifetime of the project is one important aspect. But fostering re-usability does not end by long-term preservation of certain assets (such as data and tools). In Polifonia Research Ecosystem – Impact of a project. A webinar on Data re-use and workflows, we will discuss how we ensure that more fluid assets such as interfaces, but also experiences in setting up and executing workflows via those interfaces, become reproducible and reuseable.

During the last project meeting, the Polifonia consortium extensively discussed how to foster the impact…

15 January 2024

For the Polifonia project, the Central Institute for Cataloging and Documentation (ICCD) of the Italian Ministry of Culture is carrying out activities on the historical bell heritage. The ICCD has also initiated a process of documentation of the practices and knowledge associated with bell production through collaboration with historical Italian foundries.

The bell casting process performed by the Pontifical Marinelli Foundry. Photo courtesy of ICC For…

9 January 2024

One of the tools Polifonia will release is MELODY. It stands for ‘Make mE a Linked Open Data StorY’ and is a place where you can make sense of Linked Open Data and publish text-based as well as visual data stories. Earlier this year, students of the University of Bologna explored data through this tool. Let’s see what they have found and learned about… rock music.

One of the tools Polifonia will release is MELODY. It stands for 'Make mE a Linked Open Data StorY'…

13 December 2023

Music libraries currently lack well-founded information retrieval tools. While it is relatively easy to find music based on metadata, content-based music retrieval still remains as a challenge. The Polifonia FACETS pilot aims to tackle this challenge by building a faceted search engine (FSE) for large collections of music documents.

Music libraries currently lack well-founded information retrieval tools. While it is relatively easy…

24 November 2023

This is a week of major importance to the Polifonia team, as its researchers join both the conference of the International Society for Music Information Retrieval (ISMIR) and the conference for the International Semantic Web and Linked Data Community (ISWC): venues of significant importance for both research and industry. Read more about Polifonia’s contributions below.

This is a week of major importance to the Polifonia team, as its researchers join the conference of…

7 November 2023

On Oct, 13 an explorative workshop took place in a school in Milton Keynes (UK) as part of the Polifonia project. The “Music Meets Machines workshop” gave a look into cutting-edge technologies used to represent music history.

On Oct, 13 an explorative workshop took place in a school in Milton Keynes (UK) as part of the Polifonia…

3 November 2023

Between 16 and 20 October, the Polifonia consortium met in the Italian city of Bologna, home of the project coordinator University of Bologna (UNIBO). During an intensive week, the project team took steps in the development of the pilots, including the long-awaited web portal. Read more about the 7th project meeting here.

Between 16 and 20 October, the Polifonia consortium met in the Italian city of Bologna, home of the…

27 October 2023

The sensory journey “Data Wanderings” is a new project of Polifonia. The art installation will open on Friday, Oct. 13, in Bologna, Italy and you can visit it until the 28th of the month.

The sensory journey "Data Wanderings" is a new project of Polifonia. The art installation will open…

12 October 2023

This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement N. 101004746