Role: lead interaction designer and coding
Seeinteracting Sound Pictures is the result of the encounter of four eclectic personalities from scientific research to musical composition field, united by the passion for sound experimentation.
The project arises from the desire to connect two seemingly distant but sometimes indispensable worlds: sound and image. Thanks to the technology used in the installation, the visitor is invited to interact and use their senses to blend the two elements. The works exhibited at the museum constitute the expedient through which interaction with virtual orchestration occurs: each of the 6 paintings displayed becomes the sound source from which Johann Sebastian Bach’s “The Musical Offering” originates. . This work is attributable to the full maturity of the German composer, chosen here as a pretext is among the most speculative and mathematical in the history of music for the sophisticated counterproductive techniques used.
To accompany this musical plot, a sound effect directly evoked by the representation of each frame will be generated at the same time as the observer’s presence.
So the chromatic material of the brushstroke of Corrado Spaziani or the lyrical figure of Otello Fabri, to mention only two of the artists in the hall, are emphasized and involved in this refined play of recalls and references between the figurative image and the sound .
But the form and the musical sense of this virtual orchestration can only be shaped by the presence and movements of the spectator as a consequence of its variation within the physical space. As suggested by the neologism that identifies the installation, “looks interacting with sound shapes”, a sinesthetic path is proposed that invests the spectator in person, releasing him from the role of a purely passive participant of aesthetic exponence to elevate him to an active subject of artistic creation.
In this extremely dynamic acoustic space an additional element intervenes: the anthropomorphic sculptures placed on the short side of the hall repeatedly pronounce some of the sentences inspirers of this FAST edition.
The acoustic word thus generated will be simultaneously displayed as an oscillogram (waveform) within a virtual reconstruction of the acoustic field, proposing an alphabet of signs describing the sound itself, in a process of transduction from its natural pressure to the visual one. It is in this continual modulation of the space of our perceptions that the contamination between what we see and hear suggests and suggests an uninterrupted flow of the image that inspires the sound … and of the sound that comes back to being visual.
Festival Internazionale della Creazione Contemporanea, FAST 2011 – Terni
Music: Maurizio Massarelli
Interactive Design: Marco Bertola
Engineering: Marco Bertola, Gianluca Susi, Emiliano Daddario
Artistic Advice: Barbara Reggio