Interactive painting sonification using a sensor-equipped runway

In the present study we will show the realization of a multimedia installation for the interactive sonification of a painting of Hartwig Thaler. The sonification is achieved by means of sound synthesis models, capable of reproducing continuous auditory feedback, eventually generated from the feature analysis of three color layers extracted from the painting (red, blue, yellow). Furthermore, a wooden sensors equipped runway, divided in three sections, each of which represent a different layer, will activate the corresponding soundscape according to the visitor position. This system enables to discover a 2D painting in a new 3D approach, moving along the runway toward the projection of the painting. The paper describes in details the developing of all the elements of the system: starting from the analysis of the image and the algorithm to realize the acoustic elements, than the sensorized runway and finally the testing results.