Interactive Art "W♭Y♭KM♭CK"

Usually, illustrations, which are flat image data, and music, which is irreversible waveform data, cannot be connected to the viewer's physical actions or spatial arrangement.

However, this work attempts to connect them and explores new audiovisual experiences (musical experiences).

The illustration, separated into CMYK+W, is printed on acrylic plates and arranged three-dimensionally with intervals. By designing it this way, viewers can walk around the work and view it from various angles, experiencing how the illustration shifts depending on the location.

At this time, the angle at which the viewer faces the illustration is detected by image recognition. Then, a system is constructed in which the constituent sounds of chords that are periodically played in the music gradually shift according to the acquired position information and are output from speakers.

By using the body to experience the synchronization of the shifts in the illustration and the shifts in the music, a "new sense of displacement" that is not possible with ordinary viewing is created, giving presence to the illustration and the music.