The author presents a novel compositional framework to guide designing interplay between moving listeners and sound objects in space. Demonstrated by a case study of interactive octophonic installation, the presented framework offers new ways to articulate and analyze artistic interplay using real-world location context as a spatial composition canvas.

ABSTRACT The authors describe an artistic exploration of sound in space enabled by real-time computer vision algorithms that provide hand shape and 3D hand-tracking information.