The authors describe a gesturally controlled improvisation system for an experimental pianist, developed over several laboratory sessions and used during a performance at the 2011 conference on New Interfaces for Musical Expression (NIME). They discuss the architecture and performative advantages and limitations of the system, and reflect on the lessons learned throughout its development.