This article presents a human-machine design approach to the artistic and metaphorical representation of the traditional weaving scenes featured on Yunjin brocade as interactive moiré patterns accompanied by Nanjing Baiju performance. After extracting the basic elements of the eye-shaped moiré patterns, the authors systematically recomposed them to mimic the weaving process. They then wrote an algorithm to generate moiré patterns that respond dynamically to the unique sounds weavers make while weaving, symbolizing the gazes and eye contacts among the weavers. This became an interactive sonic installation, Sweating Weaving Room , which represents the rhythmic machine sounds, the Nanjing Baiju, and the hard labor and harmonious work hidden behind the glamorous brocade.