This paper presents the creation of an assembly simulation environment with multisensory feedback (auditory and visual), and the evaluation of the effects of auditory and visual feedback on the task performance in the context of assembly simulation in a virtual environment (VE). This VE experimental system platform brings together complex technologies such as constraint-based assembly simulation, optical motion tracking technology, and real time 3D sound generation technology around a virtual reality workbench and a common software platform. A peg-in-a-hole and a Sener electronic box assembly task have been used as the task cases to conduct the human factor experiment, using sixteen participants. Both objective performance data (i.e., task completion time, TCT; and human performance error rate, HPER) and subjective opinions (i.e., questionnaires) on the utilization of auditory and visual feedback in a virtual assembly environment (VAE) have been gathered from the experiment. Results showed that the introduction of auditory and/or visual feedback into VAE did improve the assembly task performance. They also indicated that integrated feedback (auditory plus visual) offered better assembly task performance than either feedback used in isolation. Most participants preferred integrated feedback to either individual feedback (auditory or visual) or no feedback. The participants' comments demonstrated that nonrealistic or inappropriate feedback had a negative effect on the task performance, and easily made them frustrated.

This article details research to develop a distributed collaborative engineering environment (DCEE) system that will allow members of a geographically dispersed multidisciplinary team to collaborate during product development. This article addresses the problems of integrating the information that is generated during product development (product data) with a distributed virtual environment, and the problems of supporting multidisciplinary teams in the development process. The DCEE is an enhanced distributed virtual environment with a rich set of engineering applications and information as it provides an architecture and engineering tools that allow the direct sharing of standard product data among the users with immediate propagation of any changes. Each user has a local environment that can be configured with the tools and data that each specialist requires in the product development lifecycle. An implementation of the architecture has been built to demonstrate this approach, and its performance has also been evaluated.