This survey, compiled from our recent research reports, describes research accomplishments in interactive design and assembly with 3D computer graphics environments, carried out in the AI & Computer Graphics Lab at the University of Bielefeld. As a means of communicating with such environments, agent techniques and dynamic knowledge representations are used to process qualitative verbal instructions to quantitative scene changes. A key idea is to exploit situated 'perceptive' information by inspecting the computer graphics scene models.