Two Controlled Experiments Assessing the Usefulness of Design Pattern Information in Program Maintenance

Abstract

. A major hypothesis underlying design pattern research is that use of design patterns improves programmer productivity and software quality. This paper reports on a first experimental test of this hypothesis. Subjects performed maintenance tasks on two programs ranging from 360 to 560 LOC including comments. Both programs contained design patterns. The controlled variable was whether the design patterns were documented or not. The experiments thus tested whether additional (but redundant) pattern documentation (PD) helps during maintenance if patterns are present. The experiment was initially performed with 74 graduate students at the University of Karlsruhe, Germany, with programs written in Java. The experiment was repeated with 22 undergraduate students at Washington University in St. Louis, USA, with the programs rewritten in C++. A conservative analysis of the results supports the hypothesis that pattern-relevant maintenance tasks are completed faster or with fewer errors if redu...