Defect Analysis

Data on defect analysis is a little sketchier. I present below a table of the defect classifications and their average duration for both C++ and Eiffel. Note that this table does include design injections, as they were too difficult to separate for this analysis.

Table 15-1. Average duration of defect types, C++ and Eiffel

Defect TypeAvg Duration - C++Avg Duration - Eiffel
ct0.890.62
ic3.31.63
is1.720.23
iu3.780.16
ma3.421.05
mc0.41.04
md3.273.10
mi0.722.18
sy0.540.44
wa6.856.49
wc3.331.72
wn0.90.78
wt2.690.68

Most of these numbers aren't significant, but a few drew my attention. Note particularly the big split between wt (wrong type) in C++ (2.69 minutes) and Eiffel (0.68 minutes)-- significant, and understandable. The C++ compiler is very lazy about types, allowing easy (and often cryptic) conversion between real and integer values. The Eiffel compiler would have none of that, and quickly identified these problems.

The numbers for iu (interface use, 3.78 vs 0.16) are even more interesting, and I believe strongly reflect the easy-to-use documentation which can be generated from Eiffel classes. While it's true that similar utilities exist for C++, they are 1) not standard, and 2) do not include the contractual information (pre- and post-conditions) which describe the semantics of Eiffel features; this makes for a significant increase in reuse of Eiffel code as compared to C++ code, particularly as the Eiffel community tends to use more useful parameter names than the C++ community. I could use the Eiffel ARRAY and LIST classes "right out of the box" by examining their automatic documentation. Reading the header files for the C++ vector and list classes was both irritating and error-prone.

Several other errors were easier to catch under Eiffel; ma (missing assignment) was generally easy to catch in the expansive stack traces printed out after each Eiffel exception trap (the messages printed by C++ and my contract macros were not nearly as helpful). Wrong calls (wc) were similarly easy to find. And some variants of syntax (sy) from C++, such as the need to maintain parity between header and implementation files, simply went away (as would memory management issues, although they were not a problem with these programs).

On the other hand, Eiffel did take a few hits here, mostly in mc (missing call) and mi (missing implementation), both of which were used by me when I ran into something that I didn't have a standard library class for. The Eiffel standard library is extremely good, but did have a few shortcomings. Overall, however, I found the process of debugging Eiffel code to be significantly more pleasant than that of C++ code, even though (and this is the really interesting part, to me) I had a very nice debugger for C++ and no debugger at all for Eiffel.