Conducting tests and recording results
It is best to plan the details of complex tests ahead of time and to lay out written procedures for conducting tests that involve multiple participants. The following sections present a few recommendations for achieving success when testing complex systems.
Identify the data to be collected
Once the structure of a test has been articulated, the tester must determine what information must be gathered during and after the test to answer any questions that may arise during analysis of the test results. This information will naturally include data from the system itself that represents its behavior, including information displayed to the user or recorded as part of normal system operation.
With our focus on embedded systems, it is likely that additional information will need to be collected to evaluate the results of some test scenarios. This data may be gathered using a wide variety of techniques. Some examples of data collection tools and...