An experimental assessment of module documentation-based testing.
Context: Testing a module that has memory using the black-box approach has been found to be expensive and relatively ineffective. Instead, testing without knowledge of the specifications (white-box approach) may not be effective in showing whether a program has been properly implemented as stated in...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English English |
| Published: |
Elsevier
2011
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/18476/1/An%20experimental%20assessment%20of%20module%20documentation.pdf http://psasir.upm.edu.my/id/eprint/18476/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| id |
my.upm.eprints.18476 |
|---|---|
| record_format |
eprints |
| spelling |
my.upm.eprints.184762015-08-28T00:49:58Z http://psasir.upm.edu.my/id/eprint/18476/ An experimental assessment of module documentation-based testing. Baharom, Salmi Shukur, Zarina Context: Testing a module that has memory using the black-box approach has been found to be expensive and relatively ineffective. Instead, testing without knowledge of the specifications (white-box approach) may not be effective in showing whether a program has been properly implemented as stated in its specifications. We propose instead a grey-box approach called Module Documentation-based Testing or MD-Test, the heart of which is an automatic generation of the test oracle from the external and internal views of the module. Objective: This paper presents an empirical analysis and comparison of MD-Test against three existing testing tools. Method: The experiment was conducted using a mutation-testing approach, in two phases that assess the capability of MD-Test in general and its capability of evaluating test results in particular. Results: The results of the general assessment indicate that MD-Test is more effective than the other three tools under comparison, where it is able to detect all faults. The second phase of the experiment, which is significant to this study, compares the capabilities of MD-Test and JUnit-black using the test evaluation results. Likewise, an analysis of the test evaluation results shows that MD-Test is more effective and efficient, where MD-Test is able to detect at least the same number of faults as, or is at par with, the black-box approach. Conclusion: It is concluded that test evaluation using grey-box approach is more effective and efficient that the black-box approach when testing a module that has memory. Elsevier 2011 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/18476/1/An%20experimental%20assessment%20of%20module%20documentation.pdf Baharom, Salmi and Shukur, Zarina (2011) An experimental assessment of module documentation-based testing. Information and Software Technology, 53 (7). pp. 747-760. ISSN 0950-5849 10.1016/j.infsof.2011.01.005 English |
| institution |
Universiti Putra Malaysia |
| building |
UPM Library |
| collection |
Institutional Repository |
| continent |
Asia |
| country |
Malaysia |
| content_provider |
Universiti Putra Malaysia |
| content_source |
UPM Institutional Repository |
| url_provider |
http://psasir.upm.edu.my/ |
| language |
English English |
| description |
Context: Testing a module that has memory using the black-box approach has been found to be expensive and relatively ineffective. Instead, testing without knowledge of the specifications (white-box approach) may not be effective in showing whether a program has been properly implemented as stated in its specifications. We propose instead a grey-box approach called Module Documentation-based Testing or MD-Test, the heart of which is an automatic generation of the test oracle from the external and internal views of the module. Objective: This paper presents an empirical analysis and comparison of MD-Test against three existing testing tools. Method: The experiment was conducted using a mutation-testing approach, in two phases that assess the capability of MD-Test in general and its capability of evaluating test results in particular. Results: The results of the general assessment indicate that MD-Test is more effective than the other three tools under comparison, where it is able to detect all faults. The second phase of the experiment, which is significant to this study, compares the capabilities of MD-Test and JUnit-black using the test evaluation results. Likewise, an analysis of the test evaluation results shows that MD-Test is more effective and efficient, where MD-Test is able to detect at least the same number of faults as, or is at par with, the black-box approach. Conclusion: It is concluded that test evaluation using grey-box approach is more effective and efficient that the black-box approach when testing a module that has memory. |
| format |
Article |
| author |
Baharom, Salmi Shukur, Zarina |
| spellingShingle |
Baharom, Salmi Shukur, Zarina An experimental assessment of module documentation-based testing. |
| author_facet |
Baharom, Salmi Shukur, Zarina |
| author_sort |
Baharom, Salmi |
| title |
An experimental assessment of module documentation-based testing. |
| title_short |
An experimental assessment of module documentation-based testing. |
| title_full |
An experimental assessment of module documentation-based testing. |
| title_fullStr |
An experimental assessment of module documentation-based testing. |
| title_full_unstemmed |
An experimental assessment of module documentation-based testing. |
| title_sort |
experimental assessment of module documentation-based testing. |
| publisher |
Elsevier |
| publishDate |
2011 |
| url |
http://psasir.upm.edu.my/id/eprint/18476/1/An%20experimental%20assessment%20of%20module%20documentation.pdf http://psasir.upm.edu.my/id/eprint/18476/ |
| _version_ |
1643826813599744000 |
| score |
13.211869 |