Skip to Main Content
Frequently Asked Questions
Submit an ETD
Global Search Box
Need Help?
Keyword Search
Participating Institutions
Advanced Search
School Logo
Files
File List
case1096385607.pdf (771.96 KB)
ETD Abstract Container
Abstract Header
Profile Analysis Techniques for Observation-Based Software Testing
Author Info
Leon Cesin, David Zaen
Permalink:
http://rave.ohiolink.edu/etdc/view?acc_num=case1096385607
Abstract Details
Year and Degree
2005, Doctor of Philosophy, Case Western Reserve University, Computing and Information Science.
Abstract
Observation-based testing is a software-testing paradigm based on the idea of observing the behavior of the program when executed under a variety of test cases. The runtime behavior of a program can be summarized in profiles, which can then be analyzed for a variety of purposes useful for the tester. This dissertation presents techniques for test suite visualization, test case selection and test case prioritization based on profile data and includes extensive experiments on large, real-world applications to compare these techniques with ones from the literature. Test suite visualization is the application of multivariate visualization techniques to profile data in order to visually study the composition of the test suite and its interaction with the program. Two techniques are examined for this purpose, Correspondence Analysis and Multidimensional Scaling, and a novel algorithm for the latter is presented and studied. Example applications of test suite visualization are provided. Test case selection is the problem of selecting a small set of tests from a large test suite such that the most defects are revealed when this subset is executed. Test case prioritization is the problem of finding an optimal scheduling of the tests in a test suite so that the number of defects found earlier during testing is maximized. Other researchers have tried to address these problems using profile information, by looking at the amount of code executed by a subset of tests. Dickinson proposed some methods for test-case selection that consider the distribution of the profiles in the profile space by using cluster analysis on the profiles. This work was later extended in conjunction with the author. These methods will be presented in this work, together with novel methods for test case prioritization. Experimental validations and comparisons of all of these methods will be presented, including comparison criteria that were missing from earlier work. The results suggest that profile analysis is a useful tool for software testers, and that studying the distribution of tests in a profile space can be more beneficial than concentrating on code coverage.
Committee
H. Podgurski (Advisor)
Pages
130 p.
Subject Headings
Computer Science
Keywords
Software Engineering
;
Software Testing
;
Cluster Analysis
;
Observation-based testing
Recommended Citations
Refworks
EndNote
RIS
Mendeley
Citations
Leon Cesin, D. Z. (2005).
Profile Analysis Techniques for Observation-Based Software Testing
[Doctoral dissertation, Case Western Reserve University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=case1096385607
APA Style (7th edition)
Leon Cesin, David.
Profile Analysis Techniques for Observation-Based Software Testing.
2005. Case Western Reserve University, Doctoral dissertation.
OhioLINK Electronic Theses and Dissertations Center
, http://rave.ohiolink.edu/etdc/view?acc_num=case1096385607.
MLA Style (8th edition)
Leon Cesin, David. "Profile Analysis Techniques for Observation-Based Software Testing." Doctoral dissertation, Case Western Reserve University, 2005. http://rave.ohiolink.edu/etdc/view?acc_num=case1096385607
Chicago Manual of Style (17th edition)
Abstract Footer
Document number:
case1096385607
Download Count:
1,026
Copyright Info
© 2004, all rights reserved.
This open access ETD is published by Case Western Reserve University School of Graduate Studies and OhioLINK.