{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:56:26Z","timestamp":1750308986347,"version":"3.41.0"},"reference-count":12,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[1991,7,1]],"date-time":"1991-07-01T00:00:00Z","timestamp":678326400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSOFT Softw. Eng. Notes"],"published-print":{"date-parts":[[1991,7]]},"abstract":"<jats:p>Test coverage is an important aspect of a validation suite for implementations of a standard such as the CAIS. This paper presents the development and application of a constrained optimization process for CAIS test coverage. Subjective criteria and goals combined with objective measures of test coverage derived from information models yield a quasi-quantitative figure of merit for test objectives. The approach next identifies resource (time and effort) and process constraints. A greedy algorithm provides a partial solution to the coverage design problem. The decreasing first fit bin packing heuristic then refines the coverage measure of the validation test suite within the process constraints. Finally, the paper presents the results of the application test selection and optimization process to the design of the CIVC-A test suite.<\/jats:p>","DOI":"10.1145\/127099.127126","type":"journal-article","created":{"date-parts":[[2004,7,21]],"date-time":"2004-07-21T23:30:10Z","timestamp":1090452610000},"page":"87-92","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Optimization of validation test suite coverage"],"prefix":"10.1145","volume":"16","author":[{"given":"Timothy E.","family":"Lindquist","sequence":"first","affiliation":[{"name":"Arizona State University, Tempe, AZ"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kurt M.","family":"Gutzmann","sequence":"additional","affiliation":[{"name":"SofTech, Inc., 1300 Hercules, Suite 105, Houston, TX"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David L.","family":"Remkes","sequence":"additional","affiliation":[{"name":"SofTech, Inc., 1300 Hercules, Suite 105, Houston, TX"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gary","family":"McKee","sequence":"additional","affiliation":[{"name":"McKee Consulting, 111 West Fremont Avenue, Littleton, CO"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[1991,7]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"[ANSI1815] American National Standards Institute (ANSI) Ada Language Reference Manual ANSI-STD-1815A 1983.  [ANSI1815] American National Standards Institute (ANSI) Ada Language Reference Manual ANSI-STD-1815A 1983."},{"key":"e_1_2_1_3_1","unstructured":"[DOD1838] DOD-STD-1838 Common APSE Interface Set (CAIS) 9 October 1986.  [DOD1838] DOD-STD-1838 Common APSE Interface Set (CAIS) 9 October 1986."},{"key":"e_1_2_1_4_1","unstructured":"[Gutzmann90] Kurt M. Gutzmmm David Auty Gary Woodcock and Gary Young CIVC Phase I Report CIVC-FINL-021-1 25 September 1990.  [Gutzmann90] Kurt M. Gutzmmm David Auty Gary Woodcock and Gary Young CIVC Phase I Report CIVC-FINL-021-1 25 September 1990."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1137\/0203025"},{"key":"e_1_2_1_6_1","unstructured":"[Lindquist89] Timothy E. Lindquist (chairman) Issues and Strategies for Evaluation and Validation of CAIS-A Implementations Air Force Evaluation and Validation Team Standards Evaluation and Validation Working Group (SEVWG) white paper Version 2.0 December 1989.  [Lindquist89] Timothy E. Lindquist (chairman) Issues and Strategies for Evaluation and Validation of CAIS-A Implementations Air Force Evaluation and Validation Team Standards Evaluation and Validation Working Group (SEVWG) white paper Version 2.0 December 1989."},{"key":"e_1_2_1_7_1","unstructured":"[MIL1838A] MIL-STD-1838A Common APSE Interface Set Revision A (CAIS-A) September 1989.  [MIL1838A] MIL-STD-1838A Common APSE Interface Set Revision A (CAIS-A) September 1989."},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"[Munck88a] Robert Munck Patricia Oberndorf Erhard Ploedereder Richard Thall An Overview of DOD-STD-1838A (proposed) The Common APSE Interface Set Revision A CACM May 1988.  [Munck88a] Robert Munck Patricia Oberndorf Erhard Ploedereder Richard Thall An Overview of DOD-STD-1838A (proposed) The Common APSE Interface Set Revision A CACM May 1988.","DOI":"10.1145\/64135.65025"},{"volume-title":"Proceedings of the Sixth Annual Conference on Ada Technology","year":"1988","author":"Munck Robert","key":"e_1_2_1_9_1"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.6154"},{"key":"e_1_2_1_11_1","unstructured":"[Purdom85] Paul Walton Purdom Jr. Cynthia A. Brown The Analysis of Algorithms Holt Rhinehart and Winston New York 1985.   [Purdom85] Paul Walton Purdom Jr. Cynthia A. Brown The Analysis of Algorithms Holt Rhinehart and Winston New York 1985."},{"key":"e_1_2_1_12_1","unstructured":"[SofTech90] SofTech Inc CIVC-A Implementor's Guide CIVC-PREL- 019-2 31 December 1990.  [SofTech90] SofTech Inc CIVC-A Implementor's Guide CIVC-PREL- 019-2 31 December 1990."},{"volume-title":"CIVC Technical Interchange Meeting","year":"1990","key":"e_1_2_1_13_1"}],"container-title":["ACM SIGSOFT Software Engineering Notes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/127099.127126","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/127099.127126","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:41:11Z","timestamp":1750282871000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/127099.127126"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1991,7]]},"references-count":12,"journal-issue":{"issue":"3","published-print":{"date-parts":[[1991,7]]}},"alternative-id":["10.1145\/127099.127126"],"URL":"https:\/\/doi.org\/10.1145\/127099.127126","relation":{},"ISSN":["0163-5948"],"issn-type":[{"type":"print","value":"0163-5948"}],"subject":[],"published":{"date-parts":[[1991,7]]},"assertion":[{"value":"1991-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}