Timed Testing under Partial Observability

Alexandre David, Kim Guldstrand Larsen, Shuhao Li, Brian Nielsen

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

18 Citations (Scopus)
378 Downloads (Pure)

Abstract

To steer model-based conformance testing of real-time systems towards certain test purposes or test coverage, many testing methods need (to be enhanced with) the assumption of full observability of the System Under Test (SUT), which means that the tester can observe precisely what state or configuration the SUT is in, or can uniquely infer one such state or configuration by observing an externally observable timed input/output action sequence on the tester/SUT interface. However, in practice this is often not the case due to e.g. the internal component interactions inside the SUT, or the limited precision sensors that we use to measure the SUT. This paper studies the problem of testing timed systems that are only partially observable. We model the SUT using Timed Game Automata (TGA) which has internal actions, uncontrollable outputs and timing uncertainty of outputs. We define the partial observability of SUT using a set of predicates over the TGA state space, and specify the test purposes in Computation Tree Logic (CTL) formulas. A recently developed partially observable timed game solver is used to generate winning strategies, which are used as test cases. We propose a conformance testing framework, define a partial observation-based conformance relation, present the test execution algorithms, and prove the soundness and completeness of this test method (i.e., a detected error is really an error, and if the SUT violates the test purpose, then a test case can be generated to detect this violation). Experiments on some non-trivial examples show that this method yields encouraging results.
Original languageEnglish
Title of host publicationProceedings of 2009 International Conference on Software Testing Verification and Validation
Number of pages10
PublisherIEEE Computer Society Press
Publication date2009
Pages61-70
ISBN (Print)978-0-7695-3601-9
ISBN (Electronic)978-0-7695-3601-9
Publication statusPublished - 2009
Event2nd IEEE International Conference on Software Testing, Verification, and Validation (ICST'09) - Denver, Colorado, United States
Duration: 1 Apr 20094 Apr 2009
Conference number: 2

Conference

Conference2nd IEEE International Conference on Software Testing, Verification, and Validation (ICST'09)
Number2
CountryUnited States
CityDenver, Colorado
Period01/04/200904/04/2009

    Fingerprint

Keywords

  • real-time systems, conformaance testing, timed game automata, test purpose, winning strategy, test case

Cite this

David, A., Larsen, K. G., Li, S., & Nielsen, B. (2009). Timed Testing under Partial Observability. In Proceedings of 2009 International Conference on Software Testing Verification and Validation (pp. 61-70). IEEE Computer Society Press.