ModelBasedTesting.pptVIP

Model Based Testing Property Checking for Real Overview Overview Testing Testing: to check the quality of an objectby performing experimentsin a controlled wayw.r.t. a specification Paradox of Software Testing Testing is: important much practiced 30% - 50% of project effort expensive time critical not constructive(but sadistic?) But also: ad-hoc, manual, error-prone hardly theory / research no attention in curricula not cool :“if you’re a bad programmer you might be a tester” Types of Testing Testing Overview Testing Formal MethodsA Perfect Couple ? Formal Testing Why testing with a formal specification: improves the testing process precise and unambiguous basis for testing allows automatic generation of tests Development Process Specification BasedFunctional Testingwith Formal Methods Overview Formal Testing Formal Testing : Conformance Formal Testing : Test Hypothesis Formal Testing : Conformance Completeness Testing for Conformance Formal Testing Approaches to Formal TestingInstantiations of Formal Framework Programs as functions (pre/post-conditions) Finite State Machine / methods with state Labelled Transition Systems Abstract Data Type testing Overview Simple Input/Output Programs Specification: s ? X ? Y Test hypothesis: implementation i :: X ? Y Tests: T ? X Passing a test t ? T : ( t, i(t) ) ? s Tools: QuickCheck, G?ST Problem/challenge: select good subset T ? X:classical techniques: equivalence partitioning, boundary analysis, …… Input/Output Program: Example Specification:propSqrt(x,y) = x ? 0 ? |y ? y - x| ? 0.00001 Possible test set: T = { 0, 0.00232, 1, 1.87392, 2738894 } Tools like QuickCheck, G?ST easily generate thousandsof test cases But still: what is a good set ? Overview Formal Testing with Transition Systems Labelled Transition Systems Labelled Transition System ? S, L, T, s0 ? Implementation Relation ioco Implementation Relation ioco Implementation Relation ioco Test Gene