Conformiq

Modeling Reactive Systems: Language Needs

Lars Frantzen writes: In several commercial and academic projects we have struggled with the problem of the lack of a proper language to model reactive systems. Such models should be used to specify and test (in a model-based fashion) reactive systems. Currently, either no real language at all was used (like XML), or some old fashioned, hard to ...

Software Processes Accommodating MBT

People ask often from us if model-based testing with Conformiq Designer can be a good fit for e.g. Agile, Test-Driven Development, Scrum or RUP. Now instead of providing a short answer ("yes"), I will try to explain in this post how model-based testing changes a software process, where that change occurs, and what is its impact. I will also give ...

How Computers Design Tests Differently from Humans

One complaint against computer-generated test cases is that they differ from those designed by humans. Somehow, computer-generated test cases have a different feel to them, and it is sometimes difficult for humans to grasp what is the crux or focal point of a test case produced by a model-based test generator, such as Conformiq Designer™. But why ...

MBT Users Report Triple Benefit & 59% Bug Reduction

According to the recent model-based testing user survey (see here), the respondents saw on the average a 59% reduction in escaped bugs, 17% reduction in testing costs, and 25% reduction in testing time. What do these figures mean? Let's say that a (software) product has 100 defects (that can manifest themselves) when it enters the testing phase, ...

Top 3 Problems with Model-Based Testing

According to the recent model-based testing users survey, the top three problems MBT users face are in this order (see p. 26 of the report): Modeling is too hard Models blow up (the tool in use does not scale to complex models) Generated tests miss bugs These are all real problems and we have certainly seen customers face them (after all, the ...

MBTUC 2011: Model-Based Testing Survey

The results of a (small) survey of model-based testing users has been released and is available here. According to the results, 73% of users were "very likely" or "extremely likely" to continue using model-based testing in their organization, More analysis to follow later.

Conformiq CTO Presents Automated AUTOSAR Testing

Dr. Stephan Schulz, Conformiq's CTO, will give a presentation on "Automating AUTOSAR Functional Test Design with Model-Based Testing" at the SAE 2012 World Congress, to be held in Detroit, USA in April 2012. The SAE 2012 World Congress theme, Get Connected, is said to represent the new and diverse connections that will drive significant ...

ETSI TTCN-3 & MBT Workshop 2012 Announced

11th edition of ETSI T3UC-2012: ETSI TTCN-3 User Conference and Model-Based Testing Workshop will be hosted in Bangalore, India on June 11-14, 2012. See the official website. The conference is co-organized by Sasken, ISQT International, and the European Telecommunications Standards Institute (ETSI). Topics include industrially deployed MBT ...

Understanding Pairwise Test Generation

Combinatorial test data generators generate data tables for testing. The most basic, commonly used combinatorial data generation strategy is what is known as pairwise testing, all-pairs testing, covering arrays or Taguchi designs. (The term orthogonal array is sometimes used also, but it actually refers to a method for designing statistical ...

Using Conformiq Designer with Test Execution Platforms

We are often asked if we execute test cases and how, so here some comments regarding that. Conformiq Designer generates tests but does not execute them. In order to automatically execute tests generated by Conformiq Designer, you need to get them out of Conformiq Designer in a format that an external test execution platform can interpret. You ...

Automatic Test Data Generation by Constraint Solving

Conformiq Designer generates test data automatically from system models using something known as "constraint solving". In this blog post I want to explain how this works. It is actually an FAQ: "where does the test data come from?" Many first-time users are actually confused by the fact that there is no manual test data entry, so I hope I can ...