Conformiq

MBT Users Report Triple Benefit & 59% Bug Reduction

According to the recent model-based testing user survey (see here), the respondents saw on the average a 59% reduction in escaped bugs, 17% reduction in testing costs, and 25% reduction in testing time. What do these figures mean? Let's say that a (software) product has 100 defects (that can manifest themselves) when it enters the testing ...

Top 3 Problems with Model-Based Testing

According to the recent model-based testing users survey, the top three problems MBT users face are in this order (see p. 26 of the report): Modeling is too hard Models blow up (the tool in use does not scale to complex models) Generated tests miss bugs These are all real problems and we have certainly seen customers face them (after ...

Conformiq CTO Presents Automated AUTOSAR Testing

Dr. Stephan Schulz, Conformiq's CTO, will give a presentation on "Automating AUTOSAR Functional Test Design with Model-Based Testing" at the SAE 2012 World Congress, to be held in Detroit, USA in April 2012. The SAE 2012 World Congress theme, Get Connected, is said to represent the new and diverse connections that will drive significant ...

Understanding Pairwise Test Generation

Combinatorial test data generators generate data tables for testing. The most basic, commonly used combinatorial data generation strategy is what is known as pairwise testing, all-pairs testing, covering arrays or Taguchi designs. (The term orthogonal array is sometimes used also, but it actually refers to a method for designing statistical ...

Using Conformiq Designer with Test Execution Platforms

We are often asked if we execute test cases and how, so here some comments regarding that. Conformiq Designer generates tests but does not execute them. In order to automatically execute tests generated by Conformiq Designer, you need to get them out of Conformiq Designer in a format that an external test execution platform can interpret. You ...

Automatic Test Data Generation by Constraint Solving

Conformiq Designer generates test data automatically from system models using something known as "constraint solving". In this blog post I want to explain how this works. It is actually an FAQ: "where does the test data come from?" Many first-time users are actually confused by the fact that there is no manual test data entry, so I hope I can ...

Why Conformiq Designer Costs ______

Please excuse the blunt title of this post. It is an FAQ why Conformiq Designer costs exactly as much as it does, and here are some answers. (Note that this post is not about the actual price itself, but only about the pricing logic.) (more…)

Conformiq Drops Online Testing Support

When Conformiq Designer 1.0 was released at the beginning of 2007 it had support for both test script generation as well as for online testing. The idea of online testing is simply that a model-based testing tool interacts directly with the system under test, instead of the tool generating a test script that can be executed later and independently ...

Reusing Implementation Models for Test Generation

Some companies implement parts of their products using Model Driven Engineering (MDE). In this approach, implementation code is generated, at least partially, from system models. In those domains where it works, the MDE approach can lead to significant cost savings and quality improvement. It is then natural to ask if the same implementation ...

Tackling Huge System Specs in Model-Based Testing

Conformiq's system model based testing is based on the premise that you can create a (computer-readable) model of the intended behavior of the system under test. But what if the system is really big? This is a question that people often ask from us, and there are typically three concerns: (1) How long will it take to create the model? (2) Can our ...

Skill Profile of a Successful Conformiq User

Automated test design with Conformiq Designer is a new way to create, maintain and manage tests. Using Conformiq successfully requires a different skill profile than manual testing does. The crucial difference to manual testing is that manual testing typically does not require any programming skills. At the same time, creating models is quite near ...