The Art of Evolution: Effective Agile Transformations

Testers will invariably find bugs and feed those into the current sprint or into a future sprint. This unplanned work delays the project as items need to be fixed and re-tested. This often results in negative progression, with stakeholders blaming Agile.

So what is the solution? Automate. Automate it all! Well, at least that should be the goal. Easier said than done you say?With the help of mature tools, release automation should be relatively straightforward for most applications. You take what is in the heads of your dev and ops teams and script it. They do it repeatedly, so it is probably a well-documented process, or at least it should be. Teams should be able to take this knowledge and move it into one of the many tools on the market today; Jenkins, TeamCity, Travis Ci - or one of my favourites, GoCd, an open-source project, sponsored by ThoughtWorks. Manual intervention should be avoided at all stages of the release process.

The next more complicated element is test automation. Testing typically comes in two flavours; functional and non-functional. Functional testing is a type of software testing whereby the system is tested against the functional requirements/specifications. Non-functional testing is defined as a type of testing implemented to check non-functional aspects (performance, usability, reliability, etc). In my experience, non-functional test coverage is easier to achieve than functional. Many providers and tools can help with non-functional testing without knowing a huge amount about your domain. These types of test are still important but can usually be outsourced.

However, the harder tests are your unit tests and your business logic tests, sometimes referred to as system tests. Unit tests test an individual software component or module and are typically done by a programmer and not a tester. Development managers like to have a suite of unit tests that cover a percentage of the number of lines of code in a system. A metric greater than 80 percent of lines covered is indicative of a development team that puts testing at the forefront of their development lifecycle. In saying that, unit tests are very difficult to create retrospectively. If you have a large system with little or no unit test coverage, then it is going to a take a large commitment from the business to get you to a reasonable level of coverage in a reasonable timeframe. Unit tests make your system more robust by massively reducing runtime bugs and decreasing the chances of your new features unexpectedly breaking other parts of the application. This makes sense to developers, but quite often, the business case to increase unit test coverage is difficult to justify, especially to non-tech stakeholders.

Another more palatable option is to automate your system tests. Typically, this can be done by automating the interactions a tester/customer would take in your user interface (UI). System testers start by gathering all the business logic requirements for your system. Most of the time they can talk to testers and subject matter/domain experts in the business, which helps, keep the development teams free from interruptions. Once the requirements are collected, system testers can apply a ‘Combinatorial Testing’ technique called ‘Pairwise Testing’ to assess all the potential functional permutations in order to reduce the number of required tests without sacrificing useful coverage. It is usually impractical and time-consuming to test all possible combinations for all those requirements. So instead, a subset of combinations is generated to satisfy all factors. How is this done? There are a few systems on the market today, but an industry leader is System Testing software Tosca, developed by Tricentis. They can automate this analysis for you to find optimal test combinations. More recently, they have been using AI to improve this analysis. Tosca will take your requirements and map them to UI interactions, which can run repeatedly in your CI/CD pipeline. Tosca can also help with service virtualization, which is a method to help you emulate your service dependencies, but I’ll leave that for another article.

In my opinion, automating your system tests via UI automation can have one of the best ROI’s for your business. Almost without fail, quality goes up and predictability increases. It also goes a long way in helping you be successful in your Agile transformation journey.