Why developers don’t use TDD
Although the total number of acronyms in the programing industry has probably already exceeded the number of stars observable on the moonless night sky, only a subset has gained popularity and recognition. TDD definitely belongs to this group. Judging by numerous conference lectures, books, podcasts, and blog posts, the fact that Test Driven Development is a widely known technique is rather undeniable. Yet, when you consider its adoption and actual usage the reality might look a bit different. In this article we will take a look at the different reasons for avoiding TDD that have been presented by candidates during several conducted technical interviews and try to disprove if they are real obstacles.
1. “Management doesn’t allow us”
The question that can be asked here is why management decides whether TDD should be used by developers. Does a doctor ask a hospital director if he’s allowed to use medical gloves? Of course not, because he uses them for his own protection. He also doesn’t consult each drug he prescribes to his patients. As a specialist, he is allowed to make own decisions in the area of his accountability.
By the same token developers can look at their toolset and techniques. Your goal is to effectively deliver software and as a professional, it’s your responsibility to find out how to achieve that. Nothing prevents you from making a dry run on a small feature in order to assess whether the technique works for you or is it more like a ball and chain.
Nontechnical managers can’t actually grasp what TDD is all about. Many of them associate the word Test with Quality Analysis and since in many organizations there are dedicated QA people for that job, they don’t understand why developers should duplicate their efforts. There is no point in trying to explain what the difference is. After adding a new feature, you probably don’t explain to your manager which data structures have been chosen to fulfill the task, because it isn’t the level of details they are interested in. TDD belongs to the same level.
2. “Not enough time to write tests”
The second excuse (which applies to all kinds of automated testing, not only TDD) is very similar to the first one, but it deserves a separate look because the reason might not be the same. While managers very often try to set tight deadlines, developers are responsible for evaluating their exaggerate optimism and disagree when appropriate. You are the best to assess the amount of work needed to complete a task. Make sure that your estimates include writing automated tests.
The issue here is that developers like to impress others with their effectiveness and sometimes accept more assignments than can actually be completed in the estimated time. If eventually a task takes more than initially expected, instead admitting underestimation they very often resign from writing tests in order to meet “promised” delivery time. If you don’t postpone writing a set of tests for a feature to the end, but write them together with production code as TDD suggests, you will never have a chance to resign from testing.
3. “My team disagrees whether we should use TDD”
When working on a software project there are decisions which affect each team member (like picking a framework or package organization) and should be agreed by everyone or imposed by a team leader. But is TDD one of those decisions? Is it possible that only a few team members work with TDD?
In one of Uncle Bob’s articles we can read that it’s rather impossible. If a part of such team values TDD and other relies on integration tests, the end result will always be the same – separation. Eventually, developers will seek for teams which share their values – if needed in a different company.
Fortunately, there is also a positive variant for disagreement which wasn’t mentioned by Uncle Bob. Some teams split between those who value automated tests and those who don’t write any kind of tests. In such scenario TDD can be successfully introduced by some team members without starting a conflict. There is a chance that by giving an example more teammates will get interested in TDD in the course of time.
4. “Return On Investment in TDD isn’t proved”
Many people ask for the scientific proof for the effectiveness of TDD and they absolutely have right for it. After all, they are going to spend their own time on the technique so evaluation of the investment seems reasonable. The statement about the lack of evidence isn’t, however, correct as there are several trustworthy sources which can be presented to TDD skeptics.
The first one is a paper from North Carolina State University created by Boby George and Laurie Williams in 2003. TDD opponents often demonize the technique as extremely time-consuming, but this document demonstrates that the studied group of TDD practitioners spent only 16% more time on the overall development process.
Another experiment documented in 2008 by Nachiappan Nagappan et al., which was conducted on three Microsoft and one IBM development teams shown a significant decrease (between 40% and 90%) in total number of pre-release bugs in comparison with similar projects.
You can find much more studies on the web, but we can’t forget it’s impossible to generalize as each software project is different, some domains are hard to compare, and hence the exact numbers won’t be the same in various cases. The real takeaway from such papers is the observable fact that TDD is beneficial for software quality, but you should decide if required time investment is the price worth paying in your particular case. When a brand can suffer because of bugs in software it’s better to find them as early as possible. But for back-office tools, fixing issues found by users is probably more acceptable. Test Driven Development isn’t a silver bullet.
5. “We tried but it didn’t work”
Bad learning experience can effectively discourage software developers from using any technique. Such effect can be observed when TDD is applied to legacy code which wasn’t designed with testability and modularity in mind. God objects which commonly occur in older systems are sworn enemies of unit tests. Legacy code isn’t the best place for the evaluation of TDD.
The problem also happens when TDD is applied to code which doesn’t need unit tests. Purists can say that you should aim for 100% code coverage, but in the real life, such goal is a waste of time. Every application consists of some kind of business logic and rather brainless glue code. While TDD is great for the first group, for the second it’s like using a sledgehammer to crack a nut. Such code usually coordinates sequence of operations and may have many dependencies which require a lot of mocks in order to test. Long list of mocks and indirect result assertions can also lead to bad impression of TDD which in this case is simply a misuse of the technique.
6. “Slow build process”
One possible reason for slow tests is the complexity of their setup. If units selected for testing are too big, preparation of the starting state may take a significant amount of time. Slow running tests can be treated as a red flag which indicates that you should look more carefully into the application’s design and assess coupling between elements which are under tests. The longest running tests can be easily found and addressed separately.
It’s also worth to mention that there is no reason to run all application tests as part of the Red Green Refactor process. In a properly designed project structure, there shouldn’t be a problem to select only these tests which are dedicated for currently changed part of the code base.
Another cause for slow running tests is their total number. As already mentioned, some parts of every application simply don’t need tests. Code coverage metrics boosting is simply lying to oneself that software quality is improved. Automated tests should focus on code that changes a lot, business logic, calculations, etc. Learn to assess in which cases they aren’t needed.
7. “I don’t know all requirements upfront to write all tests”
This is an example of misunderstanding the concept of the technique. TDD isn’t about creating all possible test scenarios for a given code unit before writing production code, but rather about discovering test cases together with implemented the requirements. The whole beauty of TDD is that the gradual addition of new logic can be done with confidence because the regression of the requirements covered previously is guided by tests. TDD is an iterative process in which production code and tests are created alternately.
Naturally, there’s nothing wrong in speeding up the cycle by writing a few tests in a row. In his book Test-Driven Development: By example, Kent Beck admits that as long as you understand the problem you try to tackle, you don’t have to strictly stick to the Red Green Refactor cycle. Just remember you can always slow down while working on more complex challenges if you feel the need.
Handful of tips for TDD adepts
Bad impression of TDD can be severely minimized by learning from others’ mistakes. If you’re at the beginning of your journey with TDD below you can find a few general hints which should simplify the learning process.
- Let’s start with a truism: All beginnings are hard. Expect initial increase in time spent on developing new features. Learning a new thing, whether it’s a framework, a musical instrument, or an unfamiliar technique takes time. In order to improve, you need to overcome the temptation to return to old habits.
- Focus on writing tests before production requirement implementation. It will force you to think about code modularity and impact the way you design classes and their relationships.
- Legacy code isn’t the most pleasant playground for TDD. New feature shouldn’t cause any problem, but adding tests to the existing monolith code base can quickly cool down your aspirations for the technique as it’s definitely more challenging.
- The aim of 100% code coverage is a myth and the reason why TDD disbelievers describe it as a waste of time. Concentrate on the most crucial part of your software where the business logic resides.
- There is plenty of material available on the Web, but if you look for recommendation, you should check out Test-Driven Development: By Example written by Kent Beck, who is leading TDD advocate.
- Improve your unit testing skills. Frameworks come and go, but investing your time in learning how to write proper automated tests will be long useful.
- Opinionated side mark: Making changes in code which isn’t covered by tests is stressful. TDD is good for your health ��
What would you add?
The test-first approach has been around almost 20 years now and yet doubts about its productivity are still pretty common. Hopefully presented examples will let persuade some of those who hesitate with TDD adoption. If you observed any other excuse that isn’t covered by the post or have a tip for beginners, the comment section is waiting for you. Maybe you experienced harmful effects of the technique and the story is worth sharing? Your knowledge can help to avoid problems by other developers. Feel invited to the discussion.
Published on Java Code Geeks with permission by Daniel Olszewski, partner at our JCG program. See the original article here: Why developers don’t use TDD Opinions expressed by Java Code Geeks contributors are their own. |
Changing requirements is another reason big one. Management or the customer can change a requirement in such a way the the tests fail. Change it often enough, or be ambiguous with the requirements, and making tests, for TDD or otherwise, slowly becomes less feasible.
That is true. If such situation happens too often, people don’t see the point in writing tests and get discouraged. On the other hand, sometimes tests,just like production code, have to be thrown away when a feature changes.
“100% code coverage is a myth” … what do you mean to convey here? Code coverage is not required at all or choose the target based on the need? For example, we may need code coverage in areas where we have challenges in terms of complexity, inexperienced engineers, and possibly it could be a measure of “all the code written is for the identified test cases only and most of them are passing” – more of a measure to confirm that the team is progressing well on TDD implementation. May be, when the TDD is implemented and practiced (matured) as… Read more »
I miss the reason “TDD advocates often do not know how to present their ideas to other programmers and managers”; for example, at the last code retreat I attended, there were various exercises like “if you have not produced code within 2 minutes of writing the test, throw both code and test away” and “create the simplest test possible” – so first a test (“product(2,3) should be 6”), then make code (product(int a, int b) { return 6; }), then write another test… Not everyone was enchanted by this approach or believed that it would make programmers more productive, and… Read more »