Take the 2-minute tour ×
Game Development Stack Exchange is a question and answer site for professional and independent game developers. It's 100% free, no registration required.

I have been reading about BDD - Behavior Driven Development for a while, and I find it really easy and usefull to convert features into code. BDD users often call it TDD done right.

BDD is a tool for software design, from outside to inside, from the bussiness value (or gameplay value) to code.

Dan North introducing BDD

Do you know any resources about BDD and Games other than this?

share|improve this question
    
It looks just like an adaption of TDD, and as such that link is pretty much a duplicate. –  The Communist Duck Jun 16 '11 at 9:39
    
As BDD is a well organized process to do TDD, i'd like to know if someone use it, and what's the experience. –  MarcoTmp Jun 16 '11 at 22:02
    
Doesn't that question answer your questions? –  The Communist Duck Jun 17 '11 at 10:22
    
Not really, because I still don't know how others use BDD in games. –  MarcoTmp Jun 17 '11 at 11:58
    
I still feel it is basically TDD performed in a different style. –  The Communist Duck Jun 17 '11 at 12:24
add comment

3 Answers

It's probably safe to say that BDD, like TDD, or (insert trendy development buzzword-paradigm here) is used by some game developers somewhere, but they probably don't know they are nor would they neccessarily be able to identify what BDD actually means. The question is really how much they use it and how much do they have to use it for it to matter to you?

For example, where I work, all our unit test names are "sentences" like Dan North suggests in that article you linked. That alone isn't sufficient to say that we use BDD, of course, but maybe it's what you really care about?

The focus, in my opinion, should not be on which buzzword you apply at a studio, but rather which productivity and development process techniques you employ overall. I find that the most productive teams are mixing and matching techniques from a variety of "buzzword-paradigms" rather than committing, dogmatically, to every bit of rigid doctrine some internet study says comprises one particular buzzword-paradigm.

I see this most often with the Agile trend: teams that identify themselves as "doing Agile" tend to be more inflexible (ironically) about the process than teams that are organically incorporating the bits of Agile that make sense for them. The former teams almost always end up being less productive, in my experience.

A development team is made up of humans, who are not interchangeable cogs in a machine. They operate uniquely as individuals and as the unique combination of themselves. The way to effective development is not to bend your humans into the {BDD, Agile, WhateverIsNext} mold but to be constantly re-assessing how the team is progressing and shoring up deficiences in the process, replacing broken techqniues, and reinforcing things that are working. In short, to focus on shipping a title and not on "being Agile (or whatever)."

share|improve this answer
    
I should note of course that all I have is anecdotal evidence here w.r.t to my comments about the link between emphatically adhering to process dogma and productivity. It's just my experience and not scientific study. –  Josh Petrie Jul 26 '11 at 15:32
    
-1. Thanks for your opinion. Care to answer the question? –  Jess Telford Nov 7 '12 at 9:29
    
+1, nice answer. @JoshPetrie Do use use at least sometimes TDD or do you measure tests coverage? Just interesting the state of developer testing in game dev. –  Ilya Ivanov Jan 8 '13 at 16:32
add comment

Is it? Maybe. My opinion would be that it would make for a very poor fit for entertainment software generally, although it might work well for the low level libraries.

EDIT: Here's some justification for my opinion.

Wikipedia defines BDD as a technique that "encourages collaboration between developers, QA and non-technical or business participants in a software project." This already sounds like a bad idea because games differ from most software in that they are not designed as tools to meet a specific need for a 'non-technical or business participant', but are cohesive works broadly designed to entertain. There is an emphasis on "desired software behaviour" but games rarely have 'desired software behaviour' except at the technical level. There is definitely merit in checking that part of the code, but not with the end user, because they will never see it.

But let's assume that you want to throw out that human stakeholder stuff and just use BDD to enforce contracts between different code modules, which as far as I can see doesn't differ much from normal test-driven development, which I also consider poorly-suited to games, for the following reason.

Tests are useful for checking that discrete events happened when expected. This works well in event-driven programming, ie. most of the software world, where an action is performed, some output is generated, and then you just verify that the action and the result match up. However, game software is typically a simulation, where an action does not have a discrete result but a continuous change in the world state. If my hidden player makes a noise, I might want to check that the AI hunts me down. So, I can create a test to make sure that the AI is in 'hunting' state after a noise is created, and that's great. But how do I know the hunting even works? You can't check that instantly - you can only observe it over the passage of time. You can hack in various tests to test certain aspects but this is not well-suited to a typical testing approach.

Additionally, a test-first approach can create a false sense of security, and lead people to believe code is better than it really is.

def check_dice_roll_in_range():
    d = new Dice()
    assert(d.roll() between 1 and 6)

class Dice:
    def roll():
        return 4

Since a test result can give a false positive, you can never escape the basic need to check the code itself. But if the code itself is checked adequately, the test takes on secondary importance. This is why, in my opinion, tests are best used after the event, to test bug fixes.

I wouldn't argue that there's never any benefit in testing that, when objects X and Y work together, the result you get is as expected. The issue is whether you are using the most effective way of verifying this. Methods could include formal verification, a code review, test-first methods, test-last methods, traditional QA black-box testing, or simply using the code as expected and observing the results. The last two options are surprisingly effective most of the time, because despite sounding like they lack rigour, most bugs are found during the course of typical use, and understanding a bug in its natural context can sometimes be easier than understanding it in an artificial test harness. On top of this, formal testing and verification often fails to find problems because (by definition) you can only test for the scenarios you expect - and it's not the expected scenarios that are typically the cause of poor software quality.

So, in summary, I think that test driven development is not necessarily a great choice for software, that tests alone are never sufficient to ensure software quality (and thus the time spent writing them must be compared against alternative uses of that developer time), that games are an especially poor match for automated test cases, and that games are an especially poor match for development methods that look to emphasis 'business value' and 'acceptance testing'.

(Hopefully that is a better answer, even if you don't agree with my points.)

share|improve this answer
    
-1 from me as well; if anything, BDD is an even better fit for games than it is for other things. It's even more natural to specify the behavior of a character in response to input than it is to specify the behavior of a web-service in response to a given XML message. –  BlueRaja - Danny Pflughoeft Jul 26 '11 at 18:53
    
Entertainment software is still software, isn't it? –  prusswan Jul 26 '11 at 19:15
    
A good variety of opinions from experts is highly valuable, IMHO. Each person has a rep badge on their answers, so readers can devise how heavily to weigh the opinion when taken in conjunction with the rest posted for a particular question. –  Nate Jul 26 '11 at 21:24
    
Looking back, I think that downvotes for the lack of content in my answer are deserved, so that's fine. :) I do believe it is an awful paradigm for game software development, and I'll now edit this to clarify my stance a little. –  Kylotan Jul 26 '11 at 23:55
1  
As for testing: if that is how you are writing tests, then you're doing it completely wrong. Ex. to test Dice, you would pass in a mock Random object, and make sure Roll() returns the correct values. You use exactly the same techniques to test simulations (video games) that you do to test normal applications. Unit tests can only test units - so you are correct that "tests alone are never sufficient to ensure software quality" (that is why QA still exists). But that doesn't mean they're less useful for video games. –  BlueRaja - Danny Pflughoeft Jul 27 '11 at 22:26
show 3 more comments

I think BDD is appropriate in every in environment. As others mentioned you are developing software and as a result you should test it. I do like bdd for some of the random semantics mentioned like test names as sentences. I also like grouping certain tests together while still being able to test 1 class.

To combat other messages here I'd like to point out that on a larger project it is MUCH harder to refactor code without tests. If you refactor some code you are flying blind as to whether everything will explode in a blaze of glory or not. The tests help you catch things early. So you write your test, fail, code just enough to pass and continue. When you refactor you should do the same thing, but rather than write you revise the test. In most cases you run the test it will fail, you go change what you think should change and it STILL fails. At which point you realize that some other piece of code relies on this function/method a completely different way. You can then fix your test and the resulting code. Without that sort of code coverage you'd be stumbling around for days trying to find where stuff is broken, bugs are not easy to find or track, and moreover you REALLY can't refactor code and you start fearing your code base.

Go read about "Contracts" in the Pragmatic Progammer's book. Testing helps you achieve code contracts. This code does X and nothing more than X and don't expect it to do anything about Y or try to adapt it to do Z. It ensures code cleanliness and expects everyone to not be a dick and muddy up the code base.

There are more reasons to BDD. The main one for me is that I would do the same amount of testing to validate my assumptions anyways so I might as well formalize it.

On the point of "how" it really depends on your environment. I am writing a java game now and using robolectric. You should always attempt to "expect" something. I've heard that spies/mocks/stubs are not as useful since you need to have equivalent on the other side, but sometimes you have no choice especially with APIs. You can assume that the other side of the API is not terrible though and it is usually your code that sucks.

If for example you are testing movement. Well you expect when "Up" is pressed that the user moves forward by some measurement.

If for example you are testing graphics rendering... well don't test that too much because are you really doing that? A good test framework might handle this part for you. Reflection is not super trivial I'd say for these sorts of things. You may need to check buffers etc etc. I'd simply just check for what you are actually doing. Character is here, now he is there after some action.

You should have plenty of tiny little functions/tests and together they will sum up to something useful.

share|improve this answer
    
Oh lastly, I've noticed plenty of people that just so happen to get the right behavior when coding up games/graphics. Testing kinda prevents that "it just kinda works" effect. It is much harder to KNOW how your equations will affect things than just copy some code and make assumptions. –  Parris Aug 18 '12 at 19:33
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.