Advogato blog for ade

34: Back In Black

Mon, 8 Feb 2010 01:06:42 GMT

New Frontiers: TDD and Refactoring Workshop at Brunel University

Mon, 1 Feb 2010 02:12:47 GMT

At the first Software Craftsmanship Conference in London I met Steve Counsell. He's an academic at Brunel University with an interest in Object Orientation, Metrics and Refactoring.

A while ago Steve invited me to give a short presentation at one of a series of workshops he's running. These 'Reftest' workshops are aimed at bringing academia and industry together to share our insights and experiences with both Test Driven Development and Refactoring.

There were too many interesting presentations at last week's event for me to describe them all. But they should all eventually end up on the Reftest website so you can read them there. That site doesn't have a feed yet so I've set up this: http://www.google.com/notificationservice/webchanges/webfeeds/11897478376600010732 which basically notifies you of any changes to the website.

Anyway, there was a lovely presentation by Charles Tolman from Quantel about some of the issues you run into when you have a 12 year old codebase containing 17 million lines of C++ and Python. This lead into an interesting discussion about detecting duplicate code. I maintain Same but nowadays I find that Eric Raymond's Comparator is a better solution for most people so I recommended that.

One of my favourite asides from Charles's 30 years in software (20 of them spent at Quantel) was "tools should enable the intelligence of the programmer rather than attempt to encapsulate the intelligence of the programmer."

The folks from the University of Kent showed some impressive results for their tools which provide:

model checking
property-based testing
interactive clone elimination

Best of all many of the principles behind them aren't restricted to Erlang. So these kinds of techniques and tools can be applied to mainstream languages. They just chose Erlang because the tools were built as part of the ProTest project they're doing with Ericsson.

My own presentation looked at some of the problems with TDD and Refactoring.

I discussed problems with teaching the cluster of tacit knowledge that we call TDD and covered issues like the convenient fictions we use, the mis-leading tutorials and the overly simplistic examples that involve starting with a blank slate. I also threw in a brief digression about the Norvig-Jeffries kerfuffle.

The section of my presentation on refactoring mostly involved going back to Opdyke's thesis and looking at some of the consequences of his ideas. One thing that struck me was how insightful Opdyke's work was when it came to the issues like preserving class invariants and the subtle side-effects of most refactorings. Somewhere along the line though as we automated refactoring we seem to have lost the heart of his ideas.

I'd expected the last section with it's references to model checking, property-based testing tools like ScalaCheck, mutation testing and fuzz testing to be controversial but the discussion ended up being a very productive look at ways in which we could fix the problems. The whole day made me very hopeful about the prospects for significant progress in the tools and techniques for TDD and refactoring.

Updated 2010/02/06: Ben Stopford has written up his perspective on the workshop and uploaded his PDF slides.

33: Brunel

Sun, 31 Jan 2010 17:13:38 GMT

32: Juxtaposition

Mon, 25 Jan 2010 00:14:56 GMT

31: Flight to nowhere

Tue, 19 Jan 2010 00:08:43 GMT

30: Eventually

Sun, 10 Jan 2010 03:10:26 GMT

29: Elementary

Tue, 5 Jan 2010 01:09:05 GMT

What did I learn in 2009?

Sat, 2 Jan 2010 15:08:22 GMT

I attended both Software Craftsmanship conferences and as a result I now see software craftsmanship as a 'movement' in the same sense as Impressionism. In other words it's a group of very loosely affiliated people who are linked by overlapping values rather than rigid adherence to some set of rules. However its roots in the Agile movement mean its likely to be subject to the same forces that took us from 'lightweight methodologies' for getting useful work done to a marketing brand with a formal alliance overseeing its usage. Large chunks of the Agile community seem to have become more interested in process improvement than in improving their skill or their techniques. Reading parody sites like this: http://www.ambysoft.com/certification/ and finally asking awkward questions about Scrum (it's a very bad sign when no-one will publicly answer a question like "is it possible to fail a Scrum course?") made me realise that 'Agile' has become a meaningless tag that I don't want to be associated with any more.

This was the year I started to really see the limits of my tools and techniques. This includes Java, TDD, the LAMP stack and the conventional approach to logging. As a result I'm doing more work with Python; thinking more in terms of invariants and algorithmic complexity as well as looking at tools like QuickCheck and SparseCheck; playing with App Engine and experimenting with the event sink approach that Nat Pryce and Steve Freeman describe in their book Growing Object Oriented Software.

The aforementioned limits (plus a discussion with Dan Creswell and Manik Surtani) lead me to the Scalability Staircase and I realised that much of my 'experience' was now invalid because I'm not working in an enterprise environment. In fact many of those enterprise software environments have radically changed but the people working in them are only just starting to realise that they'll need different approaches to software development now that they're working at web scale.

I started to appreciate the benefits of feature segmentation/partitioning through flags and dependency injection. Flickr wrote a somewhat controversial article about their approach although many of the critics haven't spotted the connection with bucket testing/multivariate testing.

In 2009 I found that I got better results by modelling people who were effective rather than brilliant. Effective people tended to have generated a lot of artefacts whilst the brilliant tended to agonise over a small set of projects and as such artificially constrained their potential impact. Perfectionism often got in the way of delivering results whilst focussing on getting a little better every day left with me lots of useful artefacts, lots of real-world feedback and more opportunities to take creative risks.

Getting in the habit of making improvements rather than offering criticism leads to lots of work but it also leads to things getting better. As a consequence I'm now spending more time helping out on open source projects. Another consequence was discovering that you're better off focussing on people's artefacts (their code, their data, the things they've made) rather than their opinions. Without that focus it becomes difficult to distinguish between people who have discovered better skills/techniques and those who just have a convincing argument.

One of the side-effects of my new-found appreciation for these 'productive communities' was that I attended more BarCamp-style events. At one of those I ran a session which gathered a group of people who understand the semantic web and Linked Data. Thanks to those people I now understand the appeal of Web Scale Identifiers. Basically the idea is that if your website is about something like books, music, musicians, etc which already has a good identifier (e.g. ISBN, ASIN or MusicBrainz id) then you should re-use that identifier. Inventing your own identifier or exposing your database's primary key or using the simple name leads to a wide range of annoying problems for your users whilst re-using existing identifiers means you get to benefit from the work being by the rest of the Web.

28: So this is Christmas

Sat, 2 Jan 2010 14:09:57 GMT

XPDay UK 2009

Sat, 2 Jan 2010 14:09:57 GMT

For the last few years I've been attending a cosy little community-run conference in the UK called XP Day. This year it was held in Church House which is a stone's throw away from Parliament.

As the slogan on their website says it was "more than XP. More than one day." The "more than XP" part of the slogan resulted in a surprising number of sessions about Lean and Kanban. Since these seem to be replacements for, the increasingly reviled, Scrum it got to the point where there was an open space session asking if we could have XP back.

The conference began with Google's Mark Striebeck giving an interesting keynote on the massive data collection and analysis effort his team is undertaking in order to turn testing "from an art into a science." Unfortunately I was constantly distracted by his usage of the word "art" in contexts where "craft" seemed more suitable. Since the relationship between art, craft and science is important to me, for obvious reasons, I was disappointed to see that Mark didn't give definitions. This meant that I couldn't work out if he'd truly confused craft with art or whether he was just using different definitions to the ones I prefer.

Gojko Adzic had a blog post out with the details of Mark's talk before the applause had died down. My own attempts at using the XP Day Jaiku channel for note-taking eventually faded away due to the sheer number of interesting talks, workshops and open space sessions going on.

This year's conference was heavily focussed on experience reports. Anna Shipman ran a couple of brutally honest and insightful sessions on situations where an Agile adoption goes wrong. There was also a large contingent from 7Digital who shared the difficulties and benefits of adopting Agile in a start-up. This was especially illuminating because their CEO participated in the experience report and gave us the customer's perspective. I especially liked his focus on using Agile as a competitive business advantage rather than merely as a way of fixing broken software processes.

My favourite session was probably Gojko's workshop on Building Software That Matters. It gave a roomful of people a chance to talk about some of my favourite topics: feature partitioning, creating quantifiable feedback loops in the software development process by testing with real users and developers focussing on helping to create value rather than just blindly implementing the requirements they're given.

I hope next year's XP Day is as interesting.