Archimedes and Newton: Old school split testers

It is not uncommon to see news stories celebrating the success of some initiative or individual as being due to some bright idea or moment of inspiration.  This phenomenon is not new; every child is taught that Archimedes had his ‘Eureka moment’ and can recite the story of Netwon’s falling apple.  It is these flashes of insight that we remember and strive to emulate.

However, the focus on creativity is unfortunate because it only paints half the picture.  For instance, the ‘file drawer problem’ means we see those flashes of inspiration that led to success, rather than the countless others that didn’t.  And, it is easy to forget that people like Archimedes and Newton were old-school split testers.  They subjected idea after idea to the brutal scientific method and learned from the many failures they no doubt had.  It is their perseverance and commitment to testing, not just their creativity, that we should remember them for.

Fortunately, more news is starting to bubble to the surface about the interplay between the creative and scientific processes.  For instance, this wired story shows how the gaming industry (typically considered a bastion of creativity and design) is embracing split testing to drive development decisions.  I also recently saw the following talk shared widely on Twitter about the testing that went into the success of Obama’s 2008 fundraising campaigns.

These stories highlight the fact that creative ideas are like the random mutations that drive the evolutionary process.  They are necessary, but certainly not sufficient, for progress to occur.  And another interesting recurrent theme is that the mental models underlying our creativity – the source of our ‘gut feelings’ about what will work – are often wrong.  Indeed, testing is essential to updating these models and is an under appreciated input to the creative process.  Together, they form an iterative learning cycle.

This interplay has implications for organisational and personal development in that as much effort should be put into developing the testing and learning process as goes into supporting the creative process.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s