Finishing the unfinishable. Where lessons should lead.

I had the pleasure of working in Edinburgh today, and flew in over the Forth Bridge (the rail bridge). It’s an iconic engineering landmark and a symbol of Scotland, which was recognised earlier this month by UNESCO as a world heritage site.

What this bridge is most famous for though, is that the task of ‘painting the Forth Bridge’ has become a metaphor for never-ending, unfinishable jobs. With 240,000 square metres of steel to cover with 230,000 litres of paint – no sooner have the painting team finished the job, that the weathering processes mean that they have to start again. 

Until recently that is.

Four years ago, new innovative epoxy paint with glass flakes was used on the bridge – the same paint that is used by the offshore oil industry. The new coating is predicted to last 25 years, ending the 120-year tradition of continuous painting. (Well, let’s face it, they needed a rest!)

This is a helpful metaphor for lesson learning in organisations.

  • It’s not unusual for the same lessons to learned over and over again by different teams in the same organisation.

  • It’s not uncommon for the same lessons to be captured over and over again in the same system.

  • It’s not uncommon for other teams to be well aware of the lessons which their peers learned before them.

  • Sometimes they even modify their plans accordingly – but even that shouldn’t be seen as the end-game.

 Effective lesson-learning isn’t predicated on the endless handover of the same knowledge and learning baton from team-to-team. That’s just like the ‘painting the Forth Bridge’ cliché. Learning is transferred but nothing fundamentally changes as a consequence.

 In 2011, something fundamentally changed with the Forth Bridge. Insights from the use of paint in another industry was suggested, tests were conducted, a business case was formed, a decision was made, a project was funded a specialist painting contractor received a lucrative contract (and the incumbent paint supplier lost an established customer), the old paint was blasted off and the new paintwork was completed after a ten-year effort. The unfinishable was finished.

 Learning, Innovation, Adaptation, Change, Improvement, Value Creation.

Getting Lessons Learned Right! Part 1: Customers.

Having spent the last few weeks exploring what’s wrong with lessons learned, it’s time to turn our attention towards the elements that contribute to successful organisational learning.

As we piece this puzzle together, one of the most important principles to bear in mind is that of knowing your customer.

It sounds obvious, but in my experience it’s often overlooked.  Just who is customer for the learning?

1. The current team.

One clear customer is the team who are conducting the review.  A well-facilitated review will not only surface technical, commercial and process-related learning, but also personal, behavioural and team-related insights. Even if the activity was a one-off, never-to-be-repeated project, there will always be learning relevant to each individual – provided the team explores the right questions.

Imagine a research team is working on a vaccine for an incurable disease.  After years of experimentation, analysis and a little luck, they stumble upon the antidote.  The team is ecstatic – they have a formula in their hands that could improve the lives of thousands of people.  So they secretly inoculate themselves, disband the team and each individual starts on their next challenge.

Now imagine the outcry!  That would be outrageous – a waste of extensive research. Commercially disastrous and selfish to the point of immorality!

There is a research team hidden in every operational project we do – it’s just that we fail to help them realise and multiply the value in what they have discovered - which takes us to customer type number 2:

2. The next team. One year ago, a large number of representatives from the London Organising Committee of the Olympic Games conducted an extensive debrief. That debrief wasn’t carried out in London.  Instead, it was conducted in Rio de Janeiro, in the presence of the Rio 2016 team, facilitated by the IOC.  Not only that, but the time was deliberately managed such that 50% of each day was available for connecting, networking and asking further questions., as well as exchanging documentation. The customer was clear – it was the next team.

Sometimes we know who exactly the next team (or teams) will be, and we can set up relationships, staff transfers, conversations, forums to ask questions, site visits, peer assists, peer reviews.  The IOC do all of this very well. When we know who our customers are, then we can connect the supply with demand. Dialogue-based approaches are the most effective mechanisms for this.

However, there are times when we don’t know who the next team will be – but we’re sure that there will be one at some time.  We can’t afford to wait until the demand surfaces, because the supply (the current team) will have already been disbanded, and may well have left the organization.  In these cases we do need to capture some record of the context and the learning, and where it is relevant, to express this as principles, propositions, recommendations or specific advice for the next team, whoever they might be.

We need to ask the right questions (more on this the next post); questions which make the current team think about the needs of an imaginary future team:

  • “What would you say to a team about to start on a similar project?"

  • "If you had just 5 minutes with them, what key pieces of advice would you give them, based on your experiences?"

  • "How could they repeat your successes; how could they ensure that they avoid the low points you faced?”

In practice, it can be difficult to convince a busy team that they need to invest time together for the benefit of some future imaginary team. They know it makes sense, but they usually have other priorities, even if there is a requirement in the project process that they need to comply with.  Compliance rarely generates thoughtful dialogue.

You will want to start with them as the customer, and bring the questions around to the future once they have warmed up, and seen some personal benefit.  You may need to appeal to people’s professionalism and pride to get them to engage in the idea of being recognized for leaving a legacy.  Indeed, some organisations have recognition schemes in place for exactly this. (ConocoPhillips’ “Gather” award, and Syngenta’s “Embed” award are both examples of this.)

Of course, when we take on a customer mindset, we need to consider more than just what they need to know.  We have to think equally as hard about how they would like to receive this knowledge.  You can bet that they don’t want a copy of a flipchart sporting a set of bullet points from a meeting that they were not present at!  They would probably like to have context, contacts, reasons for decisions, artifacts, quotations, narrative, references, top tips, things to avoid… – all nicely structured and easy to navigate.

When we understand that we have knowledge customers, then we need to consider our knowledge products.

More on this at a later date.

3. The Organisation itself.

So the current and future teams are clear enough, but how does the organisation become a customer?

It’s the best way I could think of to describe the idea of improving the structural capital – the processes, guidelines, protocols, standards, policies, training, development and formal ways of working.  I have had the privilege of spending time with the IOC over the past two years, and their approach to closing the loop and translating learning into technical guidance through their technical manuals is a great example of this.

An effective “lessons learned programme” does to simply pass the baton to the next team, neither does if make it’s goal in life the develop a library of lessons learned.  The focus should always be on improvement.  The question should be “how do we ensure that actions follow which remove the risk, or bake-in the benefits that our learning has uncovered?”.  I covered this in my BMW shaggy-dog story earlier last year.

The question “what have we learned?” should be followed by  “what should we do about this?”.  A learning log needs to have an actions log.

When we apply KM in Safety context we do this without another thought.  If someone is killed, injured or in the event of a near miss, a sequence of safety-related review processes are initiated, root causes are understood, risks mitigated, procedures updated, communication planned and training delivered.

We are good at closing the loop between a moment of learning and a permanent change in the structural capital.  Hopefully this is because we don’t want to kill or injure anyone, and hence care enough to make someone accountable for looking for risks and actions in every fragment of learning.

In my experience, other topics don’t receive this level of attention, even though the commercial value at stake might be significant.  Something we could learn from there.

False customers.

Just a few words about other stakeholders who are sometimes unhelpfully referred to as the customer for learning.

The customer is the project management process.

Never heard anyone say that?  Well, perhaps you’ve heard them express the same sentiment when them say: “the process says we need to have a review before proceeding to the next stage gate”. That’s more or less the same mindset.  We need to raise the sights of our project teams to see the real customer – themselves, the next team, or the betterment of the organization, which ultimately will improve relationships with a real external customer.

The customer is the regulator.

In some regulated businesses, there is an expectation that effective learning and improvement cycles are in place. This is a good thing!   Sadly, the regulators often look for evidence of inputs (because that’s what how they can measure compliance and consistency) rather than outputs (where the customer creates the value).  This can launch an industry of lessons logs and registers, unproductive reviews and ineffective debriefs, again the real customer has been lost and regulatory compliance has become a distraction.

This can be difficult, as nobody wants to do the work twice.  I recommend a dialogue with the regulating body to find out what they are actually looking for, rather than making assumptions that they have a preferred format. In my experience, regulators are specialists in their subject matter, but not specialists in organisational learning.  Engage them in a discussion about your preferred approach and propose different or additional sources of evidence of learning and transfer (for example: meetings in schedules, testimonies from individuals, candidates for recognition schemes).

Let's keep our focus on the true customers, and magnify the benefits.

What's wrong with Lessons Learned? Part 4.

Over the past two weeks, we’ve looked at three of the inherent weaknesses of “Lessons Learned” and the way the label is perceived:  Passiveness, Negativity and Ambiguity.We will move onto a more positive note soon, but before we do, I want to introduce one further weakness:  Bad Teachers.

At this point I want to make it clear that I have seen the Diaz/Timberlake/Segel film of the same name, and that they are 92 minutes of my life that I would like to have back! However, the image was too good not to use.

What do I mean by bad teaching?

In the educational sense of the word, a lesson is deliberately crafted and designed in order to teach.  I can say from experience of being married to a teacher, that every hour of teaching she delivers requires another hour to cover preparation, marking and feedback to the learners.

Lessons are carefully formulated to take account of learning styles, levels of capability and connections with other parts of the syllabus. They evaluate understanding, they build on prior knowledge, they include references to further exploration and they have measurable outcomes.

Our bullet point lessons look a bit lame now, don’t they?

“Ah, but we’re not in the business of education”, I hear you say. Well, perhaps we should make education more of our business!

There’s a George Bernard Shaw quote which teachers hate - my wife included.  You’ve probably heard it.

Those who can, do.  Those who can’t, teach.

But there’s a corollary to this, which I’d like to add:

Those who can do, often can’t teach.

And that’s often our problem.

A project team successfully learns something from a project review meeting.  A lot of their learning is internalized, and the “lesson” they write down on that flipchart makes sense to them.

But it doesn’t make sense to the next team who will be using it. Just because I’ve learned something doesn’t make it a lesson for everyone else when I write it down.

Imagine my wife visiting an Egyptology exhibition and giving the brochure to her class on Monday morning whilst announcing “Hey class 4, this is what I learned about the Egyptians over the weekend – why don’t you take a look!”It’s not what she learned that matters, it’s what she teaches.

So how do you prepare a lesson which becomes a good teacher?

  • Think about the customer for the knowledge.  Who will be reading this?  What questions would they have?

  • Consider the context.  In what situations would this lesson be relevant?  Is it specific or general recommendation?  A good practice? Something to bear in mind?  Something to avoid?

  • Provide the back-story. Help the reader to understand the circumstances which gave rise to your experience to help them make sense of what you learned and make a judgement on its applicability in their context.

  • Illustrate the lesson with artifacts, images, documents, quotes, videos, references and links to provide a richness to the learning experience.

  • Don't separate the lesson from it's source. Ensure that the person behind the story behind the lesson is clearly referenced.  Include a photo and full contact details.

  • Show where it fits with other lessons.  Signpost other relevant lessons and content by drawing together related content into a "knowledge asset".

  • Keep it fresh. Revisit the content periodically to ensure that it is still current, relevant, and illustrated with the best examples.

That way, we can be those who can do, can learn and can teach.

Follow @chris_collison

What's wrong with Lessons Learned? Part 3.

In the last few posts we've been exploring what's wrong with the way we position "lessons learned".  In part one, we looked at the passive problem of people's tendency to focus on the lessons rather than the activity of learning.  In part two, we looked at the negative associations of the term 'lessons', and the impact that this can have. In part three, I want to look at the problem of ambiguity.

The label "lessons learned" trips off the tongue easily, but that doesn't mean that everybody hears it in the same way. Learning appears in more than one place on an learning loop, so there is plenty of room here for confusion. It can be an output, an input, or an agent of change. Here is one, very simple question you can ask to check whats going on in your lessons learned process.

Who is learning?

Here are potential three recipients of the learning - let's imagine we give a badge of recognition in each case:

Image
Image

It could be person or team who had the experience, who completed the activity and then reflected upon it.

In this case, learning is an output.

Image
Image

It could be a function or department who learn from a team's experience and make a change to a process, policy, standard or working practice -  thereby reducing the risk or improving the prospects for everyone who follows. In this case, learning is an agent of change to the structural capital of the organisation. It becomes an embedded inheritance for all who follow.

Image
Image

It could be another team about to commence a new activity who are learning from the experience of a previous team. In this case, learning is an input. This input could proactively pushed to another team, or pulled by the new team, through a peer assist, for example.

It's important to recognise that all of of these are valid and desirable outcomes , or there's a danger that we allow learning from lessons to be a slightly self-indulgent team huddle.  Worse still, we focus on building the library of lessons rather than actioning the change that the learning should produce, see my earlier shaggy dog story about selling a BMW.

MAKE award winners ConocoPhillips and Syngenta both recognise the need to lubricate all parts of the learning and sharing cycle with appropriate senior recognition.

ConocoPhillips have their 4G awards:  Give (sharing knowledge), Grab (applying someone else's knowledge), Gather (consolidating knowledge), Guts (sharing learning from failure).

Agri-business Syngenta loved this, and created their own TREE awards along very similar lines:  Transfer, Re-use, Embed and [share a difficult] Experience.

In each case, senior leaders are involved in judging and celebrating the best examples of these essential behaviours, and the teams or individuals concerned receive a physical recognition award.  It's very clear who is learning, who is sharing, what is improving and where the value is - all of which is the best antidote for ambiguity.

Syngenta TREE award
Syngenta TREE award

What's wrong with Lessons Learned? Part 2.

What's the connection between Madonna, King Solomon and Louis Vuitton? Tricky one eh?

In "Live to tell", Madonna famously stated:

"A man can tell a thousand lies I've learned my lesson well..."

King Solomon waxed lyrical about lessons from laziness in the book of Proverbs (24:30-34)

"I went past the field of a sluggard, past the vineyard of someone who has no sense; thorns had come up everywhere, the ground was covered with weeds, and the stone wall was in ruins. I applied my heart to what I observed and learned a lesson from what I saw: A little sleep, a little slumber, a little folding of the hands to rest—and poverty will come on you like a thief and scarcity like an armed man."

Louis Vuitton clearly have a position on this too:

Luis Vitton
Luis Vitton

It's not just that they all connect with the concept of "lessons learned".  It's that in each case the association is negative.  In fact, nearly all references to lessons learned outside of KM, Organisational Learning or Project Management have negative connotations.

When my wife will knowingly shakes her head at me and tuts "...lessons learned darling, lessons learned...", I know I'm well and truly busted.

What went wrong with the concept of lessons?  In school, lessons are positive, educational and beneficial.  The minute we step out of the school gates they become negative, undesirable and punitive.

  • The phrase "I've learned my lesson" usually follows sorrow and suffering.
  • The phrase "I'm going to teach you a lesson" is usually followed by sorrow and suffering.

So with these precious market insights in mind, what name shall we give to our Organisational Learning processes to make them relevant, constructive and appealing? Imagine the following phone call...

me: Hello is that the KM Sales & Marketing department? Any ideas on branding this learning cycle stuff?

them: We've had this brilliant idea. Let's call it "Lessons Learned"!

me: Well, I guess it's better than "Post Mortem" that the Project guys are already using.

Sigh.  Sometimes we don't exactly make it easy for ourselves.

Not to say that we want to discourage learning from negative experiences.  Of course we don't - it's a precious, precious investment.  But if that's all we do, then learning itself becomes a negative experience by association.

1.  Let’s ensure that we apply the same learning approaches when things go well, as when they go badly.  This can difficult to embed without some discipline and leadership commitment, because when a project goes well, the team assume that the success was all down to their own natural professionalism and struggle to articulate recommendations for others.  (When a project goes badly, then the team will be quick to blame external factors - See Argyris, Teaching Smart People how to Learn for details.)

2.  Let's be prepared to dispense with the "lessons" word altogether if it carries so much baggage.

My favourite alternative is "Learning from Experience". Experience is much more neutral than "lessons".  It can be positive experience, negative experience, our experience or someone else's experience (more on that in part 3.)

If you get the chance to position and brand your efforts, you might consider about losing lessons and exhorting experience.

As Albert Einstein provocatively put it.

Experience is learning. Everything else is just information.

Follow @chris_collison

Learning on a Rollercoaster

One of my current clients needs to conduct a learning review from a 2-year IT project which, by her own admission, has had its fair share of ups and downs. The project is at its mid-point, so the main customer for the learning is the team itself. They don't have much time to conduct the review (sadly just 90 minutes), so she asked me for some ideas for pre-work  for the team. Sometimes you don't have the luxury of a full day to conduct an exhaustive review, so you have to work with what you have and help the team to quickly connect their hearts and minds to the review process.  It's the heart bit which interests me here.

When we're under time pressure, we tend to focus on the facts, the timeline, the plan, the process, contract, technology, scope and the deviations. Intellectual recall. In fact, most project review documents contain little more than this kind of intellectual recall. It usually takes a bit longer to get a team to talk about how they felt, and to draw out some the more people-oriented learning - let's call that a kind of "emotional recall".

I combined some ideas from Retrospects, After Action Reviews, Baton-passing and Future Backwards (Heaven and Hell) exercises into this approach. Enjoy the ride!

With thanks to Navcon
With thanks to Navcon

Part 1 - the pre-work:

Before the meeting, ask each member of the team to think back over the project timeline and to focus on their emotions at each stage. You can provide them with a template like this, with key dates or milestones marked to give a sense of orientation.

1. Ask them to sketch out their own "emotional rollercoaster", paying attention to the highs and lows.

2. For the high spots, write down what went well, and why you think it went well.

3. Do the same for the low spots. What was difficult, and why do you think that was?

4. How do you think the rollercoaster is most likely to continue?  Draw the continuing journey.  Bring this to the meeting with your notes on the reasons for the highs and lows.

Part 2 - during the meeting.

Sharing the Past and Present.

  • Collectively, in the meeting, create a large version of the rollercoaster timeline on the wall.
  • Each participant draws their journey up to the present day, pausing to describe the lows and highs, and the reasons for these.   A facilitator should probe these reasons using the "5-whys"  technique to get to the underlying reason.
  • For each high and low, ask the group to express the reason as a recommendation - something that someone else should do to repeat the delight, or avoid the despair - or an action which should be taken in order to change a process such that the good practice becomes embedded.
  • Capture these recommendations on post-its and place on the rollercoaster.
  • Repeat for each member of the project team (towards the end, they can "pass" if someone has already identified a high or low. )
  • This should create a shared view of the past, and "how we got to where we are today", with some useful recommendations captured. Consider who you might share these with beyond the team.

Creating the Future together.

  • Now ask each member to sketch how they think the project will go from now to the end date. You will probably get a range of options!
  • Focus on the best projected outcome and ask "based on all we've learned to date, what actions could we take to make this happen, rather than the less positive options?". You can take feedback from the entire group, or get them to discuss in pairs or sub-groups first.
  • Capture these actions (with names!).

Thank you ladies and gentlemen, this is the end of the ride. Please be sure to collect your belongings as you leave and don't forget to check your photo on the way out.

Taking lessons back to school...

I've been thinking recently about "Lessons Learned", and how widely that term is used and abused, both inside and outside KM and Organisational Learning circles.  How often in the press do we see Government departments, Football managers, Chief Police Officers et al utter the immortal words:  "we will be learning the lessons from this..."?

I wonder what this really means.  Is a lesson learned when it is identified by a reflecting practitioner, after a specific experience?  Is it learned when it is codified and made available for others, in specific or abstract form?  Or is a lesson learned when another individual has applied it, and experimented with it?

That was the basis of Kolb's learning cycle...

kolb.jpg
kolb.jpg

...but I'm not sure that I could point to many examples of organisations where this cycle of organizational learning represents the norm.  Not

really.

The

Centre for Wildfire Lessons

puts it nicely: 

"A lesson is truly learned when we modify our behavior to reflect what we now know."

What I do see a lot of is something more like this.

Let's call it "Collison's Ignorance Spiral"

(I hope the name doesn't catch on!).

cis.jpg
cis.jpg

Somehow, the "abstract conceptualisation" bit seems to wear a bit thin - too many motherhood statements in lessons learned reports which fester on electronic shelves.   Now it might be that a deliberate abstract conceptualisation step can be short-circuited completely, through storytelling and the rapid exchanges and collaboration available through social media.  Perhaps abstract conceptualisation is a personal, subconscious step, rather than a clumsy organisationally imposed process. I need to think more about that one. 

But I'm still left with a lingering doubt that

we just aren't very good at designing lessons with a (future) learner in mind

. I've been in a number of lessons learned reviews where the intent of the meeting seems to be catharsis for the team or compliance with the process, rather than learning for the organisation.

So, just for fun - what does a well designed lesson look like in a

school

Let's take a primary school lesson as an example (especially as I have a primary teacher conveniently sitting beside me right now!). I am reliably informed that a well designed lesson will have the following components.

Introduction - explain what you want them to learn; clear objectives. Test past learning, build on the results of past learning. Provide exemplar expectations - what would "good" look like? Be accessible to different learning styles (visual, auditory, kinaesthetic). Be capable of differentiate to multiple levels of capability. Combination of activity-based learning and theoretical-based learning, individual and group. Have a list of accessible resources. Conclude with a  plenary to summarise and test what has  been learned.

How do the lessons in your organisation measure up to that checklist?  Perhaps I should spend more time in the classroom...