Wednesday, September 4, 2013

Benchmarking and Internal Assesments: Eight Questions That Will Improve Your Studies and Their Results

If you saw last weeks post on the troubles "benchmarkers" deal with here then you may be wondering how do we make it better? If you are addressing the issues mentioned there and you want to take it to the next level here are eight points to consider when assessing your performance and benchmarking with others. These are based on the seventy plus assessments I have been involved in during the last ten years and the struggles I have seen during those and other assessments.
Does your assessment or benchmarking study have the following: 
an element of Volume – Does the assessment have more than just yes or no questions? Does it look into the amount of application of the concept or element or just the existence? For example, does it ask "Do you have planners?" or "What percentage of work is fully planned?" or as a second example "Do you use work orders?" or "What percentage of your craft hours is captured on a work order?" The second question in each provides the element of volume. This demonstrates the penetration of the concept into the way the site does business not just whether they have pockets of excellence in one area.
Detail - Do you have enough data and detail in each of the sections or elements of the assessment? Do you get a complete picture of the components that make up the element being assessed?  For example: Can you address all of the elements of Planning and Scheduling effectiveness with just one question in your study? Not likely. You will need more details and data in order to identify actionable gaps for closure.
Frequency – Are you doing it often enough? If you are only assessing or benchmarking once every ten years that would show little trend data. I would recommend a robust external assessment every three to four years for maximum effect. External does not have to be a consultant driven process you just need fresh eyes from another site or division.
Process Standard – Do you have a process and standards for the benchmark assessment so that the data is of like kind and comparable with other locations?
Personnel Standard – Do your assessors have the knowledge and competency to assess? Are they task qualified in the process standard. Are they standardized? Will the non-task qualified assessors affect the comparability of the data where they are involved? I have seen this over and over. Having a standard for performance and qualifying individuals is crucial to effective benchmarking.
Performance – Is the assessment having the desired effect? Is the assessment providing a view into the gaps that you need to address? Is the study executed at a level that identifies next steps to close the gaps. Is it driving the organization to close those gap? Is the organization better as a whole because they did the study?
Efficiency – Are you doing the study efficiently? Is it a major disruption to the business or can it be accomplished with minimal interruptions. Is your assessment or benchmark study addressing the elements required without being exhaustive? Is it full of manual calculations or does it standardized on base data that is used to generate the various calculations "automagicly"?
Innovation – Are you finding a better way to do it? Have you improved the assessment and benchmarking process each time you have executed it? This could be through data standardization or tool improvements or collected history.
This become the checklist that I review to ensure the highest level of success with benchmarking and assessments. Every time I use this list I am upping the return on effort of the study.

Are you happy with your assessments and benchmarking studies? Tell us about what you like with yours below in the comments section please.


  1. Hey Shon, may I add a 9th element to your great and insightful list? Really it should be the 1st element as it is the driver and glue that holds the other 8 together. Money, like TDC (True Downtime Cost) metrics. As well was volume, the true $$ Value should ride along with each benchmark so all are constantly aware and prioritize accordingly. You will then see success with benchmarking and assessments greatly improve. As money is the reason in the 1st place, and we all know money talks, ...

  2. mr. shon
    I have been reading the post in the benchmarking and have some thoughts in how to improve the product be it whatever it might be. The First thing a company needs is some employees that can think and have the desire to make or product the best product that can be made. But you have to have upper-management can respect the lower personal and take some suggestion on how to make some improvements in different areas. In other words if you want the best product, ask the people who makes it happen. In other words it all starts with the people that you have working for you. thanks charlie