Posts Tagged ‘Benchmarking’

On data quality and crowdsourcing: Calvin and Hobbes

Friday, December 17th, 2010

While 15 years old, the cartoon below illustrates the issues with data quality in business intelligence, performance measurement and benchmarking initiatives:

Source: Calvin and Hobbes comic strip, by Bill Watterson, 23 August 1995

Transcript:

Calvin: “I’m filling out a reader survey for Chewing magazine. See, they asked how much money I spend on gum each week, so I wrote ‘$500.’ For my age, I put ‘43′ and when they asked what my favorite flavor is, I wrote ‘garlic/curry.’”
Hobbes: “This magazine should have some amusing ads soon.”
Calvin: “I love messing with data.”

Benchmarking, Rank Xerox and Canon

Friday, June 18th, 2010

smartKPIs.com Performance Architect update 24/2010

Benchmarking as a management concept is reported to have its roots in land surveying, where the altitude of objects is estimated based on a pre-established point of reference on an arbitrary landmark (McNary, 1994). Frederick Taylor is reported to be the first to use benchmarking along with other principles in a business enterprise to improve performance. Elements of benchmarking can be recognized in Taylor’s scientific management approach applied during his time at Bethlehem Steel Company (McNary, 1994), popularized in “The Principles of Scientific Management” .

Benchmarking as we know it today was first applied by the Xerox Corporation in later 70s, early 80s. Faced with increased competition from Japanese imports, Xerox set upon improve its order fulfillment process and other processes deemed unproductive. One of the first accounts of the “competitive benchmarking” approach at Xerox was given in 1992 by Rob Walker, the Director of Business Management Systems and Quality at Rank Xerox (U.K.) Ltd. at the time. In his article “Rank Xerox – Management Revolution”, he describes in detail the challenges, changes made and impact of the “competitive benchmarking” approach at the company. Under the “competitive benchmarking” initiative. Xerox compared itself to its Japanese competitors as well as large organizations operating outside of the industry: “American Express for billing and collections, American Hospital Supply for automated inventory control, LL Bean for distribution, warehousing and order-taking” (Walker, 1992).

The ascent of benchmarking in the 80s resulted in numerous books and articles published, reflected in the business environment by an increase in the use of benchmarking around the world. Comparing to others is natural to humans, so benchmarking was rather easy to understand in theory. Applying it in practice and generating value from it is a different story.

In sports and tennis in particular, performance metrics are monitored by players and coaches to track progress and how the game plan was executed. In terms of benchmarking KPIs between players, this needs to be explored with care. The playing style is different from one player to another. One player might have a very powerful serve, but generally inaccurate. Another might have a high percentage of net approaches, but ineffective. On top of this, in tennis the concentration power and determination is in many instances more important than game statistics. Similarly, in business, many companies zoom to a different tune. While benchmarking sounds good in theory, there are many practical issues relating to data accuracy and relevance of results. There are many questions organisations need to clarify before embarking on such a road:

a. Who may the beneficiaries of such an exercise be?

b. What is the added value?

c. Who has done this well?

The graph below raises another question:

Source: Google Finance, 2010

Did it ultimately work for Rank Xerox?

or even

What did Canon differently to generate such a gap between the stock price performance over the last 10 years?

Comparing performance across entities is even easier today. Availability of information technology and rich datasets facilitates benchmarking across multiple dimensions. However, embarking on benchmarking initiatives  because “it seems to be a popular tool” or because it was recommended by a consultant can be risky. Same as if it is pursued  “just because we can” or with unreliable data. Done properly, it might still be a good idea overall, but then another question needs to be asked:

Are there any other better ideas?

Yet again, Study puts initiatives management in a new light.

Stay smart! Enjoy smartKPIs.com!

Aurel Brudan

Performance Architect,
www.smartKPIs.com


References

McNary, Lisa D. 1994, “Thinking about excellence and benchmarking”, The Journal for Quality and Participation, July-August 1994, v17, n4, p90(1)

Walker, Rob 1992, “Rank Xerox – Management Revolution”, Long Range Planning, Vol. 25, No. 1, pp. 9 to 21

Walker, Rob 1992, Rank Xerox – Management Revolution”, Long Range Planning, Vol. 25, No. 1, pp. 9 to 21

The roots of Marketing Performance Management – An investigation in the context of its emergence

Saturday, May 1st, 2010

Literature reveals that the influence of Marketing on firm performance, especially on the bottom line, has been extensively explored, mainly from a resource-based view (RBV) perspective (Hooley et al. 2005; Fine 2009; Nath, Nachiappan & Ramanathan 2010). It seems natural to estimate that Marketing (no matter its forms: Market Research, Marketing mix etc.), as long as it generates sales, impacts in a positive manner the bottom line.

Moreover, there have been attempts to prove that customer satisfaction influences the stock prices, although economists and analysts commonly make limited use of this kind of data when projecting stock performance, and suggest firms should report forward-looking customer metrics (customer equity statement) (Fine 2009), because financial indicators have a lagging, not a leading perspective.

Source: Wikimedia Commons, 2010

The fundamentals for measuring Marketing results are therefore thought to rely on the very specific nature of Marketing as an organizational function. Just like the Human Resources function, Marketing was long considered to be a consumer of organizational resources, mainly financial, that wasn’t able to prove the worthiness of that consumption. David Reibstein from Wharton Business School, Jason Pashko from Accenture and Jeff Levitan from SAS discuss this issue in a webcast in 2007, arguing the replacement of  “old age marketers”, that wanted to be left alone, stating that their activity was all about creativity and not agreeing with budget accountability with “new age marketers” that in order to be controllers and investors of assets present results in shape of metrics to prove they do their job well.  One trigger that enhanced the extended use of performance measurement in Marketing was the development of technology and new business models that allow organizations to capture much more data on the market (Reibstein, Pashko & Levitan 2007).

Another context, besides that of accountability, mentioning the measurement of Marketing performance was the one dealing with improvement of Marketing practices and processes. Such a context can be found in a benchmarking initiative of the Marketing process. The benchmarking process is described by experts as a multistage approach, commonly consisting of the following three levels: identification of the best performers, setting the benchmarking goals and implementing changes. Performance measurement of Marketing appears in the second and the third stages: in order to set benchmarking goals, companies measure their own productivity against productivity of the leaders and during implementation, companies use indicators to track the progress in reaching the benchmarking goals (Donthu et al. 2005).

It is argued that commonly, a benchmarking tool needs to be focused on a single measure of overall efficiency or productivity that can be computed for the  firm and compared with competitors. However, a more robust approach is by analyzing multiple inputs and multiple outputs that can provide feedback regarding areas with need for improvement (Donthu et al. 2005). For example, if the overall benchmarking measure would be the level of customer satisfaction with complaints handling, several inputs and outputs to be analyzed in this context would be the following:

  • # Time to resolve customer complaints (output),
  • # Investment in customer support infrastructure (input),
  • # Customer support staff (input),
  • # Complaints backlog (output),
  • % Times where customers with handled complaints were courteously recalled (output) etc.

The belief that Marketing influences firm performance and recent Marketing developments impose raised Marketing accountability and continuous improvement of the Marketing capabilities. Marketing Performance Management (MPM) has emerged as a new area of Marketing to deal with “measuring, learning from, and improving upon marketing strategies and tactics over time” (CMG Partners & Chadwick Martin Bailey 2009).

References

CMG Partners & Chadvick Martin Bailey 2009, The Marketing Performance Advantage. Improving Effectiveness and Accountability, viewed 3 May 2010, <http://www.marketingperformanceadvantage.com/>.

Donthu, N, Hershberger, EK & Osmonbekov, T 2005, ‘Benchmarking marketing productivity using data envelopment analysis,’ Journal of Business Research, vol. 58, pp. 1474– 1482.

Fine, LM 2009, ‘The bottom line: Marketing and firm performance,’ Business Horizons, vol. 52, pp. 209-214.

Hooley, GJ, Greenley, GE, Cadogan, JW & Fahy, J 2005, ‘The performance impact of marketing resources,’ Journal of Business Research, vol. 58, pp. 18– 27.

Nath, P, Nacchiapan, S & Ramanathan, R 2010, ‘The impact of marketing capability, operations capability and diversification strategy on performance: A resource-based view,’ Industrial Marketing Management, vol. 39, pp. 307-329.

Reibstein, D, Pashko, J & Levitan, J 2007, Marketing Performance Management: The Key to Accountability webcast, viewed 3 May 2010, <http://www.bettermanagement.com/seminars/seminar.aspx?mode=play&L=14518>.

The importance of learning from practice

Saturday, April 24th, 2010

smartKPIs.com Performance Architect update 16/2010

DuPont, Toyota, Xerox, Analog Devices, Motorola…

What do they have in common?

Abstract reasoning and introspection enabled humans to advance scientific knowledge at an ever accelerating rate over the last 2500 years. As opposed to other natural sciences such as physics and chemistry, human organization or administration is more loosely defined, some considering it a science and others an art. However, both proponents of management as a science and as an art agree on its ultimate function – the one of getting things done or accomplishing desired goals.

While administrative science is one of the oldest fields of human inquiry, it is still behind in terms of maturity and impact, especially when compared to other fields. Scientific management is less than 100 years old and reporting the level of advancement in this field to others, one might consider it as being in its embryonic stage. It is ironic, as it is perhaps one of the most important aspects of human life – how as people on Earth we organize ourselves to live harmoniously and keep a balance between so many conflicting forces and priorities at so many levels.

So what can be done to accelerate the progress of administrative science, better known in practice as management, at both theoretical and practical level?

While there are many avenues to be explored, one of them is simple and with a considerable impact on both short and long term: Learning from practice.

Over time, administrative science has been driven by 3 main categories of contributors:

  • Academics – researchers employing rigorous academic research methods.
  • Consultants – commercial entities providing expert advice to challenges faced by practitioners.
  • Practitioners – business professionals that apply in practice principles of management to achieve desired results.

A key ingredient for speedy progress in management is cross-polenisation of ideas. That is exchanging opinions, learning and trying new approaches and sharing results, to contribute collaboratively to the body of knowledge. However, each of the three categories of contributors has certain limitations in terms of their contribution to this process:

  • Academics – sound academic research is slow and faces many challenges in terms of data availability and quality.
  • Consultants – as profit oriented businesses, generally the main purpose is profit generation by deploying services. The emphasis on Research and Development in management consulting organizations is inconsistent. Even when it is actively pursued, results are often influenced by marketing and revenue imperatives.
  • Practitioners – due to the ever-increasing demands of today’s fast-paced business environments, many of them have difficulties keeping up to date with professional development. Allocating time to activities such as research, documenting and sharing findings or even sharing opinions is mostly an exception rather than a rule.

For things to change, each of contributors from each of these categories needs to put more efforts both individually and collectively. Ultimately the most important category is the one formed by practitioners.

They spend most of their time in organizations that can be considered virtual laboratories for the administrative science.

They offer opportunities to change, experiment and innovate at a scale unmatched by both academics and consultant altogether.

This is one of the reasons why practitioners are key to the progress of administrative science. They are close to the data, can make decisions and have an unbiased position towards results as they are impacted by them anyway.

Both academics and practitioner have a key supporting role in this process. They can offer guidance and facilitate the cross-polenisation of ideas. The voice of practitioners needs to be heard more often: at conferences, on discussion forums, in academic and business publications and in businesses.

Successes from the past illustrate that, the contribution of practitioners to administrative science is the key driver of innovation in this field.

DuPont Analysis, Toyota Production System, Benchmarking, Balanced Scorecard and Six Sigma…

What do they have in common?

These concepts emerged from practice, championed in the companies nominated in the first question of this post. They were not concocted by consultants or academics in research laboratories.

Indeed, furthering the knowledge and application of such concepts in practice can’t be achieved without the support of the management consulting industry and academic institutions. They have done a rather good job so far.

However, listening to the voice of practitioners and learning from practice is something that we haven’t yet improved considerably. This is a condition that has to be met before the administrative science process of maturing is to accelerate dramatically.

Stay smart! Enjoy smartKPIs.com!

Aurel Brudan

Performance Architect,
www.smartKPIs.com


Relevant links

http://www2.dupont.com/Heritage/en_US/related_topics/donaldson_brown.html

http://www2.toyota.co.jp/en/vision/production_system/

http://hbr.org/1987/01/how-to-measure-yourself-against-the-best/ar/1

http://www.managerialaccounting.org/Balanced%20Scorecard.htm

http://www.motorola.com/Business/US-EN/Motorola+University/About

Featured products

$183 USD
 
$35 USD
 
$1800 USD
 
$289 USD
 
$45 USD
 
$99 USD
 
$99 USD
 
$99 USD