Deming and a System of Profound Ignorance

W Edwards Deming's famous (or in some circle, infamous) 14 Points traces its roots from his 'System of Profound Knowledge' (SOPK), a framework for thinking that he developed to help leaders (and really, everyone) understand what they need to know if they are to effectively improve (rather than destroy) the organisations they work in. 

SOPK consists of four components (Appreciation for a System, Theory of Knowledge, Knowledge of Variation, and Psychology) and the interactions between and among each of them.

In order to attain 'profound knowledge' one must have:

• A solid understanding of each component from a conceptual perspective (e.g., what is variation and why do I need to know about it?)
• A solid understanding of how each component interacts with the other three, from a conceptual perspective (e.g., how does a theory of knowledge impact how you interpret a system's behaviour?)
• A solid understanding of the above as applied to a domain (e.g., software development)
• A solid understanding of the above as applied to a specific organisation (e.g., this team)

Most of us will be familiar with one or more of the above components. But what about those who occupy leadership positions but are not aware of any of them? If they're using a different set of components, then they are using an alternative thinking framework, an anti-SOPK. The opposite of knowledge is ignorance, therefore such a framework can be said to be a SOPI - a System of Profound Ignorance.

What might the effects of such a framework look like?

• Lack of Appreciation for a System - SOPI practitioners focus on optimisation of each organisation sub-units, often turning them into 'profit centres', and comparing the profitability of each against the other. The psychology of survival kicks in within each sub-unit: Sales makes unachievable promises to customers, Purchasing seeks the lowest cost vendors, to the detriment of quality or reliability. Traders step over the bounds of ethics, The result: a system consisting of sub-units that fight for their own survival, a system that turns against its own best interests.
• Lack of Knowledge of Variation - SOPI practitioners look only at the most recent numbers. They celebrate when a target is exceeded, dishing out 'Well Done!'s to a few, and words of encouragement to 'Keep up the good work'. Disappointment occurs over the next several month's results as normal variation kicks in.
• Lack of a Theory of Knowledge - opinions and gut-feel rule the day. There is no appetite for going to the place where the data occurs (the gemba), no interest in persistent monitoring of phenomena, no rigorous approach to theory and experimentation to understand why things are as they are.
• Lack of appreciation for Psychology - SOPI practitioners ignore the psychological nature of people. They are surprised when people behave in ways that do not fit a deterministic, 'rational', linear cause-and-effect paradigm.

SOPK is both easy and demanding. The framework is easy enough to understand: just four components and their interactions; Deming suggests proficiency of any of the concepts is not required to begin using SOPK. 

Though easy, it is nevertheless demanding, for at least three reasons. 

First, each of the components can be a deep subject in its own right. Mastery of the concepts and principles take time. To reuse a description: a mouse can wade in any of them, yet an elephant can drown in any of them.

Second, while beginning to use SOPK is easy, the actual usage can be tedious. It is, after all, a scientific system demanding theories, experiments, validations. Mastery of application takes longer. Tenacity is required to keep using it.

Third, the insights that SOPK brings places its practitioners square against the mass of 'common sense'. The insights may say a cultural change is needed. Sometimes they direct us to a required change in the larger system. These types of changes take time and effort. In an era where instant results, 'decisive thinking', and putting out fires are what attracts attention and praise, it's not an easy place to be.

SOPK requires faith. But SOPI is the path of least resistance and instant rewards.