Complexity and Decision-Making in Groups
By Ryan Petersen
Columbia Business School, MBA '08
The Business Environment as a Complex Adaptive System
The landscape that managers must navigate is unfathomably complex. With an infinite number of interconnections and contingencies, the business environment is subject to waves of upheaval that render the most accurate snapshots irrelevant. Furthermore, this landscape appears to be made of rubber, where each step we take sends ripples of repercussion throughout the system, ultimately shaking the very ground on which we stand. Faced by the impossibility of making even one truly optimal decision in this complex adaptive system, how can managers avoid paralysis?
First, we must understand just how complex this environment is. To illustrate, let’s look at the game of chess, a highly constrained system that generates a seemingly infinite amount of uncertainty. According to Brian Arthur of the Santa Fe Institute, even if every atom in the universe were a supercomputer that had been crunching away since the Big Bang, it would still be impossible to identify the optimal move at the outset of a chess match . Given that any business system is many orders of magnitude more complex than a chess game, it is clear that we must abandon the very notion of optimal decision making.
The economy is a complex adaptive system, whose aggregate behavior emerges from a vanishingly large number of interactions taking place everyday between its component agents and artifacts. In fact, what is true for the economy as a whole is also true for the sub-components themselves; markets, corporations, divisions, business units and individuals themselves are all complex adaptive systems.
In recent years the science of complexity has provided astounding new insights on the behavior of these types of systems. Complexity theory tells us that in any complex adaptive system, the most interesting patterns will unfold at the edge of order and chaos . For managers making decisions in groups, this translates into finding the balance between everybody following the party line (order) and everybody contributing anything that comes to mind (chaos). By keeping our groups poised on this razor sharp edge, we create the greatest probability of generating novelty.
So our job is not to make optimal decisions. Rather, we must facilitate processes that allow for the invention of alternatives, welcoming of challenges, and continual learning. Each of these essential elements of successful decision-making are performed better by well-managed groups than by individuals.
Inventing Alternatives
Given that we can never be certain that our course of action is ideal, we must always be willing to explore alternatives. By their very nature, groups are better at inventing options than individuals. Each member brings a distinct set of experiences and provides unique approaches to any problem. At the same time, the very act of sharing ideas often stimulates further ideation within the group, resulting in solutions that no single member of the group could develop in isolation.
The challenge for management, however, is to create a decision-making process that balances the need for safety in exploring new ideas with the need to reach a conclusion so the group can take action. In his work on building learning organizations, Peter Senge characterizes this as a balance between dialogue and discussion. “In dialogue,” he writes,” “there is a the free and creative exploration of complex and subtle issues, a deep ‘listening’ to one another and suspending of one’s own views. By contrast, in discussion different views are presented and defended and there is a search for the best view to support decisions that must be made at this time.”
More often managers err on the side of discussion, focusing on concrete action at the expense of exploring new directions. To address this problem, managers must be willing to make changes to the very process of decision-making. We should assemble diverse teams and encourage cognitive conflict between the members. We should reward people who propose ideas, even when the idea is not adopted. If we are seen as too close to a problem, we should consider removing ourselves from the idea generation process. If a decision is important enough, we should consult with experts from diverse backgrounds who are further from the problem than our group. And if we remain frustrated by a lack of promising alternatives, we should consider introducing outside facilitators to lead formal ideation sessions.
Inviting Challenge
Challenging our assumptions, ideas and perspectives is crucial to improving our decision-making abilities. Indeed, the generation of actionable feedback is the very essence of learning from experience. We must create atmospheres where dissenting opinions and challenges to our perspectives can be safely introduced. To do this we must open ourselves up to personal challenge.
Unfortunately, by our very nature such challenges generate uncomfortable emotions that millions of years of evolution have programmed us to avoid. This opposition to challenge, known as homeostasis, characterizes all self-regulating systems. We owe our very existence to this built-in resistance to change, as it creates the stability needed to survive in an ever-changing world. Unfortunately, homeostasis does not discriminate between changes that are good for us and those that are not. It just opposes all forms of change indiscriminately!
Developing emotional self-awareness is the key to overcoming this natural tendency to feel threatened by opposition. Managers must foster the ability to disconnectedly observe their own emotions, understand the root causes of the feelings, and then make a conscious decision about whether these are justified or not given the circumstances. Achieving this degree of awareness (enlightenment?) is perhaps the most daunting task we face. Yet if we are to create a process that generates the actionable feedback necessary for learning, we have no choice.
Learning as Feedback in an Evolutionary Business System
The complexities of the business world are such that we will never have all the information we need to make truly optimal decisions. What we can do, however, is to improve our ability to interpret the limited data we do have through continual learning.
The business environment is an evolutionary system: a vast, self-organizing web of agents and business modules coevolving through time. The most successful business modules become widely replicated, while less profitable ones disappear. Fundamentally, the manager’s job is to develop business modules that are able to adapt quickly to the constantly shifting landscape beneath our feet. The “fossil” record provides ample evidence of overly rigid companies that failed to coevolve with their environment.
Recognizing that the business world is subject to the forces of natural selection, managers would do well to take lessons from the evolution of ecological systems. The driving force behind natural selection is feedback from the environment. Mutations in DNA generate alternatives and the environment provides brutal feedback about their fitness. In a sense, over time the species “learns” what characteristics the environment values most.
Fortunately for us, our business units are powered by human brains with the power to receive feedback from the environment far faster than the DNA within us. We have the ability to synthesize a lifetime of diverse experiences to develop near instantaneous decision-making. Most important for the manager, we have the ability to connect our minds in a vast network.
To encourage development of a learning organization, the manager must adopt processes that facilitate a true linking of the minds on his team. A first step is to lay out a vision with the power to motivate team members and align their efforts toward a common goal. He must create safety, reward innovation, encourage dissent and welcome challenge. Meanwhile he must work to maintain a balance between dialogue and discussion. And throughout the process he must be constantly vigilant of his own emotions.
If the leader’s job really is to keep his team forever balanced on this tightrope between order and chaos, then it becomes clear why so many promising young managers plateau just a few years after graduation. They may have unknowingly accepted the hardest task known to man.
Labels: business, Columbia Business School, complex adaptive systems, complexity, evolution







