Showing posts with label complexity theory. Show all posts
Showing posts with label complexity theory. Show all posts

Saturday, February 08, 2014

The New Sciences of Networks & Complexity: A Short Introduction


From Cadmus, this is a nice introduction and overview to network and complexity science.

The New Sciences of Networks & Complexity: A Short Introduction

ARTICLE | | BY Raoul Weiler, Juri Engelbrecht


Abstract

This paper is the result of two recent e-workshops organized by The World Academy of Art and Science (WAAS), one on the Science of Networks, the other on Complexity. These Sci­ences have emerged in the last few decades and figure among a large group of ‘new’ sciences or knowledge acquisitors. They are connected with one another and are very well exposed in the diagram available under the name ‘Map of Complexity Science’ on Wikipedia. Networks exist in extremely diverse contexts: in the biological world, in social constructions, in urbanism, climate change and many more. The novelty appears in the correlations and the laws (e.g. power laws), which were discovered recently, and indicates a totally different appraisal from what was generally expected to exist. The Science of Complexity is directly related to networks. Networks are an essential part of the complexity phenomenon. Their applications, which are highly diverse, are recommended by several scientists; decision makers and politicians have to make use of this knowledge for better evaluation of the impact of their decisions in increasingly complex societies and as a function of time. The paper mentions a recent report on Complexity in Economics and the Economic Complexity Index.

1. Preamble & Frame

Networks and complexity have been recognized since quite a few decades. In recent years, real breakthroughs have taken place with the help of newmathematical instruments. Other ‘new sciences’ have emerged, say in about half a century, as illustrated by the comprehensive diagram published in Wikipedia;1 the diagram comes from a book by Brian Castellani and Frederic Hafferty2 titled Sociology and Complexity Science: A New Field of Inquiry (2009), and is called the Map of Complexity Science. It was a helping hand for drafting this paper, and is further highly recommended to be consulted. A multitude of new knowledge ‘providers’ have shown new ways and insights for exploring entities, ensembles and behavior of groups in very different domains. According to the diagram, quite a number of new sciences have emerged since the mid-20th century: the essential pillars for new ideasare Systems Theory,3 Cybernetics4 and Artificial Intelligence; a series of specific approaches emerge from there.

Cybernetics plays a central role in the acquisition of new or additional knowledge. Merriam-Webster defines the term this way:
“Cybernetics is the science of communication and control theory that is concerned especially with the comparative study of automatic control systems (as the nervous system and brain and mechanical-electrical communication systems).”
According to the diagram, the Science of Complexity was preceded and followed directly or in parallel by a series of new methods and approaches such as self-organization/autopoiesis, New Sciences of Networks and Global Network society. Not to forget the importance of the Dynamics of Systems Theory in which Jay Forrester of MIT occupies a major role which led to the publication of The Limits to Growth(1972),the first report to the Club of Rome.5

We all agree that our societies evolve to more complex entities; the evolution is expressed by economic globalization, planetary communications – wired and wireless – geopolitical conflicts, and the like. However, the decision processes at the political and societal levels continue to rely on habits and practices from ancient times: the rule of thumb method is still used in decision processes. The linear analysis in decision processes still remains the most used approach in management and governance questions, although we are aware of the complexity of societal situations. Therefore, the new sciences,6, 7 in particular networks and complexity, provide excellent new methods for analysis and prospective insights. As a matter of fact, we may treat networks as patterns or structures but complexity is an implicit property of such structures. 
Focusing on New Sciences looks to be a very promising endeavor, in particular for WAAS. Although the field of these new ‘knowledge producers’ is extremely broad, it provides new understandings, and establishes specific relationships between actors in many branches of sciences and contributes beyond present assumptions.

The New Sciences are to be understood as complementary to the ‘classical’ sciences; they ‘uncover’ new relationships, new laws (of mathematical character), and new characteristics among the parameters. The new sciences enable us to take non-linear relationships within systems into account, which was almost impossible before.

There are several fundamental problems where the applications of the Sciences of Networks & Complexity provide new insights in pure scientific domains, for example in the functioning of metabolisms in micro-organisms; applications in the domain of climate change and eco-biosphere are expected to bring a better understanding on the regional and planetary scale. In the fields of sociology and economics, these problems include new methods which enhance diagnostics that were not available before.
The governance of complex industrialized societies requires a better understanding of their underlying trends and institutional political decision processes. The methods applied so far do not appear to be able to provide appropriate guidelines. New insights into the organiza­tion of very large institutions, ministries and businesses, of international governing bodies, and perhaps in the governance of financial world, etc. require approaches which the science of networks and complexity can offer.

For long, scientists have expressed the need for cross-domain analyses, overcoming the exclusive approach of specialized understanding and arriving at an overarching understanding, denominated as a holistic methodology. The Western science and culture of the Renaissance have made tremendous progress based on reductionist analytical methods. However, these assumptions are frequently insufficient for a deeper understanding of reality. The well-known phrase The whole is more than the sum of the parts’ (attributed to Aristotle) is not only correct but now much more practicable than a reductionist approach. With the emergence of the Systems Theory, Complexity Science and related methods, a holistic understanding is at reach.

2. The Science of Networks

Several models of networks8 have been described over time: Random Network known as the Erdös-Rényi Model9 (1959); Scale-Free Model known as the BA Model called after Barabasi & Albert10, 11 (1999); Small World Model known as the Watts-Strogatz algorithm12(2008).
It must be stressed that mathematical tools have contributed substantially to analyses of the descriptions, characteristics and properties of networks, thus contributing to an understanding of reality which is yet to be recognized.

2.1 Scale-Free Networks and Power Law13, 14

Over the past few years, investigators from a variety of fields have discovered that many networks – from the World Wide Web to a cell’s metabolic system to actors in Hollywood –are dominated by a relatively small number of nodes that are connected to many other nodes.

Networks containing such important nodes or hubs tend to be what is called “scale-free” in the sense that a lower number of hubs has higher links and many nodes have less number of links. The surprising discovery was that these networks do not behave in the expected random behavior, which is a generally accepted description of phenomena in physics, result­ing frequently in the well-known ‘bell’ curve coming from a usual statistical distribution, characterized by log-log relationships which form the ‘power law’.

It is important that the scale-free networks behave in certain predictable ways: for example, they are remarkably resistant to accidental failures but extremely vulnerable to coordinated attacks.

As an example, counting how many webpages have exactly k links showed that the distribution followed a so-called power law: the probability that any node is connected to k other nodes is proportional to 1/kn. The value of n for incoming links is approximately 2. Power laws are quite different from the bell-shaped distributions that characterize random networks. Specifically, a power law does not have a peak like a bell curve does (Poisson distribution), but is instead described by a continuously decreasing function. When plotted on a log-log scale, a power law is a straight line. In contrast to a ‘democratic’ distribution of links seen in random networks, power laws describe systems in which a few hubs dominate.

2.2 Some Important Properties of Networks

2.2.1 Resilience /Robustness15

As humanity becomes increasingly dependent on electricity grids and communication webs, a much-voiced concern arises: Exactly how reliable are these types of networks? The good news is that complex systems can be amazingly resilient against accidental failures. In fact, although hundreds of routers routinely malfunction on the Internet at any moment, the network rarely suffers major disruptions. A similar degree of robustness characterizes living systems: people rarely notice the consequences of thousands of errors in their cells, ranging from mutations to misfolded proteins.

What is the origin of this robustness? Intuition tells us that the breakdown of a substantial number of nodes will result in a network’s inevitable fragmentation. This is certainly true for random networks: if a critical fraction of nodes is removed, these systems break into tiny, non-communicating islands.
Yet, simulations of scale-free networks tell us a different story: as many as 80 percent of randomly selected Internet routers can fail and the remaining ones will still form a compact cluster in which there will still be a path between any two nodes.

It is equally difficult to disrupt a cell’s protein-interaction network: measurements indicate that even after high levels of random mutations are introduced, the unaffected proteins will continue to work together.

In general, scale-free networks display an amazing robustness against accidental fail­ures, a property that is rooted in their inhomogeneous topology. The random removal of nodes will take out the small ones mainly because they are much more plenty than hubs. And the elimination of small nodes will not disrupt the network topology significantly, because they contain few links compared with the hubs, which connect to nearly everything. But a reliance on hubs has a serious drawback: vulnerability to attacks.

In a series of simulations, it was found that the removal of just a few key hubs from the Internet splintered the system into tiny groups of hopelessly isolated routers. Similarly, knockout experiments in yeast have shown that the removal of the more highly connected proteins has a significantly greater chance of killing the organism than the deletion of other nodes. These hubs are crucial; if mutations make them dysfunctional, the cell will most likely die.

2.2.2 Strengths and Weaknesses

A reliance on hubs can be advantageous or not depending on the system.

First, one has to note that resistance to randombreakdown is good news for both the Internet and the cell. In addition, the cell’s reliance on hubs provides pharmaceutical re­­searchers with new strategies for selecting drug targets, potentially leading to cures that would kill only harmful cells or bacteria by selectively targeting their hubs, while leaving healthy tissues unaffected.

Second, the ability of a small group of well-informed hackers to crash the entire communications infrastructure by targeting its hubs is a major reason for concern.

2.3 Some Examples of Applications

Over the past several years, researchers have uncovered scale-free structures in a stunning range of systems which include
  • the World Wide Web;
  • some social networks. A network of sexual relationships among people (from a research in Sweden) followed a power law: although most individuals had only a few sexual partners during their lifetime, a few (the hubs) had hundreds;
  • the network of people connected by e-mail;
  • the network of scientific papers, connected by citations, follows a power law: collaborations among scientists in several disciplines, including physicians and computer scientists;
  • business networks; a study on the formation of alliance networks in the U.S. bio-technology industry discovered definite hubs;
  • the network of actors in Hollywood: popularized by the game Six Degrees of Kevin Bacon, in which players try to connect actors via the movies in which they have appeared together. A quantitative analysis of that network showed that it, too, is dominated by hubs;
  • biological realm: in the cellular metabolic networks of 43 different organisms from all three domains of life, including Archaeoglobus fulgidus (an archae-bacterium), Escherichia coli (a eubacterium) and Caenorhabditis elegans (a eukaryote), it was found that most molecules participate in just one or two reactions, but a few (the hubs), such as water and adenosine triphosphate, play a role in most of them;
  • protein-interaction network of cells. In such a network, two proteins are “connected” if they are known to interact with each other. Investigating Baker’s yeast, one of the simplest eukaryotic (nucleus-containing) cells, with thousands of proteins, a scale-free topology was discovered: although most proteins interact with only one or two others, a few are able to attach themselves physically to a huge number; a similar result was found in the protein-interaction network of an organism that is very different from yeast, a simple bacterium called Helicobacter pylori.
Indeed, the more scientists studied networks, the more scale-free structures were discovered. These findings raised an important question: How can systems as fundamentally different as the cell and the Internet have the same architecture and obey the same laws? Not only are these various networks scale-free, they also share an intriguing property: for reasons not yet known, the value of nin the knterm of the power law tends to fall between 2 and 3.

A compelling question arises: How many hubs are essential? Recent research suggests that, generally speaking, the simultaneous elimination of as few as 5 to 15% of all hubs can crash a system.

3. The Science of Complexity

3.1 General Remarks

The focus lies on the innovative character of this new science, in terms of scientific development: mathematical, biological, as well as in terms of societal behavior, in particular in sociology but also in economics. Will industrial societies evolve to a new pattern of evolution/development under the influence of these new network facilities created by entirely new technologies? Relationship between individuals, or inter-subjectivity, will depend on the availability and accessibility of network and complexity methodologies. Therefore, uncovering new types of relationships enables more sustainable prospective scenarios on how our industrial societies will or could look like by the mid-21st century.

Important issues to be examined are democratic processes through the existence or ‘spontaneous’ emergence of networks. This new phenomenon becomes an important parameter in electoral campaigns, in major political processes as overthrowal of leaders, local and community issues. This very interesting domain is open for debate and reflection.

The state of knowledge about networking and complexity will play an increasing role in understanding the organization and functions of societies. Some most recent events and tendencies, in a large variety of domains, indicate the richness of applicability of these sciences: analysis and search for remediation of the worldwide financial crises; underlying political channels and possible solutions regarding the events in the Middle East; nature and size of social developments in nations with emerging economies; health research and disease dis­semination; impact of diminishing bio-diversity on human society and on a planetary scale etc.

The issues which have not yet found appropriate and durable (sustainable) answers will most likely find substantial progress with the application of these new sciences. The understanding of such phenomena requires other type of approaches – more holistic than reductionist – necessary for improved diagnosis and resulting in a better understanding and increased acceptance of proposed solutions.

In the case of world problems, the search for appropriate solutions by international or­ganizations within the present political frame shows quite clearly that progress can only be made by other approaches than the one used until now, based on scientific analysis and understanding, in which these new sciences will play a substantial role.

3.2 The Science of Complexity: Definitions, Properties & Tools

3.2.1 Definitions

Defining complexity remains not an easy task. Some definitions below are taken from publications and depend strongly on the viewpoint of the authors.

From Melanie Mitchell (2009):16
“Complexity is a system in which large networks of components with no central control and simple rules of operation give rise to complex collective behavior, sophisticated information processing, and adaptation via learning or evolution.
From Roger Lewin(1993):1
“Complexity science offers a way of going beyond the limits of reductionism, because it understands that much of the world is not machine-like and comprehensible through a cataloging of its parts; but consists instead mostly organic and holistic systems that are difficult to comprehend by traditional scientific analysis.
From the OECD Global Science Forum Applications of Complexity Science for Public Policy: New Tools for Finding Unanticipated Consequences and Unrealized Opportunities (2009):1
“Government officials and other decision makers increasingly encounter a daunting class of problems that involve systems composed of very large numbers of diverse interacting parts. These systems are prone to surprising, large-scale, seemingly uncontrollable, behaviors. These traits are the hallmarks of what scientists call complex systems.

An exciting, interdisciplinary field called complexity science has emerged and evolved over the past several decades, devoted to understanding, predicting, and influencing the behaviors of complex systems. The field deals with issues that science has previously had difficulty addressing (and that are particularly common in human systems) such as: non-linearities and discontinuities; aggregate macroscopic patterns rather than causal microscopic events; probabilistic rather than deterministic outcomes and predictions; change rather than stasis.
3.2.2 Some Properties

The promise of complexity science for policy applications is, at its core, the hope that science can help anticipate and understand the key patterns in complex systems that involve or concern humans, thus enabling wiser decisions about policy interventions.
Some important characteristics of complex systems are:
  • Adaptability: independent constituents interact changing their behaviors in reaction to those of others, and adapting to a changing environment;
  • Emergence: novel pattern that arises at the system level not predicted by fundamental properties of the system’s constituents;
  • Self-organization: a system that operates through many mutually adapting constituents where no entity designs it or directly controls it;
  • Attractors: some complex systems spontaneously and consistently revert to recognizable dynamic states known as attractors. While they might theoretically be capable of exhibiting a huge variety of states, in fact they mostly exhibit the constrained attractor states;
  • Self-organized Criticality: a complex system may possess a self-organizing attractor state that has an inherent potential for abrupt transitions of a wide range of intensities. For a system that is in a self-organized critical state, the magnitude of the next transition is unpredictable, but the long-term probability distribution of event magnitudes is a regularly known distribution (a “power law”);
  • Chaos: chaotic behavior is characterized by extreme sensitivity to initial conditions;
  • Non-linearity: non-linear relationships require sophisticated algorithms, and are sometimes probabilistic in nature. Small changes might have large effects, large changes could have little or no effects;
  • Phase Transitions: system behavior changes suddenly and dramatically (and, often, irreversibly) because a “tipping point”, or phase transition point, is reached. Phase transitions are common in nature: boiling and freezing of liquids, the onset of superconductivity in some materials when their temperature decreases beyond a fixed value;
  • Power Laws: probabilistic distribution characterized by a slowly decreasing function (log-log), different from the ‘familiar’ bell-shaped curve.
3.2.3 Tools and Techniques for Complexity Science

Some of the most important complexity tools being used in public policy domains at this time are:
  • Agent-based or Multi-agent Models: in computerized, agent-based simulations, a synthetic virtual “world” is populated by artificial agents who could be individuals, families, organizations, etc. The agents interact adaptively with each other and also change with the overall conditions in the environment;
  • Network Analyses: a common feature of many complex systems is that they are best represented by networks, which have defined structural features and follow specific dynamic laws. Scientists seek to identify configurations that are especially stable (or particularly fragile); some network patterns have been identified as predictors of catastrophic failures in real-life networks: electricity-distribution or communication infrastructures.
Additional complexity-related techniques deserve a special mention, although their use is not unique to complexity science: Data Mining, Scenario Modeling, Sensitivity Analysis, Dynamical Systems Modeling.

3.3 Possible Applications in the Public Policy Domain

Several examples of application domains have been explored, e.g.: epidemiology & contagion; traffic, identification of terrorist associations. Of more general interest is climate change, in particular the social and human aspects – connection between economy, finance, energy, industry, agriculture and the natural world. These new degrees of sophistication can only be achieved using complexity science.

Complexity science techniques can be useful in identifying dangerous tipping points in the human-earth system, which can occur independently of purely geophysical transitions. Perhaps, the most likely disruption of this type involves the management of water resources. Drought and water stresses occur regularly across large sections of Europe and the developing world. There are indications that a tipping point may be near, leading to massive long-term water shortages.

3.4 A Recent Topic: Economic Complexity19

The recently published The Atlas of Economic Complexity and the Index (ECI) defined in that publication have largely inspired what follows.

Gross Domestic Product (GDP) is the most used indicator to measure the level of economic activity and its evolution in time in terms of economic growth. GDP per capita is used to express the average wealth of the population of a country. However, GDP falls short when it comes to evaluating the well-being of a society.

Many attempts have been undertaken to improve or find better indices to express real progress in well being. In the frame of the Science of Complexity, an interesting approach has been proposed, rather recently, with the creation of the Economic Complexity Indicator (ECI), which focuses on the structure of the economy of a country and enables the diagnosis of its further development or progress, essentially based on the amount of knowledge available in a society for producing goods and services.

In a way ECI shows substantial progress in the evaluation of the economy of a country compared to what the GDP does. The many attempts for elaborating a ‘new’ economic system cannot oversee this innovative approach in using new sciences such as Networks and Complexity.
 
3.4.1 What is Economic Complexity?20

The complexity of an economy is related to the multiplicity of useful knowledge embedded in it. For a complex society to exist, and to sustain itself, people who know about design, marketing, finance, technology, human resource management, operations and trade laws, must be able to interact and combine their knowledge to make products. These same products cannot be made in societies that are missing parts of this capability set. Economic com­plexity, therefore, is expressed in the composition of a country’s productive output and reflects the structures that emerge to hold and to combine knowledge.

Knowledge can only be accumulated, transferred and preserved if it is embedded in networks of individuals and organizations that put this knowledge into productive use. Knowledge that is not used, at least as used in this economic context, however, is also not transferred, and will disappear once the individuals and organizations that have it retire or die.

Complex economies are those that can weave vast quantities of relevant knowledge together, across large networks of people, to generate a diverse mix of knowledge-intensive products. Simpler economies, in contrast, have a narrow base of productive knowledge and produce fewer and simpler products, which require smaller webs of interaction. Because individuals are limited in what they know, the only way societies can expand their knowledge base is by facilitating the interaction of individuals in increasingly complex webs of organizations and markets. Increased economic complexity is necessary for a society to be able to hold and use a larger amount of productive knowledge, and we can measure it from the mix of products that countries are able to make.

3.4.2 The Economic Complexity Index (ECI) & the Product Complexity Index (PCI)

First, the amount of embedded knowledge that a country has, is expressed in its productive diversity, or the number of distinct products that it makes. Second, products that demand large volumes of knowledge are feasible only in the few places where all the requisite knowledge is available. We define ubiquity as the number of countries that make a product. Using this terminology, we can observe that complex products – those that are based on much knowledge – are less ubiquitous. The ubiquity of a product, therefore, reveals information about the volume of knowledge that is required for its production. Hence, the amount of knowledge that a country has is expressed in the diversity and ubiquity of the products that it makes.

Economic Complexity Index (ECI) refers to countries. The corresponding measure for products gives us the Product Complexity Index (PCI). The mathematical approach exploits the combination of these indices as well as the diversity and ubiquity to create measures that approximate the amount of productive knowledge held in each of these countries.

In short, economic complexity matters because it helps explain differences in the level of income of countries, and more importantly, because it predicts future economic growth. Economic complexity may not be simple to accomplish, but the countries that do achieve it, tend to reap important rewards.

4. Complexity Science: New ways of Thinking for Policymakers (see OECD Report)21

The suggested new ways of thinking focus their attention on dynamic connections and evolution, not just on designing and building fixed institutions, laws, regulations and other traditional policy instruments:
  • Predictability: the science of complex systems focuses on identifying and analyzing trends and probabilities, rather than seeking to predict specific events. It will be challenging, though necessary, for policymakers and scientists alike to move beyond strict determinism if they wish to effectively engage in decision making under conditions of uncertainty and complexity.
  • Control: control is generally made possible by identifying cause-and-effect chains and then manipulating the causes. But cause and effect in complex systems are distributed, intermingled and not directly controllable. Complexity science offers many insights into finding and exploiting desirable attractors; identifying and avoiding dangerous tipping points; and recognizing when a system is in a critical self-organizing state.
  • Explanation: analyses done using complexity science methods, insights about the underlying mechanisms that lead to complex behavior are revealed. Although deterministic quantitative prediction is not generally achieved, the elucidation of the reasons for complex behavior is often more important for comprehending what might otherwise be puzzling real-world events.
  • Changing the Mindset: understanding the basic ideas of complexity of the world together with unpredictability. One should not forget that Albert Einstein has warned: “Not everything that counts can be counted, and not everything that can be counted counts”.

Notes

  1. Brian Castellani, “Complexity Map Overview,” Wikipedia http://en.wikipedia.org/wiki/File:Complexity-map-overview.png
  2. Brian Castellani and Frederic Hafferty, Sociology and Complexity Science: A New Field of Inquiry (New York: Springer, 2009)
  3. Immanuel Wallerstein, World-Systems Analysis: An Introduction (Durham: Duke University Press, 2004)
  4. Merriam-Webster Online, http://www.merriam-webster.com/dictionary/cybernetics
  5. Donella H. Meadows et al., The Limits to Growth (New York: Universe Books, 1972)
  6. Melanie Mitchell, Complexity: A Guided Tour (Oxford: Oxford University Press, 2009)
  7. Roger Lewin, Complexity: Life at the Edge of Chaos (London: Phoenix paperbacks, 1993)
  8. M. E. J. Newman, “The Structure and Function of Complex Networks” http://arxiv.org/pdf/condmat/0303516.pdf
  9. Stefano Boccaletti et al., “Complex Networks: Structure and Dynamics,” Elsevier, Physical Reports 424, no. 4-5 (2006): 175-308
  10. Albert-László Barabási, Linked: The New Science of Networks (Cambridge: Perseus Publishing, 2002)
  11. Albert-László Barabási and Eric Bonabeau, “Scale-Free Networks,” Scientific American 288, no. 5 (2003): 50-59 http://www.barabasilab.com/pubs/CCNR-ALB_Publications/200305-01_SciAmer-ScaleFree/200305-01_SciAmer-ScaleFree.pdf
  12. Duncan J. Watts, Six Degrees: The Science of a Connected Age (New York: W.W. Norton, 2003)
  13. "Report on: Applications of Complexity Science for Public Policy: New Tools for Finding Unanticipated Consequences and Unrealized Opportunities,” OECD http://www.oecd.org/sti/sci-tech/43891980.pdf
  14. Gérard Weisbuch and Sorin Solomon, eds., Tackling Complexity in Science: General Integration of the Application of Complexity in Science (Gloucester: Renouf Publishing Company Limited, 2007)
  15. Barabási and Bonabeau, “Scale-Free Networks”
  16. Melanie Mitchell, Complexity
  17. Roger Lewin, Complexity
  18. “Report on: Applications of Complexity Science for Public Policy”
  19. Ricardo Hausmann et al., The Atlas of Economic Complexity- Mapping Paths to Prosperity (Cambridge: MIT Press, 2011) http://atlas.media.mit.edu/book/
  20. Guido Caldarelli et al., Ranking and Clustering Countries and their Products; A Network Analysis, PLoS ONE 7, no. 10 (2012): e47278
  21. “Report on: Applications of Complexity Science for Public Policy”

About the Author(s)

Raoul Weiler
Member of the Comité de Pilotage, Division de l'éthique des sciences et des technologies, of UNESCO
Juri Engelbrecht
Vice-President of the Estonian Academy of Sciences

Thursday, February 06, 2014

Science in a Complex World: Declassification of Data Important to Future Science

The Santa Fe Institute publishes a series of articles from time to time in the Santa Fe New Mexican on complexity science and complex systems that are critical to human society — economies, ecosystems, conflict, disease, human social institutions and the global condition.

Science in a Complex World: Declassification of data important to future science


Posted: Sunday, February 2, 2014
Eric Rupley

Did you know top-secret intelligence by the U.S. government has played a key role in helping scientists understand how human societies and ecosystems have evolved over the last 10,000 years.


The catch, of course, is that this has happened only after the declassification of the intelligence.

I am an archaeologist and anthropologist at the Santa Fe Institute. With my colleagues, I study the long-term evolution of human societies, seeking the shared underlying principles that are responsible for the emergence of complex social, political and economic organization. To do this, we need two things: ideas about how things happened and data to evaluate those ideas. The evaluation of ideas with data leads to new ideas; this is the process that leads to scientific discovery.
Here is a story about a discovery in which which declassified top-secret data was critical. We know from archaeology that the first large-scale societies with a differentiated labor force, record-keeping bureaucracies and political systems that united communities beyond kinship emerged on the planet at least 6,000 years ago. This happened first in Mesopotamia — not just the land between the Tigris and Euphrates rivers, but all the lands drained by them in what is now southern Turkey, western Iran, Syria and Iraq.

The evolution of these first economies, we now know, occurred across the entire region. We didn’t always know this. Twenty years ago, we used to think the evolution of the earliest economies occurred only in a restricted area of southern Mesopotamia, mostly south of Baghdad. The area, called the “heartland of cities” by the eminent archaeologist (and former Santa Fe Institute trustee) Robert McCormick Adams, requires irrigation for agriculture.

New ways of thinking and new evidence have changed our view. Initially, we envisioned a core area of initial social innovation, while regions outside the core were “under-developed” and only passively participated in the creation of the first complex societies.

The mechanisms for the creation of a centralized bureaucracy were thought to have stemmed from the environmental characteristics of the core: In the earlier part of this century, some archaeologists believed it arose from the need to manage irrigation. But when it became clear that complex irrigation systems do not require centralized control, the irrigation hypothesis was replaced by other ideas about how communities in the region evolved. One idea was that a lack of material resources forced centralized trade and, thus, centralized bureaucracy.

Over the last 15 years, however, new information has been recovered that is leading us to an understanding that the origins of complex economies were not as restricted in location or as external in cause; almost all of Mesopotamia was locally involved in the evolution of a more complex regional economy. This new view leads us to new models of how the change occurred, and these new models emphasize internal forces over external conditions. In turn, this new understanding allows us to more effectively compare the evolution of civilization across the planet, identifying key evolutionary phenomena shared among human societies globally.

And here’s the crux of this story: In part, this discovery was made possible by one of the most closely held intelligence secrets of the Cold War. The Corona, Argon and Lanyard programs, initiated by the U.S. government in the 1950s, launched the first spy satellites. By the late 1960s, the systems were able to collect imagery with a ground resolution of less than six feet — good enough to identify small trees and large vehicles.

The remarkable half-century-old images contain detail almost as good as state-of-the-art digital images now available from commercial satellites. In addition to the Cold War mission for which they were designed (as dramatized in the 1968 movie Ice Station Zebra), the space photographs incidentally recorded traces of past human settlements that have survived for 10,000 years — crucial evidence about how we came to live in the world we now inhabit. In the last few decades, we have lost much of this landscape to industrial agriculture and mechanized land-leveling.

In 1995, a remarkable thing happened when this closely held secret of the government was partially declassified. The story of how this declassification occurred is only partly known. (See, for example, the work of authors Dwayne Day or Robert McDonald.) One undocumented story involves conversations between the archaeologist mentioned at the start of this piece, Adams, who was then secretary of the Smithsonian, and James Woolsey, then the U.S. director of central intelligence and a regent of the Smithsonian. Whatever the background of the declassification, the last Corona camera was given to the Smithsonian, a presidential order was signed on Feb. 22, 1995, and the imagery from the the missions was transferred to the National Archives. The United States Geological Survey took responsibility for releasing the data publicly.

The declassified images were of immediate use to archaeologists working in the Near East because they preserved information about a lost landscape. For the first time, we were able to see the land surface before the destruction of the sites we sought to investigate. (See, for example, the Corona Atlas of the Near East, a project by colleague Jesse Casana of the University of Arkansas, Fayetteville.)

Archaeologists were, in some instances, able to visit the remains of the damaged sites and systematically recover traces of the past cultures that inhabited the region thousands of years ago. What we’ve pieced together from excavation and from archaeological survey aided by the declassified images has helped revise our understanding of how our first complex societies and differentiated economies came to be. The declassified data from Corona have helped not just archaeologists; glaciologists, geologists and ecologists all have used the imagery to monitor how our world has changed.

Unfortunately, for reasons that remain unclear, the initial declassification tapered off, despite its broad scientific success. Yet, in these days of post-Edward Snowden debate over sweeping government information collection, we should keep in mind the importance of declassification to scientists. This is not a proposal to declassify everyone’s metadata. But we are now well beyond space photography and into an era of Big Data (as discussed in past articles in this newspaper by the Santa Fe Institute’s Chris Wood and Simon DeDeo).

While we can, and probably should, limit contemporary collection, part of the debate as we reassess our national surveillance policies should be a consideration of the future scientific utility of archival collections: Should we, in the future, release previously collected “legacy” data in a manner that both protects privacy and helps scientists understand the collective patterns of human interaction that govern our daily lives? If so, what should be the design of a curation policy that would balance privacy concerns and make full utility of what we have already gathered?

This is a challenging problem that pits citizen privacy and limits on government against an almost infinite space of future security concerns and what will surely be vastly improved analytical methods leading to greater utility of legacy data. While its purpose remains unclear, we might surmise from the construction of the so-called Utah Data Center (a government facility possibly designed to curate the digital collections of our intelligence community) that the community understands the future utility of currently collected data. But given the benefits of declassification and our concerns for privacy, the questions of if, when and how to release this data are important to us all. Asking these questions is in keeping with the Open Government Initiative signed by President Barack Obama on the first day of his administration.

We don’t yet know what shape an overall declassification policy should take, but we do know this: The data we collect now, on ourselves, will provide the digital archaeologists and historians of the future a window into how we operate as a society. Toward that gift — the understanding of the drivers of change in human society — we can make a direct contribution by taking into account the importance of future public research on legacy intelligence collections.


~ Eric Rupley is an anthropological archaeologist at the Santa Fe Institute and a doctoral candidate at the University of Michigan’s Museum of Anthropology. His research analyzes cross-cultural, region-scale data on past human activities and settlement systems to explore how new forms of social organization emerge. His primary field work has been in Syria and Turkey. He can be reached through email at erupley@santafe.edu.

About the series

The Santa Fe Institute is a private, nonprofit, independent research and education center founded in 1984, where top researchers from around the world gather to study and understand the theoretical foundations and patterns underlying the complex systems that are most critical to human society — economies, ecosystems, conflict, disease, human social institutions and the global condition. This column is part of a series written by researchers at the Santa Fe Institute and published in The New Mexican.

Tuesday, October 01, 2013

Applying Complexity Theory to a Dynamical Process Model of the Development of Pathological Belief Systems


O'Connor and Gabora premise their model for the development of pathological belief systems on the understand that "the web of understandings a human mind weaves about the world is not just complex, dynamic, self-organizing (Orsucci, 2002) but also self-regenerating, self-perpetuating, and thereby ‘alive’, and evolving not just at the biological organismic level but at a second, cultural level (Gabora, 1998, 2004, 2008)." Our ability to create an internal model of the world is founded in our capacity for a "self-triggered stream of thought," which allows to follow the freight-train of thoughts (monkey mind, in Buddhist lingo), and then to also manipulate the sensory experiences we have of the external world.

These manipulations (mental operations) allow us to structure sensations and impressions into a somewhat coherent "web of understanding" of the external world, a talent that also allows us to plan, prioritize, create analogies, adapt our behavior according to the situation, and so on. This is not without its issues, however, in that "the proclivity to mentally operate on impressions also provides for the possibility that they become increasingly distorted, particularly if the developing worldview that shapes this assimilation process is becoming a biased model of the external world."

This is an excellent and interesting paper using dynamical systems and complexity theory to make sense of how the human mind creates pathological belief systems in the context of mental illness.

Full Citation:
O'Connor, B, and Gabora, L. (2009, ). Applying complexity theory to a dynamical process
model of the development of pathological belief systems. Chaos and Complexity Letters, 4(3), 75-96.

This version:  arXiv:1309.5670 [nlin.AO], submitted Sep 23, 2013.

Applying complexity theory to a dynamical process model of the development of pathological belief systems

Brian P. O’Connor and Liane Gabora
Department of Psychology, University of British Columbia, Kelowna, BC, CANADA

ABSTRACT
A general dynamical process model of psychiatric disorders is proposed that specifies the basic cognitive processes involved in the transition from beliefs about self, others and world that are normal and adaptive, to beliefs that are rigid, extreme, and maladaptive. The relevant thought trajectories are self-confirming, and are considered to underlie the corresponding trajectories in symptoms. In contrast with previous work, the model focuses on underlying mechanisms, and it provides an evolutionary basis for the widespread susceptibility to psychiatric symptoms and disorders without the problematic claim that such disorders were selected by evolutionary forces. The model thereby incorporates both normality and abnormality in the same framework.

INTRODUCTION

Humans are susceptible to a wide variety of mental disorders that, despite their substantial differences, are all characterized by distinctive, rigid, extreme beliefs about themselves and others, and maladaptive ways of acting in the world. Examples of such beliefs include “I am a failure,” “I am incapable of having positive interactions with others,” and “I am overweight and cannot believe those who tell me I am dangerously thin.” The maladaptive beliefs associated with psychiatric disorders are evident and challenging to anyone who interacts with the individuals on a regular basis, including family members and mental health professionals. Yet most people were not born with such peculiar beliefs, and their family members can recall times when the client did not have such problematic views or any other psychiatric symptoms. How did they come about?


We propose that they are side-effects of the fact that the web of understandings a human mind weaves about the world is not just complex, dynamic, self-organizing (Orsucci, 2002) but also self-regenerating, self-perpetuating, and thereby ‘alive’, and evolving not just at the biological organismic level but at a second, cultural level (Gabora, 1998, 2004, 2008). The ability to weave an internal model of the world, or worldview, stems from the specifically human capacity for a self-triggered stream of thought, in which one thought triggers another, which triggers another, and so forth; our daily experience is formed not just by sensory impressions but also by mental operations on these impressions. These mental operations have the desirable effect of structuring impressions into a more-or-less coherent web of understanding, the integrated nature of which enables us to plan and prioritize, draw analogies, adapt behavior to the specifics of situations, and so forth. However, the proclivity to mentally operate on impressions also provides for the possibility that they become increasingly distorted, particularly if the developing worldview that shapes this assimilation process is becoming a biased model of the external world.


The goal of this chapter is to unpack this argument and propose a tentative, general model of the process by which once-normal individuals develop deep, maladaptive convictions that are seemingly impervious to refuting evidence and that are closely intertwined with other symptoms. Although the contents of beliefs vary across disorders, it is proposed that the basic cognitive processes involved are essentially the same across disorders. The model incorporates the possible influences of affective and biological factors on the trajectories of belief systems. The focus is on cognition, but there is no claim that cognitive factors are always primary or causal. Distinct belief systems are nevertheless almost always present in psychiatric disorders, and we are simply proposing a general model of how they develop. A proper understanding of how such belief systems develop will presumably be important to understanding how rigid belief systems can change for the better.


The chapter begins with descriptions of the particular beliefs that are commonly involved in a variety of Axis I and Axis II disorders from the Diagnostic and Statistical Manual (DSM-IV-TR; American Psychiatric Association, APA, 2000). In the second section, we provide an outline of relevant concepts from dynamical systems and complexity theory. Distinctions are made between how the present model differs from previous applications of these concepts to psychopathology. We also describe research on memory and thought processes, and on interpersonal processes, that are involved in the trajectories of belief systems. The fourth section describes the implications of our model and  the corresponding answers to a number of perennial questions in the literature.