Showing posts with label computational model. Show all posts
Showing posts with label computational model. Show all posts

Sunday, August 03, 2014

Neurobiology for Dummies w/ Frank Amthor, PhD (Brain Science Podcast 110)

 

Frank Amthor, PhD, is the author of Neurobiology for Dummies (2014), the follow up to his popular Neuroscience for Dummies (2011). He is the guest on the most recent edition of the Brain Science Podcast, hosted by Dr. Ginger Campbell.

"Neurobiology for Dummies" (BSP 110)

July 26, 2014 / Ginger Campbell, MD


Frank Amthor, PhD

Frank Amthor's latest book Neurobiology for Dummies isn't just for readers who are new to neuroscience. In this excellent follow-up to his Neuroscience for Dummies Dr. Amthor discusses a wide variety of brain-related topics. Since I have known Frank for several years it was a special treat to interview him for BSP 110. We talked about a wide variety of ideas ranging from what makes neurons special to how brains differ from current computers.

How to get this episode:
The most recent 25 episodes of the Brain Science Podcast are still FREE. See the individual show notes for links the audio files.



Reference and Links:

Announcements:

Tuesday, October 29, 2013

On the Computational Theory of Mind (IEET)

Via the Institute for Ethics and Emerging Technologies . . . .

By way of introduction, here is the first section from "Introduction to Computational Cognitive Modeling," by Ron Sun, to begin a definition of what is meant by computational models of cognition, or of a computational theory of mind.

1. What is Computational Cognitive Modeling?


Research in computational cognitive modeling, or simply computational psychology, explores the essence of cognition (broadly defined, including motivation, emotion, perception, and so on) and various cognitive functionalities through developing detailed, process-based understanding by specifying corresponding computational models (in a broad sense) of representations, mechanisms, and processes. It embodies descriptions of cognition in computer algorithms and programs, based on computer science (Turing 1950). That is, it imputes computational processes (in a broad sense) onto cognitive functions, and thereby it produces runnable computational models. Detailed simulations are then conducted based on the computational models (see, e.g., Newell 1990, Rumelhart et al 1986, Sun 2002). Right from the beginning of the formal establishment of cognitive science around late 1970’s, computational modeling has been a mainstay of cognitive science. [1]


In general, models in cognitive science may be roughly categorized into computational, mathematical, or verbal-conceptual models (see, e.g., Bechtel and Graham 1998). Computational models (broadly defined) present process details using algorithmic descriptions. Mathematical models presents relationships between variables using mathematical equations. Verbal-conceptual models describe entities, relations, and processes in rather informal natural languages. Each model, regardless of its genre, might as well be viewed as a theory of whatever phenomena it purports to capture (as argued extensively before by, for example, Newell 1990, Sun 2005).


Although each of these types of models has its role to play, in this volume, we will be mainly concerned with computational modeling (in a broad sense), including those based on computational cognitive architectures. The reason for this emphasis is that, at least at present, computational modeling (in a broad sense) appears to be the most promising approach in many respects, and it offers the flexibility and the expressive power that no other approach can match, as it provides a variety of modeling techniques and methodologies and supports practical applications of cognitive theories (Pew and Mavor 1998). In this regard, note that mathematical models may be viewed as a subset of computational models, as normally they can readily lead to computational implementations (although some of them may appear sketchy and lack process details).


Computational models are mostly process based theories. That is, they are mostly directed at answering the question of how human performance comes about, by what psychological mechanisms, processes, and knowledge structures and in what ways exactly. In this regard, note that it is also possible to formulate theories of the same phenomena through so called “product theories”, which provide an accurate functional account of the phenomena but do not commit to a particular psychological mechanism or process (Vicente and Wang 1998). We may also term product theories blackbox theories or input-output theories. Product theories do not make predictions about processes (even though they may constrain processes). Thus, product theories can be evaluated mainly by product measures. Process theories, in contrast, can be evaluated by using process measures when they are available and relevant (which are, relatively speaking, rare), such as eye movement and duration of pause in serial recall; or by using product measures, such as recall accuracy, recall speed, and so on. Evaluation of process theories using the latter type of measures can only be indirect, because process theories have to generate an output given an input based on the processes postulated by the theories (Vicente and Wang 1998). Depending on the amount of process details specified, a computational model may lie somewhere along the continuum from pure product theories to pure process theories.


There can be several different senses of “modeling” in this regard, as discussed in Sun and Ling (1998). The match of a model with human cognition may be, for example, qualitative (i.e., nonnumerical and relative), or quantitative (i.e., numerical and exact). There may even be looser “matches” based on abstracting general ideas from observations of human behaviors and then developing them into computational models. Although different senses of modeling or matching human behaviors have been used, the overall goal remains the same, which is to understand cognition (human cognition in particular) in a detailed (process-oriented) way.


This approach of utilizing computational cognitive models for understanding human cognition is relatively new. Although earlier precursors might be identified, the major developments of computational cognitive modeling have occurred since the 1960’s. It has since been nurtured by the Annual Conferences of the Cognitive Science Society (which began in the late 1970’s), by the International Conferences on Cognitive Modeling (which began in the 1990’s), as well as by the journals of Cognitive Science (which began in the late 1970’s), Cognitive Systems Research (which began in the 1990’s), and so on.


From Schank and Abelson (1977) to Minsky (1981), a variety of influential symbolic “cognitive” models were proposed in Artificial Intelligence. They were usually broad and capable of a significant amount of information processing. However, they were usually not rigorously matched against human data. Therefore, it was hard to establish cognitive validity of many of these models. Psychologists have also been proposing computational cognitive models, which are usually narrower and more specific. They were usually more rigorously evaluated in relation to human data. An early example is Anderson’s HAM (Anderson 1983). Many of such models were inspired by symbolic AI work at that time (Newell and Simon 1976).


The resurgence of neural network models in the 1980’s brought another type of model into prominence in this field (see, e.g., Rumelhart et al 1986, Grossberg 1982). Instead of symbolic models that rely on a variety of complex data structures that store highly structured pieces of knowledge (such as Schank’s scripts or Minsky’s frames), simple, uniform, and often massively parallel numerical computation was used in these neural network models (Rumelhart et al 1986). Many of these models were meant to be rigorous models of human cognitive processes, and they were often evaluated in relation to human data in a quantitative way (but see Massaro 1988).


Hybrid models that combine the strengths of neural networks and symbolic models emerged in the early 1990’s (see, e.g., Sun and Bookman 1994). Such models could be used to model a wider variety of cognitive phenomena due to their more diverse and thus more expressive representations (but see Regier 2003 regarding constraints on models). They have been used to tackle a broad range of cognitive data, often (though not always) in a rigorous and quantitative way (see, for example, Sun and Bookman 1994, Sun 1994, Anderson and Lebiere 1998, Sun 2002).


For overviews of some currently existing software, tools, models, and systems for computational cognitive modeling, the reader may refer to the following Websites (among others):


http://www.cogsci.rpi.edu/~rsun/arch.html
http://books.nap.edu/openbook.php?isbn=0309060966
http://www.isle.org/symposia/cogarch/archabs.html


as well as the following Websites for specific software, cognitive models, or cognitive architectures (e.g., Soar, ACT-R, and CLARION):


http://psych.colorado.edu/~oreilly/PDP++/PDP++.html
http://www.cogsci.rpi.edu/~rsun/clarion.html
http://act-r.psy.cmu.edu/
http://sitemaker.umich.edu/soar/home
http://www.eecs.umich.edu/~kieras/epic.html\


Note:
1. The roots of cognitive science can, of course, be traced back to much earlier times. For example, Newell and Simon’s early work in the 60’s and 70’s has been seminal (see, e.g., Newell and Simon 1976). The work of Miller, Galanter, and Pribram (1960) has also been highly influential. See the chapter by Boden in this volume for a more complete historical perspective (see also Boden 2006).
And here also is well-known philosopher (if only for his hair) David Chalmers offering a brief introduction to the topic in his 1993 paper, "A Computational Foundation for the Study of Cognition" (Journal of Cognitive Science, 2012):

1 Introduction


Perhaps no concept is more central to the foundations of modern cognitive science than that of computation. The ambitions of artificial intelligence rest on a computational framework, and in other areas of cognitive science, models of cognitive processes are most frequently cast in computational terms. The foundational role of computation can be expressed in two basic theses. First, underlying the belief in the possibility of artificial intelligence there is a thesis of computational sufficiency, stating that the right kind of computational structure suffices for the possession of a mind, and for the possession of a wide variety of mental properties. Second, facilitating the progress of cognitive science more generally there is a thesis of computational explanation, stating that computation provides a general framework for the explanation of cognitive processes and of behavior.

These theses are widely held within cognitive science, but they are quite controversial. Some have questioned the thesis of computational sufficiency, arguing that certain human abilities could never be duplicated computationally (Dreyfus 1974; Penrose 1989), or that even if a computation could duplicate human abilities, instantiating the relevant computation would not suffice for the possession of a mind (Searle 1980). Others have questioned the thesis of computational explanation, arguing that computation provides an inappropriate framework for the explanation of cognitive processes (Edelman 1989; Gibson 1979), or even that computational descriptions of a system are vacuous (Searle 1990, 1991).

Advocates of computational cognitive science have done their best to repel these negative critiques, but the positive justification for the foundational theses remains murky at best. Why should computation, rather than some other technical notion, play this foundational role? And why should there be the intimate link between computation and cognition that the theses suppose? In this paper, I will develop a framework that can answer these questions and justify the two foundational theses.

In order for the foundation to be stable, the notion of computation itself has to be clarified. The mathematical theory of computation in the abstract is well-understood, but cognitive science and artificial intelligence ultimately deal with physical systems. A bridge between these systems and the abstract theory of computation is required. Specifically, we need a theory of implementation: the relation that holds between an abstract computational object (a "computation" for short) and a physical system, such that we can say that in some sense the system "realizes" the computation, and that the computation "describes" the system. We cannot justify the foundational role of computation without first answering the question: What are the conditions under which a physical system implements a given computation? Searle (1990) has argued that there is no objective answer to this question, and that any given system can be seen to implement any computation if interpreted appropriately. He argues, for instance, that his wall can be seen to implement the Wordstar program. I will argue that there is no reason for such pessimism, and that objective conditions can be straightforwardly spelled out.

Once a theory of implementation has been provided, we can use it to answer the second key question: What is the relationship between computation and cognition? The answer to this question lies in the fact that the properties of a physical cognitive system that are relevant to its implementing certain computations, as given in the answer to the first question, are precisely those properties in virtue of which (a) the system possesses mental properties and (b) the system's cognitive processes can be explained.

The computational framework developed to answer the first question can therefore be used to justify the theses of computational sufficiency and computational explanation. In addition, I will use this framework to answer various challenges to the centrality of computation, and to clarify some difficult questions about computation and its role in cognitive science. In this way, we can see that the foundations of artificial intelligence and computational cognitive science are solid.
Where Gerald O'Brien seems to differ from these more traditional models is in his adherence to a connectional model of neural networks, which he describes as fully computational. Here is a brief definition of connectionism from Wikipedia:
Connectionism is a set of approaches in the fields of artificial intelligence, cognitive psychology, cognitive science, neuroscience, and philosophy of mind, that models mental or behavioral phenomena as the emergent processes of interconnected networks of simple units. There are many forms of connectionism, but the most common forms use neural network models.
This is closer to what I tend to believe than more traditional computational models, although I am not sure how he or other connectionists account for the input of the body and its role in shaping the mind (see Lakoff and Johnson, Philosophy In The Flesh).

This is a nice discussion from the IEET podcast, Rationally Speaking.

On the Computational Theory of Mind


Rationally Speaking  |  Posted: Oct 28, 2013 


Gerard O'Brien


(Studies in Applied Philosophy, Epistemology and Rational Ethics)


This episode of Rationally Speaking features philosopher Gerard O'Brien from the University of Adelaide, who specializes in the philosophy of mind - Physical Computation and Cognitive Science was published Oct, 27 of 2013. Gerard, Julia, and Massimo discuss the computational theory of mind and what it implies about consciousness, intelligence, and the possibility of uploading people onto computers.



Gerard's pick: "Alan Turing: The Enigma The Centenary Edition"

Listen/View

Monday, August 19, 2013

Richard Brown's Course on Consciousness and Its Place in Physical Reality


Richard Brown, who blogs at Philosophy Sucks! and Associate Professor at LaGuardia College, CUNY, recently posted the course outline and readings for a class he taught at LaGuardia that had the theme Cosmology, Consciousness, and Computation.

Aside from one book, his own Terminator and Philosophy: I'll Be Back, Therefore I Am, all of the readings are from online sources, particularly the outstanding Stanford Encyclopedia of Philosophy and YouTube.

Here is his course outline and the links to the readings:

Consciousness and its Place in Physical Reality

Posted on August 17, 2013 by Richard Brown

In the Spring 2013 semester I initiated a new course at LaGuardia that had the theme Cosmology, Consciousness, and Computation. The basic idea was to explore issues relating to physicalism. Intuitively, physicalism is the view that everything that exists is physical but what is the nature of physical reality? The idea I had was to have the course divided into three sections. In the first section we would do a conceptual physics course talking about the development of physics from the ancient world to the present day. Then we would turn to issues about consciousness and mind and where they fit in the physical picture we have so far developed. After that we turn to issues about computation; Is the universe computable? Or perhaps does it instantiate some computation? Is consciousness computational? Are we living in a simulation? Is the universe a hologram?

In my quest to have low cost book options for students I have adopted the Terminator book I co-edited and have supplemented that with readings from the Stanford Encyclopedia of Philosophy and other online material. The reception to the course was very good and I am really looking forward to doing it a second time in Fall 2013. I have updated the syllabus and, as usual, would welcome any suggestions or feedback.

Week I: Introduction
• →Richard Brown on What is Philosophy? – http://www.youtube.com/watch?v=ySS0bNeWZOg

Week 2: Early Attempts to Understand Mind and Physical Reality
• →Terminator Ch 10: The Nature of Time and the Universe
• Time- http://plato.stanford.edu/entries/time/
• Richard Brown on Pre-Socratic Philosophy- http://www.youtube.com/watch?v=zfLgRotdcKI&list=PLfR0qhtOKP6eYkUoW7DH8qdjwEyQnsbPJ&index=2
• Pre-Socratic Philosophy- http://plato.stanford.edu/entries/presocratics/
• Ancient Theories of the Soul- http://plato.stanford.edu/entries/ancient-soul/
• Parmenides- http://plato.stanford.edu/entries/parmenides/
• Zeno’s Paradoxes- http://plato.stanford.edu/entries/paradox-zeno/
• Ancient Atomism- http://plato.stanford.edu/entries/atomism-ancient/
• Democritus- http://plato.stanford.edu/entries/democritus/
• Intentionality in Ancient Philosophy- http://plato.stanford.edu/entries/intentionality-ancient/
• Time- http://plato.stanford.edu/entries/time/

Week 3: Modern Philosophy and Modern Science
• →Terminator Ch 2 –Animal consciousness, Descartes, and Emotions
• Descartes’ Physics- http://plato.stanford.edu/entries/descartes-physics/
• Descartes’ Epistemology- http://plato.stanford.edu/entries/descartes-epistemology/
• Descartes’ Theory of Ideas- http://plato.stanford.edu/entries/descartes-ideas/
• Other Minds- http://plato.stanford.edu/entries/other-minds/
• Animal Consciousness- http://plato.stanford.edu/entries/consciousness-animal/
• Locke on Real Essence- http://plato.stanford.edu/entries/real-essence/
• Locke’s Philosophy of Science- http://plato.stanford.edu/entries/locke-philosophy-science/
• Newton’s Philosophy- http://plato.stanford.edu/entries/newton-philosophy/
• Isaac Newton- http://plato.stanford.edu/entries/newton/
• Newton’s Views on Space, Time, and Motion-http://plato.stanford.edu/entries/newton-stm/
• The Contents of Perception- http://plato.stanford.edu/entries/perception-contents/
• The Problem of Perception- http://plato.stanford.edu/entries/perception-problem/

Week 4: Relativity Physics
• →Terminator Ch 8: paradoxes of time travel
• Einstein for Everyone:http://www.pitt.edu/~jdnorton/teaching/HPS_0410/chapters/index.html
• Brian Greene’s The Elegant Universe on NOVA-http://www.pbs.org/wgbh/nova/physics/elegant-universe.html#elegant-universe-einstein.html
• Time Travel and Modern Physics- http://plato.stanford.edu/entries/time-travel-phys/
• Time Machines- http://plato.stanford.edu/entries/time-machine/
• The Equivalence of Mass and Energy- http://plato.stanford.edu/entries/equivME/
• The Hole Argument- http://plato.stanford.edu/entries/spacetime-holearg/
• David Lewis’ The Paradoxes of Time Travel-http://www.csus.edu/indiv/m/merlinos/Paradoxes%20of%20Time%20Travel.pdf

Week 5: Quantum Mechanics
• Brian Greene’s The Fabric of the Cosmos on NOVA-http://www.pbs.org/wgbh/nova/physics/fabric-of-cosmos.html
• Copenhagen Interpretation of Quantum Mechanics:http://plato.stanford.edu/entries/qm-copenhagen/
• Many Worlds Interpretation of Quantum Mechanics-http://plato.stanford.edu/entries/qm-manyworlds/
• The Uncertainty Principle: http://plato.stanford.edu/entries/qt-uncertainty/
• Quantum Entanglement and Information: http://plato.stanford.edu/entries/qt-entangle/
• The Einstein-Podolsky-Rosen Argument in Quantum Theory-http://plato.stanford.edu/entries/qt-epr/
• Measurement in Quantum Theory: http://plato.stanford.edu/entries/qt-measurement/
• Quantum Mechanics- http://plato.stanford.edu/entries/qm/
• Richard Feynman on Double Slit Experiment- http://www.youtube.com/watch?v=hUJfjRoxCbk&list=PLfR0qhtOKP6eYkUoW7DH8qdjwEyQnsbPJ&index=3

Week 6: The Nature and Origin of the Universe
• →The Scale of the Universe- http://htwins.net/scale2/
• Hubble Deep Field: http://hubblesite.org/hubble_discoveries/hubble_deep_field/
• Cosmology and Theology- http://plato.stanford.edu/entries/cosmology-theology/
• Atheism and Agnosticism- http://plato.stanford.edu/entries/atheism-agnosticism/
• Religion and Science- http://plato.stanford.edu/entries/religion-science/
• Teleological Arguments for God’s Existence-http://plato.stanford.edu/entries/teleological-arguments/
• Cosmological Argument- http://plato.stanford.edu/entries/cosmological-argument/
• The Possible Parallel Universe of Dark Matter-http://discovermagazine.com/2013/julyaug/21-the-possible-parallel-universe-of-dark-matter#.UhDhPRbtaz6

Week 7: The Possibility of Life Beyond Earth
• Life- http://plato.stanford.edu/entries/life/
• Molecular Biology- http://plato.stanford.edu/entries/molecular-biology/
• Finding Life Beyond Earth- http://www.youtube.com/watch?v=FVzmGaGCqP8

Week 8: Consciousness in the Physical World?
• Consciousness- http://plato.stanford.edu/entries/consciousness/
• Representational Theories of Consciousness-http://plato.stanford.edu/entries/consciousness-representational/
• Functionalism- http://plato.stanford.edu/entries/functionalism/
• The Mind/Brain Identity Theory- http://plato.stanford.edu/entries/mind-identity/
• Dualism- http://plato.stanford.edu/entries/dualism/
• Zombies- http://plato.stanford.edu/entries/zombies/

Week 9: Beyond Physicalism?
• Eliminative Materialism- http://plato.stanford.edu/entries/materialism-eliminative/
• Folk Psychology as a Theory- http://plato.stanford.edu/entries/folkpsych-theory/
• The Philosophy of Neuroscience- http://plato.stanford.edu/entries/neuroscience/
• Panpsychism- http://plato.stanford.edu/entries/panpsychism/

Week 10: Transhumanism
• →Terminator Ch 4: Extended Mind, Transhumanism
• A History of Transhumanist Thought-http://www.fhi.ox.ac.uk/documents/journal_publications/al/nick_bostrom
• Biohackers: A Journey into Cyborg America- http://www.youtube.com/watch?v=K0WIgU7LRcI&list=PLfR0qhtOKP6eYkUoW7DH8qdjwEyQnsbPJ&index=48
• Tim Cannon on Potential Benefits of Sensory Augmentation-http://www.youtube.com/watch?v=KZ1KCpSL51E&list=PLfR0qhtOKP6eYkUoW7DH8qdjwEyQnsbPJ&index=46
• Aubrey de Grey on Defeating Aging- http://www.youtube.com/watch?v=d1FBJGl2c-Y&list=PLfR0qhtOKP6eYkUoW7DH8qdjwEyQnsbPJ&index=17

Week 11: A.I. and The Singularity
• →Terminator Ch 1: A.I., Chinese Room, Transhumanism
• →Terminator Ch 3: Why always with the killing?
• The Chinese Room Argument- http://plato.stanford.edu/entries/chinese-room/
• The Turing Test- http://plato.stanford.edu/entries/turing-test/
• The Frame Problem- http://plato.stanford.edu/entries/frame-problem/
• David Chalmers’ The Singularity: A Philosophical Analysis-http://consc.net/papers/singularity.pdf
• David Chalmers on Simulation and Singularity- http://www.youtube.com/watch?v=FafHdF_D8gA&list=PLfR0qhtOKP6eYkUoW7DH8qdjwEyQnsbPJ&index=13

Week 12: The Simulation Argument & The Holographic Hypothesis
• Nick Bostrom’s Simulation Argument Website- http://www.simulation-argument.com
• Nick Bostrom on The Simulation Argument- http://www.youtube.com/watch?v=nnl6nY8YKHs&list=PLfR0qhtOKP6eYkUoW7DH8qdjwEyQnsbPJ&index=24
• David Chalmers’ The Matrix as Metaphysics- http://consc.net/papers/matrix.html
• Leonard Susskind on The World as a Hologram- http://www.youtube.com/watch?v=2DIl3Hfh9tY&list=PLfR0qhtOKP6eYkUoW7DH8qdjwEyQnsbPJ&index=16

Sunday, March 10, 2013

Ray Kurzweil's "How to Create a Mind" Reviewed by Philosopher Colin McGinn


From the New York Review of Books, eminent philosopher Colin McGinn reviews the new, somewhat controversial book from Ray Kurzweil, How to Create a Mind: The Secret of Human Thought Revealed.  

McGinn begins the review by rightly pointing out that Kurzweil is not a professional neuroscientist, psychologist, or philosopher. Based on this, he seems incredulous that Kurzweil's books promises to reveal "the secret of human thought.” Kurzweil makes the bold assertion that he knows "how to create a mind.”

Although my reasons are different (in part) from McGinn's for finding Kurzweil's claims to be too far reaching to be taken seriously, I am in agreement with much of what he writes here.

As a little background, here is a very brief sketch of McGinn from Wikipedia:
Colin McGinn (born 10 March 1950) is a British philosopher, currently Professor of Philosophy and Cooper Fellow at the University of Miami. He previously held teaching positions at the University of Oxford and Rutgers University. 
McGinn is best known for his work in the philosophy of mind, and is the author of over 20 books on this and other areas of philosophy, including The Character of Mind (1982), The Problem of Consciousness (1991), Consciousness and Its Objects (2004), and The Meaning of Disgust (2011).

Perhaps most relevant to this review, he is also author of The Character of Mind: An Introduction to the Philosophy of Mind (OPUS) (1997) and The Mysterious Flame: Conscious Minds In A Material World (2000).

Homunculism

MARCH 21, 2013

Colin McGinn



Eric Edelman: Inspiration of a Dreamer, 2013

How to Create a Mind: The Secret of Human Thought Revealed
by Ray Kurzweil
Viking, 336 pp., $27.95

According to Wikipedia, Ray Kurzweil is an
American author, inventor, futurist, and director of engineering at Google. Aside from futurology, he is involved in such fields as optical character recognition (OCR), text-to-speech synthesis, speech recognition technology, and electronic keyboard instruments.
So he is a computer engineer specializing in word recognition technology, with a side interest in bold predictions about future machines. He is not a professional neuroscientist or psychologist or philosopher. Yet here we have a book purporting to reveal—no less—“the secret of human thought.” Kurzweil is going to tell us, in no uncertain terms, “how to create a mind”: that is to say, he has a grand theory of the human mind, in which its secrets will be finally revealed.

These are strong claims indeed, and one looks forward eagerly to learning what this new theory will look like. Perhaps at first one feels a little skeptical that Kurzweil has succeeded where so many have failed, but one tries to keep an open mind—hoping the book will justify the hype so blatantly brandished in its title. After all, Kurzweil has honors from three US presidents (so says Wikipedia) and was the “principal inventor of the first CCD flatbed scanner” and other useful devices, as well as receiving many other entrepreneurial awards. He is clearly a man of many parts—but is ultimate theoretician of the mind one of them?

What is this grand theory? It is set out in chapter 3 of the book, “A Model of the Neocortex: The Pattern Recognition Theory of Mind.” One cannot help noting immediately that the theory echoes Kurzweil’s professional achievements as an inventor of word recognition machines: the “secret of human thought” is pattern recognition, as it is implemented in the hardware of the brain. To create a mind therefore we need to create a machine that recognizes patterns, such as letters and words. Calling this the PRTM (pattern recognition theory of mind), Kurzweil outlines what his theory amounts to by reference to the neural architecture of the neocortex, the wrinkled thin outer layer of the brain.

According to him, there are about 300 million neural pattern recognizers in the neocortex, with a distinctive arrangement of dendrites and axons (the tiny fibers that link one neuron to another). A stimulus is presented, say, the letter “A,” and these little brain machines respond by breaking it down into its geometric constituents, which are then processed: thus “A” is analyzed into a horizontal bar and two angled lines meeting at a point. By recognizing each constituent separately, the neural machine can combine them and finally recognize that the stimulus is an instance of the letter “A.” It can then use this information to combine with other letter recognizers to recognize, say, the word “APPLE.” This procedure is said to be “hierarchical,” meaning that it proceeds by part-whole analysis: from elementary shapes, to letters, to words, to sentences. To recognize the whole pattern you first have to recognize the parts.

The process of recognition, which involves the firing of neurons in response to stimuli from the world, will typically include weightings of various features, as well as a lowering of response thresholds for probable constituents of the pattern. Thus some features will be more important than others to the recognizer, while the probability of recognizing a presented shape as an “E” will be higher if it occurs after “APPL.”

These recognizers will therefore be “intelligent,” able to anticipate and correct for poverty and distortion in the stimulus. This process mirrors our human ability to recognize a face, say, when in shadow or partially occluded or drawn in caricature. Kurzweil contends that such pattern recognizers are uniform across the brain, so that all regions of the neocortex work in basically the same manner. This is why, he thinks, the brain exhibits plasticity: one part can take over the job performed by another part because all parts work according to the same principles.

It is this uniformity of anatomy and function that emboldens him to claim that he has a quite general theory of the mind, since pattern recognition is held to be the essence of mind and all pattern recognition is implemented by the same basic neural mechanisms. And since we can duplicate these mechanisms in a machine, there is nothing to prevent us from creating an artificial mind—we just need to install the right pattern recognizers (which Kurzweil can manufacture for a price). The “secret of thought” is therefore mechanical pattern recognition, with hierarchical structure and suitable weightings for constituent features. All is revealed!

What are we to make of this theory? First, pattern recognition is a subject much studied by perceptual psychologists, so Kurzweil is hardly original in calling attention to it (I worked on it myself as a psychology student back in 1970). What is more original is his contention that it provides the key to mental phenomena in general.

However, that claim seems obviously false. Pattern recognition pertains to perception specifically, not to all mental activity: the perceptual systems process stimuli and categorize what is presented to the senses, but that is only part of the activity of the mind. In what way does thinking involve processing a stimulus and categorizing it? When I am thinking about London while in Miami I am not recognizing any presented stimulus as London—since I am not perceiving London with my senses. There is no perceptual recognition going on at all in thinking about an absent object. So pattern recognition cannot be the essential nature of thought. This point seems totally obvious and quite devastating, yet Kurzweil has nothing to say about it, not even acknowledging the problem.

He does in one place speak of dreaming as a “sequence of patterns” and he might try to say the same about thinking. But this faces obvious objections. First, even if that is true, there is no pattern recognition involved when I dream, or when I think about London and my friends and relatives there. So his “model of the neocortex” does not apply. Second, it is quite unclear what this description is supposed to mean. Why is a dream a sequence of “patterns,” instead of just ideas or images or hallucinations? The notion of “pattern” has lost its moorings in the geometric models of letters and faces: Are we seriously to suppose that dreams and thoughts have geometrical shape? At best the word “pattern” is now being used loosely and metaphorically; there is no theory of dreaming or thinking here. Similarly for Kurzweil’s claim that memories are “sequences of patterns”: What notion of pattern is he working with here? Why is remembering that I have to feed the cat itself some kind of pattern?

What has happened is that he has switched from patterns as stimuli in the external environment to patterns as mental entities, without acknowledging the switch; and it is hardly plausible to suggest that dreams and thoughts are themselves geometric patterns that we introspectively recognize. So what is the point of calling dreams and thoughts “patterns”? The truth is that the PRTM does not generalize beyond its original home of sensory perception—the recognition of external patterns in the environment.

Indeed, it is notable that Kurzweil makes no serious effort to generalize beyond the perceptual case, blithely proceeding as if everything mental involves perception. In fact, it is not even clear that all perception involves pattern recognition in any significant sense. When I see an apple as red, do I recognize the color as a pattern? No, because the color is not a geometric arrangement of shapes or anything analogous to that—it is simply a homogeneous sensory quality. Is the sweetness of sugar or the smell of a rose a pattern? Not every perceived feature of objects resembles a letter of the alphabet or a word—the objects of Kurzweil’s professional interest and expertise.

Then there are such mental phenomena as emotion, imagination, reasoning, willing, intending, calculating, silently talking to oneself, feeling pain and pleasure, itches, and moods—the full panoply of the mind. In what useful sense do all these count as “pattern recognition”? Certainly they are nothing like the perceptual cases on which Kurzweil focuses. He makes no attempt to explain how these very various mental phenomena fit his supposedly general theory of mind—and they clearly do not. So he has not shown us how to “create a mind,” or come anywhere near to doing so. Thus the hype of the title explodes very early and with a feeble fizzle. Why write a book with such an ambitious title and then deliver so little?

There is another glaring problem with Kurzweil’s book: the relentless and unapologetic use of homunculus language. Kurzweil writes: “The firing of the axon is that pattern recognizer shouting the name of the pattern: ‘Hey guys, I just saw the written word “apple.”’” Again:
If, for example, we are reading from left to right and have already seen and recognized the letters “A,” “P,” “P,” and “L,” the “APPLE” recognizer will predict that it is likely to see an “E” in the next position. It will send a signal down to the “E” recognizer saying, in effect, “Please be aware that there is a high likelihood that you will see your “E” pattern very soon, so be on the lookout for it.” The “E” recognizer then adjusts its threshold such that it is more likely to recognize an “E.”
Presumably (I am not entirely sure) Kurzweil would agree that such descriptions cannot be taken literally: individual neurons don’t say things or predict things or see things—though it is perhaps as if they do. People say and predict and see, not little bunches of neurons, still less bits of machines. Such anthropomorphic descriptions of cortical activity must ultimately be replaced by literal descriptions of electric charge and chemical transmission (though they may be harmless for expository purposes). Still, they are not scientifically acceptable as they stand.

But the problem bites deeper than that, for two reasons. First, homunculus talk can give rise to the illusion that one is nearer to accounting for the mind, properly so-called, than one really is. If neural clumps can be characterized in psychological terms, then it looks as if we are in the right conceptual ballpark when trying to explain genuine mental phenomena—such as the recognition of words and faces by perceiving conscious subjects. But if we strip our theoretical language of psychological content, restricting ourselves to the physics and chemistry of cells, we are far from accounting for the mental phenomena we wish to explain. An army of homunculi all recognizing patterns, talking to each other, and having expectations might provide a foundation for whole-person pattern recognition; but electrochemical interactions across cell membranes are a far cry from actually consciously seeing something as the letter “A.” How do we get from pure chemistry to full-blown psychology?

And the second point is that even talk of “pattern recognition” by neurons is already far too homunculus-like for comfort: people (and animals) recognize patterns—neurons don’t. Neurons simply emit electrical impulses when caused to do so by impinging stimuli; they don’t recognize anything in the literal sense. Recognizing is a conscious mental act. Neither do neurons read or understand—though they may be said to simulate these mental acts.

Eric Edelman: An Unanswered Question, 2013

Here I must say something briefly about the standard language that neuroscience has come to assume in the last fifty or so years (the subject deserves extended treatment). Even in sober neuroscience textbooks we are routinely told that bits of the brain “process information,” “send signals,” and “receive messages”—as if this were as uncontroversial as electrical and chemical processes occurring in the brain. We need to scrutinize such talk with care. Why exactly is it thought that the brain can be described in these ways? It is a collection of biological cells like any bodily organ, much like the liver or the heart, which are not apt to be described in informational terms. It can hardly be claimed that we have observed information transmission in the brain, as we have observed certain chemicals; this is a purely theoretical description of what is going on. So what is the basis for the theory?

The answer must surely be that the brain is causally connected to the mind and themind contains and processes information. That is, a conscious subject has knowledge, memory, perception, and the power of reason—I have various kinds of information at my disposal. No doubt I have this information because of activity in my brain, but it doesn’t follow that my brain also has such information, still less microscopic bits of it. Why do we say that telephone lines convey information? Not because they are intrinsically informational, but because conscious subjects are at either end of them, exchanging information in the ordinary sense. Without the conscious subjects and their informational states, wires and neurons would not warrant being described in informational terms.

The mistake is to suppose that wires and neurons are homunculi that somehow mimic human subjects in their information-processing powers; instead they are simply the causal background to genuinely informational transactions. The brain considered in itself, independently of the mind, does not process information or send signals or receive messages, any more than the heart does; people do, and the brain is the underlying mechanism that enables them to do so. It is simply false to say that one neuron literally “sends a signal” to another; what it does is engage in certain chemical and electrical activities that are causally connected to genuine informational activities.

Contemporary brain science is thus rife with unwarranted homunculus talk, presented as if it were sober established science. We have discovered that nerve fibers transmit electricity. We have not, in the same way, discovered that they transmit information. We have simply postulated this conclusion by falsely modeling neurons on persons. To put the point a little more formally: states of neurons do not have propositional content in the way states of mind have propositional content. The belief that London is rainy intrinsically and literally contains the propositional content that London is rainy, but no state of neurons contains that content in that way—as opposed to metaphorically or derivatively (this kind of point has been forcibly urged by John Searle for a long time).

And there is theoretical danger in such loose talk, because it fosters the illusion that we understand how the brain can give rise to the mind. One of the central attributes of mind is information (propositional content) and there is a difficult question about how informational states can come to exist in physical organisms. We are deluded if we think we can make progress on this question by attributing informational states to the brain. To be sure, if the brain were to process information, in the full-blooded sense, then it would be apt for producing states like belief; but it is simply not literally true that it processes information. We are accordingly left wondering how electrochemical activity can give rise to genuine informational states like knowledge, memory, and perception. As so often, surreptitious homunculus talk generates an illusion of theoretical understanding.*

Returning to Ray Kurzweil, I must applaud his chapter on consciousness and free will—for its existence, if not for its content. He is at least aware that these are difficult philosophical and scientific problems; he commendably refrains from offering facile “solutions” of the kind beloved by the brain-enamored. But the chapter sits ill with the earlier parts of the book, in which we are confidently assured that the author has a grand theory of the mind, in the form of the PRTM. For consciousness and free will are surely central aspects of the human mind and yet Kurzweil makes no claim (wisely) that they can be reductively explained by means of his 300 million “pattern recognizers” (which don’t, as I have noted, really recognize anything).

To create a mind one needs at a minimum to create consciousness, but Kurzweil doesn’t even attempt to describe a way for doing that. He is content simply to record his conviction (he calls it a “leap of faith”) that if a machine can pass the Turing test we can declare it to be conscious—that is, if it talks like a conscious being it must be a conscious being. But this is not to provide any theory of themechanism of consciousness—of what it is in the brain that enables an organism to be conscious. Clearly, unconscious processes of so-called “pattern recognition” in the neocortex will not suffice for consciousness, being precisely unconscious. All we really get in this chapter is a ramble over very familiar terrain, with nothing added to what currently exists. Worse, there are some quite execrable remarks about the philosophy of Wittgenstein, which demonstrate zero understanding of his philosophy during the periods of the Tractatus-Logico Philosophicus and thePhilosophical Investigations. Kurzweil asks:
What is it that the later Wittgenstein thought was worth thinking and talking about? It was issues such as beauty and love, which he recognized exist imperfectly in the minds of men.
So what are we to make of all the discussion of language and meaning in the Investigations? Kurzweil is way out of his depth here.

The computer engineer gets back to his main field of competence in the penultimate chapter, which restates his earlier published views about the future of information technology. His “futurist” thesis is that computing power doubles every year—information technology improves exponentially, not linearly (he calls this the Law of Accelerating Returns). He boasts that this prediction has been borne out every year since 1890 (the year of the first automated US census), and there does seem to be an empirical basis for it. But is it a law of nature and if so of what kind? What exactly is the reason for it? Technology does not in general improve exponentially, so what is it about information technology that makes this putative law hold? Is it somehow inherent in information itself? That seems hard to understand. Perhaps it is just the way things have contingently been so far, so that the rate of growth may slow down at any minute.

Kurzweil acknowledges that there are physical limits on the “law,” imposed by the structure of the atom and its possible states; it is not that computing power will double every year for all eternity! So the “law” doesn’t seem much like other scientific laws, such as the law of gravity or even the law of supply and demand. What seems to me worth noting is that the growth of information technology does not depend on the nature of the material substrate in which information exists (such as silicon chips), because new substrates keep being invented. Once the information capacity of one medium has been exhausted, engineers come up with a new medium, with even more potential states and yet more tightly packed. But then the “law” depends on a prediction about human ingenuity—that we will keep inventing ever more powerful physical systems for computation.

It is therefore ultimately a psychological law: to the effect that human creativity in the field of information technology improves exponentially. And that doesn’t look like a natural law at all, but just a fortunate historical fact about the twentieth century. Thus Kurzweil’s “law” is more likely to be fortuitous than genuinely law-like: there is no necessity that information technology improves exponentially over (all?) time. It is just an accidental, though interesting, historical fact, not written into the basic workings of the cosmos. As philosophers say, the generalization lacks nomological necessity.

Here then is my overall assessment of this book: interesting in places, fairly readable, moderately informative, but wildly overstated.

*****
Not all neuroscience employs homuncular language. Many neuroscientists limit themselves to descriptions of electrical and chemical activity in the brain. The recent announcement by the Obama administration of an ambitious project to map the human brain seems commendably free of homunculus mythology. The same can be said for a recent article in the journal Neuron by six scientists recommending such a project. See A. Paul Alivisatos et al., “The Brain Activity Map Project and the Challenge of Functional Connectomics,” Neuron, Vol. 74 (June 21, 2012).