Saturday, 8 April 2017

Integrated Information Theory: Is Consciousness Structured? (3)

Giulio Tononi

I first came across references to “structure” (within an analysis of consciousness) in a work by David Chalmers. In his 'Facing Up to the Hard Problem of Consciousness' (1995), Chalmers writes, for example, that “we can use facts about neural processing of visual information to indirectly explain the structure of colour space”. (Note the word “indirectly”, which, from what follows in this piece, proves to be important.) He then says that “the structure of experience will also be explained” (634). Nonetheless, Chalmers also says:

There are properties of experience, such as the intrinsic nature of a sensation of red, that cannot be fully captured in a structural description” (633).

Prima facie, it seems odd to say, as Giulio Tononi and Chalmers do, that “[c]onsciousness is structured”. It intuitively seems like a Rylean “category mistake”. That is, didn't William James and Wilfrid Sellars (as well as others) say that consciousness is “grainless”? (James also referred to the “stream of consciousness”, which is a related idea.)

In simple terms, Giulio Tononi tells us that “consciousness has composition”. That means that consciousness (or a particular experience) is composed of different things. What things? Tononi says that these things include “color and shape”. These components “structure visual experience”. Indeed it's this structure which “allows for [the] various distinctions” we'll make later in this piece.

What is an Experience or Mental State?

Does Tononi try to make things a little too neat and tidy; especially since he's putatively attempting to be doing a (new) kind of phenomenology; even if that phenomenology is (eventually?) anchored to neuroscience

What is a single experience anyway? Is there such a thing? (The same goes for a single mental state.) If it's difficult to think in terms of a single experience, then Tononi's “axioms” of each experience are, by definition, problematic. Can we say, as Tononi does, that “each experience is irreducible to non-interdependent, disjoint subsets of phenomenal distinctions”? Do we have this “integration”, as Tononi calls it?

Similarly, what is “a whole visual scene”? Where are its boundaries? Does it have boundaries? Why should it have boundaries? Tononi justifies his belief in an integrated single experience (or “visual scene”) when he says that he experiences “not the left side of the visual field independent of the right side (and vice versa)”. It's difficult to understand what that means. Why can't one experience the left side of a visual scene and then the right side of that visual scene? If such a visual scene is defined as including both a left side and a right side then, by definition, that experience (or scene) must include both sides. Wouldn't this be a question of definition and not one of phenomenology? The scene may have both a left and a right side; though why must the experience (or visual scene) be the same as the description of that scene? In more detail, a table has a right side and a left side; though must the experience itself (of that table) also include a left and a right side?

This may all depend on how cognitively enriched an experience is taken to be. On a Kantian reading, experiences are cognitively enriched with concepts/categories and cognitive activity. They're more than mere “sense impressions”, “sense-data” or “sensory information” (depending on the jargon one chooses). Strictly, one applies the concept [table] to a table. In that sense, perhaps one also applies [table legs], [table top], etc. to a table. Either way, that experience is cognitively enriched.

An Experience of a Blue Book

Tononi says that “each experience is composed of multiple phenomenological distinctions, elementary or higher-order”. What does that mean? Tononi writes:

For example, within one experience I may distinguish a book, a blue color, a blue book, the left side, a blue book on the left, and so on.”

This is tricky. What exactly do we do when we “distinguish a book, a blue color, a blue book, the left side, a blue book on the left”? Distinguishing x from y (or even x in itself) is surely a cognitive act. (An act of mental will, as it were.) Do we make these discrete distinctions in experience (or in every experience)? Do we distinguish at all?

We have an experience of a blue book “which is on the left”. However, that's not the same as saying that these elements are cognitively distinguished as being separate from one another. In a sense we have a solid and grainless experience of a blue book, which is indeed on the left. We don't (necessarily) distinguish the blueness of the book and it's being on the left side. We could do so. However, a pure or simple experience of a blue book on the left side doesn't demand or require any cognitive act of distinguishing x from y or a blue book from its surroundings.

Tononi makes a similarly case – one of a specific experience (or visual scene) not being capable of being reduced to its individual components – when he talks about “seeing a blue book”. This too is “irreducible” to “seeing a book without the color blue, plus the color blue without the book”. At first this is difficult to decipher and a little strange. John Horgan expresses this position when he says that “[e]xclusion [Tononi's technical term] helps explain why we don’t experience consciousness as a jumble of mini-sensations” [2015].

Sure, when we experience a blue book, we don't – cognitively! - separate the blueness of the book from the book itself. The blue book is, therefore, a single package; or, in Tononi's word, “irreducible”. What must we conclude from this? We can cognitively distinguish the book's blueness from the book itself. (We can also distinguish the front cover from the book itself.) Nonetheless, Tononi is saying that the phenomenological experience (or visual scene) isn't like that. Thus even though Kantian experience (or perception) can be – or is – cognitively enriched, that's not the same as saying that the book's blueness is distinguished from the book itself in a (Kantian) experience or perception of a blue book. That distinction can be made, of course, though it's not part of the experience of a blue book itself. The distinction, if it's made, will come later (if it follows at all).

Despite this seeming agreement with Tononi, what must we conclude from all this? Specifically, what is the blue-book experience's (with its axioms) relation to its “physical postulates”? How does the purity and grainlessness of that experience take us to Tononi's physical postulates?

An Experience of a Blue Book in a Bookcase

Prima facie, Tononi seems to be making the same points about what he calls “exclusion” as he made earlier about another technical term of his - “integration”. This time, instead of blueness and a book making a single package, he now says that when we experience a bookcase which has a blue book within it, we don't make an experiential distinction between that bookcase and that blue book.

Tononi also emphasises the “distinction blue/not blue”. More precisely, in this experience of a bookcase (rather than a blue book), that experience is “one of which is a blue book, but I am not having an experience with less content—say, one lacking the phenomenal distinction blue/not blue, or colored/not colored”. This use of positives and their negations is puzzling. Tononi appears to be saying that part of this experience of a bookcase (with a blue book) includes “the phenomenal distinction blue/not blue, or colored/not colored”. That is, this experience doesn't “lack[]” that precise “phenomenal distinction”. Yet earlier it seemed that basic experience didn't have any phenomenal distinctions – they are grainless. Making distinctions between blue and not blue, and between coloured and not coloured, are surely acts of cognition; which were seemingly excluded when Tononi talked about “integration”.

It can of course be said that an experience which makes “the phenomenal distinction blue/not blue” isn't cognitive in nature. More precisely, that phenomenal distinction between blue and not blue isn't cognitive at all – it's “phenomenal” or experiential. I simply see or experience that the aforesaid book is blue, not not-blue. That may mean that the phenomenal reality is pure or non-cognitive; though the analysis of this experience (which includes a distinction between blue and not blue) is evidently impure – it's cognitive in nature. How could it not be? Tononi is breaking down the experience of a blue book in a bookcase into its constituents after the fact (as it were). This isn't done during the actual experience; only after.

An Experience of the Word 'Because'

There are other justifications of Tononi's position on “integration”.

He cites the example of “the experience of seeing the word 'BECAUSE' written in the middle of a blank page”. His phenomenological analysis of this (if it is phenomenological) is that this experience of the word 'BECAUSE' is “irreducible to an experience of seeing 'BE' on the left plus an experience of seeing 'CAUSE' on the right”. That may happen; though surely it's not definitive of an experience of the word 'BECAUSE' in the middle of a page. Though we don't ordinarily distinguish the 'BE' from the 'CAUSE'. Perhaps if we did, we'd also distinguish the 'B' from the 'E', the 'E' from the 'C' and so on.

Even if we don't distinguish the 'BE' from the 'CAUSE' – what is that fact meant to tell us? Unless it tells us something about right- and left-eye vision working together. That is, the left eye (or the right-side of the brain) distinguishes the grapheme 'BE', and the right eye (or the left-side of the brain) distinguishes the grapheme 'CAUSE' at one and the same time. Perhaps Tononi's analysis is proved to be true by the neuroscience or neurophysiology that's responsible for such grainlessness. But would that be an analysis of a phenomenological experience of the word 'BECAUSE'?

The Speed and Length of an Experience

The axiom of exclusion includes some pretty bizarre properties. Yes, they are properties which exclude other properties. Thus if “my experience flows at a particular speed”, then it can't flow at another speed. Tononi even cites a speed (or, at the least, a possible speed) when he says that “each experience encompassing say a hundred milliseconds or so”. Is Tononi mixing up (or fusing) speed and length here? For example, say that one experiences a bus moving at 40 miles-an-hour for two minutes. Here the speed and the length that speed is maintained are two different things; though, in this case, they are related to one another.

In any case, the axiom of exclusion tells us that this particular experience is not minutes or hours long. Though it seems clear that a particular experience can be minutes- or hours-long. (Such a Sting's 24-hour orgasm?)

How are these speeds measured? I doubt that they're measured phenomenologically, as it were. Thus do neuroscientists, psychologists or cognitive scientists measure them? If so, how do they do so? And if the neuroscientist (or psychologist/cognitive scientist) has to tell us the speed of and length of an experience, then surely these aren't phenomenological data. Yet Tononi (or IIT) is supposed to move from the phenomenology (or the axioms of consciousness) to the the physical postulates. Of course it may be the case that Tononi's IIT fuses phenomenological data with neuroscientific data at such points. Though even if that's the case, it can't be (strictly speaking) a journey from consciousness (at time t) to the physical (at time t1).

The Binding Problem

We've all heard of the “binding problem”.

Tononi claims (or does he?) that he moves from consciousness to the physical when dealing with the structure of consciousness. Thus in terms of structure, this concerns, for example, the fact that a “simple experience like viewing a cue ball unites different elements such as color, shape, and size”. (We can also call this “the unity of conscious experience”.) Thus “any theory of consciousness will need to make sense of how this happens”. True; though surely only neurophysiology can answer this question, not a phenomenological analysis of consciousness (or the experiencing of a cue ball).

How can the binding problem be solved in an a priori manner? This is surely the way a phenomenological analysis would need to proceed. Yet we're meant (in IIT) to move from the axioms of consciousness, and the structure of experience, to the physical postulates. It seems, however, that when it comes to the binding problem, we would need to move in the opposite direction – from neurophysiology to consciousness.

However, I say elsewhere (in my 'Integrated Information Theory: From Consciousness to the Brain') that the direction of the arrow may not matter that much – or at all. It may not matter if we move from consciousness to the physical or from the physical to consciousness. What matters is that both consciousness (specifically phenomenology) and the physical (or the brain) are included in the analysis. Though that would mean that we don't have a pure phenomenology here. Perhaps that doesn't matter either. Tononi, after all, doesn't claim to Edmund Husserl or even that he's a phenomenologist; just as he doesn't claim to be a Cartesian when he talks about the given nature of the axioms of consciousness. What he does say is that both phenomenological analysis and an acceptance of the Cartesian givens (i.e., axioms) – not only neuroscience - are important to any theory of consciousness. Some would say that this is evidently so!


1) Giulio Tononi's prose style doesn't help us here. It's highly technical and, well, a little lifeless. (At least in the pieces I've relied on.) He doesn't make much of an effort to simplify what it is he's saying. Perhaps that's not required of academic works.

He doesn't seem to offer arguments either. Instead, he makes statements. Sure, arguments have led to his statements; though where does that leave the layman? The same is true of Tononi when seen on video or giving a seminar. He makes lots of statements and does very little philosophy. Not only that: he seems a little too confident for his own good.

The superb science writer, John Horgan, also takes this position. Horgan says that “[o]ne challenge posed by IIT is obscurity”. Indeed, according to Horgan, Tononi “acknowledged that IIT takes a while to 'seep in'”. Thus he concludes that “[p]opular accounts usually leave me wondering what I’m missing”. That doesn't seem to be correctly articulated, however. That is, the academic prose on IIT is obscure; though the popular accounts “leave [us] wondering what [we're] missing”. That's not the same thing.


Horgan, John (2015) 'Can Integrated Information Theory Explain Consciousness?' (Scientific American).
Tononi, Giulio (2015) 'Integrated information theory'.

*) Next: 'Integrated Information Theory: Information' (4)

No comments:

Post a Comment