Forget Brain Age: Researchers Develop Software That Makes You Smarter

Index » 喫茶店 (Koohii Lounge)

  • 1
 
Reply #1 - 2010 March 25, 9:16 pm
ruiner Member
Registered: 2009-08-20 Posts: 751

I've repeatedly come across this 'dual n-back task' reference in my readings on current models of intelligence as they become more dynamic and plastic through studies and imaging of the brain, and this flows with my own ideas of how to improve the mind by taking how the brain works into account, building knowledge, and training working memory, so I find this interesting and I'm surprised I overlooked it till now--I think it's precisely because most of the IQ-oriented stuff is just so stagnant and pseudoscientific I ignore it... but: http://www.wired.com/science/discoverie … t_software

That 2008 piece is already dated when it talks about the future potential of the work, and since then research in various ways has continued, delving into how working memory training improves what some call 'crystallized' intelligence as well as 'fluid' (I don't like these distinctions or the use of the idea 'intelligence' but whatever, I rambled about that in 'cognitive abilities' thread), and there's a crop of dual n-back freeware out there that you might be interested in, if you haven't seen it already.

http://brainworkshop.sourceforge.net/
http://www.soakyourhead.com/
http://cognitivefun.net/test/5

Original paper: Improving fluid intelligence with training on working memory

Related:

Increasing fluid intelligence is possible after all
Of Mice and Memory: 'Working Memory' of Mice Can Be Improved
Students Who Believe Intelligence Can Be Developed Perform Better
Training can improve multitasking ability
Working Memory, but Not IQ, Predicts Subsequent Learning in Children with Learning Difficulties
Increased prefrontal and parietal activity after training of working memory
Working memory, fluid intelligence, and science learning
Can Intelligence Be Trained? Martin Buschkuehl shows how

Bonus: Enhanced Memory for Scenes Presented at Behaviorally Relevant Points in Time
First Direct Evidence of Neuroplastic Changes Following Brainwave Training
Human memory strength is predicted by theta-frequency phase-locking of single neurons

A more recent overview by the same authors: http://www.smw.ch/docs/PdfContent/smw-12852.pdf  - Apparently they mention the single n-back is effective as well ("Single N-back Is As Effective As Dual N-back")--not sure how that ties into multisensory integration or lackthereof. There are still criticisms by David E. Moody on some of their methods that I'm not satisfied has been addressed, so I look forward to all this continuing research on intelligence and plasticity. I expect current models of intelligence to be overhauled in the future, but I'm not sure how, except I think it will relate to the same processes at work with regards to theories of mind/global neuronal workspace theory/fame in the brain/dispensing with the dynamic unconscious... I'll take a wait and see approach. ;p

Last edited by ruiner (2010 March 26, 8:35 pm)

dbh2ppa Member
From: Costa Rica Registered: 2009-05-05 Posts: 120

does anyone have any first-hand anecdotal accounts of positive results with dual n-back training?

i ask because the training can get to be a pain, and without reference to it actually working, it's hard to keep up the motivation.

kendo99 Member
From: TN Registered: 2010-03-08 Posts: 182 Website

All the science supports it, as well as my own intuition about "intelligence", but you are right, 25 minutes or so a day is a good bit of time to devote to something you can't "feel" working right away, so I haven't gotten around to it yet...

Advertising (register and sign in to hide this)
JapanesePod101 Sponsor
 
kendo99 Member
From: TN Registered: 2010-03-08 Posts: 182 Website

@ruiner, what area of research/academia do you work in?  Or is this just your own interest?  My background is in Phil. of Mind with a heavy leaning towards a complex neuroscientific reductionism ala Patricia and Paul Churchland, Antonio Damasio, Mark Johnson, etc.  I've also done some graduate work in psychology but the program was too oriented towards therapy/counseling so I left it to go back into Philosophy.  I wish my undergraduate school had a stronger neuroscience faculty because I haven't had time to take much since leaving, and I'd like to have a deeper understanding at a level beneath/underlying the theoretical...  I totally get tensor network theory on the one hand, and don't get it at all on the other because I don't understand the smaller neuronal mechanisms, etc. undergirding it.

What I want to do is find a materialist explanation for certain Buddhist conceptions of the mind.  Owen Flannigan<sp?> at Duke has done some work in this area, as have a few others, unfortunately there are very few people with strong backgrounds in both areas, and too many people with a more materialist background view buddhist phil. of mind as some sort of idealism and/or monism and it is neither one.  It is more of a materialist phenomenology, with more in common with Husserl than Hegel... The exception being those damned Tibetans...those guys are whack (j/clowning).

Anyway, didn't mean to spam your thread, just curious and thought I'd share a little of my own background since I was asking about yours.

ruiner Member
Registered: 2009-08-20 Posts: 751

I'm just making stuff up as I go along. ;p

Most of my ideas about the 'mind' are shaped by Daniel Dennett and most recently by Stanislas Dehaene's hybridization, in my opinion, of Dennett's philosophy of mind with Baars' Global Workspace. This is what I usually link to nowadays: http://www.edge.org/3rd_culture/dehaene … index.html

Also: http://www.scholarpedia.org/article/Mul … afts_model (it's been updated by Dennett recently so it's not actually about multiple drafts any longer, but 'fame in the brain')...

I recently 'updated' my 'pet theories' with this stuff and used these to get up to date on the cognitive research:

Self-consciousness, self-agency, and schizophrenia - http://www.physics.wisc.edu/undergrads/ … cc2003.pdf
Towards a Cognitive Neuroscience of Consciousness: Basic Evidence and a Workspace Framework - http://srsc.ulb.ac.be/AI/papers/dehaene.pdf
Are we Explaining Consciousness Yet? - http://ase.tufts.edu/cogstud/papers/cognition.fin.htm
Neural Events and Perceptual Awareness - http://web.mit.edu/bcs/nklab/media/pdfs … tion01.pdf

Thomas Metzinger on 'self' I also find appealing (see also Jureidini and O'Brien's two papers on the dispensing with/last rites of the dynamic unconscious--if you missed the reference before you can also find them via the adelaide links via archive.org--I definitely recommend because they elucidate the notions of nonconscious/preconscious well, in my opinion, in removing the need for 'unconscious'). I've read Damasio (confused them recently w/ another Damasio, in fact, re: neural correlates of 'g') but I can't recall how much I agreed with them on the NCC stuff.

I'm also big on speculative realism, particularly Quentin Meillassoux.

Last edited by ruiner (2010 March 26, 6:13 am)

kendo99 Member
From: TN Registered: 2010-03-08 Posts: 182 Website

Dennett was Patricia Churchland's mentor early on as she turned her research towards "neurophilosophy" as she calls it, and still does a lot of her editing although they disagree on some things I couldn't put my finger on without digging up some old papers.  If you haven't, you should totally read the book "Neurophilosophy," it is actually pretty light on the neuroscience so easy for someone without an Ph.D in neuroscience to plow through but the philosophy is excellent.  She absolutely destroys all shreds of dualism, even stuff like Daniel Chalmers "property dualism."  There were really only two weak points in her entire arguement, and there it is really an issue of ambiguity of language causing the problem, not the logic or science.  It's a classic in the field, at least as important as "Consciousness Explained", although she needs to put out an updated book with the latest research (she has a textbook out now that includes this but it isn't really the same), and her work has actually inspired whole programs in "neurophilosophy" to open up, for instance at Georgia State, where I almost went but they couldn't provide enough funding.

I agree with a lot of Dennett's views but I think that sometimes he almost purposefully uses ambigious language to dance around important questions.  For instance, his theory on Free Will is probably pretty correct, but all the book left me with was an intuitive understanding of the theory and not a really concrete grasp on it.  Of course, this could be just a problem with my own understanding of what he's doing, or a personal failure to "get" his writing/arguement style.  I have that problem for sure with Continental Philosophers--Even though I love them, their writing style just doesn't click with me.  Give me William James any day.  Not to compare Dennett's much clearer, concise, analytically trained writing with someone like Derrida, but the principle is the same: I just don't quite feel like his arguements fully provide exposition to some of his views.

I think Damasio is pretty dead-on, Descartes Error was an impressive work, and I really like his take on the meaning of emotions, the role the body plays in the mind, etc.

I'll have to plow through some of those links next week when I have time, it looks like good stuff (research material wink ).

Reply #7 - 2010 March 26, 1:19 am
ruiner Member
Registered: 2009-08-20 Posts: 751

Neurophilosophy is what I'm interested in--or rather, I don't understand how anyone ever philosophized about the mind without basing their theories on neuroscience. Guess that was before my time. ;p In a sense I'm not too interested in neurophilosophy except insofar as it can facilitate better meta-models in cognitive neuroscience (and in general).

I believe I've also read of Damasio before in the context of Panksepp and affective neuroscience. That's something I want to read more on, to see how it fits my theories about emotions, so I can then mask my own ideas with better developed, evidence-based stuff from established thinkers. ^_^

Reply #8 - 2010 March 26, 1:43 am
kendo99 Member
From: TN Registered: 2010-03-08 Posts: 182 Website

Theory and Meta-theory are of course neccessary to provide direction and structure to research, otherwise you are just collecting a lot of data that tells us very little.  One thing that happens in the sciences, or neuroscience field at least, is that a researcher gets really good at a particular technique, and so long after they have gathered all the valuable/ground-breaking data they continue to do research on the same thing with infinite minor variations despite the fact that the data at that point has become pretty pointless.

On the other hand, theory and meta-theory not grounded in good science is just mental metaphysical masturbation.  There's definitely room for phenomenology, speculative psychology, etc but not when they try to exist in some sort of Whiteheadian vacuum, removed from the facts on the ground, so to speak.

Of course, Quine thought the entire language was a malleable network and all science/analytic knowledge was really just pragmatic metaphysics , and Quine is right to a large extent, and also he makes clear that he still thinks science is a better "model" than metaphysical speculations because it is self-correcting, and leads to results which can be beneficial to people.

It was only immediately after reading the Churchlands' works that I realized I'd been doing exactly that before, trying to get a grasp of something that is essentially a physical object, spinning my wheels with theories that had no basis in science, just my own phenomenological experience of them and logical arguements like Chalmers that make a good point but just don't hold up in the light of the sun.

Reply #9 - 2010 March 26, 2:20 am
ruiner Member
Registered: 2009-08-20 Posts: 751

Speaking of Kuhn and Popper and Feyerabend and Quine, et al...

You might find these fellows interesting, if you aren't familiar with them already:

http://en.wikipedia.org/wiki/Speculative_realism
http://speculativeheresy.wordpress.com/resources/
http://www.bogost.com/blog/speculative_ … ator.shtml

A very sexy and vibrant 'post-Continental' field, in my opinion, that relates to intersections of philosophy and science and is striking for its online theoretical developments. Meillassoux on 'correlationism' in After Finitude really impressed me, I was raving about it for a while after reading. I am hoping to see his other work translated from French to spare me the desire to postpone Japanese. Ray Brassier in particular seems influenced by Quine and Churchland. Unmentioned there seems to be Reza Negarestani's Cyclonopedia. Collapse (journal) is mentioned there--in Volume IV's essays on 'horror' they include a nonfictional excerpt from Thomas Ligotti's The Conspiracy Against The Human Race, who in turn had one of his fictive works (My Work is Not Yet Done) reviewed under the catchy rubric of 'Dark Buddhism'.

Speaking of Buddhism, there's a fascinating book called Buddhist Warfare, about militant elements of Buddhism. Lastly, Ronald Giere wrote a book called Scientific Perspectivism that goes into the idea of distributed cognition in some interesting ways that I think relates to 'speculative realism' and the like. (Also a related discourse in another thread related to Diamond's Guns, Germs, and Steel and stereotypical views of science in Japan.) But I digress. ^_-

Last edited by ruiner (2010 March 26, 2:26 am)

Reply #10 - 2010 March 26, 3:30 am
Smackle Member
Registered: 2008-01-16 Posts: 463

And this marks where kendo99 and nest0r fell in love at first sight.

Last edited by Smackle (2010 March 26, 3:39 am)

Reply #11 - 2010 March 26, 3:42 am
ruiner Member
Registered: 2009-08-20 Posts: 751

Smackle wrote:

And this marks where kendo99 and nest0r fell in love at first sight.

That's not what your boyfriend/girlfriend said.

Reply #12 - 2010 March 26, 5:03 am
kendo99 Member
From: TN Registered: 2010-03-08 Posts: 182 Website

I think I am in love... with Speculative Realism.  This isn't a field taught anywhere I've studied and I just hadn't bumped up against it before now but a quick perusal of those links pushed all the right buttons.

Rejection of Kantian "unknowable."  Influence by Hume, hardcore anti-nominalism, return to Aristotelian notions, Fichte, Schelling, Spinoza, Badiou, Churchland.  I was really surprised not to see Peirce's name in there...and Brassier's unrepentant nihilism, use of the internet to publish and make work more widely available, bloggers involved, rejection of Kantian "unknowable"...Rejection of Kantian "unknowable"...Sexy ass names for their positions like Transcendental Materialism and Transcendental Nihilism.  wow, how could I have not discovered this before?

I'm going to have to go to the library and dig up those copies of "Collapse"

Thank you!!!

Last edited by kendo99 (2010 March 26, 5:04 am)

Reply #13 - 2010 March 26, 1:01 pm
ruiner Member
Registered: 2009-08-20 Posts: 751

Haha, no problem? There's an essay juxtaposing Peirce and Sherlock Holmes over at--well there's a link to the general site it's at over at Speculative Heresy. "You Know My Method." Anyway, I thought it was funny, especially the trope of Sherlock Holmes being used as a device in philosophical/theory books and papers.

Last edited by ruiner (2010 March 26, 1:02 pm)

Reply #14 - 2010 March 26, 1:25 pm
Surreal Member
From: Sweden Registered: 2009-05-18 Posts: 325

!!! I leave it for posterity but you probably don't want to read it so skip this post !!!

Ruiner did mention Moody's criticism it but I believe it deserves some more explanation; it has the sensible title of "Can intelligence be increased by training on a task of working memory?" and if you can access these things - I did it through my uni login - it's available at
http://www.sciencedirect.com/science/ar … 053ef2a7f3

To sum it up; the evidence for the effects of dual n-back training is based on improved intelligence test performance, notably a test with tasks similar to the dual n-back task. Another experiment group that received the same training was tested on an other intelligence test, with tasks not quite as similar to the dual n-back task. This other group showed some improvement but not as much. Overall, this is what it comes down to: interpreters of the experiments have worked with the assumption that getting better at an intelligence test means that you have become more intelligent generally - and even worse, the assumption that just because you don't get that much better at some intelligence tests it doesn't mean you haven't generally boosted your intelligence. I mean, when you stop to think about it really makes you go huh. uh. huh?
The thing that really pissed Moody off is that the experimenters changed the conditions for taking the intelligence test without giving good reasons for doing so, citing not at all reliable sources.

What interests us the most though is if the dual n-back task actually improves overall fluid intelligence/aptitude/IQ whatever you want to call it.
After reading up a bit on it (as well as trying out the free software) and keeping Moody's criticism in mind:
The arguments for that the dual n-back task mostly just improves (some) intelligence test performance are much stronger than the ones for the task improving broad, daily usable and applicable intelligence.

In my opinion.


The main reason I looked this stuff up is I considered trying the software out for a period but I'm not gonna do that. I don't want to pour that much time into something that I suspect will be looked at as either
A) an interesting but ineffective method that sparked debate which eventually gave birth to real effective methods
or
B) An ineffective method with some pretty shaky evidence to back it up mostly given interest because "oh think of the possibilities!" and the media-friendly character of it all that eventually fizzled out.
some years from now

And after doing a couple sessions of dual n-back I have no doubt that I'd become incredibly bored very fast if I tried to do it daily. I mean if they put it in a Zelda game with special effects and stuff I'm gonna be like hells yeah and play it over and over but in the meantime naaah.I'll just let Brain Workshop lie around on my C: and play the game if I feel like it sometime.


(I know that I didn't describe the article very carefully but that's because I'm kinda new to reading big, grown-up science so I don't know how detailed I can legally be. If even just this is too much, please tell me so and I'll remove it.
What I can say though is that YEAH, I agree with Moody's criticism and I really really really hope that less people than I think are going to will entrust minutes of their daily lives to the results of some pretty shoddy research)


Edit: Excellent thank you for this change.
This is SUPER confusing I'm sure but I think not explaining it is better. Shortly, Ruiner is right and I'm wrong.

Edit2: I know this makes the post even more strange than it already is, but hell, I don't post here often so I might as well keep going.
Ruiner, if you see this, could you send me a mail/PM? Yours being private and all I haven't been able to contact you and the topic I want to discuss doesn't really fit on the forums.
I've been wanting to ask you on developing ideas on your own (and knowing when to let go of them), how to find the crucial 'thinking material', finding people to discuss ideas with and how to get them out there without being completely bogged down in formal systems. As I am just starting out on my higher education and am pretty young but with loads of concepts and ideas that I'm doing my best to grow, I really feel I need to get in touch with someone who knows about what to do with it all. Talking to teachers, peers and even my family I'm mostly met with skepticism and being misunderstood as someone who just wants to show how smart he is.
I do realize this is because I'm not good at communicating what I really mean with all this, man I barely even know what I mean myself.
Do you kind of get this? If not, or if you feel like it would be a waste of time, no worries. I'm sure I can find my way somehow. But I'd be very grateful if you could help me out on this; just a bundle of links to others who have useful things to say about it would be fine, too. (or if there's a site dedicated to this... stuff? there ought to be one)

Last edited by Surreal (2010 March 26, 5:40 pm)

Reply #15 - 2010 March 26, 1:41 pm
ruiner Member
Registered: 2009-08-20 Posts: 751

I also am concerned with this Moody person's arguments, but I find them very slight in comparison to the overall research we're seeing with regards to notions of fluid intelligence and working memory, neuroplasticity, etc. There's been other research into this type of training, I think it all establishes a compelling picture. I've never done this dual n-back task but I think it's on the right track. Did you read the other papers, or just the ones that made you feel better about not doing it? ;p It's been less than two years, so I'm hopeful.

More on Moody's paper w/ excerpts: http://groups.google.com/group/brain-tr … e00fe9bca9

In fact, the more closely I analyze Moody's refutation in those excerpts, the shoddier it seems to me. Wait, it's not an excerpt? That's it, his whole response? No wonder they didn't bother replying. He complains about their methods very shallowly and selectively. Are you kidding me? This is what I was concerned about? I take back what I said earlier, I'm not dissatisfied with their response to Moody at all. I'm surprised he was even mentioned anywhere. ;p

You could literally pick his flawed logic apart without even referring to the original paper.

After reading the original paper again after reading Moody's 'criticism', it doesn't just seem shallow and shoddy, but even deceitful in how it misrepresents the original paper's purposes and explanations. Tsk tsk.

Edit: I just went through it and wrote responses piece by piece as if engaged in a forum style quote-argument with Moody. That was fun.

[What Jaeggi et al. reported were modest increases in performance on a
test of fluid intelligence following several days of training on a
task of working memory. The reported increases in performance are not
in question here. But the manner in which the test was administered
severely undermines the authors' interpretation that their subjects'
intelligence itself was increased.]

"Not in question" except the 'modest' label vs. 'severely' as rhetorical devices apparently disagree... vs. repeated use of 'significant', a more statistical term, by the paper, w/ numbers. I also think 'intelligence' should always be put in quotes by everyone in this field who writes like it's a concrete thing.

[The subjects were divided into four groups, differing in the number of
days of training they received on the task of working memory. The
group that received the least training (8 days) was tested on Raven's
Advanced Progressive Matrices (Raven, 1990), a widely used and well-
established test of fluid intelligence. This group, however,
demonstrated negligible improvement between pre- and post-test
performance.]

Moody implies this is because of the test difference and says it's negligible--I thought the increase wasn't in question? They say it's statistically significant--they're measuring internal changes rather than waxing rhetorical... they also say: "... subsequent analysis of the gain scores (posttest minus pretest) as a function of training time (8, 12, 17, or 19 days) showed that transfer to fluid intelligence varied as a function of training time (F(3,30) = 9.25; P < 0.001; ηp2  = 0.48; Fig. 3b)... These analyses indicate that the gain in fluid intelligence was responsive to the dosage of training."

Doesn't it make sense that the least amount of training would have the least improvement? Have they determined the minimal time, is that even the purpose of the research at that point of the study? They did another paper where they say they replicated the results of this search but with both RAVEN and BOMAT. Keep in mind this version of BOMAT is already officially called the 'short version' and 'advanced'--the way they describe timing guidelines also gives the impression that time is based on general needs of students as a part of schedules and effort and the like, rather than some kind of scientific criteria for test validity.

[The other three groups were not tested using Raven's Matrices, but
rather on an alternative test of much more recent origin. The Bochumer
Matrices Test (BOMAT) (Hossiep, Turck, & Hasella, 1999) is similar to
Raven's in that it consists of visual analogies. In both tests, a
series of geometric and other figures is presented in a matrix format
and the subject is required to infer a pattern in order to predict the
next figure in the series. The authors provide no reason for switching
from Raven's to the BOMAT.]

I wouldn't call it 'switching'--they did one or the other from the beginning. I would presume that's because the BOMAT is more recent and is more difficult, and has parallel A/B versions rather than requiring odd and even #s? I don't see how it's important unless you're comparing the RAVEN people with BOMAT people as control/experimental groups, especially in light of the dose-responsive trend for 12+ days...

[The BOMAT differs from Raven's in some important respects, but is
similar in one crucial attribute: both tests are progressive in
nature, which means that test items are sequentially arranged in order
of increasing difficulty. A high score on the test, therefore, is
predicated on subjects' ability to solve the more difficult items.]

A high score in this study is as specified in the study. "More difficult" being relative. I imagine people who compare them would say those important respects relate to the superiority of the BOMAT and restandardization, perhaps related to the Flynn effect, but I'm not sure. They say the BOMAT is more difficult, so I'm sure, if they were focusing on comparing the 8 dayers vs. the rest in a control/experimental way, which they aren't, that the easiest BOMAT would be checked against the easiest staggered #s of the RAVEN. Which would be weird and if they were doing such a study I'm sure they'd use a better methodology.

[However, this progressive feature of the test was effectively
eliminated by the manner in which Jaeggi et al. adminstered it. The
BOMAT is a 29-item test which subjects are supposed to be allowed 45
min to complete. Remarkably, however, Jaeggi et al. reduced the
allotted time from 45 min to 10. The effect of this restriction was to
make it impossible for subjects to proceed to the more difficult items
on the test. The large majority of the subjects—regardless of the
number of days of training they received—answered less than 14 test
items correctly.]

Effectively eliminated how? I think the 45 was a guideline, the site mentioned 30 as well, but I don't know French/German/whatever the language for the site is so I couldn't make out what they meant. I'm not sure the tests' internal structure is time-dependent. I'm sure future studies will (and did, actually, see end of first comment) use both decreased/increased n-levels, # of days of training, test intervals, etc.--proportionately. Plenty of research to be done.

And they say: "To keep the pre- and posttest sessions short enough, we allowed limited time (10 min) to complete the task, and the number of correct solutions provided in that time served as the dependent variable."

Also: "Carpenter et al. (1) have proposed that the ability to abstract relations and to maintain a large set of possible goals in working memory accounts for individual differences in tasks such as the Raven's Advanced Progressive Matrices test, and therefore in Gf. This ability to maintain multiple goals in working memory seems especially crucial in speeded Gf tasks because one can speed performance by maintaining more goals in mind at once to foster selection among representations. Therefore, after training working memory, participants should be able to come up with more correct solutions within the given time limit of our speeded version of the Gf  task. "

[By virtue of the manner in which they administered the BOMAT, Jaeggi
et al. transformed it from a test of fluid intelligence into a speed
test of ability to solve the easier visual analogies.]

They did? How so? + Easier compard to what? The later questions aren't factored in that way. See above.

[The time restriction not only made it impossible for subjects to
proceed to the more difficult items, it also limited the opportunity
to learn about the test—and so improve performance—in the process of
taking it. This factor cannot be neglected because test performance
does improve with practice, as demonstrated by the control groups in
the Jaeggi study, whose improvement from pre- to post-test was about
half that of the experimental groups. The same learning process that
occurs from one administration of the test to the next may also
operate within a given administration of the test—provided subjects
are allowed sufficient time to complete it.]

Again, more difficult compared to what? Also, is Moody arguing that the restriction exemplifies how what's being tested isn't the test-taking ability? Good, that's something that's been noted by those critical of these intelligence tests before and what I think this study goes a long way towards overhauling, paradigmatically, and they explicitly take that into consideration: "To control for the impact of individual differences and gain in working memory capacity, a digit-span task (38), as well as a reading span task (39), was used in the pre- and postsession. However, the reading span task was not assessed in the 8-day group. "

Plus: "Examining the transfer task in terms of the processes involved, there is evidence that it shares some important features with the training task, which might help to explain the transfer from the training task to the Gf measures. First of all, it has been argued that the strong relationship between working memory and Gf primarily results from the involvement of attentional control being essential for both skills (22). By this account, one reason for having obtained transfer between working memory and measures of Gf is that our training procedure may have facilitated the ability to control attention. This ability would come about because the constant updating of memory representations with the presentation of each new stimulus requires the engagement of mechanisms to shift attention. Also, our training task discourages the development of simple task-specific strategies that can proceed in the absence of controlled allocation of attention. "

[Since the whole weight of their conclusion rests upon the validity of
their measure of fluid intelligence, one might assume the authors
would present a careful defense of the manner in which they
administered the BOMAT. Instead they do not even mention that subjects
are normally allowed 45 min to complete the test. Nor do they mention
that the test has 29 items, of which most of their subjects completed
less than half.]

They probably found it irrelevant. + See above. But hopefully we'll start seeing plenty more research now that the 'fixed' paradigm has been busted in yet another way.

[The authors' entire rationale for reducing the allotted time to 10 min
is confined to a footnote.]

Really, their entire rationale? Seems like they repeatedly explained it to me.

[That footnote reads as follows:

    Although this procedure differs from the standardized procedure,
there is evidence that this timed procedure has little influence on
relative standing in these tests, in that the correlation of speeded
and non-speeded versions is very high (r = 0.95; ref. 37).

The reference given in the footnote is to a 1988 study (Frearson &
Eysenck, 1986) that is not in fact designed to support the conclusion
stated by Jaeggi et al. The 1988 study merely contains a footnote of
its own, which refers in turn to unpublished research conducted forty
years earlier. That research involved Raven's matrices, not the BOMAT,
and entailed a reduction in time of at most 50%, not more than 75%, as
in the Jaeggi study.]

I'm pretty sure their reference to 'relative standing' and speeded vs. non-speeded was related to that area of research that compares mental chronometry and inspection time (terms used by sources in question) with the viability of measuring fluid intelligence and new notions of such processes. As stated above, they have their own purposes and if you're going to question the amount of time and progressive nature of the tests, I'm sure it's relevant in some way for testing other things, and the BOMAT people could explain why they have both 30 minutes and 45 minutes and progressive difficulty and how it relates to testing integrity overall.

[So instead of offering a reasoned defense of their procedure, Jaeggi
et al. provide merely a footnote which refers in turn to a footnote in
another study. The second footnote describes unpublished results,
evidently recalled by memory over a span of 40 years, involving a
different test and a much less severe reduction in time.]

Nitpicking over irrelevancies with rhetorical flourishes. See above. Also see other responses in that Google Groups thread, including Granstrom's later comments in mouse working memory thread on that Google Groups site.

[In this context it bears repeating that the group that was tested on
Raven's matrices (with presumably the same time restriction) showed
virtually no improvement in test performance, in spite of eight days'
training on working memory. Performance gains only appeared for the
groups administered the BOMAT. But the BOMAT differs in one important
respect from Raven's. Raven's matrices are presented in a 3 × 3
format, whereas the BOMAT consists of a 5 × 3 matrix configuration.]

"Virtually none" now, instead of "negligible"? They showed the least improvement--is it because--I mean "in spite of"--8 days is the minimum? Is the least group compared to the 12+ days groups in a versus equation? Given replications of their results and similar results with other tests, I'm thinking the latter rather than some nefarious plot or severe gaps in logic involving different types of testing. "Presumably" -- They clearly state the time restrictions were the same, no?

[With 15 visual figures to keep track of in each test item instead of
9, the BOMAT puts added emphasis on subjects' ability to hold details
of the figures in working memory, especially under the condition of a
severe time constraint. Therefore it is not surprising that extensive
training on a task of working memory would facilitate performance on
the early and easiest BOMAT test items—those that present less of a
challenge to fluid intelligence.]

Really, not surprising? They go into that whole contested area of how working memory and fluid intelligence relate, and explain in lengthy detail how the tasks relate to attentional control and the like, yes? That's a rich field of research, and there's at least two studies cited at Wikipedia on working memory that discuss irrelevant information and distractors, as well as new research at Science Daily and the like on focus and attention that's ever-present in RSS feeds around the world. I'm not sure what Moody's on about with regards to the 'easiest' and 'less of a challenge to fluid intelligence'--in relation to what? The measure is of transfer effects and gains in performance within the study. I'm assuming continuing research will take broader approaches. Right now I'm also surprised there hasn't been more criticism of this study--how many years before someone with vested interest in genetic, fixed IQ will try to debunk them more robustly, vs. the eager beaver software developers wanting to market an IQ boosting gimmick, subverting a good bit of research for their own purposes?

[This interpretation acquires added plausibility from the nature of one
of the two working-memory tasks administered to the experimental
groups. The authors maintain that those tasks were “entirely
different” from the test of fluid intelligence. One of the tasks
merits that description: it was a sequence of letters presented
auditorily through headphones.]

Yes, they say 'entirely different' in the introduction and explain as I previous quoted and this whole section of paragraphs such as this one: "Operationally, we believe that the gain in Gf emerges because of the inherent properties of the training task. The adaptive character of the training leads to continual engagement of executive processes while only minimally allowing the development of automatic processes and task-specific strategies. As such, it engages g-related processes (5, 17). Furthermore, the particular working memory task we used, the “dual n-back” task, engages multiple executive processes, including ones required to inhibit irrelevant items, ones required to monitor ongoing performance, ones required to manage two tasks simultaneously, and ones required to update representations in memory. In addition, it engages binding processes between the items (i.e., squares in spatial positions and consonants) and their temporal context (30, 31). " Or:

"However, our additional analyses show that there is more to transfer than mere improvement in working memory capacity in that the increase in Gf was not directly related to either preexisting individual differences in working memory capacity or to the gain in working memory capacity as measured by simple or complex spans, or even, by the specific training effect itself.

Therefore, it seems that the training-related gain on Gf goes beyond what sheer capacity measures even if working memory capacity is relevant to both classes of tasks. Of course, tasks that measure Gf are picking up other cognitive skills as well, and perhaps the training is having an effect on these skills even if measures of capacity are not sensitive to them. One example might be multiple-task management skills. Our dual n-back task requires the ability to manage two n-back tasks simultaneously, and it may be this skill that is common to tasks that measure Gf. Our measures of working memory capacity, by contrast, index capacity only for simpler working memory tasks that are not so demanding of multiple-task management skills. So, sheer working memory capacity alone may be an important component of measures of Gf, but beyond this capacity, there may be other skills not measured by simpler working memory tasks that are engaged by our training task and that train skills needed in measures of Gf."

[But the other working-memory task involved recall of the location of a
small square in one of several positions in a visual matrix pattern.
It represents in simplified form precisely the kind of detail required
to solve visual analogies. Rather than being “entirely different” from
the test items on the BOMAT, this task seems well-designed to
facilitate performance on that test.]

Not exactly. See above. I don't think inferences in visual analogies and recall of multiple components as in the dual n-back are all that similar. However, they've also found single n-back effective, see first comment. But yes, I do think we'll find that test-taking measures test-taking and where it doesn't, it involves trainable working memory type skills. Physical capacity limits of the brain as influenced by environment and heritability have little variation between individuals compared to that, from what I've seen, and I think by the time we reach and can isolate and measure those capacities in real time in relation to countless other variables that practically influence intra-individual variation, we'll be well beyond rhetoric and notions of 'fixed' anything.

Personally I'm more interested in the idea of applying multitasking exercises to what individuals actually intend to study/do in life, re: multimodal integration.

Last edited by ruiner (2010 March 26, 7:35 pm)

Reply #16 - 2010 March 27, 2:20 pm
ruiner Member
Registered: 2009-08-20 Posts: 751

I've been using Brain Workshop in Jaeggi Mode (simulates the original all the way down to appearance). It's hard but fun once you get into it. Rather addictive. The anecdotal results I'm seeing online about improved 'IQ' and the ability to master complex physics quickly is quite amusing, however. Likewise the various companies implementing the freely available dual n-back tasks into their otherwise useless for-pay software, then posting about how their work is backed by Real Research™! and misrepresenting it.

At any rate, I do think there's something to it--it ties into the stuff about extractive listening, introducing interference into phonological loop, developing chunking strategies and retrieval structures, etc., that I've been talking about for multimodal use in Anki, based on other literature on working memory. The choice to consciously use such strategies while n-backing seems to be variant amongst testers, according to Jaeggi, vs. an intuitive flow, but I imagine to an extent it becomes automatic/required at higher levels. I think going intuitive first then allowing the tactical nature develop is perhaps better, to get one used to thinking of it less as a competitive game to score points and more of a 'process'.

It's odd, did you know that until Jaeggi, et al., recommended this 'dual' n-back task (it had been around in single form since the 50s apparently), based on recent research (this facinating overview is from Sternberg, first link in Related section, "... After All"--definitely read if you've read the original paper), they hadn't actually tried the whole multisensory interference stuff as a task-neutral training strategy? It seems like the perfect setup to me, but I guess we have the benefit now of all these recent studies so it's easy to criticize.

At any rate, if you see that followup by Jaeggi and co. at the bottom of the first link which also notes related studies--though until the bulk of it stretches past them and that Cogmed fellow I'll remain skeptical--you'll note that they replicated their results, aiming again for robustness in testing with both RAVEN and BOMAT, and using single n-back somehow, but it doesn't seem the paper's available online yet. The overview is still worth reading, because you can see how sober their aims and future goals are versus the hype that probably leads to unfair criticism. Those sorts of studies, especially as they want to test out long-term findings, must take months to set up, execute, and then longer to publish... the single thing could be related to the fluidity of possible components of working memory.

I know I've mentioned elsewhere some bits about sensorimotor operations as part of linguistic rehearsal loops, so I wonder what other modifications could work beyond dual n-back with visual/audio... that triple n-back mode in Brain Workshop isn't impressive, it's just adding more visual or colours or something. Suppose haptic modification would be required otherwise.

Anyway, I'll probably tinker around with this on and off for a few months, see how it blends into language-learning. Now that I think about possible mods, the more I think they might be unnecessary, except to switch the letter audio to kana (especially when letters intersect with input keys, so perhaps I'll just change those)... it's already so similar to listening/reading exercises I mentioned wanting to incorporate elsewhere, but more abstract.

Also, I was just reading a Wikipedia article on n-back that claimed the control groups used one test and experimental another, just the incorrect implied criticism I snarkily slammed Moody for (apologies if you're egosurfing yourself and read this, dude, don't come bash me with your math doctorate ;p) above (I think Sternberg covered all the critical bases), as both control and experimental from the 8-day task only used it, and the others used BOMAT and still the differences in gain and transferability were clear.

Bwahaha, oh yes, the next steps will be to remove notions of 'g' as anything but a spurious mathematical construct entirely, replacing with useful conceptions of multivalent dynamic conscious processes operating in conjunction with physiological capacity limits and memory storage components to create the global neuronal workspace, neural correlates smeared and identifiable in countless areas as they're used, identified in retrospect as this cognition doesn't occur in a separate space after a transition, but is merely constantly recognized and integrated, information parsed in a dorsolateral prefrontal meta-hub and similar evolutionarily significant areas in addition to recyclage of primordial areas and cortical columns... or something. Ran out of jargon to repeat. ;p Edit: Ooh, was just reading about research into quantifying individual differences and combining neural/non-heridity-centric genetic assays with training/brain plasticity in doing so, also incorporating energy usage and emotions--that's what I'm talking about... a great hypothetical paradigm...

/ruiner's last post

Last edited by ruiner (2010 March 27, 3:31 pm)

Reply #17 - 2010 March 28, 11:33 pm
nest0r Member
Registered: 2007-10-19 Posts: 5236 Website

Here's more information describing the replication of previous results, this time testing each group on both Raven's and BOMAT, and which also investigates the effectiveness of single n-back rather than dual--that is, one modality (visuospatial) rather than both visuospatial and audio--it's just as effective, apparently.

http://brain-training.googlegroups.com/ … DZpFtcP-AU - Improving Fluid Intelligence – Single N-back Is As Effective As Dual N-back - This means that dual w/ audio isn't required (but I think colour could still play a part if one wanted to try dual modalities purely visuospatially)... And: "Our results open a wider range of application for our training approach in that the single n-back task can be used for participant groups who would find the dual n-back task quite taxing. Furthermore, it makes the investigation of the processes in training and transfer more accessible because the processes engaged by the single n-back task are better understood than the ones in dual n-back tasks."

Also, if the 'reasons for selecting a single task' are any indication, this is twice that they've replicated their results on the effects of n-backing on measurements of fluid intelligence. The second paper exploring single n-backing in detail is still under review, however.

Personally I don't even care about the intelligence stuff, I'm only interested in applicable exercises for training multimodal working memory and multitasking, so I'm happy. But I didn't like the audio-dependent aspect, seemed weird to me, especially as I view those elements of working memory to be relatively fluid, so I'm glad to see multimodality isn't required for the underlying processes as they translate to what's measured by progressive matrices.

I would like to see the results of a study with audio-only single n-back, though.

Oh, and this book seems cool: The Overflowing Brain

Last edited by nest0r (2010 March 28, 11:48 pm)

Reply #18 - 2010 March 28, 11:49 pm
Asriel Member
From: 東京 Registered: 2008-02-26 Posts: 1343

Sorry, but could someone tl;dr this for me?
What 'games' should I be playing to improve my intelligence?
And do/can they work?

Reply #19 - 2010 March 28, 11:56 pm
nest0r Member
Registered: 2007-10-19 Posts: 5236 Website

Yes, someone read the first paragraph for Asriel so they can get to the Wired link. And the second paragraph to get to the freeware links. (It would be impossible to click them without reading one and two whole paragraphs, respectively. ;p)

Reply #20 - 2010 March 29, 12:08 am
Smackle Member
Registered: 2008-01-16 Posts: 463

The links are too long for asriel to click on.

Reply #21 - 2010 March 29, 12:08 am
Asriel Member
From: 東京 Registered: 2008-02-26 Posts: 1343

Yes, I know, I have been using Brain Workshop for a few weeks now

I'm just wondering what you guys have been talking about for these lengthy 17 replies

Reply #22 - 2010 March 29, 12:37 am
nest0r Member
Registered: 2007-10-19 Posts: 5236 Website

@Smackle - hehe

@Asriel - What do you think of Brain Workshop? Do you use Jaeggi mode? Made any modifications? In general or in terms of effects on Japanese study...

Because my main interest is how to combine this with my ideas for multimodal language learning. As in, I was trying to think of ways of doing exercises with software to practice listening/reading with other methods, like dynamically introducing interference and reinforcement while focusing on parsing and retaining information (I can link to comments where I explain my reasoning and references, but tl dr), and I think n-back provides a great model! That is, the dual/adaptive components introduced by Jaeggi, et al. in 2003. And especially this open source software like Brain Workshop seems like a good start for modifying stuff and seeing how it might work...

At the same time I think I might not get too extensive in terms of linguistic content and might just stick with the 'neutral' (i.e. just simple geometries and sounds) elements. That whole culture-neutral/task-specific thing to test transferability for intelligence measurements could be kind of the same principle as aiming for the most robust and concise targets in output cards, when I apply it to particular language training. But I digress.

Last edited by nest0r (2010 March 29, 12:48 am)

Reply #23 - 2010 March 29, 2:38 am
kendo99 Member
From: TN Registered: 2010-03-08 Posts: 182 Website

ruiner wrote:

Bwahaha, oh yes, the next steps will be to remove notions of 'g' as anything but a spurious mathematical construct entirely, replacing with useful conceptions of multivalent dynamic conscious processes operating in conjunction with physiological capacity limits and memory storage components to create the global neuronal workspace, neural correlates smeared and identifiable in countless areas as they're used, identified in retrospect as this cognition doesn't occur in a separate space after a transition, but is merely constantly recognized and integrated, information parsed in a dorsolateral prefrontal meta-hub and similar evolutionarily significant areas in addition to recyclage of primordial areas and cortical columns... or something. Ran out of jargon to repeat. ;p

I think the whole notion of "mind" as some single entity is flawed.  It's just a collection of semiotic activity playing out physically and "consciousness" is simply the interpretant of those processes, where semiotic activity resulting from neural stimulation through the senses can play out through its influence on the physical systems at work in the brain.  Hell, the split brain experiments and research demonstrate that we have at least "two consciousnesses" at work at any given time.  My guess is that its actually fractured into much smaller components than two, but there isn't currently a way to record that because our technological capabilities for recording from multiple neurons is not yet powerful enough to pull it off.  In a way, one could think of each "moment" of consciousness--either thought or perception--as a seperate instance of "mind".  In other words, we will never have a working model of consciousness as long as we are looking for "consciousness" because its a fiction--perhaps useful at time but ultimately bullshit.

Last edited by kendo99 (2010 March 29, 2:39 am)

Reply #24 - 2010 March 29, 3:13 am
nest0r Member
Registered: 2007-10-19 Posts: 5236 Website

Just an update, I recommended these two papers earlier, by Jureidini and O'Brien, because I think they're a great application of Dennett/Dehaene/etc. style concepts of consciousness to delineate why popular conceptions of consciousness/unconsciousness don't really work in light of actual empirical evidence. I don't know if they'd convince others or you if you differ in your conceptions, but they're interesting and relatively clear and concise. They pair up well with 'fame in the brain'/'global neuronal workspace'...

Anyway, they're available through that site that I didn't mention because that site is 'bad' but a link to which can be found in one of the first links at that Speculative Heresy link, as well as archive.org's Wayback Machine, but it's a pain to search and download from there, so: The first is http://www.mediafire.com/?mccw1oljzy3 and they follow up with http://www.mediafire.com/?ydlxgjliljd ...

Last edited by nest0r (2010 March 29, 3:15 am)

Reply #25 - 2010 March 29, 5:34 am
Asriel Member
From: 東京 Registered: 2008-02-26 Posts: 1343

nest0r wrote:

@Asriel - What do you think of Brain Workshop? Do you use Jaeggi mode? Made any modifications? In general or in terms of effects on Japanese study...

...lots of other stuff...

What do I think of it? It's a good distraction for a few minutes in between something or other...Difficult, and yet fun. I've just been using it in the Default mode, which isn't Jaeggi, from what I understand. No modifications, just going with the flow. That's kind of what I was interested in -- what kind of modifications, etc, make it more beneficial than just "out of the box."

I haven't read this whole post, but I read what you wrote, and I, too, am interested in what might become of your whole multi-modal language learning. I haven't studied anything about it, but I see you pop in and out about new ideas about this and that.
I would love to read a simple summary, which I am going to search for after I post this.
If you get to a stage where I could be of assistance (software development, testing, whatever), I would love to be involved...just without all the lengthy reading, research, and resources.

  • 1