.


For your daily dose of debunking, from Steve Milloy,
visit the Junk Science Home Page.


What is Junk Science?


Special rules for this forum.

  Debunkers
  Philosophy
  Pathology of True Believers

Post New Topic  Post A Reply
profile | register | preferences | faq | search

next newest topic | next oldest topic
Author Topic:   Pathology of True Believers
DaveL
Moderator
posted 02-23-2006 12:54 PM     Click Here to See the Profile for DaveL     Edit/Delete Message   Reply w/Quote
In one of the quackery threads in Mixed Nuts, llamas observes:
quote:
If you can accept and repeat an untruth like that - without questioning it, without checking it - then anything you say must be suspect, because you'll believe anything.
Gullibility seems to be a very common characteristic of the junk science True Believers. I'm curious, though, as to why the gullibility is a one-way ratchet. Why do TB's credulously accept the pronouncements from self-proclaimed expert A, but not from experts B, C, D, etc.?

In our current example,Lysimachus believes the pronouncements of this Dr. Said person, to the exclusion of other, reputable physicians. (I'm deliberately assuming that Lysimachus falls into the category of "ignorant dupe" rather than "insidious shill". The jury is still out on that issue.) Another example from a few years ago was Isabelle, who believed she had fungus in the blood, because some homoeopath had shown her dark-field micrographs that "proved" it, despite the fact that real doctors disagreed.

So why do the gullible believe hacks and quacks, but don't believe real physicians and scientists? I can think of a couple of reasons, but would be interested in hearing others' opinions.

1. Hucksters have a better sales-pitch. (Makes them of the same caliber as cult leaders).
2. Frustration with conventional science / medicine.
3. There are gullibles on our side of the fence; we just don't se them because they blend into the crowd.

IP: Logged

KGB
Moderator
posted 02-23-2006 01:16 PM     Click Here to See the Profile for KGB     Edit/Delete Message   Reply w/Quote
I think all three contribute.

The first is telling. Most doctors have treated enough really sick people, and seen enough of them die, to understand their own limitations. Furthermore, informed consent laws compel the doctor to outline all the ways his treatment recommendations might go wrong.

The people treated by naturopaths are, by and large, not very sick, except in their minds. Few die. Furthermore, there seems to be no enforceable requirement of informed consent for naturopathic "therapy." (How could there be?) Add to this the fact that, if the naturopath wasn't better at making sales pitches than practicing medicine, he'd be practicing real medicine, and you have an important selection bias.

I once had a physician suggest I try a couple of the more plausible herbal medications for my prostatitis, on the grounds that scientific medicine didn't have much left to offer me. I find it almost impossible to picture a naturopath telline me that a condition I was presenting was serious enough to need a physician. (I can picture this from some chiropractors, which is why I consider chiropractic to be only 90% quackery.)

Sufficiently stupid people will mistake humility for incompetence.

Another factor is bonding. We tend to bond to the first good-looking thing that comes along. An attack on our idol is automatically treated with skepticism -- which is carefully fanned by the huckster.

IP: Logged

Ryan Atwater
Member
posted 02-23-2006 01:39 PM     Click Here to See the Profile for Ryan Atwater     Edit/Delete Message   Reply w/Quote
There is another factor whch probably holds true in the recent case in question, and that is the financial factor.

As can be seen from their web site, the "Envia Gold Stairway to Success" appears to be a basic pyramid scheme.

As such, someone involved would very much have a financial incentive to believe.

IP: Logged

setnahkt
Member
posted 02-23-2006 06:28 PM     Click Here to See the Profile for setnahkt     Edit/Delete Message   Reply w/Quote
I would add another one: investment.

I've heard this called the "Concorde fallacy"; once you've invested a lot in a project, it's very difficult to cut and run. I would note that it doesn't necessarily have to be a financial investment; I'm thinking of the Branch Davidians - once they surrendered all the other aspects of their lives to David Koresh, it was probably difficult not to surrender their wives as well.

IP: Logged

Chaon
Moderator
posted 02-23-2006 07:59 PM     Click Here to See the Profile for Chaon     Edit/Delete Message   Reply w/Quote
Does this 'Concorde Fallacy' also apply to projects like the invasion of middle-Eastern countries?

IP: Logged

KGB
Moderator
posted 02-23-2006 09:19 PM     Click Here to See the Profile for KGB     Edit/Delete Message   Reply w/Quote
quote:
Originally posted by Chaon:
Does this 'Concorde Fallacy' also apply to projects like the invasion of middle-Eastern countries?

Possibly, though with the not unimportant distinction that the Concorde isn't likely to chase you all the way back across the Atlantic.

IP: Logged

Greg F
Member
posted 02-23-2006 10:03 PM     Click Here to See the Profile for Greg F     Edit/Delete Message   Reply w/Quote
I have a sister that is a full blown quack follower. IMO, the belief in this stuff is partially driven by a desire to see oneself as more enlightened then the average person.

IP: Logged

entropy
Member
posted 02-23-2006 11:27 PM     Click Here to See the Profile for entropy     Edit/Delete Message   Reply w/Quote
Is this not a place to mention a favorite book from the the distant past. THE TRUE BELIEVER by Eric Hoffer? http://tinyurl.com/m87m5

IP: Logged

llamas
Member
posted 02-24-2006 06:47 AM     Click Here to See the Profile for llamas     Edit/Delete Message   Reply w/Quote
It's been said that 'you can't fool an honest man' and I think that's the jewel on which this issue turns. It seems to me that the pitches for this sort of MLM are very-finely-tuned on multiple levels, namely

- to find people who have a pre-disposition to doubt commonly-accepted scientific ways of finding out and knowing things and then presenting the pitch in terms which will appeal to them (the 'science doesn't have all the answers', try-it-and-see-for-yourself appraoch), and/or

- to find people who have a pre-disposition to accept without question commonly-accepted scientific ways of finding out and knowing things and then presenting the pitch in terms which will appeal to them (the pseudo-scientific approach), and/or

- to find people with just a little bit of larceny in their hearts. Just a tiny little bit.

It's been my observation that those who practise MLM are overwhelmingly lower-middle-class, white and socially-conservative. The socio-political aspects of the Amway leviathan have been well-documented, and Amway is about as lily-white as it gets. As a copper friend of mine says, you'd never get anyone from the criminal classes into Amway - they can see the worm in the apple a mile off.

Hitting the intersections of the target audiences described is no mean feat, and requires a pitch of a high order - even in the instant case, we can see the conflicts, where conventional medicine is trashed in one part of the pitch, and yet we are supposed to value the opinions of a conventional MD in another part of the pitch. The whole tale has to have just enough of each part in it to reach out to each target segment, without having so much of any one part as to alienate another target segment. It's actually quite a trick. That's why I mused about the connection to the skills of the carnival barker.

In some ways, the architecture of the Web page makes this easier - as one may see from a casual trip to the website in question here. Want the pseudoscience? Follow this link . . . and all of a sudden, the pages and the links concentrate on the pseudoscience. It's Dr this and University of That and Nobel prize winners all over. Want the all-natural approach? Follow this link . . . and all of a sudden, the medical doctors and the research fade into the background, and it's all about depleted soils and natural Solutomic biovailability and Different Ways of Knowing. Just want the money? Follow this link, and forget all about the product, because that's secondary - here's the chart that shows you how much you'll make.

It's Fascinating, and I am Fascinated. McKay wrote about this in 'Extraordinary Popular Delusions and the Madness of Crowds', 160 years ago, and this is obviously nothing new.

llater,

llamas

------------------
. . . a truly bad and evil man. So bad and evil that he's banned by Kim du Toit.

"All things are ready, if our minds be so."
King Henry V, Act 4, scene 3

"Let us labour, then, to think well, for such is the foundation of morality"
Pascal, "Pensees", sec. VI

IP: Logged

David Bell
Member
posted 02-24-2006 09:00 AM     Click Here to See the Profile for David Bell     Edit/Delete Message   Reply w/Quote
quote:
Originally posted by DaveL:
Gullibility seems to be a very common characteristic of the junk science True Believers. I'm curious, though, as to why the gullibility is a one-way ratchet. Why do TB's credulously accept the pronouncements from self-proclaimed expert A, but not from experts B, C, D, etc.?

I will note a common interest. I fear that an issue is that so much of modern life is covered by knowledge, where only experts know enough to make a sensible judgement. I am quite happy to note that my ignorance is virtually infinite; but not everyone is !

This manifests in court proceedings; where juries have to weigh up the evidence of different experts, I fear that they sometimes are not incisive on the expert evidence. Come what may, it is very easy to be swayed by people, rather than facts.

cheers
david

IP: Logged

nmcvaugh
New Member
posted 02-24-2006 09:18 AM     Click Here to See the Profile for nmcvaugh     Edit/Delete Message   Reply w/Quote
Hey all,

I'm new to the forum - a regular contributer here suggested I might have some insight into this area, so I set up an account. I'll comment in another post, but just wanted to introduce myself first.

I'm a doctoral student in educational psychology (learning and cognition focus) at UT Austin, with an interest in 'fundamentalism' and how people convince themselves that their viewpoints are correct, especially against competing explanations or contrary evidence. Anyhoo, I'll be posting more soon.

Nate

IP: Logged

llamas
Member
posted 02-24-2006 10:04 AM     Click Here to See the Profile for llamas     Edit/Delete Message   Reply w/Quote
quote:
Originally posted by nmcvaugh:
Hey all,

I'm new to the forum - a regular contributer here suggested I might have some insight into this area, so I set up an account. I'll comment in another post, but just wanted to introduce myself first.

I'm a doctoral student in educational psychology (learning and cognition focus) at UT Austin, with an interest in 'fundamentalism' and how people convince themselves that their viewpoints are correct, especially against competing explanations or contrary evidence. Anyhoo, I'll be posting more soon.

Nate


Nate - welcome to the Pleasuredome, we've been expecting you. Look forward to seeing what you have to say - this is a subject area which has exercised us greatly in the past, and if you have data, that would be wonderful.

llater,

llamas

------------------
. . . a truly bad and evil man. So bad and evil that he's banned by Kim du Toit.

"All things are ready, if our minds be so."
King Henry V, Act 4, scene 3

"Let us labour, then, to think well, for such is the foundation of morality"
Pascal, "Pensees", sec. VI

IP: Logged

barisax
Member
posted 02-24-2006 10:05 AM     Click Here to See the Profile for barisax     Edit/Delete Message   Reply w/Quote
Another factor, I think, is that it is hard for people to admit that they are wrong, or even to consider the possibility. Their pride prevents them from properly processing the information you give them, and they filter out anything contrary to their already formed opinion.

I see the 'concorde fallacy' all the time when money is involved. Here's how it works. You have a problem, so you decide to spend x dollars to solve it. If the problem still exists after x has been spent, you figure that an additional 0.2x might do the trick...you already spent x, so an additional 0.2x investment might make that initial investment payoff. This can go on and on because you don't want to admit that your whole series of decisions were wrong.

IP: Logged

setnahkt
Member
posted 02-24-2006 10:16 AM     Click Here to See the Profile for setnahkt     Edit/Delete Message   Reply w/Quote
Some True Believers are literally True Believers; a number of perpetual motion scams have been addressed to religious fundamentalists. The most famous one was Arnold Burke's "Jeremiah 33:3" pump, but I think Joseph Newman and Dennis Lee also used religious appeals in their sales pitches. It's interesting that pseudoscience appeals to conservatives usually focus on energy and power while appeals to liberals usually focus on health and wellness.

IP: Logged

nmcvaugh
New Member
posted 02-24-2006 10:49 AM     Click Here to See the Profile for nmcvaugh     Edit/Delete Message   Reply w/Quote
Okay, I'm trying to get the hang of citation conventions and formatting, so please be patient, and let me know if there's an easier or preferred method for formatting. :-)

DaveL:

quote:
Gullibility seems to be a very common characteristic of the junk science True Believers. I'm curious, though, as to why the gullibility is a one-way ratchet. Why do TB's credulously accept the pronouncements from self-proclaimed expert A, but not from experts B, C, D, etc.?

It's probably more informative to look at gullibility from a slightly different perspective. We all have expectations, ideas and 'narratives' that we use to explain the world. And when new information is encountered, we try to understand it using what we already know. In the case of gullibility that you're talking about, I suspect that you'll find that adopting positions of A as opposed to B, C or D has a lot to do with how closely A reinforces and supports existing beliefs.

It also helps to keep in mind that most people have no problem compartmentalizing (technical term) knowledge and believing things that literally contradict each other. In other words, A and B may disagree, but if different claims of A and B appeal to somebody, they have no problem in accepting both claims.

An example from Creationism provides a good example. Many Creationists view the second law of thermodynamics (or 2LOT) as showing that it's impossible for complexity to spontaneously emerge. At the same time, they point to the Miller-Urrey (sp?) experiment that produced amino acids as being wrong because it doesn't duplicate prebiotic conditions on earth. The interesting thing is that according to their understanding of 2LOT, Miller-Urrey shouldn't have produced amino acids in the first place. Yet this point is never considered, and conceptions of 2LOT and Miller-Urrey are maintained seperately and used for completely different purposes.

More soon, but I don't want to drone on too long without feedback.

Nate

IP: Logged

nmcvaugh
New Member
posted 02-24-2006 11:01 AM     Click Here to See the Profile for nmcvaugh     Edit/Delete Message   Reply w/Quote
setnahkt:

quote:
I've heard this called the "Concorde fallacy"; once you've invested a lot in a project, it's very difficult to cut and run. I would note that it doesn't necessarily have to be a financial investment;

Yep - any investment in building up a something is worth protecting, regardless of whether it's a physical artifact or a mental construct like a belief system. The critical item to consider is whether the risk of being wrong is significant or not. If it will 'cost' little to change beliefs if you don't have much resting on them, if you have a lot resting on them, then that cost is very high, and you'll need extraordinary circumstances before a change is considered.

An analogy from V. L. Ramachandran's Phantoms in the Brain considers a general who's getting ready to attack the enemy at 6:00 knowing from multiple scout reports that he has 600 tanks while the enemy only has 400. At 5:58, a scout comes in and tells the general that the enemy actually has 600 tanks. The general discounts this report and goes on with the battle as planned - too much is invested to change the strategy now, and the scout may be mistaken given the other reports that he's heard.

Now imagine that the scout instead reports that the enemy has nuclear weapons. At this point, the general may decide that the risk is too great to continue with his strategy.

Hope this isn't just restating the obvious.

Nate

IP: Logged

LaneH
Member
posted 02-24-2006 11:19 AM     Click Here to See the Profile for LaneH     Edit/Delete Message   Reply w/Quote
I'll exempt you from the three-posts-in-a-row = loon, rule. Oh, wait, you only got in two before I commented.

Good stuff.

------------------
lane h. can be reached at laneman@erols.com
"Never let your mind remain so open that your brain falls out."

IP: Logged

KGB
Moderator
posted 02-24-2006 11:23 AM     Click Here to See the Profile for KGB     Edit/Delete Message   Reply w/Quote
quote:
Originally posted by LaneH:

Good stuff.

Indeed. It has some of the flavor of the public choice theory of rational ignorance.

... Rational moonbattery? I feel a blog post coming on.

[This message has been edited by KGB (edited 02-24-2006).]

IP: Logged

10SNE1
Moderator
posted 02-24-2006 11:32 AM     Click Here to See the Profile for 10SNE1     Edit/Delete Message   Reply w/Quote
Thanks, Nate.

Hope to see much more from you in the NTDF. We can sorely use someone for whom this is a primary area of study.

-Jorian

IP: Logged

nmcvaugh
New Member
posted 02-24-2006 12:10 PM     Click Here to See the Profile for nmcvaugh     Edit/Delete Message   Reply w/Quote
Greg F

quote:
I have a sister that is a full blown quack follower. IMO, the belief in this stuff is partially driven by a desire to see oneself as more enlightened then the average person.

barisax

quote:
Another factor, I think, is that it is hard for people to admit that they are wrong, or even to consider the possibility. Their pride prevents them from properly processing the information you give them, and they filter out anything contrary to their already formed opinion.

And I think that both of you have hit one of the central issues - ego or self-concept. As I said, most of my interest is in religious fundamentalists, and there too the majority of beliefs seem to be devoted to nothing so much as assuring the person who holds them that they are Right and people who believe otherwise are Wrong. Being part of the select few who are blessed with The Truth has got to be a huge ego boost.

Unfortunately, the personality aspect is also something that I know the least about. Psychology tends to view the clinical and personality specializations as slightly refined voodoo, and Freud certainly has a lot to do with that reputation. I understand that personality theory may be shedding the Freudian vestiges in much the same way that psychology moved beyond behaviorism, but I'm profoundly ignorant of the current state of the art.

I will be taking some personality classes, but I just haven't had a chance to yet. So much reading, so little time...

Nate

IP: Logged

nmcvaugh
New Member
posted 02-24-2006 12:15 PM     Click Here to See the Profile for nmcvaugh     Edit/Delete Message   Reply w/Quote
And thanks all for the feedback. Hope I can provide some perspective and information you wouldn't have had. I feel like I've caught up and said what I wanted to, so I'll artfully ditch the three strikes rule and zip my lip until I get some feedback about the claims I've made. I'll check back throughout the day. I can never tell how busy it's going to be around here, so if I'm delayed on responding, it's nothing personal.

Oh, and I only have dial-up at home, so as a rule I don't post during weekends. This forum doesn't look like it will eat much bandwidth, so I may be a bit more active during weekends than I can be on the NYT forums. That said, happy Friday all!

Nate

IP: Logged

El Buggo
Member
posted 02-24-2006 12:37 PM     Click Here to See the Profile for El Buggo     Edit/Delete Message   Reply w/Quote
quote:
So why do the gullible believe hacks and quacks, but don't believe real physicians and scientists?

Perhaps it's because the hacks/quacks will give them time and attention that they desire even more strongly than a true solution to whatever ails them? Similarly, by promoting something outside the mainstream that they believe in, they may generate further attention than they would if they simply echo what conventional _____ is currently indicating?

In both instances they get the attention they are seeking. In the first it arises from someone cashing in on them, but that probably matters little. In the second the attention may be negative, witness the SBI discussions of yore, but it is attention nonetheless.

I dunno.

IP: Logged

llamas
Member
posted 02-24-2006 12:49 PM     Click Here to See the Profile for llamas     Edit/Delete Message   Reply w/Quote
Nate - this is good stuff. More, please.

llater,

llamas

------------------
. . . a truly bad and evil man. So bad and evil that he's banned by Kim du Toit.

"All things are ready, if our minds be so."
King Henry V, Act 4, scene 3

"Let us labour, then, to think well, for such is the foundation of morality"
Pascal, "Pensees", sec. VI

IP: Logged

Victor
Member
posted 02-25-2006 02:22 PM     Click Here to See the Profile for Victor     Edit/Delete Message   Reply w/Quote
quote:
Being part of the select few who are blessed with The Truth has got to be a huge ego boost.

This is not too different from the adolescent need to wear the "right" jeans, and go to the "right" places, and associate with the "right" people in order to be part of the inner circle.

Adults have the same need, but they have more variety in hierarchies with which they can associate. Most of these groups are benign, my parish choir for instance, but occasionally there is one that ends up harming its members or society at large.

By the way, I believe there was a Harvard psychologist named David McMillan who proposed a "need for affiliation" as a basic human drive. He also proposed a "need for achievement" and I saw a video on that in college. These proposals did not apparently go very far. I think that may have more to do with his being head of the Harvard Psychology Department when Timothy Leary was discovering LSD than any actual merit, howver.

[This message has been edited by Victor (edited 02-25-2006).]

IP: Logged

jessho
Member
posted 02-25-2006 05:00 PM     Click Here to See the Profile for jessho     Edit/Delete Message   Reply w/Quote
I sometimes wonder if "true' believers" are as helpless to their reactions as herds of cattle are to stampedes. Logic and careful examination are replaced by the blind urge to flee and survive. Maybe the human brain creates chemical triggers due to certain stimuli. These chemicals, even if they are released by the wrong perception of an external source, become permanent. What we perceive as irrational thought might be a slow, but just as purposeful, reaction to a threat.

IP: Logged

Victor
Member
posted 02-25-2006 07:02 PM     Click Here to See the Profile for Victor     Edit/Delete Message   Reply w/Quote
quote:
I sometimes wonder if "true' believers" are as helpless to their reactions as herds of cattle are to stampedes.

A famous experiment on this subject was done by Solomon Asch in the 1950's. See http://en.wikipedia.org/wiki/Asch_conformity_experiments. Asch found that most people have a strong need to conform to the beliefs of the group, even if they are obviously wrong.

[This message has been edited by Victor (edited 02-25-2006).]

IP: Logged

nmcvaugh
New Member
posted 02-25-2006 08:34 PM     Click Here to See the Profile for nmcvaugh     Edit/Delete Message   Reply w/Quote
Hey all,

A few more thoughts on the previous post about 'public choice theory' (as KGB suggested).

Note that some of the implications of this model should be noticed. If the 'cost' of switching ideas (or artifacts) is low or non-existant, there will be little resistance to making changes. In new learning, it's best to nip preconceptions in the bud before they begin to form the basis of other beliefs. Catching them early makes it 'cheaper' to change.

Conversely, if it becomes too 'expensive' to maintain an existing set of beliefs, then there's also a lessened resistance to making changes.

The problem seems to be in how we evaluate the costs of different options. I'm sure that there are probably some cross-disciplinary articles that have been done with economists. I'll see if I can find anything on this in the literature. Speaking of which...

Jessho:

quote:
Logic and careful examination are replaced by the blind urge to flee and survive.

There's some evidence that this stuff does go on at a neurological level, at least for personality 'defense' strategies ala Freud. Now I'm no fan of Freud's developmental schemes or personality theory, but I do like what he had to say about the types of defenses people use in place of rational arguments. Projection, denial, rationalization, confabulation etc are all real phenomena. I highly suggest a chapter of Ramachandran's Phantoms in the Brain for some enticing neurological hypotheses. I can post an excerpt I scanned in online if there's interest, though I'll only keep it up a short time because of copyright.

Victor

quote:
He also proposed a "need for achievement"

I vaguely recall McMillan from emotion & motivation. I think he still gets mentioned every now and then. Don't recall a thing about him though. :-)

Back to the books. Later ya'll.

IP: Logged

Victor
Member
posted 02-26-2006 10:03 AM     Click Here to See the Profile for Victor     Edit/Delete Message   Reply w/Quote
quote:
I vaguely recall McMillan from emotion & motivation. I think he still gets mentioned every now and then. Don't recall a thing about him though. :-)

I had actually not heard of him until fairly recently. The short video in college on the "need for achievement" did not mention him by name. I did recall the video a few years back when I was reading Simon Baron-Cohen's book, the Essential Difference. Baron-Cohen identifies two sets of skills, one he calls empathizing, the other systemizing. These align very neatly with the need for affiliation and the need for achievement and led me to do some research. That is how I found McMillan's name.

It is likely that this need for affiliation contributes to the cost a True Believer will have to pay if he renounces his belief. The True Believer's social network very ofter is composed mainly of other True Believers. By rejecting the belief, he risks his social group rejecting him.

IP: Logged

All times are ET (US)

next newest topic | next oldest topic

Administrative Options: Close Topic | Archive/Move | Delete Topic
Post New Topic  Post A Reply
Hop to:

Contact Us | The Debunkers

Personal Safety Notice: The discussions on this site may address activities which are inherently dangerous and other activities which could be dangerous if done improperly. Many opinions may be expressed. All or none may be valid. The management of this board has no way of assuring that any of the opinions expressed are consistent with safe practices. If you choose to follow any of the "guidance" expressed on this site and, as a result, blow three of your fingers off, please let us know about it so we can laugh at your stupidity.

Copyright Restrictions: You should know the drill by now. If you post it here, then you promise that you have the right to do so and pledge to defend and hold harmless this board and the staff which manages daily operations. The staff reserves the right to edit or delete material you submit if, in its judgment, your claim is not reasonable.

Powered by Infopop www.infopop.com © 2000
Ultimate Bulletin Board 5.45c