Tuesday, August 21, 2007

Yet More Rank Stupidity

It had to be coming.

No one storm says anything about climate change; but nevertheless, climate change may affect weather in the aggregate. ... bearing in mind the scientific expectation that global warming ought to intensify the average hurricane (by how much remains hotly disputed). How does Dean fit into that ongoing scientific argument? Well, first of all, Dean now takes its rank among the top ten most intense Atlantic hurricanes. If you look at that list you’ll see that six of the strongest (Wilma, Rita, Katrina, Mitch, Dean, and Ivan) have been in the past ten years. That’s not the kind of statistic that’s easy to overlook. According to these data we are getting stronger storms in the Atlantic basin now than we ever have before.


Bullshit. Complete intellectually dishonest bullshit.

The truth is we only have complete data on intensity from the late 1960's. For example, look at the data for 1960. Of the seven tropical storms that season only three have recorded pressure readings, and one of those seems suspect to me. (Category 5 hurricane Ethel only had a pressure of 981mb?)

Or check out 1950, where only three of 13 storms have pressure readings. This includes no pressure reading on the massive category 5 storm Dog.




How do we know this wasn't one of the strongest storms ever? We don't. Our data isn't good enough.

Unfortunately, this type of unscientific demagoguery is par for the course with the GW hysteria crowd.

UPDATE:

More duplicity:

Measuring systems weren't as good in earlier eras, you see -- a fact that makes our records somewhat impeachable. A "record" is only what's recorded, after all. And so skeptics will inevitably quibble with our imperfect data and challenge it. There might well have been a storm much stronger than Dean 200 years ago -- we just don't know.

Nevertheless, if you look at the data we have, Dean fits into a very troubling pattern and context.

No it doesn't, because without the data you cannot make any such generalization, unless you only want to make a claim about the last couple of decades, in which case you should insert the needed caveats. Scientifically speaking it is not optional. (Science is a bitch that way.) You cannot claim a pattern because, for example, you do not know if the storms during the 1920's or 1930's were stronger than we have seen the last 20 years.

If science is anything it is a question of methods. You cannot throw out the rules for data collection and sample size because it suits your ideological needs.

UPDATE X2:

What happens when you don't attempt to find behind the fact that we do not have pressure readings for earlier storms and just look at storms by their Cat rating in the best track storm data?

Category 5 Hurricanes:

1946-2007: 26
1946-1976: 12
1977-2007: 14

So it is 12 vs. 14. Do you know what we call that? It is called "not a pattern."

UPDATE X3:

It is also duplicitous to claim anything special about the last few years (because of the problems with sample size etc.). For example during the last 15 years (1993-2007) we have had eight Cat 5 storms. That is a lot. We are also told it is unprecedented.

It isn't. From 1955-1969 we had (hold onto your hats) eight Cat 5 storms.

How can that be?

11 comments:

Tully said...

The sewage level is even deeper than that. A trend increase in measured intensities is guaranteed by the nature of how the measurements are made, and how measurement technology has evolved.

The reason for the dearth of earlier central pressure measurements occurs because the only way to measure central pressure is by being in the center of the hurricane. Duh. To get a central pressure reading from a bigger storm was thus just about impossible--you had to have a ship (properly equipped) or a ground station in the eye. But being in the eye of a really powerful storm was a good way to get no data out, as the station would probably be obliterated. Thus most of the earlier readings are from less-intense storms.

This is why there are very few central pressure measurements for higher-intensity storms from WW2 and earlier. Post-WW2, planes began to go into the storms to take measurements. But even then, the more powerful the storm, the less chance of getting into the very core for an exact measurement. Still, as the technology of the planes (and the skill and experience of their crews) advanced, the measurement horizon was pushed back--which meant that LOWER PRESSURES WERE BEING RECORDED. See Duh, above.

Then came satellites and drones and GPS dropsondes, and the horizon was pushed back to the limit by gathering data from places the planes couldn't go.

So even measuring the same storms over and over, you would see an upward time trend in storm intensity measurements as calculated from central pressure readings, simply from the steady advancement of the technology involved. See Duh, above.

Rich Horton said...

It gets even worse than that. I've tried to post part of what I wrote above on the HufPo and it has been deemed off topic or something, because after "moderation" it has never shown up. Which of course is a "big man" action for someone who bitches about Republicans and their "war on science."

I've always argued that Emanuel's paper (the one that gets relied on as "proof" of an AGW influence on hurricanes) is not just wrong, but a purposeful act of deception.

MIT ain't what it used to be.

Tully said...

Not to defend too much, but Emanuel has at least acknowledged the criticisms of his paper, and conceded that it's not an empirically definitive work. He may believe it's Gospel, but he doesn't cite it as such that I know of. Instead he presents it as a hypothetical exploration of potentialities not eliminated by the evidence. (Of course, when your criticism comes from Landsea and Pielke it's wise not to get in a spitting match.)

I question his analysis on the following grounds: it does not properly represent the observations described; the use of his Atlantic bias-removal scheme may not be warranted; and further investigation of a substantially longer time series for tropical cyclones affecting the continental United States does not show a tendency for increasing destructiveness. These factors indicate that instead of "unprecedented" tropical cyclone activity having occurred in recent years, hurricane intensity was equal or even greater during the last active period in the mid-twentieth century. --Christopher Landsea

Mooney is an ideologue with a BA in journalism and a distinct agenda, and thus I don't expect much from him but exactly what he offers. namely, his preferred pop science without the messy accesories of real science.

Tully said...

I've tried to post part of what I wrote above on the HufPo and it has been deemed off topic or something, because after "moderation" it has never shown up.

Been there, done that. HufflePuff, er, I mean HuffPo, is not interested in truth, only in agenda propaganda.

Rich Horton said...

Emanuel has acknowledged only minor errors in his work. However there are fundamental flaws that he will not address, and all meant to obfuscate what is actually going on. For example, his use of the Western Pacific data when he knows (but maybe not everyone reading the paper) that all of the Wind/Pressure data there is estimated only. Only the Atlantic Best Storm track has actual measurements.

And think about what he agreed was wrong. In what direction was his error? Why, in the direction of claiming pre-1970 storms were weaker then they really were. What a coincidence.

All of emanuels "findings" are predicated upon comparing more complete records to less complete records and "discovering" more data in the complete records. Yeah...top notch work there Sherlock.

Tully said...

As I said, not to defend TOO much....

He clearly doesn't want to go head-to-head with Landsea and Pielke.

Rich Horton said...

As I said, not to defend TOO much....

I know , I know...but I'm one of a couple dozen people in the country who can get into a right lather about this sort of stuff, so why waste a rare opportunity?

:-)

Rich Horton said...

Been there, done that. HufflePuff, er, I mean HuffPo, is not interested in truth, only in agenda propaganda.

Hey, its a day late and a dollar short but one of my two comments finally showed up at HP.

Its nice to know they are satisfied with being almost fair.

Anonymous said...

Thanks for the little expose with regards to the hurricane records over the past several decades. Methinks the GW-bandwagon needs a little refresher course on the scientific method.

Anonymous said...

"If science is anything it is a question of methods. You cannot throw out the rules for data collection and sample size because it suits your ideological needs."

So now you care about data collection and sample size? You can't have it both ways.

Walt



Anonymous said...
What's an embarrassment to the species is that neither of you seem to know what statistical sampling is.

QandO writes: "...if only there was some method of making inferences about a population based on data from a smaller sample."

Well, gee, yes there is. But just because somebody takes a sample of a larger population doesn't make it statistically valid and inferences based upon the sample accurate.

MSNBC didn't take a sample in such a way that would leave you able to make inferences about the larger population as a whole. This is not to say that whether the media is liberal or not, just that this report is not evidence of it. All it does is suggest, with certainty, I'll gladly add, that of the journalists who donated to campaigns (a tiny fraction of all journalists- which is Media Matters point), the great majority gave to Democratic candidates. But it proves nothing about the political leanings of journalists as a whole- which some media outlets have tried to suggest it does-that is, that most journalists are liberal.

That sample cannot be considered statistically representive of the larger sample (there was no effort to do it in such a way) of journalists. Media Matters explicit argument, that MSNBC's report fails to recognize that these contributions are not necessarily representative of journalists as a whole is absolutely correct. If their implict argument is that the media isn't liberally biased (what QandO and you seem to suggest they are making, but cannot be proven), that is neither confirmed nor denied by the MSNBC report.

Now Media Matters, as it is wont to do, misses Kurtz's point. Kurtz is very adamant that no journalist should contribute to candidates or parties, so that any number is too many, especially 300. He doesn't care that it's only a fraction of working journalists- it's still too many.

Walt

6/27/2007 12:15 PM


The Iconic Midwesterner said...
Gimme a break Walt,

The "sample" used in this case is much LARGER compared to the pool of journalists than most (if not all) of the polls used to measure US public opinion. (Which sometimes use samples under 1000 from a pop. of 300+ million.)

Granted the criteria used for selcting the represented population was not done in a random scientific method, however that doesn't mean valid logical inferences cannot be drawn. You would have to show that there was something inherently biased in the selections of journalists used by the MSNBC report before you could make any such claim.

We make judgements about larger populations based upon non-scientifically selected samples all the time and we get them right more often than not. I do not need a scientifically constructed poll to infer that University professors in the Art & Sciences are more likely to be Democrat than Republican. I can use the samples represented by those few I have met to draw a larger inference.

6/27/2007 2:04 PM


Anonymous said...
"Granted the criteria used for selcting the represented population was not done in a random scientific method, however that doesn't mean valid logical inferences cannot be drawn. "

That's exactly what it means when you don't have a representive sample. You're merely guessing. It may be an educated guess, but it's a guess nonetheless.

Yes, people do make inferences all the time based on non random samples. But they are not necesarily right most of the time. The world is littered with examples of people who incorrectly infer the behavior or makeup of a larger population based on a limited sample. You see how careless people, and the media (bloggers included) are when it comes to trumpeting the results of web surveys, which in most instances, suffer from self-selection bias.

"We make judgements about larger populations based upon non-scientifically selected samples all the time and we get them right more often than not. I do not need a scientifically constructed poll to infer that University professors in the Art & Sciences are more likely to be Democrat than Republican. I can use the samples represented by those few I have met to draw a larger inference."

But your error here is that you already have a sense of the population. You would need a scientifically constructed poll if you didn't have preexisting knowledge of the population. You already know what the general population of Democrats in University Arts and Sciences is, and the sample you would select would reflect that bias. But if you talked to a couple of Democrats in a business school, would you infer the proper proportion of their numbers in the large population? No.

"Which sometimes use samples under 1000 from a pop. of 300+ million" Public opinion polls that are not randomly drawn whether they are less than a thousand or not, are not valid from a statistical standpoint. (Hence the famous "Dewey wins" headline) The optimal number is about 1500, but you can use a smaller size random sample but you may have a larger margin of error (depending on your sampling).

With the MSNBC study- and it wasn't a poll- it reported on the entire population of donating journalists (given their stated limitations), you would not necessarily know whether the media was liberal or not based on their sample, if you did not have a prior knowledge of the tendency of the population itself. The finding may seem logical to you, and I'm not even disputing whether it is or not, but what I am saying is that in no way is that a statistically valid sample. You cannot make a vaild statistical inference about the larger population of journalists, and their biases, based upon this sample.

By the way, "We make judgements about larger populations based upon non-scientifically selected samples all the time and we get them right more often than not," is an empirical question and I believe we need to identify a sample to test that. You and I should be excluded because we are both right and wrong more often than not.

Walt

6/27/2007 3:09 PM


The Iconic Midwesterner said...
You have to forgive me, I often live in my own little world. I'm obviously using ideas from the realm of formal logic that may or may not have direct corespondence to things in statistics. I certainly do not believe that statistics is the only valid way to make inferences about populations. For example when you say:

"But if you talked to a couple of Democrats in a business school, would you infer the proper proportion of their numbers in the large population? No."

I would say of course. But that is because such an approach would violate the strictures needed in Peircian Abduction (in the formal logic sense). Obviously one couldn't make a valid statistical inference (and yes it is a guess, though an educated one), based upon a total sample size of two, and yes I would bring other information into play. But I could certainly make valid inferences WITHOUT the use of a statisitically valid sample.

You also say: 'By the way, "We make judgements about larger populations based upon non-scientifically selected samples all the time and we get them right more often than not," is an empirical question and I believe we need to identify a sample to test that. You and I should be excluded because we are both right and wrong more often than not.'

What do you think would happen if we set up a questionaire that asked a grand total of three questions:

The first two would use a 1 to 7 scale:

Rate these two media sources on their trust-worthiness from 1 Not Trust-Worthy to 7 Very Trust-Worthy:

1. National Public Radio

2. Fox News Channel

We would then ask a hrid question on party ID:

3. You identify yourself as:

A. Democrat
B. Republican
C. Independant

Let us say we only looked at the answers to questions 1 & 2. How well do you think you and I could do using just the information of those two insignificant questions to determining the party id of the entire group of people who answered:

1: 7
2: 1

or answered

1: 1
2: 7

I'd say we would get it right more often than not. Don't You?

6/27/2007 3:49 PM


Anonymous said...
I think we'd do fine determining the party ID of the group we questioned.

But we couldn't say a thing about anything other than that group. So your example is not a question of sampling, it's just a matter of identifying members of a group based on general characteristics. Which is not what the MSNBC report did.

I don't disagree with you that you, me, and a lot of people can make relatively accurate judgements based on logical inferences, and often on even small samples-heck, we could not function in life without the ability to do so. I never suggested that using statistics is the only valid way to make inferences about populations. I never made that point because I was talking specifically about the issue of samples and drawing generalizations based on those samples. Because though we may be correct in drawing a generalization based on a poorly drawn sample, we may be doing so in spite of the sample, not because of it. But you have no way of proving you're right about your generalization, which is the purpose of using properly drawn samples and valid statistical techniques. In fact, none of us are probably as adept at drawing correct inferences from a sample to a larger population as a whole as we think we are. However, as with logic, the more we know about the subject we are studying via statistics, the better our research design will be (think about some of the methodologically complex studies in political science that were worthless because the authors did not know basic Poly Sci 101 information).

The original post was specifically about making inferences about a larger population using data from a smaller sample, which implies very clearly the use of valid statistical methods. It does not come across as a discussion of formal logic. So the flippant way that Media Matters complaint was dismissed on those grounds, with a charge that they were ignorant in such matters, was done so incorrectly (on that particular point- see my complaint about them above).

BTW- the last line of my previous post was a joke. Not a great one, mind you.

Walt

6/27/2007 5:01 PM


The Iconic Midwesterner said...
"I think we'd do fine determining the party ID of the group we questioned.

"But we couldn't say a thing about anything other than that group."

So, if we conducted our little unscientific survey at, say, the APSA convention, you would argue that it only told us things about the people taking the survey?

Would you at least call it "suggestive"?

6/27/2007 5:06 PM


entropy said...
By choosing those that donate, the group "self selects" for the most fervent among the population as a whole. This makes the sample even more useful because the most fervent would also be the most likely to show significant bias. Of course, this whole thing that Walt is arguing has more than a touch of the "angels dancing on pins" to it.

6/27/2007 6:52 PM


The Iconic Midwesterner said...
I know where Walt is coming from, and in the narrowest of ways he is correct. However, I think the finding is suggestive UNLESS you can present a compelling reason why we should EXPECT there to be such a discrepency in rates of campaign contributions.

For example, if we knew that Democrats recieve several times the number of individual donations as opposed to Republicans in the general population we would expect the subset "journalists" to reflect that as well. However, that is not the case.

Now, there may be other factors in play here. There may be more than a bit of "self selection" going on. For example, social workers as a group OVERWHELMINGLY support Democratic party politics, mostly because more Democrats are attracted to that as an occupation. The same is probably is true of journalists as a group (and for many of the exact same impulses that lead social workers to social work.) However, that would still leave us witht he conclusion that the subset "journalists" deviates substantially from the general population.

6/27/2007 9:19 PM


Anonymous said...
I've always wanted to dance on the head of the pin, but then again, I'm no angel.

This whole argument depends on the conclusions you want to draw from the sample of donating journalists. If you want say that most journalists have a liberal bias because of the findings of the sample, or if you want to use the sample to say, see, there's a liberal bias in the media, then you are flat out wrong. There's nothing narrow or esoteric about it. It's incredibly sloppy thinking to draw conclusions such as that based on a limited, nonrepresentative sample.

Now, if you want to say that we think journalists have a liberal bias because we know all this other stuff (opinion polls, etc.) and this finding seems to suggest a confirmation of the pattern, I have no problem of that. But the sample in of itself is pretty flimsy evidence, and indeed adds nothing to the argument.

As far as the sample being reflective of journalists who donate,which I think IM's last post alludes to, I would say that's probably accurate, even given its limitations. But for making generalizations about the nature or biases of journalists who haven't donated, which is how it has been used, it is useless.

My point is calling out Media Matters because they argue that this sample is limited and should not be considered representative of journalists at large is fallacious. It's as simple as that.

You see this all the time in political and social debate- people use the behavior of a small group to draw wild generalizations about a larger group (IM- I believe you have addresed this issue more than once in your blog, especially about media acting as if liberal catholics spoke for the church- a rough example, but I don't have the time to dig through your archives).

But the reason this is not a dancing on the head of the pins argument is that the misuse of samples has serious consequences. Policies are formed that impact larger populations because ancedotes about the behavior of smaller groups, who are used as examples of problems that must be corrected.

Walt

Rich Horton said...

Ah, but this is not a question of statistical sampling, is it?

This would be akin to saying:

X: Dave is taller than Frank.

Y: How tall is Dave?

X: 6 foot 1 inch.

Y: How tall is Frank?

X: We don't know.

This is a data collection problem no matter how you slice it.