Apr 182008
 

I recently discovered one of the most entertaining web reads I’ve come across for ages … Bad Science which is a site dedicated to pointing out where the (mostly media) uses “Bad Science” or falls victim to “Bad Science”. The author (Ben Goldacre) is a medical doctor so most of the criticisms are in relation to medicine rather than science in general. But the debunking of rubbish media reports on (mostly) medical issues is worthwhile and done in an entertaining way.

It is interesting that many of the more foolish reports in the media have to do with bad statistics rather than bad science itself. That is I suppose not too surprising, as statistics seems to be widely misunderstood.

I have the advantage that many years ago I spent some time studying statistics, and many media reports have the effect of making my inner statistician jump up and down in fury shouting “Bullshit” over and over again. Fortunately he doesn’t shout too loudly or I’d run the risk of being shut away in a room with nice soft walls.

Statistics don’t lie, but they don’t always say what we think they do

I’m going to make use of an example relating to cannabis and an article publish by that paragon of excellent and accurate reporting, the Daily Mail. The article itself is here … scary isn’t it?

A report that has statistics that says that people who smoke cannabis have a 41% higher risk of schizophrenia, indicates that cannabis smokers are more likely to have schizophrenia than the general population. That doesn’t mean that cannabis causes mental health issues; that is an untested hypothesis. A quick uneducated guess at a number of possible reasons why includes :-

  • Cannabis use increases the risk of mental health problems (yes it is possible).
  • People with mental health problems are more likely to use cannabis than others.
  • Cannabis use makes existing mental health problems worse.
  • There is no link between cannabis use and mental health problems; the correlation is accidental.
  • The study that found a correlation between cannabis use and mental health problems is flawed and there is in fact no such correlation.

One of the biggest mistakes anyone can make with statistics is to take a link between two variables (a correlation) and assume that one variable causes another (cannabis use causes mental health issues). This is known as “Correlation does not imply causation”; stealing a Wikipedia example, there is a correlation between going to bed with shoes on and waking up with a headache. Sleeping with shoes on does not cause headaches, but drinking copious quantities of alcohol makes it more likely that you will sleep with your shoes on, and far more likely you will wake with a headache.

Apr 072008
 

I loath spam; all those unsolicited emails that advertise herbal mortgages, pills that will lower the interest rate, and all those lottery wins from places I’ve never heard of. Of course everyone else does too.

But what about emails that are “near spam” ? Say you bought something online 5 years ago from some company or other, and haven’t been near them since (nothing that was wrong, you just haven’t gotten into the habit of buying socks online). Now of course, you receive this “sock newsletter” once a month. Now perhaps you were once interested, or on a very slow Sunday you like to read about socks. Perhaps.

Of course you didn’t just buy a pair of socks 5 years ago. You’ve been buying stuff ever since, and everybody is desperate to get your email address to push virtual catalogues into your over cluttered Inbox. You could go and visit the unsubscribe links to get your address removed from each and every list out there.

But someone told you once that unsubscribe links are dangerous because they’re used by spammers to verify addresses, and besides which it would take you days to get unsubscribed from all the rubbish. And of course just occasionally you take a peek at one of the emails and it has something in it you want to know … a special offer or something.

What is needed is a way of keeping “near spam” emails under control. A central place to go to indicate your preferences (“no near spam”, “just one a day”, “as much as you want to send me”, “don’t send me those stupid messages that tell me I have to use a browser to view this email”). I’m currently automatically filtering “near spams” into a folder where I can ignore them … which is something that the sales critters who spew them out certainly don’t want!

Feb 282008
 

First of all, a little apology … I’m no expert Mathematician, was pretty dire at Physics, and I’m no great name in Computer Science. In fact the “physics” here could be any science that makes use of mathematics as a tool. Now for the really scary part … I’m going to be talking about equations.

At least some of the unpopularity of Physics has something to do with the equations that can be found in it. There is no getting around it, Physics and other sciences cannot be really called “science” without equations. But I do believe that physicists do make their equations a little too mysterious :-

e = m c ^ 2

(apologies for not using real symbols there)

Now that is one of the better known equations from physics, but were it one that was less well-known the general reaction would be “eh?”. Does the obscurity of the variables here help ?

When I was learning to write programs, I quickly came to the realisation that using descriptive variables was the start of writing understandable code and went some way to documenting what was going on. It is all very well writing a piece of code with less expressive variables but it makes understanding what you wrote some weeks (or months) ago much harder.

The use of obscure variables come from Maths where you start with equations like :-

x ^ 2 = 9

Now Maths (as I understand it) is basically a set of puzzles that have to be solved using the techniques of Maths; those techniques and the puzzles are divorced from any real problems. The use of deliberately inscrutable variables is by design.

Which way should sciences that use equations go ? The way that Maths goes with inscrutable variable names, or the way of software engineering with descriptive variables ? Historically sciences have gone down the route in common with Maths; understandably enough, but why not try descriptive names. Isn’t an equation like :-

Energy = Mass * Speed of Light ^ 2

… far more understandable, and possibly just a little bit less scary to those put off by equations ? If changing to descriptive variables brings a few more young people into the study of science, is that a good reason for using them. I think so.

Feb 032008
 

There is something a little odd about the Writer’s Guild Of America’s strike for a better deal on “residuals”. In fact there are a couple of odd things about it. Not that I am against what they are trying to accomplish … anyone who wants to fight the big studios for whatever reason has me at least half on their side before I’ve started to think. And what they are trying to get sounds more than a little reasonable.

The first odd thing is that the workers are trying to get a bigger share of the profits. Not a share but a bigger one! Now there are other industries where workers can sometimes get a share of the profits, but it is very rare. Now why is that ? It would seem both sensible and fair to give the workers a cut of the profits … after all profits cannot be made without workers to make a ‘product’. But perhaps the bosses are too greedy to cut their workers in.

I am sure an apologist for the corrupt capitalist system will claim that entrepreneurs deserve to be rewarded for the great risk they are taking when starting an enterprise, and that share-holders also deserve a reward for the risk they take. Maybe so, but workers also deserve some of the reward.

Of course the writers of the WGA are already more successful than many other workers; one suspects this is because they are on the “posh” side of the pool of workers. Can you imagine coal miners getting a similar deal ?

The other odd thing about the whole issue is just how much support the WGA seems to get in their strike action. The US is not the first place one thinks of as places sympathetic to organised labour. In fact you would expect to see large numbers of US citizens frothing at the mouth with outrage at cheek of the workers. Perhaps this is again something to do with how writers are perceived as opposed to coal miners ?

Or perhaps the bosses in this particular case are so widely hated that even their natural supporters in politics (the Republicans) do not want to be seen supporting them.

Jan 132008
 

‘I met the well connected, the powerful and the rich; I saw little to envy or, indeed, much to admire; we were being lionised by a class of society with which we had little in common’ — Edmund Hillary

I recently read Ian Bone’s blog (a good place to go for some fresh ideas) entry on Edmund Hillary and space exploration. I was particularly taken with the quote above, and wondered about how many ordinary people have been given a glimpse into the inside of the celebrity world and recoiled with the kind of exclamation that might pop out when you lift a foot for inspection to realise that you’ve trodden in something from the bowels of a particularly unwell dog and that it is busy climbing up your jeans towards your knee.

Note that I am not talking about those who have dived head-first into the trough of the celebrity world only to discover that there are disadvantages in being a celebrity … such as a constant ‘tail’ of paparazzi busy taking photos of you when you would rather they were taking photos of someone else. Such people almost deserve their treatment although the existence of paparazzi is a symptom of some sort of disease.

I don’t particularly begrudge those with genuine talent being rewarded for doing what they do, although one does tend to worry about a society that values someone who makes people laugh greater than someone who saves their life. But these days the celebrity world seems to be populated not only by those with some level of talent, but also by those who are famous for no real reason I can figure out. I am not talking about those whose talents run in directions I don’t like … such as business or architecture, but those who really lack any form of talent whatsoever except possibly the “talent” of picking the right people to sleep with.

Mind you the world of celebrity does seem to be heavily loaded in favour of those who are good at proclaiming how important they are, rather than with those who genuinely deserve the respect of the rest of society. Some of those in the celebrity world are there because they work in industries that thrive on publicity … I am thinking specifically of actors. Perhaps those who end up being celebrities because they are actors or musicians should try to bring more normal people into the celebrity world … those who deserve to be honoured but who are unlikely to trumpet their own worthiness.