Personal Science Week - 1 Sep 2022
COVID testing, Muscle strength, the limits of expertise, and more
Testing when you already have COVID
The US government’s free distribution of at-home COVID tests ends this week, but if somebody in your household feels sick, you might try to enroll in the CDC’s Track Covid at Home study. Eligible participants get an at-home blood test shipped immediately, and another followup kit four weeks later. Return all the tests and receive $100.
More precise comparison of muscle strength
Muscle strength is an important aspect of healthy aging, but how do you know what's optimal for you?
In our 2 Jun 2022 edition, we showed a chart, based on a Harvard study of firefighters, for how many pushups you should be able to do at a given age. An even more personalized resource is available at the Strength Level web site. Although there are many wonderful (and free) fitness resources on the internet (e.g. see https://exrx.net/), Strength Level compiles the self-reported results of millions of weightlifting sessions to identify ranges personalized to you.
I found the standards to be significantly different from the Harvard list. I’m not sure if this is due to my incorrect reading of the data, or to a bias at the Strength Level site. After all, the type of person who cares enough about strength training to compare himself to others is not typical. Here’s the chart for pushup reps by age. (For comparison, the Harvard study says that a 60-year-old who can do 39 reps is in the 99th percentile, merely “advanced” on this chart).
I learned about this site and much more from the highly-recommended Mehdi Yacoubi Substack The Long Game.
The Limits of Expertise
Ordinary people, sufficiently motivated, are capable of finding insights that match or exceed career experts.
It’s no secret that experts are often wrong. Anyone can make a bad call now and then, but at least in theory an “expert” should make far fewer mistakes than the rest of us. But that’s true less often than we might expect.
Social scientists surveyed before and after the Covid-19 pandemic performed no better than non-experts when asked to make predictions about its effects on society.
Look at the so-called “replication crisis” in science. One estimate is that perhaps half of all U.S. preclinical biomedical research – $28 Billion worth – is wasted because once published, nobody else is able to replicate the result.
Some apparent incompetence may simply be a case of over-confidence. This so-called Dunning-Kruger effect is probably over-publicized by experts to laud their superior thinking skills, but common sense tells us that many people exaggerate their own abilities. But are they really exaggerating, or are they simply showing their determination to solve a difficult problem:
Overconfidence has three different meanings:
Overprecision: belief that the prediction is more accurate than it is. This is the error found in tests that ask you to “guess the length of the Nile in miles”.
Overplacement: the belief that we perform better than others.
Overestimation: Belief that we can perform at a higher level than what is objectively warranted.
But this is precisely the area where a positive attitude can actually improve your performance.
Note that people who suffer from overestimation (e.g. 90% of drivers think they’re above average), aren’t necessarily being haughty. Ask them to rank their drawing (or singing) ability, for example, and you’ll often find they rank themselves below average.
For things we can’t control (e.g. weather, the S&P500) there’s nothing to be gained from overestimation. But when we can influence events, then optimism and a bias for action are good things. Think about what would happen if a beleaguered military commander gave his misfit troops an honest assessment of how they were likely to perform on the battlefield.
Nullius in verba (“Take nobody’s word for it”) is the motto of the Royal Society, established in 1660. But how often is this the watchword of today’s practicing scientists? The standard response in most discussions of expertise is to point to “the peer-reviewed literature”, as if that were the final answer.
The distinguishing feature of an expert – the attribute that make him (or her) better than the rest of us is experience. An expert has simply seen more cases than the rest of us.
A coffee expert, for example, has presumably tasted or otherwise worked with far more varieties than the rest of us. It might be possible – though extremely difficult – to become a coffee expert without ever having tasted the drink. Somebody with health or religious objections to coffee-drinking might, for example, find himself owning a business that requires he learn much more about the varietals than the average person. But he will never be an expert without repeated exposure to something. In fact, you could say that “expertise” is another word for distilled experience.
Of course, experience alone is not the answer. An expert must apply his observations to new, ever-specific situations. Exposure to an unchanging sequence of items doesn’t stretch the abilities of the would-be expert. Sometimes called deliberate practice, to be a true master of a skill requires sustained, focused attention through a variety of situations and conditions.
Although experience is the main attribute that separates the average person from an expert, the motivated personal scientist has one big advantage: the requirements are personal. Nobody will be as much of an expert on you as you.