30

Calibrating Yourself

The twenty-six chapters just past measure other people on dozens of parameters. They measure you on none. This chapter fixes that — and it is the chapter that will make you most uncomfortable.

An unfinished system

THE SUBJECT 8 baseline parameters plus nine zones, four domains, verbal layer THE OBSERVER 0 parameters measured yet the one who makes every judgement This is the largest hole left in the system.
The observer is the only measuring instrument in the whole procedure, and until this chapter, the only one that had never been calibrated.

Three quantities to measure about yourself

Quantity one — your own baseline

You have recorded eight parameters for other people. Record them for yourself. This needs another person observing, or a recording, because by definition you cannot see yourself.

The specific questions

This quantity matters for a very practical reason: you are the largest source of noise in every measurement you make. The contagion trap in chapter 28 is not an abstract possibility — it runs in every meeting, and its strength depends on everything you have just listed above.

Quantity two — your real hit rate

This is the most uncomfortable quantity, because almost nobody measures it, and almost everybody believes theirs is higher than it is.

FILL IN ALL FOUR BOXES REALITY: AS I PREDICTED REALITY: OTHERWISE I PREDICTED “A PROBLEM” I PREDICTED “NOTHING HERE” HIT The one box you recall and retell to others FALSE ALARM Almost nobody counts this box because it leaves no trace MISS You do not know this box either unless the truth comes out later RIGHT, BUT DULL Nobody remembers a correct “nothing here” prediction Natural memory keeps only the top-left box. That is why everyone feels skilled.
This is the full mechanism of the illusion of competence in this field. It is not that you deceive yourself — it is that three of the four boxes leave no trace. The only way to get all four is to record them before you know the outcome.

And one more trap: the base rate

Suppose that in your environment nine people in ten tell the truth. If you always guess “this person is telling the truth”, you will be right 90% of the time without looking at anything.

So the number that means something is not your hit rate. It is your hit rate MINUS the base rate. If that difference is zero, your skill has contributed nothing — and you will never know it if you only count the times you were right.

Quantity three — systematic bias

Random error cannot be corrected, but a directional bias can be — and almost everyone has one.

Leaning towards suspicion

You see a problem everywhere. Your “false alarm” box is full. Common in people who have been badly deceived once, or in those whose work punishes error in this direction less.

The correction: raise the minimum number of signals in the cluster factor from three to four. Force yourself to write two alternative hypotheses instead of one.

Leaning towards trust

You miss things. Your “miss” box is full, but you do not know it, because it is silent. Common in people who are fond of the subject, or in those for whom suspicion is costly to the relationship.

The correction: use verifiable questions — chapter 25, technique five — mechanically, even when you see no need.


The prediction notebook

This is the only tool in the chapter, and it is the cheapest tool in the whole set. A small notebook, four columns, and one rule: write it down before you know the outcome.

DATE    SITUATION              MY PREDICTION               CONFIDENCE  OUTCOME
──────  ─────────────────────  ──────────────────────────  ──────────  ─────────────
12/03   Candidate A interview  “The CV gap was a layoff”   7/10        ✗ caring for
                                                                       a relative

14/03   Negotiation with B     “They will concede on       5/10        ✓
                                price before the weekend”

15/03   Team meeting           “C will vote against”       9/10        ✓

18/03   Client meeting with D  “They had decided not to    8/10        ✗ bought, 2
                                buy before we met”                     weeks late

Four rules for using the notebook

  1. Write first. A prediction recorded after the outcome is known is worthless, and memory will quietly correct it into a right answer.
  2. Record a confidence level out of ten. This is the most important column — it lets you measure overconfidence, not just error.
  3. The prediction has to be verifiable. “This person is not honest” cannot be checked. “This person will not call back within two weeks” can.
  4. Record the times you predicted “nothing here” as well. Otherwise you can only fill one of the four boxes.
100% 50% 0 CONFIDENCE YOU CLAIM (out of 10) REAL HIT RATE perfect calibration line typical real line overconfidence gap The gap between the two lines is what you must measure.
This shape turns up again and again in every field of judgement: when you say “nine out of ten certain”, the real hit rate is usually much lower. And the gap is widest at the highest confidence level.

The four conditions for being allowed to score

This is the hardest statement in the whole set, and it is here because it is the natural conclusion of everything before it.

You may score only when all four are met

  1. You have established their baseline. Eight parameters, in this context, today.
  2. You have checked your own posture and state. And you know what your own baseline is.
  3. You have written down at least one alternative hypothesis before observing.
  4. You know how you will verify independently. Specifically, not “I will keep an eye out”.

If any condition is missing, you may still use the whole of this set to steer the conversation — ask better, de-escalate at the right moment, build the relationship better. You simply may not end with a judgement about the other person. That is a much narrower limit than it looks, and most of the value of the set lies in the part that is not limited.

The calibration schedule

  1. First month — record only, judge nothing

    Write ten to fifteen predictions. Do no arithmetic at all. The aim is to build the habit of writing first.

  2. End of the first month — fill the four boxes

    How many hits, how many false alarms, how many misses did you catch? Subtract the base rate.

  3. Second month — draw the calibration curve

    Group the predictions by confidence. In the “eight or nine out of ten certain” group, what is the real hit rate? This is usually the most uncomfortable moment.

  4. Third month — find the systematic bias

    Which way do your errors lean? Then apply the matching correction above.

  5. After that — maintain

    Three predictions a week is enough. A calibration system kept up lightly is better than a perfect one abandoned after three weeks.

What the best readers have that others do not

Not more signals. Not better intuition. But an honest record of where they have been wrong — and so they know exactly which of their confidence levels can be trusted.

An open notebook on a desk
This notebook is the cheapest thing in the whole set and the one with the largest effect on your hit rate. It is also the thing almost nobody does, and that is exactly why it makes a difference.

Chapter exercises

One. Buy a small notebook today. Write your first prediction this week, with a confidence level out of ten.

Two. Ask someone you trust to record your eight baseline parameters during a conversation. Then ask them: “when I am under stress, what changes in me first?”

Three. Estimate the base rate in your environment: of ten people you meet on business, how many really have something to hide? That figure is the threshold your skill has to beat before it is worth anything.

Chapter summary

Previous chapter29 · When the Other Side Knows Too