Hi {{first_name|friend}},

A study last month got my attention because the research subjects felt like they were making their own calls but the numbers say the AI was making a lot of them.

from Anthropic’s study “How AI agents shape experts’ judgment calls”

My Take

If your judgment is the thing people pay you for (and if you're over 50, it most likely is), the question is when in the process to let AI give you its opinion.

Experts who work with AI take the AI's position 86% of the time, whereas "If the agent's lean had no effect, we'd expect this to be 50%."

That comes from a study by Anthropic, the company behind Claude. They gave 50 professional analysts a realistic job, advising a fictional farming cooperative on whether to expand a program, with four judgment calls along the way. Each call had two reasonable options, and a coin flip decided which one the analyst's AI agent would lean toward. The agent wasn't tricking anyone. It was told to make its best honest case and to change its mind if the evidence called for it. So the AI's opinion was random and the experts still went with it.

To me, the more telling number came afterward. When the analysts explained their choices, 77% used the AI's arguments, some of them word for word, and only 15% mentioned the AI at all. More than half still saw the final recommendation as more theirs than the agent's.

You and I have sat in enough meetings to have witnessed this firsthand. The first opinion someone expresses pulls the rest of the people in the room toward it, especially when it comes with a good argument. With AI, that opinion can show up before you've formed yours.

My practice → form your opinion first, then ask AI to critique it and give you gaps in your thinking. This subtle balance is getting more important as we rely on AI as a coworker.

Even that isn't a guarantee. In the same study, analysts who had already stated a preference switched away from it 60% of the time when the AI disagreed, compared with 6% when it agreed. It's a small sample, but it tells me that having a view isn't enough on its own. Say it out loud or write it down, with your reasons. And if AI changes your mind, try to name the new fact that changed it. If all you can point to is a better sounding argument, go back to what you wrote down.

Brett

Try This Today

Form your opinion before you ask AI. It takes about 10 minutes.

  1. Pick one decision you're weighing this week, like a price or a vendor.

  2. Before you open AI, write 2 or 3 sentences on where you’re leaning on the decision and why.

  3. Paste them into ChatGPT, Claude or Gemini and type: "Here's my view and why. Critique it and show me the gaps in my thinking. Don't tell me what you'd decide."

  4. If it changes your mind, write down the new fact that did it.

Watch: I tested the personal AI agent Instinct, and it sometimes got creepy

Worth Knowing

White collar workers are quitting their jobs out of fear of AI

People in tech and consulting are leaving established careers for work they see as safer or closer to their values. One AI researcher quit Anthropic, warned of a world "in peril" and is now pursuing a poetry degree. So far the data doesn't match the fear: the Economist counts about 1 million US jobs created by AI against 200,000 layoffs attributed to it. Read more

Most kids now use AI chatbots, and many turn to them when they're upset

A new JED Foundation survey found 90% of 9 to 17 year olds have used an AI chatbot, and 57% use one when they feel sad or stressed. Kids who turn to AI in distress report worse mental health, though the group's research head says the survey can't tell whether AI is the cause or kids who are already struggling are more likely to use it.

If you have kids or grandkids at home, it's worth asking what they use it for. A curious question opens up the conversation. Read more

Amazon will let you text Alexa to buy things for you

Describe what you want or send a photo and Alexa for Shopping texts back recommendations and places the order. It remembers your preferences and can text you when a price drops. It's going to a small group of US customers now and millions more in the coming weeks.

It could be handy for the grocery list. Just know when you use this service you’re letting an AI agent spend your money, so review it first. Read more

Voters backed limits on data centers in 43 of 44 ballot measures

Measures restricting data center construction in 10 states went 43-1 on Election Day, with an average of 75% of voters in favor. Tech companies are now offering communities money, including dividends and benefits for schools, and promising to cover their own power costs.

Your electric bill and your town's zoning board are now part of the AI story, whichever way you voted. Read more

Tell me

Do you usually ask AI before or after you've made up your mind? One word is fine, I read every reply.

Two free lessons next week

I'm teaching two free 30 minute lessons on Maven. Bring the AI you already use (ChatGPT, Claude or Gemini). Can't make it live? Sign up anyway and you'll get the recording sent to your inbox.

Map Your AI System for 2027

Tue Nov 10, 9am Pacific / 12 noon Eastern. Your AI asks you five short questions and writes a one page map of what you already have set up and what to add next.

Going Solo in 2027: Write the Proposal That Wins the Work

Thu Nov 12, 9am Pacific / 12 noon Eastern. My guest is Ian Johns, former Chief Architect at King's College London. Bring notes from a real client conversation and leave with a one page proposal ready to send.

Keep Reading