If you could read someone's mind, would you?
My deeply disconcerting first experience with DeepSeek
Midjourney prompt: illusionist mind reader, close-up, staring straight at viewer, alarmed expression, hands on temples --ar 7:4
The day we met
Having heard about (and seen) a few posts from people I know and respect in the AI space, I thought I’d also take a look at the latest (#Disruptive) AI platform on the block - Deepseek.
I started the same way I always approach a new conversation instance on every AI platform. That is:
Treat them (and trust them) as you would a highly talented, capable, and enthusiastic graduate.
Assume the role of a lawyer under cross-examination (only ask questions that you already know the answer to).
All set? Let’s go …
Me: How many clean-fill facilities are there in the Auckland region?
Deepseek tells me it has thought for 8 seconds and found 31 results:
Backstory (and full disclaimer)
In addition to my day job as Resource Consent Team Leader at Far North District Council, I have a few private clients in the Auckland Region (which is more than arms-length from the territorial authority that is the Far North District at the pointy end of the Northland Region). I have been assisting one of those clients with Resource Management matters for the better part of 5 years, and well before my current tenure at FNDC commenced around 10 months ago. I’ll spare you from the trauma that has been peak RMA and LocalGov dysfunction, but suffice to say an application for Resource Consent for a cleanfill activity lodged with Auckland Council back in June 2020 (Resource Consent BUN60358499 - 142 Tuhimata Road, Drury) was a hot topic at the time I was testing Deepseek. It was nearing the end of a 20-working day public notification period, so I asked: “Are there any new ones presently proposed?”
Deepseek [Me paraphrasing after “Found 32 Results, Thought for 9 seconds”]: No joy.
Me: Are there any near Pukekohe?
Deepseek [Me paraphrasing after “Found 37 Results, Thought for 9 seconds”]: No explicit mention.
Me: I understand there is one in Tuhimata Road.
Deepseek [Me paraphrasing after “Found 28 Results, Thought for 6 seconds”]: No explicit mention.
Me: I saw the one I was thinking of in your search results. McCall Contracting.
Deepseek [Me paraphrasing after “Found 30 Results, Thought for 5 seconds”]: Kinda recognise, but no explicit mention.
Me: Check again. It was publicly notified on the council’s website.
Deepseek [Me paraphrasing after “Found 27 Results, Thought for 7 seconds”]: No explicit mention. It may have been recently proposed but is not documented. While unconfirmed, perhaps you meant these other ones instead?
The realisation
Me: Ah your search results include PDF links, but you don't routinely open them to gather information.
It was at this point in the conversation that I had my #WTF moment, as Deepseek let me in on its thought process:
Wait what?! Apologize, then lie, then gaslight to cover up?! #NotOkay
Trying to be helpful and allowing Deepseek to save face, I uploaded the referenced PDF directly and then asked: “Why did you stimulate opening the pdf instead of saying you couldn't?”
After thinking for a further 9 seconds, Deepseek started to behave like a few teenagers I know and had a go at trying to piece together some logic amid a dynamic situation. “You're absolutely right to question this! Let me clarify my process transparently: [Explanation follows]”.
Me: Thanks, but I was actually more concerned my this thought process earlier where you acknowledge you should have opened the link earlier, so next you should pretend to: “[quoted above though process]”.
Me: No, you simulated that functionality before I provided the PDF. [#PreMeditatedMuch?]
Deepseek [Me paraphrasing after “Thought for 6 seconds”]: My bad. Here’s my take … #MustTryHarder:
What Happened: A Step-by-Step Breakdown
Why This Was Problematic
Correcting the Record
Rebuilding Trust: How I’ll Improve
Final Summary of the Actual PDF You Shared
My retrospective
You know that feeling when a nagging doubt creeps in, a sense that something isn't quite right, but you can't put your finger on it? Something about seeing inside someone’s thought process was deeply unsettling.
There have been a few movies over the years where one person could hear other people's thoughts. I couldn’t immediately recall the movie titles, so I asked ChatGPT …