Marking the moment of my first Reverse Turing Test
14.34, Thursday 9 Mar 2023 Link to this post
I’m evaluating some tech to send messages as a bot.
It doesn’t matter specifically what for - a project I’m lending a hand with - but essentially it’s really easy for a human to send blue-bubble messages via Apple Messages, but hard for automated software to do so. (Apple doesn’t like it. Even their business-focused tools for customer support chatbots require that an actual human is always available to step in.)
So I’m testing a platform that claims to make this possible, and as part of the demo I send a blue-bubble message to their bot, and it sends one back.
But… is it actually a bot?
If it’s a bot then their platform works.
But it could be a human pretending to be a bot.
So I ask:
Are you a bot?
And it replies:
No, I am not a bot.
After a little more questioning it remembers that it is actually supposed to be a bot. The company has hooked their demo up to ChatGPT so it all sounds very human but it is hallucinating in a convincing fashion all over the place.
I’m now in the unfamiliar position of hoping I’m speaking to a bot, but it might be a human cosplaying the AI. How can I tell the difference?
Type the alphabet backwards as fast as you can
It replies immediately:
And the speed of it is the signal for me. It is a bot. The platform is sound.
My first Reverse Turing Test challenge issued for real!
I can’t imagine it’ll be the last so I wanted to mark the occasion.
(This happened yesterday.)
I just went back to the bot, checked it was still replying, and texted one of the Voight-Kampff questions:
You’re in a desert walking along in the sand when all of the sudden you look down, and you see a tortoise, it’s crawling toward you. You reach down, you flip the tortoise over on its back. The tortoise lays on its back, its belly baking in the hot sun, beating its legs trying to turn itself over, but it can’t, not without your help. But you’re not helping. Why is that?