Want to find out if the text you’re reading online was written by an real human or spat out by a large language model (LLM) trying to sound like one? Mozilla’s Fakespot Deepfake Detector Firefox add-on may can help give you an indication. Similar to online AI detector tools, the add-on can analyse text (of 32 words or more) to identify patterns, traits, and tells common in AI generated or manipulated text. It uses Mozilla’s proprietary ApolloDFT engine and a set of open-source detection models.
I like the idea of a general AI detection approach. Problem is that it’s very easy to get false positives depending on the writer’s personal style. Accusing garbage of being garbage does nothing, but falsely accusing an individual of using AI when none is used will just lead to harmful witch hunt behavior.
Also, putting your trust in a flawed tool like this, which might miss actual AI written speech (or human bullshit speech) will just give a false sense of security.
Be careful out there fine folks. The unscrupulous used to lie using just humans, now they also use robots to do it.
Oh man - right after I posted this, I got the DM others have reported from the Polish tech chick from Toronto, with links to her cool videos. I passed her message to this extension but it says it looks like Human text. Oh well.
AI detector can’t detect AI. Is anyone surprised by this anymore?
There’s an entire category of machine learning dedicated to having two AIs “fight” against each other. One generates something while the other classifies it as either AI generated or genuine.
Anyway, this is a complete tangent. Just thought it was interesting. AI detector tools for LLMs aren’t usually very accurate, unfortunately.
Quick review:
‘tis shite
Made by people that either:
- don’t understand how reinforcement learning works, or
- are lying for publicity
Because there is not now, nor will there ever be, nor CAN there ever be, an effective AI detection tool.
