“There doesn't seem to be a very good accountability mechanism here,” said Victoria resident and frequent police critic Stephen Harrison, who obtained the documents. “Literally nobody other than the individual officer has access — you wouldn't even know that they're using it.”
I think there is still a significant issue with accountability and accuracy.
Are they more or less accurate than a trained human legal expert? Maybe equivalent, but they’re non-deterministic so will frequently have different answers to the same question asked at different times. They will typically bull ahead with incorrect information rather than output that they’re unsure and need to investigate which you would expect a human expert to say.
LLMs also have no accountability so all decisions must be verified by an accountable expert. Given the time it takes to read and absorb a potentially wrong advice, and given you need to ask the legal expert anyway, you might as well ask the expert in the first instance.
yeah, well, this is what I mean by the inherent problems. The open models still hallucinate, they are still probability-driven. Even when guided by RAG and other precautions, it still is only as good as those supporting elements can offer (assuming they are high-quality themselves).
On balance, I do not understand how this kind of tool will help officers in the field unless it is to advise on procedures for the officer to follow. Not trying to interpret situations as offenses or not, not trying to be a pocket legal interpreter.
I only suggest that whomever decided to try this for VicPD is being supported by a LLM geek that probably at least cares how well the models are performing. They seem to understand what kind of safeguards should exist for this type of thing to exist in this space… I personally doubt its good enough, but I rather see this than ChatGPT.
Does that matter? It’s not like cops are legal experts.
The cops should have access to a legal expert when they have a legal question. Arguably the cops should also be trained in the laws they need to uphold and all aspects of their position in the legal process, particularly for those cops holding rank. I would be surprised if this wasn’t already the case. Each individuals capability to understand and correctly interpret what they’ve been trained in probably varies …