This is very much my worry with AI in government. Those systems mass hallucinating fraud or some other punishable crime, and then the justice system doing what it does by threatening absurd sentences to compel plea deals and the evidence takes years to be properly challenged.
We are implementing AI in places it shouldn't be used and this whole thing is going to spin out of control at some point.
How can this happen over a thousand times without raising eyebrows? I can just imagine top managers noticing this and looking the other way to save their asses. Nobody wants to be the one who gets associated with such a scandal and ostracized for it. The fact that a documentation is often the only way to get heard is alarming.
It's enough to notice shortcomings and just not investigating further due to being perceived as complicated.
How can we build companies that incentivizes whistle-blowing the right(morally/legally correct?) way?
This is very much my worry with AI in government. Those systems mass hallucinating fraud or some other punishable crime, and then the justice system doing what it does by threatening absurd sentences to compel plea deals and the evidence takes years to be properly challenged.
We are implementing AI in places it shouldn't be used and this whole thing is going to spin out of control at some point.
How can this happen over a thousand times without raising eyebrows? I can just imagine top managers noticing this and looking the other way to save their asses. Nobody wants to be the one who gets associated with such a scandal and ostracized for it. The fact that a documentation is often the only way to get heard is alarming.
It's enough to notice shortcomings and just not investigating further due to being perceived as complicated.
How can we build companies that incentivizes whistle-blowing the right(morally/legally correct?) way?
>How can this happen over a thousand times without raising eyebrows?
No one ever holds the legal community to account.
All the finger pointing is at Royal Mail and Fujitsu. None at the lawyers and judges involved.
The judicicial system is a mess and incompetence and bias is systemic, but the mainstream UK press know better than to challenge it.
At Least 13 People Died by Suicide Amid U.K. Post Office Scandal, Report Says - https://news.ycombinator.com/item?id=44531120 - Jul 2025 (390 comments)
A good reminder that each of us is responsible for making the world the way it is.
There's no way this could have happened without many people seeing something and not saying something.
They haven't "killed themselves". They have been pushed to kill themselves.