wow sounds like we should never trust open
ai to be a vendor of decision making software

September 21, 2025 - 16:43 UTC

1
0
9
I don’t think they’re useless and I was pleasantly surprised to see how effective training on expressions of uncertainty was (got rid of 2/3 of confabulations and didn’t cause a big drop in answering when the model is correct) but empirically it doesn’t seem to be enough to fix things
1
0
4
There isn't even anything to fix; correctness can never be more than an accidental product of the system's use
2
0
6