hn • r/hackernews
Comment on: Mythologizing AI makes it more likely that we’ll fail to operate it well (2023)
Not nearly all prompt injections are by any means that absolute unless starting from the exact same state. Many of them will also work only probabilistically unless you turn temperature to 0 for exactly that reason.And at the same time, whole books have been written about how reliably we can induce certain behaviours from humans.E.g. the Blue-seven phenomenon [1] - I've personally experienced that second hand and it was how I learned about it by searching for it subsequently because I suspected it was a known thing, having read about cold reading before. A co-worker came back from lunch and re