Honestly, the most alarming thing about AI isn’t so much about AI itself, but about how utterly hell-bent humans are to use it for things that it does a bad job at. H sapiens is bound and determined to use this chisel as a screwdriver.
Case in point: the recent news story about a lawyer (or pair of lawyers – finger pointing is underway) who submitted a filing in federal court which had actually been written by ChatGPT.
What is the one thing one can assume everyone has heard about LLMs? That they make completely bogus shit up, including inventing nonexistent citations.
It would be hard to overstate how unacceptable to a court it is for a lawyer to submit a legal argument which cites nonexistent case law. That’s the kind of shit that can get a lawyer disbarred. It’s a, uh, *career-limiting* move.
But apparently some lawyer actually did it: he took the output of a computer program famous for fabricating false citations and piped it directly into a court.
1/?