Honestly, the most alarming thing about AI isn’t so much about AI itself, but about how utterly hell-bent humans are to use it for things that it does a bad job at. H sapiens is bound and determined to use this chisel as a screwdriver.

Case in point: the recent news story about a lawyer (or pair of lawyers – finger pointing is underway) who submitted a filing in federal court which had actually been written by ChatGPT.

What is the one thing one can assume everyone has heard about LLMs? That they make completely bogus shit up, including inventing nonexistent citations.

It would be hard to overstate how unacceptable to a court it is for a lawyer to submit a legal argument which cites nonexistent case law. That’s the kind of shit that can get a lawyer disbarred. It’s a, uh, *career-limiting* move.

But apparently some lawyer actually did it: he took the output of a computer program famous for fabricating false citations and piped it directly into a court.

1/?

—@siderea

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Your post must include a link to this post.

How does this work?
Write a response on your own website and include a link to this post. Then submit your response’s URL here. Your response may appear here after moderation. To update or remove it, edit or delete your original post and submit the same URL again. Learn more about Webmentions.