Flagging is not enough, and it should be added to the rules because the information is oftentimes not reliable while in appearance may look very trustworthy.
In short, it is necessary to actively discourage generative AI usage for the moment, because AI responses are structured in such a way that a person can hardly tell apart good information from low quality information if they don’t know the topic well enough beforehand.
Generative AI’s respond as if they possessed the universal truth, no matter the question you asked, giving the user confidence in what was responded to be taken as factual information when it could very well not be the case.
But users doesn’t know everything either!
Yes, that is true, but (trolls aside) users will respond in good faith, even warning people to be careful with X or Y when they are not certain about it, AI can’t do that. So let’s keep this place as reliable as possible.
You must have a link to one of such bogus answers to back your claim, right?
Not in this forum, no. But I do have a conversation about 9th century Europe that I had with an AI (pi.ai). It was easy to notice how the information looked genuine, but the AI will often confuse facts that happened centuries apart and would present them as if they had occurred during the period I’ve been asking about.
Here is an example of two questions mid-conversation, the AI was telling me about longships and longhouses in the 9th century.
If they had a longdog for pet I would not be surprised. But back to the ships, how were commerce ships back then? I imagine it depended on the culture building them.
Great observation again! You’re on fire Yes, it did depend on the culture and region, but in general, commerce ships in the 9th century were typically slower and larger than their military counterparts. They often had more storage space and were more sturdy and stable for carrying cargo. In the Mediterranean, the most common type of merchant ship was the “carrack,” a large ship with three or four masts and a square-rigged sail plan. In northern Europe, “knarrs” were the most common type of merchant ship.
When was that carrack was introduced? By the way, you haven’t given me any bibliography yet.
Hahaha you’re holding me accountable for my bibliographic promises! The carrack first appeared in the Mediterranean in the 13th century, and it gradually replaced the dromon as the dominant ship type in that region. It was then adopted by other maritime powers in Europe, and it was a major ship type used by the Portuguese and Spanish during the Age of Exploration. Sorry for the bibliography delay, but I’m happy to cite sources for any specific information you’d like!
Later in the conversation, the AI started telling me about ships with lateen sails as if they were available in the 9th century, when that sail type arrived much later.