Something AI is good at—and something it's not

“Studies this year of ChatGPT in legal analysis and white-collar writing chores have found that the bot helps lower-performing people more than it does the most skilled. On a task that required reasoning based on evidence, however, ChatGPT was not helpful at all. Here, ChatGPT lulled employees into trusting it too much. Unaided humans had the correct answer 85 percent of the time. People who used ChatGPT without training scored just over 70 percent. Those who had been trained did even worse, getting the answer only 60 percent of the time. In interviews conducted after the experiment, “people told us they neglected to check because it’s so polished, it looks so right.’”

Read more in The New York Times