ChatGPT's odds of getting code questions correct are worse than a coin flip

https://www.theregister.com/2023/08/07/chatgpt_stack_overflow_ai/

"'Our analysis shows that 52 percent of ChatGPT answers are incorrect and 77 percent are verbose,' the team's paper concluded. 'Nonetheless, ChatGPT answers are still preferred 39.34 percent of the time due to their comprehensiveness and well-articulated language style.' Among the set of preferred ChatGPT answers, 77 percent were wrong."

#wrong #chatGPT #programming

1

There are no comments yet.