OpenAI, the company that launched ChatGPT a little over a year ago, has recently taken to social media to address concerns regarding the “lazy” performance of GPT-4 on social media and Google Reviews.
This move comes after growing user feedback online, which even includes a one-star Google Review on the company’s Google Business Profile.
OpenAI Gives Insight Into Training Chat Models, Performance Evaluations, And A/B Testing
OpenAI, through its @ChatGPTapp Twitter account, detailed the complexities involved in training chat models.
Screenshot from X, December 2023The organization highlighted that the process is not a “clean industrial process” and that variations in training runs can lead to noticeable differences in the AI’s personality, creative style, and political bias.
Thorough AI model testing includes offline evaluation metrics and online A/B tests. The final decision to release a new model is based on a data-driven approach to improve the “real” user experience.
OpenAI’s Google Review Score Affected By GPT-4 Performance, Billing Issues
This explanation comes after weeks of user feedback about GPT-4 becoming worse on social media networks like X.
Idk if anyone else has noticed this, but GPT-4 Turbo performance is significantly worse than GPT-4 standard.
I know it’s in preview right now but it’s significantly worse.
— Max Weinbach (@MaxWinebach) November 8, 2023
