Ask HN: Have people started to see cracks in the ChatGPT answers with time
Context: I have a co-worker who is used to execute the suggested scripts from Chat-gpt with high confidence. Lately one of the scripts to use Github API was not working and he asked me to debug. Turns out, Github had changed/updated the attribute names in the output and they no longer matched with the Chat-Gpt provided script. Hard part, this individual is really good engineer, however he/she was low on confidence about how to debug the Chat-gpt provided script
Don't use chatgpt for that kind of work, use agents. It will read the error message and adapt, perhaps even go as far as open the release notes for the tools you're using and fix the problems it encounters.
Skill issue.
First, switch to Codex. Then, consider using the context7 mcp server to let agents automatically fetch the latest documentation.
Debugging is not so different than debugging code written by someone else. It’s a skill you can practice.
By the way, agents are also good at debugging.
This is a great advertisement:
Agents: harder, slower and more expensive than just doing it yourself.