08/26/2026
đ¤ We gave the exact same ad data to two different AI models.
They gave us two different interpretations.
In our tests, Claude tended to catastrophize. It focused on the wrong numbers, made questionable inferences, and then built worst-case scenarios around them.
ChatGPT was generally more measured but it wasn't perfect either..
The bigger issue wasnât which model performed better.
Both models sometimes:
𫣠Focused on the wrong metrics
đŹ Recommended Meta strategies that were severely out of date
đł Made up information that wasnât in the data
And they presented all of it confidently.đ
AI can absolutely help you evaluate your ad performance. We use it ourselves.
But right now, you still need enough advertising knowledge to recognize when the analysis doesnât make sense.
Otherwise, itâs very easy to mistake a confident answer for a correct one.
Use AI. Just double-check the data and the recommendations before you make decisions with your ad budget.