# Switching from GPT-4 to GPT-4o **URL:** \ **Category:** Bugs / Site Issues\ **Created:** [June 2, 2025, 9:54am UTC](https://community.pickaxe.co/t/switching-from-gpt-4-to-gpt-4o/6055 "2025-06-02T09:54:00Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![somatics](https://yyz2.discourse-cdn.com/flex004/user_avatar/community.pickaxe.co/somatics/32/2637_2.png) [@somatics](https://community.pickaxe.co/u/somatics)\ **Post date:** [June 2, 2025, 9:54am UTC](https://community.pickaxe.co/t/switching-from-gpt-4-to-gpt-4o/6055/1 "2025-06-02T09:54:00Z")
Hi, I’ve been using a single Pickaxe embedded on my paywalled Kajabi site for testing purposes. It was working fine in April 2025. 1. I noticed today that the behaviour of the Pickaxe has degraded, in that it used to answer specific questions correctly, and would pull info from my knowledge base. It now fails to answer specific questions correctly. 2. As an experiment, I changed from the GPT-4 model to the GPT-4o model, and noticed that token lengths increased (as expected), so I pushed some of those sliders up … and yet the Pickaxe is still getting those basic questions incorrect. 3. I notice that whether I’m using GPT-4 or GPT-4o there is zero change in the behaviour of my Pickaxe. It gets the same questions correct, and the same questions incorrect, regardless of which model I’m using. Any thoughts welcome! Thanks. ---
**Author:** ![somatics](https://yyz2.discourse-cdn.com/flex004/user_avatar/community.pickaxe.co/somatics/32/2637_2.png) [@somatics](https://community.pickaxe.co/u/somatics)\ **Post date:** [June 2, 2025, 9:56am UTC](https://community.pickaxe.co/t/switching-from-gpt-4-to-gpt-4o/6055/2 "2025-06-02T09:56:25Z")
I’ve also adjusted the randomness slider with zero effect, i.e. nothing is different, regardless of model. I’m happy to use any model as long as it works. I’m not wedded to 4o or 4. ---
**Author:** ![ab2308](https://yyz2.discourse-cdn.com/flex004/user_avatar/community.pickaxe.co/ab2308/32/1542_2.png) [@ab2308](https://community.pickaxe.co/u/ab2308)\ **Post date:** [June 3, 2025, 1:20am UTC](https://community.pickaxe.co/t/switching-from-gpt-4-to-gpt-4o/6055/3 "2025-06-03T01:20:16Z")
@somatics can you try with Gemini to understand if the problem is with OpenAI? ---
**Author:** ![somatics](https://yyz2.discourse-cdn.com/flex004/user_avatar/community.pickaxe.co/somatics/32/2637_2.png) [@somatics](https://community.pickaxe.co/u/somatics)\ **Post date:** [June 3, 2025, 1:39am UTC](https://community.pickaxe.co/t/switching-from-gpt-4-to-gpt-4o/6055/4 "2025-06-03T01:39:11Z")
Tried that. Gemini gives considerably worse answers to basic questions. i.e. zero correct answers ---
**Author:** ![somatics](https://yyz2.discourse-cdn.com/flex004/user_avatar/community.pickaxe.co/somatics/32/2637_2.png) [@somatics](https://community.pickaxe.co/u/somatics)\ **Post date:** [June 3, 2025, 12:27pm UTC](https://community.pickaxe.co/t/switching-from-gpt-4-to-gpt-4o/6055/5 "2025-06-03T12:27:12Z")
Ok, it seems that I’m experiencing almost complete knowledge loss, as per: > [@My sole pickaxe answers 5% of questions correctly](https://community.pickaxe.co/t/my-sole-pickaxe-answers-5-of-questions-correctly/4755/): > > Hola. Today I migrated to V2 and re-embedded my sole pickaxe into my Kajabi website. However… when I ask it questions (on the Kajabi site or on [pickaxe.co](http://pickaxe.co)) it states that it doesn’t know the answer to 95% of the questions I ask. My uploaded documents filled with training data are all still in the pickaxe; nothing has changed. I’ve checked my settings and nothing has changed from yesterday. What am I missing here? ---
**Author:** ![intellibotique](https://avatars.discourse-cdn.com/v4/letter/i/f9ae1b/32.png) [@intellibotique](https://community.pickaxe.co/u/intellibotique)\ **Post date:** [June 3, 2025, 4:25pm UTC](https://community.pickaxe.co/t/switching-from-gpt-4-to-gpt-4o/6055/6 "2025-06-03T16:25:54Z")
Can you look at your Pickaxe functionality to see if it’s even calling the knowledge base? ---
**Author:** ![mjhalliburton](https://yyz2.discourse-cdn.com/flex004/user_avatar/community.pickaxe.co/mjhalliburton/32/2508_2.png) [@mjhalliburton](https://community.pickaxe.co/u/mjhalliburton)\ **Post date:** [June 8, 2025, 11:52pm UTC](https://community.pickaxe.co/t/switching-from-gpt-4-to-gpt-4o/6055/7 "2025-06-08T23:52:14Z")
Curious what was the outcome of this. Sounds a bit worrisome as a fellow user… ---
**Author:** ![stephenasuncion](https://yyz2.discourse-cdn.com/flex004/user_avatar/community.pickaxe.co/stephenasuncion/32/3111_2.png) [@stephenasuncion](https://community.pickaxe.co/u/stephenasuncion)\ **Post date:** [June 9, 2025, 12:19am UTC](https://community.pickaxe.co/t/switching-from-gpt-4-to-gpt-4o/6055/8 "2025-06-09T00:19:24Z")
Hi @somatics and @mjhalliburton, Check out this video on how to test for knowledge base retrieval: [![](https://canada1.discourse-cdn.com/flex004/uploads/pickaxeproject/original/2X/2/2a08468bbe81e3268c8b6fcf528895c963cf12ee.jpeg "Knowledge Base Configuration Tutorial - Pickaxe") ](https://www.youtube.com/watch?v=SlWfzz9NRo4) ---
**Author:** ![somatics](https://yyz2.discourse-cdn.com/flex004/user_avatar/community.pickaxe.co/somatics/32/2637_2.png) [@somatics](https://community.pickaxe.co/u/somatics)\ **Post date:** [June 11, 2025, 11:25am UTC](https://community.pickaxe.co/t/switching-from-gpt-4-to-gpt-4o/6055/9 "2025-06-11T11:25:20Z")
Bizarrely it just started working out of the blue. I reverted to GPT-4… then GPT4-0, then GPT-4.1 mini. Nothing changed, the Pickaxe essentially stopped working properly with no changes from me, and then started working properly with no changes from me.