Thanks for sharing this, I took some time to test this on my end as well.
I wasn’t able to consistently reproduce a case where deleted Knowledge Base files alone were still driving the same answers, so I’d love to understand your setup a bit more.
One important thing to keep in mind: the Knowledge Base doesn’t “train” the model. It only retrieves relevant chunks at runtime. So if the model already knows something from general training (public data), it can still answer even after the file is removed.
For example, if you add “2+2=4” in the KB and later delete it, it will still say 4. Same idea if your content exists publicly and has already been learned by models.
One quick way to test this is to add something unique that isn’t publicly available, ask the Pickaxe, then delete the file and try again. When I did this, the answer no longer showed up after deletion.
If you can share a specific example where old content is still appearing, I’m happy to dig into it. And if the details are sensitive, feel free to email us with your Pickaxe link and setup so we can take a closer look.