Bring Back and Improve Scheduled Scraping for Knowledge Files (with Webhook Support)

[Ned.Malki]

Hey @taedog2020, here’s more insight into why the scheduled scraping was rolled back in V2:

How do I auto-update website content in my AI knowledge base?

It was indeed a great feature, it just only worked 70% as well as it should due to some complications with the web-browsing and it created situatinos where users sometimes thought it was doing something it was not. Because of that, we rolled it back. If we release it again, it will work more efficiently.