Currently, when using the Web Crawler as a Knowledge Base source in GHL, the data only updates when manually refreshed. This limits real-time accuracy for AI bots relying on dynamic content.

Proposal: Add an Auto-Refresh feature for Web Crawler sources, allowing users to set a refresh frequency (e.g., every 5 minutes, hourly, daily).

Example:

If I have a customer service AI bot connected to a Google Sheet or website that updates with every new order, the Web Crawler should automatically refresh so the bot can provide customers with up-to-date information about their orders without manual intervention.

Benefits:

• Keeps the Knowledge Base current and reliable.

• Prevents outdated or incorrect responses.

• Seamlessly integrates bots with live systems (CRM, orders, inventory).

• Saves manual work and reduces errors.

• Delivers a better, real-time customer experience.