D
Daniel Fundi Ndaya
Problem
Currently, GoHighLevel Managed AI Agents can generate content but lack the ability to properly analyze files sent by customers during conversations.
When a customer sends an image, video, audio recording, or document attachment through SMS, WhatsApp, Live Chat, or other supported channels, the AI cannot interpret its contents and respond intelligently.
This significantly limits the usefulness of AI agents in real customer interactions.
Proposed Solution
Introduce
multimodal file understanding
for Managed AI Agents, allowing them to automatically access, analyze, and understand customer attachments.
Requested Capabilities
1. Image Understanding
  • Analyze photos, screenshots, and graphics.
  • Identify objects, products, and visual details.
  • Extract text using OCR.
  • Answer questions about images.
2. Video Understanding
  • Analyze uploaded videos and their contents.
  • Understand scenes, actions, and visual context.
  • Transcribe and interpret spoken dialogue.
  • Summarize videos and answer questions.
3. Document Understanding
  • Read PDFs, Word, Excel, PowerPoint, and text files.
  • Extract information from tables and forms.
  • Summarize, compare, and answer document-related questions.
  • Process scanned documents.
4. Audio Understanding
  • Transcribe voice notes and audio files.
  • Understand spoken requests.
  • Identify relevant information and respond accordingly.
5. Automatic Attachment Processing
  • Automatically detect incoming attachments.
  • Analyze files without requiring manual intervention.
  • Combine file contents with conversation history.
  • Support multiple attachments in one message.
  • Allow agents to use extracted information in workflows and CRM updates.
Example Use Cases
  • Hair Salon:
    Customer sends a hairstyle photo; AI identifies the style and recommends the appropriate service.
  • Real Estate:
    Customer sends property photos; AI analyzes visible features.
  • Education:
    Student uploads a transcript; AI extracts relevant academic information.
  • Customer Support:
    Customer sends a screen recording; AI identifies the reported issue.
Expected Outcome
Managed AI Agents should not only generate images, videos, and documents but also
understand files received from customers
.
This would enable truly multimodal, context-aware AI conversations and significantly reduce human intervention.