Google Cloud Blog
Follow
How Box is unlocking multimodal enterprise agents with Gemini Embeddings 2
Enterprise content management is undergoing a significant architectural transformation, moving beyond traditional text-based AI. Businesses store vast amounts of critical data in Box, including financial models and legal documents. While text-based search and RAG have been effective, the new agentic era requires multimodal capabilities. This evolution allows systems to process and understand not only text but also spatial and structural data. Google Cloud and Box are integrating advanced multimodal capabilities into Box’s Agentic Platform, powered by Gemini Multimodal Embeddings 2. This merge enhances Box’s platform with Google Cloud’s AI embeddings.Improved embeddings preserve visual and spatial geometry crucial for understanding complex documents like financial tables. They illuminate visual elements such as charts and flowcharts, making them searchable alongside text. This technology also connects hybrid file formats, unifying understanding across PDFs, spreadsheets, and presentations. Gemini Multimodal Embeddings 2 creates a unified vector space for text, images, and document pages. It enables crossmodal retrieval (text-to-visual and visual-to-text) without manual tagging. The system also supports layout-aware document embedding, preserving visual hierarchies, and bridges heterogeneous formats seamlessly.Three core patterns for multimodal enterprise agents emerge from this integration within Box. The first pattern addresses complex financial and analytical reporting by capturing the structural alignment of tables and charts. This allows agents to perform visual trend analysis and contextual sourcing. The second pattern focuses on multimodal clinical decision support, synthesizing various data formats like physical photos and pathology slides. It enables cross-modal clinical synthesis, granular anomaly identification, and risk-aware decision support. The third pattern tackles cross-document multimodal synthesis and data reconciliation for fragmented enterprise information. This leads to cross-file synthesis, conflict resolution, and visual-to-text auditing across disparate documents.The future of agentic enterprise content management relies on this integration to move beyond basic search to intelligent collaboration. Box's platform provides a governed, semantically indexed reasoning layer for AI agents, ensuring compliance and security. By proactively surfacing insights and flagging discrepancies, Box helps mitigate business risks. This multimodal understanding is critical for industries like financial services and life sciences. Box serves as a governed content foundation, ensuring AI-driven workflows use authorized and auditable data. The ability to make sense of the inherently multimodal enterprise data landscape marks a new era of productivity and innovation.