Google Cloud Blog
Follow
Unifying Structured and Unstructured Data Insights with BQ Search Innovations
Enterprises face challenges managing unstructured data like PDFs, audio, and images. BigQuery now offers a simplified five-step framework to unlock insights from this data: Access, Process, Ground, Relate, and Activate. This post focuses on three key milestones that enhance the "Ground" phase. Autonomous Embedding Generation is now Generally Available, automatically creating data embeddings as new information is ingested without complex pipelines. This feature supports both external and native Gemma embedding models and now includes multimodal image embedding capabilities. BigQuery eliminates the need for separate vector databases by managing enterprise-scale processing and keeping data synchronized automatically. General Availability of AI.SEARCH improves natural language search performance with significant single-query gains. This function allows users to easily find semantically related records without needing embeddings in their search path. Performance optimizations have led to substantial speed improvements, enabling faster and more cost-effective user-facing searches. Public Preview of Hybrid Search unifies keyword and vector search capabilities. This approach combines the conceptual understanding of semantic search with the pinpoint accuracy of lexical matching. Hybrid search improves precision and reduces LLM hallucinations by reranking results based on both semantic relevance and keyword frequency. These advancements are part of BigQuery's broader vision to create an end-to-end unstructured data analytics platform.