Google Cloud Blog
Follow
Zero-code, low-cost data ingestion: New BigQuery DTS capabilities
In the digital economy, efficient data management is crucial, but many companies struggle with complex, in-house ETL pipelines or unreliable third-party tools. BigQuery Data Transfer Service (DTS) offers a fully managed, zero-code solution that automates data ingestion into BigQuery, freeing teams from pipeline maintenance. The service is expanding its integrations to address data silos across various platforms. New capabilities include direct ingestion into Apache Iceberg tables from cloud storage, enabling multi-cloud compatibility with BigQuery's performance.A next-generation agentic architecture allows AI applications to programmatically discover and manage data transfers. DTS now supports enterprise databases like Microsoft SQL Server, PostgreSQL, and MySQL for both full and incremental transfers, consolidating data into BigQuery. E-commerce and marketing platforms such as Shopify, Klaviyo, HubSpot, and Mailchimp are also integrated to automate the extraction of granular data.Migration connectors, including Snowflake, offer features for seamless data movement. Major connectors like ServiceNow, Salesforce, and Oracle have been enhanced with native incremental updates. BigQuery DTS provides cost efficiency with free ingestion for many Google and other major sources, and low consumption-based rates for third-party SaaS.Security is frictionless, with automatic inheritance of BigQuery's security features like Column-Level Security and Customer-Managed Encryption Keys without extra configuration. The service boasts industry-leading performance and resilience with a >=99.99% monthly uptime SLA, ensuring reliable data updates. Companies can transform their data operations by using BigQuery DTS to build a scalable data stack, with new connectors continuously being developed based on user needs.