Amazon Redshift introduces lon... Note

Amazon Redshift introduces long-term system table retention with Amazon S3 Tables integration

Amazon Redshift now integrates with Amazon S3 Tables to enable long-term retention of system table data. This new feature allows users to extend system table data retention beyond the standard seven days. It is designed to help meet compliance, auditing, and observability needs.Once activated, AWS automatically archives system table data to S3 Tables in Apache Iceberg format. The system handles the management of partitioning, compaction, and retention of this data. Previously, extending retention required complex and resource-intensive custom ETL pipelines. This new integration eliminates the need for such pipelines, reducing development and operational overhead.For organizations managing multiple Redshift clusters, system table data can be consolidated into a single location for cross-warehouse analysis. The open Apache Iceberg format ensures compatibility with various query engines like Redshift and Amazon Athena. This facilitates building comprehensive observability dashboards. The AWS Agent Toolkit further supports this by offering tools to query system table data for performance insights. This feature is available on Provisioned RG, RA3 instances, and Redshift Serverless across numerous AWS Regions.