AWS Recent Announcements
Follow
Amazon OpenSearch Serverless supports intelligent ingestion for time series collection
Amazon OpenSearch Serverless now features intelligent ingestion for time series collections. This allows users to import logs and event data from Amazon S3 without needing an ingestion pipeline. Setup is streamlined, requiring just a few clicks in the AWS Management Console or a single API call.Intelligent ingestion automatically detects data types, parses records, and indexes them into the collection. It supports observability logs in JSON, NDJSON, and JSON array formats. Users can choose between one-time ingestion jobs or continuous ingestion streams to keep collections updated.Source S3 buckets can reside in the same or different AWS accounts as the collection. Capacity scales automatically with the workload, and users only pay for active processing. Once ingested, data benefits from existing time series collection features.The collection automatically handles ingestion spikes and stores recent data in a hot tier for quick querying. Older data transitions to a lower-cost warm tier based on user-defined retention policies. Each document must contain a valid timestamp field for successful ingestion.Missing or invalid timestamps will result in document rejection. Alerting and anomaly detection can be performed directly on the ingested logs and events. This simplifies leveraging large S3 log archives for analytics, monitoring, and IoT telemetry.Intelligent ingestion is currently available in seven AWS regions, including US East (N. Virginia), US East (Ohio), and Europe (Ireland). To begin, navigate to the Ingestion tab within your time series collection in the Amazon OpenSearch Service console. Further details are available in the intelligent ingestion and OpenSearch Serverless documentation. Pricing information can be found on the Amazon OpenSearch Service pricing page.