Skip to main content

Amazon Kinesis Data Streams

Amazon Kinesis Data Streams features

Why Kinesis Data Streams?

Amazon Kinesis Data Streams is a massively scalable, durable, and low-cost streaming data service. Kinesis Data Streams can continuously capture gigabytes of data per second from hundreds of thousands of sources, such as website clickstreams, database event streams, financial transactions, social media feeds, IT logs, and location-tracking events. The collected data is available in milliseconds to allow real-time analytics use cases, such as real-time dashboards, real-time anomaly detection, dynamic pricing.

Page topics

Page topics

General

Open all

There are no servers to manage with Amazon Kinesis Data Streams. The on-demand mode further removes the need to provision or manage throughput by automatically scaling capacity when there is an increase in workload traffic. You can get started with Kinesis Data Streams with a few clicks from the AWS Management Console.

Synchronously replicate your streaming data across three Availability Zones (AZs) in an AWS Region, and store that data for up to 365 days to provide multiple layers of data loss protection.

Make your streaming data available to multiple real-time analytics applications, to Amazon Managed Service for Apache Flink, or to AWS Lambda within 70 milliseconds of being collected.

You can attach up to 20 consumers to your Kinesis data stream, each with its own dedicated read throughput.

Both On-demand Standard and On-demand Advantage mode provide automated capacity management. While On-demand Standard provides a pay-as-you-go model, On-demand Advantage allows you to commit the account to a small data throughput of 25MB/s for discounted usage and access to warm throughput across all on-demand streams in a region. If you ingest over 10MB/s across all your streams, want to fan out to more than two consumers, or use more than 50 streams, On-demand Advantage mode will be the more cost-effective choice.

Choose On-demand Advantage when you need automated capacity management, simple data-throughput-based pricing, and the ability to fan out to multiple consumer applications. Consider Provisioned instead for workloads that require fine-grained control over shard count.

Encrypt sensitive data within Kinesis Data Streams to meet your regulatory and compliance needs, and securely access your data via Amazon Virtual Private Cloud (VPC). Data can be secured at rest using server-side encryption and AWS Key Management Service (KMS) keys.

Use Kinesis Data Streams integrations with other AWS services, such as Amazon DynamoDB, Amazon QLDB, Amazon Aurora, AWS Database Migration Service, Amazon Cloudwatch, AWS Lambda, Amazon Managed Service for Apache Flink, and Amazon Kinesis Data Firehose to build complete applications quickly.