Amazon Kinesis Data Streams

You can utilize Amazon Kinesis Data Streams to gather and procedure large streams of data records progressively. You can make data-preparing applications, known as Kinesis Data Streams applications. A run of the mill Kinesis Data Streams application peruses data from a data stream as data records. These applications can utilize the Kinesis Client Library, and they can run on Amazon EC2 instances. You can send the processed records to dashboards, use them to generate alerts, dynamically change pricing and advertising strategies, or send data to a variety of other AWS services.

Kinesis Data Streams is part of the Kinesis streaming data platform, along with Kinesis Data Firehose, Kinesis Video Streams, and Kinesis Data Analytics.

Benefits

Real-time performance

Although you can use Kinesis Data Streams to solve a variety of streaming data problems, a common use is the real-time aggregation of data followed by loading the aggregate data into a data warehouse or map-reduce cluster.

Durability and Elasticity

Data is placed into Kinesis data streams, which guarantees durability and elasticity. The postponement between the time a record is placed into the stream and the time it tends to be recovered (put-to-get delay) is commonly under 1 second. At the end of the day, a Kinesis Data Streams application can begin expending the data from the stream very quickly after the data is included. The oversaw service part of Kinesis Data Streams eases you of the operational weight of making and running a data consumption pipeline. You can make streaming guide diminish type applications. The versatility of Kinesis Data Streams empowers you to scale the stream up or down, so you never lose data records before they expire.

Multi-action

Multiple Kinesis Data Streams applications can expend data from a stream, with the goal that various activities, such as filing and handling, can happen simultaneously and autonomously. For instance, two applications can peruse data from a similar stream. The primary application ascertains running totals and updates an Amazon DynamoDB table, and the subsequent application packs and documents data to a data store like Amazon Simple Storage Service (Amazon S3). The DynamoDB table with running aggregates is then read by a dashboard for up-to-the-minute reports.

Secure

Meet your regulatory and compliance needs by encrypting sensitive data within KDS, and privately accessing your data via your Amazon Virtual Private Cloud (VPC). Data can be secured at-rest by using server-side encryption and AWS KMS master keys.

Low cost

Kinesis Data Streams has no upfront cost, and you only pay for the resources you use. For as little as $0.015 per hour, you can have a Kinesis data stream with 1MB/second ingest and 2MB/second egress capacity.

How it Works

Use cases

Log and event data collection

Kinesis Data Streams can be used to collect log and event data from sources such as servers, desktops, and mobile devices. You can then build Kinesis Applications to continuously process the data, generate metrics, power live dashboards, and emit aggregated data into stores such as Amazon S3.

Mobile data capture

You can have your mobile applications push data to Kinesis Data Streams from hundreds of thousands of devices, making the data available to you as soon as it is produced on mobile devices.

Real-time analytics

You can have your Kinesis Applications run real-time analytics on high-frequency event data such as sensor data collected by Kinesis Data Streams, which enables you to gain insights from your data at a frequency of minutes instead of hours or days.

Gaming data feed

Kinesis Data Streams can be used to continuously collect data about player-game interactions and feed the data into your gaming platform. With Kinesis Data Streams, you can design a game that provides engaging and dynamic experiences based on players’ actions and behaviors.