Amazon Managed Service for Apache Flink now offers a new Apache Flink connector for Amazon Kinesis Data Streams. This open-source connector, contributed by AWS, supports Apache Flink 2.0 and provides several enhancements. It enables in-order reads during stream scale-up or scale-down, supports Apache Flink’s native watermarking, and improves observability through unified connector metrics. Additionally, the connector uses AWS SDK for Java 2.x which supports enhanced performance and security features, and native retry strategy.
Amazon Kinesis Data Streams is a serverless data streaming service that enables customers to capture, process, and store data streams at any scale. Amazon Managed Service for Apache Flink makes it easier to transform and analyze streaming data in real time with Apache Flink without having to manage servers or clusters. You can use the new connector to consume data from a Kinesis Data Stream source for real-time processing in your Apache Flink application and can also send data back to a Kinesis Data Streams destination. You can use the new connector to read data from a Kinesis data stream starting with Apache Flink version 1.19.
To learn more about Apache Flink Amazon Kinesis Data Streams connector, visit the official Apache Flink documentation. You can also check the GitHub repositories for Apache AWS connectors.
Source:: Amazon AWS