Stay up to date with the latest from the Knowledge Center. See all new Knowledge Center articles published in the last month, and re:Post’s top contributors.
All Content tagged with Amazon Managed Streaming for Apache Kafka (Amazon MSK)
Amazon MSK makes it easy to ingest and process streaming data in real time with fully managed Apache Kafka.
Content language: English
Filter content
Select tags to filter
Sort by
Sort by most recent
360 results
Hello,
I am running an Apache Spark job on Amazon EMR that needs to connect to an Amazon MSK cluster configured with IAM authentication. The EMR cluster has an IAM role with full MSK permissions, and...
anyone knows how/why this happens?
```
[Worker-0114bf4dc8ea35bcf] [2025-09-26 19:37:30,753] INFO [prod-reporting-cdc|task-0|offsets] WorkerSourceTask{id=prod-reporting-cdc-0} Committing offsets for 1...
Hello,
I'm trying to integrate an external Kafka cluster using MSK Connect. This external cluster needs Kafka clients to support mTLS, so providing a keystore is mandatory for a successful SSL hands...
Hello,
I have a MSK cluster running with express brokers, I can edit monitoring and enable Enhanced broker-level monitoring and others through portal successfully. But when I tried to do the same thi...
Hey everyone,
To give everyone some context - I have a lambda function that acts as a Kafka producer. On an S3 upload, the producer should send a message ( {"bucket", "key"} ) to the broker but for so...
How do i transfer messages from ActiveMQ to AmazonMSK?
1) I have created a cluster in MSK
2) I have a queue in ActiveMQ existing and also have a message
3) I have created a topic as well in MSK
I hav...
When I tried to create a topic in my msk serverless cluster using ec2 as client machine I am facing this issue [2025-08-07 21:35:32,980] ERROR [AdminClient clientId=adminclient-1] Connection to node -...
Anubhav GuptaEXPERT
published 2 months ago6 votes99 views
In this article, we discuss the steps to implement near-real-time analytics using Amazon Redshift streaming ingestion with Amazon MSK.
We are using AWS_MSK_IAM in an EKS managed, Containerized Java Spring Boot Application.
We successfully connect and consume from the topic and at some point in time, we get the following exception:
o...
I have done a poc to create a schedule job using AWS Event bridge schedule which connects to a lambda (rust runtime or python) to publish a message to kafak topic in MSK cluster
where each schedule sh...
We have configured MSK Provisioned Cluster. I have done authentication from on-prem with Spring boot OAUTHBEARER with awsProfile. in jaas config
sasl.jaas.config = org.apache.kafka.common.security.oa...
Nitin KumarEXPERT
published 3 months ago1 votes236 views
This post discusses how to generate kafka.client.keystore.jks for connecting AWS MSK cluster with mTLS Authentication from AWS Glue.