How to consume messages using Kafkastrem

4 次查看（过去 30 天）
Marcin Kowalski
Marcin Kowalski 2023-11-28
评论： Marcin Kowalski 2023-12-14
Hi all,
The question is simple as the title says. How to consume messages from selected Kafka topic?
I have a setup which works perfectly from terminal and now I am trying to connect MATLAB with this Kafka topic, just to consume messages. I followed this:
https://www.mathworks.com/help/mps/ml_code/matlab.io.stream.event.kafkastream.html
but unfortunately there is no information how to consume messages. Any help will be appreciated!
  2 个评论
Marcin Kowalski
Marcin Kowalski 2023-11-29
I believe the issue is somewhere else. I have two machines - one with Kafka server and the second with Kafka consumer (WSL2). Communication between both works perfectly, but I cannot do the same using MATLAB.
I can set the KafkaStream object - that works well
host="10.1.147.182";
port=9092;
topic="demo-messages";
ks = kafkaStream(host,port,topic, Rows=10)
but then, I try to consume messages by
event = readevents(ks)
preview(ks)
What happens is that MATLAB is busy for ~1 min and replies with 0x0 empty timetable. Any ideas what I am doing wrong here?

请先登录，再进行评论。

请先登录，再回答此问题。

回答（1 个）

Divyanshu
Divyanshu 2023-12-13
编辑：Divyanshu 2023-12-13
Hi Marcin,
I understand that you are able to configure the kafkaStream object successfully but are facing issues while reading the messages from KafkaStream.
Please go through the following documentation which provides an example of writing and reading messages over the kafka stream:
https://www.mathworks.com/help/mps/ml_code/process-kafka-events-using-matlab.html
Also make sure to verify that once the kafkaStream object is configured, the messages are written appropriately. The function 'readtimetable' can be used to read the data as shown in the example above.
For further details about 'readtimetable' function refer the following documentation:
https://www.mathworks.com/help/mps/ml_code/matlab.io.stream.event.kafkastream.readtimetable.html
  3 个评论
显示 1更早的评论
Divyanshu
Divyanshu 2023-12-14
编辑：Divyanshu 2023-12-14
Hi Marcin,
This particular issue requires further investigation and would require some log files to track the root cause of the issue and provide a solution or workaround accordingly.
Hence I would suggest you to reach out to MathWorks Technical Support and raise a request on the below link:
https://in.mathworks.com/support/contact_us.html
Once a request is raised someone from technical support would reach out to you and would help you with the issue.
Thanks.

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Event Stream Processing 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by