Replies: 10 comments
-
@Pakisan last time we talked you were looking for some community-driven ideas/inspirations for AsyncAPI-related tools 😄 |
Beta Was this translation helpful? Give feedback.
-
I've written a proprietary tool that connects to a kafka cluster, pulls messages from the existing topics, infers schemas and outputs the information in our custom format. It has most of the authentication modes built-in (SASL Plain, SASL SCRAM, SASL GSS, TLS mutual auth) as well as the ability to pull schemas from a schema registry. I'm currently working on: 1) open-sourcing this tool since we think it would be a great addition to the community and 2) adding AsyncAPI as an output format (the format we used is close to AsyncAPI but richer since our goal is to describe the EDA and not just the API). No exact timeline on these activities yet but I've been allocated time to start working on the open-sourcing part. I can provide updates on my progress. |
Beta Was this translation helpful? Give feedback.
-
@derberg and @fmvilas maybe we should demo/discuss on one of the upcoming community meetings because our plan is to open source this and make it available for people to add their own broker plugins (today it supports Kafka and Solace) and make asyncapi easier! We would love to get your feedback! |
Beta Was this translation helpful? Give feedback.
-
If possible, it would be great if this could be modular enough to allow elements of it to be reused across protocols other than Kafka. The ability to infer a schema from example messages is by itself a super useful and awesome capability. As a generic parser capability, I could see that being useful in lots of other environments - like JMS and MQTT, etc. - with each one needing the protocol-specific aspect of how to connect and grab the few example messages to use as input. |
Beta Was this translation helpful? Give feedback.
-
Yes @dalelane, that's exactly how it's structured. There is the concept of a broker plugin, which provides the raw data to a layer with common functionality such as schema inference. |
Beta Was this translation helpful? Give feedback.
-
@jschabowsky sounds good to me. The public meeting is for all of you folks so just feel free to suggest an agenda item once the meeting schedule shows up here. The next meeting is at 8 AM UTC, the 8th of June, so definitely not your time zone. So I suggest considering the next one that will take place on 22nd of June. |
Beta Was this translation helpful? Give feedback.
-
hi, how to join to that meeting @derberg, @jschabowsky ? I would like to see that demo:
|
Beta Was this translation helpful? Give feedback.
-
@jabrena the best way is to join this google group to be included in a distribution list that we use to send the invitation to the meeting. The invitation always have a zoom link and also the link to agenda where you can see if topic from @jschabowsky is there or not |
Beta Was this translation helpful? Give feedback.
-
@jschabowsky so, when do you plan to do a demo? 😄 |
Beta Was this translation helpful? Give feedback.
-
I'm super interested in that demo as well, since we plan to have all those features as well in https://github.com/asyncapi/event-gateway. |
Beta Was this translation helpful? Give feedback.
-
Reason/Context
Please try answering few of those questions
In a Kafka Cluster, you start a project with few topics but the it grow with the time. Traditionally, you could create a documentation about the topics in a manual way but that documentation could be obsolete soon.
Kafka by nature is asynchronous, so why not generate an
AsyncAPI
Spec from Kafka in an easy way?Description
Please try answering few of those questions
It could be interesting to create a Maven plugin or something with the idea to:
AsyncAPI
SpecThat execution could be chained with other external mechanisms like FTP/Others running in a CI pipeline for the publication of this
Kafka
documentation.Note: this idea was the outcome from a conversation from @RobWin and me on Twitter: https://twitter.com/juanantoniobm/status/1397444093484089345?s=20
Many thanks in advance
Juan Antonio
Beta Was this translation helpful? Give feedback.
All reactions