Script to package up Kafka Connect connector for submission to Confluent Marketplace (neé Confluent Hub)#15113
Script to package up Kafka Connect connector for submission to Confluent Marketplace (neé Confluent Hub)#15113rmoff wants to merge 4 commits intoapache:mainfrom
Conversation
…nfluent Marketplace (hub.confluent.io)
| @@ -0,0 +1,106 @@ | |||
| #!/usr/bin/env bash | |||
There was a problem hiding this comment.
wondering if this should be placed in the dev folder where other build scripts lives. release manager usually runs the script of the root of the project as dev/some.sh . Also might be easier to discover.
not sure what others think.
There was a problem hiding this comment.
I'm a little confused because it looks like we have two copies now. I not sure if this is something we want in the dev folder though. I'm not clear on the timing of this, but I don't think this is something you would run as part of building the release, but rather after the vote succeeded.
Do we intend to publish RCs?
|
|
||
| # Add README | ||
| cat > "${PKG}/doc/README.md" << EOF | ||
| # Apache Iceberg Sink Connector |
There was a problem hiding this comment.
Minor note here, I'm not sure we can get away with not including the Apache License header here. Theoretically this is now a file we are distributing so I think it needs the full header like our normal github readme has.
|
|
||
| License: Apache License 2.0 | ||
| EOF | ||
|
|
There was a problem hiding this comment.
Same license comment here
|
I'm a little confused on the order of how this would be published. We seem to have git commands as part of the publish, but the released artifacts shouldn't depend on the repo, but rather artifacts that have been released and verified. |
|
I've reworked this into #15212 |
4 participants
Background
There is currently no prebuilt Iceberg connector for Kafka Connect provided with Iceberg. This can make it more difficult than necessary for users who just want to build pipelines, not run
gradle:)Confluent Marketplace (previously "Confluent Hub") is a long-established platform for the distribution of connectors for Kafka Connect, both open-source and proprietary.
At the moment the 1.9.2 version of the connector has been uploaded to the site by Confluent staff as an ad-hoc process.
There are several existing issues from the community regarding: #10745 #14986 #12516
This PR
This PR adds a script to build and package the Iceberg connector for Kafka Connect into the required format for submission to Confluent for inclusion on the Marketplace.
My suggestion would be that as part of the Iceberg release process, release managers use this script and submit the generated archive to Confluent (confluent-hub@confluent.io).
Confluent can then verify the authenticity of the submission by checking the detached GPG signature against the Iceberg
KEYSfile hosted on apache.org.Mailing list thread: https://lists.apache.org/thread/fc0dhqtv8717zbw01xvsc7sm203sohpd