-
-
Notifications
You must be signed in to change notification settings - Fork 194
debezium/dbz#1569 Add a blogpost for platform support for connection #1215
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 1 commit
Commits
Show all changes
3 commits
Select commit
Hold shift + click to select a range
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,122 @@ | ||
| --- | ||
| layout: post | ||
| title: "Introducing reusable Connections in the Debezium Platform" | ||
| date: 2026-01-22 | ||
| tags: [ UI, debezium-platform, integration, debezium operator, debezium, debezium-server ] | ||
| author: indrashukla | ||
| --- | ||
|
|
||
| Since introducing the Debezium Management Platform (Debezium Platform), our goal has been to simplify how you build and manage CDC data pipelines—so you can focus on how your data flows, rather than repeatedly configuring the same infrastructure details. | ||
|
|
||
| Earlier, connection-related properties (such as hostnames, ports, credentials, or authentication details) were defined directly as part of the Source or Destination configuration. | ||
indraraj marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
| While this worked, it often led to duplication, harder maintenance of the same connection details across multiple instances. | ||
indraraj marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| To address this, we are introducing **Connections** as a first-class entity in the Debezium Platform. | ||
indraraj marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| Connections allow you to define, validate, and reuse connection details independently, and then reference them from any number of Sources and Destinations. | ||
indraraj marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| == What are Connections? | ||
|
|
||
| A *Connection* represents the configuration required to connect to an external system, such as a source database or a sink endpoint. | ||
indraraj marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| Instead of embedding these details inside each Source or Destination: | ||
|
|
||
| * You create a Connection once | ||
| * Validate it independently | ||
| * Reuse it across multiple Sources and Destinations | ||
|
|
||
| This makes pipelines easier to manage, safer to modify, and faster to set up. | ||
|
|
||
| == Why introduce Connections? | ||
|
|
||
| Separating connection details from Source and Destination configurations provides several benefits: | ||
|
|
||
| **Reusability**:: | ||
| A single Connection can be reused across multiple Sources or Destinations. | ||
|
|
||
| **Centralized management**:: | ||
| Update credentials or connection parameters in one place without editing every pipeline. | ||
|
|
||
| **Early validation**:: | ||
| Validate a Connection before it is ever used by a Source or Destination. | ||
|
|
||
| **Cleaner configurations**:: | ||
| Source and Destination definitions focus only on CDC and data flow logic, not infrastructure details. | ||
indraraj marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| == Creating a Connection | ||
|
|
||
| You can create a Connection directly from the catalog or during the resource creation flow. | ||
|
|
||
| When creating a Connection, you define the connection-specific properties required to communicate with the external system (for example, database host, port, authentication details, or sink endpoint configuration). | ||
|
|
||
| Once defined, the Connection can be validated independently to ensure it is correctly configured and reachable. | ||
|
|
||
| [.centered-image.responsive-image] | ||
| ++++ | ||
| <!-- Screenshot placeholder: Connection creation form --> | ||
| ++++ | ||
|
|
||
| === Validating a Connection | ||
|
|
||
| A key part of the new Connection workflow is connection validation. | ||
|
|
||
| After creating a Connection, you can explicitly validate it to verify that: | ||
|
|
||
| * The configuration is complete | ||
| * The platform can successfully connect to the target system | ||
| * Authentication and network settings are correct | ||
|
|
||
| This helps catch issues early—before a Source or Destination is created or a pipeline is executed. | ||
indraraj marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| [.centered-image.responsive-image] | ||
| ++++ | ||
| <!-- Screenshot placeholder: Connection validation result --> | ||
| ++++ | ||
|
|
||
| == Using Connections in Sources and Destinations | ||
|
|
||
| Once a Connection is created and validated, it becomes available for selection when creating Sources and Destinations. | ||
|
|
||
| Instead of entering connection properties again, you simply reference an existing Connection. | ||
| The Source or Destination then uses that Connection at runtime. | ||
indraraj marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| [.centered-image.responsive-image] | ||
| ==== | ||
| ++++ | ||
| <img src="/assets/images/2026-01-22-Debezium-platform-connection/connection-selector.gif" style="max-width:100%;" class="responsive-image" alt="Connection selector showing how to select or create a connection when configuring a Source"> | ||
| ++++ | ||
| ==== | ||
|
|
||
| This allows the same Connection to be shared across: | ||
|
|
||
| * Multiple Sources or Destination | ||
| * Multiple pipelines | ||
|
|
||
| == Updating existing workflows | ||
|
|
||
| If you are already familiar with creating Sources and Destinations in the Debezium Platform, the overall workflow remains the same. | ||
|
|
||
| The key difference is that connection-related properties are no longer embedded directly in the resource configuration. | ||
| Instead, they are managed through reusable Connections, keeping configurations modular and easier to evolve over time. | ||
indraraj marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| == Demo: Connections in action | ||
|
|
||
| The following video demonstrates how to: | ||
|
|
||
| * Create and validate a Connection | ||
| * Reuse the Connection across multiple Sources and Destinations | ||
| * Build a pipeline using shared Connections | ||
|
|
||
| ++++ | ||
| <div class="responsive-video"> | ||
| <!-- Video placeholder --> | ||
| </div> | ||
| ++++ | ||
|
|
||
| == More coming soon! | ||
|
|
||
| Connections are a foundational step toward making the Debezium Platform more modular, maintainable, and scalable. | ||
indraraj marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| We'll continue to build on this with further improvements and new features in upcoming releases. | ||
|
|
||
| As always, feel free to leave a comment below or get in touch with us on the https://groups.google.com/forum/#!forum/debezium[mailing list] or in our https://debezium.zulipchat.com/login/#narrow/stream/302529-users[Zulip chat]. | ||
Binary file added
BIN
+135 KB
assets/images/2026-01-22-Debezium-platform-connection/connection-selector.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.