CLI-3670: Add confluent_kafka_clusters and confluent_schema_registry_clusters data sources

[keeganwitt]

We should add confluent_kafka_clusters and confluent_schema_registry_clusters data sources, so that we have a way to do https://docs.confluent.io/cloud/current/api.html#tag/Clusters-(cmkv2)/operation/listCmkV2Clusters and https://docs.confluent.io/cloud/current/api.html#tag/Clusters-(srcmv3)/operation/listSrcmV3Clusters in Terraform.

[linouk23]

Keegan Witt (@keeganwitt) thanks for creating the issue! It seems like listSrcmV3Clusters may be present already:

• https://registry.terraform.io/providers/confluentinc/confluent/latest/docs/data-sources/confluent_schema_registry_clusters

and confluent_kafka_clusters may be missing.

Could you also share a little bit more details about the use case to confirm that https://registry.terraform.io/providers/confluentinc/confluent/latest/docs/data-sources/confluent_kafka_cluster is not sufficient? Thank you!

[keeganwitt]

Ah, you're right, I missed that one.

My use case is that we are using Confluent Cloud Control Center to create environments, clusters, etc. But we are using Terraform to manage identity pools, service accounts, etc. So I'd like a way to enumerate the created clusters, rather than have a hard-coded list of clusters I have to keep in sync with creates that happen via Control Center. confluent_kafka_cluster requires I know all the IDs/names of all clusters that have been created.

[keeganwitt]

Kostya Linou (@linouk23) I created an MR to add a confluent_kafka_clusters resource. Can you take a look?

[linouk23]

update: Keegan Witt (@keeganwitt) given that confluent_schema_registry_cluster data source already supports the following:

# Loads the only Schema Registry cluster in the target environment
data "confluent_schema_registry_cluster" "example_using_env_id" {
  environment {
    id = "env-xyz456"
  }
}

we'll mark the request for confluent_schema_registry_clusters data source as won't do, and we'll review your PR for confluent_kafka_clusters data source in a bit, thanks for creating it!

[linouk23]

Keegan Witt (@keeganwitt), thanks for waiting! We used your PR as the inspiration and then created our own PR (#877) as the repository doesn't currently support community contributions due to some CI issues. Our PR includes some additional live tests required by our new testing and verification process. This will be reviewed by our team and then included in one of our upcoming releases shortly.