We’ve used all the inputs you’ve provided so far and moved on to loading data to a secured Kafka cluster.
The cluster is secured with SSL and TLS and needs to be authenticated with signed certificates.
We’ve generated and can used certificates on the machine where we’ve OpenPDC installed.
We can also produce and consume messages using sample consoles outside OpenPDC.
But when we use the adapter to send messages to the same topic, we get following errors.
" Exception while sending Kafka messages to the topic topic-name: Unable to query metadata from any of the default Kafka servers.
At least one server must be available. Server list: Misakai.Kafka.KafkaConnection"
" Message: WARNING: Failed to contact Kafka server=http://brokers.kafka-test.server-name.no:9093/. Trying next default server. Exception=System.AggregateException: One or more errors occurred. —> Misakai.Kafka.ResponseTimeoutException: Timeout Expired. Client failed to receive a response from server after waiting 00:00:30ms.
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
1.MoveNext() --- End of inner exception stack trace --- at System.Threading.Tasks.Task1.GetResultCore(Boolean waitCompletionNotification)
at Misakai.Kafka.KafkaMetadataProvider.GetMetadataResponse(IKafkaConnection connections, MetadataRequest request)"
It’s suspected that it’s due to the lack of certificate details in the request that’s sent from the Kafka adapter.
We’ve checked the KafkaProducerAdapter code on Git and don’t see any details about certificate or authentication.
Is there any properties we can include as part of the connection string to authenticate the client?
We use the below properties in the producer and consumer config file:
Thanks a lot,