Debezium 如何使用 Kafka Connect 正确注册 SqlServer 连接

Debezium How do I correctly register the SqlServer connector with Kafka Connect - connection refused(Debezium 如何使用 Kafka Connect 正确注册 SqlServer 连接器 - 连接被拒绝)

问题描述

问题:

如何使用 Kafka Connect 正确注册 SqlServer 连接器以连接到独立的 SQL Server 实例?注意:我没有在 Docker 中运行 SQL Server.

How do I correctly register the SqlServer connector with Kafka Connect to connect to a standalone SQL Server Instance? Note: I am NOT running SQL Server in Docker.

错误:

错误:由:com.microsoft.sqlserver.jdbc.SQLServerException引起:TCP/IP 连接到主机 127.0.0.1，端口 1433 失败.错误:连接被拒绝(Connection denied).验证连接特性.确保 SQL Server 的实例正在运行主机并在端口接受 TCP/IP 连接.确保 TCP与端口的连接未被防火墙阻止.".

Error: Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The TCP/IP connection to the host 127.0.0.1, port 1433 has failed. Error: "Connection refused (Connection refused). Verify the connection properties. Make sure that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port. Make sure that TCP connections to the port are not blocked by a firewall.".

问题排查:

1. 在 dbo.Posts 表上启用 CDC(见下文)
2. 在 SQL Server 配置管理器的 SQL Server 网络配置中验证 TCP/IP 已启用并将所有地址设置为已启用并在端口 1433 上处于活动状态
3. 禁用 Windows 防火墙
4. 在 SQL Server 配置管理器中启用 SQL Server 浏览器
5. 验证我可以远程登录以下内容:(127.0.0.1 1433; localhost 1433; lt-ls231 1433)

上下文:

我正在尝试使用 Docker 在 Windows 10 上设置 Debezium.我可以毫无问题地在 Powershell 中成功运行以下命令:

I am attempting to setup Debezium on Windows 10 using Docker. I can successfully run the following commands in Powershell without problem:

docker run -it --rm --name zookeeper -p 2181:2181 -p 2888:2888 -p 3888:3888 debezium/zookeeper:1.1 

docker run -it --rm --name kafka -p 9092:9092 --link zookeeper:zookeeper debezium/kafka:1.1 

docker run -it --rm --name connect -p 8083:8083 -e GROUP_ID=1 -e CONFIG_STORAGE_TOPIC=my_connect_configs -e  OFFSET_STORAGE_TOPIC=my_connect_offsets -e  STATUS_STORAGE_TOPIC=my_connect_statuses --link zookeeper:zookeeper --link kafka:kafka debezium/connect:1.1

当我尝试使用 Kafka-Connect connect 注册 SQL Server 连接时出现错误(见上文)，我运行以下命令:

I get an error (see above) when I attempt to register the SQL Server connection with Kafka-Connect connect, I run the following command:

Invoke-RestMethod -Method Post -Uri 'http://localhost:8083/connectors/' -Headers @{'Accept' = 'application/json'; 'Content-Type' = 'application/json'} -Body '{"name": "mssqlserver-localhost-testDb-connector",  "config": {"connector.class": "io.debezium.connector.sqlserver.SqlServerConnector", "database.hostname": "127.0.0.1", "database.port": "1433", "database.user": "svc_kafka", "database.password": "password", "database.dbname": "Posts", "database.server.name": "LT-LS231", "table.whitelist": "dbo.Posts", "database.history.kafka.bootstrap.servers": "kafka:9092", "database.history.kafka.topic": "dbhistory.LT-LS231" }}'

格式化后的JSON如下:

The formatted JSON is as follows:

Invoke-RestMethod -Method Post -Uri 'http://localhost:8083/connectors/' -Headers @{'Accept' = 'application/json'; 'Content-Type' = 'application/json'} -Body '

{  
    "name": "mssqlserver-localhost-testDb-connector",  
    "config": {
        "connector.class": "io.debezium.connector.sqlserver.SqlServerConnector", 
        "database.hostname": "127.0.0.1", 
        "database.port": "1433", 
        "database.user": "svc_kafka", 
        "database.password": "password", 
        "database.dbname": "Posts", 
        "database.server.name": "LT-LS231", 
        "table.whitelist": "dbo.Posts", 
        "database.history.kafka.bootstrap.servers": "kafka:9092", 
        "database.history.kafka.topic": "dbhistory.LT-LS231" 
  }
}'

这是根据 Debezium 网站上提供的 JSON 建模的:https://debezium.io/documentation/reference/1.1/connectors/sqlserver.html#sqlserver-deploying-a-connector

This is modeled after the JSON provided on Debezium's site: https://debezium.io/documentation/reference/1.1/connectors/sqlserver.html#sqlserver-deploying-a-connector

推荐答案

问题在于对 localhost 的引用.如果您在 Docker 容器中运行 Connect，则 localhost 是容器的本地主机，而不是机器的本地主机.尝试在 docker0 接口或所有接口上公开 SQL Server，然后在注册请求中使用 docker0 IP.

The problem is in the reference to the localhost. If you run the Connect in Docker container then the localhost is the localhost of the container not of the machine. Try exposing the SQL Server on docker0 interface or all intefaces and then use docker0 IP in the registration request.

这篇关于Debezium 如何使用 Kafka Connect 正确注册 SqlServer 连接器 - 连接被拒绝的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持编程学习网！