Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

scan模式开启KSN好像还是无法同步增量数据 #889

Open
lianzekunqiliangjia opened this issue Nov 26, 2024 · 5 comments
Open

scan模式开启KSN好像还是无法同步增量数据 #889

lianzekunqiliangjia opened this issue Nov 26, 2024 · 5 comments
Labels
type: question Further information is requested

Comments

@lianzekunqiliangjia
Copy link

问题描述(Issue Description)

scan全量同步完后,我往源端redis插入一个key,到目的端没有查到对应的内容,是哪里配置不太对吗

环境信息(Environment)

  • RedisShake 版本(RedisShake Version):v4
  • Redis 源端版本(Redis Source Version):单节点多DB 7.0.7
  • Redis 目的端版本(Redis Destination Version): cluster 7.0.14
  • Redis 部署方式(standalone/cluster/sentinel):cluster
  • 是否在云服务商实例上部署(Deployed on Cloud Provider):

日志信息(Logs)

2024-11-26 08:20:57 INF read_count=[218627340], read_ops=[70941.88], write_count=[218627340], write_ops=[70941.88], scan_dbid=[4], scan_percent=[90.26%], need_update_count=[99999]
2024-11-26 08:21:02 INF read_count=[218909706], read_ops=[56470.72], write_count=[218909706], write_ops=[56470.72], need_update_count=[0]
2024-11-26 08:21:07 INF read_count=[218909706], read_ops=[0.00], write_count=[218909706], write_ops=[0.00], need_update_count=[0]
2024-11-26 08:21:12 INF read_count=[218909706], read_ops=[0.00], write_count=[218909706], write_ops=[0.00], need_update_count=[0]
2024-11-26 08:21:17 INF read_count=[218909706], read_ops=[0.00], write_count=[218909706], write_ops=[0.00], need_update_count=[0]
2024-11-26 08:21:22 INF read_count=[218909706], read_ops=[0.00], write_count=[218909706], write_ops=[0.00], need_update_count=[0]
2024-11-26 08:21:27 INF read_count=[218909706], read_ops=[0.00], write_count=[218909706], write_ops=[0.00], need_update_count=[0]
2024-11-26 08:21:32 INF read_count=[218909706], read_ops=[0.00], write_count=[218909706], write_ops=[0.00], need_update_count=[0]
2024-11-26 08:21:37 INF read_count=[218909706], read_ops=[0.00], write_count=[218909706], write_ops=[0.00], need_update_count=[0]
2024-11-26 08:21:42 INF read_count=[218909706], read_ops=[0.00], write_count=[218909706], write_ops=[0.00], need_update_count=[0]
2024-11-26 08:21:47 INF read_count=[218909706], read_ops=[0.00], write_count=[218909706], write_ops=[0.00], need_update_count=[0]

其他信息(Additional Information)

请提供任何其他相关的信息,如配置文件、错误信息或截图等。

配置文件
[scan_reader]
cluster = false
address = "xxxxxxx:6379"
tls = false
scan = true
ksn = true
count = 100000

[redis_writer]
cluster = true
address = "xxxxxxx:6379"
tls = false
off_reply = false

@lianzekunqiliangjia lianzekunqiliangjia added the type: question Further information is requested label Nov 26, 2024
@suxb201
Copy link
Member

suxb201 commented Nov 26, 2024

https://tair-opensource.github.io/RedisShake/zh/reader/scan_reader.html

Redis 在默认情况下不会开启 notify-keyspace-events 配置,需要手动开启,保证值中含有 AE。

@lianzekunqiliangjia
Copy link
Author

感谢回复,notify-keyspace-events 配置为AKE 测试了一下,全量同步期间和全量同步后手动set几条好像还是无法增量同步,不知道是哪里有问题 用的是多DB单机elasticcache --> OCI的自建cluster集群
会跟我改的代码有关吗?我这个写死了theEntry.DbId = 0

@suxb201
Copy link
Member

suxb201 commented Dec 2, 2024

@lianzekunqiliangjia 你手动 set 的几条是 db0 吗?

@lianzekunqiliangjia
Copy link
Author

不是的,改这个会影响reader读取的DbId吗?

@suxb201
Copy link
Member

suxb201 commented Dec 2, 2024

不是的,改这个会影响reader读取的DbId吗?

  1. 你先撤回修改再测测
  2. 应该只影响会发往目的端的哪个 db

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants