-
Notifications
You must be signed in to change notification settings - Fork 43
Description
doris 跨集群数据同步, CCR使用ccr-syncer-3.0.6-rc04-x64,两个doris2.1.8集群之间同步是可行的。
但是从源集群(版本2.1.8)同步到目标集群(版本4.0.1)就不行。
[2025-12-16 17:03:52.153] WARN job sync failed, job: ccr_test, err: [normal] restore snapshot failed, status: TStatus({StatusCode:ANALYSIS_ERROR ErrorMsgs:[errCode = 2, detailMessage = decompress meta and job info failed]})
报错具体日志:[2025-12-16 17:03:18.453] INFO JOB STATUS: FullSync = 0, PartialSync = 0, IncrementalSync = 0 line=ccr_syncer/monitor.go:86
[2025-12-16 17:03:29.845] INFO create ccr line=service/http_service.go:203
[2025-12-16 17:03:29.846] INFO create ccr name: ccr_test, src: {{10.10.18.92 9030 9020 false} [] root finchina_monitor 0 finchina_app_info 0 map[] []}, dest: {{10.99.22.45 9030 9020 false} [] root finchina_monitor 0 finchina_app_info 0 map[] []} line=service/http_service.go:135
[2025-12-16 17:03:29.846] INFO add job: ccr_test line=ccr/job_manager.go:59
[2025-12-16 17:03:29.847] INFO first run check job, name: ccr_test, src: host: 10.10.18.92, port: 9030, thrift_port: 9020, user: root, cluster: , database: finchina_monitor, database id: 0, table: finchina_app_info, table id: 0, dest: host: 10.99.22.45, port: 9030, thrift_port: 9020, user: root, cluster: , database: finchina_monitor, database id: 0, table: finchina_app_info, table id: 0 line=ccr/job.go:4259
[2025-12-16 17:03:31.095] INFO check table finchina_monitor.finchina_app_info properties valid line=base/spec.go:344
[2025-12-16 17:03:31.113] INFO new snapshot, commitSeq: 0, prevCommitSeq: 0, prevSyncState: TableFullSync, prevSubSyncState: BeginCreateSnapshot job=ccr_test line=ccr/job.go:4003
[2025-12-16 17:03:34.116] INFO fullsync status: create snapshot with prefix ccrs_ccr_test_1765875812 job=ccr_test line=ccr/job.go:969
[2025-12-16 17:03:34.120] INFO fullsync status: create snapshot ccrs_ccr_test_1765875812_1765875814 job=ccr_test line=ccr/job.go:1015
[2025-12-16 17:03:34.121] INFO create snapshot finchina_monitor.ccrs_ccr_test_1765875812_1765875814, backup snapshot sql: BACKUP SNAPSHOT finchina_monitor.ccrs_ccr_test_1765875812_1765875814 TO __keep_on_local__ ON ( finchina_app_info ) PROPERTIES ("type" = "full") job=ccr_test line=base/spec.go:771
[2025-12-16 17:03:37.119] INFO check snapshot ccrs_ccr_test_1765875812_1765875814 backup state: [SNAPSHOTING] job=ccr_test line=base/spec.go:843
[2025-12-16 17:03:40.118] INFO check snapshot ccrs_ccr_test_1765875812_1765875814 backup state: [UPLOAD_SNAPSHOT] job=ccr_test line=base/spec.go:843
[2025-12-16 17:03:43.118] INFO check snapshot ccrs_ccr_test_1765875812_1765875814 backup state: [UPLOADING] job=ccr_test line=base/spec.go:843
[2025-12-16 17:03:46.118] INFO check snapshot ccrs_ccr_test_1765875812_1765875814 backup state: [SAVE_META] job=ccr_test line=base/spec.go:843
[2025-12-16 17:03:49.118] INFO check snapshot ccrs_ccr_test_1765875812_1765875814 backup state: [UPLOAD_INFO] job=ccr_test line=base/spec.go:843
[2025-12-16 17:03:52.118] INFO check snapshot ccrs_ccr_test_1765875812_1765875814 backup state: [FINISHED] job=ccr_test line=base/spec.go:843
[2025-12-16 17:03:52.121] INFO fullsync status: get snapshot info job=ccr_test line=ccr/job.go:1039
[2025-12-16 17:03:52.126] INFO fullsync status: add extra info job=ccr_test line=ccr/job.go:1126
[2025-12-16 17:03:52.126] INFO snapshot ccrs_ccr_test_1765875812_1765875814 response meta size: 9734, job info size: 955, expired at: 1765962214127, commit seq: 102186364 job=ccr_test line=ccr/job.go:1132
[2025-12-16 17:03:52.128] INFO gen extra info with master token 531397e8-99da-41d3-afc0-e98abda24482 job=ccr_test line=ccr/job.go:392
[2025-12-16 17:03:52.129] INFO gen extra info with backend: Backend: {Id: 10025, Host: 10.10.18.90, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} job=ccr_test line=ccr/job.go:403
[2025-12-16 17:03:52.129] INFO gen extra info with backend: Backend: {Id: 10026, Host: 10.10.18.92, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} job=ccr_test line=ccr/job.go:403
[2025-12-16 17:03:52.129] INFO gen extra info with backend: Backend: {Id: 10045, Host: 10.10.18.93, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} job=ccr_test line=ccr/job.go:403
[2025-12-16 17:03:52.129] INFO gen extra info with backend: Backend: {Id: 31240324, Host: 10.10.17.137, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} job=ccr_test line=ccr/job.go:403
[2025-12-16 17:03:52.129] INFO gen extra info with backend: Backend: {Id: 31263690, Host: 10.10.17.138, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} job=ccr_test line=ccr/job.go:403
[2025-12-16 17:03:52.130] INFO fullsync status: restore snapshot job=ccr_test line=ccr/job.go:1147
[2025-12-16 17:03:52.138] INFO fullsync status: begin restore snapshot ccrs_ccr_test_1765875812_1765875814 to ccrs_ccr_test_1765875812_1765875814_r_1765875832 job=ccr_test line=ccr/job.go:1184
[2025-12-16 17:03:52.153] WARN job sync failed, job: ccr_test, err: [normal] restore snapshot failed, status: TStatus({StatusCode:ANALYSIS_ERROR ErrorMsgs:[errCode = 2, detailMessage = decompress meta and job info failed]})
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).fullSync
/root/workspace/ccr-syncer/pkg/ccr/job.go:1271
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).fullSync
/root/workspace/ccr-syncer/pkg/ccr/job.go:1487
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).fullSync
/root/workspace/ccr-syncer/pkg/ccr/job.go:1487
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).fullSync
/root/workspace/ccr-syncer/pkg/ccr/job.go:1487
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).tableSync
/root/workspace/ccr-syncer/pkg/ccr/job.go:3855
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).sync
/root/workspace/ccr-syncer/pkg/ccr/job.go:3930
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).run
/root/workspace/ccr-syncer/pkg/ccr/job.go:3991
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).Run
/root/workspace/ccr-syncer/pkg/ccr/job.go:4119
github.com/selectdb/ccr_syncer/pkg/ccr.(*JobManager).runJob.func1
/root/workspace/ccr-syncer/pkg/ccr/job_manager.go:184
runtime.goexit
/root/workspace/go/src/runtime/asm_amd64.s:1695 job=ccr_test line=ccr/job.go:3996