Skip to content

decompress meta and job info failed #661

@xinhai123456

Description

@xinhai123456

doris 跨集群数据同步, CCR使用ccr-syncer-3.0.6-rc04-x64,两个doris2.1.8集群之间同步是可行的。
但是从源集群(版本2.1.8)同步到目标集群(版本4.0.1)就不行。

[2025-12-16 17:03:52.153] WARN job sync failed, job: ccr_test, err: [normal] restore snapshot failed, status: TStatus({StatusCode:ANALYSIS_ERROR ErrorMsgs:[errCode = 2, detailMessage = decompress meta and job info failed]})

Image

报错具体日志:[2025-12-16 17:03:18.453] INFO JOB STATUS: FullSync = 0, PartialSync = 0, IncrementalSync = 0 line=ccr_syncer/monitor.go:86
[2025-12-16 17:03:29.845] INFO create ccr line=service/http_service.go:203
[2025-12-16 17:03:29.846] INFO create ccr name: ccr_test, src: {{10.10.18.92 9030 9020 false} [] root finchina_monitor 0 finchina_app_info 0 map[] []}, dest: {{10.99.22.45 9030 9020 false} [] root finchina_monitor 0 finchina_app_info 0 map[] []} line=service/http_service.go:135
[2025-12-16 17:03:29.846] INFO add job: ccr_test line=ccr/job_manager.go:59
[2025-12-16 17:03:29.847] INFO first run check job, name: ccr_test, src: host: 10.10.18.92, port: 9030, thrift_port: 9020, user: root, cluster: , database: finchina_monitor, database id: 0, table: finchina_app_info, table id: 0, dest: host: 10.99.22.45, port: 9030, thrift_port: 9020, user: root, cluster: , database: finchina_monitor, database id: 0, table: finchina_app_info, table id: 0 line=ccr/job.go:4259
[2025-12-16 17:03:31.095] INFO check table finchina_monitor.finchina_app_info properties valid line=base/spec.go:344
[2025-12-16 17:03:31.113] INFO new snapshot, commitSeq: 0, prevCommitSeq: 0, prevSyncState: TableFullSync, prevSubSyncState: BeginCreateSnapshot job=ccr_test line=ccr/job.go:4003
[2025-12-16 17:03:34.116] INFO fullsync status: create snapshot with prefix ccrs_ccr_test_1765875812 job=ccr_test line=ccr/job.go:969
[2025-12-16 17:03:34.120] INFO fullsync status: create snapshot ccrs_ccr_test_1765875812_1765875814 job=ccr_test line=ccr/job.go:1015
[2025-12-16 17:03:34.121] INFO create snapshot finchina_monitor.ccrs_ccr_test_1765875812_1765875814, backup snapshot sql: BACKUP SNAPSHOT finchina_monitor.ccrs_ccr_test_1765875812_1765875814 TO __keep_on_local__ ON ( finchina_app_info ) PROPERTIES ("type" = "full") job=ccr_test line=base/spec.go:771
[2025-12-16 17:03:37.119] INFO check snapshot ccrs_ccr_test_1765875812_1765875814 backup state: [SNAPSHOTING] job=ccr_test line=base/spec.go:843
[2025-12-16 17:03:40.118] INFO check snapshot ccrs_ccr_test_1765875812_1765875814 backup state: [UPLOAD_SNAPSHOT] job=ccr_test line=base/spec.go:843
[2025-12-16 17:03:43.118] INFO check snapshot ccrs_ccr_test_1765875812_1765875814 backup state: [UPLOADING] job=ccr_test line=base/spec.go:843
[2025-12-16 17:03:46.118] INFO check snapshot ccrs_ccr_test_1765875812_1765875814 backup state: [SAVE_META] job=ccr_test line=base/spec.go:843
[2025-12-16 17:03:49.118] INFO check snapshot ccrs_ccr_test_1765875812_1765875814 backup state: [UPLOAD_INFO] job=ccr_test line=base/spec.go:843
[2025-12-16 17:03:52.118] INFO check snapshot ccrs_ccr_test_1765875812_1765875814 backup state: [FINISHED] job=ccr_test line=base/spec.go:843
[2025-12-16 17:03:52.121] INFO fullsync status: get snapshot info job=ccr_test line=ccr/job.go:1039
[2025-12-16 17:03:52.126] INFO fullsync status: add extra info job=ccr_test line=ccr/job.go:1126
[2025-12-16 17:03:52.126] INFO snapshot ccrs_ccr_test_1765875812_1765875814 response meta size: 9734, job info size: 955, expired at: 1765962214127, commit seq: 102186364 job=ccr_test line=ccr/job.go:1132
[2025-12-16 17:03:52.128] INFO gen extra info with master token 531397e8-99da-41d3-afc0-e98abda24482 job=ccr_test line=ccr/job.go:392
[2025-12-16 17:03:52.129] INFO gen extra info with backend: Backend: {Id: 10025, Host: 10.10.18.90, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} job=ccr_test line=ccr/job.go:403
[2025-12-16 17:03:52.129] INFO gen extra info with backend: Backend: {Id: 10026, Host: 10.10.18.92, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} job=ccr_test line=ccr/job.go:403
[2025-12-16 17:03:52.129] INFO gen extra info with backend: Backend: {Id: 10045, Host: 10.10.18.93, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} job=ccr_test line=ccr/job.go:403
[2025-12-16 17:03:52.129] INFO gen extra info with backend: Backend: {Id: 31240324, Host: 10.10.17.137, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} job=ccr_test line=ccr/job.go:403
[2025-12-16 17:03:52.129] INFO gen extra info with backend: Backend: {Id: 31263690, Host: 10.10.17.138, BePort: 9060, HttpPort: 8040, BrpcPort: 8060} job=ccr_test line=ccr/job.go:403
[2025-12-16 17:03:52.130] INFO fullsync status: restore snapshot job=ccr_test line=ccr/job.go:1147
[2025-12-16 17:03:52.138] INFO fullsync status: begin restore snapshot ccrs_ccr_test_1765875812_1765875814 to ccrs_ccr_test_1765875812_1765875814_r_1765875832 job=ccr_test line=ccr/job.go:1184
[2025-12-16 17:03:52.153] WARN job sync failed, job: ccr_test, err: [normal] restore snapshot failed, status: TStatus({StatusCode:ANALYSIS_ERROR ErrorMsgs:[errCode = 2, detailMessage = decompress meta and job info failed]})
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).fullSync
/root/workspace/ccr-syncer/pkg/ccr/job.go:1271
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).fullSync
/root/workspace/ccr-syncer/pkg/ccr/job.go:1487
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).fullSync
/root/workspace/ccr-syncer/pkg/ccr/job.go:1487
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).fullSync
/root/workspace/ccr-syncer/pkg/ccr/job.go:1487
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).tableSync
/root/workspace/ccr-syncer/pkg/ccr/job.go:3855
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).sync
/root/workspace/ccr-syncer/pkg/ccr/job.go:3930
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).run
/root/workspace/ccr-syncer/pkg/ccr/job.go:3991
github.com/selectdb/ccr_syncer/pkg/ccr.(*Job).Run
/root/workspace/ccr-syncer/pkg/ccr/job.go:4119
github.com/selectdb/ccr_syncer/pkg/ccr.(*JobManager).runJob.func1
/root/workspace/ccr-syncer/pkg/ccr/job_manager.go:184
runtime.goexit
/root/workspace/go/src/runtime/asm_amd64.s:1695 job=ccr_test line=ccr/job.go:3996

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions