Skip to content

Conversation

@stefaniereuter
Copy link

@stefaniereuter stefaniereuter commented Aug 26, 2025

Description

Opening this as a draft pull request, while finishing the refactoring on the grib comparison but to start discussing the design and features.

This draft shows the direction in which I would like to continue refactoring.

This tool allows to compare two FDB or two experiments in one FDB. It uses the standard fdb tool mechanisms, minimal-keys, CLI request, but also allows to directly specify mars keys, where entries should be ignored. it uses fdb list to generate a request then sorts the results and compares them, depending on scope, where the default is just a comparison of the mars keys, without the messages itself, possibility of comparing grib-header only and then grib-header plus data section. Default is a key by key comparison,
More explanation and examples can be found here:

https://confluence.ecmwf.int/display/~ecm4053/FDB+Comparison

Contributor Declaration

By opening this pull request, I affirm the following:

  • All authors agree to the Contributor License Agreement.
  • The code follows the project's coding standards.
  • I have performed self-review and added comments where needed.
  • I have added or updated tests to verify that my changes are effective and functional.
  • I have run all existing tests and confirmed they pass.

🌈🌦️📖🚧 Documentation 🚧📖🌦️🌈
https://sites.ecmwf.int/docs/dev-section/fdb/pull-requests/PR-165

🌈🌦️📖🚧 Documentation Z3FDB 🚧📖🌦️🌈
https://sites.ecmwf.int/docs/dev-section/z3fdb/pull-requests/PR-165

🌈🌦️📖🚧 Documentation FDB 🚧📖🌦️🌈
https://sites.ecmwf.int/docs/dev-section/fdb/pull-requests/PR-165

@stefaniereuter stefaniereuter requested a review from Ozaq August 26, 2025 06:36
@stefaniereuter
Copy link
Author

This was supposed to be a draft pull request....

@stefaniereuter stefaniereuter marked this pull request as draft August 26, 2025 06:43
@dsarmany dsarmany force-pushed the feature/FDB-327-fdb-compare branch from 684c81d to 722f460 Compare October 21, 2025 09:34
@pgeier pgeier force-pushed the feature/FDB-327-fdb-compare branch from 722f460 to 38d2604 Compare January 13, 2026 11:08
@stefaniereuter stefaniereuter force-pushed the feature/FDB-327-fdb-compare branch from 7b4aaf0 to 232d0b2 Compare January 15, 2026 12:38
@pgeier pgeier force-pushed the feature/FDB-327-fdb-compare branch from d6efd5d to 957b3c0 Compare January 16, 2026 12:51
@pgeier pgeier force-pushed the feature/FDB-327-fdb-compare branch 3 times, most recently from f6064e4 to c814917 Compare January 27, 2026 14:49
@pgeier
Copy link

pgeier commented Jan 27, 2026

Pending tasks:

  • add license to source and header files
  • document functions
  • fix tests
  • add data check tests

@pgeier pgeier force-pushed the feature/FDB-327-fdb-compare branch from c814917 to 2daf3e2 Compare January 27, 2026 14:54
@pgeier pgeier force-pushed the feature/FDB-327-fdb-compare branch from bcef5ed to b643bc8 Compare January 28, 2026 14:54
@codecov-commenter
Copy link

codecov-commenter commented Jan 28, 2026

Codecov Report

❌ Patch coverage is 54.10053% with 347 lines in your changes missing coverage. Please review.
✅ Project coverage is 72.66%. Comparing base (8abf5d2) to head (1b031b4).

Files with missing lines Patch % Lines
src/fdb5/tools/compare/grib/CompareBitwise.cc 0.00% 105 Missing ⚠️
src/fdb5/tools/compare/grib/Compare.cc 51.72% 56 Missing ⚠️
src/fdb5/tools/compare/grib/CompareKeys.cc 48.00% 52 Missing ⚠️
src/fdb5/tools/compare/fdb-compare.cc 73.18% 37 Missing ⚠️
src/fdb5/tools/compare/grib/CompareHash.cc 0.00% 32 Missing ⚠️
src/fdb5/tools/compare/common/DataMap.cc 73.68% 20 Missing ⚠️
src/fdb5/tools/compare/common/Util.cc 0.00% 19 Missing ⚠️
src/fdb5/tools/compare/common/Util.h 0.00% 6 Missing ⚠️
src/fdb5/tools/compare/grib/Utils.cc 78.57% 6 Missing ⚠️
src/fdb5/tools/compare/common/ComparisonMap.cc 79.16% 5 Missing ⚠️
... and 2 more
Additional details and impacted files
@@             Coverage Diff             @@
##           develop     #165      +/-   ##
===========================================
- Coverage    73.30%   72.66%   -0.64%     
===========================================
  Files          363      377      +14     
  Lines        21956    22712     +756     
  Branches      2253     2383     +130     
===========================================
+ Hits         16094    16504     +410     
- Misses        5862     6208     +346     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pgeier pgeier force-pushed the feature/FDB-327-fdb-compare branch from 3508d48 to 1b031b4 Compare January 29, 2026 09:49
@pgeier pgeier marked this pull request as ready for review January 29, 2026 10:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants