Another partner site tries out publishing to NG

[lliming]

• one of our next goals is to bring in another centre using the new publisher client tools to try publishing. I discussed this with Guillaume, IPSL could be in the position to be that next centre to try publishing to NG. They are maintaining the aux client publishing tools that support esgpublish so they have everything needed to try this next step now
• Set up a separate index as we would do for any other data challenge. ESGF-West could implement as a separate topic in the Kafka queue
• We’d like to get an idea of how many items Guillaume would like to publish
  IPSL publisher user would need to be onboarded in the IAM groups

[sashakames]

I have reached out to GFDL for another potential site.

[philipkershaw]

I have written to IPSL to ask

[glevava]

We have started our tests — for now using a single CMIP6 dataset and excluding QA/QC from the workflow.

We were able to install esgvoc and esgprep from scratch without any issues.
DRS structuring, versioning, and mapfile generation (including the new checksum format) all worked smoothly. We have already shared a few improvement suggestions with Laurent T. regarding esgprep.

We initially encountered some difficulties with the publisher installation, but this was mainly due to following the wrong procedure: this is now resolved. There are still a few dependency issues related to Globus, which we have reported to @sashakames. I also wanted to ask whether the dependency on esgconfigparser is still required, given that we are no longer relying on esg.ini files.

The publisher is now running, but we still need to configure it properly, in particular to obtain the required credentials.
On that topic, we are planning to publish to the East index (CEDA) — would you also like us to test against the West index (ORNL), or is that no longer necessary given the Kafka queue?

Once the publisher is fully configured, we will add around 10 test datasets that we have prepared and that pass QA/QC for CMIP6. With your approval, we can also test with CORDEX-CMIP6 datasets and the first CMIP7 files from CNRM that we have available.