data-integrator errors getting latest secret revision: state changing too quickly;

[Fedqys]

Hello!

I have a juju environment that consumes a DB as a SAAS. In there, I deployed a pgbouncer and a data-integrator. It was working well last week, and this week, when I logged in and ran juju status, pgbouncer and data-integrator were in an error state due to "secret-changed".

Specifically, this is the error I'm getting in the data integrator: ops.model.ModelError: ERROR getting latest secret revision: state changing too quickly; try again soon. (full traceback below)

I tried rebooting the unit to see if it gets the right secret, but it didn't work. I also tried running juju resolved to re-trigger the unit, but it didn’t work.

Versions

Operating system: Ubuntu 22.04.5 LTS

Juju CLI: 3.6.8-ubuntu-amd64

Juju agent: 3.6.14

Charm revision:

• data-integrator: 179
• pgbouncer: 877

Log output

Traceback:

unit-data-integrator-8: 12:41:40 INFO juju.worker.uniter awaiting error resolution for "secret-changed" hook
unit-data-integrator-8: 12:41:40 DEBUG unit.data-integrator/8.juju-log ops 2.22.0 up and running.
unit-data-integrator-8: 12:41:40 DEBUG unit.data-integrator/8.juju-log Emitting Juju event secret_changed.
unit-data-integrator-8: 12:41:40 INFO unit.data-integrator/8.juju-log authentication updated
unit-data-integrator-8: 12:41:40 INFO unit.data-integrator/8.juju-log etcd_ready updated
unit-data-integrator-8: 12:41:40 DEBUG unit.data-integrator/8.juju-log Emitting custom event <EtcdReadyEvent app='pgbouncer' unit='pgbouncer/7' on <ops.model.Relation postgresql:40> via IntegratorCharm/EtcdRequires[etcd]/on/etcd_ready[9059]>.
unit-data-integrator-8: 12:41:40 DEBUG unit.data-integrator/8.juju-log etcd ready received
unit-data-integrator-8: 12:41:41 ERROR unit.data-integrator/8.juju-log Uncaught exception while in charm code:
Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/model.py", line 3422, in _run
    result = subprocess.run(args, **kwargs)  # type: ignore
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('/var/lib/juju/tools/unit-data-integrator-8/secret-get', '--label', 'postgresql.40.user.secret', '--refresh', '--format=json')' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/src/charm.py", line 525, in <module>
    main(IntegratorCharm)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/__init__.py", line 356, in __call__
    return _main.main(charm_class=charm_class, use_juju_for_storage=use_juju_for_storage)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/_main.py", line 475, in main
    manager.run()
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/_main.py", line 459, in run
    self._emit()
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/_main.py", line 403, in _emit
    self._emit_charm_event(self.dispatcher.event_name)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/_main.py", line 438, in _emit_charm_event
    event_to_emit.emit(*args, **kwargs)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/framework.py", line 351, in emit
    framework._emit(event)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/framework.py", line 924, in _emit
    self._reemit(event_path)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/framework.py", line 1030, in _reemit
    custom_handler(event)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 4201, in _on_secret_changed_event
    getattr(self.on, "etcd_ready").emit(relation, app=relation.app, unit=remote_unit)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/framework.py", line 351, in emit
    framework._emit(event)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/framework.py", line 924, in _emit
    self._reemit(event_path)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/framework.py", line 1030, in _reemit
    custom_handler(event)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/src/charm.py", line 306, in _on_etcd_ready
    self._on_config_changed(event)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/src/charm.py", line 184, in _on_config_changed
    self.unit.status = self.get_status()
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/src/charm.py", line 133, in get_status
    self.is_database_related,
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/src/charm.py", line 443, in is_database_related
    possible_relations = [
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/src/charm.py", line 444, in <listcomp>
    self._check_for_credentials(database_requirer)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/src/charm.py", line 453, in _check_for_credentials
    if requirer.fetch_relation_field(
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1567, in fetch_relation_field
    self.fetch_relation_data([relation_id], [field], relation_name)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1559, in fetch_relation_data
    data[relation.id] = self._fetch_specific_relation_data(relation, fields)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1068, in _fetch_specific_relation_data
    return self._fetch_relation_data_with_secrets(
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1452, in _fetch_relation_data_with_secrets
    result, normal_fields = self._process_secret_fields(
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1396, in _process_secret_fields
    if group_result := operation(relation, group, secret_fields, *args, **kwargs):
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1331, in _get_group_secret_contents
    secret_data := secret.get_content()
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 752, in get_content
    self._secret_content = self.meta.get_content(refresh=True)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/model.py", line 1462, in get_content
    self._content = self._backend.secret_get(id=self.id, label=self.label, refresh=refresh)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/model.py", line 3808, in secret_get
    result = self._run('secret-get', *args, return_output=True, use_json=True)
  File "/var/lib/juju/agents/unit-data-integrator-8/charm/venv/lib/python3.10/site-packages/ops/model.py", line 3424, in _run
    raise ModelError(e.stderr) from e
ops.model.ModelError: ERROR getting latest secret revision: state changing too quickly; try again soon

Additional context

These are my juju relations:

Integration provider                   Requirer                               Interface              Type         Message
data-integrator:data-integrator-peers  data-integrator:data-integrator-peers  data-integrator-peers  peer         
pgbouncer:database                     data-integrator:postgresql             postgresql_client      subordinate  
pgbouncer:pgb-peers                    pgbouncer:pgb-peers                    pgb_peers              peer         
pgbouncer:upgrade                      pgbouncer:upgrade                      upgrade                peer         
postgresql:database                    pgbouncer:backend-database             postgresql_client      regular    

$ juju show-secret 04318833-3d82-4131-89ae-36b2fe3d4cbe/d5sgggeh3aneiqh6kubg --revisions
d5sgggeh3aneiqh6kubg:
  revision: 533
  owner: pgbouncer
  label: database.40.user.secret
  created: 2026-01-27T18:47:30Z
  updated: 2026-01-30T12:50:35Z
  revisions:
  - revision: 526
    backend: internal
    created: 2026-01-30T12:33:10Z
    updated: 2026-01-30T12:33:10Z
  - revision: 532
    backend: internal
    created: 2026-01-30T12:50:24Z
    updated: 2026-01-30T12:50:24Z
  access:
  - target: application-data-integrator
    scope: relation-data-integrator.postgresql#pgbouncer.database
    role: view

[syncronize-issues-to-jira]

Thank you for reporting your feedback to us!

The internal ticket has been created: https://warthogs.atlassian.net/browse/DPE-9374.

This message was autogenerated

[taurus-forever]

Hi @Fedqys ,

@Gu1nness is preparing a new stable release for data-integrator r344/r345, can you please give it a try?
Also, did you perform a model-migration there? Maybe: https://bugs.launchpad.net/juju/+bug/2069365

CC: @dragomirp JFYI, only, re: data-integrator<>pgbouncer.

[Gu1nness]

There's definitely something weird since it is the etcd handler that is triggering an event.
Maybe the secret-changed handlers are a bit too broad into what it handles and that could end up in that situation (I had a very similar situation a few days ago due to a similar bug).
Do you have any information in the logs that could explain the secret changed ? I have my guess, I'll investigate for that part.

[Fedqys]

Hey @Gu1nness !

I don't see anything that explains why the secret is changing. There is another error saying that the secret can not be found. I'll paste that traceback here as well.

Please let me know if you want me to run any specific command to retrieve that information.

unit-data-integrator-9: 13:47:56 ERROR juju.worker.uniter.operation hook "update-status" (via hook dispatching script: dispatch) failed: exit status 1
unit-data-integrator-9: 13:47:56 INFO juju.worker.uniter awaiting error resolution for "update-status" hook
unit-pgbouncer-8: 13:48:52 DEBUG unit.pgbouncer/8.juju-log ops 2.23.1 up and running.
unit-pgbouncer-8: 13:48:53 DEBUG unit.pgbouncer/8.juju-log no relation on 'cos-agent': tracing not ready
unit-pgbouncer-8: 13:48:53 DEBUG unit.pgbouncer/8.juju-log Starting root trace with id='c06a2eeacdb90a3afd1a2827083be1c0'.
unit-pgbouncer-8: 13:48:53 DEBUG unit.pgbouncer/8.juju-log Emitting Juju event update_status.
unit-pgbouncer-8: 13:48:53 DEBUG unit.pgbouncer/8.juju-log Starting root trace with id='c06a2eeacdb90a3afd1a2827083be1c0'.
unit-pgbouncer-8: 13:48:59 WARNING unit.pgbouncer/8.juju-log charm tracing buffer exceeds max history length (100 events)
unit-pgbouncer-8: 13:49:00 DEBUG unit.pgbouncer/8.juju-log Executing command: ['systemctl', '--quiet', 'is-active', 'pgbouncer-pgbouncer@0']
unit-pgbouncer-8: 13:49:00 DEBUG unit.pgbouncer/8.juju-log Command ['systemctl', '--quiet', 'is-active', 'pgbouncer-pgbouncer@0'] exit code: 0. systemctl output:

unit-pgbouncer-8: 13:49:00 DEBUG unit.pgbouncer/8.juju-log Executing command: ['systemctl', '--quiet', 'is-active', 'pgbouncer-pgbouncer@1']
unit-pgbouncer-8: 13:49:00 DEBUG unit.pgbouncer/8.juju-log Command ['systemctl', '--quiet', 'is-active', 'pgbouncer-pgbouncer@1'] exit code: 0. systemctl output:

unit-pgbouncer-8: 13:49:00 DEBUG unit.pgbouncer/8.juju-log Executing command: ['systemctl', '--quiet', 'is-active', 'pgbouncer-pgbouncer-prometheus']
unit-pgbouncer-8: 13:49:00 DEBUG unit.pgbouncer/8.juju-log Command ['systemctl', '--quiet', 'is-active', 'pgbouncer-pgbouncer-prometheus'] exit code: 0. systemctl output:

unit-pgbouncer-8: 13:49:00 WARNING unit.pgbouncer/8.juju-log charm tracing buffer exceeds max history length (100 events)
unit-pgbouncer-8: 13:49:00 INFO juju.worker.uniter.operation ran "update-status" hook (via hook dispatching script: dispatch)
unit-data-integrator-10: 13:49:39 INFO juju.worker.uniter awaiting error resolution for "update-status" hook
unit-data-integrator-10: 13:49:39 DEBUG unit.data-integrator/10.juju-log ops 2.22.0 up and running.
unit-data-integrator-10: 13:49:39 DEBUG unit.data-integrator/10.juju-log Emitting Juju event update_status.
unit-data-integrator-10: 13:49:39 ERROR unit.data-integrator/10.juju-log Uncaught exception while in charm code:
Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/model.py", line 3422, in _run
    result = subprocess.run(args, **kwargs)  # type: ignore
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('/var/lib/juju/tools/unit-data-integrator-10/secret-get', 'secret://04318833-3d82-4131-89ae-36b2fe3d4cbe/d5sgggeh3aneiqh6kubg', '--label', 'postgresql.40.user.secret', '--format=json')' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/model.py", line 3808, in secret_get
    result = self._run('secret-get', *args, return_output=True, use_json=True)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/model.py", line 3424, in _run
    raise ModelError(e.stderr) from e
ops.model.ModelError: ERROR secret revision "d5sgggeh3aneiqh6kubg/533" not found


The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/src/charm.py", line 525, in <module>
    main(IntegratorCharm)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/__init__.py", line 356, in __call__
    return _main.main(charm_class=charm_class, use_juju_for_storage=use_juju_for_storage)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/_main.py", line 475, in main
    manager.run()
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/_main.py", line 459, in run
    self._emit()
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/_main.py", line 403, in _emit
    self._emit_charm_event(self.dispatcher.event_name)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/_main.py", line 438, in _emit_charm_event
    event_to_emit.emit(*args, **kwargs)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/framework.py", line 351, in emit
    framework._emit(event)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/framework.py", line 924, in _emit
    self._reemit(event_path)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/framework.py", line 1030, in _reemit
    custom_handler(event)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/src/charm.py", line 179, in _on_update_status
    self.unit.status = self.get_status()
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/src/charm.py", line 133, in get_status
    self.is_database_related,
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/src/charm.py", line 443, in is_database_related
    possible_relations = [
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/src/charm.py", line 444, in <listcomp>
    self._check_for_credentials(database_requirer)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/src/charm.py", line 453, in _check_for_credentials
    if requirer.fetch_relation_field(
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1567, in fetch_relation_field
    self.fetch_relation_data([relation_id], [field], relation_name)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1559, in fetch_relation_data
    data[relation.id] = self._fetch_specific_relation_data(relation, fields)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1068, in _fetch_specific_relation_data
    return self._fetch_relation_data_with_secrets(
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1452, in _fetch_relation_data_with_secrets
    result, normal_fields = self._process_secret_fields(
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1396, in _process_secret_fields
    if group_result := operation(relation, group, secret_fields, *args, **kwargs):
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1330, in _get_group_secret_contents
    if (secret := self._get_relation_secret(relation.id, group)) and (
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 509, in wrapper
    return f(self, *args, **kwargs)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1047, in _get_relation_secret
    return self.secrets.get(label, secret_uri)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 814, in get
    if secret.meta:
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 651, in meta
    self._secret_meta = self._model.get_secret(id=self._secret_uri, label=self.label)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/model.py", line 313, in get_secret
    content = self._backend.secret_get(id=id, label=label)
  File "/var/lib/juju/agents/unit-data-integrator-10/charm/venv/lib/python3.10/site-packages/ops/model.py", line 3811, in secret_get
    raise SecretNotFoundError() from e
ops.model.SecretNotFoundError
unit-data-integrator-10: 13:49:39 ERROR juju.worker.uniter.operation hook "update-status" (via hook dispatching script: dispatch) failed: exit status 1
unit-data-integrator-10: 13:49:39 INFO juju.worker.uniter awaiting error resolution for "update-status" hook
unit-data-integrator-8: 13:50:09 INFO juju.worker.uniter awaiting error resolution for "secret-changed" hook
unit-pgbouncer-7: 13:50:56 INFO juju.worker.uniter awaiting error resolution for "update-status" hook
unit-pgbouncer-7: 13:51:20 INFO juju.worker.uniter awaiting error resolution for "update-status" hook
unit-pgbouncer-7: 13:51:20 DEBUG unit.pgbouncer/7.juju-log ops 2.23.1 up and running.
unit-pgbouncer-7: 13:51:21 DEBUG unit.pgbouncer/7.juju-log no relation on 'cos-agent': tracing not ready
unit-pgbouncer-7: 13:51:21 DEBUG unit.pgbouncer/7.juju-log Starting root trace with id='3a810bb364f01f0469b11d9d66659e2f'.
unit-pgbouncer-7: 13:51:21 DEBUG unit.pgbouncer/7.juju-log Emitting Juju event update_status.
unit-pgbouncer-7: 13:51:21 DEBUG unit.pgbouncer/7.juju-log Starting root trace with id='3a810bb364f01f0469b11d9d66659e2f'.
unit-data-integrator-8: 13:51:22 INFO juju.worker.uniter awaiting error resolution for "secret-changed" hook
unit-pgbouncer-7: 13:51:27 WARNING unit.pgbouncer/7.juju-log charm tracing buffer exceeds max history length (100 events)
unit-pgbouncer-7: 13:51:27 DEBUG unit.pgbouncer/7.juju-log Executing command: ['systemctl', '--quiet', 'is-active', 'pgbouncer-pgbouncer@0']
unit-pgbouncer-7: 13:51:27 DEBUG unit.pgbouncer/7.juju-log Command ['systemctl', '--quiet', 'is-active', 'pgbouncer-pgbouncer@0'] exit code: 0. systemctl output:

unit-pgbouncer-7: 13:51:27 DEBUG unit.pgbouncer/7.juju-log Executing command: ['systemctl', '--quiet', 'is-active', 'pgbouncer-pgbouncer@1']
unit-pgbouncer-7: 13:51:27 DEBUG unit.pgbouncer/7.juju-log Command ['systemctl', '--quiet', 'is-active', 'pgbouncer-pgbouncer@1'] exit code: 0. systemctl output:

unit-pgbouncer-7: 13:51:27 DEBUG unit.pgbouncer/7.juju-log Executing command: ['systemctl', '--quiet', 'is-active', 'pgbouncer-pgbouncer-prometheus']
unit-pgbouncer-7: 13:51:27 DEBUG unit.pgbouncer/7.juju-log Command ['systemctl', '--quiet', 'is-active', 'pgbouncer-pgbouncer-prometheus'] exit code: 0. systemctl output:

unit-pgbouncer-7: 13:51:28 WARNING unit.pgbouncer/7.juju-log charm tracing buffer exceeds max history length (100 events)
unit-pgbouncer-7: 13:51:28 ERROR unit.pgbouncer/7.juju-log Uncaught exception while in charm code:
Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/venv/lib/python3.10/site-packages/ops/model.py", line 3637, in _run
    result = subprocess.run(args, **kwargs)  # type: ignore
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '('/var/lib/juju/tools/unit-pgbouncer-7/secret-get', '--label', 'database.40.user.secret', '--refresh', '--format=json')' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/src/charm.py", line 1044, in <module>
    main(PgBouncerCharm)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/venv/lib/python3.10/site-packages/ops/__init__.py", line 356, in __call__
    return _main.main(charm_class=charm_class, use_juju_for_storage=use_juju_for_storage)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/venv/lib/python3.10/site-packages/ops/_main.py", line 502, in main
    manager.run()
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/venv/lib/python3.10/site-packages/ops/_main.py", line 486, in run
    self._emit()
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/venv/lib/python3.10/site-packages/ops/_main.py", line 421, in _emit
    self._emit_charm_event(self.dispatcher.event_name)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/venv/lib/python3.10/site-packages/ops/_main.py", line 465, in _emit_charm_event
    event_to_emit.emit(*args, **kwargs)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/venv/lib/python3.10/site-packages/ops/framework.py", line 351, in emit
    framework._emit(event)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/venv/lib/python3.10/site-packages/ops/framework.py", line 924, in _emit
    self._reemit(event_path)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/venv/lib/python3.10/site-packages/ops/framework.py", line 1030, in _reemit
    custom_handler(event)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1153, in wrapped_function
    return callable(*args, **kwargs)  # type: ignore
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/src/charm.py", line 541, in _on_update_status
    self.peers.update_leader()
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1153, in wrapped_function
    return callable(*args, **kwargs)  # type: ignore
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/src/relations/peers.py", line 160, in update_leader
    self.charm.update_client_connection_info()
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1153, in wrapped_function
    return callable(*args, **kwargs)  # type: ignore
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/src/charm.py", line 1031, in update_client_connection_info
    self.client_relation.update_connection_info(relation)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/tempo_coordinator_k8s/v0/charm_tracing.py", line 1153, in wrapped_function
    return callable(*args, **kwargs)  # type: ignore
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/src/relations/pgbouncer_provider.py", line 290, in update_connection_info
    password = self.database_provides.fetch_my_relation_field(relation.id, "password")
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 624, in wrapper
    return f(self, *args, **kwargs)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1772, in fetch_my_relation_field
    if relation_data := self.fetch_my_relation_data([relation_id], [field], relation_name):
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 624, in wrapper
    return f(self, *args, **kwargs)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1761, in fetch_my_relation_data
    data[relation.id] = self._fetch_my_specific_relation_data(relation, fields)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1240, in _fetch_my_specific_relation_data
    return self._fetch_relation_data_with_secrets(
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1614, in _fetch_relation_data_with_secrets
    result, normal_fields = self._process_secret_fields(
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1558, in _process_secret_fields
    if group_result := operation(relation, group, secret_fields, *args, **kwargs):
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 1493, in _get_group_secret_contents
    secret_data := secret.get_content()
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/lib/charms/data_platform_libs/v0/data_interfaces.py", line 912, in get_content
    self._secret_content = self.meta.get_content(refresh=True)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/venv/lib/python3.10/site-packages/ops/model.py", line 1487, in get_content
    self._content = self._backend.secret_get(id=self.id, label=self.label, refresh=refresh)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/venv/lib/python3.10/site-packages/ops/model.py", line 4023, in secret_get
    result = self._run('secret-get', *args, return_output=True, use_json=True)
  File "/var/lib/juju/agents/unit-pgbouncer-7/charm/venv/lib/python3.10/site-packages/ops/model.py", line 3639, in _run
    raise ModelError(e.stderr) from e
ops.model.ModelError: ERROR getting latest secret revision: state changing too quickly; try again soon

[dragomirp]

Hi, @Fedqys, can you try checking which field is being changed between revisions of the secret? That should give us a better idea why the secret is being overwritten.

[Fedqys]

Hey @dragomirp !

It looks like the revisions were removed. Now, when I do juju show-secret 04318833-3d82-4131-89ae-36b2fe3d4cbe/d5sgggeh3aneiqh6kubg I only get one revision, which, when I try to reveal, I get error: secret revision "d5sgggeh3aneiqh6kubg/533" not found.

$ juju show-secret 04318833-3d82-4131-89ae-36b2fe3d4cbe/d5sgggeh3aneiqh6kubg
d5sgggeh3aneiqh6kubg:
  revision: 533
  owner: pgbouncer
  label: database.40.user.secret
  created: 2026-01-27T18:47:30Z
  updated: 2026-01-30T12:50:35Z
  access:
  - target: application-data-integrator
    scope: relation-data-integrator.postgresql#pgbouncer.database
    role: view

[marceloneppel]

Hi, @Fedqys! The revision removal might have happened due to juju/juju#21783.