Skip to content

Add timeout and retry to DatasetFileDocument file-service requests #5666

Description

@Ma77Ball

Task Summary

DatasetFileDocument (amber/src/main/python/pytexera/storage/dataset_file_document.py) makes two requests.get() calls, the presigned-URL fetch in get_presigned_url and the file download in read_file, with no timeout. Since requests defaults to no timeout, a slow, hung, or unreachable file-service blocks the worker thread indefinitely, with no recovery from transient network blips. Add a request timeout and a bounded retry policy so these calls fail in bounded time and ride out transient connection errors / 5xx responses. Both calls are idempotent GETs, so retrying is safe.

Task Type

  • Performance

Metadata

Metadata

Assignees

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions