Matt Aitken
68e88d0d71
Object Storage seamless migration ( #3275 )
...
This allows seamless migration to different object storage.
Existing runs that have offloaded payloads/outputs will continue to use
the default object store (configured using `OBJECT_STORE_*` env vars).
You can add additional stores by setting new env vars:
- `OBJECT_STORE_DEFAULT_PROTOCOL` this determines where new run large
payloads will get stored.
- If you set that you need to set new env vars for that protocol.
Example:
```
OBJECT_STORE_DEFAULT_PROTOCOL=“s3"
OBJECT_STORE_S3_BASE_URL=https://s3.us-east-1.amazonaws.com
OBJECT_STORE_S3_ACCESS_KEY_ID=<val>
OBJECT_STORE_S3_SECRET_ACCESS_KEY=<val>
OBJECT_STORE_S3_REGION=us-east-1
OBJECT_STORE_S3_SERVICE=s3
```
---------
Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com >
2026-04-01 10:06:12 +01:00
..
2026-03-05 11:04:26 +01:00
2026-02-10 21:53:41 +00:00
2026-03-25 15:28:41 +00:00
2026-02-19 13:50:13 +00:00
2023-08-02 15:09:35 +01:00
2026-02-26 16:56:07 +00:00
2026-02-26 16:56:07 +00:00
2026-03-25 15:28:41 +00:00
2026-03-25 15:28:41 +00:00
2026-04-01 10:06:12 +01:00
2026-02-20 10:55:48 -05:00
2026-03-25 15:28:41 +00:00
2023-08-02 15:09:35 +01:00
2025-08-18 12:34:55 +01:00
2025-12-16 14:32:49 +00:00
2025-12-22 15:35:43 +00:00
2026-02-05 15:22:44 -08:00
2025-08-18 12:34:55 +01:00
2024-08-07 11:13:45 +01:00
2026-03-02 12:42:05 +00:00
2025-03-04 12:00:06 +00:00
2024-10-31 09:49:59 +00:00
2024-09-17 11:40:25 +01:00
2024-09-11 17:14:39 +01:00
2024-09-11 17:14:39 +01:00
2024-09-17 11:40:25 +01:00
2024-09-17 11:40:25 +01:00
2024-09-17 11:40:25 +01:00
2024-09-17 11:40:25 +01:00
2024-09-17 11:40:25 +01:00
2025-08-18 12:34:55 +01:00
2025-03-04 12:00:06 +00:00
2025-08-18 12:34:55 +01:00
2024-09-17 11:40:25 +01:00
2024-09-17 11:40:25 +01:00
2024-08-07 11:13:45 +01:00
2025-08-18 12:34:55 +01:00
2026-02-04 09:37:35 -05:00
2026-03-31 17:38:39 -04:00
2026-03-25 15:28:41 +00:00
2025-02-03 14:30:03 +00:00
2026-02-10 21:53:41 +00:00
2025-10-14 17:29:42 +02:00
2024-08-07 11:13:45 +01:00
2024-08-07 11:13:45 +01:00
2025-12-03 13:23:38 +00:00
2025-08-18 12:34:55 +01:00
2026-01-24 09:00:50 +00:00
2026-01-07 16:40:04 +00:00
2026-02-04 09:37:35 -05:00
2026-01-29 13:55:43 +00:00
2024-08-07 11:13:45 +01:00
2026-03-04 11:50:59 +00:00
2026-02-26 16:56:07 +00:00
2025-09-12 14:54:39 +01:00
2025-11-19 11:16:35 +00:00
2026-02-05 15:22:44 -08:00
2026-02-05 15:22:44 -08:00
2026-02-05 15:22:44 -08:00
2026-02-20 10:55:48 -05:00
2025-08-18 12:34:55 +01:00
2025-08-18 12:34:55 +01:00
2026-03-31 17:38:39 -04:00
2024-08-07 11:13:45 +01:00
2024-08-07 11:13:45 +01:00
2025-12-04 17:58:25 +00:00
2025-12-22 15:35:43 +00:00
2024-08-28 10:39:34 +01:00
2026-02-18 22:35:39 +00:00
2026-03-25 15:28:41 +00:00
2023-10-02 14:26:54 +01:00
2025-01-29 16:01:01 +00:00
2024-08-07 11:13:45 +01:00
2024-08-07 11:13:45 +01:00
2025-08-18 12:34:55 +01:00
2026-02-04 14:05:59 +00:00
2026-02-25 11:18:44 +00:00
2026-02-05 15:22:44 -08:00
2026-01-29 13:59:27 +00:00
2025-11-13 14:43:31 +00:00
2024-09-23 15:14:34 +01:00
2026-03-25 15:28:41 +00:00
2025-08-18 12:34:55 +01:00
2025-02-19 16:06:42 +00:00
2024-08-07 11:13:45 +01:00
2024-08-07 11:13:45 +01:00
2026-02-26 16:01:31 -05:00
2025-08-18 12:34:55 +01:00
2024-09-20 16:12:14 +01:00
2026-02-25 12:52:14 -05:00
2026-03-11 17:56:37 -04:00
2026-01-24 08:59:55 +00:00
2025-08-07 16:02:52 +01:00
2026-03-04 09:55:54 +00:00
2025-08-18 12:34:55 +01:00
2025-08-18 12:34:55 +01:00
2026-03-04 09:55:54 +00:00
2025-08-18 12:34:55 +01:00