5ff738a18c
checkpointing fixes
2024-03-19 19:21:12 +00:00
9945980ab0
update kubernetes provider and fix builds again
2024-03-18 18:45:00 +00:00
478ce006cb
v3: task run status and canceling runs ( #941 )
...
* WIP task run status, revamped resuming task dependencies
* Don’t select a span when toggling collapsing
* Cancel runs and attempts, in prod and dev
2024-03-13 15:51:43 +00:00
9b6f8f9238
v3: provider and coordinator updates ( #927 )
...
* add zod socket
* start using zod socket
* use zod socket for shared queue
* use shared provider shell
* update k8s provider task ops
* set otlp endpoint
* update docker actions and fix builds
* remove unused types
* update injected secret key env var name
* complete socket.io types to schemas migration
* update env example to new v3 key var
* fix coordinator build
* set task run label
* ensure attempt id is always set
* increase prod worker timeout
* set otlp endpoint for on runs
* pass otlp env var to prod worker
* auto-remove completed index jobs
2024-03-06 16:01:59 +00:00
52c9d485f8
v3: cli build command, prod runs, checkpoints ( #919 )
...
* fix trailing slash in api url
* add maybe platform down error
* shorten config path
* extend protobuf compiler install instructions
* build command and image model
* new image triggers task indexing
* index support for prod builds
* shorten example provider secret
* multi-stage task prod build
* lock prod tasks to node 18 image
* extract shared build and dev command libs
* pull out more shared deps
* add coordinator and providers
* fix core-apps build
* add dev builds for new apps
* fix cwd
* enable corepack
* some build fixes
* enable buildkit for old docker versions
* coordinator image fixes
* update provider containerfile
* build dev images in parallel
* upgrade pgadmin
* fix prod facade build
* prod runs
* fix merge
* don't knock out platform on invalid attempt id
* fix prod facade
* rename to build.ts
* fix prod builds
* set to executing after fetching payload
* make prod worker listen on random port if in use
* remove experimental warnings in dev
* prod resume
* prevent execution after completion
* exit prod worker after completion
* always restart otel collector
* docker checkpoints and prod runtime messaging
* don't retry indexing without chance of success
* make platform checkpoint aware
* deploy with existing hash sets latest worker
* log restore requests
* only try to checkpoint long waits
* tidying up
* lockfile
* fix build
* prod worker merge fixes
* fix prod complete and cancel
* fix lua nil checks
* socket namespace abstraction
* cleanup
* make all build args optional
* add build script
* don't require env vars for dev
* fix schema
* prod merge
* small fix
* bind correct logger
* fix v3 ref catalog entry
* resume prod batch
* pass socket to error and disconnect handlers
* fix non-batch resume
* fix batch resume
* send connection env vars when not in dev
* create worker via socket
* move api client back into v3 cli
* fix lockfile
* fix resume with failures
* marqs replace message
* typecheck prior to build
* don't define api url in prod builds
* support prod retries after resume
* skip typecheck option
2024-03-04 13:10:07 +00:00
f5ea64ef4f
Renamed the coordinator app to wss (web socket server)
2023-01-05 16:30:02 +00:00
48bacb0e60
Make workflow run steps idempotent
2023-01-04 13:39:28 +00:00
afc35caea6
Restructured internal-messages into internal-platform, to be used in the webapp
2022-12-14 15:58:42 +00:00
49d35a7a34
A couple of things in here
...
- Improved starting and stopping pulsar locally
- Starting to explore how the connections stuff in workflows (including how the types will work)
- Authorization now returns an organization id (to properly scope the pulsar topics to a unique workflow/org pair)
- Better handling of closing host connections in the coordinator
- Upgrade all zod to 3.20
2022-12-13 14:46:08 +00:00
d5a59051f3
Added pulsar docker commands and getting the message broker working in the coordinator
2022-12-09 20:23:44 +00:00
575d434240
Adding the pulsar client (with installation instructions) to the coordinator
2022-12-08 14:39:10 +00:00
fbad4d3118
Moving the sdk and coordinator work into the monorepo
2022-12-08 13:53:35 +00:00
nicktrn