79da0ca9b5
Update lockfile
2024-06-12 17:37:58 +01:00
3aca603a33
chore: Update version for release (beta) ( #1153 )
...
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-06-12 17:34:47 +01:00
c9e97d6b78
Add debug logging when we skip importing a resource span
2024-06-12 17:27:12 +01:00
01633c9c03
Print error logs on dev worker failure
2024-06-12 13:08:50 +01:00
691990d79e
Remove catalog example that was causing typecheck issues
2024-06-12 12:48:19 +01:00
b2ba403dd3
Improve error logs cli message
2024-06-12 12:04:59 +01:00
1d47cab69f
Ensure rollback triggers execution of tasks waiting for deploy
2024-06-12 11:51:51 +01:00
e23047f9ad
update pre-release script
2024-06-12 09:49:47 +01:00
68d32429b6
v3: checkpoint failover and misc fixes ( #1157 )
...
* configurable checkpoint registry namespace
* add missing task create await
* remove unused messages
* changeset
* update self-hosting docs
* capture and display stderr for failed deploys
* add missing lockfile changes
* stderr changeset
* fix cli stderr message
* update error logs label
2024-06-11 14:06:50 +01:00
36ac79ac66
Make sure users cannot revoke invites for other orgs
2024-06-11 11:09:52 +01:00
ca94f0cac3
cli v3: fix deploys by using sub-path imports (fixes execa require ESM error)
2024-06-11 11:08:15 +01:00
a5d8e453a5
v3: deploy rollbacks ( #1154 )
...
* add deployment rollbacks
* update test presenter
* update task list presenter
* fix test page for dev env
* read replica for the test presenter
2024-06-11 10:09:29 +01:00
c332519e72
v3: Add a much needed index on TaskEvent.spanId
2024-06-10 20:54:13 +01:00
52112c3bfc
Docs: added v3 limits page
2024-06-10 16:07:08 +01:00
eae294a332
Add back in the v2 timeout task thing
2024-06-10 16:06:21 +01:00
465cd0335c
v2: No longer eagerly timeout runs when no tasks are created
2024-06-10 14:54:22 +01:00
35dbaedf69
v3: self-hosting ( #1147 )
...
* add amin email regex env var
* fix displayed init command for self-hosted setups
* shared env var to disable telemetry in cli and webapp
* pin sdk version during init
* if specified, add api url to dev command shown after init
* improve checkpoint support detection
* control forced checkpoint simulation via env var
* add public init to providers
* better checkpoint support check for coordinator
* add docker to coordinator image
* update docker provider containerfile
* bump remaining containers to node 20
* add infra image build to default publish workflow
* lockfile
* remove concurrency group from infra workflow
* add docker provider to build matrix
* fix var subst
* checkpoint test is docker specific
* enable v3 projects by default on self-hosted instances
* fix v3 setup command again
* add default posthog key
* self-hosting docs
* add latest tags to versioned infra and webapp builds
* some checkpoint errors should skip retrying
* add changeset
* shorten paragraph
* some docs updates
* update tunnelling section
* add registry setup section
* use correct cli push flag
* add checkout to v3 branch
* update the worker machine setup steps
* fix infra build
* small docs update
* remove unused feature function
* Revert "remove unused feature function"
This reverts commit cfe07887a12b6893dca8ce499964481a9b3dc9db.
* fix self-hosted v3 feature gate
* add note about missing arm support
* simplify helper script syntax
2024-06-10 14:13:04 +01:00
c11a77f50b
cli v3: increase otel force flush timeout to 30s from 500ms
2024-06-07 20:46:03 +01:00
fb52b9efea
Remove redundant log (you’re welcome baselime)
2024-06-07 20:41:34 +01:00
0896b9fffc
Use the read replica more ( #1152 )
...
* Switch to read replica: getEvent API endpoint
* Switch to read replica: v2 run list presenter
* Switch to read replica: Job presenter
* Switch to read replica: Job list presenter
* Switch to read replica: billing client
* Switch to read replica: OrgUsagePresenter
* Switch to read replica: OrgBillingPlanPresenter
* Switch to read replica: ScheduleListPresenter
* Switch to read replica: EventRepository taskEvent.findMany
2024-06-07 15:47:54 +01:00
3a2dd983c5
Fix for sendEvent same id causing multiple runs ( #1151 )
...
* Proof of concept
* When ingesting events, if it’s already been delivered then don’t continue
* DeliverEvent: throw AlreadyDeliveredError and don’t retry if that’s thrown
* Test for duplicate event ids
* Return the original event so sendEvent doesn’t fail, don’t enqueue
* Add AlreadyDeliveredError to the logged out message
---------
Co-authored-by: Eric Allam <eallam@icloud.com >
2024-06-07 15:10:53 +01:00
a627ca67d1
Use a different logger key for the marqs version
2024-06-07 14:19:05 +01:00
afc180aa70
marqs: Concurrency monitor that runs periodically and vacuums completed runs ( #1150 )
2024-06-07 13:36:02 +01:00
393af1b7c5
Add ability to enable v2 marqs requeuing (and remove deprecated marqs visibility requeuing)
2024-06-06 17:14:15 +01:00
6a91fb89b8
Release 3.0.0-beta.36
2024-06-06 16:00:07 +01:00
df7d1de16d
chore: Update version for release (beta) ( #1142 )
...
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-06-06 15:59:21 +01:00
8e8ed4a3bf
Remove queueName option from ZodWorker
2024-06-06 14:49:45 +01:00
8fc8f57b39
v2: MarQS powered job executions ( #1149 )
...
* WIP
* Allow marqsv2 and v2 graphile to run in parallel
* Fix missing GraphileLogger import
* Fixed heartbeat after rebase
* Replace postgres based run counters with redis ones with a backfill
* Add back in the graphile logger
* Remove duplicate visibility timeout calls
* Clamp simple weighted strategy to max of 5
2024-06-06 13:56:27 +01:00
9ebd91ccec
Fixed auto-pagination example
2024-06-06 13:26:16 +01:00
665f7c9756
v3: runs.retrieve fixed payload value
2024-06-06 13:21:59 +01:00
928a632e23
The IngestSendEvent rate limiter is now a singleton
2024-06-06 09:18:27 +01:00
74db2de1bc
Use graphile strategy 0 (no named queues) and remove all named queues
2024-06-05 19:08:00 +01:00
93acca6c3c
maxPoolSize should be +1 from concurrency
2024-06-05 17:50:15 +01:00
ebe079d83c
Patch graphile-worker to log out the getJob query
2024-06-05 17:45:24 +01:00
d272996de3
Use the env.server import
2024-06-05 17:20:44 +01:00
531bd4970d
VERBOSE_GRAPHILE_LOGGING env var to control logging (defaults to “false”)
2024-06-05 17:18:13 +01:00
5c9eb25b5a
Added very verbose Graphile logging
2024-06-05 16:59:21 +01:00
c970e892a7
Added GraphileLogger
2024-06-05 16:20:19 +01:00
a867b6e5ae
Log out Graphile worker:getJob:error events
2024-06-05 15:24:00 +01:00
d44abbd0fc
Only auto-index v2 endpoints every hour. Timeout endpoint indexes after 5s
2024-06-05 14:39:17 +01:00
1cc680ac1e
Fail runs if they’re disabled for an org
2024-06-05 13:54:01 +01:00
9b049bc480
Set more Graphile worker job priorities to zero, including endpoint indexing
2024-06-05 12:28:30 +01:00
c24a23b551
Docs: env vars SDK docs
2024-06-05 11:41:14 +01:00
ee1ae1fca6
Docs: improved trigger.config docs for instrumentations, env vars and troubleshooting
2024-06-05 11:41:14 +01:00
8e5ef176a4
v3: registry maintenance ( #1146 )
...
* retry checkpoints with backoff and optional failover registry for deploys
* never abort checkpoint cleanup
* simulate checkpoint failure for 5 minutes
* add flag to simulate checkpoint push failure
* add flag to control push failure simulation duration
* backoff with helper
* handle all coordinator errors
* improve stop retrying
* increase cleanup ipc timeout
* improve webapp socket.io handler error logging
* remove unused backoff function
2024-06-05 11:06:18 +01:00
58b6b1aa0d
Schedule task requeue when dequeueing message in shared queue
2024-06-04 11:02:15 +01:00
9c0ae1459f
v2: Add ability to manually pause certain performRunExecutionV3 jobs in graphile
2024-06-03 22:22:48 +01:00
2f15a84320
Fixed continueRun service
2024-06-03 21:51:06 +01:00
a49a0ff416
Set the priority for deliverRunSubscriptions & deliverRunSubscription to zero (the highest)
2024-06-03 20:13:39 +01:00
b703ffed29
v2: decrease performRunExecutionV3 reschedulings
2024-06-03 14:32:17 +01:00
nicktrn