56146afcb6
TaskRunProcessProvider cleanup is async
2025-07-02 11:30:13 +01:00
020565c009
Handle dev process pool shutdown errors
2025-07-02 11:30:13 +01:00
58d56f8381
Use hostname instead of host
2025-07-02 11:30:13 +01:00
5b49b420cb
Add changeset
2025-07-02 11:30:13 +01:00
3fb68b784a
couple of tweaks for testing stuff
2025-07-02 11:30:13 +01:00
a414e65efe
handle env vars that have been removed between executions
2025-07-02 11:30:13 +01:00
38fe854559
Make refreshing a task run process work correctly
2025-07-02 11:30:13 +01:00
c24f3a56cc
Reset deployed run worker and also get the warm start stuff to work properly
2025-07-02 11:30:13 +01:00
8798352be3
Super-warm starts in deployed tasks proof
2025-07-02 11:30:13 +01:00
1a1e70ae3d
WIP deployed processKeepAlive
2025-07-02 11:30:13 +01:00
19bdf3b6ea
scope the pool by background version, allow configuring pool params in dev/prod
2025-07-02 11:30:13 +01:00
427c450391
Fixed metrics, reusing a process counts as a warm start
2025-07-02 11:30:13 +01:00
9374aea401
Split resource and span attributes
2025-07-02 11:30:13 +01:00
fd3db5f77b
Reset execution environment between runs
2025-07-02 11:30:13 +01:00
e2049fcfbf
Initial dev process keep alive. moved resource attributes to span attributes because resource attributes are global and immutable
2025-07-02 11:30:13 +01:00
1be4fcbb82
Fixes the jitter option for the scanConcurrencySets cron job ( #2220 )
2025-07-02 11:29:54 +01:00
124435e5e7
Eliminate race conditions in continueRunIfUnblocked to prevent stuck runs ( #2217 )
...
* Eliminate race conditions in continueRunIfUnblocked to prevent stuck runs
* Use assertNever for typecheck friendliness
2025-07-01 16:34:12 +01:00
4a79b3b35b
Fixed retrying on run replication inserts on connection errors ( #2216 )
2025-07-01 13:35:13 +01:00
0da6a19987
docs: Update triggering.mdx import for triggering from inside another task ( #2215 )
...
When triggering from inside another task, `runs` and `batch` should be imported from `@trigger.dev/sdk/v3`
2025-07-01 08:03:02 +01:00
08d84eb596
Fix v4 concurrency sweeper flaky test ( #2213 )
2025-06-30 16:37:52 +01:00
f38d35e9f6
ClickHouse replication improvements (retrying, strip bad unicode chars) ( #2205 )
...
* Add retry logic for insert operations
Add a generic retry mechanism for task run and payload inserts to handle
transient connection errors. The new #insertWithRetry method retries up to
three times with exponential backoff and jitter on retryable connection
errors such as connection resets or timeouts. Errors are logged and
recorded in tracing spans to improve observability and robustness of the
replication service.
* Replication settings are configurable
* Log out the runIds for failed batches
* Detecting bad JSON in run replication and ignoring it
* Reproduced split unicode error
* Move output file
* Massively improved the performance
* Minor performance improvements
* Unskip tests
* Remove unused test in CH package
* Fix for the ClickHouse UI explorer
* RunReplication keepAlive defaults to false
* Add concurrency_key and bulk_action_group_ids to ClickHouse task runs
* ClickHouse package doesn't need to be built anymore for the webapp
* Set the concurrency_key from the run replication service
2025-06-30 16:32:02 +01:00
1b4dabb8ba
v4: current concurrency sweeper ( #2206 )
...
* v4: current concurrency sweeper
* Fix webapp tests
* Ensure only a single instance performs concurrency sweeping by using redis-worker cron jobs
* Improved the mark phase
* Ensure cron jobs get rescheduled even if the handler throws an error
* Better property names
2025-06-30 16:22:19 +01:00
aa24a9aae6
Fix external registry config and other helm tweaks ( #2212 )
...
* fix both internal and external registry host
* add next steps to self-hosting overview
* separate into webapp and registry ingress
* fix external registry config check
* fix localhost registry warning
* bump chart version
2025-06-30 14:21:00 +01:00
dc568e7f3e
Self-hosting: improved worker and bucket bootstrap ( #2209 )
2025-06-29 10:42:52 +01:00
fa6675eb00
Helm chart improvements ( #2207 )
...
* add helm deps
* configurablecli tag for setup commands
* enabled -> deploy
* extraEnv -> extraEnvVars
* update docs
* minio -> s3
* improve persistence config
* set cli tag to v4-beta
* chart and image bump
* fix tests
* lock chart
* workflow hotfix
* quote for niels
* make probes configurable
* fix webapp and supervisor templates
* bump chart
2025-06-28 12:59:29 +01:00
8a86e7b41d
Remove deprecated schedule trigger jobs when registering with the schedule engine ( #2204 )
...
* Remove deprecated schedule trigger jobs when registering with the schedule engine
* Use a tryCatch just to be absolutely sure
2025-06-27 12:32:02 +01:00
119bfc0068
Fix update command version detection ( #2199 )
...
* fix root package.json resolution
* add changeset
2025-06-27 10:06:36 +01:00
7a6d9dc225
v4 self-hosting docs updates ( #2202 )
...
* quote version strings
* Update architecture diagram to include kubernetes
---------
Co-authored-by: James Ritchie <james@trigger.dev >
2025-06-26 16:53:10 +01:00
0f3179f493
Provide realtime skipColumns option via untamperable public access tokens ( #2201 )
...
* Provide realtime skipColumns option via untamperable public access tokens
* Fixed realtime client tests
* Create red-rings-marry.md
2025-06-26 15:13:26 +01:00
b87e1c4630
Improve clickhouse client debug logging ( #2197 )
...
* Improve clickhouse client debug logging
* Stop hardcoding ScheduleEngineWorker log level
* Add DLQ debug log message
2025-06-26 15:12:54 +01:00
14058d557f
fix: queues no longer unpaused on deploy ( #2198 )
2025-06-26 15:08:52 +01:00
6535cf918b
v4 helm chart and docs ( #2195 )
...
* v4 helm chart
* ignore packaged chart archives
* chart publish prep
* add helm chart release workflow
* enable draft gh release
* stateful services should be statefulsets
* expose internal otel config
* podAnnotations for all services
* postgresql.extraArgs
* postgresql -> postgres
* add clickhouse vars as extraEnv examples
* support external secrets
* improve clickhouse config
improve clickhouse config
* disable internal otel config by default
* allow nil internal config
* fix gh release permission
* fix validation step for ci
* secrets.enabled
* simplify secret keys
* bump chart version
* fix contents permission
* remove redundant print steps
* remove helm release heading
* optimise clickhouse config
* support wait-for-it.sh
* fix ch overrides
* add low-resource ch overrides to compose setup
* supervisor bootstrap config
* disable otel trace logging
* retain shared volume
* enable clickhouse for compose setup
* disable trace logging
* bump chart
* add extraManifests
* telemetry config
* add repo namespace config
* scope cluster role to namespace to support multiple installs
* external s3 config
* values tweaks
* helm docs
* bump chart
* set contents read permission
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
* add object store root credentials warning
* run init containers as uid 1000
* pass ch user creds with explicit flag
* improve ingress anotation handling
* remove duplicate colume claim block
* trim htpasswd auth
* lock curl images used for tests
* add v4-beta package version warning
* make schema and sslmode configurable
* package tag info -> warning
* improve secrets config example
* update docs
* bump version
* bump webapp reqs to account for ch
* make ch creds more easily configurable
* publish ch http port
* example point at latest beta chart
* small docs tweaks
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-06-25 23:57:51 +01:00
aaf40c3be3
Fix "Duplicate path found during parsing JSON object" clickhouse error ( #2193 )
2025-06-24 14:34:32 +01:00
35dedee1eb
Update number of allowed tags ( #2187 )
2025-06-24 10:38:59 +01:00
485f71c8d4
Improve schedule engine performance ( #2191 )
...
* Improve schedule engine performance
* Convert an info log to a debug log
2025-06-23 16:55:18 +01:00
ec2175fec8
Some docs tweaks ( #2190 )
...
* add v4 tag to playwright extension
* add self-hosting architecture section
* add v4-beta tag warning
2025-06-23 10:25:07 +01:00
fb9abe5289
fix: Incorrect/missing logs on new schedule engine runs ( #2185 )
...
* Fix incorrect logs on new schedule engine triggered taskss
Also added the ability to recover schedules in the schedule engine via an Admin API endpoint in the new schedule engine
* Fixed schedule recovery failing test
2025-06-19 15:37:50 +01:00
f2db1b8aa5
Create dedicated alerts worker ( #2184 )
...
* Add a new alerts worker that just handle alerts
* fallback to graphile worker when a tx is required
2025-06-19 11:54:49 +01:00
3c93783e8b
remove nodetype label requirement ( #2182 )
2025-06-18 11:34:35 +01:00
55f41a2168
Ensure webapp container does not fetch pnpm at runtime ( #2181 )
...
* install pnpm during build
* install pnpm for node user as well
2025-06-18 11:31:36 +01:00
4ca6506655
Delay reschedule fix (v3 & v4) ( #2180 )
...
* Fix for v3 rescheduling bug…
* v4 rescheduling working
2025-06-17 18:22:15 +01:00
9f9e74b0b6
Fix hydration error ( #2179 )
...
* Remove unused hook
* The Impersonation button was causing DOM hydration issues
2025-06-17 11:17:17 +01:00
ea6f66bdfc
Improved schedule engine ( #2174 )
2025-06-17 06:48:05 +01:00
a42c9acf44
v4: Improved run locking ( #2173 )
2025-06-17 06:45:59 +01:00
f7f8bc28c5
Docker self-hosting improvements ( #2177 )
...
* shallow clone
* fix image tag locking example
* electric should use db url env var
* add htpasswd note
* use local driver with log rotation by default
* make worker urls more easily configurable
* configure dev otel endpoint via .env
* increase min recommended worker specs
* move worker url section
2025-06-16 22:22:02 +01:00
5f6fd8e235
Tasks page didn't include Delayed runs ( #2176 )
...
* Delayed runs weren’t shown in the Tasks page mini graph
* The Tasks page Queued count didn’t include Delayed runs (since ClickHouse switchover)
2025-06-16 14:14:09 +01:00
33e1008d83
Adds a docker error entry to common problems docs page ( #2172 )
2025-06-14 11:11:24 +01:00
a0815c8e3e
Clickhouse performance improvements ( #2175 )
...
* Runs filter by org id and add created at to ordering
* CopyableText can accept an alternative value for copying
* The runs table now shows the ID instead of run number
* Paginating back/forwards fix
* The task stats need org id and project id too
2025-06-14 11:10:28 +01:00
8a5e7f34b1
Added more limits and information to the limits page ( #2171 )
2025-06-13 10:32:44 +01:00
c3dca5835d
Fix for the Kapa widget not working with SSR ( #2170 )
...
* Move all the logic into a single component, preparing for client only
* Use ClientOnly
* Fix for search param not working
2025-06-12 22:17:22 +01:00
Eric Allam