21c70ad673
Serialize metadata to prevent invalid data from breaking run completions
2025-07-02 11:30:13 +01:00
0793c2b0f4
address some nick comments in the review
2025-07-02 11:30:13 +01:00
8dc90d61b4
increase run engine test timeouts
2025-07-02 11:30:13 +01:00
57f3a89a86
Fix timeline span events tests
2025-07-02 11:30:13 +01:00
ceb737e9f1
Fix broken webapp test
2025-07-02 11:30:13 +01:00
632d6b91e9
Fix taskSlug extraction
2025-07-02 11:30:13 +01:00
b548561220
Remvoe the sometimes incorrect import file name
2025-07-02 11:30:13 +01:00
aecee4d35f
Don't reset task lifecycle hooks between executions
2025-07-02 11:30:13 +01:00
9ab590bead
Better handle snapshot changes with the new persistent task run process,
...
Also don’t re-import the task file if the task is already in the resourceCatalog
2025-07-02 11:30:13 +01:00
2cc1453f25
Always set the cold/warm variant on attempt spans, even in dev
2025-07-02 11:30:13 +01:00
82f3db6825
Only bootstrap on the cold start execution, and record how many executions in the attempt span
2025-07-02 11:30:13 +01:00
f0bc4ad2bd
Don't delete env vars with falsy values
2025-07-02 11:30:13 +01:00
4d15c8f7cf
Better reset in the prod usage manager
2025-07-02 11:30:13 +01:00
7f3b1c1735
Ensure the usage interval is cleared when resetting
2025-07-02 11:30:13 +01:00
707bc09dac
Make sure maxExecutionsPerProcess is a positive integer
2025-07-02 11:30:13 +01:00
a0f2c982f9
Make sure to clear existing metadata flush timer when resetting
2025-07-02 11:30:13 +01:00
bffd18a6b8
Properly reset listener arrays by setting length to 0
2025-07-02 11:30:13 +01:00
2018b41d22
TRIGGER -> TRIGGERDOTDEV
2025-07-02 11:30:13 +01:00
c41d63497b
Handle immediate retries better
2025-07-02 11:30:13 +01:00
56146afcb6
TaskRunProcessProvider cleanup is async
2025-07-02 11:30:13 +01:00
020565c009
Handle dev process pool shutdown errors
2025-07-02 11:30:13 +01:00
58d56f8381
Use hostname instead of host
2025-07-02 11:30:13 +01:00
5b49b420cb
Add changeset
2025-07-02 11:30:13 +01:00
3fb68b784a
couple of tweaks for testing stuff
2025-07-02 11:30:13 +01:00
a414e65efe
handle env vars that have been removed between executions
2025-07-02 11:30:13 +01:00
38fe854559
Make refreshing a task run process work correctly
2025-07-02 11:30:13 +01:00
c24f3a56cc
Reset deployed run worker and also get the warm start stuff to work properly
2025-07-02 11:30:13 +01:00
8798352be3
Super-warm starts in deployed tasks proof
2025-07-02 11:30:13 +01:00
1a1e70ae3d
WIP deployed processKeepAlive
2025-07-02 11:30:13 +01:00
19bdf3b6ea
scope the pool by background version, allow configuring pool params in dev/prod
2025-07-02 11:30:13 +01:00
427c450391
Fixed metrics, reusing a process counts as a warm start
2025-07-02 11:30:13 +01:00
9374aea401
Split resource and span attributes
2025-07-02 11:30:13 +01:00
fd3db5f77b
Reset execution environment between runs
2025-07-02 11:30:13 +01:00
e2049fcfbf
Initial dev process keep alive. moved resource attributes to span attributes because resource attributes are global and immutable
2025-07-02 11:30:13 +01:00
1be4fcbb82
Fixes the jitter option for the scanConcurrencySets cron job ( #2220 )
2025-07-02 11:29:54 +01:00
124435e5e7
Eliminate race conditions in continueRunIfUnblocked to prevent stuck runs ( #2217 )
...
* Eliminate race conditions in continueRunIfUnblocked to prevent stuck runs
* Use assertNever for typecheck friendliness
2025-07-01 16:34:12 +01:00
4a79b3b35b
Fixed retrying on run replication inserts on connection errors ( #2216 )
2025-07-01 13:35:13 +01:00
0da6a19987
docs: Update triggering.mdx import for triggering from inside another task ( #2215 )
...
When triggering from inside another task, `runs` and `batch` should be imported from `@trigger.dev/sdk/v3`
2025-07-01 08:03:02 +01:00
08d84eb596
Fix v4 concurrency sweeper flaky test ( #2213 )
2025-06-30 16:37:52 +01:00
f38d35e9f6
ClickHouse replication improvements (retrying, strip bad unicode chars) ( #2205 )
...
* Add retry logic for insert operations
Add a generic retry mechanism for task run and payload inserts to handle
transient connection errors. The new #insertWithRetry method retries up to
three times with exponential backoff and jitter on retryable connection
errors such as connection resets or timeouts. Errors are logged and
recorded in tracing spans to improve observability and robustness of the
replication service.
* Replication settings are configurable
* Log out the runIds for failed batches
* Detecting bad JSON in run replication and ignoring it
* Reproduced split unicode error
* Move output file
* Massively improved the performance
* Minor performance improvements
* Unskip tests
* Remove unused test in CH package
* Fix for the ClickHouse UI explorer
* RunReplication keepAlive defaults to false
* Add concurrency_key and bulk_action_group_ids to ClickHouse task runs
* ClickHouse package doesn't need to be built anymore for the webapp
* Set the concurrency_key from the run replication service
2025-06-30 16:32:02 +01:00
1b4dabb8ba
v4: current concurrency sweeper ( #2206 )
...
* v4: current concurrency sweeper
* Fix webapp tests
* Ensure only a single instance performs concurrency sweeping by using redis-worker cron jobs
* Improved the mark phase
* Ensure cron jobs get rescheduled even if the handler throws an error
* Better property names
2025-06-30 16:22:19 +01:00
aa24a9aae6
Fix external registry config and other helm tweaks ( #2212 )
...
* fix both internal and external registry host
* add next steps to self-hosting overview
* separate into webapp and registry ingress
* fix external registry config check
* fix localhost registry warning
* bump chart version
2025-06-30 14:21:00 +01:00
dc568e7f3e
Self-hosting: improved worker and bucket bootstrap ( #2209 )
2025-06-29 10:42:52 +01:00
fa6675eb00
Helm chart improvements ( #2207 )
...
* add helm deps
* configurablecli tag for setup commands
* enabled -> deploy
* extraEnv -> extraEnvVars
* update docs
* minio -> s3
* improve persistence config
* set cli tag to v4-beta
* chart and image bump
* fix tests
* lock chart
* workflow hotfix
* quote for niels
* make probes configurable
* fix webapp and supervisor templates
* bump chart
2025-06-28 12:59:29 +01:00
8a86e7b41d
Remove deprecated schedule trigger jobs when registering with the schedule engine ( #2204 )
...
* Remove deprecated schedule trigger jobs when registering with the schedule engine
* Use a tryCatch just to be absolutely sure
2025-06-27 12:32:02 +01:00
119bfc0068
Fix update command version detection ( #2199 )
...
* fix root package.json resolution
* add changeset
2025-06-27 10:06:36 +01:00
7a6d9dc225
v4 self-hosting docs updates ( #2202 )
...
* quote version strings
* Update architecture diagram to include kubernetes
---------
Co-authored-by: James Ritchie <james@trigger.dev >
2025-06-26 16:53:10 +01:00
0f3179f493
Provide realtime skipColumns option via untamperable public access tokens ( #2201 )
...
* Provide realtime skipColumns option via untamperable public access tokens
* Fixed realtime client tests
* Create red-rings-marry.md
2025-06-26 15:13:26 +01:00
b87e1c4630
Improve clickhouse client debug logging ( #2197 )
...
* Improve clickhouse client debug logging
* Stop hardcoding ScheduleEngineWorker log level
* Add DLQ debug log message
2025-06-26 15:12:54 +01:00
14058d557f
fix: queues no longer unpaused on deploy ( #2198 )
2025-06-26 15:08:52 +01:00
Eric Allam