ceb737e9f1
Fix broken webapp test
2025-07-02 11:30:13 +01:00
632d6b91e9
Fix taskSlug extraction
2025-07-02 11:30:13 +01:00
b548561220
Remvoe the sometimes incorrect import file name
2025-07-02 11:30:13 +01:00
aecee4d35f
Don't reset task lifecycle hooks between executions
2025-07-02 11:30:13 +01:00
9ab590bead
Better handle snapshot changes with the new persistent task run process,
...
Also don’t re-import the task file if the task is already in the resourceCatalog
2025-07-02 11:30:13 +01:00
2cc1453f25
Always set the cold/warm variant on attempt spans, even in dev
2025-07-02 11:30:13 +01:00
82f3db6825
Only bootstrap on the cold start execution, and record how many executions in the attempt span
2025-07-02 11:30:13 +01:00
f0bc4ad2bd
Don't delete env vars with falsy values
2025-07-02 11:30:13 +01:00
4d15c8f7cf
Better reset in the prod usage manager
2025-07-02 11:30:13 +01:00
7f3b1c1735
Ensure the usage interval is cleared when resetting
2025-07-02 11:30:13 +01:00
707bc09dac
Make sure maxExecutionsPerProcess is a positive integer
2025-07-02 11:30:13 +01:00
a0f2c982f9
Make sure to clear existing metadata flush timer when resetting
2025-07-02 11:30:13 +01:00
bffd18a6b8
Properly reset listener arrays by setting length to 0
2025-07-02 11:30:13 +01:00
2018b41d22
TRIGGER -> TRIGGERDOTDEV
2025-07-02 11:30:13 +01:00
c41d63497b
Handle immediate retries better
2025-07-02 11:30:13 +01:00
56146afcb6
TaskRunProcessProvider cleanup is async
2025-07-02 11:30:13 +01:00
020565c009
Handle dev process pool shutdown errors
2025-07-02 11:30:13 +01:00
58d56f8381
Use hostname instead of host
2025-07-02 11:30:13 +01:00
5b49b420cb
Add changeset
2025-07-02 11:30:13 +01:00
3fb68b784a
couple of tweaks for testing stuff
2025-07-02 11:30:13 +01:00
a414e65efe
handle env vars that have been removed between executions
2025-07-02 11:30:13 +01:00
38fe854559
Make refreshing a task run process work correctly
2025-07-02 11:30:13 +01:00
c24f3a56cc
Reset deployed run worker and also get the warm start stuff to work properly
2025-07-02 11:30:13 +01:00
8798352be3
Super-warm starts in deployed tasks proof
2025-07-02 11:30:13 +01:00
1a1e70ae3d
WIP deployed processKeepAlive
2025-07-02 11:30:13 +01:00
19bdf3b6ea
scope the pool by background version, allow configuring pool params in dev/prod
2025-07-02 11:30:13 +01:00
427c450391
Fixed metrics, reusing a process counts as a warm start
2025-07-02 11:30:13 +01:00
9374aea401
Split resource and span attributes
2025-07-02 11:30:13 +01:00
fd3db5f77b
Reset execution environment between runs
2025-07-02 11:30:13 +01:00
e2049fcfbf
Initial dev process keep alive. moved resource attributes to span attributes because resource attributes are global and immutable
2025-07-02 11:30:13 +01:00
1be4fcbb82
Fixes the jitter option for the scanConcurrencySets cron job ( #2220 )
2025-07-02 11:29:54 +01:00
124435e5e7
Eliminate race conditions in continueRunIfUnblocked to prevent stuck runs ( #2217 )
...
* Eliminate race conditions in continueRunIfUnblocked to prevent stuck runs
* Use assertNever for typecheck friendliness
2025-07-01 16:34:12 +01:00
4a79b3b35b
Fixed retrying on run replication inserts on connection errors ( #2216 )
2025-07-01 13:35:13 +01:00
0da6a19987
docs: Update triggering.mdx import for triggering from inside another task ( #2215 )
...
When triggering from inside another task, `runs` and `batch` should be imported from `@trigger.dev/sdk/v3`
2025-07-01 08:03:02 +01:00
08d84eb596
Fix v4 concurrency sweeper flaky test ( #2213 )
2025-06-30 16:37:52 +01:00
f38d35e9f6
ClickHouse replication improvements (retrying, strip bad unicode chars) ( #2205 )
...
* Add retry logic for insert operations
Add a generic retry mechanism for task run and payload inserts to handle
transient connection errors. The new #insertWithRetry method retries up to
three times with exponential backoff and jitter on retryable connection
errors such as connection resets or timeouts. Errors are logged and
recorded in tracing spans to improve observability and robustness of the
replication service.
* Replication settings are configurable
* Log out the runIds for failed batches
* Detecting bad JSON in run replication and ignoring it
* Reproduced split unicode error
* Move output file
* Massively improved the performance
* Minor performance improvements
* Unskip tests
* Remove unused test in CH package
* Fix for the ClickHouse UI explorer
* RunReplication keepAlive defaults to false
* Add concurrency_key and bulk_action_group_ids to ClickHouse task runs
* ClickHouse package doesn't need to be built anymore for the webapp
* Set the concurrency_key from the run replication service
2025-06-30 16:32:02 +01:00
1b4dabb8ba
v4: current concurrency sweeper ( #2206 )
...
* v4: current concurrency sweeper
* Fix webapp tests
* Ensure only a single instance performs concurrency sweeping by using redis-worker cron jobs
* Improved the mark phase
* Ensure cron jobs get rescheduled even if the handler throws an error
* Better property names
2025-06-30 16:22:19 +01:00
aa24a9aae6
Fix external registry config and other helm tweaks ( #2212 )
...
* fix both internal and external registry host
* add next steps to self-hosting overview
* separate into webapp and registry ingress
* fix external registry config check
* fix localhost registry warning
* bump chart version
2025-06-30 14:21:00 +01:00
dc568e7f3e
Self-hosting: improved worker and bucket bootstrap ( #2209 )
2025-06-29 10:42:52 +01:00
fa6675eb00
Helm chart improvements ( #2207 )
...
* add helm deps
* configurablecli tag for setup commands
* enabled -> deploy
* extraEnv -> extraEnvVars
* update docs
* minio -> s3
* improve persistence config
* set cli tag to v4-beta
* chart and image bump
* fix tests
* lock chart
* workflow hotfix
* quote for niels
* make probes configurable
* fix webapp and supervisor templates
* bump chart
2025-06-28 12:59:29 +01:00
8a86e7b41d
Remove deprecated schedule trigger jobs when registering with the schedule engine ( #2204 )
...
* Remove deprecated schedule trigger jobs when registering with the schedule engine
* Use a tryCatch just to be absolutely sure
2025-06-27 12:32:02 +01:00
119bfc0068
Fix update command version detection ( #2199 )
...
* fix root package.json resolution
* add changeset
2025-06-27 10:06:36 +01:00
7a6d9dc225
v4 self-hosting docs updates ( #2202 )
...
* quote version strings
* Update architecture diagram to include kubernetes
---------
Co-authored-by: James Ritchie <james@trigger.dev >
2025-06-26 16:53:10 +01:00
0f3179f493
Provide realtime skipColumns option via untamperable public access tokens ( #2201 )
...
* Provide realtime skipColumns option via untamperable public access tokens
* Fixed realtime client tests
* Create red-rings-marry.md
2025-06-26 15:13:26 +01:00
b87e1c4630
Improve clickhouse client debug logging ( #2197 )
...
* Improve clickhouse client debug logging
* Stop hardcoding ScheduleEngineWorker log level
* Add DLQ debug log message
2025-06-26 15:12:54 +01:00
14058d557f
fix: queues no longer unpaused on deploy ( #2198 )
2025-06-26 15:08:52 +01:00
6535cf918b
v4 helm chart and docs ( #2195 )
...
* v4 helm chart
* ignore packaged chart archives
* chart publish prep
* add helm chart release workflow
* enable draft gh release
* stateful services should be statefulsets
* expose internal otel config
* podAnnotations for all services
* postgresql.extraArgs
* postgresql -> postgres
* add clickhouse vars as extraEnv examples
* support external secrets
* improve clickhouse config
improve clickhouse config
* disable internal otel config by default
* allow nil internal config
* fix gh release permission
* fix validation step for ci
* secrets.enabled
* simplify secret keys
* bump chart version
* fix contents permission
* remove redundant print steps
* remove helm release heading
* optimise clickhouse config
* support wait-for-it.sh
* fix ch overrides
* add low-resource ch overrides to compose setup
* supervisor bootstrap config
* disable otel trace logging
* retain shared volume
* enable clickhouse for compose setup
* disable trace logging
* bump chart
* add extraManifests
* telemetry config
* add repo namespace config
* scope cluster role to namespace to support multiple installs
* external s3 config
* values tweaks
* helm docs
* bump chart
* set contents read permission
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
* add object store root credentials warning
* run init containers as uid 1000
* pass ch user creds with explicit flag
* improve ingress anotation handling
* remove duplicate colume claim block
* trim htpasswd auth
* lock curl images used for tests
* add v4-beta package version warning
* make schema and sslmode configurable
* package tag info -> warning
* improve secrets config example
* update docs
* bump version
* bump webapp reqs to account for ch
* make ch creds more easily configurable
* publish ch http port
* example point at latest beta chart
* small docs tweaks
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-06-25 23:57:51 +01:00
aaf40c3be3
Fix "Duplicate path found during parsing JSON object" clickhouse error ( #2193 )
2025-06-24 14:34:32 +01:00
35dedee1eb
Update number of allowed tags ( #2187 )
2025-06-24 10:38:59 +01:00
485f71c8d4
Improve schedule engine performance ( #2191 )
...
* Improve schedule engine performance
* Convert an info log to a debug log
2025-06-23 16:55:18 +01:00
Eric Allam