0410316e14
Enable prisma metrics and add them to the /metrics endpoint ( #2111 )
...
* Enable prisma metrics and add them to the /metrics endpoint
* Add support for bearer token auth on metrics endpoint
2025-05-27 13:28:45 +01:00
c571c5ef32
v4: Can now set project ref using the TRIGGER_PROJECT_REF env var ( #2109 )
...
* v4: Can now set project ref using the TRIGGER_PROJECT_REF env var
* Add changeset
* Improve the name of the resolvEnvVars function and move setting NODE_ENV into the dev supervisor
* Removed moved function
2025-05-27 12:51:04 +01:00
e84ede9599
Upgrade to electric@1.0.13 ( #2089 )
...
* Upgrade to electric@1.0.13
* Add ELECTRIC_INSECURE env var to test container
2025-05-23 16:59:53 +01:00
3fc5630be7
fix: calculating next schedule should always just be from now ( #2102 )
2025-05-23 16:55:52 +01:00
13d378f6df
v4: batches can only complete when all their runs have been created ( #2101 )
...
* v4: batches can only complete when all their runs have been created
* Fix flaky runs replication test
2025-05-23 16:53:50 +01:00
1a6a9ca97a
perf fix: calculateNextScheduledTimestamp speed improvement ( #2099 )
...
* Simulate "next steps" when calculating the next timestamp to prevent millions of iterations on dev schedues
* Add additional tests
* Fix typescript issue
2025-05-23 16:24:33 +01:00
6cb57b803c
Added openai agent sdk guardrails docs ( #2100 )
2025-05-23 16:09:12 +01:00
7c791dd519
Improve unit test workflow performance ( #2096 )
...
* shard unit tests
* temp enable for all pushes
* fix test workflow
* update to latest vitest and only add to root package.json
* additionally use default reporter
* gather reports before uploading
* split up slow replication tests
* split up unit tests workflow
* move workflows to parent dir
* use new paths in parent workflow
* prevent artifact clashes
* we always need to create the reports dir
* speed up merge reports
* gather reports even when tests fail
* fix artifact patterns
* increase shards
* disable push trigger again
* improve dequeue snapshot test reliability
2025-05-23 12:22:14 +01:00
cf3735976e
Release 4.0.0-v4-beta.18 ( #2095 )
...
* chore: Update version for release (v4-beta)
* Release 4.0.0-v4-beta.18
---------
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com >
2025-05-22 21:59:11 +01:00
a9a40b5184
Fix dev indexing ( #2094 )
...
* save build manifest for dev runs again
* add changeset
2025-05-22 21:54:00 +01:00
0f928e224b
Release 4.0.0-v4-beta.17 ( #2071 )
...
* chore: Update version for release (v4-beta)
* Release 4.0.0-v4-beta.17
---------
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com >
2025-05-22 19:51:18 +01:00
a306545952
Always find debug logs when in the span sidebar ( #2093 )
2025-05-22 14:22:12 +01:00
1bb1fc4c8f
v4 run engine debug logs now filtered out in SQL by default ( #2092 )
2025-05-22 10:44:06 +01:00
1ca37f5745
Expose esbuild keepNames and minify options (experimental) ( #2091 )
...
* Expose esbuild `keepNames` option (experimental)
* Expose esbuild `minify` option (experimental)
* test new experimental options
2025-05-22 10:42:48 +01:00
8112c12092
Improve email whitelisting and extend to GitHub auth ( #2090 )
...
* make github auth respect email whitelist
* display github login errors
* fix smtp secure env vars
* prevent sending magic link if email not allowed
* fix MARQS_DISABLE_REBALANCING and RUN_ENGINE_DEBUG_WORKER_NOTIFICATIONS
2025-05-22 10:30:00 +01:00
c8d252e300
Add experimental externals detection ( #2083 )
...
* add auto detect externals
* stop spinner on esbuild errors
* test problematic packages
* fix braces types
* improve detection 10x
* ignore sentry stub
* improve main package json detection
* rename to experimental_autoDetectExternal
2025-05-21 16:40:37 +01:00
d89f740d18
Write esbuild metafile to output dir ( #2087 )
...
* write esbuild metafile to output dir
* add changeset
2025-05-21 16:17:10 +01:00
41a3bdec68
Add id-token permission to the publish webapp workflow ( #2088 )
2025-05-21 14:30:03 +01:00
a9a937dd25
Implement example of streamText fallback using an AI data stream ( #2068 )
2025-05-21 13:22:06 +01:00
14e081e17d
release concurrency system reliability improvements ( #2081 )
...
* Refill release concurrency tokens when a run is cancelled
* Improved release concurrency accounting system + a sweeper to auto-refill tokens for snapshots that are no longer the latest snapshot on a run (e.g. the run has moved to a new snapshot state)
* Fix order of arguments to the releasings sweeper
* Add a heartbeat for SUSPENDED snapshots, where when stalled will attempt to continue the run if unblocked
2025-05-21 13:21:17 +01:00
500a173d67
Set default values on the invite and new env var forms to fix an issue after updating conform ( #2084 )
2025-05-21 13:20:16 +01:00
cc562c58fa
Remove unused publish job from the release github workflow to fix permissions error ( #2085 )
2025-05-21 13:19:49 +01:00
0334df70ad
Prevent socket hangup error by removing the aggressive clickhouse keep alive ttl env var default ( #2082 )
2025-05-21 13:15:15 +01:00
e08e493b3c
Potential fix for code scanning alert no. 2: Workflow does not contain permissions ( #2078 )
...
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-05-19 21:17:35 +01:00
f667d61d4c
Potential fix for code scanning alert no. 3: Workflow does not contain permissions ( #2077 )
...
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-05-19 21:16:58 +01:00
325ef04c7f
Potential fix for code scanning alert no. 6: Workflow does not contain permissions ( #2076 )
...
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-05-19 21:15:42 +01:00
79f0a6a662
Potential fix for code scanning alert no. 42: Workflow does not contain permissions ( #2074 )
...
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-05-19 21:14:26 +01:00
ad5027b5fd
Potential fix for code scanning alert no. 1: Workflow does not contain permissions ( #2079 )
...
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-05-19 20:59:50 +01:00
f0809e6ad6
Potential fix for code scanning alert no. 38: Workflow does not contain permissions ( #2075 )
...
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-05-19 20:48:58 +01:00
c63559f55d
v4: fix race condition when continuing run when blocked at the same time ( #2073 )
...
* v4: fix race condition when continuing run when blocked at the same time
* Attempt to fix flaky e2e test
* Make waitpoint race condition test less flaky
2025-05-19 16:50:36 +01:00
8471169b30
Fix various dependabot alerts ( #2063 )
...
* Upgrade posthog-node to clear axios vulns
* Upgrade @slack/web-api to use a secure version of axios
* Update parse-duration to fix security vulns
* Mitigate against the ws DoS vuln
* Upgrade body-parser to 1.20.3 in the webapp
* Upgrade react-use to 17.5.1 to remove the fast-loops transitive dep
* Remove unused babel dev deps and config file that's no longer used
* Upgrade prismjs to 1.30.0 and bundle parse-duration now
* upgrade express to 4.20.0 to fix issue with XSS when redirecting
* Upgrade @conform/zod to 0.9.2
2025-05-19 12:01:51 +01:00
558a39c644
Remove supervisor docker binary requirement and other tweaks ( #2062 )
...
* don't require docker binary
* more structured logs
* remove docker type dep
* add core changeset
* use implicit DOCKER_HOST instead
* disable resource monitor for now
* support attaching docker runners to multiple networks
* warn if dequeue interval > idle dequeue interval
* verbose logs
* add changeset
2025-05-17 12:33:41 +01:00
b4ab06600b
Create AGENTS.md file ( #2070 )
2025-05-17 07:54:04 +01:00
c8e8bc9306
engine v2: Fix selectTopEnvs missing queues ( #2069 )
2025-05-17 07:53:48 +01:00
a69621bdcc
Allow self-hosted deploys locally by pointing to docker.host.internal on macOS ( #2064 )
2025-05-16 15:20:48 +01:00
ad4daa3301
Fix run replication payloads/outputs trying to send invalid types like BigInt to clickhouse ( #2065 )
2025-05-16 11:02:30 +01:00
bb7173b4ab
Improve run replication logging ( #2060 )
...
* Remove the tcp buffer monitors
* Improve run replication logging
2025-05-15 14:12:01 +01:00
2aee3debc0
Docs: 3rd party log exporters ( #2058 )
2025-05-15 10:50:15 +01:00
d1e40643fc
Allow creating and monitoring run replication services with different settings ( #2055 )
...
* Allow creating and monitoring run replication services with different settings
* Fix test
2025-05-14 20:40:47 +01:00
a8e38d9231
chore: Skip unit tests dependency when running publish image workflow ( #2054 )
2025-05-14 19:31:50 +01:00
2ae0e22d81
Release 4.0.0-v4-beta.16 ( #2053 )
...
* chore: Update version for release (v4-beta)
* Release 4.0.0-v4-beta.16
---------
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com >
2025-05-14 16:26:28 +01:00
206a2c3245
Fix init.ts detection for sentry plugin users ( #2051 )
...
* fix init.ts detection when using the sentry plugin
* add changeset
2025-05-14 16:20:05 +01:00
eb3929880f
runs replication leader lock expiration fix ( #2050 )
...
* runs replication leader lock expiration fix
* Allow configuring the container image --max-old-space-size using NODE_MAX_OLD_SPACE_SIZE
* Ability to configure the clickhouse keep alive settings
* Add some logging because we might not be able to do telemetry
2025-05-14 15:49:48 +01:00
0661ee5fdd
Release 4.0.0-v4-beta.15 ( #2040 )
...
* chore: Update version for release (v4-beta)
* Release 4.0.0-v4-beta.15
---------
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com >
2025-05-14 12:33:37 +01:00
2deef00d48
Improvements to the runs replication service to prevent buffer exhaustion ( #2047 )
2025-05-14 11:35:51 +01:00
fa5360a99d
Feat: supervisor ARM builds ( #2046 )
...
* v4 worker multi-arch builds
* v4-beta tag for webapp
* add oidc permission
* deps fetcher needs python
* node-gyp needs complete toolchain
* fix headers
* bust pnpm cache
* add setuptools
* switch back to old cache id
* push worker images
* pass the correct tags
2025-05-14 11:23:41 +01:00
7ace1c3e25
Fix run replication telemetry by passing in a tracer ( #2045 )
2025-05-14 09:52:09 +01:00
a815633712
Add external log exporters and fix missing external trace exporters in deployed tasks ( #2038 )
...
* Add external log exporters and fix missing external trace exporters in deployed tasks
* Generate the external traceID correctly and exporter 3rd party logs with the external traceID as well
2025-05-13 16:54:24 +01:00
84a0336bdd
Fix #1955 : schemaTask parse payload failures handled gracefully ( #2043 )
2025-05-13 16:47:21 +01:00
7be07b4d0e
allow configuring the replication leader lock settings ( #2042 )
2025-05-13 14:17:36 +01:00
Eric Allam