cf3735976e
Release 4.0.0-v4-beta.18 ( #2095 )
...
* chore: Update version for release (v4-beta)
* Release 4.0.0-v4-beta.18
---------
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com >
2025-05-22 21:59:11 +01:00
a9a40b5184
Fix dev indexing ( #2094 )
...
* save build manifest for dev runs again
* add changeset
2025-05-22 21:54:00 +01:00
0f928e224b
Release 4.0.0-v4-beta.17 ( #2071 )
...
* chore: Update version for release (v4-beta)
* Release 4.0.0-v4-beta.17
---------
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com >
2025-05-22 19:51:18 +01:00
a306545952
Always find debug logs when in the span sidebar ( #2093 )
2025-05-22 14:22:12 +01:00
1bb1fc4c8f
v4 run engine debug logs now filtered out in SQL by default ( #2092 )
2025-05-22 10:44:06 +01:00
1ca37f5745
Expose esbuild keepNames and minify options (experimental) ( #2091 )
...
* Expose esbuild `keepNames` option (experimental)
* Expose esbuild `minify` option (experimental)
* test new experimental options
2025-05-22 10:42:48 +01:00
8112c12092
Improve email whitelisting and extend to GitHub auth ( #2090 )
...
* make github auth respect email whitelist
* display github login errors
* fix smtp secure env vars
* prevent sending magic link if email not allowed
* fix MARQS_DISABLE_REBALANCING and RUN_ENGINE_DEBUG_WORKER_NOTIFICATIONS
2025-05-22 10:30:00 +01:00
c8d252e300
Add experimental externals detection ( #2083 )
...
* add auto detect externals
* stop spinner on esbuild errors
* test problematic packages
* fix braces types
* improve detection 10x
* ignore sentry stub
* improve main package json detection
* rename to experimental_autoDetectExternal
2025-05-21 16:40:37 +01:00
d89f740d18
Write esbuild metafile to output dir ( #2087 )
...
* write esbuild metafile to output dir
* add changeset
2025-05-21 16:17:10 +01:00
41a3bdec68
Add id-token permission to the publish webapp workflow ( #2088 )
2025-05-21 14:30:03 +01:00
a9a937dd25
Implement example of streamText fallback using an AI data stream ( #2068 )
2025-05-21 13:22:06 +01:00
14e081e17d
release concurrency system reliability improvements ( #2081 )
...
* Refill release concurrency tokens when a run is cancelled
* Improved release concurrency accounting system + a sweeper to auto-refill tokens for snapshots that are no longer the latest snapshot on a run (e.g. the run has moved to a new snapshot state)
* Fix order of arguments to the releasings sweeper
* Add a heartbeat for SUSPENDED snapshots, where when stalled will attempt to continue the run if unblocked
2025-05-21 13:21:17 +01:00
500a173d67
Set default values on the invite and new env var forms to fix an issue after updating conform ( #2084 )
2025-05-21 13:20:16 +01:00
cc562c58fa
Remove unused publish job from the release github workflow to fix permissions error ( #2085 )
2025-05-21 13:19:49 +01:00
0334df70ad
Prevent socket hangup error by removing the aggressive clickhouse keep alive ttl env var default ( #2082 )
2025-05-21 13:15:15 +01:00
e08e493b3c
Potential fix for code scanning alert no. 2: Workflow does not contain permissions ( #2078 )
...
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-05-19 21:17:35 +01:00
f667d61d4c
Potential fix for code scanning alert no. 3: Workflow does not contain permissions ( #2077 )
...
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-05-19 21:16:58 +01:00
325ef04c7f
Potential fix for code scanning alert no. 6: Workflow does not contain permissions ( #2076 )
...
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-05-19 21:15:42 +01:00
79f0a6a662
Potential fix for code scanning alert no. 42: Workflow does not contain permissions ( #2074 )
...
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-05-19 21:14:26 +01:00
ad5027b5fd
Potential fix for code scanning alert no. 1: Workflow does not contain permissions ( #2079 )
...
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-05-19 20:59:50 +01:00
f0809e6ad6
Potential fix for code scanning alert no. 38: Workflow does not contain permissions ( #2075 )
...
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-05-19 20:48:58 +01:00
c63559f55d
v4: fix race condition when continuing run when blocked at the same time ( #2073 )
...
* v4: fix race condition when continuing run when blocked at the same time
* Attempt to fix flaky e2e test
* Make waitpoint race condition test less flaky
2025-05-19 16:50:36 +01:00
8471169b30
Fix various dependabot alerts ( #2063 )
...
* Upgrade posthog-node to clear axios vulns
* Upgrade @slack/web-api to use a secure version of axios
* Update parse-duration to fix security vulns
* Mitigate against the ws DoS vuln
* Upgrade body-parser to 1.20.3 in the webapp
* Upgrade react-use to 17.5.1 to remove the fast-loops transitive dep
* Remove unused babel dev deps and config file that's no longer used
* Upgrade prismjs to 1.30.0 and bundle parse-duration now
* upgrade express to 4.20.0 to fix issue with XSS when redirecting
* Upgrade @conform/zod to 0.9.2
2025-05-19 12:01:51 +01:00
558a39c644
Remove supervisor docker binary requirement and other tweaks ( #2062 )
...
* don't require docker binary
* more structured logs
* remove docker type dep
* add core changeset
* use implicit DOCKER_HOST instead
* disable resource monitor for now
* support attaching docker runners to multiple networks
* warn if dequeue interval > idle dequeue interval
* verbose logs
* add changeset
2025-05-17 12:33:41 +01:00
b4ab06600b
Create AGENTS.md file ( #2070 )
2025-05-17 07:54:04 +01:00
c8e8bc9306
engine v2: Fix selectTopEnvs missing queues ( #2069 )
2025-05-17 07:53:48 +01:00
a69621bdcc
Allow self-hosted deploys locally by pointing to docker.host.internal on macOS ( #2064 )
2025-05-16 15:20:48 +01:00
ad4daa3301
Fix run replication payloads/outputs trying to send invalid types like BigInt to clickhouse ( #2065 )
2025-05-16 11:02:30 +01:00
bb7173b4ab
Improve run replication logging ( #2060 )
...
* Remove the tcp buffer monitors
* Improve run replication logging
2025-05-15 14:12:01 +01:00
2aee3debc0
Docs: 3rd party log exporters ( #2058 )
2025-05-15 10:50:15 +01:00
d1e40643fc
Allow creating and monitoring run replication services with different settings ( #2055 )
...
* Allow creating and monitoring run replication services with different settings
* Fix test
2025-05-14 20:40:47 +01:00
a8e38d9231
chore: Skip unit tests dependency when running publish image workflow ( #2054 )
2025-05-14 19:31:50 +01:00
2ae0e22d81
Release 4.0.0-v4-beta.16 ( #2053 )
...
* chore: Update version for release (v4-beta)
* Release 4.0.0-v4-beta.16
---------
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com >
2025-05-14 16:26:28 +01:00
206a2c3245
Fix init.ts detection for sentry plugin users ( #2051 )
...
* fix init.ts detection when using the sentry plugin
* add changeset
2025-05-14 16:20:05 +01:00
eb3929880f
runs replication leader lock expiration fix ( #2050 )
...
* runs replication leader lock expiration fix
* Allow configuring the container image --max-old-space-size using NODE_MAX_OLD_SPACE_SIZE
* Ability to configure the clickhouse keep alive settings
* Add some logging because we might not be able to do telemetry
2025-05-14 15:49:48 +01:00
0661ee5fdd
Release 4.0.0-v4-beta.15 ( #2040 )
...
* chore: Update version for release (v4-beta)
* Release 4.0.0-v4-beta.15
---------
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com >
2025-05-14 12:33:37 +01:00
2deef00d48
Improvements to the runs replication service to prevent buffer exhaustion ( #2047 )
2025-05-14 11:35:51 +01:00
fa5360a99d
Feat: supervisor ARM builds ( #2046 )
...
* v4 worker multi-arch builds
* v4-beta tag for webapp
* add oidc permission
* deps fetcher needs python
* node-gyp needs complete toolchain
* fix headers
* bust pnpm cache
* add setuptools
* switch back to old cache id
* push worker images
* pass the correct tags
2025-05-14 11:23:41 +01:00
7ace1c3e25
Fix run replication telemetry by passing in a tracer ( #2045 )
2025-05-14 09:52:09 +01:00
a815633712
Add external log exporters and fix missing external trace exporters in deployed tasks ( #2038 )
...
* Add external log exporters and fix missing external trace exporters in deployed tasks
* Generate the external traceID correctly and exporter 3rd party logs with the external traceID as well
2025-05-13 16:54:24 +01:00
84a0336bdd
Fix #1955 : schemaTask parse payload failures handled gracefully ( #2043 )
2025-05-13 16:47:21 +01:00
7be07b4d0e
allow configuring the replication leader lock settings ( #2042 )
2025-05-13 14:17:36 +01:00
bb96e848de
Fix init.ts import for deployed workers ( #2041 )
...
* import init file in managed worker
* refactor for easier diff
* managed worker: attach configured incorrectly error details
* add changeset
* disable pre
* we also didn't rewrite the output path
* Revert "disable pre"
This reverts commit 89afe44f6c42d4bd7b5a51f7fda1caec6cab8a24.
2025-05-13 13:27:49 +01:00
39f03085b4
feat: ffmpeg v7 ( #1777 )
...
* adding ffmpeg v7
* Renaming id ffmpeg to ffmpeg7
* added space
* fixing formatting issue
* fix unit test workflow for forks
* merge ffmpeg v7 into existing extension
* verify md5 checksum
* fix dns resolution
* fix v7 install
* remove redundant code
* add changeset
* mark fluent-ffmpeg as external
* add docs
* Revert "mark fluent-ffmpeg as external"
This reverts commit 74cd317ae69c7453a22d3fa412ff00b402840b87.
---------
Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com >
2025-05-13 12:27:35 +01:00
21c0dc619e
feat: playwright extension ( #1764 )
...
* feat: playwright build extension
* feat: add playwright task
* full dep list & added some comments
* fix v3-catalog
* log image size for local builds
* detect playwright version
* add changesets
* add docs
* additional checks
* fix unit test workflow for forks
* use middleware and update docs
* update jsdoc
---------
Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com >
2025-05-13 12:22:01 +01:00
da0ef73724
Docs: Removes an issue listed in ‘known issues’ in the v4 migration guide ( #2039 )
2025-05-13 10:14:27 +01:00
65da20c225
feat: replicate task runs to clickhouse to power dashboard improvements ( #2035 )
...
* WIP clickhouse package with test containers setup
* More clickhouse client setup now with otel and real tests, and the v1 of raw run events
* Add some additional columns to raw_run_events_v1
* WIP runs dashboard service
* Create a new run engine event bus event for the runs dashboard to hook into
* Track run events in the run engine
* make sure engine v1 runs get synced to CH
* Update the attemptNumber of v3 task runs
* Restructure the run events to be more sparse
* emit more stuff
* Setup replication package
* scaffold the replication package
* replication wip
* resolve conflicts
* more replication stuff
* Add ability to drop the replication slot completely on teardown
* Use the new single replacingmergetree task events table for replication
* get it working
* insert payloads into their own table only on insert and then join
* prepare for using clickhouse cloud and now running ch migrations during boot in the entrypoint.sh
* Handover WIP and tests
* Testing the replication service
* Remove the runs dashboard stuff that we aren't using anymore
* Added a test for large payloads
* hacky typecheck fix
* Fix new internal package typecheck issues and start adding telemetry to the replication service
* tracing over spans, some other improvements
* Improvements to the runs replication service, now ready for testing
* Some fixes and cleanups
* Don't need this code anymore
* move transaction types into the runs replication service
* only send spans where there are transaction events
* A couple of suggested tweaks
2025-05-12 22:12:36 +01:00
ccc9764383
Active incident status panel in the side menu ( #2033 )
...
* WIP adding a side menu panel to display incident statuses
* Fixes re-rendering bug and copy tweak
* cache the betterstack response using unkey
* Style the button to fit the panel colors
2025-05-09 15:52:17 +01:00
584722d48b
[v4] Complete a waitpoint and then get affected runs ( #2034 )
...
* Complete waitpoint before getting affected runs. Added more logging
* Added another error log
2025-05-09 15:46:41 +01:00
1b1ad16d94
Improve worker management admin route ( #2032 )
...
* improve route to add worker group, handles existing groups gracefully
* add option to remove default worker group from project
* separate project id field
* update supervisor readme with route changes
2025-05-09 10:43:31 +01:00
github-actions[bot]