Commit Graph

5037 Commits

Author SHA1 Message Date
Eric Allam 225effb599 Add task endpoints to the endpoint authentication table 2024-06-21 15:11:50 +01:00
Eric Allam 98eb6ed4f9 Add trigger and batch trigger API docs 2024-06-21 15:08:06 +01:00
Eric Allam 3069ebf0d8 Release 3.0.0-beta.40 @trigger.dev/airtable@3.0.0-beta.40 @trigger.dev/astro@3.0.0-beta.40 @trigger.dev/cli@3.0.0-beta.40 @trigger.dev/core-backend@3.0.0-beta.40 @trigger.dev/core@3.0.0-beta.40 @trigger.dev/eslint-plugin@3.0.0-beta.40 @trigger.dev/express@3.0.0-beta.40 @trigger.dev/github@3.0.0-beta.40 @trigger.dev/hono@3.0.0-beta.40 @trigger.dev/linear@3.0.0-beta.40 @trigger.dev/nestjs@3.0.0-beta.40 @trigger.dev/nextjs@3.0.0-beta.40 @trigger.dev/otlp-importer@3.0.0-beta.40 @trigger.dev/plain@3.0.0-beta.40 @trigger.dev/react@3.0.0-beta.40 @trigger.dev/remix@3.0.0-beta.40 @trigger.dev/replicate@3.0.0-beta.40 @trigger.dev/resend@3.0.0-beta.40 @trigger.dev/sdk@3.0.0-beta.40 @trigger.dev/sendgrid@3.0.0-beta.40 @trigger.dev/shopify@3.0.0-beta.40 @trigger.dev/slack@3.0.0-beta.40 @trigger.dev/stripe@3.0.0-beta.40 @trigger.dev/supabase@3.0.0-beta.40 @trigger.dev/sveltekit@3.0.0-beta.40 @trigger.dev/testing@3.0.0-beta.40 @trigger.dev/typeform@3.0.0-beta.40 @trigger.dev/yalt@3.0.0-beta.40 trigger.dev@3.0.0-beta.40 @trigger.dev/integration-kit@3.0.0-beta.40 @trigger.dev/openai@3.0.0-beta.40 2024-06-21 14:29:04 +01:00
github-actions[bot] e133e628ca chore: Update version for release (beta) (#1170)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-06-21 14:28:25 +01:00
Eric Allam 098932ea96 v3: edge runtime support (#1172)
* v3: remove node:stream and simplify env var upload API to better work with non-node runtimes

* Remove file/Response envvars upload docs

* Add changeset
2024-06-21 13:33:38 +01:00
Eric Allam 65f960e883 Move the max live reload setting into an env var instead of hardcoding it 2024-06-21 12:55:33 +01:00
Eric Allam ccbeff47e6 Improve trace view performance 2024-06-21 12:46:46 +01:00
Matt Aitken 7c8f2df105 After 500 logs we stop live reloading on the run page 2024-06-21 11:26:02 +01:00
Eric Allam fd44dabfe0 Disable the event loop monitor 2024-06-20 23:56:29 +01:00
Eric Allam 5daed3f69d Turn off rebalancing 2024-06-20 23:42:54 +01:00
Eric Allam 596bf78e55 Add an event loop monitor 2024-06-20 23:26:38 +01:00
Eric Allam 6ca66b76f4 Remove unnecessary transaction from the runtime environment session handling 2024-06-20 22:47:12 +01:00
nicktrn 29ef0395ce Only import types from db in task status 2024-06-20 15:25:18 +01:00
nicktrn 55d1f8c677 v3: fix dependency checkpoint race (#1171)
* consolidate task statuses and utils

* check dependency completion when creating checkpoints

* add changeset
2024-06-20 10:10:39 +01:00
Eric Allam 9835f4ec55 Adding changeset 2024-06-19 15:11:50 +01:00
Eric Allam 7fae10db23 v3: make sure force flush timeout is set so flushing doesn’t hang forever 2024-06-19 14:56:10 +01:00
Eric Allam 8cf1f0a37d v3: don’t set a default forceFlushTimeoutMillis 2024-06-19 14:29:50 +01:00
Eric Allam dba4313c5c v3: more visibility into flushing worker otel data in prod 2024-06-19 14:22:06 +01:00
Eric Allam 506613dc92 v3: prod workers should always log everything from forked node process 2024-06-19 14:05:30 +01:00
Eric Allam 764df23d19 Release 3.0.0-beta.39 @trigger.dev/airtable@3.0.0-beta.39 @trigger.dev/astro@3.0.0-beta.39 @trigger.dev/cli@3.0.0-beta.39 @trigger.dev/core-backend@3.0.0-beta.39 @trigger.dev/core@3.0.0-beta.39 @trigger.dev/eslint-plugin@3.0.0-beta.39 @trigger.dev/express@3.0.0-beta.39 @trigger.dev/github@3.0.0-beta.39 @trigger.dev/integration-kit@3.0.0-beta.39 @trigger.dev/linear@3.0.0-beta.39 @trigger.dev/nestjs@3.0.0-beta.39 @trigger.dev/nextjs@3.0.0-beta.39 @trigger.dev/openai@3.0.0-beta.39 @trigger.dev/otlp-importer@3.0.0-beta.39 @trigger.dev/plain@3.0.0-beta.39 @trigger.dev/react@3.0.0-beta.39 @trigger.dev/remix@3.0.0-beta.39 @trigger.dev/replicate@3.0.0-beta.39 @trigger.dev/resend@3.0.0-beta.39 @trigger.dev/sdk@3.0.0-beta.39 @trigger.dev/sendgrid@3.0.0-beta.39 @trigger.dev/shopify@3.0.0-beta.39 @trigger.dev/slack@3.0.0-beta.39 @trigger.dev/stripe@3.0.0-beta.39 @trigger.dev/supabase@3.0.0-beta.39 @trigger.dev/sveltekit@3.0.0-beta.39 @trigger.dev/testing@3.0.0-beta.39 @trigger.dev/typeform@3.0.0-beta.39 @trigger.dev/yalt@3.0.0-beta.39 trigger.dev@3.0.0-beta.39 @trigger.dev/hono@3.0.0-beta.39 2024-06-19 12:22:19 +01:00
github-actions[bot] 4b961a6ae2 chore: Update version for release (beta) (#1169)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-06-19 12:21:30 +01:00
Eric Allam 8757fdceef v3: [prod] force flush timeout should be 1s 2024-06-19 12:16:11 +01:00
Eric Allam 2404e88ac5 Add a IMPORTANT note to the ProdTaskRunExecution 2024-06-19 11:16:40 +01:00
Eric Allam 88b36f5090 Add a default on machine preset 2024-06-19 11:07:57 +01:00
Eric Allam b73ae3f927 Release 3.0.0-beta.38 @trigger.dev/airtable@3.0.0-beta.38 @trigger.dev/astro@3.0.0-beta.38 @trigger.dev/cli@3.0.0-beta.38 @trigger.dev/core@3.0.0-beta.38 @trigger.dev/eslint-plugin@3.0.0-beta.38 @trigger.dev/express@3.0.0-beta.38 @trigger.dev/github@3.0.0-beta.38 @trigger.dev/hono@3.0.0-beta.38 @trigger.dev/integration-kit@3.0.0-beta.38 @trigger.dev/linear@3.0.0-beta.38 @trigger.dev/nestjs@3.0.0-beta.38 @trigger.dev/nextjs@3.0.0-beta.38 @trigger.dev/openai@3.0.0-beta.38 @trigger.dev/otlp-importer@3.0.0-beta.38 @trigger.dev/plain@3.0.0-beta.38 @trigger.dev/react@3.0.0-beta.38 @trigger.dev/remix@3.0.0-beta.38 @trigger.dev/replicate@3.0.0-beta.38 @trigger.dev/sdk@3.0.0-beta.38 @trigger.dev/sendgrid@3.0.0-beta.38 @trigger.dev/shopify@3.0.0-beta.38 @trigger.dev/slack@3.0.0-beta.38 @trigger.dev/stripe@3.0.0-beta.38 @trigger.dev/supabase@3.0.0-beta.38 @trigger.dev/sveltekit@3.0.0-beta.38 @trigger.dev/testing@3.0.0-beta.38 @trigger.dev/typeform@3.0.0-beta.38 @trigger.dev/yalt@3.0.0-beta.38 trigger.dev@3.0.0-beta.38 @trigger.dev/core-backend@3.0.0-beta.38 @trigger.dev/resend@3.0.0-beta.38 2024-06-19 10:40:29 +01:00
github-actions[bot] b605b892ac chore: Update version for release (beta) (#1166)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-06-19 10:39:24 +01:00
Eric Allam 233316f7e8 TaskRun.startedAt will now be lazily migrated 2024-06-18 15:49:14 +01:00
Eric Allam 1b90ffbb8c Add a changeset for the usage tracking PR (I forgot) 2024-06-18 14:56:25 +01:00
Matt Aitken b45ca4e146 If the timezone has changed then we need to reschedule the next scheduled run 2024-06-18 14:49:16 +01:00
Eric Allam 25d15578f7 Remove the update migration 2024-06-18 13:51:29 +01:00
Eric Allam fe865a0f49 Make startedAt backwards compat by giving it a default 2024-06-18 13:16:36 +01:00
Eric Allam 0ed93a748e v3: Remove aggressive otel flush timeouts in dev/prod 2024-06-18 11:48:35 +01:00
Michael Li e02320f65d fix: allow command login to read api url from cli args (#1168)
* fix: allow login to read api url from args

* Create strong-phones-smoke.md

---------

Co-authored-by: Eric Allam <eallam@icloud.com>
2024-06-18 09:43:42 +01:00
Eric Allam 85a543d8ec v3: usage tracking (#1163)
* Starting to measure wall time and cpu time in the workers, and reporting that via otel and to completed task run attempts

* Move usage tracking outside of the executor

* WIP prod usage tracking

* WIP

* WIP custom fetch to openmeter

* Create a usage client

* WIP

* WIP

* Implement new machine preset stuff and send usage reports to OpenMeter from webapp

* WIP

* Expose usage info to the client

* Add usage and cost to TaskEvent

* Add ability to globally configure the task machine preset

* Report start run usage

* Change the machine docs to use presets

* setExpirationTime to 24h

* Removed logs

* Update machines.mdx

* Removed console.logs

* Handle revalidating JWT tokens

* Couple tweaks

---------

Co-authored-by: Matt Aitken <matt@mattaitken.com>
2024-06-18 09:40:23 +01:00
Ryan Lee 10ceb85a92 fix: cloudfront timeouts not being caught (#1162) 2024-06-14 15:11:39 +01:00
Matt Aitken c405ae7117 Schedule limits and timezone support (#1165)
* Added maximumScheduleInstancesLimit column to Org, default to 20

* Docs on the schedule limits and improved soft-limit communication

* Added limit info to the schedules list page

* Created a task that creates schedules, useful for testing

* Make deduplicationKey required when creating/updating a schedule using the SDK

* New schedule button shows an alert if you’re over the limit

* Added timezone to the form and db

* WIP on the timezone dropdown for the create/edit schedule form

* Use the new filter search for timezones

* Made the timezone dropdown faster by fixing the virtualization

* The preview table is working and added a nice message about daylight savings

* Created a page where you can view the full list of timezones

The URL is included in the error message if you send an invalid time using the SDK

* Creating tasks with the timezone

* Added timezone support the the scheduler and the schedules list

* Added timezone support to more of the schedules UI

* The timezone comes through to scheduled runs with nice JSDocs

* Allow setting the timezone from the SDK

* Always have a timezone on a schedule

* Updated jsdocs

* Updated catalog example

* Changed the column to be a string, not null. Added the timezone across the SDK

* API endpoint for getting the timezones

* Added an SDK function to get the list of timezones

* Added timezones to the docs

* Changeset: Added timezone support to schedules

* Added support for testing timezone

* Tidied up imports

* Imports

* Imports

* Update limits.mdx

* Fixed a couple type issues and use the already exported zodfetch

---------

Co-authored-by: Eric Allam <eallam@icloud.com>
2024-06-14 13:31:27 +01:00
nicktrn 3687fcb61e Make pod cleaner interval configurable 2024-06-14 12:12:42 +01:00
Émile Ré d4ccdf7105 v3 CLI compiling E2E test suite (#1135)
* Boilerplate server-only use case

* wip: integration suite instrumentation setup

* Working poc testing compileProject

* Add pnpm script to run e2e tests only

* Use vitest globals

* Remove commented line

* Remove useless export

* Add modifier to test only one fixture project

* Handle package manager and log level choice

* Update server-only example

* Setup / teardown + split compile for package manager capabilities

* Ignore yarn files

* Fix issue with corepack, store version in engines field

* Rename test file

* Fix npm updates yarn.lock

* Move typecheking in a dedicated test

* Stop bundling the compile command to allow for more granular testing

* Put config resolving in separate test

* Add no-config test case and add test case expected errors configuration

* Add wantCompilationError option

* Add dependencies handling

* Use packageManager passed as option to resolve required deps

* Remove unused guard clauses

* Add postinstall & hash handling step

* Add worker start test

* Handle yarn.lock copy renaming on sigterm and sigkill

* Update vitest and use concurrent option

* Add a readme file

* Add CI workflow

* Fix handle cli deps

* Run cli v3 e2e tests on publish action

* Increase timeout on deps resolving step

* Add changeset

* Remove .pnp.cjs as we use yarn with nodeLinker node-modules

* Add missing .yarnrc.yml file

* No need to build CLI to run E2E tests

* Remove bun.lockb files

* Update beige-pears-explode.md

---------

Co-authored-by: Eric Allam <eallam@icloud.com>
2024-06-14 11:28:36 +01:00
nicktrn e08b4569e5 Improve checkpoint restore logging 2024-06-13 10:18:41 +01:00
nicktrn 79da0ca9b5 Update lockfile @trigger.dev/airtable@3.0.0-beta.37 @trigger.dev/astro@3.0.0-beta.37 @trigger.dev/cli@3.0.0-beta.37 @trigger.dev/core@3.0.0-beta.37 @trigger.dev/eslint-plugin@3.0.0-beta.37 @trigger.dev/express@3.0.0-beta.37 @trigger.dev/github@3.0.0-beta.37 @trigger.dev/hono@3.0.0-beta.37 @trigger.dev/integration-kit@3.0.0-beta.37 @trigger.dev/linear@3.0.0-beta.37 @trigger.dev/nestjs@3.0.0-beta.37 @trigger.dev/nextjs@3.0.0-beta.37 @trigger.dev/otlp-importer@3.0.0-beta.37 @trigger.dev/plain@3.0.0-beta.37 @trigger.dev/react@3.0.0-beta.37 @trigger.dev/remix@3.0.0-beta.37 @trigger.dev/replicate@3.0.0-beta.37 @trigger.dev/resend@3.0.0-beta.37 @trigger.dev/sendgrid@3.0.0-beta.37 @trigger.dev/shopify@3.0.0-beta.37 @trigger.dev/slack@3.0.0-beta.37 @trigger.dev/supabase@3.0.0-beta.37 @trigger.dev/sveltekit@3.0.0-beta.37 @trigger.dev/testing@3.0.0-beta.37 @trigger.dev/typeform@3.0.0-beta.37 trigger.dev@3.0.0-beta.37 @trigger.dev/core-backend@3.0.0-beta.37 @trigger.dev/stripe@3.0.0-beta.37 @trigger.dev/yalt@3.0.0-beta.37 @trigger.dev/sdk@3.0.0-beta.37 @trigger.dev/openai@3.0.0-beta.37 2024-06-12 17:37:58 +01:00
github-actions[bot] 3aca603a33 chore: Update version for release (beta) (#1153)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-06-12 17:34:47 +01:00
Eric Allam c9e97d6b78 Add debug logging when we skip importing a resource span 2024-06-12 17:27:12 +01:00
nicktrn 01633c9c03 Print error logs on dev worker failure 2024-06-12 13:08:50 +01:00
nicktrn 691990d79e Remove catalog example that was causing typecheck issues 2024-06-12 12:48:19 +01:00
nicktrn b2ba403dd3 Improve error logs cli message 2024-06-12 12:04:59 +01:00
nicktrn 1d47cab69f Ensure rollback triggers execution of tasks waiting for deploy 2024-06-12 11:51:51 +01:00
nicktrn e23047f9ad update pre-release script 2024-06-12 09:49:47 +01:00
nicktrn 68d32429b6 v3: checkpoint failover and misc fixes (#1157)
* configurable checkpoint registry namespace

* add missing task create await

* remove unused messages

* changeset

* update self-hosting docs

* capture and display stderr for failed deploys

* add missing lockfile changes

* stderr changeset

* fix cli stderr message

* update error logs label
2024-06-11 14:06:50 +01:00
Eric Allam 36ac79ac66 Make sure users cannot revoke invites for other orgs 2024-06-11 11:09:52 +01:00
Eric Allam ca94f0cac3 cli v3: fix deploys by using sub-path imports (fixes execa require ESM error) 2024-06-11 11:08:15 +01:00