Commit Graph

5052 Commits

Author SHA1 Message Date
Eric Allam ccb0bc510a Release 3.0.0-beta.43 @trigger.dev/astro@3.0.0-beta.43 @trigger.dev/cli@3.0.0-beta.43 @trigger.dev/core-backend@3.0.0-beta.43 @trigger.dev/core@3.0.0-beta.43 @trigger.dev/eslint-plugin@3.0.0-beta.43 @trigger.dev/express@3.0.0-beta.43 @trigger.dev/hono@3.0.0-beta.43 @trigger.dev/integration-kit@3.0.0-beta.43 @trigger.dev/linear@3.0.0-beta.43 @trigger.dev/nestjs@3.0.0-beta.43 @trigger.dev/nextjs@3.0.0-beta.43 @trigger.dev/openai@3.0.0-beta.43 @trigger.dev/otlp-importer@3.0.0-beta.43 @trigger.dev/plain@3.0.0-beta.43 @trigger.dev/react@3.0.0-beta.43 @trigger.dev/remix@3.0.0-beta.43 @trigger.dev/replicate@3.0.0-beta.43 @trigger.dev/resend@3.0.0-beta.43 @trigger.dev/sdk@3.0.0-beta.43 @trigger.dev/sendgrid@3.0.0-beta.43 @trigger.dev/slack@3.0.0-beta.43 @trigger.dev/stripe@3.0.0-beta.43 @trigger.dev/supabase@3.0.0-beta.43 @trigger.dev/sveltekit@3.0.0-beta.43 @trigger.dev/testing@3.0.0-beta.43 @trigger.dev/typeform@3.0.0-beta.43 @trigger.dev/yalt@3.0.0-beta.43 trigger.dev@3.0.0-beta.43 @trigger.dev/shopify@3.0.0-beta.43 @trigger.dev/github@3.0.0-beta.43 @trigger.dev/airtable@3.0.0-beta.43 2024-06-27 11:09:27 +01:00
github-actions[bot] 56d66ee07c chore: Update version for release (beta) (#1182)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-06-27 11:08:30 +01:00
Eric Allam 4ca8887972 v3: fix issue where in progress events weren’t being shown 2024-06-26 16:15:44 +01:00
Eric Allam 89bffc066c Remove the [traceId, startTime] index on TaskEvent for now (not necessary) 2024-06-26 15:32:43 +01:00
Eric Allam 34ca7667d3 Various perf improvements to prevent event loop lag (#1186)
* WIP

* Handle tasks that have failed but are being auto yielded

* Limit trace view to 25k event records, add a download run logs button

Also added two new indexes to TaskEvent:

```
/// Used on eventRepository.getTraceSummary()
  @@index([traceId, startTime])
  // Used for getting all logs for a run
  @@index([runId])
```

* perf improvements on eventRepository.getSpan()

* v2: Add a 5 minute timeout for run execution requests in dev

* v3: Include presigned urls for downloading large payloads and outputs when using runs.retrieve

* v3: better handle large task payloads and outputs

* Change to 512KB

* v2: paginate trigger schedules endpoint

* v3: add 3MB limit on batch and single payloads

* Update task payload and output limits
2024-06-26 15:22:35 +01:00
nicktrn 3e327acc0f Catch zod message sender exceptions 2024-06-26 15:20:33 +01:00
Eric Allam 77ad4127cb v3: Improved ESM module require error detection logic 2024-06-25 09:08:43 +01:00
Eric Allam 8a5076aacf Release 3.0.0-beta.42 @trigger.dev/airtable@3.0.0-beta.42 @trigger.dev/astro@3.0.0-beta.42 @trigger.dev/cli@3.0.0-beta.42 @trigger.dev/core-backend@3.0.0-beta.42 @trigger.dev/core@3.0.0-beta.42 @trigger.dev/eslint-plugin@3.0.0-beta.42 @trigger.dev/express@3.0.0-beta.42 @trigger.dev/github@3.0.0-beta.42 @trigger.dev/hono@3.0.0-beta.42 @trigger.dev/integration-kit@3.0.0-beta.42 @trigger.dev/linear@3.0.0-beta.42 @trigger.dev/nestjs@3.0.0-beta.42 @trigger.dev/nextjs@3.0.0-beta.42 @trigger.dev/openai@3.0.0-beta.42 @trigger.dev/otlp-importer@3.0.0-beta.42 @trigger.dev/plain@3.0.0-beta.42 @trigger.dev/react@3.0.0-beta.42 @trigger.dev/replicate@3.0.0-beta.42 @trigger.dev/resend@3.0.0-beta.42 @trigger.dev/sdk@3.0.0-beta.42 @trigger.dev/sendgrid@3.0.0-beta.42 @trigger.dev/stripe@3.0.0-beta.42 @trigger.dev/supabase@3.0.0-beta.42 @trigger.dev/sveltekit@3.0.0-beta.42 @trigger.dev/testing@3.0.0-beta.42 @trigger.dev/typeform@3.0.0-beta.42 @trigger.dev/yalt@3.0.0-beta.42 trigger.dev@3.0.0-beta.42 @trigger.dev/shopify@3.0.0-beta.42 @trigger.dev/remix@3.0.0-beta.42 @trigger.dev/slack@3.0.0-beta.42 2024-06-24 19:52:22 +01:00
github-actions[bot] 5399f6bfb7 chore: Update version for release (beta) (#1181)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-06-24 19:51:48 +01:00
Eric Allam ecef199660 v3: Use global setTimeout to ensure cross-runtime support 2024-06-24 19:49:22 +01:00
Eric Allam 4acfb8f4bb Release 3.0.0-beta.41 @trigger.dev/airtable@3.0.0-beta.41 @trigger.dev/astro@3.0.0-beta.41 @trigger.dev/cli@3.0.0-beta.41 @trigger.dev/core-backend@3.0.0-beta.41 @trigger.dev/core@3.0.0-beta.41 @trigger.dev/eslint-plugin@3.0.0-beta.41 @trigger.dev/express@3.0.0-beta.41 @trigger.dev/hono@3.0.0-beta.41 @trigger.dev/linear@3.0.0-beta.41 @trigger.dev/nextjs@3.0.0-beta.41 @trigger.dev/openai@3.0.0-beta.41 @trigger.dev/otlp-importer@3.0.0-beta.41 @trigger.dev/plain@3.0.0-beta.41 @trigger.dev/react@3.0.0-beta.41 @trigger.dev/remix@3.0.0-beta.41 @trigger.dev/replicate@3.0.0-beta.41 @trigger.dev/resend@3.0.0-beta.41 @trigger.dev/sdk@3.0.0-beta.41 @trigger.dev/sendgrid@3.0.0-beta.41 @trigger.dev/shopify@3.0.0-beta.41 @trigger.dev/slack@3.0.0-beta.41 @trigger.dev/stripe@3.0.0-beta.41 @trigger.dev/supabase@3.0.0-beta.41 @trigger.dev/sveltekit@3.0.0-beta.41 @trigger.dev/testing@3.0.0-beta.41 @trigger.dev/typeform@3.0.0-beta.41 @trigger.dev/yalt@3.0.0-beta.41 trigger.dev@3.0.0-beta.41 @trigger.dev/nestjs@3.0.0-beta.41 @trigger.dev/integration-kit@3.0.0-beta.41 @trigger.dev/github@3.0.0-beta.41 2024-06-24 17:30:01 +01:00
github-actions[bot] 2ef278db67 chore: Update version for release (beta) (#1178)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-06-24 17:29:32 +01:00
Eric Allam c7a55804d9 v3: fix jsonc-parser import in cli
Lock jsonc-parser to 3.2.1

Revert that change
2024-06-24 17:24:23 +01:00
Eric Allam da6a66efff v3: fix task queues with concurrency = 0 getting cleared on task trigger 2024-06-24 16:37:30 +01:00
Eric Allam 7c36a1a4b0 v3: Adding SDK functions for triggering tasks in a typesafe way (#1177)
* v3: Adding SDK functions for triggering tasks in a typesafe way, without importing task file

* Add type usages
2024-06-24 12:37:34 +01:00
Eric Allam 225effb599 Add task endpoints to the endpoint authentication table 2024-06-21 15:11:50 +01:00
Eric Allam 98eb6ed4f9 Add trigger and batch trigger API docs 2024-06-21 15:08:06 +01:00
Eric Allam 3069ebf0d8 Release 3.0.0-beta.40 @trigger.dev/airtable@3.0.0-beta.40 @trigger.dev/astro@3.0.0-beta.40 @trigger.dev/cli@3.0.0-beta.40 @trigger.dev/core-backend@3.0.0-beta.40 @trigger.dev/core@3.0.0-beta.40 @trigger.dev/eslint-plugin@3.0.0-beta.40 @trigger.dev/express@3.0.0-beta.40 @trigger.dev/github@3.0.0-beta.40 @trigger.dev/hono@3.0.0-beta.40 @trigger.dev/nestjs@3.0.0-beta.40 @trigger.dev/nextjs@3.0.0-beta.40 @trigger.dev/otlp-importer@3.0.0-beta.40 @trigger.dev/plain@3.0.0-beta.40 @trigger.dev/react@3.0.0-beta.40 @trigger.dev/remix@3.0.0-beta.40 @trigger.dev/replicate@3.0.0-beta.40 @trigger.dev/resend@3.0.0-beta.40 @trigger.dev/sdk@3.0.0-beta.40 @trigger.dev/sendgrid@3.0.0-beta.40 @trigger.dev/shopify@3.0.0-beta.40 @trigger.dev/slack@3.0.0-beta.40 @trigger.dev/stripe@3.0.0-beta.40 @trigger.dev/supabase@3.0.0-beta.40 @trigger.dev/sveltekit@3.0.0-beta.40 @trigger.dev/testing@3.0.0-beta.40 @trigger.dev/typeform@3.0.0-beta.40 @trigger.dev/yalt@3.0.0-beta.40 @trigger.dev/integration-kit@3.0.0-beta.40 @trigger.dev/openai@3.0.0-beta.40 trigger.dev@3.0.0-beta.40 @trigger.dev/linear@3.0.0-beta.40 2024-06-21 14:29:04 +01:00
github-actions[bot] e133e628ca chore: Update version for release (beta) (#1170)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-06-21 14:28:25 +01:00
Eric Allam 098932ea96 v3: edge runtime support (#1172)
* v3: remove node:stream and simplify env var upload API to better work with non-node runtimes

* Remove file/Response envvars upload docs

* Add changeset
2024-06-21 13:33:38 +01:00
Eric Allam 65f960e883 Move the max live reload setting into an env var instead of hardcoding it 2024-06-21 12:55:33 +01:00
Eric Allam ccbeff47e6 Improve trace view performance 2024-06-21 12:46:46 +01:00
Matt Aitken 7c8f2df105 After 500 logs we stop live reloading on the run page 2024-06-21 11:26:02 +01:00
Eric Allam fd44dabfe0 Disable the event loop monitor 2024-06-20 23:56:29 +01:00
Eric Allam 5daed3f69d Turn off rebalancing 2024-06-20 23:42:54 +01:00
Eric Allam 596bf78e55 Add an event loop monitor 2024-06-20 23:26:38 +01:00
Eric Allam 6ca66b76f4 Remove unnecessary transaction from the runtime environment session handling 2024-06-20 22:47:12 +01:00
nicktrn 29ef0395ce Only import types from db in task status 2024-06-20 15:25:18 +01:00
nicktrn 55d1f8c677 v3: fix dependency checkpoint race (#1171)
* consolidate task statuses and utils

* check dependency completion when creating checkpoints

* add changeset
2024-06-20 10:10:39 +01:00
Eric Allam 9835f4ec55 Adding changeset 2024-06-19 15:11:50 +01:00
Eric Allam 7fae10db23 v3: make sure force flush timeout is set so flushing doesn’t hang forever 2024-06-19 14:56:10 +01:00
Eric Allam 8cf1f0a37d v3: don’t set a default forceFlushTimeoutMillis 2024-06-19 14:29:50 +01:00
Eric Allam dba4313c5c v3: more visibility into flushing worker otel data in prod 2024-06-19 14:22:06 +01:00
Eric Allam 506613dc92 v3: prod workers should always log everything from forked node process 2024-06-19 14:05:30 +01:00
Eric Allam 764df23d19 Release 3.0.0-beta.39 @trigger.dev/airtable@3.0.0-beta.39 @trigger.dev/cli@3.0.0-beta.39 @trigger.dev/core-backend@3.0.0-beta.39 @trigger.dev/core@3.0.0-beta.39 @trigger.dev/eslint-plugin@3.0.0-beta.39 @trigger.dev/express@3.0.0-beta.39 @trigger.dev/github@3.0.0-beta.39 @trigger.dev/integration-kit@3.0.0-beta.39 @trigger.dev/linear@3.0.0-beta.39 @trigger.dev/nestjs@3.0.0-beta.39 @trigger.dev/nextjs@3.0.0-beta.39 @trigger.dev/openai@3.0.0-beta.39 @trigger.dev/plain@3.0.0-beta.39 @trigger.dev/react@3.0.0-beta.39 @trigger.dev/remix@3.0.0-beta.39 @trigger.dev/replicate@3.0.0-beta.39 @trigger.dev/resend@3.0.0-beta.39 @trigger.dev/sdk@3.0.0-beta.39 @trigger.dev/sendgrid@3.0.0-beta.39 @trigger.dev/shopify@3.0.0-beta.39 @trigger.dev/slack@3.0.0-beta.39 @trigger.dev/stripe@3.0.0-beta.39 @trigger.dev/sveltekit@3.0.0-beta.39 @trigger.dev/testing@3.0.0-beta.39 @trigger.dev/typeform@3.0.0-beta.39 @trigger.dev/yalt@3.0.0-beta.39 trigger.dev@3.0.0-beta.39 @trigger.dev/hono@3.0.0-beta.39 @trigger.dev/otlp-importer@3.0.0-beta.39 @trigger.dev/astro@3.0.0-beta.39 @trigger.dev/supabase@3.0.0-beta.39 2024-06-19 12:22:19 +01:00
github-actions[bot] 4b961a6ae2 chore: Update version for release (beta) (#1169)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-06-19 12:21:30 +01:00
Eric Allam 8757fdceef v3: [prod] force flush timeout should be 1s 2024-06-19 12:16:11 +01:00
Eric Allam 2404e88ac5 Add a IMPORTANT note to the ProdTaskRunExecution 2024-06-19 11:16:40 +01:00
Eric Allam 88b36f5090 Add a default on machine preset 2024-06-19 11:07:57 +01:00
Eric Allam b73ae3f927 Release 3.0.0-beta.38 @trigger.dev/airtable@3.0.0-beta.38 @trigger.dev/astro@3.0.0-beta.38 @trigger.dev/cli@3.0.0-beta.38 @trigger.dev/core@3.0.0-beta.38 @trigger.dev/eslint-plugin@3.0.0-beta.38 @trigger.dev/express@3.0.0-beta.38 @trigger.dev/github@3.0.0-beta.38 @trigger.dev/hono@3.0.0-beta.38 @trigger.dev/integration-kit@3.0.0-beta.38 @trigger.dev/linear@3.0.0-beta.38 @trigger.dev/nestjs@3.0.0-beta.38 @trigger.dev/nextjs@3.0.0-beta.38 @trigger.dev/openai@3.0.0-beta.38 @trigger.dev/otlp-importer@3.0.0-beta.38 @trigger.dev/plain@3.0.0-beta.38 @trigger.dev/react@3.0.0-beta.38 @trigger.dev/remix@3.0.0-beta.38 @trigger.dev/replicate@3.0.0-beta.38 @trigger.dev/sdk@3.0.0-beta.38 @trigger.dev/sendgrid@3.0.0-beta.38 @trigger.dev/shopify@3.0.0-beta.38 @trigger.dev/slack@3.0.0-beta.38 @trigger.dev/stripe@3.0.0-beta.38 @trigger.dev/supabase@3.0.0-beta.38 @trigger.dev/sveltekit@3.0.0-beta.38 @trigger.dev/testing@3.0.0-beta.38 @trigger.dev/typeform@3.0.0-beta.38 @trigger.dev/yalt@3.0.0-beta.38 trigger.dev@3.0.0-beta.38 @trigger.dev/core-backend@3.0.0-beta.38 @trigger.dev/resend@3.0.0-beta.38 2024-06-19 10:40:29 +01:00
github-actions[bot] b605b892ac chore: Update version for release (beta) (#1166)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-06-19 10:39:24 +01:00
Eric Allam 233316f7e8 TaskRun.startedAt will now be lazily migrated 2024-06-18 15:49:14 +01:00
Eric Allam 1b90ffbb8c Add a changeset for the usage tracking PR (I forgot) 2024-06-18 14:56:25 +01:00
Matt Aitken b45ca4e146 If the timezone has changed then we need to reschedule the next scheduled run 2024-06-18 14:49:16 +01:00
Eric Allam 25d15578f7 Remove the update migration 2024-06-18 13:51:29 +01:00
Eric Allam fe865a0f49 Make startedAt backwards compat by giving it a default 2024-06-18 13:16:36 +01:00
Eric Allam 0ed93a748e v3: Remove aggressive otel flush timeouts in dev/prod 2024-06-18 11:48:35 +01:00
Michael Li e02320f65d fix: allow command login to read api url from cli args (#1168)
* fix: allow login to read api url from args

* Create strong-phones-smoke.md

---------

Co-authored-by: Eric Allam <eallam@icloud.com>
2024-06-18 09:43:42 +01:00
Eric Allam 85a543d8ec v3: usage tracking (#1163)
* Starting to measure wall time and cpu time in the workers, and reporting that via otel and to completed task run attempts

* Move usage tracking outside of the executor

* WIP prod usage tracking

* WIP

* WIP custom fetch to openmeter

* Create a usage client

* WIP

* WIP

* Implement new machine preset stuff and send usage reports to OpenMeter from webapp

* WIP

* Expose usage info to the client

* Add usage and cost to TaskEvent

* Add ability to globally configure the task machine preset

* Report start run usage

* Change the machine docs to use presets

* setExpirationTime to 24h

* Removed logs

* Update machines.mdx

* Removed console.logs

* Handle revalidating JWT tokens

* Couple tweaks

---------

Co-authored-by: Matt Aitken <matt@mattaitken.com>
2024-06-18 09:40:23 +01:00
Ryan Lee 10ceb85a92 fix: cloudfront timeouts not being caught (#1162) 2024-06-14 15:11:39 +01:00