* WIP execution concurrency controls implemented via Redis
- Split up resuming a run and executing a run
- Added some new statuses to better show what is going on in a run
- Removed preprocessing runs
* WIP
* Convert to using ZSETs and adding env vars
* Removed unused import
* Improve run number generation using advistory locks, and only on start
* More execution concurrency stuff
* Add support for job concurrency limits and concurrency limit groups
* Create wild-swans-battle.md
* Increase slots refresh timeout to 10s
* Try to fix Redis connection issues
* Don’t be so strict about the APP_ENV
* Add the blank tls option to the normal redis client as well
* Add docs
* Add OpenAI support for 4.16.0
* Add support for background polling and use that in OpenAI integration to power assistants
* Much improved OpenAI docs
* Added backgroundPoll docs
* Implements waitForEvent and added docs for more built in tasks
* Add sendEvent API referenc
* Write the task libray
* Add changeset and warning for waitForEvent
* Implement manually invokable jobs through the invokeTrigger
Also implemented a job run notification system, that will POST details of a run on completion. This combines with the task callbackUrl system to implement the invokeAndWait
* Document the invoke trigger
* batch invoke and wait
* background fetch timeouts
* Use @whatwg-node/fetch instead of the polyfilled fetch
* Fix some outdated dependencies in webapp
* Improved subtask error propogation messages
* Document the OpenAI changes and the batch invoke stuff
* Fix dequeuing jobs
* Don’t retry the OpenAI completion background task
* Added OpenAI changesets
* Use the new ResumeTaskService in ProcessCallbackTimeout as well
* Card hover state is now grey
* Added a callout warning if you don’t have any tasks
* Conditionally show the no-task warning at the top of the run
* New job to test the no-task warning message
* Created a new example Job for the CLI that uses Tasks
* Updated the Next.js cli joke job
* Updated the Remix app cli job example
* Updated the Astro app cli job example
* Made sure the example job works in remix
* Added changeset
---------
Co-authored-by: Eric Allam <eric@trigger.dev>
This commit introduces the ability to set custom base URLs, which allows for the use of different APIs such as Perplexity. It also ensures that any OpenAI-related task now includes an idempotency key when making requests. Works for background tasks as well.
* Auto-yield run execution to help prevent duplicate task executions
* Add auto-yield config to endpoints
* Refactor run execution with buffer and limits
Introduced constants RUN_CHUNK_EXECUTION_BUFFER and MAX_RUN_CHUNK_EXECUTION_LIMIT. Adjusted PerformRunExecutionV2Service to use the new constants to fine-tune execution timings and buffers.
* Add endpoint probing functionality
Added new `RESPONSE_TIMEOUT_STATUS_CODES` in `consts.ts` to manage timeout responses. Additional functions `detectResponseIsTimeout(response: Response)` was added in `endpoint.server.ts` to detect if a response was a timeout based on the status codes from `RESPONSE_TIMEOUT_STATUS_CODES`.
Update actions to use new endpoint probing endpoint service. This allows for the early probing of endpoints to determine if they're up and running.
A new class `ProbeEndpointService` was created in `probeEndpoint.server.ts` which makes HTTP requests to a given endpoint and updates its properties based on the result.
Finally, `detectResponseIsTimeout(response)` is used in `performRunExecutionV2.server.ts` for marking the execution as succeeded when facing a timeout.
* Refactored probe method in EndpointApi class
The probe method of the EndpointApi class has been refactored to remove the error handling part and it now takes a timeout sent from the client directly. The corresponding changes were also made in the ProbeEndpointService and TriggerClient objects to reflect the alterations in the probe method.
The error handling related to the timeout has been removed and the responsibility of handling the timeout has been shifted to the client. Thus, the probe method has been greatly simplified. The `probeEndpoint.server.ts` file was also changed to accommodate the change in behavior of the probe result.
In the `triggerClient.ts` the timeout for probe is now read from the incoming request object. For backward compatibility, if no timeout is provided in the request, the default value of 15 minutes is used.
* Remove performRunExecution v1 enqueue function
* Better document limits and add docs on increasing function timeouts
* Upgrade webapp docker container to use 18.18.2
* force clients to yield when a run is executing in a gracefully shutting down worker
* Renamed task `key` to `cacheKey` and added more task documentation
* Index the `@trigger.dev/sdk` version on Endpoints
commit 13ed268f1d6732ef28c6e4a9eeb927c1af822032
Author: Matt Aitken <matt@mattaitken.com>
Date: Fri Oct 20 11:38:22 2023 +0100
Added all the tabler-icons to Storybook
commit 62738d71a40f17c45c0b29332359b2b670233a97
Author: Matt Aitken <matt@mattaitken.com>
Date: Fri Oct 20 11:38:09 2023 +0100
Use the no-stroke version of the tabler-sprite so we can control the stroke width
commit a1b7edd57f8b2d3f2a5f4d96cbc9eb0a887f3442
Author: Matt Aitken <matt@mattaitken.com>
Date: Fri Oct 20 11:37:54 2023 +0100
Set the default width to 1.5, so they’re a bit thinner
commit 69ba38802b849376611678537f7d8e248b60086b
Author: Matt Aitken <matt@mattaitken.com>
Date: Fri Oct 20 10:55:34 2023 +0100
Added a tabler icon to an events job catalog job
commit eb3c5f649d06adcc9ce0641f50e082ecdeead7a2
Author: Matt Aitken <matt@mattaitken.com>
Date: Fri Oct 20 10:53:40 2023 +0100
Moved the tabler sprite to the app and use an import. This means it’ll be cached and we can move it
commit c24d76e6df9233b001a0242f8806076562ca2e90
Author: Chaturved Degloorkar <48447253+chaturrved@users.noreply.github.com>
Date: Fri Oct 20 15:22:59 2023 +0530
feat: Add support for tabler-icons when using the icon for Tasks (#629)
* Add support for tabler-icons
* Changed the core update type from minor to a patch
---------
Co-authored-by: Matt Aitken <matt@mattaitken.com>
* add cli init maxDuration to the api/trigger route for nextjs
* refactor createTriggerRoute
* move boxen log to createTriggerRoute function
* refine detectNextVersion and versionNumberPattern regex to match the latest nextjs version
* add tests for the detectNextVersion function
* add changeset file
* If the regex doesn't match, it returns null instead of throwing
* Tweaked message about the max duration
---------
Co-authored-by: Matt Aitken <matt@mattaitken.com>
* feat: add ability to use custom tunnel in dev cmd
* Added a short flag -t for the tunnel flag
* skip framework url resolution if tunnel-url is provided
* remove type annotation
---------
Co-authored-by: Eric Allam <eric@trigger.dev>
Co-authored-by: Matt Aitken <matt@mattaitken.com>
* Add tsup config package
* Add integration tsconfig to extend from
* Return correct version via cli -v
* Make create-integration use templates
* Add changeset
* Switch to liquidjs templates
---------
Co-authored-by: Matt Aitken <matt@mattaitken.com>
commit c028db229cece2bf7d7acf04e7b1c08fea61798c
Author: Matt Aitken <matt@mattaitken.com>
Date: Fri Oct 13 16:04:54 2023 +0100
Some fixes for getting the endpoint id
commit e31b7ac5f2d451f70e3d42a3fb3e5f718d93485b
Author: Matt Aitken <matt@mattaitken.com>
Date: Fri Oct 13 15:39:18 2023 +0100
Added a link in the instructions if Node isn’t detected
commit 1a59cced775fbeac3e5b94e0c151b490c838d8f8
Author: Matt Aitken <matt@mattaitken.com>
Date: Fri Oct 13 15:39:05 2023 +0100
Fixed some conflict issues
commit 77263ed26bcf7025071ac0faf15fb867fff245d0
Author: Matt Aitken <matt@mattaitken.com>
Date: Fri Oct 13 15:38:56 2023 +0100
Added a changeset
commit 1a7df3f37f0c65d68cb9a9fe7ac50328bbb4d879
Author: GuyBorderless <100129659+guy-borderless@users.noreply.github.com>
Date: Fri Oct 13 17:31:01 2023 +0300
feat: enable deno (#531)
* adding deno reference project and JSRuntime file
* accessing runtime specific functions through JsRuntime
* adding support for both deno.json and deno.jsonc
* no automatic setup for deno projects currently
---------
Co-authored-by: Guy Kedem <guy@propertiz.net>
Co-authored-by: Matt Aitken <matt@mattaitken.com>
* Added EndpointIndex status. Default is PENDING, existing rows are SUCCESS
* Made it easier to create a migration SQL file
* Created a job-catalog file for misconfigured Jobs that should error when running the CLI
* EndpointIndex data and state are now optional
* The Environments page now shows the status of the last refresh
* Improved the UI about endpoints
* Added EndpointIndex error column
* WIP making the endpoint indexing more robust
* Indexing errors are now surfaced
* Improved the error show it shows the job id
* Use “performEndpointIndexing” when you create your first endpoint from the UI
* Use “performEndpointIndexing” for the recurring endpoint checker
* Staging is now auto-indexed every 10 mins too
* Use “performEndpointIndexing” for the webhook
* Moved the throttling to a util
* Removed instructional comments
* Created a reusable retry system with exponential backoff
* Use p-retry for retrying with backoff
* The CLI gets indexing results and displays errors
* Improved the indexing error messages and display in the console
* Use a pre so the Indexing error is correctly split over multiple lines
* Use a db transaction for webhook that triggers endpoint indexing
* Tidied up imports
* Support older versions of the server
* Improved the comment on the misconfigured job
* Changeset: When indexing user's jobs errors are now stored and displayed
* [TRI-1333] : Upgrade all packages to use Node18 and use fetch instead of node-fetch
* Changeset Added
* Update pnpm-lock to compatible pnpm v7.18.1
* Restored pnpm-lock to the last known good point compatible with pnpm v7.18.1
* Update chilled-plants-exercise.md
---------
Co-authored-by: Eric Allam <eallam@icloud.com>
* Feat/svelte kit support (#467)
* feat: implemented svelte-kit adapter
* feat: implemented the @trigger.dev/svelte package
* scaffolded a sveltekit example project with trigger.dev
* added the convertToStandardRequest function in the sveltekit package
* example sveltekit project with the @trigger.dev/svelte package
* doc: added the manual setup guide for sveltekit
* updated the web app onboard for sveltekit
* formatted the manual setup guide for sveltekit
* added a link to webapp sveltekit onboarding
* added a wait function to the sveltekit example app job
* typo fix
* removed comments from the @trigger.dev/svelte
- commented out the useEventRunDetails
* updated package.json to use internal packages
* added a .env.example file
* updated the example-svelte-app
* updated the svelte-example
* updated the onboarding page to reflect requested changes
* made the manual setup guide more specific
* created a .env.example file for svelte-example
* added import aliases
* updated the tsconfig and svelte.config file
* updated to use uint8Array
* added missing paths in the tsconfig
---------
Co-authored-by: Matt Aitken <matt@mattaitken.com>
* Moved examples to references
* Tweaked the SveleteKit manual setup guide
* Updated zod, and set the svelte/sveltekit package versions to match other packages
* Added the headers to the response from the SvelteKit api/trigger route
* Changeset for Svelte and SvelteKit packages
* Revert change to rawBody
* Remove core from changeset packages
* Delete svelte .npmrc file
* Build svelte package to build, not build/lib
* Made the snapshot instructions easier to copy
* Delete the svelte package
* Latest lockfile
* Updated the SvelteKit docs
* Attempt to get Svelte to import the package
* Updates for port and host options
* Updated lockfile from main
* Update neat-feet-wait.md
---------
Co-authored-by: Chigala <92148630+Chigala@users.noreply.github.com>
github-actions[bot]