* Latest lockfile * Updated Astro setup docs: env import * Astro docs improvements * Docs: improved the limitations * Bumped package versions to 2.1.3 * Updated the Astro docs with SSR notes * test/368/use vitest instead of jest (#470) * chore: add vitest dependencies * refactor: replace jest by vitest * test: disable broken test * Update pnpm-lock.yaml * Update pnpm-lock.yaml --------- Co-authored-by: Matt Aitken <matt@mattaitken.com> * Created Temp for pull req, bugreport & feature req * A few teaks to the templates * Added instructions for how to do Changeset snapshots * Redirect people to discord to ask a question * Documentation Update: Added <github_username> instead of triggerdotdev to avoid confusion while cloning the repository (#477) * add fastify package * add fastify example * update fastify docs * add pnpm-lock * update readme * Added a link to the homepage from the side menu (#479) * Added 2 new named icons * New side menu link to the homepage * Updated lock file * Removed un-used import * update client-adaptors for fastify * Renamed the examples dir to references (true examples are in another repo and this was confusing) * Add a references README * Fixes broken pnpm lock file * Improve the Astro manual setup guide * Fixed cal.com link * Upgrade to the latest remix (pre v2) * React status hooks (#493) * Added stripInternal to SDK tsconfig * Statuses can now be set from a run, and are stored in the database * Added the key to the returned status * Made the test job have an extra step and only pass in some of the options * client.getRunStatuses() and the corresponding endpoint * client.getRun() now includes status info * Fixed circular dependency schema * Translate null to undefined * Added the react package to the nextjs-reference tsconfig * Removed unused OpenAI integration from nextjs-reference project * New hooks for getting the statuses * Disabled most of the nextjs-reference jobs * Updated the hooks UI * Updated the endpoints to deal with null statuses values * The hook is working, with an example * Changeset: “You can create statuses in your Jobs that can then be read using React hooks” * Changeset config is back to the old changelog style * WIP on new React hooks guide * Guide docs for the new hooks * Added the status hooks to the React hooks guide * Removed the links to the status hooks reference for now * Re-ordered the hooks * Fix for an error in the docs * Set a default of a blank array for the GetRunSchema * Fixed dependency * Revert "Upgrade to the latest remix (pre v2)" This reverts commit4edc7112ab. * Update introduction.mdx (#498) Changed https://github.com/triggerdotdev/examples/tree/main/resend (which was a 404) to https://github.com/triggerdotdev/examples/tree/main/resend-email-form * Use the bell icon for the new status Tasks * Going exponential with `Linear` (#478) * Unleash GPT magic * Clean up after GPT * All the hooks * Provisional integration catalog entry * Sample webhook jobs * Attachments with alpha warnings * Remove some verbose logs * Fix IP restrictions * Remove tunnel * Revert "Remove tunnel" This reverts commit c5b69ce6524e3b40c26b66cdc56e087b8576b8c6. * Resolve event name clashes * Remove circular dependency * Use correct payload uuid * Schema fixes * Fix webhook event name * Start to Linearify catalog entry * Remove todo * More catalog updates * Make OAuth work * Rename webhook helper * Schema juggling * More discrimination * Add Issue SLA event * Simplify triggers * Handle rate limits * Fix Project schema * Payload examples * Improve event props * Remove redundant source metadata * One type to rule them all * Recursive WithoutFunctions type * Linear output serializer * Some tasks * Update catalog entry * Dynamic usage sample * Bump version * Remove tunnel * More tasks * Add optional skipRetrying on runTask errors * Fail fast on user errors * Entity getter tasks * Another couple of tasks * Token to apiKey * Sort tasks * Add filtered issue SLA triggers * Add docs * Type fixes * Job catalog examples * Serialization helper docs * Add changeset * Refactor webhooks * Enhance properties * Pagination helper and docs * Clean up imports * Change misc catalog job --------- Co-authored-by: Matt Aitken <matt@mattaitken.com> * Use absolute image paths (#490) * Update sendevent.mdx * fix: Fail client-side on invalid Stripe event names (#492) * Parse event names * Add changeset * feat: BYO Auth (#491) * feat: BYO Auth Define client-side auth resolvers to be able to supply custom authentication credentials for integrations before a run is performed - Added new defineAuthResolver - Update all integrations to support the new auth resolvers - Strip internal symbols from .d.ts in integrations and trigger-sdk - Added BYO Auth docs - Update Dynamic Schedule to support associated account IDs - Create external accounts just-in-time - Added Account ID field to test job when there are external auth integrations - Show Account ID on run dashboard - Added new Run error state called “Unresolved auth” * Added changeset * Remove @internal from TriggerIntegration public methods * Add void to the result union * DynamicTriggers now work with the new BYO auth system, and added a bunch of docs and docs changes * Add additional key material for registering dynamic trigger task * Add new define* instance methods to the overview * CLI now supports multiple frameworks (with tests) (#480) * Early work defining CLI framework support * WIP moving CLI init logic to the Framework class * Installing files should now work for Nextjs * Some fixes * WIP creating unit tests for Next.js project detection * Delete old jest config * Latest lockfile * Detect use of src directory test * Tests for detection pages/app directory * Correct detection of Next.js project * Renamed test file * Create install files from template files with replacements. With tests * Added multiple uses of the same replacement * Created a test for the install step (it fails right now with JS) * Removed unused import * Another test that should pass but currently fails… * Path alias fixed and now has tests * New pathAlias function used * Nextjs page install tests * Fixed app directory install (with tests) * Removed e2e CLI test, switched to unit testing strategy instead * Latest lockfile * The install files are now actual files that are copied and transformed * Got the template files working correctly after building * Next steps are now framework specific * createFileFromTemplate now works with a path again. Uses mock if specified. * Renamed apiRoute.js to pagesApiRoute.js * Simplified pages file generation * Next.js app API route template * Next.js App routing support, with common files logic shared * Dev command now uses framework default values if they exist and aren’t overridden * Unused import * pathAlias now works for all frameworks * Added a test to detect Next from the next.config.js * WIP on Remix framework support * Tests for Remix install * Replaced references to Next.js * Use a green ✔️ instead of ✅ in the CLI * Support for multiple hostnames * Tunneling can now use the hostname and port * Work on multiple ports * Improved the error messages. Added some extra pots to Next.js * Update the Remix templates to have .server in the imports * Remix updated to use server-runtime instead of node. Node v18+ * Frameworks can specify the watch paths and ignore paths * Define the watch variables above, so we can easily log them for debugging * Don’t wait for outdated package checking when running the dev command * Improved the Remix manual setup guide * Rewriting docs for quickstart * Updated the Next.js quickstart * Remix quick start * Added a changeset * Improved the Next.js manual setup * Tweaked the Linear scopes * Latest lockfile * Fix for getPathAlias typecheck failure * Linear getAll type error (weirdly not in VSCode…) and removed the pagination example that uses the SDK as won’t work with timeouts * Add BYO auth for oauth options * Add back in Job.toJSON to fix the testing package * Removed dynamicTrigger @internal from toJSON * The CLI now checks for a dev server API key in init and dev commands * Remix onboarding now uses the CLI init command * Decouple zod (#500) Zod Schemas is no longer required for validating/inferring event triggers. We’ve taken inspiration from how domain-functions did it: https://github.com/seasonedcc/domain-functions/pull/114 * chore: Update version for release (#481) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Latest lockfile * feat: Basic usage dashboard to show run volume (#501) * New usage dashboard with static data * Implement org usage dash * Grab chart data for the last 12 months * If no org is found just return undefined so a 404 will be shown * Remove mock data * Fill in missing months with 0s --------- Co-authored-by: James Ritchie <james@jamesritchie.co.uk> * Fixed duplicate end month * hotfix * hotfix 2 * Astro CLI support (#506) * Astro framework CLI support * Changeset: Added Astro automatic installation * Fixed the package name – was remix, now astro * Fixed the export of the example * Added IPv6 localhost to Astro hostnames * Updated Astro onboarding to show the CLI init command, instead of manual instructions * Astro quickstart * Fix for type in Remix quickstart * Next.js framework detection allows different config file extensions and “next” devDependency * Made the dev command port more general so it works with various frameworks * chore: Update version for release (#508) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Fix for incorrectly named Next.js package in manual setup * Latest lockfile * Increased the intervalTrigger max from 1 day to 30 days * Implement the task output redacting to prevent redacted values from showing in the logs * Express frameworks docs + CLI (#512) * Manual setup docs * Added the onboarding * The emails package now works with Node > 18 * Added CLi support for Express, including custom init command finished messages * Need to actually log out the installation complete message… * Fix for an old Remix reference * Renamed the page export * Use resolvedOptions.triggerUrl * Typo in manual instructions * chore: Update version for release (#513) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Latest lockfile * Add the STAGING environment by default * Fixed sparodically failed run creations - Use a better way of getting the latest job run number to increment - Make the CreateRunService transaction more reliable - Invoke dispatchers in parallel - No longer swallow prisma errors in $transaction * Swapped out the Homepage link in the side menu for a link to the Changelog * Youtube embedded video fits its aspect ratio instead of going full width * Improved CLI init Next.js middleware detection * CLI init: adds public key as “TRIGGER_PUBLIC_API_KEY” except for Next which overrides this * Updated the docs for the React hooks * chore: Update version for release (#521) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Display framework logos on the onboarding setup pages (#519) * autofocus the search field on the Job page * Add some documentation around canceling scheduled events * Updated outdated lockfile * Updated docs README.md * Improves the performance of run resuming (#522) * Improves the perform of run resuming When runs resume, we try and make sure that tasks that have already been completed are cached and reused. Worst case scenario the client needs to hit the API server once for a non-cached task that is indeed completed on the server, but this can get pretty expensive when there are a larger number of tasks. This commit does 2 different things to help: - noop tasks are no longer “cached” using the cachedTasks strategy, instead their idempotency keys are shoved into a bloom filter and the client tests for their inclusion in the bloom filter before running them (since they don’t have any concept of output, this works) - Additional cached tasks are lazy loaded when a task is run. This allows us to progressively fetch additional tasks to be cached on the client, which will cut down on cache misses by a decent amount * Create warm-carrots-float.md * Make io.yield backwards compat with older platform versions * Better support old clients connecting to server versions that support lazy loading cached tasks * Fixed type errors when settings headers with unknown value * Better yield not support error message * Rename _version to _serverVersion to be more clear * Add typed filters to `Linear` getAll helper (#517) * Fix getAll params type * Changeset * Search param types * Update changeset * `Replicate` integration and remote callbacks (#507) * Support tasks with remote callbacks * Add common integration tsconfig * Add Replicate integration * Basic job catalog example * Integration catalog entry * Check for callbackUrl during executeTask * Fix getAll * Improve JSDoc * Bump version * Remove named queue * Simplify runTask types * Trust the types * Fail tasks on timeout * Callback timeout as param * Mess with types * performRunExecutionV1 * Update runTask docs * Shorten callback task methods * Fix run method return type * Image processing jobs * Replicate docs * Text output example * Changeset * Version bump * Roll back ugly types * Remove missing types * Quicker return when waiting on remote callback * Remote callback example * Bump version * Remove schema parsing * Only schedule positive callback timeout * Decrease callback secret length * Explicit default timeouts * Import deployments tasks * JSDoc * Deployments docs * Fix runTask examples, mention wrappers --------- Co-authored-by: Eric Allam <eric@trigger.dev> * Update pnpm lock file * Allow blank issues * chore: Update version for release (#538) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Fix pnpm lock file * feat: New Test page (#558) * Improvements to the shortcut keys * Updated code mirror theme to the new dark mode style * Removed the old test page help panel copy * WIP new structure for the test page * Added some of the side panel options for examples and account ID * Conditionally hide the side panel components if they’re blank * Example with selected state working * Allow selecting the example again to overwrite any edits * Previous run payloads working * Select a recent payload if there’s no example * Created Icon and DetailCell components * The integrations now use the DetailCell * Use DetailCell on the integrations page * Added support for description to DetailCell. With proper variants now * DateTimeAccurate and formatDateTimeAccurate weren’t displaying correctly. fractionalSecondDigits isn’t in the types, but is supported for 92.5% of users * DetailCell now allows label and description to be React components * Using the DetailCell on the Test page * Styled the CodeMirror scrollbars to match elsewhere * Adding copy and clear to the JSONEditor, not working properly yet though * Removed the copy/clear buttons from the Test route * Delete the light color theme * The editor now supports copying/clearing etc * Made it clear when text is copied * Changed the learn link to a tertiary button * Fixed CMD shortcut keys * Run test button now works with ⌘ Enter * CodeMirror now allows ⌘Enter to escape the field * Added JSON linter to the test editor * Fix for buttons not being aligned correctly * Copy/clear buttons now aligned * Made the integration DetailCell text smaller * The test recent payloads now have colored text to help identify the status * DetailCell descriptions are dimmer * Added link to docs for BYOA * Fix for buttons going full width when they shouldn’t --------- Co-authored-by: James Ritchie <james@jamesritchie.co.uk> * chore: update doc title for groups (#539) * chore: update doc title for groups * update docs for sdk and integrations * Add instructions for triggering job runs to the job catalog readme * Updated the Test docs * Removed a console.log when a user’s file is changed that CLI dev is listening for * feat: allow cancelling jobs from trigger-client sdk (#562) * feat: allow cancelling jobs from trigger-client sdk * use presenter instead of service for non-mutating logic * chore: upgrade zod to 3.22.3 (#570) * chore: upgrade zod to 3.22.3 * add changeset * Stringify event payload and context before serialization This fixes an issue where an event payload was being serialized through remix-typedjson and was causing issues with incorrect meta keys and so deserialization was failing. See https://github.com/kiliman/remix-typedjson/pull/33 for more * Need to properly format the payload JSON * NestJS framework suport (from @H4ad) (#574) * feat: added nestjs package adapter * Latest lockfile * Updated Astro setup docs: env import * Astro docs improvements * Docs: improved the limitations * Bumped package versions to 2.1.3 * Updated the Astro docs with SSR notes * test/368/use vitest instead of jest (#470) * chore: add vitest dependencies * refactor: replace jest by vitest * test: disable broken test * Update pnpm-lock.yaml * Update pnpm-lock.yaml --------- Co-authored-by: Matt Aitken <matt@mattaitken.com> * Created Temp for pull req, bugreport & feature req * A few teaks to the templates * Added instructions for how to do Changeset snapshots * Redirect people to discord to ask a question * Documentation Update: Added <github_username> instead of triggerdotdev to avoid confusion while cloning the repository (#477) * Added a link to the homepage from the side menu (#479) * Added 2 new named icons * New side menu link to the homepage * Updated lock file * Removed un-used import * Renamed the examples dir to references (true examples are in another repo and this was confusing) * Add a references README * Fixes broken pnpm lock file * Improve the Astro manual setup guide * Fixed cal.com link * Upgrade to the latest remix (pre v2) * React status hooks (#493) * Added stripInternal to SDK tsconfig * Statuses can now be set from a run, and are stored in the database * Added the key to the returned status * Made the test job have an extra step and only pass in some of the options * client.getRunStatuses() and the corresponding endpoint * client.getRun() now includes status info * Fixed circular dependency schema * Translate null to undefined * Added the react package to the nextjs-reference tsconfig * Removed unused OpenAI integration from nextjs-reference project * New hooks for getting the statuses * Disabled most of the nextjs-reference jobs * Updated the hooks UI * Updated the endpoints to deal with null statuses values * The hook is working, with an example * Changeset: “You can create statuses in your Jobs that can then be read using React hooks” * Changeset config is back to the old changelog style * WIP on new React hooks guide * Guide docs for the new hooks * Added the status hooks to the React hooks guide * Removed the links to the status hooks reference for now * Re-ordered the hooks * Fix for an error in the docs * Set a default of a blank array for the GetRunSchema * Fixed dependency * Revert "Upgrade to the latest remix (pre v2)" This reverts commit4edc7112ab. * Update introduction.mdx (#498) Changed https://github.com/triggerdotdev/examples/tree/main/resend (which was a 404) to https://github.com/triggerdotdev/examples/tree/main/resend-email-form * Use the bell icon for the new status Tasks * Going exponential with `Linear` (#478) * Unleash GPT magic * Clean up after GPT * All the hooks * Provisional integration catalog entry * Sample webhook jobs * Attachments with alpha warnings * Remove some verbose logs * Fix IP restrictions * Remove tunnel * Revert "Remove tunnel" This reverts commit c5b69ce6524e3b40c26b66cdc56e087b8576b8c6. * Resolve event name clashes * Remove circular dependency * Use correct payload uuid * Schema fixes * Fix webhook event name * Start to Linearify catalog entry * Remove todo * More catalog updates * Make OAuth work * Rename webhook helper * Schema juggling * More discrimination * Add Issue SLA event * Simplify triggers * Handle rate limits * Fix Project schema * Payload examples * Improve event props * Remove redundant source metadata * One type to rule them all * Recursive WithoutFunctions type * Linear output serializer * Some tasks * Update catalog entry * Dynamic usage sample * Bump version * Remove tunnel * More tasks * Add optional skipRetrying on runTask errors * Fail fast on user errors * Entity getter tasks * Another couple of tasks * Token to apiKey * Sort tasks * Add filtered issue SLA triggers * Add docs * Type fixes * Job catalog examples * Serialization helper docs * Add changeset * Refactor webhooks * Enhance properties * Pagination helper and docs * Clean up imports * Change misc catalog job --------- Co-authored-by: Matt Aitken <matt@mattaitken.com> * Use absolute image paths (#490) * Update sendevent.mdx * fix: Fail client-side on invalid Stripe event names (#492) * Parse event names * Add changeset * feat: BYO Auth (#491) * feat: BYO Auth Define client-side auth resolvers to be able to supply custom authentication credentials for integrations before a run is performed - Added new defineAuthResolver - Update all integrations to support the new auth resolvers - Strip internal symbols from .d.ts in integrations and trigger-sdk - Added BYO Auth docs - Update Dynamic Schedule to support associated account IDs - Create external accounts just-in-time - Added Account ID field to test job when there are external auth integrations - Show Account ID on run dashboard - Added new Run error state called “Unresolved auth” * Added changeset * Remove @internal from TriggerIntegration public methods * Add void to the result union * DynamicTriggers now work with the new BYO auth system, and added a bunch of docs and docs changes * Add additional key material for registering dynamic trigger task * Add new define* instance methods to the overview * CLI now supports multiple frameworks (with tests) (#480) * Early work defining CLI framework support * WIP moving CLI init logic to the Framework class * Installing files should now work for Nextjs * Some fixes * WIP creating unit tests for Next.js project detection * Delete old jest config * Latest lockfile * Detect use of src directory test * Tests for detection pages/app directory * Correct detection of Next.js project * Renamed test file * Create install files from template files with replacements. With tests * Added multiple uses of the same replacement * Created a test for the install step (it fails right now with JS) * Removed unused import * Another test that should pass but currently fails… * Path alias fixed and now has tests * New pathAlias function used * Nextjs page install tests * Fixed app directory install (with tests) * Removed e2e CLI test, switched to unit testing strategy instead * Latest lockfile * The install files are now actual files that are copied and transformed * Got the template files working correctly after building * Next steps are now framework specific * createFileFromTemplate now works with a path again. Uses mock if specified. * Renamed apiRoute.js to pagesApiRoute.js * Simplified pages file generation * Next.js app API route template * Next.js App routing support, with common files logic shared * Dev command now uses framework default values if they exist and aren’t overridden * Unused import * pathAlias now works for all frameworks * Added a test to detect Next from the next.config.js * WIP on Remix framework support * Tests for Remix install * Replaced references to Next.js * Use a green ✔️ instead of ✅ in the CLI * Support for multiple hostnames * Tunneling can now use the hostname and port * Work on multiple ports * Improved the error messages. Added some extra pots to Next.js * Update the Remix templates to have .server in the imports * Remix updated to use server-runtime instead of node. Node v18+ * Frameworks can specify the watch paths and ignore paths * Define the watch variables above, so we can easily log them for debugging * Don’t wait for outdated package checking when running the dev command * Improved the Remix manual setup guide * Rewriting docs for quickstart * Updated the Next.js quickstart * Remix quick start * Added a changeset * Improved the Next.js manual setup * Tweaked the Linear scopes * Latest lockfile * Fix for getPathAlias typecheck failure * Linear getAll type error (weirdly not in VSCode…) and removed the pagination example that uses the SDK as won’t work with timeouts * Add BYO auth for oauth options * Add back in Job.toJSON to fix the testing package * Removed dynamicTrigger @internal from toJSON * The CLI now checks for a dev server API key in init and dev commands * Remix onboarding now uses the CLI init command * Decouple zod (#500) Zod Schemas is no longer required for validating/inferring event triggers. We’ve taken inspiration from how domain-functions did it: https://github.com/seasonedcc/domain-functions/pull/114 * chore: Update version for release (#481) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Latest lockfile * feat: Basic usage dashboard to show run volume (#501) * New usage dashboard with static data * Implement org usage dash * Grab chart data for the last 12 months * If no org is found just return undefined so a 404 will be shown * Remove mock data * Fill in missing months with 0s --------- Co-authored-by: James Ritchie <james@jamesritchie.co.uk> * Fixed duplicate end month * hotfix * hotfix 2 * Astro CLI support (#506) * Astro framework CLI support * Changeset: Added Astro automatic installation * Fixed the package name – was remix, now astro * Fixed the export of the example * Added IPv6 localhost to Astro hostnames * Updated Astro onboarding to show the CLI init command, instead of manual instructions * Astro quickstart * Fix for type in Remix quickstart * Next.js framework detection allows different config file extensions and “next” devDependency * Made the dev command port more general so it works with various frameworks * chore: Update version for release (#508) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Fix for incorrectly named Next.js package in manual setup * Latest lockfile * Increased the intervalTrigger max from 1 day to 30 days * Implement the task output redacting to prevent redacted values from showing in the logs * Express frameworks docs + CLI (#512) * Manual setup docs * Added the onboarding * The emails package now works with Node > 18 * Added CLi support for Express, including custom init command finished messages * Need to actually log out the installation complete message… * Fix for an old Remix reference * Renamed the page export * Use resolvedOptions.triggerUrl * Typo in manual instructions * chore: Update version for release (#513) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Latest lockfile * Add the STAGING environment by default * Fixed sparodically failed run creations - Use a better way of getting the latest job run number to increment - Make the CreateRunService transaction more reliable - Invoke dispatchers in parallel - No longer swallow prisma errors in $transaction * Swapped out the Homepage link in the side menu for a link to the Changelog * Youtube embedded video fits its aspect ratio instead of going full width * Improved CLI init Next.js middleware detection * CLI init: adds public key as “TRIGGER_PUBLIC_API_KEY” except for Next which overrides this * Updated the docs for the React hooks * chore: Update version for release (#521) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Display framework logos on the onboarding setup pages (#519) * autofocus the search field on the Job page * Add some documentation around canceling scheduled events * Updated outdated lockfile * Updated docs README.md * Improves the performance of run resuming (#522) * Improves the perform of run resuming When runs resume, we try and make sure that tasks that have already been completed are cached and reused. Worst case scenario the client needs to hit the API server once for a non-cached task that is indeed completed on the server, but this can get pretty expensive when there are a larger number of tasks. This commit does 2 different things to help: - noop tasks are no longer “cached” using the cachedTasks strategy, instead their idempotency keys are shoved into a bloom filter and the client tests for their inclusion in the bloom filter before running them (since they don’t have any concept of output, this works) - Additional cached tasks are lazy loaded when a task is run. This allows us to progressively fetch additional tasks to be cached on the client, which will cut down on cache misses by a decent amount * Create warm-carrots-float.md * Make io.yield backwards compat with older platform versions * Better support old clients connecting to server versions that support lazy loading cached tasks * Fixed type errors when settings headers with unknown value * Better yield not support error message * Rename _version to _serverVersion to be more clear * Add typed filters to `Linear` getAll helper (#517) * Fix getAll params type * Changeset * Search param types * Update changeset * `Replicate` integration and remote callbacks (#507) * Support tasks with remote callbacks * Add common integration tsconfig * Add Replicate integration * Basic job catalog example * Integration catalog entry * Check for callbackUrl during executeTask * Fix getAll * Improve JSDoc * Bump version * Remove named queue * Simplify runTask types * Trust the types * Fail tasks on timeout * Callback timeout as param * Mess with types * performRunExecutionV1 * Update runTask docs * Shorten callback task methods * Fix run method return type * Image processing jobs * Replicate docs * Text output example * Changeset * Version bump * Roll back ugly types * Remove missing types * Quicker return when waiting on remote callback * Remote callback example * Bump version * Remove schema parsing * Only schedule positive callback timeout * Decrease callback secret length * Explicit default timeouts * Import deployments tasks * JSDoc * Deployments docs * Fix runTask examples, mention wrappers --------- Co-authored-by: Eric Allam <eric@trigger.dev> * Update pnpm lock file * Allow blank issues * chore: Update version for release (#538) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Fix pnpm lock file * feat: New Test page (#558) * Improvements to the shortcut keys * Updated code mirror theme to the new dark mode style * Removed the old test page help panel copy * WIP new structure for the test page * Added some of the side panel options for examples and account ID * Conditionally hide the side panel components if they’re blank * Example with selected state working * Allow selecting the example again to overwrite any edits * Previous run payloads working * Select a recent payload if there’s no example * Created Icon and DetailCell components * The integrations now use the DetailCell * Use DetailCell on the integrations page * Added support for description to DetailCell. With proper variants now * DateTimeAccurate and formatDateTimeAccurate weren’t displaying correctly. fractionalSecondDigits isn’t in the types, but is supported for 92.5% of users * DetailCell now allows label and description to be React components * Using the DetailCell on the Test page * Styled the CodeMirror scrollbars to match elsewhere * Adding copy and clear to the JSONEditor, not working properly yet though * Removed the copy/clear buttons from the Test route * Delete the light color theme * The editor now supports copying/clearing etc * Made it clear when text is copied * Changed the learn link to a tertiary button * Fixed CMD shortcut keys * Run test button now works with ⌘ Enter * CodeMirror now allows ⌘Enter to escape the field * Added JSON linter to the test editor * Fix for buttons not being aligned correctly * Copy/clear buttons now aligned * Made the integration DetailCell text smaller * The test recent payloads now have colored text to help identify the status * DetailCell descriptions are dimmer * Added link to docs for BYOA * Fix for buttons going full width when they shouldn’t --------- Co-authored-by: James Ritchie <james@jamesritchie.co.uk> * chore: update doc title for groups (#539) * chore: update doc title for groups * update docs for sdk and integrations * Add instructions for triggering job runs to the job catalog readme * Updated the Test docs * Removed a console.log when a user’s file is changed that CLI dev is listening for * feat: allow cancelling jobs from trigger-client sdk (#562) * feat: allow cancelling jobs from trigger-client sdk * use presenter instead of service for non-mutating logic * chore: upgrade zod to 3.22.3 (#570) * chore: upgrade zod to 3.22.3 * add changeset * Created a changeset with the correct starting package version * Added headers to NestJS response * Added some types to the NestJS project * Added fastify types * Removed log from CodeMirror * Added InstallPackages component * Improved the NestJS onboarding instructions * Updated the onboarding instructions * Made all the quickstart framework cards snippets, so the page isn’t a nightmare to edit * NestJS docs updates * Added dotenv to the earlier code sample * Latest lockfile * Moved the nestjs-example to the reference folder --------- Co-authored-by: Vinícius Lourenço <contact@viniciusl.com.br> Co-authored-by: Wesley <100464352+ologbonowiwi@users.noreply.github.com> Co-authored-by: Vishesh Rawal <92795514+visheshrwl@users.noreply.github.com> Co-authored-by: Eric Allam <eallam@icloud.com> Co-authored-by: Aniket Bindhani <aniketbindhani44@gmail.com> Co-authored-by: James Ritchie <james@trigger.dev> Co-authored-by: D-K-P <dkp.github@pm.me> Co-authored-by: Gregory <93215236+gjohnsx@users.noreply.github.com> Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com> Co-authored-by: Eric Allam <eric@trigger.dev> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: James Ritchie <james@jamesritchie.co.uk> Co-authored-by: Hemachandar <132386067+hmacr@users.noreply.github.com> * chore: Update version for release (#571) Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Latest lockfile * Removed NestJS example project tests * Removed testing dependencies from nestjs example --------- Co-authored-by: Matt Aitken <matt@mattaitken.com> Co-authored-by: Wesley <100464352+ologbonowiwi@users.noreply.github.com> Co-authored-by: Vishesh Rawal <92795514+visheshrwl@users.noreply.github.com> Co-authored-by: Eric Allam <eallam@icloud.com> Co-authored-by: Aniket Bindhani <aniketbindhani44@gmail.com> Co-authored-by: James Ritchie <james@trigger.dev> Co-authored-by: D-K-P <dkp.github@pm.me> Co-authored-by: Gregory <93215236+gjohnsx@users.noreply.github.com> Co-authored-by: nicktrn <55853254+nicktrn@users.noreply.github.com> Co-authored-by: Eric Allam <eric@trigger.dev> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: James Ritchie <james@jamesritchie.co.uk> Co-authored-by: Hemachandar <132386067+hmacr@users.noreply.github.com> Co-authored-by: Vinícius Lourenço <contact@viniciusl.com.br>
10 KiB
Contributing to Trigger.dev
Thank you for taking the time to contribute to Trigger.dev. Your involvement is not just welcomed, but we encourage it! 🚀
Please take some time to read this guide to understand contributing best practices for Trigger.dev.
Thank you for helping us make Trigger.dev even better! 🤩
Developing
The development branch is main. This is the branch that all pull
requests should be made against. The changes on the main
branch are tagged into a release monthly.
Prerequisites
- Node.js version >=16.x
- pnpm package manager version 7
- Docker
Setup
-
Clone the repo into a public GitHub repository or fork the repo. If you plan to distribute the code, keep the source code public to comply with the Apache Licence 2.0.
git clone https://github.com/<github_username>/trigger.dev.gitIf you are on windows, run the following command on gitbash with admin privileges:
git clone -c core.symlinks=true https://github.com/<github_username>/trigger.dev.git -
Navigate to the project folder
cd trigger.dev -
Install the required packages using pnpm.
pnpm i -
Create your
.envfilecp .env.example .env -
Open it and generate a new value for
ENCRYPTION_KEY:ENCRYPTION_KEYis used to two-way encrypt OAuth access tokens and so you'll probably want to actually generate a unique value, and it must be a random 16 byte hex string. You can generate one with the following command:openssl rand -hex 16Feel free to update
SESSION_SECRETandMAGIC_LINK_SECRETas well using the same method. -
Start Docker. This starts the required services like Postgres. If this is your first time using Docker, consider going through this guide
pnpm run docker -
Migrate the database
pnpm run db:migrate -
Build the app
pnpm run build --filter webapp -
Run the seed script
pnpm run db:seed -
Run the app. See the section below.
Running
-
You can run the app with:
pnpm run dev --filter webappIt should run on port
3030: http://localhost:3030 -
Once the app is running click the magic link button and enter your email.
-
Check your terminal, the magic link email should have printed out as following:
webapp:dev: Log in to Trigger.dev webapp:dev: webapp:dev: Click here to log in with this magic link webapp:dev: [http://localhost:3030/magic?token=U2FsdGVkX18OvB0JxgaswTLCSbaRz%2FY82TN0EZWhSzFyZYwgG%2BIzKVTkeiaOtWfotPw7F8RwFzCHh53aBpMEu%2B%2B%2FItb%2FcJYh89MSjc3Pz92bevoEjqxSQ%2Ff%2BZbks09JOpqlBbYC3FzGWC8vuSVFBlxqLXxteSDLthZSUaC%2BS2LaA%2BJgp%2BLO7hgjAaC2lXbCHrM7MTgTdXOFt7i0Dvvuwz6%2BWY25RnfomZOPqDsyH0xz8Q2rzPTz0Xu53WSXrZ1hd] webapp:dev: webapp:dev: If you didn't try to log in, you can safely ignore this email.Paste the magic link shown in your terminal into your browser to login.
Adding and running migrations
-
Modify packages/database/prisma/schema.prisma file
-
Change directory to the packages/database folder
cd packages/database -
Generate the Prisma client
pnpm run generateThe above updates the prisma client generated into node_modules/.prisma/client folder. This helps with typing of relevant prisma models. It ensures typescript recognizes fields added or removed from a model and type-checks appropriately.
-
Create and apply the migrations
pnpm run db:migrate:devThis creates a migration file and executes the migrations against your database and applies changes to the database schema(s)
-
Commit generated migrations as well as changes to the schema.prisma file
-
If you're using VSCode you may need to restart the Typescript server in the webapp to get updated type inference. Open a TypeScript file, then open the Command Palette (View > Command Palette) and run
TypeScript: Restart TS server.
Testing CLI changes
To test CLI changes, follow the steps below:
- Build the CLI and watch for changes
cd packages/cli
pnpm run dev
-
Open a new Terminal window and run the webapp locally and then create a new project in the dashboard. Copy out the dev API key.
-
Create a new temporary Next.js app in references directory
cd ./references
pnpm create next-app@latest test-cli --ts --no-eslint --tailwind --app --src-dir --import-alias "@/*"
- Then once that's finished, add the
@trigger.dev/clito thedevDependenciesof the newly created Next.js app'spackage.jsonfile, like so:
{
// other package.json properties
"devDependencies": { "@trigger.dev/cli": "workspace:*" }
}
- Back in the terminal, navigate into the reference, and initialize the CLI. When prompted, select
self-hostedand enterlocalhost:3030if you are testing against the local instance of Trigger.dev, or you can just use the Trigger.dev cloud. When asked for an API key, use the key you copied earlier.
cd ./test-cli
pnpm i
pnpm exec trigger-cli init
- If you are just testing the
initcommand, you can stop here. If you'd like to test thedevcommand, first start the Next.js app on port 3000:
pnpm run dev
- Open a new terminal window, and then run the
devcommand like so:
pnpm exec trigger-cli dev
- Please remember to delete the temporary project you created after you've tested the changes, and before you raise a PR.
Running end-to-end webapp tests
To run the end-to-end tests, follow the steps below:
- Set up environment variables (copy example envs into the correct place)
cp ./.env.example ./.env
cp ./references/nextjs-test/.env.example ./references/nextjs-test/.env.local
- Set up dependencies
# Build packages
pnpm run build --filter @references/nextjs-test^...
pnpm --filter @trigger.dev/database generate
# Move trigger-cli bin to correct place
pnpm install --frozen-lockfile
# Install playwrite browsers (ONE TIME ONLY)
npx playwright install
- Set up the database
pnpm run docker
pnpm run db:migrate
pnpm run db:seed
- Run the end-to-end tests
pnpm run test:e2e
Cleanup
The end-to-end tests use a setup and teardown script to seed the database with test data. If the test runner doesn't exit cleanly, then the database can be left in a state where the tests can't run because the setup script will try to create data that already exists. If this happens, you can manually delete the users and organizations from the database using prisma studio:
# With the database running (i.e. pnpm run docker)
pnpm run db:studio
Add sample jobs
The references/job-catalog project defines simple jobs you can get started with.
cdintoreferences/job-catalog- Create a
.envfile with the following content, replacing<TRIGGER_DEV_API_KEY>with an actual key:
TRIGGER_API_KEY=[TRIGGER_DEV_API_KEY]
TRIGGER_API_URL=http://localhost:3030
TRIGGER_API_URL is used to configure the URL for your Trigger.dev instance,
where the jobs will be registered.
- Run one of the the
job-catalogfiles:
pnpm run events
This will open up a local server using express on port 8080. Then in a new terminal window you can run the trigger-cli dev command:
pnpm run dev:trigger
See the Job Catalog file for more.
- Navigate to your trigger.dev instance (http://localhost:3030), to see the jobs. You can use the test feature to trigger them.
Making a pull request
If you get errors, be sure to fix them before committing.
- Be sure to check the "Allow edits from maintainers" option while creating you PR.
- If your PR refers to or fixes an issue, be sure to add
refs #XXXorfixes #XXXto the PR description. ReplacingXXXwith the respective issue number. See more about Linking a pull request to an issue . - Be sure to fill the PR Template accordingly.
Adding changesets
We use changesets to manage our package versions and changelogs. If you've never used changesets before, first read their guide here.
If you are contributing a change to any packages in this monorepo (anything in either the /packages or /integrations directories), then you will need to add a changeset to your Pull Requests before they can be merged.
To add a changeset, run the following command in the root of the repo
pnpm run changeset:add
Here's an example of creating a patch changeset for the @trigger.dev/github and @trigger.dev/slack packages (click to view):
You will be prompted to select which packages to include in the changeset. Only select the packages that you have made changes for.
Most of the time the changes you'll make are likely to be categorized as patch releases. If you feel like there is the need for a minor or major release of the package based on the changes being made, add the changeset as such and it will be discussed during PR review.
Troubleshooting
EADDRINUSE: address already in use :::3030
When receiving the following error message:
webapp:dev: Error: listen EADDRINUSE: address already in use :::3030
The process running on port 3030 should be destroyed.
- Get the
PIDof the process running on PORT3030lsof -i :3030 - Kill the process
sudo kill -9 <PID>