Commit Graph

4398 Commits

Author SHA1 Message Date
nicktrn 9971267af2 Start fixing batched webhook delivery 2023-12-04 11:11:24 +00:00
nicktrn 32c6815859 Fix batched payloads for n = 1 2023-12-04 11:10:33 +00:00
nicktrn 5aa448b7fd Fix payload size chunking 2023-12-04 09:58:18 +00:00
nicktrn ccb620807c Webhook delivery batching and some fixes 2023-11-30 23:35:09 +00:00
nicktrn 531b9e7e99 Improve KV get types 2023-11-30 22:54:12 +00:00
nicktrn d10a7d053b Shorten redisinsight container name 2023-11-29 09:44:26 +00:00
nicktrn b26bf168ca Merge branch 'main' into worker-upgrade 2023-11-29 09:37:13 +00:00
nicktrn 57fe918650 Update batch send example 2023-11-29 09:33:50 +00:00
nicktrn 497bbbd20b Update UI to support batch payloads 2023-11-29 09:32:21 +00:00
nicktrn 5495f9330b Batch support for Job Runs 2023-11-29 09:31:15 +00:00
nicktrn 0d535688ac Pass jobKey to queueName func 2023-11-29 09:28:32 +00:00
Eric Allam ca05d5f603 @trigger.dev/openai: Adding additional assistant tasks 2023-11-28 22:48:31 +00:00
Hemachandar 4dc46cbbe4 fix: transform Headers object to Record type (#760) 2023-11-28 18:42:50 +00:00
nicktrn 1dcd87a2aa URI encode keys (#758) 2023-11-28 18:05:15 +00:00
Eric Allam c4cb98af5c Clarified the run execution limits 2023-11-28 16:23:35 +00:00
Eric Allam 6ebd435e81 Feature: Run execution concurrency limits (#750)
* WIP execution concurrency controls implemented via Redis

- Split up resuming a run and executing a run
- Added some new statuses to better show what is going on in a run
- Removed preprocessing runs

* WIP

* Convert to using ZSETs and adding env vars

* Removed unused import

* Improve run number generation using advistory locks, and only on start

* More execution concurrency stuff

* Add support for job concurrency limits and concurrency limit groups

* Create wild-swans-battle.md

* Increase slots refresh timeout to 10s

* Try to fix Redis connection issues

* Don’t be so strict about the APP_ENV

* Add the blank tls option to the normal redis client as well

* Add docs
2023-11-28 16:21:06 +00:00
Eric Allam caf203c084 Made webhook index stats optional
🚀 Publish Trigger.dev Docker / units (push) Failing after 4s
🚀 Publish Trigger.dev Docker / typecheck (push) Failing after 4s
🚀 Publish Trigger.dev Docker / e2e (push) Failing after 19s
🚀 Publish Trigger.dev Docker / publish (push) Has been skipped
v.docker.2.2.13
2023-11-28 15:04:24 +00:00
Eric Allam dbc2e3f713 Refreshed pnpm lock @trigger.dev/airtable@2.2.8 @trigger.dev/astro@2.2.8 @trigger.dev/cli@2.2.8 @trigger.dev/core-backend@2.2.8 @trigger.dev/core@2.2.8 @trigger.dev/eslint-plugin@2.2.8 @trigger.dev/express@2.2.8 @trigger.dev/github@2.2.8 @trigger.dev/integration-kit@2.2.8 @trigger.dev/linear@2.2.8 @trigger.dev/nestjs@2.2.8 @trigger.dev/nextjs@2.2.8 @trigger.dev/openai@2.2.8 @trigger.dev/plain@2.2.8 @trigger.dev/react@2.2.8 @trigger.dev/remix@2.2.8 @trigger.dev/replicate@2.2.8 @trigger.dev/resend@2.2.8 @trigger.dev/sdk@2.2.8 @trigger.dev/sendgrid@2.2.8 @trigger.dev/shopify@2.2.8 @trigger.dev/slack@2.2.8 @trigger.dev/stripe@2.2.8 @trigger.dev/supabase@2.2.8 @trigger.dev/sveltekit@2.2.8 @trigger.dev/testing@2.2.8 @trigger.dev/typeform@2.2.8 2023-11-28 14:53:37 +00:00
github-actions[bot] a5b49cb61f chore: Update version for release (#753)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2023-11-28 14:53:06 +00:00
nicktrn 175b58ce48 Event trigger batching tests 2023-11-28 09:44:54 +00:00
nicktrn f0d7b63f04 Add batching to event dispatch 2023-11-28 09:42:55 +00:00
nicktrn f7872a45a9 Expose batch function on even triggers only 2023-11-28 09:32:42 +00:00
nicktrn de428f0d07 Lint 2023-11-28 09:09:51 +00:00
nicktrn 4eef340d7d Add batch opts to event trigger 2023-11-28 09:00:34 +00:00
nicktrn 84c28bcd9b Fix custom batch job function 2023-11-28 08:58:07 +00:00
nicktrn 01bd1af65c Fix cleanup and simulate batch 2023-11-28 08:57:33 +00:00
nicktrn 8ac89a0f8a Make batch enqueue only accept batch tasks 2023-11-28 08:11:53 +00:00
nicktrn 285e7bb2bc Upgrade graphile to latest rc 2023-11-27 20:55:13 +00:00
nicktrn f648fb6e10 Batch enqueue types 2023-11-27 20:53:00 +00:00
nicktrn 5e37d955a4 Merge branch 'main' into worker-upgrade 2023-11-27 19:03:56 +00:00
nicktrn 1637d25e3a Fix migration error detection 2023-11-27 18:53:24 +00:00
nicktrn 096151c014 Fix: Shopify subpath imports, enhance docs (#755)
🚀 Publish Trigger.dev Docker / typecheck (push) Failing after 0s
🚀 Publish Trigger.dev Docker / units (push) Failing after 0s
🚀 Publish Trigger.dev Docker / e2e (push) Failing after 0s
🚀 Publish Trigger.dev Docker / publish (push) Has been skipped
* Fix invalid subpath imports

* Remove @trigger.dev/tsup dep

* Update lockfile

* Small github docs fix

* Pull runtime adaptor import out of integration

* Fix io.store docs examples

* Add sendEvents to task library

* Add KV to task library and small fixes

* Suppress duplicate http endpoint warnings

* Changeset

* Add task returns
v.docker.2.2.12
2023-11-27 16:03:03 +00:00
nicktrn 546588df48 Merge branch 'main' into worker-upgrade 2023-11-27 15:07:32 +00:00
Dan 5d28f1a3d6 Update github-triggers.mdx 2023-11-27 10:32:21 +00:00
nicktrn 6b12a92431 Merge branch 'main' into worker-upgrade 2023-11-24 17:08:34 +00:00
Eric Allam 56ae0ed0d3 Only tag v.docker tags with the latest tag 2023-11-24 16:46:06 +00:00
Eric Allam a2f5dc8bc6 Only attempt to login to Docker if the workflow event is a push 2023-11-24 14:16:41 +00:00
Eric Allam d56b2eded5 Features: new login page (#754)
* Initial commit and WIP new login page

* added wrapper to fix layout

* Improved the layout and style of the page

* Added a new extra-large button style (and added it to storybook)

* Moved the cusom onboarding style tooltip to the Tooltip component

* Populated the bento grid with items

* Imrpoved the quote styling

* Tooltip doesn’t stay if you mouse over it

* Added more content including a list of quote that cycle on page load

* New quote mark positioning

* Added the rest of the content to the tooltips

* Made the bento grid responsive

* Moved the login page layout to a seaparte component

* Login pages now use the new layout component

* Extra large button style tweak

* Match the large input style with the large button style

* Cleaned up imports and made the Ts & Cs text the same for magic links

* Layout fix

* Quotes don’t push content off the screen as much

* Added openai integration to the grid

* Make the quote fit if the screen height is narrower

* Style update to the magic link sent state

* Icon colour updates

* fixed text centering on mobile

* Icons are more responsive

* removed unnecessary w-fulls

* Added 2 onboarding questions

* Revalidate form on submit, not input

* Typo fixes

* Name field focuses by default

* Added conform to the employees question

* Update pnpm lock file

* Implement referral source and company size on managed cloud

* Fixed some type errors

---------

Co-authored-by: James Ritchie <james@jamesritchie.co.uk>
2023-11-24 14:08:50 +00:00
nicktrn 0ae9adafbf Fix: Shopify build and webhook indexing (#752)
* Revert to old tsup config

* Make webhooks index optional
2023-11-24 11:45:33 +00:00
Eric Allam 03403ad9cb Fix for pull request workflow (#751)
* Allow PRs that have /publish-docker in the body to cause docker images to be published

* Also ignore mdx file changes

* pr_checks now uses pull_request instead of pull_request_target
2023-11-24 11:19:06 +00:00
nicktrn 82163c55d4 Merge branch 'main' into worker-upgrade 2023-11-24 10:40:31 +00:00
nicktrn 067e19fec9 Feature: New Webhook Triggers, KV Store, and Shopify integration (#745)
* Attach webhook to http endpoint

* Create internal webhook handler job

* Fix delivery

* Add webhook trigger

* Index webhooks

* Fix webhook connect

* Webhook activation

* Rename to TriggerWebhook

* Save webhooks to index

* Extend register payload

* Revert attachSource

* Add update webhook helper

* Use crud interface for registration

* Remove filter from params

* Destructure options

* Missing ohash dep

* Chainable trigger filter

* Optional request verification

* Handler call with context

* Update config on register success

* Rename to webhookData

* Add basic key-value store

* Improve kv store

* Webhook trigger UI

* Webhook delivery UI

* Some fixes

* Airtable experiments

* Fix tabs transitions

* Only run register if config differs

* Use subtasks for delivery

* Missing dep

* Error handing and fixes

* Namespace cursor

* Fix hmac verification

* Gut Airtable

* Lockfile

* Template optional api key

* Template event sources and icons

* Template remove filter from params

* Fix models template

* Template fixme

* Fix webhook trigger header

* Actually send params for registration..

* Add back oauthed client

* Verify signature header encoding param

* Fix delivery context

* Webhook create retry with prior delete

* Webhook source type fixes

* Webhook config merge

* Update webhook icon

* Verify webhook task options

* Rename handler to generateEvents

* Send event icons

* Shopify with webhooks

* Shopify job-catalog entry

* Lockfile

* Add webhook migration

* Better icons

* Type fixes

* Make param type optional

* Scope type

* More examples

* More schemas

* Trigger catalog

* Bump versions

* Just a few more events they said

* Simplify session and config

* Typed serializer

* Fix payload type

* Remove unused getters

* Reduce logging output

* Rest resource tasks

* Lockfile

* Bump version

* Remaining triggers

* Fix event types

* Fix import

* Link from webhook trigger to http endpoint

* Use rest resource tasks for crud

* Fix rest save type

* Improve KV types

* Improve attach webhook logging

* Make header schema more lenient

* Fix save type again

* Final error callback

* Shorten keys

* Remove ohash diff

* Disable Airtable webhooks

* Webhook environments

* Fix shopify error import

* Link to integration and http endpoint

* Integration catalog entry

* Disable oauth

* Require api key, simplify client secret

* Move trigger types

* Update catalog example

* Small KV endpoint refactor

* Fix custom migration

* Webhook environment migration

* Improve crud types

* Remove unused schema

* Fix crud context type

* KV limits and HTTP verbs

* KV improvements

* Jobless webhook delivery

* Airtable delivery fixes

* Make deliveries sexy again

* Some docs

* Fix payload types.. again

* Final payload pass

* Schema cleanup

* Refactor handler service

* Remove more stale schemas

* registerJobNamespace import

* Expose KV on TriggerClient

* Remove dummy click handler

* Remove unused components

* Fix delivery pagination

* Enable registration rerun button

* Comment out registration route action handler

* Rename KV as not tied to IO anymore

* Swap api with trigger client

* Disabled fields param

* KV docs

* Changeset

* Shopify docs fixes
2023-11-24 10:22:12 +00:00
nicktrn 2cce68b5f7 Revert "Remove the pg listen code to see if it’s causing DB issues" (#749)
This reverts commit e8e7c116d1.
2023-11-24 09:30:48 +00:00
Dan e3c3aa91e1 Added Clerk / Cal.com / HubSpot / Hugging Face / Mailgun / Novu / WhatsApp HTTP endpoint examples (#748)
Co-authored-by: Matt Aitken <matt@mattaitken.com>
2023-11-23 16:11:34 +00:00
Marius Vilholm 5c0ca83852 Fix wrong import in example for useRunDetails (#744)
Thanks @mariusvilholm
2023-11-23 15:35:33 +00:00
Marius Vilholm 2b24104c97 Fix wrong import in example of useEventRunDetails (#743) 2023-11-23 15:35:02 +00:00
Marius Vilholm 5977a5aa51 Fix spelling in OpenAI Assistants (#742)
Co-authored-by: Matt Aitken <matt@mattaitken.com>
2023-11-23 15:34:30 +00:00
Eric Allam 131d0dbea4 Adding an example of using OpenAI GPT 4 Vision 2023-11-21 10:23:11 +00:00
Eric Allam 59277731c4 Fix pnpm lock file @trigger.dev/airtable@2.2.7 @trigger.dev/astro@2.2.7 @trigger.dev/cli@2.2.7 @trigger.dev/core-backend@2.2.7 @trigger.dev/core@2.2.7 @trigger.dev/eslint-plugin@2.2.7 @trigger.dev/express@2.2.7 @trigger.dev/integration-kit@2.2.7 @trigger.dev/linear@2.2.7 @trigger.dev/nestjs@2.2.7 @trigger.dev/nextjs@2.2.7 @trigger.dev/plain@2.2.7 @trigger.dev/replicate@2.2.7 @trigger.dev/resend@2.2.7 @trigger.dev/sdk@2.2.7 @trigger.dev/sendgrid@2.2.7 @trigger.dev/stripe@2.2.7 @trigger.dev/supabase@2.2.7 @trigger.dev/typeform@2.2.7 @trigger.dev/react@2.2.7 @trigger.dev/slack@2.2.7 @trigger.dev/sveltekit@2.2.7 @trigger.dev/openai@2.2.7 @trigger.dev/remix@2.2.7 @trigger.dev/testing@2.2.7 @trigger.dev/github@2.2.7 2023-11-16 16:32:14 +00:00
github-actions[bot] 742d16087b chore: Update version for release (#739)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2023-11-16 16:31:41 +00:00