bc020a3ffe
Get the internal telemetry ready for test/prod
2024-03-28 18:12:01 +00:00
719c0a0b94
v3: better clock management for spans/logs in CRIU envs ( #980 )
...
* durable clock WIP
* Fixed incorrect span timings around checkpoints by implementing a precise wall clock that resets after restores
* Add changeset
2024-03-28 14:20:44 +00:00
215b60c742
v3: superjson output support ( #971 )
...
* superjson output support
* Better support for superjson in the task events, limiting output attributes
* Offload large outputs to object store (r2)
* Finishing up the offloading of large outputs/payloads to an object store
2024-03-27 11:57:22 +00:00
ba0ffacb15
Set the OTEL_EXPORTER_OTLP_ENDPOINT env var on dev workers
2024-03-18 20:16:25 +00:00
67cac97b26
Add DEPLOY_REGISTRY_HOST to allow configuring the deploy registry via the server
2024-03-18 15:56:28 +00:00
c385db63be
v3: cli deploy command ( #931 )
...
* WIP proxy/deploy
* WIP, registry proxy in express working
* A couple of notes, preparing for indexing
* Move the changes to prod-worker into the new file
* Deploy command working with indexing and runs (docker provider only for now)
* Removed ts-expect-error directive
* Fixed build command
2024-03-08 10:49:42 +00:00
52c9d485f8
v3: cli build command, prod runs, checkpoints ( #919 )
...
* fix trailing slash in api url
* add maybe platform down error
* shorten config path
* extend protobuf compiler install instructions
* build command and image model
* new image triggers task indexing
* index support for prod builds
* shorten example provider secret
* multi-stage task prod build
* lock prod tasks to node 18 image
* extract shared build and dev command libs
* pull out more shared deps
* add coordinator and providers
* fix core-apps build
* add dev builds for new apps
* fix cwd
* enable corepack
* some build fixes
* enable buildkit for old docker versions
* coordinator image fixes
* update provider containerfile
* build dev images in parallel
* upgrade pgadmin
* fix prod facade build
* prod runs
* fix merge
* don't knock out platform on invalid attempt id
* fix prod facade
* rename to build.ts
* fix prod builds
* set to executing after fetching payload
* make prod worker listen on random port if in use
* remove experimental warnings in dev
* prod resume
* prevent execution after completion
* exit prod worker after completion
* always restart otel collector
* docker checkpoints and prod runtime messaging
* don't retry indexing without chance of success
* make platform checkpoint aware
* deploy with existing hash sets latest worker
* log restore requests
* only try to checkpoint long waits
* tidying up
* lockfile
* fix build
* prod worker merge fixes
* fix prod complete and cancel
* fix lua nil checks
* socket namespace abstraction
* cleanup
* make all build args optional
* add build script
* don't require env vars for dev
* fix schema
* prod merge
* small fix
* bind correct logger
* fix v3 ref catalog entry
* resume prod batch
* pass socket to error and disconnect handlers
* fix non-batch resume
* fix batch resume
* send connection env vars when not in dev
* create worker via socket
* move api client back into v3 cli
* fix lockfile
* fix resume with failures
* marqs replace message
* typecheck prior to build
* don't define api url in prod builds
* support prod retries after resume
* skip typecheck option
2024-03-04 13:10:07 +00:00
07f7c65054
v3 queue system ( #903 )
...
* Introducing Modular Asynchronous Reliable Queueing System (MarQS). Works in dev
* Convert MarQS to using lua and dealing with concurrency
* Simplified the timeout queue and current concurrency is now a set instead of a flat value (to support idempotency)
* Implement task heartbeating and reconnect the background workers CLI when the websocket connection reconnects
* Start adding internal telemetry support for the server
* Get env vars to work in dev and implement prisma tracing in webapp
* Cleanup telemetry and implement it in the consumer
* Implement dequeuing a message from a parent shared queue
* Implement a custom logger exporter instead of using console log exporter
* Use node instead of shell for generating protocol buffer code
* Propogate trace context into debug logs, and allow turning off logger exporter through env vars
* Switch to using baselime for internal otel data
* Make orgMember optional to fix type issues
* Provide the CLI dev env vars through the CLI, don’t build dotenv into facade
* Removed the logger import
* Address Matt’s comments
* Addressing more of Matt’s comments
* Handle sending an execution after a websocket connection closes
* Remove auth from the env attributes to prevent obfuscation
2024-02-20 12:16:41 +00:00
9cb39bf7d7
Added Redis example env vars
2023-11-29 10:34:54 +00:00
10e935b864
fix(TRI-1444): Allow only logins from WHITELISTED_EMAILS regex ( fixes #685 ) ( #721 )
2023-11-06 09:06:54 +00:00
15f17d27e0
Going exponential with Linear ( #478 )
...
* Unleash GPT magic
* Clean up after GPT
* All the hooks
* Provisional integration catalog entry
* Sample webhook jobs
* Attachments with alpha warnings
* Remove some verbose logs
* Fix IP restrictions
* Remove tunnel
* Revert "Remove tunnel"
This reverts commit c5b69ce6524e3b40c26b66cdc56e087b8576b8c6.
* Resolve event name clashes
* Remove circular dependency
* Use correct payload uuid
* Schema fixes
* Fix webhook event name
* Start to Linearify catalog entry
* Remove todo
* More catalog updates
* Make OAuth work
* Rename webhook helper
* Schema juggling
* More discrimination
* Add Issue SLA event
* Simplify triggers
* Handle rate limits
* Fix Project schema
* Payload examples
* Improve event props
* Remove redundant source metadata
* One type to rule them all
* Recursive WithoutFunctions type
* Linear output serializer
* Some tasks
* Update catalog entry
* Dynamic usage sample
* Bump version
* Remove tunnel
* More tasks
* Add optional skipRetrying on runTask errors
* Fail fast on user errors
* Entity getter tasks
* Another couple of tasks
* Token to apiKey
* Sort tasks
* Add filtered issue SLA triggers
* Add docs
* Type fixes
* Job catalog examples
* Serialization helper docs
* Add changeset
* Refactor webhooks
* Enhance properties
* Pagination helper and docs
* Clean up imports
* Change misc catalog job
---------
Co-authored-by: Matt Aitken <matt@mattaitken.com >
2023-09-21 15:14:54 -07:00
603ffbc426
docs: add supabase guide ( #297 )
...
* docs: add supabase guide
* feat: add support for external connection poolers
* chore: use .env symlink in database package
* chore: remove database .env.example
* docs: finish supabase pooling section
* docs: fix small typo
* docs: replace prisma with app wording
* docs: fix up supabase pooling section
* fix: deleted too much in contributing docs
* docs: change pooling heading
* docs: reduce linux shaming
* docs: include direct connection url in fly.io
2023-08-11 15:51:54 +01:00
36ec16babe
feat: encrypt values in SecretStore using an encryption key ( #240 )
...
* feat: encrypt values in SecretStore using an encryption key and `aes-256-gcm`
* Stopped using apiCors in the connectionId API endpoint
2023-08-01 10:11:47 +01:00
0b45338300
Remove the bad RESEND_API_KEY from .env.example
2023-07-17 13:00:38 +01:00
00845b43b4
Renamed the .example env file and added instructions for getting your Resend API
2023-06-26 14:31:27 +01:00
Eric Allam