Skip to content

ElectricSQL run page and react-window-splitter #1277

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 84 commits into from
Sep 4, 2024
Merged

Conversation

matt-aitken
Copy link
Member

ElectricSQL + run page

ElectricSQL syncs partial database replicas. This PR includes:

  • The local setup and integration of it with Postgres (default to running on 3060 locally)
  • The run page now live reloads the relevant spans and runs using Electric
  • The inspector uses this data. For runs we fetch some additional data async from the server.

Generally this means this page is much more responsive now, requires far fewer network roundtrips and navigating between spans is way faster. The live reloading is also much more immediate.

CleanShot.2024-08-30.at.17.45.53-trimmed.mp4

react-window-splitter

This new package allows panels to be set with pixel widths and has better serialization: https://react-window-splitter-six.vercel.app/

matt-aitken and others added 30 commits August 12, 2024 12:15
* Fixed v2 usage meter displaying when on paid plan

* Show the free usage panel only for v3 projects
* Initial TaskRunConcurrencyTracker implementation

* MARQS calls a subscriber to events

* When enqueuing add the extra required metadata

* Track concurrency per environment for tasks too

* Admin page for global concurrency

* Use the new concurrency tracker on the tasks page

* Useful performance test task

* getAllTaskIdentifiers()

* New page for concurrency

* BackgroundWorkerTask index for quick lookup of task identifiers

* Added a way to get concurrency for environments

* Added upgrade/request more concurrency button

* Queued task column working

* Use defer and suspense

* Added queue column to the concurrency environments table

* Some comments added for clarity

* Fixed bad log message

* Sidemenu: move lower and rename to “Concurrency limits”

* Only show the environments, not tasks. Renamed to “Concurrency limits”
* support named capture groups

* write crash errors to attempt.error

* make restored pod names unique per checkpoint

* use last eight characters of checkpoint id instead

* add more chaos monkey env vars

* Ignore unfreezable states

* prevent excessive queue config parsing errors

* handle dependency resume edge case

* better entry point logging

* ignore checkpoint cancellation timeouts

* add missing idempotency keys to wait for dep replays

* remove checkpoints between attempts

* fix retry container names on kubernetes

* add changeset

* fix types

* bring back internal duration timers
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
# Conflicts:
#	.changeset/hungry-sloths-promise.md
#	apps/webapp/app/models/runtimeEnvironment.server.ts
#	apps/webapp/app/presenters/v3/ConcurrencyPresenter.server.ts
#	apps/webapp/app/routes/_app.orgs.$organizationSlug.projects.v3.$projectParam.schedules/route.tsx
#	apps/webapp/app/v3/services/completeAttempt.server.ts
#	apps/webapp/app/v3/services/createCheckpoint.server.ts
#	apps/webapp/app/v3/services/resumeBatchRun.server.ts
#	apps/webapp/app/v3/services/resumeTaskDependency.server.ts
#	apps/webapp/app/v3/taskStatus.ts
#	docs/troubleshooting.mdx
#	integrations/airtable/CHANGELOG.md
#	integrations/airtable/package.json
#	integrations/github/CHANGELOG.md
#	integrations/github/package.json
#	integrations/linear/CHANGELOG.md
#	integrations/linear/package.json
#	integrations/openai/CHANGELOG.md
#	integrations/openai/package.json
#	integrations/plain/CHANGELOG.md
#	integrations/plain/package.json
#	integrations/replicate/CHANGELOG.md
#	integrations/replicate/package.json
#	integrations/resend/CHANGELOG.md
#	integrations/resend/package.json
#	integrations/sendgrid/CHANGELOG.md
#	integrations/sendgrid/package.json
#	integrations/shopify/CHANGELOG.md
#	integrations/shopify/package.json
#	integrations/slack/CHANGELOG.md
#	integrations/slack/package.json
#	integrations/stripe/CHANGELOG.md
#	integrations/stripe/package.json
#	integrations/supabase/CHANGELOG.md
#	integrations/supabase/package.json
#	integrations/typeform/CHANGELOG.md
#	integrations/typeform/package.json
#	packages/astro/CHANGELOG.md
#	packages/astro/package.json
#	packages/cli-v3/CHANGELOG.md
#	packages/cli-v3/package.json
#	packages/cli-v3/src/entryPoints/deploy-run-controller.ts
#	packages/cli/CHANGELOG.md
#	packages/cli/package.json
#	packages/core-apps/CHANGELOG.md
#	packages/core-apps/package.json
#	packages/core-backend/CHANGELOG.md
#	packages/core-backend/package.json
#	packages/core/CHANGELOG.md
#	packages/core/package.json
#	packages/eslint-plugin/CHANGELOG.md
#	packages/eslint-plugin/package.json
#	packages/express/CHANGELOG.md
#	packages/express/package.json
#	packages/hono/CHANGELOG.md
#	packages/hono/package.json
#	packages/integration-kit/CHANGELOG.md
#	packages/integration-kit/package.json
#	packages/nestjs/CHANGELOG.md
#	packages/nestjs/package.json
#	packages/nextjs/CHANGELOG.md
#	packages/nextjs/package.json
#	packages/otlp-importer/CHANGELOG.md
#	packages/otlp-importer/package.json
#	packages/react/CHANGELOG.md
#	packages/react/package.json
#	packages/remix/CHANGELOG.md
#	packages/remix/package.json
#	packages/sveltekit/CHANGELOG.md
#	packages/sveltekit/package.json
#	packages/testing/CHANGELOG.md
#	packages/testing/package.json
#	packages/trigger-sdk/CHANGELOG.md
#	packages/trigger-sdk/package.json
#	packages/yalt/CHANGELOG.md
#	packages/yalt/package.json
#	pnpm-lock.yaml
Copy link

changeset-bot bot commented Aug 30, 2024

⚠️ No Changeset found

Latest commit: 1812067

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@ericallam
Copy link
Member

What does the live reloading look like?

Copy link

pkg-pr-new bot commented Aug 30, 2024

pnpm add https://pkg.pr.new/triggerdotdev/trigger.dev/@trigger.dev/build@1277
pnpm add https://pkg.pr.new/triggerdotdev/trigger.dev@1277
pnpm add https://pkg.pr.new/triggerdotdev/trigger.dev/@trigger.dev/core@1277
pnpm add https://pkg.pr.new/triggerdotdev/trigger.dev/@trigger.dev/sdk@1277

commit: 1812067

@matt-aitken matt-aitken merged commit 5231381 into main Sep 4, 2024
10 checks passed
@matt-aitken matt-aitken deleted the electricsql-run branch September 4, 2024 16:55
matt-aitken added a commit that referenced this pull request Sep 5, 2024
This reverts commit 5231381.

# Conflicts:
#	pnpm-lock.yaml
@matt-aitken matt-aitken restored the electricsql-run branch September 12, 2024 17:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants