Skip to content

docs: document dedicated-nodes and do-not-disrupt deployment options#2165

Open
velo wants to merge 5 commits into
mainfrom
docs/nodegroups-do-not-disrupt
Open

docs: document dedicated-nodes and do-not-disrupt deployment options#2165
velo wants to merge 5 commits into
mainfrom
docs/nodegroups-do-not-disrupt

Conversation

@velo

@velo velo commented Jun 25, 2026

Copy link
Copy Markdown
Collaborator

Documents two cloud-deployment options in documentation/docs/configuration-engine/cloud-deployment.md:

  • *-node-groups — pins a component's pods onto dedicated nodes (hard requirement → Pending if unavailable). Each name derives a node selector (N=true) + a toleration for taint key N; infra labels+taints the node group. Covers taskmanager-node-groups/jobmanager-node-groups (Flink), node-groups (Postgres, Vert.x).
  • do-not-disrupt — protects pods from voluntary autoscaler consolidation. Documents per-engine defaults (Flink false, Postgres true, Vert.x false).

Matches the implementation in cloud-compilation (per-service deployment config passthrough).

velo added 2 commits June 25, 2026 16:14
Signed-off-by: Marvin Froeder <marvin@datasqrl.com>
Signed-off-by: Marvin Froeder <marvin@datasqrl.com>
@velo velo requested a review from mbroecheler June 25, 2026 19:44
@velo velo enabled auto-merge (squash) June 25, 2026 19:44
Signed-off-by: Marvin Froeder <marvin@datasqrl.com>
@velo

velo commented Jun 26, 2026

Copy link
Copy Markdown
Collaborator Author

Related PRs — ship together:

  • DataSQRL/cloud-compilation#1030 — create-indexes option, schema index-strip, and the CreatePostgresIndexes upgrade step
  • DataSQRL/cloud-backend#553 — metrics catch-up skips indexes; blue-green validation moved after the steady-state upgrade
  • docs: document dedicated-nodes and do-not-disrupt deployment options #2165create-indexes documentation in cloud-deployment.md

@ferenc-csaky

Copy link
Copy Markdown
Collaborator

I'm wondering about if it's a good thing in general to include cloud-specific things to the doc? Technically these options are orthogonal to SQRL, at this point cloud processes and validates them.

I guess it makes sense to keep documentation centralized, but then I think it would make sense to restructure the docs and separate Cloud-specific things to their own page or something.

…sql.parameters passthrough)

Signed-off-by: Marvin Froeder <velo.br@gmail.com>

## Create Indexes (`create-indexes`)

Controls whether the PostgreSQL table indexes are created for the deployment. Defaults to `true`. PostgreSQL only.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it only applies to secondary indexes, right? Not the primary key indexes that are defined on the table itself. Those are needed even during replay, otherwise Postgres cannot effectively upsert and every upsert becomes a full table scan.

@velo velo Jun 29, 2026

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Signed-off-by: Marvin Froeder <marvin@datasqrl.com>
@velo velo changed the title docs: document node-groups and do-not-disrupt deployment options docs: document dedicated-nodes and do-not-disrupt deployment options Jun 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants