Skip to content

Opened by mistake, ignore#4262

Closed
czy006 wants to merge 52 commits into
apache:masterfrom
czy006:codex/hash-fxied
Closed

Opened by mistake, ignore#4262
czy006 wants to merge 52 commits into
apache:masterfrom
czy006:codex/hash-fxied

Conversation

@czy006

@czy006 czy006 commented Jun 29, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Rename Paimon primary-key compaction Spark UI description from buckets to bucketUnits.
  • Show the real bucket id when a task contains exactly one bucket unit.
  • Align the Paimon primary-key commit-message INFO log field name with the new wording.

Test Plan

  • ./mvnw -pl amoro-format-paimon -Dtest=TestPaimonPrimaryKeyCompactionTask test
  • git diff --check

chenzhengyu and others added 30 commits April 20, 2026 09:56
…eta to database

Fixed the code execution order in triggerTableAdded() method to check format
support BEFORE inserting TableRuntimeMeta to database. This prevents orphaned
database records for unsupported table formats like Paimon.

Changes:
- Move createTableRuntime() call before insertRuntime()
- Change log level from WARN to INFO for unsupported formats
- Add clear message that table metadata browsing is still available
- 新增 PaimonTableRuntime 和 PaimonTableRuntimeOptimizingState
- DefaultTableRuntimeFactory 中为 PAIMON 格式路由到 PaimonTableRuntime
- DefaultTableService 补充对已同步但缺少 Runtime 的表创建逻辑
- amoro-format-paimon 依赖从 test scope 提升为 compile scope

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
[JSPT-2396] 初步支持PAIMON SNAPSHOT快照调度清理

See merge request shopline/datacenter/dp/dpops/amoro!16
[XRKM-182] 优化Paimon查询详细信息的RT接口

See merge request shopline/datacenter/dp/dpops/amoro!17
[Hotfix]: 修正 Paimon Snapshot 分页查询缓慢的问题

See merge request shopline/datacenter/dp/dpops/amoro!15
[JSPT-2461] 湖仓管控平台:Paimon Append Table Compaction 与 Amoro框架整合,完成初步POC优化演示

See merge request shopline/datacenter/dp/dpops/amoro!18
[JSPT-2522] 修正Paimon表某些情况下权限认证失败的问题

See merge request shopline/datacenter/dp/dpops/amoro!19
[JSPT-2521] 湖仓管控平台:错误的表类型进入优化调度队列Planner,导致其他正常实现的表类型无法优化

See merge request shopline/datacenter/dp/dpops/amoro!20
[JSPT-2483][ams][paimon] 支持Snapshot 的 MAX_DELETE和执行用户参数配置

See merge request shopline/datacenter/dp/dpops/amoro!21
@github-actions github-actions Bot added type:docs Improvements or additions to documentation module:mixed-flink Flink moduel for Mixed Format module:mixed-spark Spark module for Mixed Format module:ams-server Ams server module module:mixed-hive Hive moduel for Mixed Format module:ams-optimizer AMS optimizer module module:mixed-trino trino module for Mixed Format type:infra type:build module:ams-dashboard Ams dashboard module module:common type:site labels Jun 29, 2026
@czy006 czy006 closed this Jun 29, 2026
@czy006 czy006 deleted the codex/hash-fxied branch June 29, 2026 02:18
@czy006 czy006 changed the title fix: clarify paimon primary key bucket description Opened by mistake, ignore Jun 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

module:ams-dashboard Ams dashboard module module:ams-optimizer AMS optimizer module module:ams-server Ams server module module:common module:mixed-flink Flink moduel for Mixed Format module:mixed-hive Hive moduel for Mixed Format module:mixed-spark Spark module for Mixed Format module:mixed-trino trino module for Mixed Format type:build type:docs Improvements or additions to documentation type:infra type:site

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants