Skip to content

feat(blob): Remove blob external storage mode#393

Open
lxy-9602 wants to merge 2 commits into
alibaba:mainfrom
lxy-9602:rm-blob-external
Open

feat(blob): Remove blob external storage mode#393
lxy-9602 wants to merge 2 commits into
alibaba:mainfrom
lxy-9602:rm-blob-external

Conversation

@lxy-9602

@lxy-9602 lxy-9602 commented Jul 1, 2026

Copy link
Copy Markdown
Collaborator

Purpose

Linked issue: close #283

Remove the blob-external-storage-field and blob-external-storage-path functionality, following apache/paimon#8378.

This change:

  • Removes the external-storage blob table options from public option definitions and CoreOptions.
  • Removes external-storage blob schema validation.
  • Deletes ExternalStorageBlobWriter and its write-path integration from AppendOnlyWriter.
  • Simplifies BlobFileContext to only classify descriptor, view, inline, and regular blob-file fields.
  • Simplifies blob writer plumbing by removing the now-unused WriteConsumer and blob path creator hooks.
  • Keeps existing descriptor/blob-view/raw blob behavior unchanged.
  • Keeps historical test data, but removes the deleted options from fixture schema files.

Tests

API and Format

This removes two public table options from the C++ API:

  • blob-external-storage-field
  • blob-external-storage-path

No storage format change is introduced. Existing BlobDescriptor data whose URI points outside the main table path can still be read as long as the referenced files exist.

Documentation

Generative AI tooling

Generated-by: OpenAI Codex (GPT-5)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature] Support multiple blob fields and BlobView/descriptor-inline mode in paimon-cpp

1 participant