Skip to content

Reduce image storage duplication by using containerd as the primary OCI content store #138

Description

@mike-sul

composectl currently maintains its own OCI content store and then imports images into the container runtime.

On systems using containerd as the image backend, this can result in multiple copies of the same image data being stored on disk:

  1. composectl content store
  2. containerd content store
  3. containerd snapshotter storage

This is particularly costly on storage-constrained edge devices and for large application or AI/ML images.

Investigate using containerd as the primary OCI content store and streaming image content directly into it, eliminating the need for a separate persistent content store in composectl.

If the investigation determines that this approach is feasible and provides meaningful benefits, implement a prototype to validate the architecture and quantify storage savings.

Expected benefits:

  1. Reduced storage utilization
  2. Less duplicate image data
  3. Better alignment with containerd architecture
  4. Improved support for large artifacts on edge devices

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions