Export to zipped tree of files as Markdown would be helpful for debugging purposes.
Decide on whether files or chunks should be exported.
Properly interlinking the files/chunks will generate a nice graph in Obsidian, for example. (Relevant when #4 has been implemented)
Would also serve as integrity check as each chunk of each file would need to be retrieved.
For Huggingface folks, export to parquet format as well.
Export to zipped tree of files as Markdown would be helpful for debugging purposes.
Decide on whether files or chunks should be exported.
Properly interlinking the files/chunks will generate a nice graph in Obsidian, for example. (Relevant when #4 has been implemented)
Would also serve as integrity check as each chunk of each file would need to be retrieved.
For Huggingface folks, export to parquet format as well.