Contents

Preemptive multitasking (native threads pool) based storage driver. Uses thread-per-task approach for I/O.

Design

Batch Mode

A storage driver implementation can use the batch mode to work with the load operations to increase the efficiency.

Assuming

• Q_output: storage-driver-limit-queue-output
• Q_input: storage-driver-limit-queue-input
• S_batch: load-batch-size

the following equation should always be true: Q_output ≥ Q_input * S_batch

otherwise, there may be the load operation results handling failures.

Heap Memory Consumption

The default Mongoose's load-batch-size configuration value is 32,768. The preemptive storage driver plugin which the task for each load operations batch. The default input queue size (storage-driver-limit-queue-input) is 1,000,000. This yields the 32,768,000,000 instances of the load operations in the runtime and require ~ 6 terabytes of the heap memory. To avoid this behavior, override the defaults:

Q_input * S_batch ≤ 1,000,000