Using local storage on A100 MIG server

Hello,

When using the A100, it seems that all storage is provided through overlay mode, which appears to cause significant bottlenecks due to the nature of deep learning training that requires continuous reading of small files.

Is there a way to add high-speed storage or use local device storage?

Thank you.

Your current Runbox environment is based on a container architecture, and it does not support manually mounting local disks or connecting separate high-performance storage directly.

We recommend switching to a VM-based ECI environment for an optimized deep learning training setup. In ECI environments based on H100 and B200, NVMe Local Storage is provided by default.

2 Likes