FSx for Lustre's S3 Data Repository Integration
~8 min read
How Lustre treats an S3 bucket as its backing data repository, and what lazy loading means in practice.
FSx for Lustre's S3 Data Repository Integration is a Pro topic
Sign in, then upgrade to Pro or Power to unlock this topic and the full AWS curriculum.
Key points
- •Data repository association links a Lustre file system to an S3 bucket as its backing store
- •Lazy loading means data streams in from S3 on first read, not via a slow full upfront copy
- •The full S3 namespace is browsable immediately, even before objects are physically loaded
- •Optional export-back-to-S3 lets job output/checkpoints land in durable storage with no extra upload code