The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3. PyTorch is an open source machine learning framework widely used by AWS customers to build and train machine learning models. The Amazon S3 Connector for PyTorch automatically optimizes S3 read and list requests to improve data loading and checkpoint performance for your training workloads. Saving machine learning training model checkpoints is up to 40% faster with the Amazon S3 Connector for PyTorch than saving to Amazon EC2 instance storage.
Source:: Amazon AWS