Introducing Amazon S3 Switch Supervisor within the AWS SDK for Java 2.x

We’re happy to announce the Developer Preview launch of the Amazon S3 Switch Supervisor – a excessive stage file switch utility for the Amazon Easy Storage Service (Amazon S3) within the AWS SDK for Java 2.x.

Utilizing Switch Supervisor’s easy API, now you can carry out accelerated uploads and downloads of objects to and from Amazon S3 and profit from enhanced throughput and reliability, which is achieved via concurrent transfers of a set of small components from a single object. The Switch Supervisor is constructed on high of the Java bindings of the AWS Widespread Runtime S3 shopper and leverages Amazon S3 multipart add and byte-range fetches for parallel transfers.

Parallel add by way of multipart add

For add operation, the Switch Supervisor makes use of the Amazon S3 multipart add API; it converts one single PutObjectRequest to a number of MultiPartUpload requests and sends these requests concurrently to realize excessive efficiency.

Parallel obtain by way of byte-range fetches

For obtain operation, the Switch Supervisor makes use of byte-range fetches. It splits a GetObjectRequest to a number of smaller requests, every of which retrieves a selected portion of the item. These requests are additionally executed via concurrent connections to Amazon S3.

If you’re utilizing Switch Supervisor 1.x, an object have to be uploaded utilizing multipart add for it to be eligible to be downloaded with optimized efficiency. If an object was initially uploaded as a single object, the Switch Supervisor will be unable to speed up the downloading course of.

With the brand new Switch Supervisor 2.x, that is now not a limitation – downloading an object doesn’t rely upon how the item was initially uploaded, and all downloads can profit from excessive throughput and concurrency.

Getting Began

Add a dependency for the Switch Supervisor

First, it is advisable to embody the separate dependency in your venture.

<dependency>
  <groupId>software program.amazon.awssdk</groupId>
  <artifactId>s3-transfer-manager</artifactId>
  <model>2.17.123-PREVIEW</model>
</dependency>

Instantiate the Switch Supervisor

You’ll be able to instantiate the Switch Supervisor simply utilizing the default settings

S3TransferManager transferManager = S3TransferManager.create();

If you happen to want to configure settings, we suggest utilizing the builder as a substitute:

S3TransferManager transferManager =
    S3TransferManager.builder()
                     .s3ClientConfiguration(cfg -> cfg.credentialsProvider(credentialProvider)
                                                      .area(Area.US_WEST_2)
                                                      .targetThroughputInGbps(20.0)
                                                      .minimumPartSizeInBytes(10 * MB))
                     .construct();

Add a file to Amazon S3

To add a file to S3, it is advisable to present the supply file path and the PutObjectRequest that ought to be used for the add.

FileUpload add = transferManager.uploadFile(b -> b.supply(Paths.get("myFile.txt"))
                                                     .putObjectRequest(req -> req.bucket("bucket")
                                                                         .key("key")));

add.completionFuture().be a part of();

Obtain an Amazon S3 object to a file

To obtain an object, it is advisable to present the vacation spot file path and the GetObjectRequest that ought to be used for the obtain.

FileDownload obtain = 
    transferManager.downloadFile(b -> b.vacation spot(Paths.get("myFile.txt"))
                                       .getObjectRequest(req -> req.bucket("bucket")
                                                                   .key("key")));
obtain.completionFuture().be a part of();

Conclusion

To discover ways to arrange and start utilizing the Switch Supervisor for the AWS SDK for Java 2.x, go to our Developer Information. If you wish to study extra, you may try the supply code on GitHub. Check out the brand new Switch Supervisor right now and tell us what you assume by way of the GitHub points web page!