org.finra.herd.dao.impl

Class S3OperationsImpl

java.lang.Object

org.finra.herd.dao.impl.S3OperationsImpl

All Implemented Interfaces:

S3Operations

public class S3OperationsImpl
extends Object
implements S3Operations

Field Summary

Fields inherited from interface org.finra.herd.dao.S3Operations

ERROR_CODE_ACCESS_DENIED, ERROR_CODE_INTERNAL_ERROR, ERROR_CODE_NO_SUCH_BUCKET, ERROR_CODE_NO_SUCH_KEY

Constructor Summary

Constructors

Constructor and Description
S3OperationsImpl()

Method Summary

Modifier and Type	Method and Description
void	abortMultipartUpload(com.amazonaws.services.s3.model.AbortMultipartUploadRequest abortMultipartUploadRequest, com.amazonaws.services.s3.AmazonS3 s3Client) Aborts a multipart upload.
com.amazonaws.services.s3.transfer.Copy	copyFile(com.amazonaws.services.s3.model.CopyObjectRequest copyObjectRequest, com.amazonaws.services.s3.transfer.TransferManager transferManager) Schedules a new transfer to copy data from one Amazon S3 location to another Amazon S3 location.
com.amazonaws.services.s3.model.DeleteObjectsResult	deleteObjects(com.amazonaws.services.s3.model.DeleteObjectsRequest deleteObjectsRequest, com.amazonaws.services.s3.AmazonS3 s3Client) Deletes the specified S3 objects in the specified S3 bucket.
com.amazonaws.services.s3.transfer.Download	download(String s3BucketName, String s3Key, File file, com.amazonaws.services.s3.transfer.TransferManager transferManager) Schedules a new transfer to download data from Amazon S3 and save it to the specified file.
com.amazonaws.services.s3.transfer.MultipleFileDownload	downloadDirectory(String s3BucketName, String s3KeyPrefix, File destinationDirectory, com.amazonaws.services.s3.transfer.TransferManager transferManager) Downloads all objects in the virtual directory designated by the key prefix given to the destination directory given.
URL	generatePresignedUrl(com.amazonaws.services.s3.model.GeneratePresignedUrlRequest generatePresignedUrlRequest, com.amazonaws.services.s3.AmazonS3 s3Client) Returns a pre-signed URL for accessing an Amazon S3 resource.
com.amazonaws.services.s3.model.ObjectMetadata	getObjectMetadata(String s3BucketName, String s3Key, com.amazonaws.services.s3.AmazonS3 s3Client) Gets the metadata for the specified Amazon S3 object without actually fetching the object itself.
com.amazonaws.services.s3.model.GetObjectTaggingResult	getObjectTagging(com.amazonaws.services.s3.model.GetObjectTaggingRequest getObjectTaggingRequest, com.amazonaws.services.s3.AmazonS3 s3Client) Returns all S3 object tags for the specified object.
com.amazonaws.services.s3.model.S3Object	getS3Object(com.amazonaws.services.s3.model.GetObjectRequest getObjectRequest, com.amazonaws.services.s3.AmazonS3 s3) Gets the object stored in Amazon S3 under the specified bucket and key.
com.amazonaws.services.s3.model.MultipartUploadListing	listMultipartUploads(com.amazonaws.services.s3.model.ListMultipartUploadsRequest listMultipartUploadsRequest, com.amazonaws.services.s3.AmazonS3 s3Client) Lists in-progress multipart uploads.
com.amazonaws.services.s3.model.ObjectListing	listObjects(com.amazonaws.services.s3.model.ListObjectsRequest listObjectsRequest, com.amazonaws.services.s3.AmazonS3 s3Client) Returns a list of summary information about the objects in the specified bucket.
com.amazonaws.services.s3.model.VersionListing	listVersions(com.amazonaws.services.s3.model.ListVersionsRequest listVersionsRequest, com.amazonaws.services.s3.AmazonS3 s3Client) Returns a list of summary information about the versions in the specified bucket.
com.amazonaws.services.s3.model.PutObjectResult	putObject(com.amazonaws.services.s3.model.PutObjectRequest putObjectRequest, com.amazonaws.services.s3.AmazonS3 s3Client) Uploads a new object to the specified Amazon S3 bucket.
void	restoreObject(com.amazonaws.services.s3.model.RestoreObjectRequest requestRestore, com.amazonaws.services.s3.AmazonS3 s3Client) Requests to restore an object, which was transitioned to Amazon Glacier from Amazon S3 when it was expired, into Amazon S3 again.
void	rollback() Rolls back any updates to S3 within a given session.
com.amazonaws.services.s3.model.SetObjectTaggingResult	setObjectTagging(com.amazonaws.services.s3.model.SetObjectTaggingRequest setObjectTaggingRequest, com.amazonaws.services.s3.AmazonS3 s3Client) Set the tags for the specified object.
com.amazonaws.services.s3.transfer.Upload	upload(com.amazonaws.services.s3.model.PutObjectRequest putObjectRequest, com.amazonaws.services.s3.transfer.TransferManager transferManager) Schedules a new transfer to upload data to Amazon S3.
com.amazonaws.services.s3.transfer.MultipleFileUpload	uploadDirectory(String s3BucketName, String virtualDirectoryKeyPrefix, File directory, boolean includeSubdirectories, com.amazonaws.services.s3.transfer.ObjectMetadataProvider metadataProvider, com.amazonaws.services.s3.transfer.TransferManager transferManager) Uploads all files in the directory given to the bucket named, optionally recursing for all subdirectories.
com.amazonaws.services.s3.transfer.MultipleFileUpload	uploadFileList(String s3BucketName, String virtualDirectoryKeyPrefix, File directory, List<File> files, com.amazonaws.services.s3.transfer.ObjectMetadataProvider metadataProvider, com.amazonaws.services.s3.transfer.TransferManager transferManager) Uploads all specified files to the bucket named, constructing relative keys depending on the common parent directory given.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

S3OperationsImpl

public S3OperationsImpl()

Method Detail

abortMultipartUpload

public void abortMultipartUpload(com.amazonaws.services.s3.model.AbortMultipartUploadRequest abortMultipartUploadRequest,
                                 com.amazonaws.services.s3.AmazonS3 s3Client)

Description copied from interface: S3Operations

Aborts a multipart upload.

Specified by:

abortMultipartUpload in interface S3Operations

Parameters:

abortMultipartUploadRequest - the request object containing all the parameters for the operation

s3Client - the AmazonS3 implementation to use

copyFile

public com.amazonaws.services.s3.transfer.Copy copyFile(com.amazonaws.services.s3.model.CopyObjectRequest copyObjectRequest,
                                                        com.amazonaws.services.s3.transfer.TransferManager transferManager)

Description copied from interface: S3Operations

Schedules a new transfer to copy data from one Amazon S3 location to another Amazon S3 location.

Specified by:

copyFile in interface S3Operations

Parameters:

copyObjectRequest - the request containing all the parameters for the copy

transferManager - the transfer manager implementation to use

deleteObjects

public com.amazonaws.services.s3.model.DeleteObjectsResult deleteObjects(com.amazonaws.services.s3.model.DeleteObjectsRequest deleteObjectsRequest,
                                                                         com.amazonaws.services.s3.AmazonS3 s3Client)

Description copied from interface: S3Operations

Deletes the specified S3 objects in the specified S3 bucket.

Specified by:

deleteObjects in interface S3Operations

Parameters:

deleteObjectsRequest - the request object containing all the options for deleting multiple objects in a specified bucket

s3Client - the AmazonS3 implementation to use

Returns:

the successful response to the delete object request

download

public com.amazonaws.services.s3.transfer.Download download(String s3BucketName,
                                                            String s3Key,
                                                            File file,
                                                            com.amazonaws.services.s3.transfer.TransferManager transferManager)

Description copied from interface: S3Operations

Schedules a new transfer to download data from Amazon S3 and save it to the specified file.

Specified by:

download in interface S3Operations

Parameters:

s3BucketName - the S3 bucket name

s3Key - the S3 key

file - the destination file

transferManager - the transfer manager implementation to use

Returns:

the object that represents an asynchronous download from Amazon S3

downloadDirectory

public com.amazonaws.services.s3.transfer.MultipleFileDownload downloadDirectory(String s3BucketName,
                                                                                 String s3KeyPrefix,
                                                                                 File destinationDirectory,
                                                                                 com.amazonaws.services.s3.transfer.TransferManager transferManager)

Description copied from interface: S3Operations

Downloads all objects in the virtual directory designated by the key prefix given to the destination directory given.

Specified by:

downloadDirectory in interface S3Operations

Parameters:

s3BucketName - the S3 bucket name

s3KeyPrefix - the S3 key prefix

destinationDirectory - the destination directory

transferManager - the transfer manager implementation to use

Returns:

the object that represents an asynchronous multiple file download of an entire virtual directory

generatePresignedUrl

public URL generatePresignedUrl(com.amazonaws.services.s3.model.GeneratePresignedUrlRequest generatePresignedUrlRequest,
                                com.amazonaws.services.s3.AmazonS3 s3Client)

Description copied from interface: S3Operations

Returns a pre-signed URL for accessing an Amazon S3 resource.

Specified by:

generatePresignedUrl in interface S3Operations

Parameters:

generatePresignedUrlRequest - the request object containing all the options for generating a pre-signed URL (bucket name, key, expiration date, etc)

s3Client - the AmazonS3 implementation to use

Returns:

the pre-signed URL which expires at the specified time, and can be used to allow anyone to download the specified object from S3, without exposing the owner's AWS secret access key

getObjectMetadata

public com.amazonaws.services.s3.model.ObjectMetadata getObjectMetadata(String s3BucketName,
                                                                        String s3Key,
                                                                        com.amazonaws.services.s3.AmazonS3 s3Client)

Description copied from interface: S3Operations

Gets the metadata for the specified Amazon S3 object without actually fetching the object itself.

Specified by:

getObjectMetadata in interface S3Operations

Parameters:

s3BucketName - the S3 bucket name

s3Key - the S3 key

s3Client - the AmazonS3 implementation to use

Returns:

the Amazon S3 object metadata for the specified object

getObjectTagging

public com.amazonaws.services.s3.model.GetObjectTaggingResult getObjectTagging(com.amazonaws.services.s3.model.GetObjectTaggingRequest getObjectTaggingRequest,
                                                                               com.amazonaws.services.s3.AmazonS3 s3Client)

Description copied from interface: S3Operations

Returns all S3 object tags for the specified object.

Specified by:

getObjectTagging in interface S3Operations

Parameters:

getObjectTaggingRequest - the request object containing all the options on how to retrieve the Amazon S3 object tags

s3Client - the AmazonS3 implementation to use

Returns:

the set of S3 object tags

getS3Object

public com.amazonaws.services.s3.model.S3Object getS3Object(com.amazonaws.services.s3.model.GetObjectRequest getObjectRequest,
                                                            com.amazonaws.services.s3.AmazonS3 s3)

Description copied from interface: S3Operations

Gets the object stored in Amazon S3 under the specified bucket and key.

Specified by:

getS3Object in interface S3Operations

Parameters:

getObjectRequest - the request object containing all the options for downloading an Amazon S3 object

s3 - the AmazonS3 implementation to use

Returns:

the object stored in Amazon S3

listMultipartUploads

public com.amazonaws.services.s3.model.MultipartUploadListing listMultipartUploads(com.amazonaws.services.s3.model.ListMultipartUploadsRequest listMultipartUploadsRequest,
                                                                                   com.amazonaws.services.s3.AmazonS3 s3Client)

Description copied from interface: S3Operations

Lists in-progress multipart uploads. An in-progress multipart upload is a multipart upload that has been initiated, but has not yet been completed or aborted. This operation returns at most 1,000 multipart uploads in the response by default.

Specified by:

listMultipartUploads in interface S3Operations

Parameters:

listMultipartUploadsRequest - the request object that specifies all the parameters of this operation

s3Client - the AmazonS3 implementation to use

Returns:

the listing of multipart uploads from Amazon S3

listObjects

public com.amazonaws.services.s3.model.ObjectListing listObjects(com.amazonaws.services.s3.model.ListObjectsRequest listObjectsRequest,
                                                                 com.amazonaws.services.s3.AmazonS3 s3Client)

Description copied from interface: S3Operations

Returns a list of summary information about the objects in the specified bucket.

Specified by:

listObjects in interface S3Operations

Parameters:

listObjectsRequest - the request object containing all options for listing the objects in a specified bucket

s3Client - the AmazonS3 implementation to use

Returns:

the listing of the objects in the specified bucket

listVersions

public com.amazonaws.services.s3.model.VersionListing listVersions(com.amazonaws.services.s3.model.ListVersionsRequest listVersionsRequest,
                                                                   com.amazonaws.services.s3.AmazonS3 s3Client)

Description copied from interface: S3Operations

Returns a list of summary information about the versions in the specified bucket.

Specified by:

listVersions in interface S3Operations

Parameters:

listVersionsRequest - the request object containing all options for listing the versions in a specified bucket

s3Client - the AmazonS3 implementation to use

Returns:

the listing of the versions in the specified bucket

putObject

public com.amazonaws.services.s3.model.PutObjectResult putObject(com.amazonaws.services.s3.model.PutObjectRequest putObjectRequest,
                                                                 com.amazonaws.services.s3.AmazonS3 s3Client)

Description copied from interface: S3Operations

Uploads a new object to the specified Amazon S3 bucket.

Specified by:

putObject in interface S3Operations

Parameters:

putObjectRequest - the request object containing all the parameters to upload a new object to Amazon S3

s3Client - the AmazonS3 implementation to use

Returns:

the object containing the information returned by Amazon S3 for the newly created object

restoreObject

public void restoreObject(com.amazonaws.services.s3.model.RestoreObjectRequest requestRestore,
                          com.amazonaws.services.s3.AmazonS3 s3Client)

Description copied from interface: S3Operations

Requests to restore an object, which was transitioned to Amazon Glacier from Amazon S3 when it was expired, into Amazon S3 again.

Specified by:

restoreObject in interface S3Operations

Parameters:

requestRestore - the request object containing all the options for restoring an object

s3Client - the AmazonS3 implementation to use

rollback

public void rollback()

Description copied from interface: S3Operations

Rolls back any updates to S3 within a given session. Whether rollback is supported or not is implementation dependent.

Specified by:

rollback in interface S3Operations

setObjectTagging

public com.amazonaws.services.s3.model.SetObjectTaggingResult setObjectTagging(com.amazonaws.services.s3.model.SetObjectTaggingRequest setObjectTaggingRequest,
                                                                               com.amazonaws.services.s3.AmazonS3 s3Client)

Description copied from interface: S3Operations

Set the tags for the specified object.

Specified by:

setObjectTagging in interface S3Operations

Parameters:

setObjectTaggingRequest - the request object containing all the options for setting the tags for the specified object

s3Client - the AmazonS3 implementation to use

Returns:

the result of the set operation

upload

public com.amazonaws.services.s3.transfer.Upload upload(com.amazonaws.services.s3.model.PutObjectRequest putObjectRequest,
                                                        com.amazonaws.services.s3.transfer.TransferManager transferManager)

Description copied from interface: S3Operations

Schedules a new transfer to upload data to Amazon S3.

Specified by:

upload in interface S3Operations

Parameters:

putObjectRequest - the request containing all the parameters for the upload

transferManager - the transfer manager implementation to use

Returns:

the object to use to check the state of the upload, listen for progress notifications, and otherwise manage the upload

uploadDirectory

public com.amazonaws.services.s3.transfer.MultipleFileUpload uploadDirectory(String s3BucketName,
                                                                             String virtualDirectoryKeyPrefix,
                                                                             File directory,
                                                                             boolean includeSubdirectories,
                                                                             com.amazonaws.services.s3.transfer.ObjectMetadataProvider metadataProvider,
                                                                             com.amazonaws.services.s3.transfer.TransferManager transferManager)

Description copied from interface: S3Operations

Uploads all files in the directory given to the bucket named, optionally recursing for all subdirectories.

Specified by:

uploadDirectory in interface S3Operations

Parameters:

s3BucketName - the S3 bucket name

virtualDirectoryKeyPrefix - the key prefix of the virtual directory to upload to

directory - the directory to upload

includeSubdirectories - specified whether to include subdirectories in the upload. If true, files found in subdirectories will be included with an appropriate concatenation to the key prefix

metadataProvider - the callback of type ObjectMetadataProvider which is used to provide metadata for each file being uploaded

transferManager - the transfer manager implementation to use

Returns:

the multiple file upload information

uploadFileList

public com.amazonaws.services.s3.transfer.MultipleFileUpload uploadFileList(String s3BucketName,
                                                                            String virtualDirectoryKeyPrefix,
                                                                            File directory,
                                                                            List<File> files,
                                                                            com.amazonaws.services.s3.transfer.ObjectMetadataProvider metadataProvider,
                                                                            com.amazonaws.services.s3.transfer.TransferManager transferManager)

Description copied from interface: S3Operations

Uploads all specified files to the bucket named, constructing relative keys depending on the common parent directory given.

Specified by:

uploadFileList in interface S3Operations

Parameters:

s3BucketName - the S3 bucket name

virtualDirectoryKeyPrefix - the key prefix of the virtual directory to upload to

directory - the common parent directory of files to upload. The keys of the files in the list of files are constructed relative to this directory and the virtualDirectoryKeyPrefix

files - the list of files to upload. The keys of the files are calculated relative to the common parent directory and the virtualDirectoryKeyPrefix

metadataProvider - the callback of type ObjectMetadataProvider which is used to provide metadata for each file being uploaded

transferManager - the transfer manager implementation to use

Returns:

the multiple file upload information