com.salesforce.cantor.s3

Class S3Utils.S3Select

java.lang.Object

com.salesforce.cantor.s3.S3Utils.S3Select

Enclosing class:

S3Utils

public static class S3Utils.S3Select
extends Object

S3 Select is allows use of SQL queries on top of data stored in s3 that is in either JSON or CSV. This helper class is a wrapper around the query requests. For more documentation refer to https://docs.aws.amazon.com/AmazonS3/latest/dev/selecting-content-from-objects.html

Constructor Summary

Constructors

Constructor and Description
S3Select()

Method Summary

Modifier and Type	Method and Description
static com.amazonaws.services.s3.model.SelectObjectContentRequest	generateCsvRequest(String bucket, String key, String query) Generate an S3 Select query against a csv file
static com.amazonaws.services.s3.model.SelectObjectContentRequest	generateJsonRequest(String bucket, String key, String query) Request will allow a limited for of SQL describe here: https://docs.aws.amazon.com/AmazonS3/latest/dev/s3-glacier-select-sql-reference.html
static String	queryObject(com.amazonaws.services.s3.AmazonS3 s3Client, com.amazonaws.services.s3.model.SelectObjectContentRequest request)
static String	queryObjectCsv(com.amazonaws.services.s3.AmazonS3 s3Client, String bucket, String key, String query)
static String	queryObjectJson(com.amazonaws.services.s3.AmazonS3 s3Client, String bucket, String key, String query)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

S3Select

public S3Select()

Method Detail

queryObjectJson

public static String queryObjectJson(com.amazonaws.services.s3.AmazonS3 s3Client,
                                     String bucket,
                                     String key,
                                     String query)
                              throws IOException

Throws:

IOException

queryObjectCsv

public static String queryObjectCsv(com.amazonaws.services.s3.AmazonS3 s3Client,
                                    String bucket,
                                    String key,
                                    String query)
                             throws IOException

Throws:

IOException

queryObject

public static String queryObject(com.amazonaws.services.s3.AmazonS3 s3Client,
                                 com.amazonaws.services.s3.model.SelectObjectContentRequest request)
                          throws IOException

Throws:

IOException

generateJsonRequest

public static com.amazonaws.services.s3.model.SelectObjectContentRequest generateJsonRequest(String bucket,
                                                                                             String key,
                                                                                             String query)

Request will allow a limited for of SQL describe here: https://docs.aws.amazon.com/AmazonS3/latest/dev/s3-glacier-select-sql-reference.html

generateCsvRequest

public static com.amazonaws.services.s3.model.SelectObjectContentRequest generateCsvRequest(String bucket,
                                                                                            String key,
                                                                                            String query)

Generate an S3 Select query against a csv file