org.apache.nifi.minifi.c2.cache.s3

Class S3OutputStream

java.lang.Object

java.io.OutputStream

org.apache.nifi.minifi.c2.cache.s3.S3OutputStream

All Implemented Interfaces:

Closeable, Flushable, AutoCloseable

public class S3OutputStream
extends OutputStream

This implementation has heavily borrowed Kafka's implementation which borrowed the general structure of Hadoop's implementation.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static class	S3OutputStream.ConnectProgressListener
private class	S3OutputStream.MultipartUpload

Field Summary

Fields

Modifier and Type	Field and Description
private String	bucket
private ByteBuffer	buffer
private boolean	closed
private String	key
private static org.slf4j.Logger	log
private S3OutputStream.MultipartUpload	multiPartUpload
private int	partSize
private com.amazonaws.event.ProgressListener	progressListener
private com.amazonaws.services.s3.AmazonS3	s3

Constructor Summary

Constructors

Constructor and Description
S3OutputStream(String bucket, String key, com.amazonaws.services.s3.AmazonS3 s3) Creates a new S3 output stream for an object.

Method Summary

Modifier and Type	Method and Description
void	close()
void	commit()
private S3OutputStream.MultipartUpload	newMultipartUpload()
private void	uploadPart()
private void	uploadPart(int size)
void	write(byte[] b, int off, int len)
void	write(int b)

Methods inherited from class java.io.OutputStream

flush, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

log

private static final org.slf4j.Logger log

s3

private final com.amazonaws.services.s3.AmazonS3 s3

bucket

private final String bucket

key

private final String key

progressListener

private final com.amazonaws.event.ProgressListener progressListener

partSize

private final int partSize

closed

private boolean closed

buffer

private ByteBuffer buffer

multiPartUpload

private S3OutputStream.MultipartUpload multiPartUpload

Constructor Detail

S3OutputStream

public S3OutputStream(String bucket,
                      String key,
                      com.amazonaws.services.s3.AmazonS3 s3)

Creates a new S3 output stream for an object.

Parameters:

bucket - The bucket.

key - The object's key.

s3 - An S3 client.

Method Detail

write

public void write(int b)
           throws IOException

Specified by:

write in class OutputStream

Throws:

IOException

write

public void write(byte[] b,
                  int off,
                  int len)
           throws IOException

Overrides:

write in class OutputStream

Throws:

IOException

uploadPart

private void uploadPart()
                 throws IOException

Throws:

IOException

uploadPart

private void uploadPart(int size)
                 throws IOException

Throws:

IOException

commit

public void commit()
            throws IOException

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class OutputStream

Throws:

IOException

newMultipartUpload

private S3OutputStream.MultipartUpload newMultipartUpload()
                                                   throws IOException

Throws:

IOException