org.apache.hadoop.fs.azurebfs.services

Class AbfsOutputStream

java.lang.Object

java.io.OutputStream

org.apache.hadoop.fs.azurebfs.services.AbfsOutputStream

All Implemented Interfaces:

Closeable, Flushable, AutoCloseable, org.apache.hadoop.fs.StreamCapabilities, org.apache.hadoop.fs.Syncable

public class AbfsOutputStream
extends OutputStream
implements org.apache.hadoop.fs.Syncable, org.apache.hadoop.fs.StreamCapabilities

The BlobFsOutputStream for Rest AbfsClient.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.fs.StreamCapabilities

org.apache.hadoop.fs.StreamCapabilities.StreamCapability

Field Summary

Fields inherited from interface org.apache.hadoop.fs.StreamCapabilities

DROPBEHIND, HFLUSH, HSYNC, READAHEAD, UNBUFFER

Constructor Summary

Constructors

Constructor and Description
AbfsOutputStream(AbfsClient client, String path, long position, int bufferSize, boolean supportFlush)

Method Summary

Modifier and Type	Method and Description
void	close() Force all data in the output stream to be written to Azure storage.
void	flush() Flushes this output stream and forces any buffered output bytes to be written out.
boolean	hasCapability(String capability) Query the stream for a specific capability.
void	hflush() Flush out the data in client's user buffer.
void	hsync() Similar to posix fsync, flush out the data in client's user buffer all the way to the disk device (but the disk may have it in its cache).
void	waitForPendingUploads()
void	write(byte[] data, int off, int length) Writes length bytes from the specified byte array starting at off to this output stream.
void	write(int byteVal) Writes the specified byte to this output stream.

Methods inherited from class java.io.OutputStream

write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AbfsOutputStream

public AbfsOutputStream(AbfsClient client,
                        String path,
                        long position,
                        int bufferSize,
                        boolean supportFlush)

Method Detail

hasCapability

public boolean hasCapability(String capability)

Query the stream for a specific capability.

Specified by:

hasCapability in interface org.apache.hadoop.fs.StreamCapabilities

Parameters:

capability - string to query the stream support for.

Returns:

true for hsync and hflush.

write

public void write(int byteVal)
           throws IOException

Writes the specified byte to this output stream. The general contract for write is that one byte is written to the output stream. The byte to be written is the eight low-order bits of the argument b. The 24 high-order bits of b are ignored.

Specified by:

write in class OutputStream

Parameters:

byteVal - the byteValue to write.

Throws:

IOException - if an I/O error occurs. In particular, an IOException may be thrown if the output stream has been closed.

write

public void write(byte[] data,
                  int off,
                  int length)
           throws IOException

Writes length bytes from the specified byte array starting at off to this output stream.

Overrides:

write in class OutputStream

Parameters:

data - the byte array to write.

off - the start off in the data.

length - the number of bytes to write.

Throws:

IOException - if an I/O error occurs. In particular, an IOException may be thrown if the output stream has been closed.

flush

public void flush()
           throws IOException

Flushes this output stream and forces any buffered output bytes to be written out. If any data remains in the payload it is committed to the service. Data is queued for writing and forced out to the service before the call returns.

Specified by:

flush in interface Flushable

Overrides:

flush in class OutputStream

Throws:

IOException

hsync

public void hsync()
           throws IOException

Similar to posix fsync, flush out the data in client's user buffer all the way to the disk device (but the disk may have it in its cache).

Specified by:

hsync in interface org.apache.hadoop.fs.Syncable

Throws:

IOException - if error occurs

hflush

public void hflush()
            throws IOException

Flush out the data in client's user buffer. After the return of this call, new readers will see the data.

Specified by:

hflush in interface org.apache.hadoop.fs.Syncable

Throws:

IOException - if any error occurs

close

public void close()
           throws IOException

Force all data in the output stream to be written to Azure storage. Wait to return until this is complete. Close the access to the stream and shutdown the upload thread pool. If the blob was created, its lease will be released. Any error encountered caught in threads and stored will be rethrown here after cleanup.

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class OutputStream

Throws:

IOException

waitForPendingUploads

public void waitForPendingUploads()
                           throws IOException

Throws:

IOException