alluxio.underfs.abfs

Class AbfsUnderFileSystem

java.lang.Object

alluxio.underfs.BaseUnderFileSystem

alluxio.underfs.ConsistentUnderFileSystem

alluxio.underfs.hdfs.HdfsUnderFileSystem

alluxio.underfs.abfs.AbfsUnderFileSystem

All Implemented Interfaces:

AsyncUfsClient, AtomicFileOutputStreamCallback, UnderFileSystem, java.io.Closeable, java.lang.AutoCloseable

@ThreadSafe
public class AbfsUnderFileSystem
extends HdfsUnderFileSystem

A Microsoft Azure Data Lake Storage Gen2 Implementation.

Nested Class Summary

Nested classes/interfaces inherited from interface alluxio.underfs.UnderFileSystem

UnderFileSystem.Factory, UnderFileSystem.SpaceType

Field Summary

Fields inherited from class alluxio.underfs.hdfs.HdfsUnderFileSystem

CHECKSUM_COMBINE_MODE, HADOOP_AUTH_METHOD, HDFS_ACL_PROVIDER_CLASS, HDFS_EC_CODEC_REGISTRY_CLASS, HDFS_EC_MIN_VERSION, HDFS_USER, JAVAX_WS_RS_CORE_MEDIA_TYPE, KRB_KEYTAB_LOGIN_AUTO_RENEW, KRB5_CONF_FILE, MAX_TRY, mHdfsAclProvider, USER_NAMESPACE_PREFIX

Fields inherited from class alluxio.underfs.BaseUnderFileSystem

EMPTY_ACL, mUfsConf, mUri

Constructor Summary

Constructors

Constructor and Description
AbfsUnderFileSystem(AlluxioURI ufsUri, UnderFileSystemConfiguration conf, org.apache.hadoop.conf.Configuration hdfsConf) Constructs a new HDFS UnderFileSystem.

Method Summary

Modifier and Type	Method and Description
static AbfsUnderFileSystem	createInstance(AlluxioURI uri, UnderFileSystemConfiguration conf) Creates a new AbfsUnderFileSystem instance.
long	getBlockSizeByte(java.lang.String path)
java.util.List<java.lang.String>	getFileLocations(java.lang.String path)
java.util.List<java.lang.String>	getFileLocations(java.lang.String path, FileLocationOptions options)
UfsStatus	getStatus(java.lang.String path, GetStatusOptions options)
java.lang.String	getUnderFSType()
void	setMode(java.lang.String path, short mode)
void	setOwner(java.lang.String path, java.lang.String user, java.lang.String group)

Methods inherited from class alluxio.underfs.hdfs.HdfsUnderFileSystem

cleanup, close, connectFromMaster, connectFromWorker, create, createConfiguration, createDirect, deleteDirectory, deleteFile, exists, getAclPair, getAttributes, getDirectoryStatus, getFileStatus, getFs, getSpace, isDirectory, isFile, isSeekable, listStatus, listStatusIterable, mkdirs, open, openPositionRead, renameDirectory, renameFile, setAclEntries, setAttribute, supportsFlush

Methods inherited from class alluxio.underfs.ConsistentUnderFileSystem

createNonexistingFile, createNonexistingFile, deleteExistingDirectory, deleteExistingDirectory, deleteExistingFile, getExistingDirectoryStatus, getExistingFileStatus, getExistingStatus, isExistingDirectory, openExistingFile, openExistingFile, renameRenamableDirectory, renameRenamableFile

Methods inherited from class alluxio.underfs.BaseUnderFileSystem

create, deleteDirectory, getConfiguration, getFingerprint, getOperationMode, getParsedFingerprint, getParsedFingerprint, getPhysicalStores, isObjectStorage, listStatus, mkdirs, open, performListingAsync, resolveUri, validatePath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface alluxio.underfs.UnderFileSystem

create, createNonexistingFile, createNonexistingFile, deleteDirectory, deleteExistingDirectory, deleteExistingDirectory, deleteExistingFile, getConfiguration, getExistingDirectoryStatus, getExistingFileStatus, getExistingStatus, getFileStatus, getFingerprint, getOperationMode, getParsedFingerprint, getParsedFingerprint, getPhysicalStores, getStatus, getTemporaryToken, isExistingDirectory, isObjectStorage, isTemporaryConnectionToken, listStatus, listStatuses, mkdirs, open, openExistingFile, openExistingFile, refreshTemporaryToken, renameRenamableDirectory, renameRenamableFile, resolveUri, setTemporaryTokenRefreshContext

Methods inherited from interface alluxio.underfs.AsyncUfsClient

performListingAsync

Constructor Detail

AbfsUnderFileSystem

public AbfsUnderFileSystem(AlluxioURI ufsUri,
                           UnderFileSystemConfiguration conf,
                           org.apache.hadoop.conf.Configuration hdfsConf)

Constructs a new HDFS UnderFileSystem.

Parameters:

ufsUri - the AlluxioURI for this UFS

conf - the configuration for this UFS

hdfsConf - the configuration for HDFS

Method Detail

createInstance

public static AbfsUnderFileSystem createInstance(AlluxioURI uri,
                                                 UnderFileSystemConfiguration conf)

Creates a new AbfsUnderFileSystem instance.

Parameters:

uri - the alluxio uri

conf - the ufs configuration

Returns:

A new AbfsUnderFileSystem instance

getUnderFSType

public java.lang.String getUnderFSType()

Specified by:

getUnderFSType in interface UnderFileSystem

Overrides:

getUnderFSType in class HdfsUnderFileSystem

getBlockSizeByte

public long getBlockSizeByte(java.lang.String path)
                      throws java.io.IOException

Specified by:

getBlockSizeByte in interface UnderFileSystem

Overrides:

getBlockSizeByte in class HdfsUnderFileSystem

Throws:

java.io.IOException

getStatus

public UfsStatus getStatus(java.lang.String path,
                           GetStatusOptions options)
                    throws java.io.IOException

Specified by:

getStatus in interface UnderFileSystem

Overrides:

getStatus in class HdfsUnderFileSystem

Throws:

java.io.IOException

setOwner

public void setOwner(java.lang.String path,
                     java.lang.String user,
                     java.lang.String group)

Specified by:

setOwner in interface UnderFileSystem

Overrides:

setOwner in class HdfsUnderFileSystem

setMode

public void setMode(java.lang.String path,
                    short mode)

Specified by:

setMode in interface UnderFileSystem

Overrides:

setMode in class HdfsUnderFileSystem

getFileLocations

public java.util.List<java.lang.String> getFileLocations(java.lang.String path)
                                                  throws java.io.IOException

Specified by:

getFileLocations in interface UnderFileSystem

Overrides:

getFileLocations in class HdfsUnderFileSystem

Throws:

java.io.IOException

getFileLocations

public java.util.List<java.lang.String> getFileLocations(java.lang.String path,
                                                         FileLocationOptions options)
                                                  throws java.io.IOException

Specified by:

getFileLocations in interface UnderFileSystem

Overrides:

getFileLocations in class HdfsUnderFileSystem

Throws:

java.io.IOException