Package alluxio.underfs.abfs

Class AbfsUnderFileSystem

  • All Implemented Interfaces:
    alluxio.underfs.AsyncUfsClient, alluxio.underfs.AtomicFileOutputStreamCallback, alluxio.underfs.UnderFileSystem, java.io.Closeable, java.lang.AutoCloseable
    @ThreadSafe
public class AbfsUnderFileSystem
extends alluxio.underfs.hdfs.HdfsUnderFileSystem
    A Microsoft Azure Data Lake Storage Gen2 Implementation.

    • Nested Class Summary

      • Nested classes/interfaces inherited from interface alluxio.underfs.UnderFileSystem

        alluxio.underfs.UnderFileSystem.Factory, alluxio.underfs.UnderFileSystem.SpaceType

    • Field Summary

      • Fields inherited from class alluxio.underfs.BaseUnderFileSystem

        EMPTY_ACL, mUfsConf, mUri

    • Constructor Summary

      Constructors 
      Constructor Description
      AbfsUnderFileSystem​(alluxio.AlluxioURI ufsUri, alluxio.underfs.UnderFileSystemConfiguration conf, org.apache.hadoop.conf.Configuration hdfsConf)
      Constructs a new HDFS UnderFileSystem.

    • Method Summary

      All Methods Static Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      static AbfsUnderFileSystem createInstance​(alluxio.AlluxioURI uri, alluxio.underfs.UnderFileSystemConfiguration conf)
      Creates a new AbfsUnderFileSystem instance.
      long getBlockSizeByte​(java.lang.String path)  
      java.util.List<java.lang.String> getFileLocations​(java.lang.String path)  
      java.util.List<java.lang.String> getFileLocations​(java.lang.String path, alluxio.underfs.options.FileLocationOptions options)  
      alluxio.underfs.UfsStatus getStatus​(java.lang.String path, alluxio.underfs.options.GetStatusOptions options)  
      java.lang.String getUnderFSType()  
      void setMode​(java.lang.String path, short mode)  
      void setOwner​(java.lang.String path, java.lang.String user, java.lang.String group)  

      • Methods inherited from class alluxio.underfs.hdfs.HdfsUnderFileSystem

        cleanup, close, connectFromMaster, connectFromWorker, create, createConfiguration, createDirect, deleteDirectory, deleteFile, exists, getAclPair, getActiveSyncInfo, getDirectoryStatus, getFileStatus, getSpace, isDirectory, isFile, isSeekable, listStatus, mkdirs, open, openPositionRead, renameDirectory, renameFile, setAclEntries, startActiveSyncPolling, startSync, stopActiveSyncPolling, stopSync, supportsActiveSync, supportsFlush

      • Methods inherited from class alluxio.underfs.ConsistentUnderFileSystem

        createNonexistingFile, createNonexistingFile, deleteExistingDirectory, deleteExistingDirectory, deleteExistingFile, getExistingDirectoryStatus, getExistingFileStatus, getExistingStatus, isExistingDirectory, openExistingFile, openExistingFile, renameRenamableDirectory, renameRenamableFile

      • Methods inherited from class alluxio.underfs.BaseUnderFileSystem

        create, deleteDirectory, getConfiguration, getFingerprint, getOperationMode, getParsedFingerprint, getParsedFingerprint, getPhysicalStores, isObjectStorage, listStatus, listStatusIterable, mkdirs, open, performListingAsync, resolveUri, validatePath

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

      • Methods inherited from interface alluxio.underfs.AsyncUfsClient

        performListingAsync

      • Methods inherited from interface alluxio.underfs.UnderFileSystem

        create, createNonexistingFile, createNonexistingFile, deleteDirectory, deleteExistingDirectory, deleteExistingDirectory, deleteExistingFile, getConfiguration, getExistingDirectoryStatus, getExistingFileStatus, getExistingStatus, getFileStatus, getFingerprint, getOperationMode, getParsedFingerprint, getParsedFingerprint, getPhysicalStores, getStatus, getTemporaryToken, isExistingDirectory, isObjectStorage, isTemporaryConnectionToken, listStatus, listStatuses, listStatusIterable, mkdirs, open, openExistingFile, openExistingFile, refreshTemporaryToken, renameRenamableDirectory, renameRenamableFile, resolveUri, setTemporaryTokenRefreshContext

    • Constructor Detail

      • AbfsUnderFileSystem

        public AbfsUnderFileSystem​(alluxio.AlluxioURI ufsUri,
                           alluxio.underfs.UnderFileSystemConfiguration conf,
                           org.apache.hadoop.conf.Configuration hdfsConf)
        Constructs a new HDFS UnderFileSystem.
        Parameters:
        ufsUri - the AlluxioURI for this UFS
        conf - the configuration for this UFS
        hdfsConf - the configuration for HDFS

    • Method Detail

      • createInstance

        public static AbfsUnderFileSystem createInstance​(alluxio.AlluxioURI uri,
                                                 alluxio.underfs.UnderFileSystemConfiguration conf)
        Creates a new AbfsUnderFileSystem instance.
        Parameters:
        uri - the alluxio uri
        conf - the ufs configuration
        Returns:
        A new AbfsUnderFileSystem instance

      • getUnderFSType

        public java.lang.String getUnderFSType()
        Specified by:
        getUnderFSType in interface alluxio.underfs.UnderFileSystem
        Overrides:
        getUnderFSType in class alluxio.underfs.hdfs.HdfsUnderFileSystem

      • getBlockSizeByte

        public long getBlockSizeByte​(java.lang.String path)
                      throws java.io.IOException
        Specified by:
        getBlockSizeByte in interface alluxio.underfs.UnderFileSystem
        Overrides:
        getBlockSizeByte in class alluxio.underfs.hdfs.HdfsUnderFileSystem
        Throws:
        java.io.IOException

      • getStatus

        public alluxio.underfs.UfsStatus getStatus​(java.lang.String path,
                                           alluxio.underfs.options.GetStatusOptions options)
                                    throws java.io.IOException
        Specified by:
        getStatus in interface alluxio.underfs.UnderFileSystem
        Overrides:
        getStatus in class alluxio.underfs.hdfs.HdfsUnderFileSystem
        Throws:
        java.io.IOException

      • setOwner

        public void setOwner​(java.lang.String path,
                     java.lang.String user,
                     java.lang.String group)
        Specified by:
        setOwner in interface alluxio.underfs.UnderFileSystem
        Overrides:
        setOwner in class alluxio.underfs.hdfs.HdfsUnderFileSystem

      • setMode

        public void setMode​(java.lang.String path,
                    short mode)
        Specified by:
        setMode in interface alluxio.underfs.UnderFileSystem
        Overrides:
        setMode in class alluxio.underfs.hdfs.HdfsUnderFileSystem

      • getFileLocations

        public java.util.List<java.lang.String> getFileLocations​(java.lang.String path)
                                                  throws java.io.IOException
        Specified by:
        getFileLocations in interface alluxio.underfs.UnderFileSystem
        Overrides:
        getFileLocations in class alluxio.underfs.hdfs.HdfsUnderFileSystem
        Throws:
        java.io.IOException

      • getFileLocations

        public java.util.List<java.lang.String> getFileLocations​(java.lang.String path,
                                                         alluxio.underfs.options.FileLocationOptions options)
                                                  throws java.io.IOException
        Specified by:
        getFileLocations in interface alluxio.underfs.UnderFileSystem
        Overrides:
        getFileLocations in class alluxio.underfs.hdfs.HdfsUnderFileSystem
        Throws:
        java.io.IOException