A B C D E F G H I J K L M N O P R S T U V W

A

access(Path, FsAction) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

acquireLease(String) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Get a lease on the blob identified by key.

acquireLease(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Get a self-renewing lease on the specified file.

append(Path, int, Progressable) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

This optional operation is not yet supported.

APPEND_SUPPORT_ENABLE_PROPERTY_NAME - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

AUTHENTICATION_FAILED_ERROR_MESSAGE - Static variable in class org.apache.hadoop.fs.azure.security.Constants

Error message for Authentication failures.

authorize(String, String, String) - Method in class org.apache.hadoop.fs.azure.RemoteWasbAuthorizerImpl

authorize(String, String, String) - Method in interface org.apache.hadoop.fs.azure.WasbAuthorizerInterface

Authorizer API to authorize access in WASB.

AZURE_CHMOD_USERLIST_PROPERTY_NAME - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Configuration property used to specify list of users that can perform chmod operation when authorization is enabled in WASB.

AZURE_CHOWN_USERLIST_PROPERTY_NAME - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Configuration property used to specify list of users that can perform chown operation when authorization is enabled in WASB.

AZURE_DAEMON_USERLIST_PROPERTY_NAME - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Configuration property used to specify list of daemon users that can perform chmod operation when authorization is enabled in WASB.

AZURE_DELETE_THREADS - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

The configuration property to set number of threads to be used for delete operation.

AZURE_ENABLE_SPNEGO_TOKEN_CACHE - Static variable in class org.apache.hadoop.fs.azure.security.Constants

The configuration property to enable SPNEGO token cache.

AZURE_KERBEROS_SUPPORT_PROPERTY_NAME - Static variable in class org.apache.hadoop.fs.azure.security.Constants

The configuration property to enable Kerberos support.

AZURE_RENAME_THREADS - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

The configuration property to set number of threads to be used for rename operation.

AzureException - Exception in org.apache.hadoop.fs.azure

Thrown if there is a problem communicating with Azure Storage service.

AzureException(String) - Constructor for exception org.apache.hadoop.fs.azure.AzureException

AzureException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.azure.AzureException

AzureException(Throwable) - Constructor for exception org.apache.hadoop.fs.azure.AzureException

AzureFileSystemInstrumentation - Class in org.apache.hadoop.fs.azure.metrics

A metrics source for the WASB file system to track all the metrics we care about for getting a clear picture of the performance/reliability/interaction of the Hadoop cluster with Azure Storage.

AzureFileSystemInstrumentation(Configuration) - Constructor for class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

AzureFileSystemMetricsSystem - Class in org.apache.hadoop.fs.azure.metrics

AzureFileSystemMetricsSystem

AzureFileSystemThreadTask - Interface in org.apache.hadoop.fs.azure

Interface for executing the file operation by a thread.

AzureLinkedStack<E> - Class in org.apache.hadoop.fs.azure

A simple generic stack implementation using linked lists.

AzureLinkedStack() - Constructor for class org.apache.hadoop.fs.azure.AzureLinkedStack

AzureNativeFileSystemStore - Class in org.apache.hadoop.fs.azure

Core implementation of Windows Azure Filesystem for Hadoop.

AzureNativeFileSystemStore() - Constructor for class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

B

BandwidthGaugeUpdater - Class in org.apache.hadoop.fs.azure.metrics

Internal implementation class to help calculate the current bytes uploaded/downloaded and the maximum bandwidth gauges.

BandwidthGaugeUpdater(AzureFileSystemInstrumentation) - Constructor for class org.apache.hadoop.fs.azure.metrics.BandwidthGaugeUpdater

Create a new updater object with default values.

BandwidthGaugeUpdater(AzureFileSystemInstrumentation, int, boolean) - Constructor for class org.apache.hadoop.fs.azure.metrics.BandwidthGaugeUpdater

Create a new updater object with some overrides (used in unit tests).

bind(OperationContext) - Static method in class org.apache.hadoop.fs.azure.SendRequestIntercept

Binds a new lister to the operation context so the WASB file system can appropriately intercept sends and allow concurrent OOB I/Os.

BlockBlobAppendStream - Class in org.apache.hadoop.fs.azure

Stream object that implements append for Block Blobs in WASB.

BlockBlobAppendStream(StorageInterface.CloudBlockBlobWrapper, String, int, boolean, OperationContext) - Constructor for class org.apache.hadoop.fs.azure.BlockBlobAppendStream

BlockBlobAppendStream constructor.

blockDownloaded(long) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Indicate that we just downloaded a block and record its latency.

blockDownloaded(Date, Date, long) - Method in class org.apache.hadoop.fs.azure.metrics.BandwidthGaugeUpdater

Indicate that a block has been downloaded.

blockUploaded(long) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Indicate that we just uploaded a block and record its latency.

blockUploaded(Date, Date, long) - Method in class org.apache.hadoop.fs.azure.metrics.BandwidthGaugeUpdater

Indicate that a block has been uploaded.

C

CachingAuthorizer<K,V> - Class in org.apache.hadoop.fs.azure

Class that provides caching for Authorize and getSasUri calls

CachingAuthorizer(long, String) - Constructor for class org.apache.hadoop.fs.azure.CachingAuthorizer

cancel(Token<?>, Configuration) - Method in class org.apache.hadoop.fs.azure.security.WasbTokenRenewer

Cancel the delegation token.

cancelDelegationToken(Token<?>) - Method in class org.apache.hadoop.fs.azure.security.RemoteWasbDelegationTokenManager

cancelDelegationToken(Token<?>) - Method in interface org.apache.hadoop.fs.azure.security.WasbDelegationTokenManager

Cancel the delegation token

changePermissionStatus(String, PermissionStatus) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Changes the permission status on the given key.

checkPath(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

cleanup() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

Clean up after execution of rename.

clear() - Method in class org.apache.hadoop.fs.azure.CachingAuthorizer

clientErrorEncountered() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Indicate that we just encountered a client-side error.

close() - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

close() - Method in class org.apache.hadoop.fs.azure.BlockBlobAppendStream

Force all data in the output stream to be written to Azure storage.

close() - Method in class org.apache.hadoop.fs.azure.metrics.BandwidthGaugeUpdater

close() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

close() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

Constants - Class in org.apache.hadoop.fs.azure.security

Constants for used with WASB security implementation.

create(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

createBlobClient(CloudStorageAccount) - Method in class org.apache.hadoop.fs.azure.SecureStorageInterfaceImpl

createBlobClient(URI) - Method in class org.apache.hadoop.fs.azure.SecureStorageInterfaceImpl

createBlobClient(URI, StorageCredentials) - Method in class org.apache.hadoop.fs.azure.SecureStorageInterfaceImpl

createInternal(Path, FsPermission, boolean, SelfRenewingLease) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

This is the version of the create call that is meant for internal usage.

createNonRecursive(Path, FsPermission, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

createNonRecursive(Path, FsPermission, EnumSet<CreateFlag>, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

createNonRecursive(Path, boolean, int, short, long, Progressable) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

currentDownloadBytesPerSecond(long) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Record the current bytes-per-second download rate seen.

currentUploadBytesPerSecond(long) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Record the current bytes-per-second upload rate seen.

D

DEFAULT_AZURE_DELETE_THREADS - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

The default number of threads to be used for delete operation.

DEFAULT_AZURE_RENAME_THREADS - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

The default number of threads to be used for rename operation.

DEFAULT_CONTAINER_SAS_KEY_PERIOD - Static variable in class org.apache.hadoop.fs.azure.SASKeyGeneratorImpl

Default value for the SAS key expiry period in days.

DEFAULT_DOWNLOAD_BLOCK_SIZE - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

DEFAULT_ENABLE_FLAT_LISTING - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Enable flat listing of blobs as default option.

DEFAULT_HADOOP_BLOCK_SIZE - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

DEFAULT_UPLOAD_BLOCK_SIZE - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

DEFAULT_USE_SECURE_MODE - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Default values to control SAS Key mode.

delete(String, SelfRenewingLease) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

API implementation to delete a blob in the back end azure storage.

delete(String) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

API implementation to delete a blob in the back end azure storage.

delete(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Deprecated.

delete(Path, boolean) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

delete(Path, boolean, boolean) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Delete the specified file or folder.

deleteFilesWithDanglingTempData(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Looks under the given root path for any blob that are left "dangling", meaning that they are place-holder blobs that we created while we upload the data to a temporary blob, but for some reason we crashed in the middle of the upload and left them there.

directoryCreated() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Indicate that we just created a directory through WASB.

directoryDeleted() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Indicate that we just deleted a directory through WASB.

DOAS_PARAM - Static variable in class org.apache.hadoop.fs.azure.security.Constants

Parameter to be used for impersonation.

DT_MANAGER_HTTP_CLIENT_RETRY_POLICY_ENABLED_KEY - Static variable in class org.apache.hadoop.fs.azure.security.RemoteWasbDelegationTokenManager

Configuration key to enable http retry policy for delegation token service calls.

DT_MANAGER_HTTP_CLIENT_RETRY_POLICY_SPEC_KEY - Static variable in class org.apache.hadoop.fs.azure.security.RemoteWasbDelegationTokenManager

Configuration key for delegation token service http retry policy spec.

dump() - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

E

ErrorMetricUpdater - Class in org.apache.hadoop.fs.azure.metrics

An event listener to the ResponseReceived event from Azure Storage that will update error metrics appropriately when it gets that event.

eventOccurred(ResponseReceivedEvent) - Method in class org.apache.hadoop.fs.azure.metrics.ErrorMetricUpdater

eventOccurred(ResponseReceivedEvent) - Method in class org.apache.hadoop.fs.azure.metrics.ResponseReceivedMetricUpdater

Handle the response-received event from Azure SDK.

eventOccurred(SendingRequestEvent) - Method in class org.apache.hadoop.fs.azure.SendRequestIntercept

Handler which processes the sending request event from Azure SDK.

execute(FileMetadata) - Method in interface org.apache.hadoop.fs.azure.AzureFileSystemThreadTask

execute() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

Execute a folder rename.

existsInternal(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Checks if a given path exists in the filesystem.

explicitFileExists(String) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Checks whether an explicit file/folder exists.

F

fileCreated() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Indicate that we just created a file through WASB.

fileDeleted() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Indicate that we just deleted a file through WASB.

fileSystemClosed() - Static method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemMetricsSystem

fileSystemStarted() - Static method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemMetricsSystem

finalize() - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

finalize() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

flush() - Method in class org.apache.hadoop.fs.azure.BlockBlobAppendStream

Flushes this output stream and forces any buffered output bytes to be written out.

FolderRenamePending(String, String, SelfRenewingLease, NativeAzureFileSystem) - Constructor for class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

FolderRenamePending(Path, NativeAzureFileSystem) - Constructor for class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

free() - Method in class org.apache.hadoop.fs.azure.SelfRenewingLease

Free the lease and stop the keep-alive thread.

G

get(K) - Method in class org.apache.hadoop.fs.azure.CachingAuthorizer

getAccountKeyFromConfiguration(String, Configuration) - Static method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

getBandwidthGaugeUpdater() - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

getBlockDownloadLatency() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Get the current rolling average of the download latency.

getBlockUploadLatency() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Get the current rolling average of the upload latency.

getCloudBlob() - Method in class org.apache.hadoop.fs.azure.SelfRenewingLease

getConf() - Method in class org.apache.hadoop.fs.azure.SASKeyGeneratorImpl

getContainerReference(String) - Method in class org.apache.hadoop.fs.azure.SecureStorageInterfaceImpl

getContainerSASUri(String, String) - Method in class org.apache.hadoop.fs.azure.LocalSASKeyGeneratorImpl

Implementation to generate SAS Key for a container

getContainerSASUri(String, String) - Method in class org.apache.hadoop.fs.azure.RemoteSASKeyGeneratorImpl

getContainerSASUri(String, String) - Method in interface org.apache.hadoop.fs.azure.SASKeyGeneratorInterface

Interface method to retrieve SAS Key for a container within the storage account.

getCredentials() - Method in class org.apache.hadoop.fs.azure.SecureStorageInterfaceImpl

getCurrentMaximumDownloadBandwidth() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Get the current maximum download bandwidth.

getCurrentMaximumUploadBandwidth() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Get the current maximum upload bandwidth.

getCurrentWebResponses() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Gets the current number of web responses obtained from Azure Storage.

getDelegationToken(String) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Get a delegation token from remote service endpoint if 'fs.azure.enable.kerberos.support' is set to 'true'.

getDelegationToken(String) - Method in class org.apache.hadoop.fs.azure.security.RemoteWasbDelegationTokenManager

getDelegationToken(String) - Method in interface org.apache.hadoop.fs.azure.security.WasbDelegationTokenManager

Get Delegation token

getDstKey() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

getEncodedKey() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

Get the blob name.

getExpiryTime() - Method in class org.apache.hadoop.fs.azure.security.SpnegoToken

getFiles() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

getFileStatus(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

getFileSystemInstanceId() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

The unique identifier for this file system in the metrics.

getFolderLease() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

getHadoopBlockSize() - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Returns the file block size.

getHomeDirectory() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

getHttpRequest(String[], String, List<NameValuePair>, int, String, boolean) - Method in class org.apache.hadoop.fs.azure.SecureWasbRemoteCallHelper

getHttpRequest(String[], String, List<NameValuePair>, int, String, boolean) - Method in class org.apache.hadoop.fs.azure.WasbRemoteCallHelper

getInstrumentation() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Gets the metrics source for this file system.

getKey() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

Get the blob name.

getKind() - Method in class org.apache.hadoop.fs.azure.security.WasbDelegationTokenIdentifier

getLeaseID() - Method in class org.apache.hadoop.fs.azure.SelfRenewingLease

getLinkInFileMetadata(String) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

If the blob with the given key exists and has a link in its metadata to a temporary file (see storeEmptyLinkFile), this method returns the key to that temporary file.

getMetrics(MetricsCollector, boolean) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

getMetricsRegistryInfo() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Get the metrics registry information.

getOutStream() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

Get a reference to the wrapped output stream.

getOutStream() - Method in class org.apache.hadoop.fs.azure.SyncableDataOutputStream

Get a reference to the wrapped output stream.

getOwnerForPath(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

getPathNameWarning() - Method in class org.apache.hadoop.fs.azure.WasbFsck

getRelativeBlobSASUri(String, String, String) - Method in class org.apache.hadoop.fs.azure.LocalSASKeyGeneratorImpl

Implementation for generation of Relative Path Blob SAS Uri.

getRelativeBlobSASUri(String, String, String) - Method in class org.apache.hadoop.fs.azure.RemoteSASKeyGeneratorImpl

getRelativeBlobSASUri(String, String, String) - Method in interface org.apache.hadoop.fs.azure.SASKeyGeneratorInterface

Interface method to retrieve SAS Key for a blob within the container of the storage account.

getSasKeyExpiryPeriod() - Method in class org.apache.hadoop.fs.azure.SASKeyGeneratorImpl

getScheme() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

getScheme() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.Secure

getSourceMetadata() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

getSrcKey() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

getStorageAccountKey(String, Configuration) - Method in interface org.apache.hadoop.fs.azure.KeyProvider

Key providers must implement this method.

getStorageAccountKey(String, Configuration) - Method in class org.apache.hadoop.fs.azure.ShellDecryptionKeyProvider

getStorageAccountKey(String, Configuration) - Method in class org.apache.hadoop.fs.azure.SimpleKeyProvider

getStorageAccountKeyName(String) - Method in class org.apache.hadoop.fs.azure.SimpleKeyProvider

getStore() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

For unit test purposes, retrieves the AzureNativeFileSystemStore store backing this file system.

getThreadPoolExecutor(int, String, String, String, String) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

getToken() - Method in class org.apache.hadoop.fs.azure.security.SpnegoToken

getUri() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

getUriDefaultPort() - Method in class org.apache.hadoop.fs.azure.Wasb

getUriDefaultPort() - Method in class org.apache.hadoop.fs.azure.Wasbs

getWorkingDirectory() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

H

handleKind(Text) - Method in class org.apache.hadoop.fs.azure.security.WasbTokenRenewer

Checks if this particular object handles the Kind of token passed.

hasCapability(String) - Method in class org.apache.hadoop.fs.azure.BlockBlobAppendStream

The Synchronization capabilities of this stream depend upon the compaction policy.

hasCapability(String) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

Propagate probe of stream capabilities to nested stream (if supported), else return false.

hasCapability(String) - Method in class org.apache.hadoop.fs.azure.SyncableDataOutputStream

hflush() - Method in class org.apache.hadoop.fs.azure.BlockBlobAppendStream

Force all data in the output stream to be written to Azure storage.

hflush() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

hflush() - Method in class org.apache.hadoop.fs.azure.SyncableDataOutputStream

hook(OperationContext, AzureFileSystemInstrumentation) - Static method in class org.apache.hadoop.fs.azure.metrics.ErrorMetricUpdater

Hooks a new listener to the given operationContext that will update the error metrics for the WASB file system appropriately in response to ResponseReceived events.

hook(OperationContext, AzureFileSystemInstrumentation, BandwidthGaugeUpdater) - Static method in class org.apache.hadoop.fs.azure.metrics.ResponseReceivedMetricUpdater

Hooks a new listener to the given operationContext that will update the metrics for the WASB file system appropriately in response to ResponseReceived events.

hook(OperationContext, float, float) - Static method in class org.apache.hadoop.fs.azure.SelfThrottlingIntercept

hsync() - Method in class org.apache.hadoop.fs.azure.BlockBlobAppendStream

Force all data in the output stream to be written to Azure storage.

hsync() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

hsync() - Method in class org.apache.hadoop.fs.azure.SyncableDataOutputStream

I

init(Configuration) - Method in class org.apache.hadoop.fs.azure.CachingAuthorizer

init(Configuration) - Method in class org.apache.hadoop.fs.azure.RemoteWasbAuthorizerImpl

init(Configuration) - Method in interface org.apache.hadoop.fs.azure.WasbAuthorizerInterface

Initializer method

initialize(URI, Configuration, AzureFileSystemInstrumentation) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Method for the URI and configuration object necessary to create a storage session with an Azure session.

initialize(URI, Configuration) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

initialize(Configuration) - Method in class org.apache.hadoop.fs.azure.RemoteSASKeyGeneratorImpl

isAtomicRenameKey(String) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Checks if the given key in Azure storage should have synchronized atomic folder rename createNonRecursive implemented.

isBlockBlobWithCompactionKey(String) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Checks if the given key in Azure Storage should be stored as a block blobs with compaction enabled instead of normal block blob.

isEmpty() - Method in class org.apache.hadoop.fs.azure.AzureLinkedStack

isFreed() - Method in class org.apache.hadoop.fs.azure.SelfRenewingLease

isKeyForDirectorySet(String, Set<String>) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

isManaged(Token<?>) - Method in class org.apache.hadoop.fs.azure.security.WasbTokenRenewer

Checks if passed token is managed.

isPageBlobKey(String) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Checks if the given key in Azure Storage should be stored as a page blob instead of block blob.

isTokenValid() - Method in class org.apache.hadoop.fs.azure.security.SpnegoToken

J

JsonUtils - Class in org.apache.hadoop.fs.azure.security

Utility class to parse JSON.

K

KEY_ACCOUNT_KEY_PREFIX - Static variable in class org.apache.hadoop.fs.azure.SimpleKeyProvider

KEY_ATOMIC_RENAME_DIRECTORIES - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Configuration key to indicate the set of directories in WASB where we should do atomic folder rename synchronized with createNonRecursive.

KEY_AUTH_SERVICE_CACHING_ENABLE - Static variable in class org.apache.hadoop.fs.azure.CachingAuthorizer

KEY_AUTH_SERVICE_CACHING_ENABLE_DEFAULT - Static variable in class org.apache.hadoop.fs.azure.CachingAuthorizer

KEY_AUTH_SERVICE_CACHING_MAX_ENTRIES - Static variable in class org.apache.hadoop.fs.azure.CachingAuthorizer

KEY_AUTH_SERVICE_CACHING_MAX_ENTRIES_DEFAULT - Static variable in class org.apache.hadoop.fs.azure.CachingAuthorizer

KEY_AZURE_AUTHORIZATION - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Configuration key to enable authorization support in WASB.

KEY_BLOCK_BLOB_WITH_COMPACTION_DIRECTORIES - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Configuration key to indicate the set of directories in WASB where we should store files as block blobs with block compaction enabled.

KEY_CRED_SERVICE_URLS - Static variable in class org.apache.hadoop.fs.azure.RemoteSASKeyGeneratorImpl

Configuration parameter name expected in the Configuration object to provide the url of the remote service "fs.azure.cred.service.urls"

KEY_DELEGATION_TOKEN_SERVICE_URLS - Static variable in class org.apache.hadoop.fs.azure.security.RemoteWasbDelegationTokenManager

Configuration parameter name expected in the configuration object to provide the url of the delegation token service to fetch the delegation tokens.

KEY_ENABLE_FLAT_LISTING - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Configuration key to enable flat listing of blobs.

KEY_PAGE_BLOB_DIRECTORIES - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Configuration key to indicate the set of directories in WASB where we should store files as page blobs instead of block blobs.

KEY_REMOTE_AUTH_SERVICE_URLS - Static variable in class org.apache.hadoop.fs.azure.RemoteWasbAuthorizerImpl

Configuration parameter name expected in the Configuration object to provide the urls of the remote service instances.

KEY_SAS_KEY_EXPIRY_PERIOD - Static variable in class org.apache.hadoop.fs.azure.SASKeyGeneratorImpl

Configuration key to be used to specify the expiry period for SAS keys This value currently is specified in days.

KEY_USE_CONTAINER_SASKEY_FOR_ALL_ACCESS - Static variable in class org.apache.hadoop.fs.azure.SecureStorageInterfaceImpl

Configuration key to specify if containerSasKey should be used for all accesses

KEY_USE_LOCAL_SAS_KEY_MODE - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

By default the SAS Key mode is expected to run in Romote key mode.

KEY_USE_SECURE_MODE - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Configuration keys to identify if WASB needs to run in Secure mode.

KeyProvider - Interface in org.apache.hadoop.fs.azure

The interface that every Azure file system key provider must implement.

KeyProviderException - Exception in org.apache.hadoop.fs.azure

Thrown if there is a problem instantiating a KeyProvider or retrieving a key using a KeyProvider object.

KeyProviderException(String) - Constructor for exception org.apache.hadoop.fs.azure.KeyProviderException

KeyProviderException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.azure.KeyProviderException

KeyProviderException(Throwable) - Constructor for exception org.apache.hadoop.fs.azure.KeyProviderException

L

LEASE_RENEWAL_PERIOD - Static variable in class org.apache.hadoop.fs.azure.SelfRenewingLease

list(String, int, int) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

listStatus(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Retrieve the status of a given path if it is a file, or of all the contained files if it is a directory.

LocalSASKeyGeneratorImpl - Class in org.apache.hadoop.fs.azure

Local SAS Key Generation implementation.

LocalSASKeyGeneratorImpl(Configuration) - Constructor for class org.apache.hadoop.fs.azure.LocalSASKeyGeneratorImpl

LOG - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

LOG - Static variable in class org.apache.hadoop.fs.azure.CachingAuthorizer

LOG - Static variable in class org.apache.hadoop.fs.azure.metrics.BandwidthGaugeUpdater

LOG - Static variable in class org.apache.hadoop.fs.azure.metrics.ResponseReceivedMetricUpdater

LOG - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

LOG - Static variable in class org.apache.hadoop.fs.azure.RemoteSASKeyGeneratorImpl

LOG - Static variable in class org.apache.hadoop.fs.azure.RemoteWasbAuthorizerImpl

LOG - Static variable in class org.apache.hadoop.fs.azure.SecureStorageInterfaceImpl

LOG - Static variable in class org.apache.hadoop.fs.azure.SecureWasbRemoteCallHelper

LOG - Static variable in class org.apache.hadoop.fs.azure.security.JsonUtils

LOG - Static variable in class org.apache.hadoop.fs.azure.security.TokenUtils

LOG - Static variable in class org.apache.hadoop.fs.azure.security.WasbTokenRenewer

LOG - Static variable in class org.apache.hadoop.fs.azure.SelfThrottlingIntercept

LOG - Static variable in class org.apache.hadoop.fs.azure.SendRequestIntercept

LOG - Static variable in class org.apache.hadoop.fs.azure.WasbRemoteCallHelper

M

main(String[]) - Static method in class org.apache.hadoop.fs.azure.WasbFsck

makeAbsolute(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Get the absolute version of the path (fully qualified).

makeRemoteRequest(String[], String, List<NameValuePair>, String) - Method in class org.apache.hadoop.fs.azure.SecureWasbRemoteCallHelper

makeRemoteRequest(String[], String, List<NameValuePair>, String) - Method in class org.apache.hadoop.fs.azure.WasbRemoteCallHelper

Helper method to make remote HTTP Get request.

makeRenamePendingFileContents() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

Return the contents of the JSON file to represent the operations to be performed for a folder rename.

METRIC_TAG_ACCOUNT_NAME - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

METRIC_TAG_CONTAINTER_NAME - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

METRIC_TAG_FILESYSTEM_ID - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

mkdirs(Path, FsPermission) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

mkdirs(Path, FsPermission, boolean) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

N

NativeAzureFileSystem - Class in org.apache.hadoop.fs.azure

A FileSystem for reading and writing files stored on Windows Azure.

NativeAzureFileSystem() - Constructor for class org.apache.hadoop.fs.azure.NativeAzureFileSystem

NativeAzureFileSystem(NativeFileSystemStore) - Constructor for class org.apache.hadoop.fs.azure.NativeAzureFileSystem

NativeAzureFileSystem.FolderRenamePending - Class in org.apache.hadoop.fs.azure

A description of a folder rename operation, including the source and destination keys, and descriptions of the files in the source folder.

NativeAzureFileSystem.NativeAzureFsOutputStream - Class in org.apache.hadoop.fs.azure

Azure output stream; wraps an inner stream of different types.

NativeAzureFileSystem.Secure - Class in org.apache.hadoop.fs.azure

A FileSystem for reading and writing files stored on Windows Azure.

NativeAzureFsOutputStream(OutputStream, String, String) - Constructor for class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

newMetricsSourceName() - Static method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Creates a new metrics source name that's unique within this process.

NO_ACCESS_TO_CONTAINER_MSG - Static variable in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

The error message template when container is not accessible.

O

open(Path, int) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

org.apache.hadoop.fs.azure - package org.apache.hadoop.fs.azure

A distributed implementation of FileSystem for reading and writing files on Azure Block Storage.

org.apache.hadoop.fs.azure.metrics - package org.apache.hadoop.fs.azure.metrics

Infrastructure for a Metrics2 source that provides information on Windows Azure Filesystem for Hadoop instances.

org.apache.hadoop.fs.azure.security - package org.apache.hadoop.fs.azure.security

P

parse(String) - Static method in class org.apache.hadoop.fs.azure.security.JsonUtils

pathToKey(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Convert the path to a key.

peek() - Method in class org.apache.hadoop.fs.azure.AzureLinkedStack

pop() - Method in class org.apache.hadoop.fs.azure.AzureLinkedStack

purge(String) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

push(E) - Method in class org.apache.hadoop.fs.azure.AzureLinkedStack

put(K, V) - Method in class org.apache.hadoop.fs.azure.CachingAuthorizer

R

rawBytesDownloaded(long) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Indicate that we just downloaded some data to Azure storage.

rawBytesUploaded(long) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Indicate that we just uploaded some data to Azure storage.

recoverFilesWithDanglingTempData(Path, Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Looks under the given root path for any blob that are left "dangling", meaning that they are place-holder blobs that we created while we upload the data to a temporary blob, but for some reason we crashed in the middle of the upload and left them there.

redo() - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

Recover from a folder rename failure by redoing the intended work, as recorded in the -RenamePending.json file.

registerSource(String, String, MetricsSource) - Static method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemMetricsSystem

REMOTE_CALL_SUCCESS_CODE - Static variable in class org.apache.hadoop.fs.azure.WasbRemoteCallHelper

Return code when the remote call is successful.

RemoteSASKeyGeneratorImpl - Class in org.apache.hadoop.fs.azure

Class implementing a RemoteSASKeyGenerator.

RemoteSASKeyGeneratorImpl(Configuration) - Constructor for class org.apache.hadoop.fs.azure.RemoteSASKeyGeneratorImpl

RemoteWasbAuthorizerImpl - Class in org.apache.hadoop.fs.azure

Class implementing WasbAuthorizerInterface using a remote service that implements the authorization operation.

RemoteWasbAuthorizerImpl() - Constructor for class org.apache.hadoop.fs.azure.RemoteWasbAuthorizerImpl

RemoteWasbDelegationTokenManager - Class in org.apache.hadoop.fs.azure.security

Class to manage delegation token operations by making rest call to remote service.

RemoteWasbDelegationTokenManager(Configuration) - Constructor for class org.apache.hadoop.fs.azure.security.RemoteWasbDelegationTokenManager

rename(String, String) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

rename(String, String, boolean, SelfRenewingLease) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

rename(String, String, boolean, SelfRenewingLease, boolean) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

rename(Path, Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

renew(Token<?>, Configuration) - Method in class org.apache.hadoop.fs.azure.security.WasbTokenRenewer

Renew the delegation token.

renewDelegationToken(Token<?>) - Method in class org.apache.hadoop.fs.azure.security.RemoteWasbDelegationTokenManager

renewDelegationToken(Token<?>) - Method in interface org.apache.hadoop.fs.azure.security.WasbDelegationTokenManager

Renew the delegation token

responseReceived(ResponseReceivedEvent) - Method in class org.apache.hadoop.fs.azure.SelfThrottlingIntercept

ResponseReceivedMetricUpdater - Class in org.apache.hadoop.fs.azure.metrics

An event listener to the ResponseReceived event from Azure Storage that will update metrics appropriately when it gets that event.

resumeAutoUpdate() - Method in class org.apache.hadoop.fs.azure.metrics.BandwidthGaugeUpdater

Resumes auto-update (undo suppressAutoUpdate).

retrieve(String) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

retrieve(String, long) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

retrieveAppendStream(String, int) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

retrieveMetadata(String) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

retryableRequest(String[], String, List<NameValuePair>, String) - Method in class org.apache.hadoop.fs.azure.WasbRemoteCallHelper

run(String[]) - Method in class org.apache.hadoop.fs.azure.WasbFsck

S

SAS_ERROR_CODE - Static variable in class org.apache.hadoop.fs.azure.SecureStorageInterfaceImpl

SAS_KEY_GENERATOR_HTTP_CLIENT_RETRY_POLICY_ENABLED_KEY - Static variable in class org.apache.hadoop.fs.azure.RemoteSASKeyGeneratorImpl

Configuration key to enable http retry policy for SAS Key generation.

SAS_KEY_GENERATOR_HTTP_CLIENT_RETRY_POLICY_SPEC_KEY - Static variable in class org.apache.hadoop.fs.azure.RemoteSASKeyGeneratorImpl

Configuration key for SAS Key Generation http retry policy spec.

SASKeyGenerationException - Exception in org.apache.hadoop.fs.azure

Exception that gets thrown during generation of SAS Key.

SASKeyGenerationException(String) - Constructor for exception org.apache.hadoop.fs.azure.SASKeyGenerationException

SASKeyGenerationException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.azure.SASKeyGenerationException

SASKeyGenerationException(Throwable) - Constructor for exception org.apache.hadoop.fs.azure.SASKeyGenerationException

SASKeyGeneratorImpl - Class in org.apache.hadoop.fs.azure

Abstract base class for the SAS Key Generator implementation

SASKeyGeneratorImpl(Configuration) - Constructor for class org.apache.hadoop.fs.azure.SASKeyGeneratorImpl

SASKeyGeneratorInterface - Interface in org.apache.hadoop.fs.azure

Iterface used by AzureNativeFileSysteStore to retrieve SAS Keys for the respective azure storage entity.

Secure() - Constructor for class org.apache.hadoop.fs.azure.NativeAzureFileSystem.Secure

SecureModeException - Exception in org.apache.hadoop.fs.azure

Exception that is thrown when any error is encountered is SAS Mode operation of WASB.

SecureModeException(String) - Constructor for exception org.apache.hadoop.fs.azure.SecureModeException

SecureModeException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.azure.SecureModeException

SecureModeException(Throwable) - Constructor for exception org.apache.hadoop.fs.azure.SecureModeException

SecureStorageInterfaceImpl - Class in org.apache.hadoop.fs.azure

An implementation of the StorageInterface for SAS Key mode.

SecureStorageInterfaceImpl(boolean, Configuration) - Constructor for class org.apache.hadoop.fs.azure.SecureStorageInterfaceImpl

SecureWasbRemoteCallHelper - Class in org.apache.hadoop.fs.azure

Helper class the has constants and helper methods used in WASB when integrating with a remote http cred service which uses Kerberos and delegation tokens.

SecureWasbRemoteCallHelper(RetryPolicy, boolean, boolean) - Constructor for class org.apache.hadoop.fs.azure.SecureWasbRemoteCallHelper

SelfRenewingLease - Class in org.apache.hadoop.fs.azure

An Azure blob lease that automatically renews itself indefinitely using a background thread.

SelfRenewingLease(StorageInterface.CloudBlobWrapper, boolean) - Constructor for class org.apache.hadoop.fs.azure.SelfRenewingLease

SelfThrottlingIntercept - Class in org.apache.hadoop.fs.azure

Introduces delays in our Azure traffic to prevent overrunning the server-side throttling limits.

SelfThrottlingIntercept(OperationContext, float, float) - Constructor for class org.apache.hadoop.fs.azure.SelfThrottlingIntercept

sendingRequest(SendingRequestEvent) - Method in class org.apache.hadoop.fs.azure.SelfThrottlingIntercept

SendRequestIntercept - Class in org.apache.hadoop.fs.azure

Manages the lifetime of binding on the operation contexts to intercept send request events to Azure storage and allow concurrent OOB I/Os.

serverErrorEncountered() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Indicate that we just encountered a server-caused error.

setAccountName(String) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Sets the account name to tag all the metrics with.

setContainerName(String) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Sets the container name to tag all the metrics with.

setEncodedKey(String) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

Set the blob name.

setKey(String) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

Set the blob name.

setMockFileSystemForTesting(FileSystem) - Method in class org.apache.hadoop.fs.azure.WasbFsck

For testing purposes, set the file system to use here instead of relying on getting it from the FileSystem class based on the URI.

setOwner(Path, String, String) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

setPermission(Path, FsPermission) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

setRetryPolicyFactory(RetryPolicyFactory) - Method in class org.apache.hadoop.fs.azure.SecureStorageInterfaceImpl

setStorageAccountName(String) - Method in class org.apache.hadoop.fs.azure.SecureStorageInterfaceImpl

setTimeoutInMs(int) - Method in class org.apache.hadoop.fs.azure.SecureStorageInterfaceImpl

setWorkingDirectory(Path) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

Set the working directory to the given directory.

ShellDecryptionKeyProvider - Class in org.apache.hadoop.fs.azure

Shell decryption key provider which invokes an external script that will perform the key decryption.

ShellDecryptionKeyProvider() - Constructor for class org.apache.hadoop.fs.azure.ShellDecryptionKeyProvider

SimpleKeyProvider - Class in org.apache.hadoop.fs.azure

Key provider that simply returns the storage account key from the configuration as plaintext.

SimpleKeyProvider() - Constructor for class org.apache.hadoop.fs.azure.SimpleKeyProvider

size() - Method in class org.apache.hadoop.fs.azure.AzureLinkedStack

SKIP_AZURE_METRICS_PROPERTY_NAME - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

SpnegoToken - Class in org.apache.hadoop.fs.azure.security

Class to represent SPNEGO token.

SpnegoToken(AuthenticatedURL.Token) - Constructor for class org.apache.hadoop.fs.azure.security.SpnegoToken

storeEmptyFolder(String, PermissionStatus) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

storeEmptyLinkFile(String, String, PermissionStatus) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

Stores an empty blob that's linking to the temporary file where're we're uploading the initial data.

storefile(String, PermissionStatus, String) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

SUFFIX - Static variable in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

suppressAutoUpdate() - Method in class org.apache.hadoop.fs.azure.metrics.BandwidthGaugeUpdater

For unit test purposes, suppresses auto-update of the metrics from the dedicated thread.

SyncableDataOutputStream - Class in org.apache.hadoop.fs.azure

Support the Syncable interface on top of a DataOutputStream.

SyncableDataOutputStream(OutputStream) - Constructor for class org.apache.hadoop.fs.azure.SyncableDataOutputStream

T

THREAD_NAME - Static variable in class org.apache.hadoop.fs.azure.metrics.BandwidthGaugeUpdater

toDelegationToken(Map<?, ?>) - Static method in class org.apache.hadoop.fs.azure.security.TokenUtils

TOKEN_KIND - Static variable in class org.apache.hadoop.fs.azure.security.WasbDelegationTokenIdentifier

TokenUtils - Class in org.apache.hadoop.fs.azure.security

Utility methods common for token management

toString() - Method in class org.apache.hadoop.fs.azure.AzureLinkedStack

toString() - Method in enum org.apache.hadoop.fs.azure.WasbAuthorizationOperations

toToken(Map<?, ?>) - Static method in class org.apache.hadoop.fs.azure.security.TokenUtils

triggerUpdate(boolean) - Method in class org.apache.hadoop.fs.azure.metrics.BandwidthGaugeUpdater

Triggers the update of the metrics gauge based on all the blocks uploaded/downloaded so far.

U

unregisterSource(String) - Static method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemMetricsSystem

updateBytesReadInLastSecond(long) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Sets the current gauge value for how many bytes were read in the last second.

updateBytesWrittenInLastSecond(long) - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Sets the current gauge value for how many bytes were written in the last second.

updateFolderLastModifiedTime(String, Date, SelfRenewingLease) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

updateFolderLastModifiedTime(String, SelfRenewingLease) - Method in class org.apache.hadoop.fs.azure.AzureNativeFileSystemStore

updateHttpClient(HttpClient) - Method in class org.apache.hadoop.fs.azure.WasbRemoteCallHelper

updateWasbAuthorizer(WasbAuthorizerInterface) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem

updateWasbRemoteCallHelper(WasbRemoteCallHelper) - Method in class org.apache.hadoop.fs.azure.RemoteWasbAuthorizerImpl

URL_STRING - Static variable in class org.apache.hadoop.fs.azure.security.TokenUtils

V

valueOf(String) - Static method in enum org.apache.hadoop.fs.azure.WasbAuthorizationOperations

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.hadoop.fs.azure.WasbAuthorizationOperations

Returns an array containing the constants of this enum type, in the order they are declared.

W

Wasb - Class in org.apache.hadoop.fs.azure

WASB implementation of AbstractFileSystem.

WASB_BYTES_READ - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_BYTES_WRITTEN - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_CLIENT_ERRORS - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_DIRECTORIES_CREATED - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_DIRECTORIES_DELETED - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_DOWNLOAD_LATENCY - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_DOWNLOAD_RATE - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_FILES_CREATED - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_FILES_DELETED - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_RAW_BYTES_DOWNLOADED - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_RAW_BYTES_UPLOADED - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_SERVER_ERRORS - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_UPLOAD_LATENCY - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_UPLOAD_RATE - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WASB_WEB_RESPONSES - Static variable in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

WasbAuthorizationException - Exception in org.apache.hadoop.fs.azure

Exception that gets thrown during the authorization failures in WASB.

WasbAuthorizationException(String) - Constructor for exception org.apache.hadoop.fs.azure.WasbAuthorizationException

WasbAuthorizationException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.azure.WasbAuthorizationException

WasbAuthorizationException(Throwable) - Constructor for exception org.apache.hadoop.fs.azure.WasbAuthorizationException

WasbAuthorizationOperations - Enum in org.apache.hadoop.fs.azure

Different authorization operations supported in WASB.

WasbAuthorizerInterface - Interface in org.apache.hadoop.fs.azure

Interface to implement authorization support in WASB.

WasbDelegationTokenIdentifier - Class in org.apache.hadoop.fs.azure.security

Delegation token Identifier for WASB delegation tokens.

WasbDelegationTokenIdentifier() - Constructor for class org.apache.hadoop.fs.azure.security.WasbDelegationTokenIdentifier

WasbDelegationTokenIdentifier(Text) - Constructor for class org.apache.hadoop.fs.azure.security.WasbDelegationTokenIdentifier

WasbDelegationTokenIdentifier(Text, Text, Text, Text) - Constructor for class org.apache.hadoop.fs.azure.security.WasbDelegationTokenIdentifier

WasbDelegationTokenManager - Interface in org.apache.hadoop.fs.azure.security

Interface for Managing the Delegation tokens.

WasbFsck - Class in org.apache.hadoop.fs.azure

An fsck tool implementation for WASB that does various admin/cleanup/recovery tasks on the WASB file system.

WasbFsck(Configuration) - Constructor for class org.apache.hadoop.fs.azure.WasbFsck

WasbRemoteCallException - Exception in org.apache.hadoop.fs.azure

Exception that gets thrown when a remote call made from WASB to external cred service fails.

WasbRemoteCallException(String) - Constructor for exception org.apache.hadoop.fs.azure.WasbRemoteCallException

WasbRemoteCallException(String, Throwable) - Constructor for exception org.apache.hadoop.fs.azure.WasbRemoteCallException

WasbRemoteCallException(Throwable) - Constructor for exception org.apache.hadoop.fs.azure.WasbRemoteCallException

WasbRemoteCallHelper - Class in org.apache.hadoop.fs.azure

Helper class the has constants and helper methods used in WASB when integrating with a remote http cred service.

WasbRemoteCallHelper(RetryPolicy) - Constructor for class org.apache.hadoop.fs.azure.WasbRemoteCallHelper

Wasbs - Class in org.apache.hadoop.fs.azure

WASB implementation of AbstractFileSystem for wasbs scheme.

WasbTokenRenewer - Class in org.apache.hadoop.fs.azure.security

Token Renewer for renewing WASB delegation tokens with remote service.

WasbTokenRenewer() - Constructor for class org.apache.hadoop.fs.azure.security.WasbTokenRenewer

webResponse() - Method in class org.apache.hadoop.fs.azure.metrics.AzureFileSystemInstrumentation

Indicate that we just got a web response from Azure Storage.

write(int) - Method in class org.apache.hadoop.fs.azure.BlockBlobAppendStream

Writes the specified byte to this output stream.

write(byte[], int, int) - Method in class org.apache.hadoop.fs.azure.BlockBlobAppendStream

Writes length bytes from the specified byte array starting at offset to this output stream.

write(int) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

Writes the specified byte to this output stream.

write(byte[]) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

Writes b.length bytes from the specified byte array to this output stream.

write(byte[], int, int) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.NativeAzureFsOutputStream

Writes len from the specified byte array starting at offset off to the output stream.

writeFile(NativeAzureFileSystem) - Method in class org.apache.hadoop.fs.azure.NativeAzureFileSystem.FolderRenamePending

Write to disk the information needed to redo folder rename, in JSON format.

A B C D E F G H I J K L M N O P R S T U V W