org.apache.hadoop.hbase.wal

Class BoundedRecoveredHFilesOutputSink

java.lang.Object

org.apache.hadoop.hbase.wal.BoundedRecoveredHFilesOutputSink

@InterfaceAudience.Private
public class BoundedRecoveredHFilesOutputSink
extends Object

A WALSplitter sink that outputs HFiles. Runs with a bounded number of HFile writers at any one time rather than let the count run up.

See Also:

for a sink implementation that writes intermediate recovered.edits files.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	OutputSink.WriterThread

Field Summary

Fields

Modifier and Type	Field and Description
protected CompletionService<Void>	closeCompletionService
protected ThreadPoolExecutor	closeThreadPool Used when close this output sink.
protected org.apache.hadoop.hbase.wal.EntryBuffers	entryBuffers
protected int	numThreads
protected CancelableProgressable	reporter
protected List<org.apache.hadoop.fs.Path>	splits List of all the files produced by this sink
protected MonitoredTask	status
protected AtomicLong	totalSkippedEdits

Constructor Summary

Constructors

Constructor and Description
BoundedRecoveredHFilesOutputSink(WALSplitter walSplitter, WALSplitter.PipelineController controller, org.apache.hadoop.hbase.wal.EntryBuffers entryBuffers, int numWriters)

Method Summary

Modifier and Type	Method and Description
List<org.apache.hadoop.fs.Path>	close()
int	getNumberOfRecoveredRegions()
Map<String,Long>	getOutputCounts()
protected void	updateStatusWithMsg(String msg) Set status message in MonitoredTask instance that is set in this OutputSink

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

entryBuffers

protected final org.apache.hadoop.hbase.wal.EntryBuffers entryBuffers

numThreads

protected final int numThreads

reporter

protected CancelableProgressable reporter

totalSkippedEdits

protected final AtomicLong totalSkippedEdits

splits

protected final List<org.apache.hadoop.fs.Path> splits

List of all the files produced by this sink

status

protected MonitoredTask status

closeThreadPool

protected final ThreadPoolExecutor closeThreadPool

Used when close this output sink.

closeCompletionService

protected final CompletionService<Void> closeCompletionService

Constructor Detail

BoundedRecoveredHFilesOutputSink

public BoundedRecoveredHFilesOutputSink(WALSplitter walSplitter,
                                        WALSplitter.PipelineController controller,
                                        org.apache.hadoop.hbase.wal.EntryBuffers entryBuffers,
                                        int numWriters)

Method Detail

close

public List<org.apache.hadoop.fs.Path> close()
                                      throws IOException

Throws:

IOException

getOutputCounts

public Map<String,Long> getOutputCounts()

Returns:

a map from encoded region ID to the number of edits written out for that region.

getNumberOfRecoveredRegions

public int getNumberOfRecoveredRegions()

Returns:

number of regions we've recovered

updateStatusWithMsg

protected final void updateStatusWithMsg(String msg)

Set status message in MonitoredTask instance that is set in this OutputSink

Parameters:

msg - message to update the status with