org.apache.iotdb.hadoop.tsfile

类 TSFInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.MapWritable>

org.apache.iotdb.hadoop.tsfile.TSFInputFormat

public class TSFInputFormat
extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.MapWritable>

嵌套类概要

从类继承的嵌套类/接口 org.apache.hadoop.mapreduce.lib.input.FileInputFormat

org.apache.hadoop.mapreduce.lib.input.FileInputFormat.Counter

字段概要

字段

限定符和类型	字段和说明
static String	FILTER_EXIST key to configure whether filtering is enable
static String	FILTER_EXPRESSION 已过时。
static String	FILTER_TYPE 已过时。
static String	READ_DELTAOBJECT_ENABLE key to configure whether reading deltaObjectId enable
static String	READ_DELTAOBJECTS key to configure the reading deltaObjectIds
static String	READ_MEASUREMENTID key to configure the reading measurementIds
static String	READ_TIME_ENABLE key to configure whether reading time enable

从类继承的字段 org.apache.hadoop.mapreduce.lib.input.FileInputFormat

DEFAULT_LIST_STATUS_NUM_THREADS, INPUT_DIR, INPUT_DIR_RECURSIVE, LIST_STATUS_NUM_THREADS, NUM_INPUT_FILES, PATHFILTER_CLASS, SPLIT_MAXSIZE, SPLIT_MINSIZE

构造器概要

构造器

构造器和说明
TSFInputFormat()

方法概要

限定符和类型	方法和说明
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.MapWritable>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
static String	getFilterExp(org.apache.hadoop.conf.Configuration configuration) 已过时。
static String	getFilterType(org.apache.hadoop.conf.Configuration configuration) 已过时。
static boolean	getHasFilter(org.apache.hadoop.conf.Configuration configuration) 已过时。
static boolean	getReadDeviceId(org.apache.hadoop.conf.Configuration configuration)
static List<String>	getReadDeviceIds(org.apache.hadoop.conf.Configuration configuration) Get the deltaObjectIds which want to be read
static List<String>	getReadMeasurementIds(org.apache.hadoop.conf.Configuration configuration) Get the measurementIds which want to be read
static boolean	getReadTime(org.apache.hadoop.conf.Configuration configuration)
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext job)
static List<TSFInputSplit>	getTSFInputSplit(org.apache.hadoop.conf.Configuration configuration, List<org.apache.hadoop.fs.FileStatus> listFileStatus, org.slf4j.Logger logger)
static void	setFilterExp(org.apache.hadoop.mapreduce.Job job, String value) 已过时。
static void	setFilterType(org.apache.hadoop.mapreduce.Job job, String value) 已过时。
static void	setHasFilter(org.apache.hadoop.mapreduce.Job job, boolean value) 已过时。
static void	setReadDeviceId(org.apache.hadoop.mapreduce.Job job, boolean value)
static void	setReadDeviceIds(org.apache.hadoop.mapreduce.Job job, String[] value) Set the deltaObjectIds which want to be read
static void	setReadMeasurementIds(org.apache.hadoop.mapreduce.Job job, String[] value) Set the measurementIds which want to be read
static void	setReadTime(org.apache.hadoop.mapreduce.Job job, boolean value)

从类继承的方法 org.apache.hadoop.mapreduce.lib.input.FileInputFormat

addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputDirRecursive, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, isSplitable, listStatus, makeSplit, makeSplit, setInputDirRecursive, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

READ_TIME_ENABLE

public static final String READ_TIME_ENABLE

key to configure whether reading time enable

另请参阅:

常量字段值

READ_DELTAOBJECT_ENABLE

public static final String READ_DELTAOBJECT_ENABLE

key to configure whether reading deltaObjectId enable

另请参阅:

常量字段值

FILTER_TYPE

@Deprecated
public static final String FILTER_TYPE

已过时。

key to configure the type of filter

另请参阅:

常量字段值

FILTER_EXPRESSION

@Deprecated
public static final String FILTER_EXPRESSION

已过时。

key to configure the filter

另请参阅:

常量字段值

FILTER_EXIST

public static final String FILTER_EXIST

key to configure whether filtering is enable

另请参阅:

常量字段值

READ_DELTAOBJECTS

public static final String READ_DELTAOBJECTS

key to configure the reading deltaObjectIds

另请参阅:

常量字段值

READ_MEASUREMENTID

public static final String READ_MEASUREMENTID

key to configure the reading measurementIds

另请参阅:

常量字段值

构造器详细资料

TSFInputFormat

public TSFInputFormat()

方法详细资料

setReadDeviceIds

public static void setReadDeviceIds(org.apache.hadoop.mapreduce.Job job,
                                    String[] value)
                             throws TSFHadoopException

Set the deltaObjectIds which want to be read

参数:

job - hadoop job

value - the deltaObjectIds will be read

抛出:

TSFHadoopException

getReadDeviceIds

public static List<String> getReadDeviceIds(org.apache.hadoop.conf.Configuration configuration)

Get the deltaObjectIds which want to be read

参数:

configuration -

返回:

List of device, if configuration has been set the deviceIds. null, if configuration has not been set the deviceIds.

setReadMeasurementIds

public static void setReadMeasurementIds(org.apache.hadoop.mapreduce.Job job,
                                         String[] value)
                                  throws TSFHadoopException

Set the measurementIds which want to be read

参数:

job - hadoop job

value - the measurementIds will be read

抛出:

TSFHadoopException

getReadMeasurementIds

public static List<String> getReadMeasurementIds(org.apache.hadoop.conf.Configuration configuration)

Get the measurementIds which want to be read

参数:

configuration - hadoop configuration

返回:

if not set the measurementIds, return null

setReadDeviceId

public static void setReadDeviceId(org.apache.hadoop.mapreduce.Job job,
                                   boolean value)

参数:

job -

value -

getReadDeviceId

public static boolean getReadDeviceId(org.apache.hadoop.conf.Configuration configuration)

参数:

configuration -

返回:

setReadTime

public static void setReadTime(org.apache.hadoop.mapreduce.Job job,
                               boolean value)

参数:

job -

value -

getReadTime

public static boolean getReadTime(org.apache.hadoop.conf.Configuration configuration)

setHasFilter

@Deprecated
public static void setHasFilter(org.apache.hadoop.mapreduce.Job job,
                                            boolean value)

已过时。

Set filter exist or not

参数:

job -

value -

getHasFilter

@Deprecated
public static boolean getHasFilter(org.apache.hadoop.conf.Configuration configuration)

已过时。

Get filter exist or not

参数:

configuration -

返回:

setFilterType

@Deprecated
public static void setFilterType(org.apache.hadoop.mapreduce.Job job,
                                             String value)

已过时。

参数:

job -

value -

getFilterType

@Deprecated
public static String getFilterType(org.apache.hadoop.conf.Configuration configuration)

已过时。

Get the filter type

参数:

configuration -

返回:

setFilterExp

@Deprecated
public static void setFilterExp(org.apache.hadoop.mapreduce.Job job,
                                            String value)

已过时。

getFilterExp

@Deprecated
public static String getFilterExp(org.apache.hadoop.conf.Configuration configuration)

已过时。

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.MapWritable> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                                                       org.apache.hadoop.mapreduce.TaskAttemptContext context)

指定者:

createRecordReader 在类中 org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.MapWritable>

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext job)
                                                       throws IOException

覆盖:

getSplits 在类中 org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.MapWritable>

抛出:

IOException

getTSFInputSplit

public static List<TSFInputSplit> getTSFInputSplit(org.apache.hadoop.conf.Configuration configuration,
                                                   List<org.apache.hadoop.fs.FileStatus> listFileStatus,
                                                   org.slf4j.Logger logger)
                                            throws IOException

抛出:

IOException