| Package | Description |
|---|---|
| com.aliyun.odps.conf |
Odps配置
|
| com.aliyun.odps.counter |
用于获取任务运行时统计数据的计数器
|
| com.aliyun.odps.io |
ODPS中使用的Writable数据类型,目前只有Graph作业需要使用
|
| com.aliyun.odps.utils |
Undocumented
|
| Modifier and Type | Class and Description |
|---|---|
class |
Configuration
配置类,提供读取和设置配置参数的方法.
|
| Modifier and Type | Class and Description |
|---|---|
class |
Counter
Counter计数器,可以自定义Counter,用于统计计数,例如统计脏数据记录个数.
|
class |
CounterGroup
Counter 组,由多个
Counter 计数器组成. |
class |
Counters
Counters 由多个
CounterGroup 组成,保存了所有的 Counter 的信息. |
| Modifier and Type | Interface and Description |
|---|---|
interface |
InputBlobWritable
InputBlobWritable表示ODPS表或分区中列类型为blob的输入接口.
|
interface |
OutputBlobWritable
OutputBlobWritable表示ODPS表或分区中列类型为blob的输出接口, 该接口只能用于
com.aliyun.odps.mapreduce.Reducer向 com.aliyun.odps.Record
中写入blob类型的列. |
interface |
WritableComparable<T>
WritableComparable 接口同时继承了
Writable 和 Comparable. |
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractDatetimeWritable<T extends AbstractDatetimeWritable>
AbstractDatetimeWritable 提供了 datetime 的
Writable 和 WritableComparable
的实现 |
class |
AbstractMapWritable
|
class |
ArrayWritable
A Writable for arrays containing instances of a class.
|
class |
BigDecimalWritable |
class |
BitMapWritable |
class |
BooleanWritable
BooleanWritable 提供了 boolean 的
Writable 和 WritableComparable
的实现 |
class |
BytesWritable
BytesWritable 提供了 byte[] 的
Writable 和 WritableComparable 的实现. |
class |
ByteWritable
ByteWritable 提供了 tinyint 的
Writable 和 WritableComparable 的实现 |
class |
CharWritable
CharWritable 提供了 char 的
Writable 和 WritableComparable 的实现 |
class |
DatetimeWritable
DatetimeWritable 提供了 datetime 的
Writable 和 WritableComparable
的实现 |
class |
DateWritable
DateWritable 提供了 date 的
Writable 和 WritableComparable
的实现。 |
class |
DoubleWritable
DoubleWritable 提供了 double 的
Writable 和 WritableComparable 的实现 |
class |
FloatWritable
FloatWritable 提供了 float 的
Writable 和 WritableComparable 的实现 |
class |
IntervalDayTimeWritable
IntervalDayTimeWritable 提供了 interval_day_time 的
Writable 和 WritableComparable
的实现 |
class |
IntervalYearMonthWritable
IntervalYearMonthWritable 提供了 interval_year_month 的
Writable 和 WritableComparable
的实现 |
class |
IntWritable
IntWritable 提供了 int 的
Writable 和 WritableComparable 的实现 |
class |
LongWritable
LongWritable 提供了 long 的
Writable 和 WritableComparable 的实现 |
class |
MapWritable
可以用于序列化的
Map,使用方法相同,可以在com.aliyun.odps.mapreduce.Mapper 中调用
com.aliyun.odps.mapreduce.MapContext#write(Object, Object)写出。 |
class |
NullWritable
NullWritable 提供了 null (空值)的
Writable 和 WritableComparable
的实现. |
class |
ShortWritable
ShortWritable 提供了 smallint 的
Writable 和 WritableComparable 的实现 |
class |
SortedMapWritable
可用于序列化的
SortedMap。 |
class |
StructWritable
StructWritable 提供了 struct 类型数据 的
Writable
的实现 |
class |
Text
Text 提供了字符串的
Writable 和 WritableComparable 的实现. |
class |
TimestampWritable
TimestampWritable 提供了 datetime 的
Writable 和 WritableComparable
的实现 |
class |
Tuple
Tuple 是
Writable 对象的有序集. |
class |
VarcharWritable
VarcharWritable 提供了 varchar 的
Writable 和 WritableComparable 的实现 |
| Modifier and Type | Method and Description |
|---|---|
static <T extends Writable> |
WritableUtils.clone(T orig,
Configuration conf)
通过Writable序列化方式拷贝一个Writable对象.
|
| Modifier and Type | Method and Description |
|---|---|
Writable[] |
ArrayWritable.get() |
Writable |
Tuple.get(int fieldNum)
Get the value in a given field.
|
Writable |
WritableRecord.get(int index)
获取某列取值,如果index>=列数,抛
ArrayIndexOutOfBoundsException异常 |
Writable |
SortedMapWritable.get(Object key) |
Writable |
MapWritable.get(Object key) |
Writable |
WritableRecord.get(String fieldName)
获取某列取值,如果列名不存在,抛
IOException异常 |
Writable[] |
WritableRecord.getAll()
获取所有列值,不包括分区列(Partition columns)
|
Writable |
SortedMapWritable.put(WritableComparable key,
Writable value) |
Writable |
MapWritable.put(Writable key,
Writable value) |
Writable |
SortedMapWritable.remove(Object key) |
Writable |
MapWritable.remove(Object key) |
Writable[] |
Tuple.toArray()
得到Tuple的数组形式
|
| Modifier and Type | Method and Description |
|---|---|
Set<Map.Entry<WritableComparable,Writable>> |
SortedMapWritable.entrySet() |
Set<Map.Entry<Writable,Writable>> |
MapWritable.entrySet() |
Set<Map.Entry<Writable,Writable>> |
MapWritable.entrySet() |
List<Writable> |
StructWritable.get()
返回此 StructWritable 的值
|
List<Writable> |
Tuple.getAll()
Get all of the fields in the tuple as a list.
|
SortedMap<WritableComparable,Writable> |
SortedMapWritable.headMap(WritableComparable toKey) |
Set<Writable> |
MapWritable.keySet() |
SortedMap<WritableComparable,Writable> |
SortedMapWritable.subMap(WritableComparable fromKey,
WritableComparable toKey) |
SortedMap<WritableComparable,Writable> |
SortedMapWritable.tailMap(WritableComparable fromKey) |
Collection<Writable> |
SortedMapWritable.values() |
Collection<Writable> |
MapWritable.values() |
| Modifier and Type | Method and Description |
|---|---|
void |
Tuple.append(Writable val)
Append a field to a tuple.
|
void |
Tuple.append(Writable[] vals)
将数组中的field添加到Tuple
|
static int |
TupleReaderWriter.compare(Writable o1,
Writable o2)
/** Compare two objects to each other.
|
static int |
TupleReaderWriter.compare(Writable o1,
Writable o2,
byte dt1,
byte dt2)
Same as
#compare(Object, Object), but does not use reflection to
determine the type of passed in objects, relying instead on the caller to
provide the appropriate values, as determined by findType(Object). |
Writable |
SortedMapWritable.put(WritableComparable key,
Writable value) |
Writable |
MapWritable.put(Writable key,
Writable value) |
void |
Tuple.set(int fieldNum,
Writable val)
Set the value in a given field.
|
void |
WritableRecord.set(int index,
Writable value)
设置列取值,如果index>=列数,抛
ArrayIndexOutOfBoundsException异常 |
void |
WritableRecord.set(String fieldName,
Writable value)
设置列取值
|
void |
ArrayWritable.set(Writable[] values) |
void |
Tuple.set(Writable[] vals)
设置Tuple中存放的
Writable对象 |
void |
WritableRecord.set(Writable[] values)
设置所有列的取值.
|
static byte[] |
WritableUtils.toByteArray(Writable... writables)
将Writable对象转化成byte数组
|
| Modifier and Type | Method and Description |
|---|---|
void |
Tuple.append(Collection<Writable> vals)
将集合中的field添加到Tuple
|
void |
MapWritable.putAll(Map<? extends Writable,? extends Writable> t) |
void |
MapWritable.putAll(Map<? extends Writable,? extends Writable> t) |
void |
SortedMapWritable.putAll(Map<? extends WritableComparable,? extends Writable> t) |
void |
Tuple.set(List<Writable> vals)
设置Tuple中存放的
Writable对象,复用vals |
void |
StructWritable.set(List<Writable> values)
设置 StructWritable 的值
|
| Constructor and Description |
|---|
ArrayWritable(Class<? extends Writable> valueClass,
Writable[] values) |
Tuple(Writable[] fields)
给定
Writable 数组构造 Tuple. |
| Constructor and Description |
|---|
ArrayWritable(Class<? extends Writable> valueClass) |
ArrayWritable(Class<? extends Writable> valueClass,
Writable[] values) |
StructWritable(List<Writable> values)
构造 struct schema 值为给定 values 的 StructWritable.
|
Tuple(List<Writable> vals,
boolean reference)
给定
List 构造 Tuple. |
| Modifier and Type | Method and Description |
|---|---|
static void |
ReflectionUtils.cloneWritableInto(Writable dst,
Writable src)
Deprecated.
|
static String |
CommonUtils.toDelimitedString(Writable[] fields,
char delim,
String nullIndicator) |
Copyright © 2021 Alibaba Cloud Computing. All rights reserved.