Sqoop 2 MapReduce Job
一个作业初始化的工作:
作业映射阶段:
下面的图表对工作的减少阶段进行了描述;
,------------. ,---------------------.
|SqoopReducer| |SqoopNullOutputFormat|
`---+--------' `----------+----------'
| | ,-----------------------------.
| |-> |SqoopOutputFormatLoadExecutor|
| | `--------------+--------------' |
| | | |
| | | ,-----------------. ,-------------.
| | |-> |SqoopRecordWriter|-->|SqoopWritable|
getRecordWriter | | `--------+--------' `---+---------'
----------------------->| getRecordWriter | | |
| |----------------->| | | ,--------------.
| | |---------------------------------->|ConsumerThread|
| | | | | `------+-------'
| |<- - - - - - - - -| | | | ,------.
<- - - - - - - - - - - -| | | | |--->|Loader|
| | | | | | `--+---'
| | | | | | |
| | | | | | load |
run | | | | | |------>|
----->| | write | | | | |
|------------------------------------------------>| setContent | | read* |
| | | |--------------->| getContent |<------|
| | | | |<-----------| |
| | | | | | - - ->|
| | | | | | | write into Data Source
| | | | | | |----------------------->