欢迎关注Hadoop、Spark、Flink、Hive、Hbase、Flume等大数据资料分享微信公共账号:iteblog_hadoop
  1. 文章总数:977
  2. 浏览总数:11,945,252
  3. 评论:3936
  4. 分类目录:106 个
  5. 注册用户数:6113
  6. 最后更新:2018年12月13日
过往记忆博客公众号iteblog_hadoop
欢迎关注微信公众号:
iteblog_hadoop
大数据技术博客公众号bigdata_ai
大数据猿:
bigdata_ai

Flume内置channel,source,sink汇总

由于经常会使用到Flume的一些channel,source,sink,于是为了方便将这些channel,source,sink汇总出来,也共大家访问。

Component InterfaceType AliasImplementation Class
*.Channelmemory*.channel.MemoryChannel
*.Channeljdbc*.channel.jdbc.JdbcChannel
*.Channelfile*.channel.file.FileChannel
*.Channel*.channel.PseudoTxnMemoryChannel
*.Channelorg.example.MyChannel
*.Sourceavro*.source.AvroSource
*.Sourcenetcat*.source.NetcatSource
*.Sourceseq*.source.SequenceGeneratorSource
*.Sourceexec*.source.ExecSource
*.Sourcesyslogtcp*.source.SyslogTcpSource
*.Sourcemultiport_syslogtcp*.source.MultiportSyslogTCPSource
*.Sourcesyslogudp*.source.SyslogUDPSource
*.Sourcespooldir*.source.SpoolDirectorySource
*.Sourcehttp*.source.http.HTTPSource
*.Sourcethrift*.source.ThriftSource
*.Sourcejms*.source.jms.JMSSource
*.Source*.source.avroLegacy.AvroLegacySource
*.Source*.source.thriftLegacy.ThriftLegacySource
*.Sourceorg.example.MySource
*.Sinknull*.sink.NullSink
*.Sinklogger*.sink.LoggerSink
*.Sinkavro*.sink.AvroSink
*.Sinkhdfs*.sink.hdfs.HDFSEventSink
*.Sinkhbase*.sink.hbase.HBaseSink
*.Sinkasynchbase*.sink.hbase.AsyncHBaseSink
*.Sinkelasticsearch*.sink.elasticsearch.ElasticSearchSink
*.Sinkfile_roll*.sink.RollingFileSink
*.Sinkirc*.sink.irc.IRCSink
*.Sinkthrift*.sink.ThriftSink
*.Sinkorg.example.MySink
*.ChannelSelectorreplicating*.channel.ReplicatingChannelSelector
*.ChannelSelectormultiplexing*.channel.MultiplexingChannelSelector
*.ChannelSelectororg.example.MyChannelSelector
*.SinkProcessordefault*.sink.DefaultSinkProcessor
*.SinkProcessorfailover*.sink.FailoverSinkProcessor
*.SinkProcessorload_balance*.sink.LoadBalancingSinkProcessor
*.SinkProcessor
*.interceptor.Interceptortimestamp*.interceptor.TimestampInterceptor$Builder
*.interceptor.Interceptorhost*.interceptor.HostInterceptor$Builder
*.interceptor.Interceptorstatic*.interceptor.StaticInterceptor$Builder
*.interceptor.Interceptorregex_filter*.interceptor.RegexFilteringInterceptor$Builder
*.interceptor.Interceptorregex_extractor*.interceptor.RegexFilteringInterceptor$Builder
*.channel.file.encryption.
KeyProvider$Builder
jceksfile*.channel.file.encryption.JCEFileKeyProvider
*.channel.file.encryption.
KeyProvider$Builder
org.example.MyKeyProvider
*.channel.file.encryption.CipherProvideraesctrnopadding*.channel.file.encryption.AESCTRNoPaddingProvider
*.channel.file.encryption.CipherProviderorg.example.MyCipherProvider
*.serialization.EventSerializer$Buildertext*.serialization.BodyTextEventSerializer$Builder
*.serialization.EventSerializer$Builderavro_event*.serialization.FlumeEventAvroEventSerializer$Builder
*.serialization.EventSerializer$Builderorg.example.MyEventSerializer$Builder
由于表格太大了,所以这里将org.apache.flume.替换为*.,读者在阅读的时候,直接将*.理解成org.apache.flume.即可!

Sinks

accumulator
agentBEChain
agentBESink
agentBestEffortSink
agentDFOChain
agentDFOSink
agentE2EChain
agentE2ESink
agentFailoverSink
agentSink
attr2hbase
autoBEChain
autoDFOChain
autoE2EChain
avroSink
collectorSink
console
counter
counterHistory
customdfs
dfs
escapedCustomDfs
escapedFormatDfs
fail
failChain
flightbookinghbase
flightsearchhbase
formatDfs
ganglia
hbase
irc
logicalSink
multigrep
multigrepspec
null
regexhisto
regexhistospec
rpcSink
seqfile
syslogTcp
text
thriftSink

Sources

asciisynth
autoCollectorSource
avroSource
collectorSource
console
exec
execPeriodic
execStream
fail
irc
log4jfile
logicalSource
multitail
nonlsynth
null
report
rpcSource
scribe
seqfile
stdin
synth
synthrndsize
syslogTcp
syslogTcp1
syslogUdp
tail
tailDir
text
thriftSource
tpriosource
twitter

Decorators

AccessIpFormatFilter
AmendAccessLogNew
AmendNginxErrorLog
ApacheFilter
CatalinaFormat
CatalinaLogExceptionFilter2
CatalinaLogExceptionFilter3
CatalinaLogFilter2
CatalinaLogFilter3
FieldEqValueFilter
Filter
FormatAccessLog
FormatDate
LogExceptionFilter
LogFilter
PhpFilter
ackChecker
ackInjector
ackedWriteAhead
amendAccessLog
batch
benchinject
benchreport
bloomCheck
bloomGen
choke
delay
digest
diskFailover
exDate
flakeyAppend
format
gunzip
gzip
inmem
insertBefore
insistentAppend
insistentOpen
intervalDroppyAppend
intervalFlakeyAppend
intervalSampler
lazyOpen
mask
mult
nullDeco
probSampler
regex
regexAll
reservoirSampler
select
split
splitCompare
stubbornAppend
unbatch
value
本博客文章除特别声明,全部都是原创!
转载本文请加上:转载自过往记忆(https://www.iteblog.com/)
本文链接: 【Flume内置channel,source,sink汇总】(https://www.iteblog.com/archives/948.html)
喜欢 (12)
分享 (0)
发表我的评论
取消评论

表情
本博客评论系统带有自动识别垃圾评论功能,请写一些有意义的评论,谢谢!