cncf-toc/proposals/fluentd.adoc

128 lines
6.3 KiB
Plaintext
Raw Permalink Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

== Fluentd Proposal
*Name of project*: Fluentd
*Description*: Fluentd is an open source data collector that allows to implement an unified logging layer. Fluentd's 600+ plugins connect it to many data sources and data outputs. Fluentd has a large adopter community consisting of Atlassian, LINE, Microsoft, Nintendo and GREE within others.
Contributions to Fluentd through plugins made by companies and individuals can be seen in the following link:
http://www.fluentd.org/plugins
*Sponsor / Advisor from TOC*: Brian Grant <briangrant@google.com>
*Unique Identifier*: fluentd
*License*: Apache License v2.0
*Source control repositories*:
The donation includes all repositories on the GitHub fluent organization (https://github.com/fluent/).
Fluentd core service and it assets:
- [fluent/fluentd](http://github.com/fluent/fluentd)
- [fluent/fluentd-website](http://github.com/fluent/fluentd-website)
- [fluent/fluentd-docs](http://github.com/fluent/fluentd-docs)
- [fluent/fluentd-ui](http://github.com/fluent/fluentd-ui)
- [fluent/fluentd-benchmark](http://github.com/fluent/fluentd-benchmark)
- [fluent/fluent.github.com](http://github.com/fluent/fluent.github.com)
Fluentd plugins/extensions:
- [fluent/fluent-plugin-mongo](http://github.com/fluent/fluent-plugin-mongo)
- [fluent/fluent-plugin-s3](http://github.com/fluent/fluent-plugin-s3)
- [fluent/fluent-plugin-kafka](http://github.com/fluent/fluent-plugin-kafka)
- [fluent/fluent-plugin-sql](http://github.com/fluent/fluent-plugin-sql)
- [fluent/fluent-plugin-flume](http://github.com/fluent/fluent-plugin-flume)
- [fluent/fluent-plugin-multiprocess](http://github.com/fluent/fluent-plugin-multiprocess)
- [fluent/fluent-plugin-webhdfs](http://github.com/fluent/fluent-plugin-webhdfs)
- [fluent/fluent-plugin-scribe](http://github.com/fluent/fluent-plugin-scribe)
- [fluent/fluent-plugin-msgpack-rpc](http://github.com/fluent/fluent-plugin-msgpack-rpc)
- [fluent/fluent-plugin-hoop](http://github.com/fluent/fluent-plugin-hoop)
- [fluent/fluent-plugin-rewrite-tag-filter](http://github.com/fluent/fluent-plugin-rewrite-tag-filter)
- [fluent/fluent-plugins](http://github.com/fluent/fluent-plugins)
Fluentd loggers for different languages:
- [fluent/fluent-logger-java](http://github.com/fluent/fluent-logger-java)
- [fluent/fluent-logger-scala](http://github.com/fluent/fluent-logger-scala)
- [fluent/fluent-logger-node](http://github.com/fluent/fluent-logger-node)
- [fluent/fluent-logger-erlang](http://github.com/fluent/fluent-logger-erlang)
- [fluent/fluent-logger-perl](http://github.com/fluent/fluent-logger-perl)
- [fluent/fluent-logger-golang](http://github.com/fluent/fluent-logger-golang)
- [fluent/fluent-logger-ruby](http://github.com/fluent/fluent-logger-ruby)
- [fluent/fluent-logger-python](http://github.com/fluent/fluent-logger-python)
- [fluent/fluent-logger-d](http://github.com/fluent/fluent-logger-d)
- [fluent/fluent-logger-ocaml](http://github.com/fluent/fluent-logger-ocaml)
Miscellaneous: related projects to Fluentd
- [fluent/fluent-bit](http://github.com/fluent/fluent-bit)
- [fluent/fluent-bit-docs](http://github.com/fluent/fluent-bit-docs)
- [fluent/fluent-bit-demo](http://github.com/fluent/fluent-bit-demo)
- [fluent/fluent-bit-dashboard](http://github.com/fluent/fluent-bit-dashboard)
- [fluent/fluentd-docker-image](http://github.com/fluent/fluentd-docker-image)
- [fluent/fluentd-forwarder](http://github.com/fluent/fluentd-forwarder)
- [fluent/data-collection](http://github.com/fluent/data-collection)
- [fluent/Nlog.Targets.Fluentd](http://github.com/fluent/Nlog.Targets.Fluentd)
*Initial Committers*:
* Sadayuki "Sada" Furuhashi
*Infrastructure requirements*: CI and potentially CNCF Community Cluster access
We currently have several unit tests for all components of Fluentd, the tests can be found in the source code here:
https://github.com/fluent/fluentd/tree/master/test
With CNCF infrastructure, we aim to improve our testing with real deployments and critical loads over different connectors that we provide.
*Issue tracker*: https://github.com/fluent/fluentd/issues and respective GitHub issues for each repository.
*Mailing lists*: https://groups.google.com/forum/#!forum/fluentd
*Website*: http://www.fluentd.org/
*Release methodology and mechanics*: The latest release is found at: https://rubygems.org/gems/fluentd
* Generally the last major version and one branch of the old major version are actively supported
* Changes are included in a minor version if they dont contain backward incompatibility, otherwise theyre included only in a branch of the next major version
* The current latest major version is 0.14 and the old major version is 0.12.
* Releases are created by the Fluentd Core Team as a tag on the git repository and a new release on rubygems.org.
*Social media accounts*: Slack (http://slack.fluentd.org), Twitter (https://twitter.com/fluentd) and Facebook (https://www.facebook.com/Fluentd-196064987183037/)
*Existing sponsorship*: Treasure Data is a primary sponsor of Fluentd.
*External Dependencies*: The dependencies can be found in the main gemspec for fluentd but are listed below: https://github.com/fluent/fluentd/blob/master/fluentd.gemspec
* https://github.com/msgpack/msgpack-ruby (ASLv2)
* https://github.com/frsyuki/sigdump (MIT)
* https://github.com/tarcieri/cool.io (MIT)
* https://github.com/tmm1/http_parser.rb (MIT)
* https://github.com/nurse/strptime (BSD 2-clause)
* http://tzinfo.github.io/ (MIT)
* https://github.com/brianmario/yajl-ruby (MIT)
* https://github.com/ruby-concurrency/thread_safe (ASLv2)
*Other Contributors*:
90 Contributors. 5 of the Top 10 committers are from Treasure Data
Non Treasure Data committers (with direct write access):
* Naotoshi Seo (https://github.com/sonots)
* Nobuyuki Kubota (https://github.com/nobu-k)
* Kosaki (https://github.com/kosaki)
* Yuichi Tateno (https://github.com/hotchpotch)
*Statement on alignment with CNCF mission*:
Logging is a crucial part of cloud native architectures. Fluentd was created to solve log/data collection and distribution needs at scale, offering a comprehensive and reliable service to be implemented in conjunction with microservices and generic cloud monitoring tools.
For more technical details about how Fluentd solves logging challenges, please refer to the following article:
http://thenewstack.io/fluentd-offers-comprehensive-log-collection-cloud-microservices-world