修正 sender 模块状态统计，更新了 metric 模块的一些字段和选项 #208
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
还有不同类型的timestamp也在这里加 |
|
LGTM |
andrewei1316
force-pushed
the
update-metric
branch
from
19c945d
to
1af8a26
Compare
hongdanyang1991
pushed a commit
to hongdanyang1991/logkit
that referenced
this pull request
Nov 20, 2017
* 检查 sender 模块的状态统计，删除冗余代码，修正可能出现问题的地方 * 更改了swap中的几个字段名称,为net添加了一个选项,为net和kernel_vmstat的字段添加前缀 * 将 metric 模块的时间戳放在每个类别里面而不是一个统一的名称
wonderflow
pushed a commit
that referenced
this pull request
Dec 4, 2017
* elasticsearchSender增加选择时区功能 * 支持采集redis的string、set数据结构的数据 * add tcp reader * add syslog parser * 添加 urlparam transformer * 添加 array expand transformer * 修复手残打错的字段名，为cluster提供一个默认的mytag * Support collection redis sortedset type data * 添加Rename Transformer，实现修改字段名，例如将字段timestamp修改为@timestamp * 支持采集redis的hash数据结构的数据 * 统一文件 * 增强replace transformer功能,支持正则替换 * 同步代码 * 为 metrics 收集的信息增加时间字段 * add logkit web * 为 开启/关闭 runner 添加二次确认 * 更改 metric runner test 以适应添加的时间戳字段 * 通过 master 批量管理 slaves，当满足条件的 slaves 不存在时返回 404 * 更改 urlparam/arrayexpand transformer，有重复 key 时尝试更改 key 5 次, 5次后丢弃 * fix kafka sender web description * 使用 pandora sender 时，自动添加发送时间 * 合并qiniu代码并解决冲突 * 代码优化 * 修复es替换字段名导致其它字段丢失的bug * 增加elasticsearch sender 添加发送时间字段功能 * 修改elasticsearch sender自动索引日期格式 * 使用 pandora sender 时，自动添加发送时间 * add vendor pkg * remove govendor on travis and readme * 修正 sender 模块状态统计，更新了 metric 模块的一些字段和选项 (#208) * 检查 sender 模块的状态统计，删除冗余代码，修正可能出现问题的地方 * 更改了swap中的几个字段名称,为net添加了一个选项,为net和kernel_vmstat的字段添加前缀 * 将 metric 模块的时间戳放在每个类别里面而不是一个统一的名称 * 从redis采集数据支持多key值 * 修改Rename Transformer参数名称 * new transformer rest api: POST /logkit/transformer/transform (accept sample logs in json array format, and transform them using registered transformers) * 使用 pandora sender 时，自动添加发送时间 * process single sample log transform * redis其它模式支持多key值采集 * 同步文件 * 增加多层map获取value及设置value方法 * 优化代码transformer api: Post Transform * 支持redis * Use map[string]interface{}. Can't use conf.MapConf(map[string]string) to bind transformer config in request, because int value exists in date transformer config * 文件读取改进 * 1.文件读取通过路径判断模式 2.改进文件读取datasource_tag参数，使其对应到解析的每一条记录中 * test code for Rename Transformer * 增强所有transformer功能,使其支持层级key * 从文件读数据增加匹配路径模式（match） * 改进文件读取match模式 * fix replace_test.go * test code for Transformer Rest API: POST /logkit/transformer/transform * transformer 代码优化 * 使用 pandora sender 时，自动添加发送时间 * add k8s deploy manifest * version v1.3.6 * add logkit on k8s * Update mysql.conf * 消除多余的换行 * redis多key值方法改变 * 放开Test_GetInode(t *testing.T)注释 * 修改runner_test测试数据 * 1.在rest_sender_model增加ES sender发送是否追加发送时间选项 2.将transformer中拆分key提取为一个utils方法 * fix rename.go * fix rename_test.go * datasource fix change * 修改POST /logkit/transformer/transform 的Response结构，添加相关状态码 * 完善测试代码 * 修改transformer的api测试（因为response的结构改变） * add autofile.go * go fmt project * 添加POST /logkit/transformer/transform 的使用说明 * fix autofile.go * autofile mode front * fix bug * replace transformer 兼容旧版本 * 规范导包顺序 * fix runner_test.go * fix autofile.go and front * add encoding item * 优化elasticsearchSender, transformer代码,增加 * 优化elasticsearchSender, transformer代码,增加测试用例 * 优化replace transformer * add autofile_test.go * fix autofile_test.go * fix autofile_test.go * test file fix * fix test file * fix test file * del test file
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixes [issue number]
Changes
Reviewers
Checklist