Skip to content

Commit

Permalink
[dbnode] Validate indexable metric tags before insert into index queue (
Browse files Browse the repository at this point in the history
  • Loading branch information
robskillington authored Jan 5, 2020
1 parent 597c894 commit 5cd41e0
Show file tree
Hide file tree
Showing 13 changed files with 1,079 additions and 124 deletions.
4 changes: 4 additions & 0 deletions .fossa.yml
Original file line number Diff line number Diff line change
Expand Up @@ -90,6 +90,10 @@ analyze:
type: go
target: github.com/m3db/m3/src/cmd/tools/read_index_ids/main
path: src/cmd/tools/read_index_ids/main
- name: github.com/m3db/m3/src/cmd/tools/verify_data_files/main
type: go
target: github.com/m3db/m3/src/cmd/tools/verify_data_files/main
path: src/cmd/tools/verify_data_files/main
- name: github.com/m3db/m3/src/cmd/tools/verify_index_files/main
type: go
target: github.com/m3db/m3/src/cmd/tools/verify_index_files/main
Expand Down
1 change: 1 addition & 0 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -89,6 +89,7 @@ TOOLS := \
read_index_files \
clone_fileset \
dtest \
verify_data_files \
verify_index_files \
carbon_load \
docs_test \
Expand Down
25 changes: 25 additions & 0 deletions src/cmd/tools/verify_data_files/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
# verify_data_files

`verify_data_files` is a utility to verify data files in a given directory.

# Usage
```
$ git clone git@github.com:m3db/m3.git
$ make verify_data_files
$ ./bin/verify_data_files
Usage: verify_data_files [-fit] [-o value] [-p value] [parameters ...]
-f, --fail-fast Fail fast will bail on first failure
-i, --fix-invalid-ids
Fix invalid IDs will remove entries with IDs that have
non-UTF8 chars
-o, --fix-path-prefix=value
Fix output path file prefix for fixed files
-p, --path-prefix=value
Path prefix [e.g. /var/lib/m3db]
-t, --fix-invalid-tags
Fix invalid tags will remove tags with name/values non-UTF8
chars
# example usage
# verify_data_files --fail-fast --path-prefix /var/lib/m3db
```
Loading

0 comments on commit 5cd41e0

Please sign in to comment.