-
-
Notifications
You must be signed in to change notification settings - Fork 671
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Rename deserialize_u64 -> deserialize_vint_u64
- Loading branch information
1 parent
4953e31
commit ca0d361
Showing
5 changed files
with
72 additions
and
14 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
# SSTable | ||
|
||
The `tantivy-sstable` crate is yet another sstable crate. | ||
|
||
It has been designed to be used in `quickwit`: | ||
- as an alternative to the default tantivy fst dictionary. | ||
- as a way to store the column index for dynamic fast fields. | ||
|
||
The benefit compared to the fst crate is locality. | ||
Searching a key in the fst crate requires downloading the entire dictionary. | ||
|
||
Once the sstable index is downloaded, running a `get` in the sstable | ||
crate only requires a single fetch. | ||
|
||
Right now, the block index and the default block size have been thought | ||
for quickwit, and the performance of a get is very bad. | ||
|
||
# Sorted strings? | ||
|
||
SSTable stands for Sorted String Table. | ||
Strings have to be insert in sorted order. | ||
|
||
That sorted order is used in different ways: | ||
- it makes gets and streaming ranges of keys | ||
possible. | ||
- it allows incremental encoding of the keys | ||
- the front compression is leveraged to optimize | ||
the intersection with an automaton |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters