Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: add page index for metadata #1000

Merged
merged 19 commits into from
Jun 20, 2023

Commits on Jun 19, 2023

  1. Configuration menu
    Copy the full SHA
    fefe89b View commit details
    Browse the repository at this point in the history
  2. add page index for meta

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    924791c View commit details
    Browse the repository at this point in the history
  3. debug row select

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    464dccd View commit details
    Browse the repository at this point in the history
  4. fmt

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    b4ba65b View commit details
    Browse the repository at this point in the history
  5. fmt

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    0a9491d View commit details
    Browse the repository at this point in the history
  6. unused code

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    a7947a1 View commit details
    Browse the repository at this point in the history
  7. meta_with_page_indexes

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    ecdcfd0 View commit details
    Browse the repository at this point in the history
  8. fix pub

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    4044560 View commit details
    Browse the repository at this point in the history
  9. reader

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    842de72 View commit details
    Browse the repository at this point in the history
  10. fmt

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    715accf View commit details
    Browse the repository at this point in the history
  11. cargo sort

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    6e08f64 View commit details
    Browse the repository at this point in the history
  12. comment todo

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    8c7991a View commit details
    Browse the repository at this point in the history
  13. comment

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    4f99cfa View commit details
    Browse the repository at this point in the history
  14. fmt

    MichaelLeeHZ committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    f5269c6 View commit details
    Browse the repository at this point in the history
  15. fix: ensure files can only be picked once (apache#995)

    ## Rationale
    In current design, sst files may be picked multiple times.
    
    ## Detailed Changes
    - Mark files as in compacting when pick files candidates, and reset it
    to false when CompactionTask is dropped.
    
    ## Test Plan
    Manually
    jiacai2050 authored Jun 19, 2023
    Configuration menu
    Copy the full SHA
    d26e958 View commit details
    Browse the repository at this point in the history
  16. fix: arrow meta data is lost when decode custom meta data (apache#1004)

    ## Rationale
    The metadata for arrow schema is encoded into the parquet file. However,
    this part is lost when building our custom metadata.
    
    ## Detailed Changes
    Keep the other metadata in the parquet metadata after extracting our
    custom metadata.
    
    ## Test Plan
    Add unit test `test_arrow_meta_data` for it.
    ShiKaiWi authored Jun 19, 2023
    Configuration menu
    Copy the full SHA
    907058e View commit details
    Browse the repository at this point in the history
  17. fix: avoid any updates after table is closed (apache#998)

    ## Rationale
    Part of apache#990.
    
    Some background jobs are still allowed to execute, and it will lead to
    data corrupted when a table is migrated between different nodes because
    of multiple writers for the same table.
    
    ## Detailed Changes
    Introduce a flag called `invalid` in the table data to denote whether
    the serial executor is valid, and this flag is protected with the
    `TableOpSerialExecutor` in table data, and the `TableOpSerialExecutor`
    won't be acquired if the flag is set, that is to say, any table
    operation including updating manifest, altering table and so on, can't
    be executed after the flag is set because these operations require the
    `TableOpSerialExecutor`. Finally, the flag will be set when the table is
    closed.
    ShiKaiWi authored Jun 19, 2023
    Configuration menu
    Copy the full SHA
    85eb0b7 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. reset

    MichaelLeeHZ committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    104f908 View commit details
    Browse the repository at this point in the history
  2. Merge branch 'fix-page-index-for-metadata' of github.com:MachaelLee/c…

    …eresdb into fix-page-index-for-metadata
    MichaelLeeHZ committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    49d825f View commit details
    Browse the repository at this point in the history