Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[experiment] storage: provoke inverted lsm #79083

Closed
wants to merge 2 commits into from
Closed

[experiment] storage: provoke inverted lsm #79083

wants to merge 2 commits into from

Commits on Mar 31, 2022

  1. storage: allow provoking L0 growth 

    - support `COCKROACH_DEBUG_PEBBLE_FILE_WRITE_DELAY=100ms`
- pick up pebble version with its own hacks:
  - support `COCKROACH_DEBUG_PEBBLE_INGEST_L0=true`
  - support `COCKROACH_PEBBLE_COMPACTION_DELAY=10s`
- script for experiment

Release note: None
    @tbg
    tbg committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    1957722 View commit details
    Browse the repository at this point in the history

  2. kvserver: force raft request queue backlog on ingestions 

    - disable size-based per-replica queue size (100)
- disable split delay helper. It will backpressure because the LHS on n3
  is always way behind. We only have one import processor per node and
  if their splits block here, it ruins the experiment.
- drain n3, since n3's raftMu is held for extended periods of time and
  this artificially throttles when proposals are acked, thus slowing the
  import down to a crawl (which is not a natural mechanism).
- disable quota pool
- give n3 a 2000 thread scheduler
- disable "max addsst per store" semaphores

TODO pick up David's patch https://github.com/cockroachdb/cockroach/compare/master...dt:import-procs?expand=1

Hopefully easy way to reproduce [cockroachdb#71805].

[cockroachdb#71805]: cockroachdb#71805 (comment)

Release note: None
    @tbg
    tbg committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    1d22272 View commit details
    Browse the repository at this point in the history