- Engage an "overlapped I/O" on Windows.
- Simple careful mode for working with corrupted DB.
- Move most of
mdbx_chk
functional to the library API. - Replace SRW-lock on Windows to allow shrink DB with
MDBX_NOTLS
option. - More flexible support of asynchronous runtime/framework(s).
- Migration guide from LMDB to MDBX.
- Get rid of dirty-pages list in MDBX_WRITEMAP mode.
- Large/Overflow pages accounting for dirty-room.
- Support for RAW devices.
- Support MessagePack for Keys & Values.
- Engage new terminology.
- Packages for Astra Linux, ALT Linux, ROSA Linux, etc.
New:
- Added the
tools-static
make target to build statically linked MDBX tools. - Support for Microsoft Visual Studio 2022.
- Support build by MinGW' make from command line without CMake.
- Added
mdbx::filesystem
C++ API namespace that corresponds tostd::filesystem
orstd::experimental::filesystem
.
Fixes:
- Fixed a race between starting a transaction and creating a DBI descriptor that could lead to
SIGSEGV
in the cursor tracking code. - Clarified description of
MDBX_EPERM
error returned frommdbx_env_set_geometry()
. - Fixed non-promoting the parent transaction to be dirty in case the undo of the geometry update failed during abortion of a nested transaction.
- Resolved linking issues with
libstdc++fs
/libc++fs
/libc++experimental
for C++std::filesystem
orstd::experimental::filesystem
for legacy compilers. - Added workaround for GNU Make 3.81 and earlier.
- Added workaround for Elbrus/LCC 1.25 compiler bug of class inline
static constexpr
member field. - Fixed minor assertion regression (only debug builds were affected).
Minors:
- Resolve minor MSVC warnings: avoid
/INCREMENTAL[:YES]
with/LTCG
,/W4
with/W3
, theC5105
warning. - Switched to using
MDBX_EPERM
instead of `MDBX_RESULT_TRUE' to indicate that the geometry cannot be updated. - Added
NULL
checking during memory allocation insidemdbx_chk
. - Resolved all warnings from MinGW while used without CMake.
The stable release with the complete workaround for an incoherence flaw of Linux unified page/buffer cache. Nonetheless the cause for this trouble may be an issue of Intel CPU cache/MESI. See issue#269 for more information.
Acknowledgements:
- David Bouyssié for Scala bindings.
- Michelangelo Riccobene for reporting and testing.
Fixes:
- Added complete workaround for an incoherence flaw of Linux unified page/buffer cache.
- Fixed cursor reusing for read-only transactions.
- Fixed copy&paste typo inside
mdbx::cursor::find_multivalue()
.
Minors:
- Minor refine C++ API for convenience.
- Minor internals refines.
- Added
lib-static
andlib-shared
targets for make. - Added minor workaround for AppleClang 13.3 bug.
- Clarified error messages of a signature/version mismatch.
The release with the temporary hotfix for a flaw of Linux unified page/buffer cache. See issue#269 for more information.
Acknowledgements:
- Simon Leier for reporting and testing.
- Kai Wetlesen for RPMs.
- Tullio Canepa for reporting C++ API issue and contributing.
Fixes:
- Added hotfix for a flaw of Linux unified page/buffer cache.
- Fixed/Reworked move-assignment operators for "managed" classes of C++ API.
- Fixed potential
SIGSEGV
while open DB with overrided non-default page size. - Made
mdbx_env_open()
idempotence in failure cases. - Refined/Fixed pages reservation inside
mdbx_update_gc()
to avoid non-reclamation in a rare cases. - Fixed typo in a retained space calculation for the hsr-callback.
Minors:
- Reworked functions for meta-pages, split-off non-volatile.
- Disentangled C11-atomic fences/barriers and pure-functions (with
__attribute__((__pure__))
) to avoid compiler misoptimization. - Fixed hypotetic unaligned access to 64-bit dwords on ARM with
__ARM_FEATURE_UNALIGNED
defined. - Reasonable paranoia that makes clarity for code readers.
- Minor fixes Doxygen references, comments, descriptions, etc.
The stable release with fixes for large and huge databases sized of 4..128 TiB.
Acknowledgements:
- Ledgerwatch, Binance and Positive Technologies teams for reporting, assistance in investigation and testing.
- Alex Sharov for reporting, testing and provide resources for remote debugging/investigation.
- Kris Zyp for Deno support.
New features, extensions and improvements:
- Added treating the
UINT64_MAX
value as maximum for given option insidemdbx_env_set_option()
. - Added
to_hex/to_base58/to_base64::output(std::ostream&)
overloads without using temporary string objects as buffers. - Added
--geometry-jitter=YES|no
option to the test framework. - Added support for Deno support by Kris Zyp.
Fixes:
- Fixed handling
MDBX_opt_rp_augment_limit
for GC's records from huge transactions (Erigon/Akula/Ethereum). - Fixed build on Android (avoid including
sys/sem.h
). - Fixed missing copy assignment operator for
mdbx::move_result
. - Fixed missing
&
forstd::ostream &operator<<()
overloads. - Fixed unexpected
EXDEV
(Cross-device link) error frommdbx_env_copy()
. - Fixed base64 encoding/decoding bugs in auxillary C++ API.
- Fixed overflow of
pgno_t
during checking PNL on 64-bit platforms. - Fixed excessive PNL checking after sort for spilling.
- Reworked checking
MAX_PAGENO
and DB upper-size geometry limit. - Fixed build for some combinations of versions of MSVC and Windows SDK.
Minors:
- Added workaround for CLANG bug D79919/PR42445.
- Fixed build test on Android (using
pthread_barrier_t
stub). - Disabled C++20 concepts for CLANG < 14 on Android.
- Fixed minor
unused parameter
warning. - Added CI for Android.
- Refine/cleanup internal logging.
- Refined line splitting inside hex/base58/base64 encoding to avoid
\n
at the end. - Added workaround for modern libstdc++ with CLANG < 4.x
- Relaxed txn-check rules for auxiliary functions.
- Clarified a comments and descriptions, etc.
- Using the
-fno-semantic interposition
option to reduce the overhead to calling self own public functions.
Acknowledgements:
- gcxfd i@rmw.link for reporting, contributing and testing.
- 장세연 (Чан Се Ен) for reporting and testing.
- Alex Sharov for reporting, testing and provide resources for remote debugging/investigation.
New features, extensions and improvements:
- Added
mdbx_cursor_get_batch()
. - Added
MDBX_SET_UPPERBOUND
. - C++ API is finalized now.
- The GC update stage has been significantly speeded when fixing huge Erigon's transactions (Ethereum ecosystem).
Fixes:
- Disabled C++20 concepts for stupid AppleClang 13.x
- Fixed internal collision of
MDBX_SHRINK_ALLOWED
withMDBX_ACCEDE
.
Minors:
- Fixed returning
MDBX_RESULT_TRUE
(unexpected -1) frommdbx_env_set_option()
. - Added
mdbx_env_get_syncbytes()
andmdbx_env_get_syncperiod()
. - Clarified description of
MDBX_INTEGERKEY
. - Reworked/simplified
mdbx_env_sync_internal()
. - Fixed extra assertion inside
mdbx_cursor_put()
forMDBX_DUPFIXED
cases. - Avoiding extra looping inside
mdbx_env_info_ex()
. - Explicitly enabled core dumps from stochastic tests scripts on Linux.
- Fixed
mdbx_override_meta()
to avoid false-positive assertions. - For compatibility reverted returning
MDBX_ENODATA
for some cases.
Acknowledgements:
- 장세연 (Чан Се Ен) for contributing to C++ API.
- Alain Picard for Java bindings.
- Alex Sharov for reporting and testing.
- Kris Zyp for reporting and testing.
- Artem Vorotnikov for support Rust wrapper.
Fixes:
- Fixed compilation with
devtoolset-9
on CentOS/RHEL 7. - Fixed unexpected
MDBX_PROBLEM
error because of update an obsolete meta-page. - Fixed returning
MDBX_NOTFOUND
error in case an inexact value found forMDBX_GET_BOTH
operation. - Fixed compilation without kernel/libc-devel headers.
Minors:
- Fixed
constexpr
-related macros for legacy compilers. - Allowed to define 'CMAKE_CXX_STANDARD` using an environment variable.
- Simplified collection statistics of page operation .
- Added
MDBX_FORCE_BUILD_AS_MAIN_PROJECT
cmake option. - Remove unneeded
#undef P_DIRTY
.
The database format signature has been changed to prevent forward-interoperability with an previous releases, which may lead to a false positive diagnosis of database corruption due to flaws of an old library versions.
This change is mostly invisible:
- previously versions are unable to read/write a new DBs;
- but the new release is able to handle an old DBs and will silently upgrade ones.
Acknowledgements:
- Alex Sharov for reporting and testing.
Unfortunately, the v0.10.5
accidentally comes not full-compatible with previous releases:
v0.10.5
can read/processing DBs created by previous releases, i.e. the backward-compatibility is provided;- however, previous releases may lead to false-corrupted state with DB that was touched by
v0.10.5
, i.e. the forward-compatibility is broken forv0.10.4
and earlier.
This cannot be fixed, as it requires fixing past versions, which as a result we will just get a current version.
Therefore, it is recommended to use v0.11.1
instead of v0.10.5
.
Acknowledgements:
- Noel Kuntze for immediately bug reporting.
Fixes:
- Fixed unaligned access regression after the
#pragma pack
fix for modern compilers. - Added UBSAN-test to CI to avoid a regression(s) similar to lately fixed.
- Fixed possibility of meta-pages clashing after manually turn to a particular meta-page using
mdbx_chk
utility.
Minors:
- Refined handling of weak or invalid meta-pages while a DB opening.
- Refined providing information for the
@MAIN
and@GC
sub-databases of a last committed modification transaction's ID.
Acknowledgements:
- Artem Vorotnikov for support Rust wrapper.
- Andrew Ashikhmin for contributing to C++ API.
Fixes:
- Fixed possibility of looping update GC during transaction commit (no public issue since the problem was discovered inside Positive Technologies).
- Fixed
#pragma pack
to avoid provoking some compilers to generate code with unaligned access. - Fixed
noexcept
for potentially throwingtxn::put()
of C++ API.
Minors:
- Added stochastic test script for checking small transactions cases.
- Removed extra transaction commit/restart inside test framework.
- In debugging builds fixed a too small (single page) by default DB shrink threshold.
Acknowledgements:
- Francisco Vallarino for Haskell bindings for libmdbx.
- Alex Sharov for reporting and testing.
- Andrea Lanfranchi for contributing.
Extensions and improvements:
- Added
cursor::erase()
overloads forkey
and forkey-value
. - Resolve minor Coverity Scan issues (no fixes but some hint/comment were added).
- Resolve minor UndefinedBehaviorSanitizer issues (no fixes but some workaround were added).
Fixes:
- Always setup
madvise
while opening DB (fixes erthink#231). - Fixed checking legacy
P_DIRTY
flag (0x10
) for nested/sub-pages.
Minors:
- Fixed getting revision number from middle of history during amalgamation (GNU Makefile).
- Fixed search GCC tools for LTO (CMake scripts).
- Fixed/reorder dirs list for search CLANG tools for LTO (CMake scripts).
- Fixed/workarounds for CLANG < 9.x
- Fixed CMake warning about compatibility with 3.8.2
Acknowledgements:
- Alex Sharov for reporting and testing.
- Andrea Lanfranchi for reporting bugs.
- Lionel Debroux for fuzzing tests and reporting bugs.
- Sergey Fedotov for
node-mdbx
NodeJS bindings. - Kris Zyp for
lmdbx-store
NodeJS bindings. - Noel Kuntze for draft Python bindings.
New features, extensions and improvements:
- Allow to predefine/override
MDBX_BUILD_TIMESTAMP
for builds reproducibility. - Added options support for
long-stochastic
script. - Avoided
MDBX_TXN_FULL
error for large transactions when possible. - The
MDBX_READERS_LIMIT
increased to32767
. - Raise
MDBX_TOO_LARGE
under Valgrind/ASAN if being opened DB is 100 larger than RAM (to avoid hangs and OOM). - Minimized the size of poisoned/unpoisoned regions to avoid Valgrind/ASAN stuck.
- Added more workarounds for QEMU for testing builds for 32-bit platforms, Alpha and Sparc architectures.
mdbx_chk
now skips iteration & checking of DB' records if corresponding page-tree is corrupted (to avoidSIGSEGV
, ASAN failures, etc).- Added more checks for rare/fuzzing corruption cases.
Backward compatibility break:
- Use file
VERSION.txt
for version information instead ofVERSION
to avoid collision with#include <version>
. - Rename
slice::from/to_FOO_bytes()
to `slice::envisage_from/to_FOO_length()'. - Rename
MDBX_TEST_EXTRA
make's variable toMDBX_SMOKE_EXTRA
. - Some details of the C++ API have been changed for subsequent freezing.
Fixes:
- Fixed excess meta-pages checks in case
mdbx_chk
is called to check the DB for a specific meta page and thus could prevent switching to the selected meta page, even if the check passed without errors. - Fixed recursive use of SRW-lock on Windows cause by
MDBX_NOTLS
option. - Fixed log a warning during a new DB creation.
- Fixed false-negative
mdbx_cursor_eof()
result. - Fixed
make install
with non-GNUinstall
utility (OSX, BSD). - Fixed installation by
CMake
in special cases by complete useGNUInstallDirs
's variables. - Fixed C++ Buffer issue with
std::string
and alignment. - Fixed
safe64_reset()
for platforms without atomic 64-bit compare-and-swap. - Fixed hang/shutdown on big-endian platforms without
__cxa_thread_atexit()
. - Fixed using bad meta-pages if DB was partially/recoverable corrupted.
- Fixed extra
noexcept
forbuffer::&assign_reference()
. - Fixed
bootid
generation on Windows for case of change system' time. - Fixed test framework keygen-related issue.
Acknowledgements:
- Alexey Akhunov and Alex Sharov for bug reporting and testing.
- Andrea Lanfranchi for bug reporting and testing related to WSL2.
New features:
- Added
-p
option tomdbx_stat
utility for printing page operations statistic. - Added explicit checking for and warning about using unfit github's archives.
- Added fallback from OFD locking to legacy non-OFD POSIX file locks on an
EINVAL
error. - Added Plan 9 network file system to the whitelist for an ability to open a DB in exclusive mode.
- Support for opening from WSL2 environment a DB hosted on Windows drive and mounted via DrvFs (i.e by Plan 9 noted above).
Fixes:
- Fixed minor "foo not used" warnings from modern C++ compilers when building the C++ part of the library.
- Fixed confusing/messy errors when build library from unfit github's archives (erthink#197).
- Fixed
#elsif
typo. - Fixed rare unexpected
MDBX_PROBLEM
error during altering data in huge transactions due to wrong spilling/oust of dirty pages (erthink#195). - Re-Fixed WSL1/WSL2 detection with distinguishing (erthink#97).
Acknowledgements:
- Mahlon E. Smith for Ruby bindings.
- Alex Sharov for mdbx-go, bug reporting and testing.
- Artem Vorotnikov for bug reporting and PR.
- Paolo Rebuffo, Alexey Akhunov and Mark Grosberg for donations.
- Noel Kuntze for preliminary Python bindings
New features:
- Added
mdbx_env_set_option()
andmdbx_env_get_option()
for controls various runtime options for an environment (announce of this feature was missed in a previous news). - Added
MDBX_DISABLE_PAGECHECKS
build option to disable some checks to reduce an overhead and detection probability of database corruption to a values closer to the LMDB. TheMDBX_DISABLE_PAGECHECKS=1
provides a performance boost of about 10% in CRUD scenarios, and conjointly with theMDBX_ENV_CHECKPID=0
andMDBX_TXN_CHECKOWNER=0
options can yield up to 30% more performance compared to LMDB. - Using float point (exponential quantized) representation for internal 16-bit values of grow step and shrink threshold when huge ones (erthink#166). To minimize the impact on compatibility, only the odd values inside the upper half of the range (i.e. 32769..65533) are used for the new representation.
- Added the
mdbx_drop
similar to LMDB command-line tool to purge or delete (sub)database(s). - Ruby bindings is available now by Mahlon E. Smith.
- Added
MDBX_ENABLE_MADVISE
build option which controls the use of POSIXmadvise()
hints and friends. - The internal node sizes were refined, resulting in a reduction in large/overflow pages in some use cases and a slight increase in limits for a keys size to ≈½ of page size.
- Added to
mdbx_chk
output number of keys/items on pages. - Added explicit
install-strip
andinstall-no-strip
targets to theMakefile
(erthink#180). - Major rework page splitting (af9b7b560505684249b76730997f9e00614b8113) for
- An "auto-appending" feature upon insertion for both ascending and descending key sequences. As a result, the optimality of page filling increases significantly (more densely, less slackness) while inserting ordered sequences of keys,
- A "splitting at middle" to make page tree more balanced on average.
- Added
mdbx_get_sysraminfo()
to the API. - Added guessing a reasonable maximum DB size for the default upper limit of geometry (erthink#183).
- Major rework internal labeling of a dirty pages (958fd5b9479f52f2124ab7e83c6b18b04b0e7dda) for
a "transparent spilling" feature with the gist to make a dirty pages
be ready to spilling (writing to a disk) without further altering ones.
Thus in the
MDBX_WRITEMAP
mode the OS kernel able to oust dirty pages to DB file without further penalty during transaction commit. As a result, page swapping and I/O could be significantly reduced during extra large transactions and/or lack of memory. - Minimized reading leaf-pages during dropping subDB(s) and nested trees.
- Major rework a spilling of dirty pages to support LRU policy and prioritization for a large/overflow pages.
- Statistics of page operations (split, merge, copy, spill, etc) now available through
mdbx_env_info_ex()
. - Auto-setup limit for length of dirty pages list (
MDBX_opt_txn_dp_limit
option). - Support
make options
to list available build options. - Support
make help
to list available make targets. - Silently
make
's build by default. - Preliminary Python bindings is available now by Noel Kuntze (erthink#147).
Backward compatibility break:
- The
MDBX_AVOID_CRT
build option was renamed toMDBX_WITHOUT_MSVC_CRT
. This option is only relevant when building for Windows. - The
mdbx_env_stat()
always, andmdbx_env_stat_ex()
when called with the zeroed transaction parameter, now internally start temporary read transaction and thus may returnsMDBX_BAD_RSLOT
error. So, just never use deprecatedmdbx_env_stat()' and call
mdbx_env_stat_ex()` with transaction parameter. - The build option
MDBX_CONFIG_MANUAL_TLS_CALLBACK
was removed and now just a non-zero value of theMDBX_MANUAL_MODULE_HANDLER
macro indicates the requirement to manually callmdbx_module_handler()
when loading libraries and applications uses statically linked libmdbx on an obsolete Windows versions.
Fixes:
- Fixed performance regression due non-optimal C11 atomics usage (erthink#160).
- Fixed "reincarnation" of subDB after it deletion (erthink#168).
- Fixed (disallowing) implicit subDB deletion via operations on
@MAIN
's DBI-handle. - Fixed a crash of
mdbx_env_info_ex()
in case of a call for a non-open environment (erthink#171). - Fixed the selecting/adjustment values inside
mdbx_env_set_geometry()
for implicit out-of-range cases (erthink#170). - Fixed
mdbx_env_set_option()
for set initial and limit size of dirty page list ((erthink#179). - Fixed an unreasonably huge default upper limit for DB geometry (erthink#183).
- Fixed
constexpr
specifier for theslice::invalid()
. - Fixed (no)readahead auto-handling (erthink#164).
- Fixed non-alloy build for Windows.
- Switched to using Heap-functions instead of LocalAlloc/LocalFree on Windows.
- Fixed
mdbx_env_stat_ex()
to returning statistics of the whole environment instead of MainDB only (erthink#190). - Fixed building by GCC 4.8.5 (added workaround for a preprocessor's bug).
- Fixed building C++ part for iOS <= 13.0 (unavailability of
std::filesystem::path
). - Fixed building for Windows target versions prior to Windows Vista (
WIN32_WINNT < 0x0600
). - Fixed building by MinGW for Windows (erthink#155).
Acknowledgements:
- Mahlon E. Smith for FreeBSD port of libmdbx.
- 장세연 for bug fixing and PR.
- Clément Renault for Heed fully typed Rust wrapper.
- Alex Sharov for bug reporting.
- Noel Kuntze for bug reporting.
Removed options and features:
- Drop
MDBX_HUGE_TRANSACTIONS
build-option (now no longer required).
New features:
- Package for FreeBSD is available now by Mahlon E. Smith.
- New API functions to get/set various options (erthink#128):
- the maximum number of named databases for the environment;
- the maximum number of threads/reader slots;
- threshold (since the last unsteady commit) to force flush the data buffers to disk;
- relative period (since the last unsteady commit) to force flush the data buffers to disk;
- limit to grow a list of reclaimed/recycled page's numbers for finding a sequence of contiguous pages for large data items;
- limit to grow a cache of dirty pages for reuse in the current transaction;
- limit of a pre-allocated memory items for dirty pages;
- limit of dirty pages for a write transaction;
- initial allocation size for dirty pages list of a write transaction;
- maximal part of the dirty pages may be spilled when necessary;
- minimal part of the dirty pages should be spilled when necessary;
- how much of the parent transaction dirty pages will be spilled while start each child transaction;
- Unlimited/Dynamic size of retired and dirty page lists (erthink#123).
- Added
-p
option (purge subDB before loading) tomdbx_load
tool. - Reworked spilling of large transaction and committing of nested transactions:
- page spilling code reworked to avoid the flaws and bugs inherited from LMDB;
- limit for number of dirty pages now is controllable at runtime;
- a spilled pages, including overflow/large pages, now can be reused and refunded/compactified in nested transactions;
- more effective refunding/compactification especially for the loosed page cache.
- Added
MDBX_ENABLE_REFUND
andMDBX_PNL_ASCENDING
internal/advanced build options. - Added
mdbx_default_pagesize()
function. - Better support architectures with a weak/relaxed memory consistency model (ARM, AARCH64, PPC, MIPS, RISC-V, etc) by means C11 atomics.
- Speed up page number lists and dirty page lists (erthink#132).
- Added
LIBMDBX_NO_EXPORTS_LEGACY_API
build option.
Fixes:
- Fixed missing cleanup (null assigned) in the C++ commit/abort (erthink#143).
- Fixed
mdbx_realloc()
for case of nullptr andMDBX_WITHOUT_MSVC_CRT=ON
for Windows. - Fixed the possibility to use invalid and renewed (closed & re-opened, dropped & re-created) DBI-handles (erthink#146).
- Fixed 4-byte aligned access to 64-bit integers, including access to the
bootid
meta-page's field (erthink#153). - Fixed minor/potential memory leak during page flushing and unspilling.
- Fixed handling states of cursors's and subDBs's for nested transactions.
- Fixed page leak in extra rare case the list of retired pages changed during update GC on transaction commit.
- Fixed assertions to avoid false-positive UB detection by CLANG/LLVM (erthink#153).
- Fixed
MDBX_TXN_FULL
and regressiveMDBX_KEYEXIST
during large transaction commit withMDBX_LIFORECLAIM
(erthink#123). - Fixed auto-recovery (
weak->steady
with the same boot-id) when Database size at last weak checkpoint is large than at last steady checkpoint. - Fixed operation on systems with unusual small/large page size, including PowerPC (erthink#157).
Acknowledgements:
- Jens Alfke (Mobile Architect at Couchbase) for NimDBX.
- Clément Renault (CTO at MeiliSearch) for mdbx-rs.
- Alex Sharov (Go-Lang Teach Lead at TurboGeth/Ethereum) for an extreme test cases and bug reporting.
- George Hazan (CTO at Miranda NG) for bug reporting.
- Positive Technologies for funding and The Standoff.
Added features:
- Provided package for buildroot.
- Binding for Nim is available now by Jens Alfke.
- Added
mdbx_env_delete()
for deletion an environment files in a proper and multiprocess-safe way. - Added
mdbx_txn_commit_ex()
with collecting latency information. - Fast completion pure nested transactions.
- Added
LIBMDBX_INLINE_API
macro and inline versions of some API functions. - Added
mdbx_cursor_copy()
function. - Extended tests for checking cursor tracking.
- Added
MDBX_SET_LOWERBOUND
operation formdbx_cursor_get()
.
Fixes:
- Fixed missing installation of
mdbx.h++
. - Fixed use of obsolete
__noreturn
. - Fixed use of
yield
instruction on ARM if unsupported. - Added pthread workaround for buggy toolchain/cmake/buildroot.
- Fixed use of
pthread_yield()
for non-GLIBC. - Fixed use of
RegGetValueA()
on Windows 2000/XP. - Fixed use of
GetTickCount64()
on Windows 2000/XP. - Fixed opening DB on a network shares (in the exclusive mode).
- Fixed copy&paste typos.
- Fixed minor false-positive GCC warning.
- Added workaround for broken
DEFINE_ENUM_FLAG_OPERATORS
from Windows SDK. - Fixed cursor state after multimap/dupsort repeated deletes (erthink#121).
- Added
SIGPIPE
suppression for internal thread duringmdbx_env_copy()
. - Fixed extra-rare
MDBX_KEY_EXIST
error duringmdbx_commit()
(erthink#131). - Fixed spilled pages checking (erthink#126).
- Fixed
mdbx_load
for 'plain text' and without-s name
cases (erthink#136). - Fixed save/restore/commit of cursors for nested transactions.
- Fixed cursors state in rare/special cases (move next beyond end-of-data, after deletion and so on).
- Added workaround for MSVC 19.28 (Visual Studio 16.8) (but may still hang during compilation).
- Fixed paranoidal Clang C++ UB for bitwise operations with flags defined by enums.
- Fixed large pages checking (for compatibility and to avoid false-positive errors from
mdbx_chk
). - Added workaround for Wine (miranda-ng/miranda-ng#1209).
- Fixed
ERROR_NOT_SUPPORTED
while opening DB by UNC pathnames (miranda-ng/miranda-ng#2627). - Added handling
EXCEPTION_POSSIBLE_DEADLOCK
condition for Windows.
Added features:
- Preliminary C++ API with support for C++17 polymorphic allocators.
- Online C++ API reference by Doxygen.
- Quick reference for Insert/Update/Delete operations.
- Explicit
MDBX_SYNC_DURABLE
to sync modes for API clarity. - Explicit
MDBX_ALLDUPS
andMDBX_UPSERT
for API clarity. - Support for read transactions preparation (
MDBX_TXN_RDONLY_PREPARE
flag). - Support for cursor preparation/(pre)allocation and reusing (
mdbx_cursor_create()
andmdbx_cursor_bind()
functions). - Support for checking database using specified meta-page (see
mdbx_chk -h
). - Support for turn to the specific meta-page after checking (see
mdbx_chk -h
). - Support for explicit reader threads (de)registration.
- The
mdbx_txn_break()
function to explicitly mark a transaction as broken. - Improved handling of corrupted databases by
mdbx_chk
utility andmdbx_walk_tree()
function. - Improved DB corruption detection by checking parent-page-txnid.
- Improved opening large DB (> 4Gb) from 32-bit code.
- Provided
pure-function
andconst-function
attributes to C API. - Support for user-settable context for transactions & cursors.
- Revised API and documentation related to Handle-Slow-Readers callback feature.
Deprecated functions and flags:
- For clarity and API simplification the
MDBX_MAPASYNC
flag is deprecated. Just useMDBX_SAFE_NOSYNC
orMDBX_UTTERLY_NOSYNC
instead of it. MDBX_oom_func
,mdbx_env_set_oomfunc()
andmdbx_env_get_oomfunc()
replaced withMDBX_hsr_func
,mdbx_env_get_hsr
andmdbx_env_get_hsr()
.
Fixes:
- Fix
mdbx_strerror()
forMDBX_BUSY
error (no error description is returned). - Fix update internal meta-geo information in read-only mode (
EACCESS
orEBADFD
error). - Fix
mdbx_page_get()
null-defer when DB corrupted (crash bySIGSEGV
). - Fix
mdbx_env_open()
for re-opening after non-fatal errors (mdbx_chk
unexpected failures). - Workaround for MSVC 19.27
static_assert()
bug. - Doxygen descriptions and refinement.
- Update Valgrind's suppressions.
- Workaround to avoid infinite loop of 'nested' testcase on MIPS under QEMU.
- Fix a lot of typos & spelling (Thanks to Josh Soref for PR).
- Fix
getopt()
messages for Windows (Thanks to Andrey Sporaw for reporting). - Fix MSVC compiler version requirements (Thanks to Andrey Sporaw for reporting).
- Workarounds for QEMU's bugs to run tests for cross-builded library under QEMU.
- Now C++ compiler optional for building by CMake.
Added features:
- Online C API reference by Doxygen.
- Separated enums for environment, sub-databases, transactions, copying and data-update flags.
Deprecated functions and flags:
- Usage of custom comparators and the
mdbx_dbi_open_ex()
are deprecated, since such databases couldn't be checked by themdbx_chk
utility. Please use the value-to-key functions to provide keys that are compatible with the built-in libmdbx comparators.
- Added support multi-opening the same DB in a process with SysV locking (BSD).
- Fixed warnings & minors for LCC compiler (E2K).
- Enabled to simultaneously open the same database from processes with and without the
MDBX_WRITEMAP
option. - Added key-to-value,
mdbx_get_keycmp()
andmdbx_get_datacmp()
functions (helpful to avoid using custom comparators). - Added
ENABLE_UBSAN
CMake option to enabling the UndefinedBehaviorSanitizer from GCC/CLANG. - Workaround for CLANG bug.
- Returning
MDBX_CORRUPTED
in case all meta-pages are weak and no other error. - Refined mode bits while auto-creating LCK-file.
- Avoids unnecessary database file re-mapping in case geometry changed by another process(es).
From the user's point of view, the
MDBX_UNABLE_EXTEND_MAPSIZE
error will now be returned less frequently and only when using the DB in the current process really requires it to be reopened. - Remapping on-the-fly and of the database file was implemented. Now remapping with a change of address is performed automatically if there are no dependent readers in the current process.
- Minor change versioning. The last number in the version now means the number of commits since last release/tag.
- Provide ChangeLog file.
- Fix for using libmdbx as a C-only sub-project with CMake.
- Fix
mdbx_env_set_geometry()
for case it is called from an opened environment outside of a write transaction. - Add support for huge transactions and
MDBX_HUGE_TRANSACTIONS
build-option (defaultOFF
). - Refine LTO (link time optimization) for clang.
- Force enabling exceptions handling for MSVC (
/EHsc
option).
- Support for Android/Bionic.
- Support for iOS.
- Auto-handling
MDBX_NOSUBDIR
while opening for any existing database. - Engage github-actions to make release-assets.
- Clarify API description.
- Extended keygen-cases in stochastic test.
- Fix fetching of first/lower key from LEAF2-page during page merge.
- Fix missing comma in array of error messages.
- Fix div-by-zero while copy-with-compaction for non-resizable environments.
- Fixes & enhancements for custom-comparators.
- Fix
MDBX_WITHOUT_MSVC_CRT
option and missingntdll.def
. - Fix
mdbx_env_close()
to work correctly called concurrently from several threads. - Fix null-deref in an ASAN-enabled builds while opening the environment with error and/or read-only.
- Fix AddressSanitizer errors after closing the environment.
- Fix/workaround to avoid GCC 10.x pedantic warnings.
- Fix using
ENODATA
for FreeBSD. - Avoid invalidation of DBI-handle(s) when it just closes.
- Avoid using
pwritev()
for single-writes (up to 10% speedup for some kernels & scenarios). - Avoiding
MDBX_UTTERLY_NOSYNC
as result of flags merge. - Add
mdbx_dbi_dupsort_depthmask()
function. - Add
MDBX_CP_FORCE_RESIZEABLE
option. - Add deprecated
MDBX_MAP_RESIZED
for compatibility. - Add
MDBX_BUILD_TOOLS
option (defaultON
). - Refine
mdbx_dbi_open_ex()
to safe concurrently opening the same handle from different threads. - Truncate clk-file during environment closing. So a zero-length lck-file indicates that the environment was closed properly.
- Refine
mdbx_update_gc()
for huge transactions with small sizes of database page. - Extends dump/load to support all MDBX attributes.
- Avoid upsertion the same key-value data, fix related assertions.
- Rework min/max length checking for keys & values.
- Checking the order of keys on all pages during checking.
- Support
CFLAGS_EXTRA
make-option for convenience. - Preserve the last txnid while copying with compactification.
- Auto-reset running transaction in mdbx_txn_renew().
- Automatically abort errored transaction in mdbx_txn_commit().
- Auto-choose page size for large databases.
- Rearrange source files, rework build, options-support by CMake.
- Crutch for WSL1 (Windows subsystem for Linux).
- Refine install/uninstall targets.
- Support for Valgrind 3.14 and later.
- Add check-analyzer check-ubsan check-asan check-leak targets to Makefile.
- Minor fix/workaround to avoid UBSAN traps for
memcpy(ptr, NULL, 0)
. - Avoid some GCC-analyzer false-positive warnings.
- Workarounds for Wine (Windows compatibility layer for Linux).
MDBX_MAP_RESIZED
renamed toMDBX_UNABLE_EXTEND_MAPSIZE
.- Clarify API description, fix typos.
- Speedup runtime checks in debug/checked builds.
- Added checking for read/write transactions overlapping for the same thread, added
MDBX_TXN_OVERLAPPING
error andMDBX_DBG_LEGACY_OVERLAP
option. - Added
mdbx_key_from_jsonInteger()
,mdbx_key_from_double()
,mdbx_key_from_float()
,mdbx_key_from_int64()
andmdbx_key_from_int32()
functions. Seemdbx.h
for description. - Fix compatibility (use zero for invalid DBI).
- Refine/clarify error messages.
- Avoids extra error messages "bad txn" from mdbx_chk when DB is corrupted.
- Fix
mdbx_load
utility for custom comparators. - Fix checks related to
MDBX_APPEND
flag insidemdbx_cursor_put()
. - Refine/fix dbi_bind() internals.
- Refine/fix handling
STATUS_CONFLICTING_ADDRESSES
. - Rework
MDBX_DBG_DUMP
option to avoid disk I/O performance degradation. - Add built-in help to test tool.
- Fix
mdbx_env_set_geometry()
for large page size. - Fix env_set_geometry() for large pagesize.
- Clarify API description & comments, fix typos.
- Fix returning MDBX_RESULT_TRUE from page_alloc().
- Fix false-positive ASAN issue.
- Fix assertion for
MDBX_NOTLS
option. - Rework
MADV_DONTNEED
threshold. - Fix
mdbx_chk
utility for don't checking some numbers if walking on the B-tree was disabled. - Use page's mp_txnid for basic integrity checking.
- Add
MDBX_FORCE_ASSERTIONS
built-time option. - Rework
MDBX_DBG_DUMP
to avoid performance degradation. - Rename
MDBX_NOSYNC
toMDBX_SAFE_NOSYNC
for clarity. - Interpret
ERROR_ACCESS_DENIED
fromOpenProcess()
as 'process exists'. - Avoid using
FILE_FLAG_NO_BUFFERING
for compatibility with small database pages. - Added install section for CMake.
- Support for Mac OSX, FreeBSD, NetBSD, OpenBSD, DragonFly BSD, OpenSolaris, OpenIndiana (AIX and HP-UX pending).
- Use bootid for decisions of rollback.
- Counting retired pages and extended transaction info.
- Add
MDBX_ACCEDE
flag for database opening. - Using OFD-locks and tracking for in-process multi-opening.
- Hot backup into pipe.
- Support for cmake & amalgamated sources.
- Fastest internal sort implementation.
- New internal dirty-list implementation with lazy sorting.
- Support for lazy-sync-to-disk with polling.
- Extended key length.
- Last update transaction number for each sub-database.
- Automatic read ahead enabling/disabling.
- More auto-compactification.
- Using -fsanitize=undefined and -Wpedantic options.
- Rework page merging.
- Nested transactions.
- API description.
- Checking for non-local filesystems to avoid DB corruption.