-
Notifications
You must be signed in to change notification settings - Fork 0
/
ChangeLog
341 lines (294 loc) · 14.4 KB
/
ChangeLog
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
Thu Jul 13 2017 Krzysztof Czurylo <krzysztof.czurylo@intel.com>
* Version 1.3
This release introduces some useful features and optimizations
in libpmemobj. Most of them are experimental and controlled by
the new pmemobj_ctl APIs. For details, please check the feature
requests identified by the issue numbers listed next to the items below.
Other important changes are related to performance tuning and
stabilization of librpmem library, which is used by libpmemobj to get
remote access to persistent memory and to provide basic data replication
over RDMA. The librpmem is still considered experimental.
NVML for Windows is feature complete (except for libvmmalloc).
This release includes the support for Unicode, long paths and
the NVML installer.
New features:
- common: add support for concatenated DAX Devices
- common: add Unicode support on Windows
- common: add long path support on Windows
- common: add NVML installer for Windows
- pmem: make pmem_is_pmem() true for Device DAX only
- obj: add pmemobj_wcsdup()/pmemobj_tx_wcsdup() APIs
- obj: export non-inlined pmemobj_direct()
- obj: add PMEMOBJ_NLANES env variable
- cpp: introduce the allocator
- cpp: add wstring version of C++ entry points
- vmem: add vmem_wcsdup() API entry
- pool: add pmempool_rm() function (#307)
- pool: add --force flag for create command (#529)
- benchmark: add a minimal execution time option
- benchmark: add thread affinity option
- benchmark: print 99% and 99.9% percentiles
- doc: separate Linux/Windows version of web-based man pages
Optimizations:
- obj: cache _pobj_cached_pool in pmemobj_direct()
- obj: optimize thread utilization of buckets
- obj: stop grabbing a lock when querying pool ptr
- rpmem: use multiple endpoints
Bug fixes:
- common: fix issues reported by static code analyzers
- pmem: fix mmap() implementation on Windows
- pmem: fix mapping addr/length alignment on Windows
- pmem: fix PMEM_MMAP_HINT implementation on Windows
- pmem: fix pmem_is_pmem() on invalid memory ranges
- pmem: fix wrong is_pmem returned by pmem_map_file()
- pmem: fix mprotect() for private mappings on Windows
- pmem: modify pmem_is_pmem() behavior for len==0
- obj: add failsafe to prevent allocs in constructor
- cpp: fix swap implementation
- cpp: fix sync primitives' constructors
- cpp: fix wrong pointer type in the allocator
- cpp: return persistent_ptr::swap to being public
- pool: treat invalid answer as 'n'
- pool: unify flags value for dry run
- pool: transform for remote replicas
- rpmem: persistency method detection
- benchmark: fix time measurement
Experimental features/optimizations:
- obj: pmemobjctl - statistics and control submodule (#194, #211)
- obj: zero-overhead allocations - customizable alloc header (#347)
- obj: flexible run size index (#377)
- obj: dynamic range cache (#378)
- obj: asynchronous post-commit (#381)
- obj: configurable object cache (#515)
- obj: add cache size and threshold tx params
- obj: add CTL var for suppressing expensive checks
- rpmem: add rpmem_set_attr() API entry
- rpmem: switch to libfabric v1.4.2
Thu May 18 2017 Krzysztof Czurylo <krzysztof.czurylo@intel.com>
* Version 1.2.3
Bug fixes:
- test: extend timeout for selected tests
- test: reduce number of operations in obj_tx_mt
- test: define cfree() as free() in vmmalloc_calloc
Other changes:
- common: move Docker images to new repo
Sat Apr 15 2017 Krzysztof Czurylo <krzysztof.czurylo@intel.com>
* Version 1.2.2
Bug fixes:
- pmempool: fix mapping type in pool_params_parse
- test: limit number of arenas in vmem_stats
- test: do not run pool_lock test as root
- common: fix pkg-config files
- common: fix building packages for Debian
Tue Feb 21 2017 Krzysztof Czurylo <krzysztof.czurylo@intel.com>
* Version 1.2.1
This NVML release changes the behavior of pmem_is_pmem() on Linux.
The pmem_is_pmem() function will now return true only if the entire
range is mapped directly from Device DAX (/dev/daxX.Y) without an
intervening file system, and only if the corresponding file mapping
was created with pmem_map_file(). See libpmem(3) for details.
Bug fixes:
- jemalloc: fix test compilation on Fedora 26 (rawhide)
- test: fix cpp test compilation on Fedora 26 (rawhide)
- common: use same queue.h on linux and windows
- common: queue.h clang static analyzer fix
- common: fix path handling in build-dpkg.sh
- test: fix match files in pmempool_transform/TEST8
Fri Dec 30 2016 Krzysztof Czurylo <krzysztof.czurylo@intel.com>
* Version 1.2 - Windows Technical Preview #1
This is the first Technical Preview release of NVML for Windows.
It is based on NVML 1.2 version, but not all the 1.2 features
are ported to Windows. In particular, Device DAX and remote access
to persistent memory (librpmem) are not supported by design.
NOTE: This release has not gone through the full validation cycle,
but only through some basic tests on Travis and AppVeyor.
Thus, it cannot be assumed "Production quality" and should not
be used in production environments.
Besides several minor improvements and bug fixes, all the other
changes since NVML 1.2 release were related to Windows support:
- win: port libvmem (and jemalloc)
- win: benchmarks Windows port
- win: fix mapping files of unaligned length
- win: clean up possible race condition in mmap_init()
- win: enable QueryVirtualMemoryInformation() in pmem_is_pmem()
- test: check open handles at START/DONE
- test: port all the remaining unit tests
(scope, pmem_map, obj_debug, util_poolset, pmempool_*)
- win: add resource files for versioning
Known issues and limitations of Windows version of NVML:
- Unicode support is missing. The UTF/USC-encoded file paths
or pool set files may not be handled correctly.
- The libvmmalloc library is not ported yet.
- The on-media format of pmem pools is not portable at the moment.
The pmem pools created using Windows version of NVM libraries
cannot be open on Linux and vice versa.
- Despite the fact the current version of NVML would work
with any recent version of Windows OS, to take full
advantage of PMEM and NVML features and to benefit from
the PMEM performance, the recommended platforms needs be
equipped with the real NVDIMMs hardware and should support
the native, Microsoft's implementation of DAX-enabled file
system (i.e. Windows Server 2016 or later).
In case of using NVML with older versions of Windows or with
the custom implementation of PMEM/DAX drivers, the performance
might not be satisfactory. Please, contact the provider
of PMEM/DAX drivers for your platform to get the customized
version of NVML in such case.
Thu Dec 15 2016 Krzysztof Czurylo <krzysztof.czurylo@intel.com>
* Version 1.2
This NVML release causes a "flag day" for libpmemobj.
The pmemobj pools built under NVML 1.1 are incompatible with pools built
under NVML 1.2 and later. This is because an issue was discovered with
the alignment of locks (#358) and, although rare, the issue potentially
impacts program correctness, making the fix mandatory.
The major version number of the pmemobj pool layout and the version
of the libpmemobj API is changed to prevent the use of the potentially
incorrect layout.
Other key changes introduced in this release:
- Add Device DAX support, providing that "optimized flush" mechanism
defined in SNIA NVM Programming Model can safely be used, even
if PMEM-aware file system supporting that model is not available,
or if the user does not want to use the file system for some reason.
- Add a package for libpmemobj C++ bindings.
C++ API is no longer considered experimental.
Web-based documentation for C++ API is available on http://pmem.io.
- Add "sync" and "transform" commands to pmempool utility.
The "sync" command allows to recover missing or corrupted part(s)
of a pool set from a healthy replica, while the "transform" command
is a convenient way for modifying the structure of an existing
pool set, i.e. by adding or removing replicas.
- Add experimental support for remote access to persistent memory and
basic remote data replication over RDMA (librpmem). Experimental
support for remote replicas is also provided by libpmemobj library.
New features:
- common: add Device DAX support (#197)
- obj: add C++ bindings package (libpmemobj++-devel)
- obj: add TOID_OFFSETOF macro
- pmempool: add "sync" and "transform" commands (#172, #196)
Bug fixes:
- obj: force alignment of pmem lock structures (#358)
- blk: cast translation entry to uint64_t when calculating data offset
- obj: fix Valgrind instrumentation of chunk headers and cancelled
allocations
- obj: set error message when user called pmemobj_tx_abort()
- obj: fix status returned by pmemobj_list_insert() (#226)
- obj: defer allocation of global structures
Optimizations:
- obj: fast path for pmemobj_pool_by_ptr() when inside a transaction
- obj: simplify and optimize allocation class generation
Experimental features:
- rpmem: add support for remote access to persistent memory and basic
remote data replication over RDMA
- libpmempool: add pmempool_sync() and pmempool_transform() (#196)
- obj: introduce pmemobj_oid()
- obj: add pmemobj_tx_xalloc()/pmemobj_tx_xadd_range() APIs and
the corresponding macros
- obj: add transaction stage transition callbacks
Thu Jun 23 2016 Krzysztof Czurylo <krzysztof.czurylo@intel.com>
* Version 1.1
This NVML release introduces a new version of libpmemobj pool layout.
Internal undo log structure has been modified to improve performance
of pmemobj transactions. Memory pools created with older versions
of the libpmemobj library must be converted to the new format using
"pmempool convert" command. See pmempool-convert(1) for details.
A new "libpmempool" library is available, providing support for
off-line pool management and diagnostics. Initially it provides only
"check" and "repair" operations for log and blk memory pools, and for
BTT devices.
Other changes:
- pmem: deprecate PCOMMIT
- blk: match BTT Flog initialization with Linux NVDIMM BTT
- pmem: defer pmem_is_pmem() initialization (#158)
- obj: add TOID_TYPEOF macro
Bug fixes:
- doc: update description of valid file size units (#133)
- pmempool: fix --version short option in man page (#135)
- pmempool: print usage when running rm without arg (#136)
- cpp: clarify polymorphism in persistent_ptr (#150)
- obj: let the before flag be any non-zero value (#151)
- obj: fix compare array pptr to nullptr (#152)
- obj: cpp pool.get_root() fix (#156)
- log/blk: set errno if replica section is specified (#161)
- cpp: change exception message (#163)
- doc: remove duplicated words in man page (#164)
- common: always append EXTRA_CFLAGS after our CFLAGS
Experimental features:
- Implementation of C++ bindings for libpmempobj is complete.
Web-based documentation for C++ API is available on http://pmem.io.
Note that C++ API is still considered experimental. Do not use it
in production environments.
- Porting NVML to Windows is in progress. There are MS Visual Studio
solution/projects available, allowing to compile libpmem, libpmemlog,
libpmemblk and libpmemobj on Windows, but the libraries are not fully
functional and most of the test are not enabled yet.
Thu Apr 07 2016 Krzysztof Czurylo <krzysztof.czurylo@intel.com>
* Version 1.0
The API of six libraries (libpmem, libpmemblk, libpmemlog,
libpmemobj, libvmem, libvmmalloc) is complete and stable.
The on-media layout of persistent memory pools will be maintained
from this point, and if changed it will be backward compatible.
Man pages are all complete.
This release has been validated to "Production quality".
For the purpose of new features planned for next releases of NVML
there have been some API modifications made:
- pmem: pmem_map replaced with pmem_map_file
- log/blk: 'off_t' substituted with 'long long'
- obj: type numbers extended to 64-bit
- obj: new entry points and macros added:
pmemobj_tx_errno, pmemobj_tx_lock, pmemobj_mutex_timedlock,
TX_ADD_DIRECT, TX_ADD_FIELD_DIRECT, TX_SET_DIRECT
Other key changes since version 0.4 include:
- common: updated/fixed installation scripts
- common: eliminated dependency on libuuid
- pmem: CPU features/ISA detection using CPUID
- obj: improved error handling
- obj: atomic allocation fails if constructor returns error
- obj: multiple performance optimizations
- obj: object store refactoring
- obj: additional examples and benchmarks
This release also introduces a prototype implementation
of C++ bindings for libpmemobj. Note that C++ API is still
experimental and should not be used in production environments.
Fri Dec 04 2015 Krzysztof Czurylo <krzysztof.czurylo@intel.com>
* Version 0.4
This NVML version primarily focuses on improving code quality
and reliability. In addition to a couple of bug fixes,
the changes include:
- benchmarks for libpmemobj, libpmemblk and libvmem
- additional pmemobj tests and examples
- pool mapping address randomization
- added pmempool "rm" command
- eliminated libpmem dependency on libpthread
- enabled extra warnings
- minor performance improvements
Man pages are all complete.
This release is considered "Beta quality" by the team, having
been thoroughly validated, including significant performance analysis.
The pmempool command does not yet support "check" and "repair"
operations for pmemobj type pools.
Sun Sep 13 2015 Andy Rudoff <andy.rudoff@intel.com>
* Version 0.3
NVML is now feature complete, adding support for:
- pool sets
- pmemobj local replication (active/passive)
- experimental valgrind support
- pmempool support for all pool types
Man pages are all complete.
This release is considered "Alpha quality" by the team, having
gone through significant validation but only some performance
analysis at this point.
Tue Jun 30 2015 Andy Rudoff <andy.rudoff@intel.com>
* Version 0.2
NVML now consists of six libraries:
- libpmem (basic flushing, etc)
- libpmemblk, libpmemlog, libpmemobj (transactions)
- libvmem, libvmmalloc (volatile use of pmem)
The "pmempool" command is available for managing pmem files.
Man pages for all the above are complete.
The only things documented in man pages but not implemented are:
- pmem sets (ability to spread a pool over a set of files)
- replication (coming for libpmemobj)
The pmempool command does not yet support pmemobj type pools.
Thu Sep 11 2014 Andy Rudoff <andy.rudoff@intel.com>
* Version 0.1
Initial development done in 0.1 builds