1 Mnesia Release Notes
This document describes the changes made to the Mnesia system from version to version. The intention of this document is to list all incompatibilities as well as all enhancements and bugfixes for every release of Mnesia. Each release of Mnesia thus constitutes one section in this document. The title of each section is the version number of Mnesia.
1.1 Mnesia 4.18
Fixed Bugs and Malfunctions
-
FIx mnesia delete object handling in transaction storage. In a transaction mnesia:read/1 could indicate that exiting objects did not exist after another object was deleted.
Own Id: OTP-16782 Aux Id: PR-2663
Improvements and New Features
-
Fixed crash during startup, which could happen if a table was deleted on another node.
Own Id: OTP-16815 Aux Id: ERIERL-500
1.2 Mnesia 4.17
Fixed Bugs and Malfunctions
-
Make mnesia:create_table/2 return correct badarg value.
Own Id: OTP-16072 Aux Id: PR-2320
-
Fixed a bug where mnesia was sometimes not waiting during start for a commit decision on asymmetric transactions.
Own Id: OTP-16634 Aux Id: PR-2610 ERL-1227
Improvements and New Features
-
Remove usage and documentation of old requests of the I/O-protocol.
Own Id: OTP-15695
-
Avoid using rpc calls to do table reads, which will reduce the load on rpc server and improve performance.
Own Id: OTP-16189
1.3 Mnesia 4.16.3
Fixed Bugs and Malfunctions
-
Fixed a timing issue in uninstall fallback functionality.
Own Id: OTP-16468 Aux Id: ERL-1151
1.4 Mnesia 4.16.2
Fixed Bugs and Malfunctions
-
Fixed mnesia crash which could happen when trying to recover from failures in transactions containing sticky_locks.
Own Id: OTP-16286 Aux Id: ERL-1077
-
Fixed mnesia index issue. Could happen when updating records with a index plugin backend.
Own Id: OTP-16291 Aux Id: ERL-1091
1.5 Mnesia 4.16.1
Fixed Bugs and Malfunctions
-
mnesia:add_table_copy/3 could cause a deadlock if called when a new node was starting.
Own Id: OTP-15933 Aux Id: ERL-872
-
Transactions with sticky locks could with async_asym transactions be committed in the wrong order, since asym transaction are spawned on the remote nodes.
To fix this bug the communication protocol between mnesia nodes had to be updated, thus mnesia will no longer be able to connect to nodes earlier than mnesia-4.14 , OTP-19.0.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-15979 Aux Id: ERL-768
1.6 Mnesia 4.16
Fixed Bugs and Malfunctions
-
Optimize mnesia:read/1 if data have been written in the same transaction.
Own Id: OTP-15550 Aux Id: PR-2029
-
Fixed bugs in table index plugin handling.
Own Id: OTP-15689 Aux Id: PR-1695 ERL-556
Improvements and New Features
-
Optimized dumping of tables with plugin backends.
Own Id: OTP-15588 Aux Id: PR-2102
-
Include stacktrace in exception if a dirty activity errors, thus if user have matched on the error thrown it may not match any more.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-15804 Aux Id: PR-2216
1.7 Mnesia 4.15.6
Fixed Bugs and Malfunctions
-
Avoid overload warnings caused by a race condition.
Own Id: OTP-15619 Aux Id: ERIERL-310
1.8 Mnesia 4.15.5
Fixed Bugs and Malfunctions
-
Fixed type spec for mnesia:change_config/2.
Own Id: OTP-15201 Aux Id: PR-1881
-
When master node is set do not force a load from ram_copies replica when there are no available disc_copies, since that would load an empty table. Wait until a disk replica is available or until user explicitly force_loads the table.
Own Id: OTP-15221 Aux Id: ERIERL-217
-
Allow to add replicas even if all other replicas are down when the other replicas are not stored on disk.
Own Id: OTP-15226 Aux Id: ERIERL-221
-
Fixed mnesia:delete_object/1 bug, where delete_object was deleting the record if it was written in the same transaction even if it was written to a different value.
Own Id: OTP-15231 Aux Id: PR-1858
-
Fixed a bug where the bag table index data was not deleted when objects were deleted.
Own Id: OTP-15243
1.9 Mnesia 4.15.4
Improvements and New Features
-
Calls to erlang:get_stacktrace() are removed.
Own Id: OTP-14861
1.10 Mnesia 4.15.3.1
Fixed Bugs and Malfunctions
-
When master node is set do not force a load from ram_copies replica when there are no available disc_copies, since that would load an empty table. Wait until a disk replica is available or until user explicitly force_loads the table.
Own Id: OTP-15221 Aux Id: ERIERL-217
-
Allow to add replicas even if all other replicas are down when the other replicase are not stored on disk.
Own Id: OTP-15226 Aux Id: ERIERL-221
1.11 Mnesia 4.15.3
Fixed Bugs and Malfunctions
-
Removed a quadratic behavior in startup. This change implies that backend plugins (if used) must be set when the schema is created or via configuration parameters before mnesia is started.
Own Id: OTP-14829 Aux Id: ERIERL-84
-
Bad timing could crash mnesia after a checkpoint was deactivated and reactivated with the same checkpoint name on different tables.
Own Id: OTP-14841 Aux Id: ERIERL-113
1.12 Mnesia 4.15.2
Fixed Bugs and Malfunctions
-
Fix backup error handling, the real failure reason was not returned.
Own Id: OTP-14776 Aux Id: ERIERL-103
1.13 Mnesia 4.15.1
Improvements and New Features
-
General Unicode improvements.
Own Id: OTP-14462
1.14 Mnesia 4.15
Improvements and New Features
-
Removed the wrapping of select continuations in extension plugin handling. This might require the user to rewrite user backend plugin if used.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14039
1.15 Mnesia 4.14.3
Fixed Bugs and Malfunctions
-
Fixed crash in checkpoint handling when table was deleted during backup.
Own Id: OTP-14167
1.16 Mnesia 4.14.2
Fixed Bugs and Malfunctions
-
A continuation returned by mnesia:select/[14] should be reusable in different, non-transactional activities.
Own Id: OTP-13944 Aux Id: PR-1184
-
Fixed crash when calling block_table multiple times. Could happen when having locks for a long time and restarting mnesia.
Own Id: OTP-13970 Aux Id: Seq-13198
-
Change mnesia_tm process to have off-heap messages since mnesia_tm can be the receiver of many non-synchronized message from other nodes.
Own Id: OTP-14074
1.17 Mnesia 4.14.1
Improvements and New Features
-
Correct some minor documentation issues.
Own Id: OTP-13891
1.18 Mnesia 4.14
Improvements and New Features
-
Added experimental external backend plugin api. This adds the possibility for the user to write other storage backends for data, for example by using shared memory or ram-cached disk storage.
The plugin api may change in future versions after being battle tested.
Own Id: OTP-13058
1.19 Mnesia 4.13.4
Fixed Bugs and Malfunctions
-
Mnesia transactions could hang while waiting on a response from a node who had stopped.
Own Id: OTP-13423
1.20 Mnesia 4.13.3
Fixed Bugs and Malfunctions
-
Avoid deadlock possibility in mnesia:del_table_copy/2
Own Id: OTP-13284
1.21 Mnesia 4.13.2
Fixed Bugs and Malfunctions
-
Fixed a process and file descriptor leak in mnesia:restore/2.
Own Id: OTP-13025 Aux Id: seq12957
1.22 Mnesia 4.13.1
Fixed Bugs and Malfunctions
-
Improved index updates to avoid a timing glitch in dirty_index_read.
Own Id: OTP-12972
1.23 Mnesia 4.13
Fixed Bugs and Malfunctions
-
Mnesia's dirty functions did not always exit with {aborted, Reason} as documented when an error occurred.
Own Id: OTP-12714
-
Consider file descriptors limits (emfile) as a fatal error and do not delete log files. Previously the error was seen as a corrupted disk and the log files deleted which caused data loss.
Own Id: OTP-12807
Improvements and New Features
-
Make Mnesia DCD dump behavior at start up optional, when turned off mnesia loads large disc_copies tables faster.
Own Id: OTP-12481
1.24 Mnesia 4.12.5
Fixed Bugs and Malfunctions
-
Fixed race condition in protocol negotiation.
Own Id: OTP-12473
Improvements and New Features
-
Grammar corrections. (Thanks to Derek Brown)
Own Id: OTP-12400
1.25 Mnesia 4.12.4
Fixed Bugs and Malfunctions
-
Fixed a spelling mistake in mnesia documentation.
Own Id: OTP-12278
-
Matching data with mnesia:match_object/1 did not work as expected in some cases, when data was written in the same transaction before the matching was invoked.
Own Id: OTP-12304 Aux Id: Seq12745
1.26 Mnesia 4.12.3
Fixed Bugs and Malfunctions
-
Various logging fixes, including: Add run queue index to the process dump in crash dumps.
Add thread index to enomem slogan when crashing.
Remove error logger message for sending messages to old instances of the same node.Own Id: OTP-12115
1.27 Mnesia 4.12.2
Fixed Bugs and Malfunctions
-
Fixed a race which could make create_table fail if a node was going down during the transaction.
Own Id: OTP-12124 Aux Id: seq12694
1.28 Mnesia 4.12.1
Fixed Bugs and Malfunctions
-
Force load table could hang when a node went away during start up.
Own Id: OTP-11948 Aux Id: seq12585
-
The time for inserting locks for a transaction with large number of locks is reduced significantly.
Own Id: OTP-11981
1.29 Mnesia 4.12
Fixed Bugs and Malfunctions
-
Some local implementations of removing the last element from a list are replaced by lists:droplast/1. Note that this requires at least stdlib-2.0, which is the stdlib version delivered in OTP 17.0. (Thanks to Hans Svensson)
Own Id: OTP-11678
-
Application upgrade (appup) files are corrected for the following applications:
asn1, common_test, compiler, crypto, debugger, dialyzer, edoc, eldap, erl_docgen, et, eunit, gs, hipe, inets, observer, odbc, os_mon, otp_mibs, parsetools, percept, public_key, reltool, runtime_tools, ssh, syntax_tools, test_server, tools, typer, webtool, wx, xmerl
A new test utility for testing appup files is added to test_server. This is now used by most applications in OTP.
(Thanks to Tobias Schlager)
Own Id: OTP-11744
Improvements and New Features
-
To prevent a race condition if there is a short communication problem when node-down and node-up events are received. They are now stored and later checked if the node came up just before mnesia flagged the node as down. (Thanks to Jonas Falkevik )
Own Id: OTP-11497
-
Added mnesia:sync_log/0 to explicit sync mnesias transaction log.
Own Id: OTP-11729
1.30 Mnesia 4.11
Fixed Bugs and Malfunctions
-
Fixed a race in mnesia which could cause hanging transaction when sticky locks had been used. Thanks janchochol.
Own Id: OTP-11375
-
Fixed dirty_update_counter which could return ok, thanks Anton Ryabkov.
Own Id: OTP-11485
1.31 Mnesia 4.10
Fixed Bugs and Malfunctions
-
Fix timing issues in checkpoint creation.
Own Id: OTP-10957
Improvements and New Features
-
Fixed a problem where the fallback BUP file is removed when calling mnesia:uninstall_fallback and mnesia is not started.
Own Id: OTP-11241
1.32 Mnesia 4.9
Fixed Bugs and Malfunctions
-
If mnesia:clear_table/2 was called during a table load on that table, the schema record was written to the table instead of clearing table.
Own Id: OTP-11030 Aux Id: seq12267
Improvements and New Features
-
Optimize index creation for Mnesia set tables. Thanks to Nick Marino.
Own Id: OTP-11103
1.33 Mnesia 4.8
Fixed Bugs and Malfunctions
-
Use chained send_after instead of send_interval, to make decrease the number of messages sent after a sleep (Thanks to James Wheare)
Own Id: OTP-10636
-
Fix format of mnesia overload message (Thanks to Ahmed Omar)
Own Id: OTP-10639
Improvements and New Features
-
Added a general framework for executing benchmarks of Erlang/OTP. Benchmarks for the Erlang VM and mnesia have been incorporated in the framework.
For details about how to add more benchmarks see $ERL_TOP/HOWTO/BENCHMARKS.md in the source distribution.
Own Id: OTP-10156
-
Where necessary a comment stating encoding has been added to Erlang files. The comment is meant to be removed in Erlang/OTP R17B when UTF-8 becomes the default encoding.
Own Id: OTP-10630
-
Remove support for the query keyword and query expressions. Thanks to Loïc Hoguin.
Own Id: OTP-10729
1.34 Mnesia 4.7.1
Fixed Bugs and Malfunctions
-
Add tests showing that trying to delete non-existing object may corrupt the
In case of bag tables, trying to delete a non-existing object leads to the index becoming corrupt. This happens if the non-existing object we try to delete happens to share its key and index field value with a single existing object in the table. Result: The index entry corresponding to the existing object is removed.
Prevent index from being corrupted if a nonexistent item is deleted
We have to ensure that we actually delete the last object with a given (key, index) pair before removing the index. Thanks to Bartlomiej Puzon
Own Id: OTP-10220
1.35 Mnesia 4.7
Fixed Bugs and Malfunctions
-
Returns the same value for mnesia_loader:disc_load_table/2 as mnesia_loader:net_load_table/4 if a table copy cannot be found. (Thanks to Uwe Dauernheim)
Own Id: OTP-10015
Improvements and New Features
-
Improved table lock algorithm.
Own Id: OTP-9890
1.36 Mnesia 4.6
Fixed Bugs and Malfunctions
-
Reduce calls to phash in key_to_frag_number
Original code calls phash 1..2 times, based on which fragment the hashed key targets and how many fragments exist. New code always calls phash only once.
Add mnesia_frag_hash test (Thanks to Philip Robinson)
Own Id: OTP-9722
-
Fixed a sticky lock bug which caused mnesia:read(Tab, Key, write) return undefined.
Own Id: OTP-9786
-
Use the synchronous log_terms instead of alog_terms in mnesia_log:ets2dcd()
This avoids the situation where mnesia could dump a very large ets table in its entirety into the message queue of the disk_log process, causing memory blowup and choking the disk logger. (Thanks to Richard Carlsson)
Own Id: OTP-9804
Improvements and New Features
-
Implemented a new option to mnesia:create_table/2 which allows the user to assign 'ets' and 'dets' options not available in mnesia.
Own Id: OTP-8970
1.37 Mnesia 4.5.1
Fixed Bugs and Malfunctions
-
Fix deadlock in mnesia:del_table_copy/2.
Own Id: OTP-9689 Aux Id: seq11927
Improvements and New Features
-
Allow schema operations when using different mnesia versions.
Own Id: OTP-9657 Aux Id: seq11926
1.38 Mnesia 4.5
Fixed Bugs and Malfunctions
-
Fix protocol issues. Mnesia-4.4.19 could not communicate with to older nodes.
Own Id: OTP-9473
-
XML files have been corrected.
Own Id: OTP-9550 Aux Id: OTP-9541
Improvements and New Features
-
Dump the log even if no transactions have been invoked on local node, otherwise the log will grow forever with decisions from the other nodes who have tables on disk. Thanks Marek Majkowski.
Own Id: OTP-9551
-
Use dedicated api for clear_table, i.e. instead of match_delete use delete_all_objects. Thanks KukHyun Lee.
Own Id: OTP-9558
1.39 Mnesia 4.4.19
Fixed Bugs and Malfunctions
-
Mnesia could crash if mnesia:add_table_index/2 was invoked before the table was loaded on all nodes.
Own Id: OTP-9285 Aux Id: seq11844
-
Add {majority, boolean()} per-table option.
With {majority, true} set for a table, write transactions will abort if they cannot commit to a majority of the nodes that have a copy of the table. Currently, the implementation hooks into the prepare_commit, and forces an asymmetric transaction if the commit set affects any table with the majority flag set. In the commit itself, the transaction will abort if it cannot satisfy the majority requirement for all tables involved in the transaction.(Thanks to Ulf Wiger)
Own Id: OTP-9304
1.40 Mnesia 4.4.18
Fixed Bugs and Malfunctions
-
Call chmod without the "-f" flag
"-f" is a non-standard chmod option which at least SGI IRIX and HP UX do not support. As the only effect of the "-f" flag is to suppress warning messages, it can be safely omitted. (Thanks to Holger Weiß)
Own Id: OTP-9170
-
Mnesia sometimes failed to update meta-information in large systems, which could cause table content to be inconsistent between nodes.
Own Id: OTP-9186 Aux Id: seq11728
1.41 Mnesia 4.4.17
Fixed Bugs and Malfunctions
-
Calling mnesia:first/1 on empty fragmented table works. Thanks Magnus Henoch.
Own Id: OTP-9108
-
If Mnesia detects that the network is not fully connected during start, Mnesia will not start until all nodes are reachable.
Own Id: OTP-9115 Aux Id: seq-11728
Improvements and New Features
-
Fix issues reported by dialyzer.
Own Id: OTP-9107
1.42 Mnesia 4.4.16
Fixed Bugs and Malfunctions
-
Sometimes a 'log_header' record was added to tables when invoking mnesia:restore/2 with the option 'recreate_tables'. Thanks Vance Shipley.
Own Id: OTP-8960
Improvements and New Features
-
Compiler warnings were eliminated.
Own Id: OTP-8855
1.43 Mnesia 4.4.15
Improvements and New Features
-
Eliminated warnings for auto-imported BIF clashes.
Own Id: OTP-8840
1.44 Mnesia 4.4.14
Improvements and New Features
-
Added mnesia:subscribe(activity) contributed by Bernard Duggan.
Own Id: OTP-8519
1.45 Mnesia 4.4.13
Fixed Bugs and Malfunctions
-
Transactions could be left hanging if a node went down when invoking mnesia:sync_transaction/[1,2]. Thanks Igor Ribeiro Sucupira.
Own Id: OTP-8402
Improvements and New Features
-
Igor Ribeiro Sucupira added the option to compress data when copying tables between Mnesia nodes.
Own Id: OTP-8406
1.46 Mnesia 4.4.12
Improvements and New Features
-
The documentation is now built with open source tools (xsltproc and fop) that exists on most platforms. One visible change is that the frames are removed.
Own Id: OTP-8250
1.47 Mnesia 4.4.11
Improvements and New Features
-
Fixed duplicate results with mnesia:index_read() on ordered_set tables. Reported by Sam Bobroff.
Fixed locking in mnesia:index_read() which now grabs a read table lock to ensure correctness, this may slow down the operation or block other processes trying to reach the same table.
Calling mnesia:dump_log() could crash mnesia, Reported by Igor Ribeiro Sucupira.
Own Id: OTP-8074
1.48 Mnesia 4.4.10
Fixed Bugs and Malfunctions
-
Mnesia crashed if a qlc query was running inside a transaction when mnesia stopped at another node. Thanks Teemu Antti-Poika.
Own Id: OTP-7968
-
Mnesia could crash when loading local_content tables.
Own Id: OTP-8002 Aux Id: seq11277
Improvements and New Features
-
Minor (smp) optimizations.
Own Id: OTP-7928
1.49 Mnesia 4.4.9
Fixed Bugs and Malfunctions
-
mnesia:clear_table/1 crashed instead of returning {aborted,..} if it was called inside a transaction.
Own Id: OTP-7911
1.50 Mnesia 4.4.8
Fixed Bugs and Malfunctions
-
With bad timing several api functions could return or exit with a bad error message when mnesia was shutting down.
Own Id: OTP-7753 Aux Id: seq11179
-
mnesia:clear_table/1 cleared all nodes table content even if the table was local_content only type.
Own Id: OTP-7835
1.51 Mnesia 4.4.7
Fixed Bugs and Malfunctions
-
Disallowed match patterns ('_', and '$n') as argument to mnesia:delete_object/1 and friends.
Own Id: OTP-7524
Improvements and New Features
-
Introduced a few new functions in Mnesia: mnesia:read/2, mnesia:first/3, mnesia:last/3, mnesia:prev/4, mnesia:next/4, mnesia_frag:first/1, mnesia_frag:last/1, mnesia_frag:prev/2, mnesia_frag:next/2.
Own Id: OTP-7625
1.52 Mnesia 4.4.6
Fixed Bugs and Malfunctions
-
mnesia:restore/2 aborted if a EXIT message appeared in the client message queue.
Own Id: OTP-7585 Aux Id: seq11046
1.53 Mnesia 4.4.5
Improvements and New Features
-
mnesia:clear_table/1 does not require that all replicas of the table are available anymore.
Own Id: OTP-7466 Aux Id: seq11015
1.54 Mnesia 4.4.4
Fixed Bugs and Malfunctions
-
Mnesia did not garbage collect transaction decisions on disk based nodes if no transactions where made on the local node.
Own Id: OTP-7419
1.55 Mnesia 4.4.3
Fixed Bugs and Malfunctions
-
Table referred to by foreign key did not have node_pool properly cleaned up when a node was removed from the schema. Thanks Paul Mineiro.
Own Id: OTP-7340
-
Mnesia crashed and generated a core dump if a schema_transaction was running when mnesia stopped.
Own Id: OTP-7378 Aux Id: seq10964
Improvements and New Features
-
It is now possible to delete a db node even when other disk resident nodes are down. Thanks Paul Mineiro.
Own Id: OTP-7383
1.56 Mnesia 4.4.2
Fixed Bugs and Malfunctions
-
Sticky locks could lead to hanging transactions.
Own Id: OTP-7205 Aux Id: seq10793
-
mnesia:snmp_get_next_index/2 didn't work with partial index keys. Argument checking is now done according to documentation, in functions mnesia:snmp_get_row/2, mnesia:snmp_get_mnesia_key/2 and mnesia:snmp_get_next_index/2. These functions now require that RowIndex is a list.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-7208
1.57 Mnesia 4.4.1
Fixed Bugs and Malfunctions
-
Snmp index tables was not initialized correctly in mnesia-4.4.
Own Id: OTP-7170 Aux Id: seq10870
Known Bugs and Problems
-
Rearranging fragmented tables is an O(N^2) operation.
Own Id: OTP-6300
1.58 Mnesia 4.4
Fixed Bugs and Malfunctions
-
Mnesia ignored the module argument to mnesia:restore/2. Thanks Paul Minerio.
Own Id: OTP-6981
Improvements and New Features
-
Mnesia's snmp operations snmp_get_row/2, snmp_get_next_index/2 and snmp_get_mnesia_key/2 have been made context aware, i.e. inside a transaction they will compensate for table updates made in earlier in the same transaction. This might cause a performance drop if a lot of updates have been made before the invocation of these functions.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6856 Aux Id: seq10671
-
Introduced erlang:phash/2 as new default for fragmented tables. Already existing tables will continue to use whatever hash function they where using.
Own Id: OTP-6923
-
Introduced mnesia:is_transaction/0.
Own Id: OTP-6995 Aux Id: seq10812
Known Bugs and Problems
-
Rearranging fragmented tables is an O(N^2) operation.
Own Id: OTP-6300