QPQ-AG/mnesia_rocksdb
11
0
Fork 0
Code Issues Pull Requests 3 Actions Packages Projects Releases Wiki Activity
129 Commits 10 Branches 2 Tags
b82f33a40aaec1751e0ee4e155722696b66c60f3
Commit Graph
129 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ulf Wiger b82f33a40a Upgrade to erlang-rocksdb-3.1.2 2026-08-18 17:13:07 +02:00
Ulf Wiger 32384f76fe Add hybrid mnesia_rocksdb backup and restore 
Provide mnesia_rocksdb:backup/1,2 and restore/1,2 that pair a Mnesia
checkpoint (schema and non-RocksDB tables) with RocksDB backup engines
for open admin and standalone databases.

Restore stages RocksDB into a sibling directory and redirects mountpoints
while Mnesia fallback purges the real directory, then relocates the data
and optionally restarts. Raise the minimum OTP version to 27.
 2026-08-12 16:49:13 +02:00
uwiger 9ffb991c2c Merge pull request 'Migrate table encoding and type' (#11) from uw-migration into master 
Reviewed-on: #11
 2026-08-12 23:47:10 +09:00
Ulf Wiger ca242b72ac Improve consistency, add test cases for change_table_type() 2026-08-10 19:37:29 +02:00
Ulf Wiger 9f00d75654 WIP implement change_table_type/3 2026-08-10 17:26:47 +02:00
Ulf Wiger 1a99fec600 WIP migrate table encoding 2026-08-04 15:30:31 +02:00
uwiger 6246f3f2e1 Merge pull request 'Add mrdb:ms/2 for match spec production' (#9) from uw-mrdb-ms into master 
Reviewed-on: #9
 2025-10-11 02:22:24 +09:00
Ulf Wiger c6969238c7 Add mrdb:ms/2 for match spec production 2025-10-10 14:01:25 +02:00
uwiger d6a4dca5f6 Merge pull request 'Fix dialyzer issues (also for test)' (#8) from uw-dialyzer-issues into master 
Reviewed-on: #8
 2025-08-05 20:06:05 +09:00
Ulf Wiger b97b727605 Fix dialyzer issues (also for test) 2025-08-01 21:14:56 +02:00
uwiger e0542f7f52 Merge pull request 'Add mrdb_index:select() et al' (#7) from uw-index-select into master 
Reviewed-on: #7
 2025-07-09 14:39:52 +09:00
Ulf Wiger 13ccdb373a Fix pattern-matching index select 2025-07-04 16:43:51 +02:00
Ulf Wiger 29d5d6f170 Add mrdb_index:select() et al 2025-07-02 14:36:38 +02:00
uwiger 4e3c9e83c8 Merge pull request 'Add mrdb:fold_reverse(), mrdb:select_reverse() etc. Remove vsn 1 support.' (#6) from uw-fold_reverse into master 
Reviewed-on: #6
 2025-06-25 03:13:52 +09:00
Ulf Wiger f9352b6ff0 Remove accidental unicode NBSP char 2025-06-19 20:18:52 +02:00
Ulf Wiger 04e6063ce0 Tests for fold, fold_reverse, select_reverse, etc. 2025-06-19 20:12:06 +02:00
Ulf Wiger 323fcea7a7 Remove legacy support for vsn 1 standalone tabs 2025-06-19 20:12:06 +02:00
Ulf Wiger d8b6ab788e Fix prefixed rdb_fold, add mrdb:rdb_rev_fold() 2025-06-19 20:12:06 +02:00
uwiger 318f84bbaf Merge pull request 'Ensure the erlang_merge_operator is always loaded' (#5) from uw-merge-operator into master 
Reviewed-on: #5
 2025-06-17 18:05:58 +09:00
Ulf Wiger 0691d8b055 Ensure the erlang_merge_operator is always loaded 2025-06-15 20:43:36 +02:00
uwiger ac69c8564f Merge pull request 'Consistent support for merge ops' (#4) from uw-merge-ops into master 
Reviewed-on: #4
 2025-06-16 03:41:44 +09:00
Ulf Wiger 2ca7f36eb1 Consistent support for merge ops 2025-06-02 20:07:05 +02:00
Ulf Wiger 56d78768d9 Produce stacktraces unless mnesia_compatible 2025-03-23 21:06:21 +01:00
zxq9 a768d8008f Merge remote-tracking branch 'ae/master' into emqx 2024-10-17 10:54:42 +09:00
Richard Carlsson 9cea41cb9a Merge pull request #57 from richcarl/use-fixed-emqx 
Use latest version of emqx fork with compilation fix
 2024-10-14 12:17:30 +02:00
Richard Carlsson d42055c7ac Update erlang-rocksdb to use latest patch fixing compilation issues 2024-10-13 14:30:56 +02:00
Richard Carlsson 0ae7ecd41d Use our patched version of the EMQX fork 2024-10-09 13:53:01 +02:00
Richard Carlsson ece9db2b09 Merge pull request #56 from richcarl/use-emqx-fork 
Use emqx fork of erlang-rocksdb
 2024-09-09 14:04:40 +02:00
Richard Carlsson 0e4382d5f7 Use emqx fork of erlang-rocksdb 2024-08-23 11:01:46 +02:00
Ulf Wiger d9d82d7ead Merge branch 'uw-catchup' into 'master' 
Fix wrong index preparation in mrdb:index_read_/3

See merge request ioecs/mnesia_rocksdb!1
 2024-08-14 09:24:16 +00:00
Ulf Wiger 34285da6d8 Merge pull request #55 from havelkadragan/master 
Fix wrong index preparation in mrdb:index_read_/3
 2024-08-13 18:21:32 +02:00
crossroad61 cb123ee28a Merge pull request #1 from aeternity/uw-ix-plugin-tests 
Improve tests (fail without Havelka's fix)
 2024-08-13 12:45:56 +02:00
Ulf Wiger 996ae82717 Improve tests (fail without Havelka's fix) 2024-08-13 10:36:31 +02:00
dragan d6b86524fd Fix wrong index preparation in mrdb:index_read_/3 
In the case when index is of type {_}, index is returned as is
instead of putting it into a tuple {Ix, ordered}.

An example

Given the following index plugin implementation:
-module(key6).

-record(cgh, {key, val}).

-export([k6/3
        , add_index/0
        , create_table/0
        , tst_bad_type/0
    ]).

k6(_, _, #cgh{key = {Name, K8, _Cid, _Vn}}) ->
    [list_to_binary([atom_to_binary(Name),
     list_to_binary(lists:sublist(K8, 6))])].

add_index() ->
    mnesia_schema:add_index_plugin({k6}, key6, k6).

create_table() ->
    mnesia:create_table(cgh,
    [{attributes, record_info(fields, cgh)},
     {type, ordered_set},
     {index, [{k6}]},
     {rocksdb_copies, [node()]},
     {local_content, true}]).

tst_bad_type() ->
    E1 = #cgh{key = {n1, "u1vgrjkh",{ecgi,238,6,213020,50},3}, val = ok},
    mnesia:dirty_write(E1),
    Index1 = list_to_binary([atom_to_binary(n1),
                             list_to_binary(lists:sublist("u1vgrjkh", 6))]),
    mrdb:index_read(cgh, Index1, {k6}).

-- testing --
Eshell V14.2.2 (press Ctrl+G to abort, type help(). for help)
(rock@bang)2> mnesia:create_schema([node()]).
ok
(rock@bang)3> mnesia:start().
ok
(rock@bang)4> mnesia_rocksdb:register().
{ok,rocksdb_copies}
(rock@bang)5> l(key6).
{module,key6}
(rock@bang)6> key6:add_index().
{atomic,ok}
(rock@bang)7> key6:create_table().
{atomic,ok}
(rock@bang)8> key6:tst_bad_type().
** exception exit: {aborted,{bad_type,{cgh,index,{k6}}}}
     in function  mnesia:abort/1 (mnesia.erl, line 362)
     in call from mrdb:ensure_ref/1 (~/projects/erlang/github/mnesia_rocksdb/src/mrdb.erl, line 609)
     in call from mrdb:index_read_/3 (~/projects/erlang/github/mnesia_rocksdb/src/mrdb.erl, line 945)

-- after patch --

(rock@bang)9> c(mrdb).
Recompiling ~/projects/erlang/github/mnesia_rocksdb/src/mrdb.erl
{ok,mrdb}
(rock@bang)10> key6:tst_bad_type().
[{cgh,{n1,"u1vgrjkh",{ecgi,238,6,213020,50},3},ok}]
(rock@bang)11>
 2024-08-12 14:32:20 +02:00
Thomas Arts 296813ef7b Merge pull request #51 from aeternity/ta-rocksdb-1.8.0 
Towards version 7.10.2 of rocksdb via version 1.8.0 or erlang_rocksdb
 2024-03-19 14:41:50 +01:00
Thomas Arts 16d0533acf Fix dialyzer errors and warnings 2024-03-19 14:08:14 +01:00
Thomas Arts 1d6ae82c6d OTP24-26 2024-03-19 14:08:14 +01:00
Ulf Wiger 71ebaf2d66 New args for rocksdb:transaction_iterator() 2024-03-18 17:40:42 +01:00
Ulf Wiger f2b6116d31 Merge pull request #47 from aeternity/uw-robustify-tx-test 
Add retry for bleed-through check
 2023-10-12 18:19:48 +02:00
Ulf Wiger 33ee7929d4 Merge pull request #44 from aeternity/uw-index-metadata 
Adding/deleting indexes cleans up index metadata
 2023-10-12 18:19:16 +02:00
Ulf Wiger 78669bb8bf Merge pull request #42 from mariari/mariari/rebar3-compatible-otp-25 
Update rebar3 bin to be compatible with OTP 25
 2023-10-09 14:47:25 +02:00
Ulf Wiger 346decee6e Merge pull request #49 from aeternity/ci_matrix 
Add CI build matrix for OTP versions
 2023-10-09 14:30:47 +02:00
Dincho Todorov 4da0fce567 Add CI build matrix for OTP versions 2023-10-09 13:22:13 +03:00
Ulf Wiger e7d42f9500 Add retry for bleed-through check 2023-10-05 13:53:13 +02:00
Ulf Wiger 699a7d5920 Merge pull request #29 from aeternity/uw-bump-hut-dep 
Change hut dep to 1.4.0
 2023-10-05 11:00:53 +01:00
Ulf Wiger 57f02078bc Fix typo 2023-10-05 11:53:41 +02:00
Ulf Wiger 791cec41db Adding/deleting indexes cleans up index metadata 2023-10-05 11:53:41 +02:00
Ulf Wiger 6eff62df6d Merge pull request #45 from aeternity/uw-ci-improvements 
Run multiple OTP vsns in CI
 2023-10-05 10:52:54 +01:00
Ulf Wiger 2e430fc5eb remove 'build' sublevel 2023-10-05 11:21:03 +02:00
Ulf Wiger e76a01f8c4 add ci workflow 2023-10-05 11:12:32 +02:00