summaryrefslogtreecommitdiff
path: root/src/memory.zig
diff options
context:
space:
mode:
authorGabriel Schneider <[email protected]>2026-10-30 00:25:19 -0300
committerGabriel Schneider <[email protected]>2026-10-30 00:53:24 -0300
commitf264dbc4a646da695331fe7401fa013cbb720b6a (patch)
treeb8d960c5034d7ebfeb44fa25fa5697abbf386a9f /src/memory.zig
parentbce88593014a4078dc9259855944f9ddbc19fe54 (diff)
downloadpardes-f264dbc4a646da695331fe7401fa013cbb720b6a.tar.gz
pardes-f264dbc4a646da695331fe7401fa013cbb720b6a.zip
the walker's digest: a blob's hash made once and folded in as a word (a 100 MB file was 5 ms a digest, two a unit, on the authority); blob fields annotated `.blob`, which the rollback copy's pins read too
walk.zig: a field named in a type's `replica.blob` (a file's text, line index and location rows, an undo snapshot's text, a register's values and joined text, the rows an edit dropped, a query's saved rows) holds immutable blobs. A digest hashes one of 4 KiB or more once, keeps the word by its address and length, and folds the length and word in; `forget` drops the word, from memory.freeRaw and freeUnfilled, through which every such blob is freed raw. Only a Debug build (the tests, the harness, replay) hashes the bytes at every digest all the same and panics where the kept word is not their hash: a blob written in place, or freed past its word. A release build, ReleaseSafe the user's own as well as ReleaseFast, takes the word and never panics on a stale one: at worst a divergence, which a replica records and then stops at (nothing resets or rejoins it yet; the notes say so). File.zig: an edit's free of the old text went to `rawFree` itself and so kept its word; the next text of the same length at the same address folded in the old one (the ReleaseFast harness diverged in 162 of 180 replica runs, in `file.content`), and it goes through freeUnfilled now. Registers.zig: `put` makes a new values array rather than writing the old one. rollback.zig: the copy pins what `.blob` names (`pinned` and `pinnedDeep` gone). Measured, ReleaseFast on the perf cores: with a 100 MB file open (PARDES_DIGEST_BENCH=100, replica.zig's bench), a unit of a key into it went from p50 10.45 ms, p99 41.6 ms to p50 24 us, p99 6.1 ms (the first, which makes the word), a digest from 5.18 ms to 10 us. The harness (20 seeds x 120 inputs x 3 clients): rollback p99 9.5 -> 2.6 ms at 30 ms (1.5 and 1.4 ms at 80 and 207), copy p99 0.27 ms; none diverged, none unequal, no delta wrong. Tests: a blob hashed once, its kept word no longer its hash once written in place, its word gone when freed. docs/next-daemon.md: the follow-up. Co-Authored-By: Claude Opus 5.5 <[email protected]>
Diffstat (limited to 'src/memory.zig')
-rw-r--r--src/memory.zig10
1 files changed, 8 insertions, 2 deletions
diff --git a/src/memory.zig b/src/memory.zig
index 1d082964..7adcf914 100644
--- a/src/memory.zig
+++ b/src/memory.zig
@@ -1,5 +1,6 @@
const std = @import("std");
const builtin = @import("builtin");
+const walk = @import("walk.zig");
const config = @import("pardes_config");
const board = config.platform == .esp32p4;
@@ -418,7 +419,10 @@ pub fn dupeUnfilled(allocator: Allocator, bytes: []const u8) Allocator.Error![]u
/// Frees without the safe-build overwrite `free` does, for text-sized buffers
/// freed on every edit.
pub fn freeUnfilled(allocator: Allocator, bytes: []const u8) void {
- if (bytes.len > 0) allocator.rawFree(@constCast(bytes), .of(u8), @returnAddress());
+ if (bytes.len == 0) return;
+ // A blob's digest word goes with it (walk.zig).
+ walk.forget(@intFromPtr(bytes.ptr));
+ allocator.rawFree(@constCast(bytes), .of(u8), @returnAddress());
}
/// `freeUnfilled` for a slice of any element: a text's line index, made
@@ -427,7 +431,9 @@ pub fn freeUnfilled(allocator: Allocator, bytes: []const u8) void {
pub fn freeRaw(allocator: Allocator, items: anytype) void {
const E = @typeInfo(@TypeOf(items)).pointer.child;
const bytes = std.mem.sliceAsBytes(items);
- if (bytes.len > 0) allocator.rawFree(@constCast(bytes), .of(E), @returnAddress());
+ if (bytes.len == 0) return;
+ walk.forget(@intFromPtr(bytes.ptr));
+ allocator.rawFree(@constCast(bytes), .of(E), @returnAddress());
}
/// Gives free memory back to the system, the arenas' and libc's, inside its