“Also, rest of his talks are also fascinating”
Emery Berger's talks are fascinating
Full comment
"Performance matters" by Emery Berger on StrangeLoop'19 is a great talk - link Also, rest of his talks are also fascinating: - this video - link
CppCon 2019: Emery Berger “Mesh: Automatically Compacting Your C++ Application's Memory”
15K views · Oct 11, 2019 · 36:10 · 2 HN recommenders · 3 mentions · discussed 2019–2023
Emery Berger's CppCon 2019 talk introducing Mesh, a drop-in malloc replacement that compacts memory in unmodified C and C++ programs. It tackles fragmentation by merging pages without changing pointers.
Why Hacker News points people here: HN recommends Berger's talks as fascinating and cites Mesh as mind-blowing memory allocator work.
“the weird and wonderful work of Emery Berger et al with their “Mesh” malloc implementation, which blows my mind”HN comment, 2023
What Hacker News said 3
“the weird and wonderful work of Emery Berger et al with their “Mesh” malloc implementation, which blows my mind”
Mesh malloc compacts memory in C++ programs
Full comment
You’d need cooperation between your malloc implementation and the application code. It’s possible, but tricky. If your malloc returned a pointer to a pointer, and promised to keep the first level pointer up to date, and was able to lock your application whenever it moved things around, it could work. Someone else already mentioned, but garbage collected languages do actually do this. Because they’re fully in control of memory (the language exposes no raw pointers), they’re able to create the layer of indirection you’ve suggested and move things around as they please. I know at minimum the JVM does this. The term to search for is “heap compaction.” There’s also the weird and wonderful work of Emery Berger et al with their “Mesh” malloc implementation, which blows my mind: this video .
“the overhead can be massive too (17% overhead measured on firefox, 50% on redis!)”
Mesh talk reports compaction overhead numbers
Full comment
According to the cppcon talk about Mesh [1] (an allocator that implement compaction for C++ programs), the overhead can be massive too (17% overhead measured on firefox, 50% on redis!) [1] this video