[graph-tool] Re: memory handling when using graph-tool's MCMCs and multiprocessing on large networks

Am 22.10.21 um 06:08 schrieb Sam G:

thanks for your reply.

here's an example running minimize_blockmodel_dl() 10 times on 10 cores. when i run this on a large network (2GB, 2M vertices, 20M edges) i get a MemoryError.

It is clear to you that if you run 10 processes in parallel you will need 10 times more memory, right? BTW, your example is not self-contained, because I cannot run it without the 'large_graph' file. Maybe you can reproduce the problem for a smaller graph, or show how much memory you are actually using for a single process. It would also be important to tell us what version of graph-tool you are running. Best, Tiago -- Tiago de Paula Peixoto <tiago@skewed.de>