You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Mar 16, 2022. It is now read-only.
That avoids problems of filesystem-latency, but unfortunately I don't think GNU fopen() uses the MAP_SHARED flag, so separate procs will not share their read-only mmapped DB.
One solution is to use r instead of rm. However, then we are back to filesystem latency problems.
A better solution is to run LA4Falcon as a function, multi-threaded in a program with its consumer. A Nim version might help with that.
The text was updated successfully, but these errors were encountered:
There was a big problem of running too many LA4Falcon jobs and too much memory consumed by the Python multiproc program. Solved in FALCON_unzip_private.
For the DB, we use GNU
fopen(filename, "rm")
, which uses "mmap" for the file.That avoids problems of filesystem-latency, but unfortunately I don't think GNU fopen() uses the MAP_SHARED flag, so separate procs will not share their read-only mmapped DB.
One solution is to use
r
instead ofrm
. However, then we are back to filesystem latency problems.A better solution is to run LA4Falcon as a function, multi-threaded in a program with its consumer. A Nim version might help with that.
The text was updated successfully, but these errors were encountered: