You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Right now we use 1/4096 of a file's size in RAM. For a 64GB file, this is 16MB. For an 8TB file, this is 2GB of RAM.
We can bound the amount of RAM used by calling mincore on parts of the file at a time. Perhaps do no more than 64GB? This would still use up to 16MB per thread, so perhaps also a global semaphore should guard overall memory usage.
The text was updated successfully, but these errors were encountered:
Right now we use 1/4096 of a file's size in RAM. For a 64GB file, this is 16MB. For an 8TB file, this is 2GB of RAM.
We can bound the amount of RAM used by calling mincore on parts of the file at a time. Perhaps do no more than 64GB? This would still use up to 16MB per thread, so perhaps also a global semaphore should guard overall memory usage.
The text was updated successfully, but these errors were encountered: