Understanding memory usage

[siddhsql]

I am running this program on a Mac. When I load a model, I see following in the output:

this shows expected memory usage as 11359 MB. But when I inspect in activity monitor I see:

so memory consumed is 2.4 GB as per activity monitor. can someone explain the discrepancy to me? thanks.

[africalimedrop]

Suspect this will help answer; bolded relevant part:

• --no-mmap: Do not memory-map the model. By default, models are mapped into memory, which allows the system to load only the necessary parts of the model as needed. However, if the model is larger than your total amount of RAM or if your system is low on available memory, using mmap might increase the risk of pageouts, negatively impacting performance. Disabling mmap results in slower load times but may reduce pageouts if you're not using --mlock. Note that if the model is larger than the total amount of RAM, turning off mmap would prevent the model from loading at all.

[siddhsql]

thanks. makes sense.

…

On Thu, Jun 15, 2023 at 11:28 AM africalimedrop ***@***.***> wrote: Suspect this will help answer; bolded relevant part: - --no-mmap: Do not memory-map the model. *By default, models are mapped into memory, which allows the system to load only the necessary parts of the model as needed.* However, if the model is larger than your total amount of RAM or if your system is low on available memory, using mmap might increase the risk of pageouts, negatively impacting performance. Disabling mmap results in slower load times but may reduce pageouts if you're not using --mlock. Note that if the model is larger than the total amount of RAM, turning off mmap would prevent the model from loading at all. — Reply to this email directly, view it on GitHub <#1876 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A6NWEK6C2DTOSVSKNTLAWRTXLNH43ANCNFSM6AAAAAAZIA6OFM> . You are receiving this because you authored the thread.Message ID: ***@***.***>