Speeding up Logos
Comments
-
There is a discussion of this at https://community.logos.com/forums/t/147283.aspx?PageIndex=1 (this was before the command box command was introduced)
0 -
Thanks Graham. I totally missed that thread & obviously there's a lot of reading. Just a quick question: Do I understand correctly that the line "set use ngen to yes" has to be inserted each time there is an update to Logos or has that changed since back then?
MSI Katana GF76 Intel Core i7-12700H, RTX3060, 16GB RAM, 1TB SSD, Windows 11 Home
0 -
Bootjack said:
Thanks Graham. I totally missed that thread & obviously there's a lot of reading. Just a quick question: Do I understand correctly that the line "set use ngen to yes" has to be inserted each time there is an update to Logos or has that changed since back then?
No - you don’t need to enter the command after each update. But you will be prompted if you still want it to be applied.
0 -
Good! Thank you Graham!
MSI Katana GF76 Intel Core i7-12700H, RTX3060, 16GB RAM, 1TB SSD, Windows 11 Home
0 -
Taht
Dave Hooton said:Scott David said:I did the Use Ngen... it did help -- maybe about a 25% increase. Perhaps it's telling Logos to commit more resources to RAM instead of Hot Swapping with the HDD?? Will enabling this option perhaps make Logos faster over time (will it observe and learn)... or is it pretty much one and done?
From MS "The Native Image Generator (Ngen.exe) is a tool that improves the performance of managed applications. Ngen.exe creates native images, which are files containing compiled processor-specific machine code, and installs them into the native image cache on the local computer. The runtime can use native images from the cache instead of using the just-in-time (JIT) compiler to compile the original assembly."
Very interesting and valuable... thanks for this!
0 -
Well I've got some final news to report; thank you to everyone who contributed. I've got some pretty surprising results to share...
A) This gave me a noticeable increase in speed: I took Dave's advice above and did the following command: Set Use Ngen to Yes
I discovered that my Webster Merriam Dictionary, when left as an open resource, slowed things down noticeably. Closing that helped.
C) This is the shocker -- ReadyBoost gave me a massive increase in speed with Logos... [The following comments are useless for those who have SSD Solid State Drives - but for the rest of us...]
Yes, believe it or not -- I decided to give option 2 a shot (use sideloaded ReadyBoost prefetch with fast 32GB flash memory). And the difference is INCREDIBLE. I'm shocked. A few things about doing this:
1) READY BOOST IS PERFECT FOR LOGOS - I read a bunch of techy 'white papers' -- and all of them said the same thing: ReadyBoost works best when you are dealing with large programs that utilize large files (like Adobe PhotoShop). Obviously, Logos fits right into this category. So I decided to give ReadyBoost a try.
2) THUMBDRIVE MUST MATCH YOUR RAM - The needed USB Flash memory for ReadyBoost depends upon your PC's RAM size -- to ascertain the best drive for your RAM, do a google search. I have 8GB of RAM, that equated to a 32GB card (according to the pros). This was proved true, as I enabled ReadyBoost, Windows recommended reserving 30488MB for ReadyBoost; my 32GB card had 30583MB available -- so it's an almost perfect match.
3) DEDICATE THE ENTIRE FLASH DRIVE - Since I got the exact right Flash for my RAM size, I could dedicate the entire USB Thumbdrive to ReadyBoost ("Dedicate this Device to ReadyBoost") instead of "Use this Device: Space to Reserve..."
4) FORMAT THE THUMBDRIVE BEFORE ENABLING READYBOOST - When you format Flash Memory you can choose i) FAT32 [worst choice in every way - especially considering ReadyBoost will be maxed at 4GB] ii)NTFS iii)exFAT. DEFINITELY choose exFAT - it is designed to handle large chunks and is specifically designed for Flash Memory. The tech articles I read said to choose "DEFAULT" for the Allocation Unit Size; that's what I did.
I picked up a 32GB 200MBps Thumbdrive on Amazon for $9 -- it only sticks out of my notebook about .25 inches. And now my Logos is faster than it's ever been.
Thanks, and blessings.
0 -
Hi everybody
Just in case you didn't see this
I have noticed on my system how the speed is dramatically increased on searching
one of the things I have done in the past is not let my Windows operating system indexing any of my drives
I do not search a lot on my hard drives as I have my filesystem organised
maybe something you could try to see if it one helps increase indexing speed for logos
if your system is indexing and also you have logos indexing then your system is going to be very slow
so I have my windows operating system not indexing
Does indexing slow down computer? But slower PCs that use indexing can see a performance hit, and you can give them a speed boost by turning off indexing. Even if you have an SSD disk, turning off indexing can improve your speed, because the constant writing to disk that indexing does can eventually slow down SSDs.
0 -
Ok Scott, thanks for that. But does not the "set use ngen to yes" do the same trick for Logos?
MSI Katana GF76 Intel Core i7-12700H, RTX3060, 16GB RAM, 1TB SSD, Windows 11 Home
0 -
Scott David said:
Well I've got some final news to report; thank you to everyone who contributed. I've got some pretty surprising results to share...
A) This gave me a noticeable increase in speed: I took Dave's advice above and did the following command: Set Use Ngen to Yes
I discovered that my Webster Merriam Dictionary, when left as an open resource, slowed things down noticeably. Closing that helped.
C) This is the shocker -- ReadyBoost gave me a massive increase in speed with Logos... [The following comments are useless for those who have SSD Solid State Drives - but for the rest of us...]
Yes, believe it or not -- I decided to give option 2 a shot (use sideloaded ReadyBoost prefetch with fast 32GB flash memory). And the difference is INCREDIBLE. I'm shocked. A few things about doing this:
1) READY BOOST IS PERFECT FOR LOGOS - I read a bunch of techy 'white papers' -- and all of them said the same thing: ReadyBoost works best when you are dealing with large programs that utilize large files (like Adobe PhotoShop). Obviously, Logos fits right into this category. So I decided to give ReadyBoost a try.
2) THUMBDRIVE MUST MATCH YOUR RAM - The needed USB Flash memory for ReadyBoost depends upon your PC's RAM size -- to ascertain the best drive for your RAM, do a google search. I have 8GB of RAM, that equated to a 32GB card (according to the pros). This was proved true, as I enabled ReadyBoost, Windows recommended reserving 30488MB for ReadyBoost; my 32GB card had 30583MB available -- so it's an almost perfect match.
3) DEDICATE THE ENTIRE FLASH DRIVE - Since I got the exact right Flash for my RAM size, I could dedicate the entire USB Thumbdrive to ReadyBoost ("Dedicate this Device to ReadyBoost") instead of "Use this Device: Space to Reserve..."
4) FORMAT THE THUMBDRIVE BEFORE ENABLING READYBOOST - When you format Flash Memory you can choose i) FAT32 [worst choice in every way - especially considering ReadyBoost will be maxed at 4GB] ii)NTFS iii)exFAT. DEFINITELY choose exFAT - it is designed to handle large chunks and is specifically designed for Flash Memory. The tech articles I read said to choose "DEFAULT" for the Allocation Unit Size; that's what I did.
I picked up a 32GB 200MBps Thumbdrive on Amazon for $9 -- it only sticks out of my notebook about .25 inches. And now my Logos is faster than it's ever been.
Thanks, and blessings.
Scott David this is really good news! Really glad you tried it No doubt will help others who are using a HDD.
Bookmarked for reference.
(1) would help improve indexing and searching speeds once you've upgraded from a HDD to SSD.
Bradley if you are still monitoring, I am interested in your suggestion about RAM. Try as I like, I cannot get Logos to use more than at most 2GB of RAM even with a full text everthing search (4000 ish resources + 2000 not downloaded). I have 10 ish active panes, plus 20 not on display but in tabs, mostly all linked.
This is on Windows. I am at 50% utilisation of RAM. Am I missing out on some memory caching or something? Maybe Windows bug/missing feature?
How much RAM is everyone else using on their systems for Logos?
0 -
Michael Parry-Thomas said:
I have noticed on my system how the speed is dramatically increased on searching... one of the things I have done in the past is not let my Windows operating system indexing any of my drives
LOL Michael; INDEXING is the Devil [6][8-|]
Indexing not only massively slows down the PC, but radically pushes components to their limits (wearing down peripherals much quicker). And when a large file with lots of text or a large quantity of files gets Moved / Copied / Added on your PC, Windows Indexing goes crazy.
I always disable all indexing and just do all my searches right within Windows File Explorer (as opposed to [WIN]+[ S ] or [CTRL]+[ESC] or [WIN]) -- the increased wait time on searches from within Explorer is totally negligible. I do any searches right from the directory I want to search in. Here are some notes on how to disable different types of indexing. If you do the first one, you shouldn't need to do any others.
Disable Indexing
- Disable All Indexing: [WIN]+[R] > services.msc (or: [WIN]+[ S ] > Services) > Indexing Services (or sometimes called Windows Search) > Double Click > STOP > Disable Startup
- Disable Whole Drive (e.g. your C:\ Drive): Windows File Explorer > Rt-Click C (or whatever drive) > General Tab > Uncheck “Allow Files on this Drive to Have Files Indexed…”
- Disable Selective Indexing Components: [WIN]+[ S ] > Indexing Options
- Disable Outlook Indexing: [WIN]+[ S ] > Indexing Options > Advanced > File Types > scroll to "msg"
0 -
Bootjack said:
Ok Scott, thanks for that. But does not the "set use ngen to yes" do the same trick for Logos?
Hi Bootjack!
Are you asking me if NGEN is the same as ReadyBoost? If so, NO.
Are you asking me if NGEN works for Logos as well as Windows? If so, YES.
Blessings!
0 -
Good enough Scott! Thank you for the clarification.
MSI Katana GF76 Intel Core i7-12700H, RTX3060, 16GB RAM, 1TB SSD, Windows 11 Home
0 -
Kevin said:
(1) would help improve indexing and searching speeds once you've upgraded from a HDD to SSD.
Bradley if you are still monitoring, I am interested in your suggestion about RAM. Try as I like, I cannot get Logos to use more than at most 2GB of RAM even with a full text everthing search (4000 ish resources + 2000 not downloaded). I have 10 ish active panes, plus 20 not on display but in tabs, mostly all linked.
This is on Windows. I am at 50% utilisation of RAM. Am I missing out on some memory caching or something? Maybe Windows bug/missing feature?
Logos will use a technology called "memory-mapped file I/O" on Windows to read/write the index files (and resources). This doesn't show up in the "Memory" column in Task Manager but can be seen with tools such as VMMap.
Some of these performance optimisations are disabled unless your system has at least 12GB of RAM (as they can potentially interfere with other programs), so you won't necessarily be able to extrapolate from the behaviour on an 8GB system to see what would happen with 16GB.
0 -
Additionally, if programs aren't actively using that RAM, Windows will automatically use it to cache frequently-accessed files. You can see this on the Memory tab of Task Manager (when More details is expanded). There should be little "Free" memory with most of your unused memory marked as "Standby": this is cached files and other data.
The more RAM you have installed on your system, the more files and data Windows can cache (to speed up all your programs).
0 -
Logos will use a technology called "memory-mapped file I/O" on Windows to read/write the index files (and resources). This doesn't show up in the "Memory" column in Task Manager but can be seen with tools such as VMMap.
Some of these performance optimisations are disabled unless your system has at least 12GB of RAM (as they can potentially interfere with other programs), so you won't necessarily be able to extrapolate from the behaviour on an 8GB system to see what would happen with 16GB.
Bradley that is really useful info thank you! It will be well considered for upgrade options [Y]
0 -
Kevin said:
Bradley if you are still monitoring, I am interested in your suggestion about RAM. Try as I like, I cannot get Logos to use more than at most 2GB of RAM...
Wow, how did you get Logos to use that much RAM? I'm lucky if I can get it up to 750MB... and I've got 8GB -- but for me, Logos just doesn't want to put everything and hold everything in RAM. This would probably be a dramatic performance increase if I could 'force' logos to get everything into RAM.
0 -
Logos will use a technology called "memory-mapped file I/O" on Windows to read/write the index files (and resources)... these performance optimisations are disabled unless your system has at least 12GB of RAM...
Ahhh... well that answers my previous post! So upgrading the RAM to >= 12GB should have a very significant impact on Logos; correct? If I upgrade my RAM, do I need to execute any special configurations to get Logos to use more RAM, or will it happen automatically? Now I'm really going back to the idea of upgrading my RAM as well. Thanks Bradley -- this is super valuable information -- for many of us I'm sure.
0 -
Bradley, once this thread has plateaued, it may be nice to take all the best practices that are applicable for most folks' contexts -- and try to consolidate everything into one 'master' post. So for example, it may look something like this:
HDD: If you have a HDD, then...
SSD: If you have SSD, then...
RAM: If you have <= 12GB RAM, then...
RAM: If you have >= 12GB RAM, then...Sort of a simple roadmap that helps folks know what their best chances would be to speed things up; know whether to ugrade RAM, try Ready Boost, try NGEN, etc.
0 -
Scott David said:
So upgrading the RAM to >= 12GB should have a very significant impact on Logos; correct?
It's hard to quantify the impact it will have. It should definitely speed up index merging. However, that should only be happening when resource updates are delivered (every two weeks) or new books are purchased (up to you). So you may not notice a large impact day-to-day.
It should help with general operations on your computer (for Logos and other programs) as files can automatically be cached in memory by Windows, reducing disk I/O. It's harder to say how much of an impact this will have for your typical use of your computer.
0