Page 1 of 2 (29 items) 1 2 Next >
This post has 28 Replies | 6 Followers

Posts 66
Father Gregory | Forum Activity | Posted: Sun, Mar 4 2018 7:57 PM

Hello folks,

Clearly I have too many books (23,000+).  I say this because it takes forever to index the books even with an I7 processor, 16GB of Ram and a SSD.  Strange as this sounds, Is there a way to reduce the number of books that I have to improve my Logos 7 software performance?  

Thanks!

Posts 218
Joshua Tan | Forum Activity | Replied: Sun, Mar 4 2018 8:05 PM

Open up Program Settings and drag the book(s) that you do not want into the "Hidden Resources" section. They will no longer be stored on your hard disk (and by implication, will no longer be indexed).

Another option would be to transfer your licenses away (e.g. sell your books to someone else or return them to FaithLife).

Posts 17874
Forum MVP
Keep Smiling 4 Jesus :) | Forum Activity | Replied: Sun, Mar 4 2018 9:54 PM

Another option is choosing when to download updates - either a scheduled time window OR turn off automatic updates so can manually choose when to download and index (ideally when not using computer for several hours).

Keep Smiling Smile

Posts 1073
Martin Folley | Forum Activity | Replied: Sun, Mar 4 2018 11:43 PM

A variaton of Joshua's suggestion is that you can also hide resources in the library by (Mac) alt-right clicking. I presume that there is a windows equivalent. This becomes much faster if you select multiple resources first (thus hiding resources in batches). In the back of my mind, I seem to remember that there was some sort of limit to the number of resources that you can hide in each batch (about 10) ... but I could be wrong ... experimentation is the key :-) 

2010 17" MBP with High Sierra, iPad4 with iOS10.

Posts 947
John Goodman | Forum Activity | Replied: Mon, Mar 5 2018 12:24 AM

Someone ought to point out that hiding is not as easy to reverse. It's one book at a time with a few seconds delay meaning some people have taken weeks to recover hidden books they decided they do in fact want! Personally I used a script for this task...

גַּם־חֹשֶׁךְ֮ לֹֽא־יַחְשִׁ֪יךְ מִ֫מֶּ֥ךָ וְ֭לַיְלָה כַּיּ֣וֹם יָאִ֑יר כַּ֝חֲשֵׁיכָ֗ה כָּאוֹרָֽה

Posts 9910
Forum MVP
NB.Mick | Forum Activity | Replied: Mon, Mar 5 2018 12:36 AM

Father Gregory:
it takes forever to index the books even with an I7 processor, 16GB of Ram and a SSD.

Hi Father Gregory,

prior to offering advice I'd like to see logs (especially indexer.log, if available). It shouldn't take "forever" to index a large library on your machine - and it shouldn't bother you either, since it runs in the background. And even if it slowed down your machine a bit, you wouldn't worry since reindexing the whole library normally doesn't happen (only if the index is broken). So there are some questions, like 

- is indexing of the library complete, or does it try over and over?

- is the "forever" indexing an incremental index of updated books?

- If so, how long does it really take and does it complete?

- Is indexing really what bothers you, or is it preparing the library upon startup, where building the collections really takes the time (and if you have all the ca. 100 canonical commentary collections plus some, then that takes a bit, even on a fast machine)?

In case it really is the number of books (impressive!) and you want to reduce it, hiding books one-by-one does not sound very helpful. It really comes down to bulk hiding as explained above (luckily there's no 10 books limit). So you can filter the library such as lang:latin or filter for Perseus and then bulk-hide the resulting many books. Just remember: there's no bulk unhide.

Running Logos 8 latest beta version on Win 10

Posts 1934
Forum MVP
Reuben Helmuth | Forum Activity | Replied: Mon, Mar 5 2018 4:28 AM

NB.Mick:
Just remember: there's no bulk unhide.

Also, there are no filtering or sorting options. All hidden resources are in a single, long alphabetical list. 😣

Posts 2372
David Ames | Forum Activity | Replied: Mon, Mar 5 2018 5:39 AM

NB.Mick:

- Is indexing really what bothers you, or is it preparing the library upon startup, where building the collections really takes the time (and if you have all the ca. 100 canonical commentary collections plus some, then that takes a bit, even on a fast machine)?

How much time does "building the collections" take?   [[That is how do many collections affect start up time?]]

If we rarely use a collection should we keep its rules in a document file of collection rules and rebuild the collection as needed?  

Posts 1803
LogosEmployee
Phil Gons (Faithlife) | Forum Activity | Replied: Sat, Mar 10 2018 5:38 PM

Version 7.14, which is in beta right now, includes a significant improvement to indexing. My library of ~60,000 resources went from indexing in 5h 21m to 2h 12m, a 59% reduction or 2.45x faster. Not all computers will see the same improvements, but the average increase may be around 2x.

We're also exploring selective download and cloud resources, which would let you choose what to install locally (and index) and what to leave in the cloud and have access to only when online.

We're considering some improvements to resource hiding, too.

Posts 218
Joshua Tan | Forum Activity | Replied: Sat, Mar 10 2018 5:44 PM

Phil Gons (Faithlife):

Version 7.14, which is in beta right now, includes a significant improvement to indexing. My library of ~60,000 resources went from indexing in 5h 21m to 2h 12m, a 59% reduction or 2.45x faster. Not all computers will see the same improvements, but the average increase may be around 2x.

We're also exploring selective download and cloud resources, which would let you choose what to install locally (and index) and what to leave in the cloud and have access to only when online.

We're considering some improvements to resource hiding, too.

This is big news, Phil. Even though it might not score as well in the marketing department as other flashier features, I'm sure many users greatly appreciate these speed improvements!

(PS: Selective download would make me be more willing to buy more resources without fear of making the software unusable [i.e. slow] on my computer.)

Posts 1081
Sean | Forum Activity | Replied: Sat, Mar 10 2018 5:51 PM

Phil Gons (Faithlife):
We're also exploring selective download and cloud resources, which would let you choose what to install locally (and index) and what to leave in the cloud and have access to only when online.

Phil, these would be very significant improvements to the programs that would help a wide range of users in different situations. For example, I have and use the Perseus library. Due to space constraints, I have hidden the Greek and Latin volumes, but there are rare occasions on which I'd like to access them. It would be very helpful if I could get to them via the web app while not downloading them to the hard drive.

More users would benefit from being able to separate the downloading of resources from program updates. I encourage you to make these improvements.

 Logos Now Subscriber -- 22/2/2018

Posts 511
Gordon Jones | Forum Activity | Replied: Sun, Mar 11 2018 1:29 AM

Father Gregory:

I have too many books

Wink

Posts 13309
Forum MVP
Mark Barnes | Forum Activity | Replied: Sun, Mar 11 2018 1:51 AM

Father Gregory:
Clearly I have too many books (23,000+).  I say this because it takes forever to index the books even with an I7 processor, 16GB of Ram and a SSD.

I have a similar size library, and a similar spec PC, but I rarely notice indexing as an issue. Perhaps there's something deeper going on? A description of exactly the symptoms, together with logs and more detailed spec might help us track that down, if you're interested.

Posts 1690
Robert M. Warren | Forum Activity | Replied: Sun, Mar 11 2018 1:53 AM

Phil Gons (Faithlife):
We're also exploring selective download and cloud resources, which would let you choose what to install locally (and index) and what to leave in the cloud and have access to only when online.

If this setting would be 'per computer', it would help a lot of users who have low disk space on their laptop, etc., but don't really want, or can't afford, a new secondary computer.

Win 10 Android 8.1 Fire OS 5

Posts 13309
Forum MVP
Mark Barnes | Forum Activity | Replied: Sun, Mar 11 2018 3:02 AM

Phil Gons (Faithlife):
Version 7.14, which is in beta right now, includes a significant improvement to indexing. My library of ~60,000 resources went from indexing in 5h 21m to 2h 12m, a 59% reduction or 2.45x faster. Not all computers will see the same improvements, but the average increase may be around 2x.

Do the improvements also affect the merge of newly indexed resources into the existing index? On my PC the merge takes far longer than the indexing itself.

Posts 8848
Forum MVP
Bruce Dunning | Forum Activity | Replied: Sun, Mar 11 2018 5:28 AM

Mark Barnes:

Phil Gons (Faithlife):
Version 7.14, which is in beta right now, includes a significant improvement to indexing. My library of ~60,000 resources went from indexing in 5h 21m to 2h 12m, a 59% reduction or 2.45x faster. Not all computers will see the same improvements, but the average increase may be around 2x.

Do the improvements also affect the merge of newly indexed resources into the existing index? On my PC the merge takes far longer than the indexing itself.

I always thought merging and indexing were the same thing. How can you merge without indexing?

Using adventure and community to challenge young people to continually say "yes" to God

Posts 3110
Mattillo | Forum Activity | Replied: Sun, Mar 11 2018 5:55 AM

I didn't know about merging... How do I do that? Is there a benefit?

Posts 1379
Rick Ausdahl | Forum Activity | Replied: Sun, Mar 11 2018 7:08 AM

Phil Gons (Faithlife):

Version 7.14, which is in beta right now, includes a significant improvement to indexing. My library of ~60,000 resources went from indexing in 5h 21m to 2h 12m, a 59% reduction or 2.45x faster. Not all computers will see the same improvements, but the average increase may be around 2x.

We're also exploring selective download and cloud resources, which would let you choose what to install locally (and index) and what to leave in the cloud and have access to only when online.

We're considering some improvements to resource hiding, too.

That's all good news, Phil!  I hope it all (including improvements to resource hiding/unhiding) makes it into Logos soon.

Posts 13309
Forum MVP
Mark Barnes | Forum Activity | Replied: Sun, Mar 11 2018 7:32 AM

Bruce Dunning:
I always thought merging and indexing were the same thing. How can you merge without indexing?

You can't merge without indexing, but you can index without merging (by re-creating the whole index, rather than creating a supplement index and merging it into the main one). The example Phil gave was of indexing without merging (i.e. a complete rebuild).

Looking at an old log (which happens to be indexing 16 new resources in 7.12 beta 3), it took 15 seconds to create the supplemental index, but 15 minutes to merge them.

Looking at a new log (indexing 2 new resources in 7.14 beta 2), it took 4 seconds to create the supplemental index, but 16 minutes to merge them.

In other words, there appears to be no improvement. That suggests the improvements are only in the 'create the index' stage. If so there will be no benefit to Logos users other than when they download/install for the first time — which means we're all getting over excited.

Posts 13309
Forum MVP
Mark Barnes | Forum Activity | Replied: Sun, Mar 11 2018 7:37 AM

Mattillo:

I didn't know about merging... How do I do that? Is there a benefit?

Merging happens automatically, as part of indexing. It used to be a secondary operation in Logos 4.0, so you'd get two sets of search results — from the main index and then the supplemental index. But merging has happened by default for many releases now.

Page 1 of 2 (29 items) 1 2 Next > | RSS