5.1a SR-1: Indexer Crashes at 99% Complete

Ryan Schatz
Ryan Schatz Member Posts: 147 ✭✭

This has been happening for me for the last few beta releases.  My indexer nearly completes and then crashes (windows tells me that Logos has encountered an error and whether I want to close it or look online for a solution to the problem).

I'm using Windows7.

Logs attached.0576.LogosIndexerError_ryanschatz.zip

Comments

  • Bradley Grainger (Logos)
    Bradley Grainger (Logos) Administrator, Logos Employee Posts: 12,138

    It looks like the indexer is failing at the very last step of merging indexes. The easiest way to fix it (although it will require a complete reindex) is simply to wipe out the existing index by deleting this folder:

    C:\Users\schatzr\AppData\Local\Logos4\Data\ujcnlvdh.qnv\LibraryIndex

    BTW, I noticed that you have at least one resource collection with the rule "title:*". You'll see a speed improvement in Logos 5 if you change the rule to just "*" (without quotes).

  • Ryan Schatz
    Ryan Schatz Member Posts: 147 ✭✭

    It looks like the indexer is failing at the very last step of merging indexes. The easiest way to fix it (although it will require a complete reindex) is simply to wipe out the existing index by deleting this folder:

    C:\Users\schatzr\AppData\Local\Logos4\Data\ujcnlvdh.qnv\LibraryIndex

    Ok, thanks... I'm reindexing now.

    BTW, I noticed that you have at least one resource collection with the rule "title:*". You'll see a speed improvement in Logos 5 if you change the rule to just "*" (without quotes).

    Hmm... but this seems to change my results.  For instance, I have a collection which is:

    type:commentary AND (title:john OR subject:john) ANDNOT (subject:"1 John","2 John","3 John","John, 1st","John, 2nd","John, 3rd",epistles-of-john)

    This produces 78 matching results.

    If I replace it with the following, I get 489 matching results:

    type:commentary AND (john OR subject:john) ANDNOT (subject:"1 John","2 John","3 John","John, 1st","John, 2nd","John, 3rd",epistles-of-john)

    Am I misunderstanding you?

    Thanks,

    Ryan

  • JT (alabama24)
    JT (alabama24) MVP Posts: 36,523

    Am I misunderstanding you?

    I think he is talking about a rule with the wildcard (*). Using a rule of title:* will reveal all resources with a title (in other words, your entire collection). Using a rule of just * will do the same thing, but be more efficient… At least, that is what I understood him to be saying. [:)]

    macOS, iOS & iPadOS |Logs| Install
    Choose Truth Over Tribe | Become a Joyful Outsider!

  • Ryan Schatz
    Ryan Schatz Member Posts: 147 ✭✭
  • NB.Mick
    NB.Mick MVP Posts: 16,250

    alabama24 said:

    Am I misunderstanding you?

    I think he is talking about a rule with the wildcard (*). Using a rule of title:* will reveal all resources with a title (in other words, your entire collection). Using a rule of just * will do the same thing, but be more efficient… At least, that is what I understood him to be saying. Smile

    and unless Logos have implemented a new feature in search evaluation which detects * and resolves the whole library without taking much time (just tested, seems not to be the case), using a rule like rating:<6 is much faster than both.

    Have joy in the Lord! Smile

  • Bradley Grainger (Logos)
    Bradley Grainger (Logos) Administrator, Logos Employee Posts: 12,138

    NB.Mick said:

    and unless Logos have implemented a new feature in search evaluation which detects * and resolves the whole library without taking much time (just tested, seems not to be the case), using a rule like rating:<6 is much faster than both.

    Sure would have been silly for me to recommend an inefficient alternative.

  • Bradley Grainger (Logos)
    Bradley Grainger (Logos) Administrator, Logos Employee Posts: 12,138

    NB.Mick said:

    just tested, seems not to be the case

    I can't repro; can you post logs?

  • NB.Mick
    NB.Mick MVP Posts: 16,250

    NB.Mick said:

    and unless Logos have implemented a new feature in search evaluation which detects * and resolves the whole library without taking much time (just tested, seems not to be the case), using a rule like rating:<6 is much faster than both.

    Sure would have been silly for me to recommend an inefficient alternative.

    I was hoping for the new feature, that's why I "tested" before. However, it seems I was too lazy: I input these rules into the library search/filter field. On my old machine it takes roughly two minutes to re-populate the nearly 6k resources library with any of the two wildcard searches discussed here - rating:<6 works in an instant. However, populating a new collection rule field for any of the three works in an instant.

    For testing collections, I now build three of them called SPEED Test 1 through 3, each with an "all but Perseus" rule.

    I did restart Logos and checked the logs - what I see is that you now convert * -perseus to a search [inverted] perseus - whereas (title:*) -perseus stays as it was. Rating:<6 seems to be built elsewhere, but rating:<6 -perseus is not shown as an index search, maybe this also is converted to [inverted] perseus - unfortunately I can't read logs well enough to ascertain the time needed for each of these and I restarted Logos again without saving this log (and the new logos.log file doesn't show any collection rebuild lines - which probably is good, since startup was much faster), thus now I can't show the logs). [inverted] seems not wo work in manual rule input for collections or the library filter, though.

    It would be really nice to see this faster interaction in the library filter. 

     

    Have joy in the Lord! Smile

  • Bradley Grainger (Logos)
    Bradley Grainger (Logos) Administrator, Logos Employee Posts: 12,138

    NB.Mick said:

    whereas (title:*) -perseus stays as it was

    "title:*" (and "type:*") is an obvious improvement that we can add to the current logic.

    NB.Mick said:

    but rating:<6 -perseus is not shown as an index search, maybe this also is converted to [inverted] perseus 

    It is, as well as "rating:>=0 ANDNOT ..." and "rating:<=5 ANDNOT ...".

    NB.Mick said:

    It would be really nice to see this faster interaction in the library filter. 

    The library filter sorts the results by Rank (even if you choose to reorder the results by Title in the grid view), which isn't compatible with some of these optimisations. (Resource Collections don't have an implicit order, so there are more opportunities for optimisation.)

    I agree that it would be nice if the Library benefitted from these optimisations, and I'll see what's possible there.

  • NB.Mick
    NB.Mick MVP Posts: 16,250

    Thanks a lot for improving our Logos experience everyday!

    Have joy in the Lord! Smile