Bug Reindexing for no apparent reason

Lewis Harper
Lewis Harper Member Posts: 450 ✭✭

After updating to RC1 on Monday, Logos did a completer reindex.  Today for no apparent reason it started to do a complete reindex again for no apparent reason.  I have almost 15000 resources and don't have time to reindex every day or two.  Please Help!!

6811.LogosLogs.lewisharper.20160302-160143.zip

MacBook Pro 10.11.4

Comments

  • JT (alabama24)
    JT (alabama24) MVP Posts: 36,512

    I am not on beta (Logos engine nor OSX), but I have had similar problems recently. Ugh.  

    macOS, iOS & iPadOS |Logs| Install
    truth over tribe

  • Lewis Harper
    Lewis Harper Member Posts: 450 ✭✭

    Thanks for confirming Alabama24,

    I hope we can get this resolved soon.

  • Levi Durfey
    Levi Durfey Member Posts: 2,214 ✭✭✭

    After updating to RC1 on Monday, Logos did a completer reindex.  Today for no apparent reason it started to do a complete reindex again for no apparent reason.  I have almost 15000 resources and don't have time to reindex every day or two.  Please Help!!

    I've had the same thing happen after installing 6.10 RC 1—multiple times. 

    1565.LogosLogs.Levi.20160302-140717 2.zip

    I've also had two Logos Indexer processes come up--

  • Steve Workman
    Steve Workman Member, Logos Employee Posts: 282

    We are looking into this currently.  I am also encountering this issue.

  • Levi Durfey
    Levi Durfey Member Posts: 2,214 ✭✭✭

    We are looking into this currently.  I am also encountering this issue.

    👍🏼Great!

  • HansK
    HansK Member Posts: 570 ✭✭

    After updating to RC1 on Monday, Logos did a completer reindex.  Today for no apparent reason it started to do a complete reindex again for no apparent reason.  I have almost 15000 resources and don't have time to reindex every day or two.  Please Help!!

    Same here for me. Reindex all of a sudden with RC 1 for Mac.

    And it takes a lot of memory....

    Not happy :-)

    Hans

    MacOS Sierra / Logos 7 Collector's Edition & All Base Packages / Logos Now

  • HansK
    HansK Member Posts: 570 ✭✭

    Here is the essential part of my indexer.log:

    2016-03-03 00:56:06.0505 | INFO | 12 | DigitalLibraryServices | (10ms) Creating library index.
    2016-03-03 00:56:06.0730 | INFO | 12 | LocalFileDatabase | Found existing database at /Users/xx/Library/Application Support/Logos4/Data/ygskfvlz.e6c/AutoComplete/AutoComplete.db
    2016-03-03 00:56:06.0746 | INFO | 12 | DigitalLibraryServices | (548ms) Creating auto complete manager.
    2016-03-03 00:56:06.0805 | INFO | 12 | IndexerProgram | (555ms) Updating Auto Complete from Resource Manager.
    2016-03-03 00:56:06.0808 | INFO | 12 | DigitalLibraryServices | (Timed) Creating bible index.
    2016-03-03 00:56:06.0877 | INFO | 12 | LocalFileDatabase | Found existing database at /Users/xx/Library/Application Support/Logos4/Data/ygskfvlz.e6c/BibleIndex/LibraryIndex.db
    2016-03-03 00:56:06.0877 | INFO | 12 | DigitalLibraryServices | (7ms) Creating bible index.
    2016-03-03 00:56:06.0889 | INFO | 12 | DigitalLibraryServices | (Timed) Creating personal book index.
    2016-03-03 00:56:06.0956 | INFO | 12 | LocalFileDatabase | Found existing database at /Users/xx/Library/Application Support/Logos4/Data/ygskfvlz.e6c/PersonalBookIndex/LibraryIndex.db
    2016-03-03 00:56:06.0956 | INFO | 12 | DigitalLibraryServices | (7ms) Creating personal book index.
    2016-03-03 00:56:06.0956 | INFO | 12 | IndexerProgram | (Timed) Updating Bible Index from Resource Manager.
    2016-03-03 00:56:06.5133 | INFO | 12 | SQLite Profile | 405ms in reverseinterlinearmanager.db for: select ResourceId, ResourceVersion, AssociatedResourceId, SourceTextResourceId, DataType from Resources
    2016-03-03 00:56:06.5357 | INFO | 12 | BibleIndex | Checking 0 resources that may have changed since they were last indexed.
    2016-03-03 00:56:06.5405 | INFO | 12 | BibleIndex | No resources need to be indexed.
    2016-03-03 00:56:06.5897 | INFO | 12 | IndexerProgram | (493ms) Updating Bible Index from Resource Manager.
    2016-03-03 00:56:06.5897 | INFO | 12 | IndexerProgram | (Timed) Updating Library Index from Resource Manager.
    2016-03-03 00:56:06.5908 | INFO | 12 | LibraryIndex | Full re-index (and deletion of existing index) requested.
    2016-03-03 00:56:06.5956 | INFO | 12 | LibraryIndex | Checking 0 resources that may have changed since they were last indexed.
    2016-03-03 00:56:06.6000 | INFO | 12 | LibraryIndex | No resources need to be indexed.
    2016-03-03 00:56:06.6084 | INFO | 12 | LibraryIndex | Final count: 21,595 resources need to be indexed; no merge necessary.
    2016-03-03 00:56:06.6126 | INFO | 12 | IndexerProgram | (23ms) Updating Library Index from Resource Manager.
    2016-03-03 00:56:06.6126 | INFO | 12 | IndexerProgram | (Timed) Updating Personal Book Index from Resource Manager.
    2016-03-03 00:56:06.6171 | INFO | 12 | PersonalBookIndex | Checking 0 resources that may have changed since they were last indexed.
    2016-03-03 00:56:06.6201 | INFO | 12 | PersonalBookIndex | No resources need to be indexed.
    2016-03-03 00:56:06.6271 | INFO | 12 | IndexerProgram | (14ms) Updating Personal Book Index from Resource Manager.
    2016-03-03 00:56:06.6492 | INFO | 12 | IndexerProgram | (Timed) Indexing.
    2016-03-03 00:56:06.6537 | INFO | 12 | IndexerProgram | Waiting for library indexing to finish.
    2016-03-03 00:56:06.6743 | INFO | 21 | BibleIndex | 0 unindexed resources out of 1766 indexable resources; supplemental index count is 0.
    2016-03-03 00:56:06.6752 | INFO | 21 | BibleIndex | All indexable resources are indexed in a single main index; marking index up-to-date.
    2016-03-03 00:56:06.7054 | INFO | 23 | LibraryIndex | 0 unindexed resources out of 21595 indexable resources; supplemental index count is 0.
    2016-03-03 00:56:06.7844 | INFO | 23 | LibraryIndex | Creating a new library index 'index-build' (type 0) in /Users/xx/Library/Application Support/Logos4/Data/ygskfvlz.e6c/LibraryIndex
    2016-03-03 00:56:06.7857 | INFO | 24 | LibraryIndex | Starting additional library indexing thread.
    2016-03-03 00:56:06.7857 | INFO | 26 | LibraryIndex | Starting additional library indexing thread.
    2016-03-03 00:56:06.7857 | INFO | 25 | LibraryIndex | Starting additional library indexing thread.
    2016-03-03 00:56:06.7911 | INFO | 23 | LibraryIndex | (Timed) Indexing {0AF5CA4B-7D90-40FC-B93A-53E7A2CF93CC}
    2016-03-03 00:56:06.7911 | INFO | 26 | LibraryIndex | (Timed) Indexing {A664EA2D-D387-40FC-9C2D-D8967E5B1E88}
    2016-03-03 00:56:06.7911 | INFO | 24 | LibraryIndex | (Timed) Indexing {868BA74B-1BCC-4AE1-BE5C-570F30514045}
    2016-03-03 00:56:06.7911 | INFO | 25 | LibraryIndex | (Timed) Indexing {2AD3832E-1731-4244-9A9F-C5996DF6823D}
    2016-03-03 00:56:07.2073 | INFO | 26 | MacIndexerProgress | 1 of 21,595 resources indexed; current phase progress is 0.0%
    2016-03-03 00:56:07.2079 | INFO | 25 | MacIndexerProgress | 2 of 21,595 resources indexed; current phase progress is 0.0%
    2016-03-03 00:56:07.2079 | INFO | 24 | MacIndexerProgress | 3 of 21,595 resources indexed; current phase progress is 0.0%
    2016- etc etc

    MacOS Sierra / Logos 7 Collector's Edition & All Base Packages / Logos Now

  • JT (alabama24)
    JT (alabama24) MVP Posts: 36,512

    We are looking into this currently.  I am also encountering this issue.

    Good! I don't know if it is related, but my MacBook gave up the ghost during the last time this happened. [:s]

    macOS, iOS & iPadOS |Logs| Install
    truth over tribe

  • Reuben Helmuth
    Reuben Helmuth MVP Posts: 2,485

    Just wanted to say that I too am experiencing this...so glad it's being addressed though! 

    Could the same bug be affecting the startup speed? Even on 6.10-RC1 startup is excruciatingly slow and I have to watch a blank white screen with a spinning beach ball for a couple minutes...and that is on one of the fastest laptops available!

  • Steve Workman
    Steve Workman Member, Logos Employee Posts: 282

    This part of your log is what kicks off the reindexing:

    Hans K said:

    2016-03-03 00:56:06.5908 | INFO | 12 | LibraryIndex | Full re-index (and deletion of existing index) requested.

    This request is coming from Logos directly, if it matches the other logos.log files the corruption that it's detecting has to do with this phrase "Corrupt index detected. ~CorruptIndexException: Couldn't load document sections."  We are still working on getting to the bottom of this.

  • Steve Workman
    Steve Workman Member, Logos Employee Posts: 282

    alabama24 said:

    Good! I don't know if it is related, but my MacBook gave up the ghost during the last time this happened. Tongue Tied

     

    Ouch, that is never a fun time.  I don't believe there is any relation to this at all.

  • JT (alabama24)
    JT (alabama24) MVP Posts: 36,512

    alabama24 said:

    Good! I don't know if it is related, but my MacBook gave up the ghost during the last time this happened. Tongue Tied

     

    Ouch, that is never a fun time.  I don't believe there is any relation to this at all.

    I think there is a connection, but in the sense of "the feather that broke the camels back." My installation required a full reindex in short succession, and each time I needed to pause it at various points to prevent it from overheating. I ran hardware tests and everything came back fine. I haven't taken out the SSD yet, but there didn't seem to be any trouble with it. 

    macOS, iOS & iPadOS |Logs| Install
    truth over tribe

  • Angela Murashov
    Angela Murashov Member Posts: 1,532

    We are looking into this currently.  I am also encountering this issue.

    This should be fixed in 6.10 RC2. 

  • Levi Durfey
    Levi Durfey Member Posts: 2,214 ✭✭✭

    This bug is still active.  Can we please get this fixed?

    Unfortunately, it seems to be the case for me also. I had downgraded to 6.9 SR-1 after encountering the bug in 6.10 RC 1. Not long after installing the 6.10 final release, Logos crashed and started reindexing. 

    5076.LogosLogs.Levi.20160307-135113.zip

  • Steve Workman
    Steve Workman Member, Logos Employee Posts: 282

    Thanks for the logs, I have reopened the case and we are looking into it.

  • Steve Workman
    Steve Workman Member, Logos Employee Posts: 282

    We are still looking into it.  This is a complex problem that we are working on getting to the bottom of.

  • Levi Durfey
    Levi Durfey Member Posts: 2,214 ✭✭✭

    We are still looking into it.  This is a complex problem that we are working on getting to the bottom of.

    In the meantime, I seem to have been able to keep it from happening by turning off the "Use Internet" setting in Program Settings.

  • HansK
    HansK Member Posts: 570 ✭✭

    We are still looking into it.  This is a complex problem that we are working on getting to the bottom of.

    Steve, I noticed that in the recent logos.log files of Levi and Lewis, there are memory errors:

    ..... Memory wanted to read 8 bytes, but got 0

    I found out (do not ask me how, I do not know) that clearing the memory cache does solve this.

    Perhaps, perhaps this helps you good folks at FL. Thanks for all your work.

    Hans

    MacOS Sierra / Logos 7 Collector's Edition & All Base Packages / Logos Now

  • Angela Murashov
    Angela Murashov Member Posts: 1,532

    We are still looking into it.  This is a complex problem that we are working on getting to the bottom of.

    This should be fixed in 6.10 SR-2. Please let us know if you are still having this issue after the update.

  • John R. Gentry
    John R. Gentry Member Posts: 94
    I was having the same problems. Thanks for fixing this FL / Logos!!! Y'all are awesome!

    John
  • Lewis Harper
    Lewis Harper Member Posts: 450 ✭✭