Perpetual "Preparing your library" and "Updating library catalog"

Rosie Perera
Rosie Perera Member Posts: 26,202 ✭✭✭✭✭
edited November 2024 in English Forum

Every time I boot this evening, I get "Preparing your library" and "Updating library catalog" but it should already be up-to-date. I downloaded a few new resources earlier today, but have restarted a dozen times and rebooted the computer, and still I'm getting "Preparing your library" and "Updating library catalog".

It used to be that Logos would not have anymore preparing/updating to do after a couple of restarts after new resources were downloaded. What's going on?

LogosError.log contains the following:

Error ID: 3073
Error detail: SQLiteException: Full: database or disk is full

I was running low on disk space an hour or so ago, but I cleared up a huge amount of space and now have 44GB free on my C: drive and 724GB free on my F: drive which is where Logos is stored. My reboot and several restarts of Logos have happened after clearing up that space.

Logs attached.

1067.LogosLogs L8.4 20190501.zip

Tagged:

Comments

  • Lynden O. Williams
    Lynden O. Williams MVP Posts: 8,992

    Mine keeps telling me that resources are ready to be added to your library. It is also saying that this will happen when the application is restarted. Restarted 3 times already. It is indexing now.

    Mission: To serve God as He desires.

  • Rick
    Rick Member Posts: 2,012 ✭✭

    Mine keeps telling me that resources are ready to be added to your library. It is also saying that this will happen when the application is restarted. Restarted 3 times already. It is indexing now.

    I had the same situation and I posted my solution to the problem here: https://community.logos.com/forums/t/181105.aspx 

    For me, resources aren't downloading in the library correctly.

  • Rosie Perera
    Rosie Perera Member Posts: 26,202 ✭✭✭✭✭

    Rick said:

    Mine keeps telling me that resources are ready to be added to your library. It is also saying that this will happen when the application is restarted. Restarted 3 times already. It is indexing now.

    I had the same situation and I posted my solution to the problem here: https://community.logos.com/forums/t/181105.aspx 

    For me, resources aren't downloading in the library correctly.

    I appreciate your suggestion, but I don't think it's the same problem for me. I'm not getting the "Resources are Ready to be Added to Your Library" message.

    I think it somehow has to do with the fact that I was running out of disk space. I had gotten a warning message from Windows saying I had 0 space free. It was actually somewhere around 700K, but that's effectively like zero on a 1TB drive. I cleared up 44GB of space and rebooted. But Logos seems to have gotten stuck in a state where it thinks there isn't enough disk space for it to complete the update.

    I'm guessing there is some file I can delete that will fix it, but I'm not sure what file that would be. And I think that if this situation can happen, and that is indeed what's causing it, they should do a better job of detecting when the disk space problem has been remedied and be able to recover on its own without the user having to delete some obscure file that they'd only be able to find out about by contacting a very technically alert support specialist.

    I'm hoping one of the very techy MVPs might be able to help with this.

  • Randy W. Sims
    Randy W. Sims Member Posts: 2,272 ✭✭✭

    Logs show 0 MB avail on your temp drive: C:\Users\Rosie Perera\AppData\Local\Temp\

    Is something wrong with that folder? Purge that folder and check Permissions.

  • Milkman
    Milkman Member Posts: 4,868 ✭✭✭

    All done on my end. Took a couple of reboots - not with my feet, although it was frustrating enough to do so.

  • Rosie Perera
    Rosie Perera Member Posts: 26,202 ✭✭✭✭✭

    Logs show 0 MB avail on your temp drive: C:\Users\Rosie Perera\AppData\Local\Temp\

    Is something wrong with that folder? Purge that folder and check Permissions.

    I've purged everything I could delete in that folder (some files were still in use). Permissions on it aren't out of the ordinary.

    Rebooted again. Still having the same problem.

    LogosError.log is now showing "Free temp space: 39,397 MB".

    Logos.log shows thousands of Error lines like this:

    2019-05-02 23:32:52.1311 16 Error CloudResourceManager Download job for resource 'LLS:BBLDRCTNSM' was expected but not found.

    Also lots of lines like these:

    2019-05-02 23:32:52.1321 16 Error ApplicationUtility CloudResourceManager was unable to find an expected download job for a resource.
    2019-05-02 23:32:52.1741 24 Info UpdatePipelineManager Delaying update check pending completion of update check.

  • Randy W. Sims
    Randy W. Sims Member Posts: 2,272 ✭✭✭

    Logs show 0 MB avail on your temp drive: C:\Users\Rosie Perera\AppData\Local\Temp\

    Is something wrong with that folder? Purge that folder and check Permissions.

    I've purged everything I could delete in that folder (some files were still in use). Permissions on it aren't out of the ordinary.

    Rebooted again. Still having the same problem.

    LogosError.log is now showing "Free temp space: 39,397 MB".

    Did that eliminate the Disk Full error?

    Logos.log shows thousands of Error lines like this:

    2019-05-02 23:32:52.1311 16 Error CloudResourceManager Download job for resource 'LLS:BBLDRCTNSM' was expected but not found.

    I noticed those. Over 37k of them: I'm guessing one for every resource you own. Seems excessive. But I was hoping that would go away with the disk full....

    You mentioned in your OP that Logos was on drive F:, but the logs don't mention that drive. They show the normal location on C:. Are you using a folder link (junction) on your logos folder? Wonder if something in the new cloud resources code isn't following links?

    We probably need Andrew to take a look at this one.

  • Andrew Batishko
    Andrew Batishko Member, Administrator, Community Manager, Logos Employee Posts: 5,409

    You might try deleting this file: C:\Users\Rosie Perera\AppData\Local\Logos5\Data\xkysu0lr.4zp\UpdateManager\Updates.db

    This will get regenerated the next time you start the application.

    It's not clear to me why the application is attempting to download a large number of those files. Are you able to open any of the listed resources? For example, "LLS:BBLDRCTNSM" is "Biblical Directionism: A Biblical Approach to Counseling Methodology".

    Andrew Batishko | Logos software developer

  • Rosie Perera
    Rosie Perera Member Posts: 26,202 ✭✭✭✭✭

    You might try deleting this file: C:\Users\Rosie Perera\AppData\Local\Logos5\Data\xkysu0lr.4zp\UpdateManager\Updates.db

    Good idea. I tried that. But I'm still having the problem.

    It's not clear to me why the application is attempting to download a large number of those files. Are you able to open any of the listed resources? For example, "LLS:BBLDRCTNSM" is "Biblical Directionism: A Biblical Approach to Counseling Methodology".

    That one is a hidden resource. Perhaps all of those are hidden resources. I checked one other, LLS:BLESSKNGUN, which I guessed was "Blessing the King of the Universe: Transforming Your Life Through the Practice of Biblical Praise" which is also in my Hidden Resources. So maybe that's the issue.

    Here are updated log files:

    1856.Logos Logs L8.4 20190503.zip

    I'm still getting those errors of the form:

    2019-05-03 19:36:28.7927 27 Error CloudResourceManager Download job for resource 'LLS:BBLDRCTNSM' was expected but not found.

    Notice also in LogosError.log a whole slew of Exception errors of the form (these were there before too, but I didn't report above as I didn't want to complicate matters at the time).

    Program Version: 8.4 SR-1 (8.4.0.0047)
    Time: 2019-05-03 19:36:37 -07:00 (2019-05-04T02:36:37Z)
    Exception loading ContentsEntry from string: strReference=[Article=A_APRIL15|ArticleLength=42|Context=April%2015%0a%0a|Offset=0|OffsetInContext=0|Resource=PBB:95afc6e2a79f480796f4803567670e67|Version=2011-12-21T07:29:35Z], resourceId=[PBB:95afc6e2a79f480796f4803567670e67]
    System.FormatException: Unable to load contents entry for resource: PBB:95afc6e2a79f480796f4803567670e67, parameters: Article=A_APRIL15|ArticleLength=42|Context=April%2015%0a%0a|Offset=0|OffsetInContext=0|Resource=PBB:95afc6e2a79f480796f4803567670e67|Version=2011-12-21T07:29:35Z
    at Libronix.DigitalLibrary.Resources.Logos.LogosResource.LoadContentsEntryCore(String strSaved)
    at Libronix.DigitalLibrary.Documents.ReadingPlan.ContentsEntryResourceReference.LoadFromSessionReading(ReadingPlanSessionReading reading, Resource resource)

  • Rosie Perera
    Rosie Perera Member Posts: 26,202 ✭✭✭✭✭

    You mentioned in your OP that Logos was on drive F:, but the logs don't mention that drive. They show the normal location on C:. Are you using a folder link (junction) on your logos folder? Wonder if something in the new cloud resources code isn't following links?

    Yes, I'm using a folder link to point C:/Users/Rosie Perera/AppData/Logos5 to F:/Logos5

    I wonder if that could be causing a problem? I set that up a few months ago (when I had a previous crisis of running low on disk space on C:) and had had no problems up until recently. Perhaps it started with the new 8.4 release with cloud resources; not sure. I only noticed it for the first time on May 1.

  • Andrew Batishko
    Andrew Batishko Member, Administrator, Community Manager, Logos Employee Posts: 5,409

    That one is a hidden resource. Perhaps all of those are hidden resources. I checked one other, LLS:BLESSKNGUN, which I guessed was "Blessing the King of the Universe: Transforming Your Life Through the Practice of Biblical Praise" which is also in my Hidden Resources. So maybe that's the issue.

    Ah ha... that's really good to know. That explains why the problem keeps coming back. I'll investigate on Monday.

    Andrew Batishko | Logos software developer

  • Randy W. Sims
    Randy W. Sims Member Posts: 2,272 ✭✭✭

    Notice also in LogosError.log a whole slew of Exception errors of the form (these were there before too, but I didn't report above as I didn't want to complicate matters at the time).

    Program Version: 8.4 SR-1 (8.4.0.0047)
    Time: 2019-05-03 19:36:37 -07:00 (2019-05-04T02:36:37Z)
    Exception loading ContentsEntry from string: strReference=[Article=A_APRIL15|ArticleLength=42|Context=April%2015%0a%0a|Offset=0|OffsetInContext=0|Resource=PBB:95afc6e2a79f480796f4803567670e67|Version=2011-12-21T07:29:35Z], resourceId=[PBB:95afc6e2a79f480796f4803567670e67]
    System.FormatException: Unable to load contents entry for resource: PBB:95afc6e2a79f480796f4803567670e67, parameters: Article=A_APRIL15|ArticleLength=42|Context=April%2015%0a%0a|Offset=0|OffsetInContext=0|Resource=PBB:95afc6e2a79f480796f4803567670e67|Version=2011-12-21T07:29:35Z

    These are errors in one of your Personal Books. All in the same book. You can see which by entering it in the GO box: PBB:95afc6e2a79f480796f4803567670e67.

    It's not clear to me why the application is attempting to download a large number of those files. Are you able to open any of the listed resources? For example, "LLS:BBLDRCTNSM" is "Biblical Directionism: A Biblical Approach to Counseling Methodology".

    That one is a hidden resource. Perhaps all of those are hidden resources.

    There are over 27k of those mentioned in the log file. Are they all hidden? [:O]

  • Rosie Perera
    Rosie Perera Member Posts: 26,202 ✭✭✭✭✭

    These are errors in one of your Personal Books. All in the same book. You can see which by entering it in the GO box: PBB:95afc6e2a79f480796f4803567670e67.

    Hmm, the plot thickens. That is a personal book I have called Daily Bible Reading: A Chronological Plan, which I got from Warren Doud's site www.gracenotes.info.

    It had last been built in 2013, so I rebuilt it. Got the following error:

    [Error] Font 'Calibri' is not a valid font for use in resources.

    That's weird. It hadn't caused that error before when I'd built it back in 2013. And why couldn't I use whatever fonts I wanted for a PBB?

    Anyway, I changed the font throughout to Times New Roman and rebuilt, and that error went away.

    But I'm still getting the "Exception loading..." errors from that PBB. Any clues as to what else might be causing that? The book builds fine and opens fine and functions fine. Here is the docx file:

    4628.Daily Bible Reading - A Chronological Plan.docx

    There are also a bunch of errors in my Logos.log of the form:

    2019-05-04 19:36:22.9641 1 Error ApplicationUtility Exception loading ContentsEntry from string: strReference=[Article=R1|ArticleLength=3|Context=%20%20%0a|Offset=0|OffsetInContext=0|Resource=LLS:9781441240439|Version=2012-09-10T20:57:28Z], resourceId=[LLS:9781441240439] ~FormatException: Unable to load contents entry for resource: LLS:9781441240439, parameters: Article=R1|ArticleLength=3|Context=%20%20%0a|Offset=0|OffsetInContext=0|Resource=LLS:9781441240439|Version=2012-09-10T20:57:28Z

    And this is with a Faithlife eBook, LLS:9781441240439 (Devotions for Advent (Ebook Shorts): Meditations Based on Best-Loved Hymns). So not my fault.

    There are over 27k of those mentioned in the log file. Are they all hidden? Surprise

    Well, I don't know exactly how many hidden resources I have (it's impossible to count). But I wouldn't doubt it. I hid most if not all of the Library of Early English History and there are over 25k volumes in that.

  • danwdoo
    danwdoo Member Posts: 580 ✭✭✭

    I have been getting the "preparing your library" staying up for 5-10 seconds each time I start Logos for while now even when no resources have been added. I assumed this behavior was from one of the recent updates and have been hoping it will be addressed soon, but it could be some kind of resource issue.

  • Randy W. Sims
    Randy W. Sims Member Posts: 2,272 ✭✭✭

    Hmm, the plot thickens. That is a personal book I have called Daily Bible Reading: A Chronological Plan, which I got from Warren Doud's site www.gracenotes.info.

    It had last been built in 2013, so I rebuilt it. Got the following error:

    [Error] Font 'Calibri' is not a valid font for use in resources.

    That's weird. It hadn't caused that error before when I'd built it back in 2013. And why couldn't I use whatever fonts I wanted for a PBB?

    Anyway, I changed the font throughout to Times New Roman and rebuilt, and that error went away.

    But I'm still getting the "Exception loading..." errors from that PBB. Any clues as to what else might be causing that? The book builds fine and opens fine and functions fine. Here is the docx file:

    4628.Daily Bible Reading - A Chronological Plan.docx

    I've tried very briefly this morning, but I can't repro this. I tried this file as well as the two posted to:

    https://community.logos.com/forums/t/41690.aspx

    Added Personal Book, type Calendar Devotional. Added to a card to home page. No PBB compile errors. Nothing in Logos.log nor LogosError.log. Not sure if there are outside factors that could cause different results? Not sure what the error refers to; the only reference to it that I find in the forums is from another post by you:

    https://community.logos.com/forums/p/171043/1031362.aspx#1031362

    Rosie Perera said:

    There are also a bunch of errors in my Logos.log of the form:

    2019-05-04 19:36:22.9641 1 Error ApplicationUtility Exception loading ContentsEntry from string: strReference=[Article=R1|ArticleLength=3|Context=%20%20%0a|Offset=0|OffsetInContext=0|Resource=LLS:9781441240439|Version=2012-09-10T20:57:28Z], resourceId=[LLS:9781441240439] ~FormatException: Unable to load contents entry for resource: LLS:9781441240439, parameters: Article=R1|ArticleLength=3|Context=%20%20%0a|Offset=0|OffsetInContext=0|Resource=LLS:9781441240439|Version=2012-09-10T20:57:28Z

    And this is with a Faithlife eBook, LLS:9781441240439 (Devotions for Advent (Ebook Shorts): Meditations Based on Best-Loved Hymns). So not my fault.

    That looks like the same error but on a different resource. I have that book also, but no errors [:S]

  • Andrew Batishko
    Andrew Batishko Member, Administrator, Community Manager, Logos Employee Posts: 5,409

    Try deleting this file. If this doesn't fix the problem, please post the log from the first run after the file was deleted.

    C:\Users\Rosie Perera\AppData\Local\Logos5\Data\xkysu0lr.4zp\CloudResourceManager\CloudResources.db

    Andrew Batishko | Logos software developer

  • Andrew Batishko
    Andrew Batishko Member, Administrator, Community Manager, Logos Employee Posts: 5,409

    There are over 27k of those mentioned in the log file. Are they all hidden?

    From the log file:

    2019-05-01 23:33:24.7445 32 Info LDLS4.AppModel There are 27375 hidden resources.

    Andrew Batishko | Logos software developer

  • Randy W. Sims
    Randy W. Sims Member Posts: 2,272 ✭✭✭

    There are over 27k of those mentioned in the log file. Are they all hidden?

    From the log file:

    2019-05-01 23:33:24.7445 32 Info LDLS4.AppModel There are 27375 hidden resources.

    Thank you for pointing that out. I completely missed that. That might have been a good clue!

  • Rosie Perera
    Rosie Perera Member Posts: 26,202 ✭✭✭✭✭

    Try deleting this file. If this doesn't fix the problem, please post the log from the first run after the file was deleted.

    C:\Users\Rosie Perera\AppData\Local\Logos5\Data\xkysu0lr.4zp\CloudResourceManager\CloudResources.db

    Did that. The problem is still there.

    Here's the log from the first run after I deleted that file:

    8105.Logos.log

  • Andrew Batishko
    Andrew Batishko Member, Administrator, Community Manager, Logos Employee Posts: 5,409

    Did that. The problem is still there.

    Here's the log from the first run after I deleted that file:

    It looks like the application is updating the metadata for 212 resources, and updating community metadata for all resources. Can you run once and wait for the yellow notification bar in the library to go away (to make sure that everything is up to date). Then restart the application and post the log from the second run. The second run shouldn't be updating metadata, but there may be some kind of problem with that.

    Andrew Batishko | Logos software developer

  • Rosie Perera
    Rosie Perera Member Posts: 26,202 ✭✭✭✭✭

    It looks like the application is updating the metadata for 212 resources, and updating community metadata for all resources. Can you run once and wait for the yellow notification bar in the library to go away (to make sure that everything is up to date). Then restart the application and post the log from the second run. The second run shouldn't be updating metadata, but there may be some kind of problem with that.

    Here you go again. It still puts up the "Preparing your library" message every time I restart it, and it still gets the yellow notification bar in the library every time, though the latter lasts only a second now.

    7658.Logos.log

    Still lots of errors in that log file, though they seem unrelated to the "Preparing your library" problem. Let's troubleshoot one thing a a time.

  • Rodney Phillips
    Rodney Phillips Member Posts: 656

    I have a similar problem I think.   For the past 2 or 3 days mine always says "Resources are ready to be added to your Library"   "Updates will be added when the application is restarted".  But have restarted several times and this message always comes back..   And no other messages but this one.   

  • Randy W. Sims
    Randy W. Sims Member Posts: 2,272 ✭✭✭

    I have a similar problem I think.   For the past 2 or 3 days mine always says "Resources are ready to be added to your Library"   "Updates will be added when the application is restarted".  But have restarted several times and this message always comes back..   And no other messages but this one.   

    This is unlikely related to this thread, but not sure without logs. You can try the solution posted here:

      https://community.logos.com/forums/p/181105/1047622.aspx#1047622

    If that does not work, please start a new thread with details and include logs:

      Windows => https://support.logos.com/hc/en-us/articles/360008571551

      Mac => https://support.logos.com/hc/en-us/articles/360015776171

  • Rosie Perera
    Rosie Perera Member Posts: 26,202 ✭✭✭✭✭

    I have a similar problem I think.   For the past 2 or 3 days mine always says "Resources are ready to be added to your Library"   "Updates will be added when the application is restarted".  But have restarted several times and this message always comes back..   And no other messages but this one.   

    This is a separate problem which is discussed in this thread and has apparently been fixed in the latest beta, so you'll get it with the next stable release (8.5) whenever that ships.

    But I'm still waiting to hear back from Andrew on my latest posted log. Or should I just hope that the fix in 8.5 Beta 3 might have fixed my issue as well and wait for the stable release?

  • Rosie Perera
    Rosie Perera Member Posts: 26,202 ✭✭✭✭✭

    It looks like the application is updating the metadata for 212 resources, and updating community metadata for all resources. Can you run once and wait for the yellow notification bar in the library to go away (to make sure that everything is up to date). Then restart the application and post the log from the second run. The second run shouldn't be updating metadata, but there may be some kind of problem with that.

    Andrew, I posted that log for you above as requested. Any thoughts?

  • Andrew Batishko
    Andrew Batishko Member, Administrator, Community Manager, Logos Employee Posts: 5,409

    Sorry about the delay in responding.

    The errors you mentioned are almost certainly the result of some kind of link to a position in a PBB resources where the PBB was significantly changed and recompiled (such as a shortcut, note attachment, etc). This is nothing new, and isn't really likely to be causing a performance impact. Note that all of those message are logged over the span of less than a second.

    I do notice some network-related errors in the log. This could be slowing things down if network problems are causing delays or timeouts.

    The "Preparing your library" message during startup is actually an entirely generic message, and pretty much just means that the application is busy doing some stuff that isn't more specifically categorized (such as syncing). There's not really any significance to the fact that that specific message is appearing.

    The main window is displaying within 8 seconds (although another 5 seconds until it finishes displaying the initial layout), which certainly seems reasonable. Is that significantly slower than previous?

    I don't really see anything else that looks concerning.

    Andrew Batishko | Logos software developer

  • Rosie Perera
    Rosie Perera Member Posts: 26,202 ✭✭✭✭✭

    The "Preparing your library" message during startup is actually an entirely generic message, and pretty much just means that the application is busy doing some stuff that isn't more specifically categorized (such as syncing). There's not really any significance to the fact that that specific message is appearing.

    Well, it never used to happen every single time I restarted the app. Only the first time or two after new resources were downloaded. Now it happens every time. So I was just wondering what might have changed to make that happen every time now. It's not a huge problem or delay.

    The main window is displaying within 8 seconds (although another 5 seconds until it finishes displaying the initial layout), which certainly seems reasonable. Is that significantly slower than previous?

    No, it's not significantly slower. But 13 seconds is longer than I'd like to have to wait before I'm able to use the program. I've always wondered whether some performance improvement at startup could be achieved by waiting to display any windows until the full layout was figured out. There's always a lot of temporary flashing of windows and black rectangles and such. When I was working on development of a major Windows app (Microsoft Word), the practice was always to create the main window hidden and do all the work on the layout of it behind the scenes while it was still invisible and then show it so that suddenly it all appeared in its final state. It avoids all the flickering/flashing of the display and speeds startup up because the GDI calls are quicker when they are done in memory and not actually going to the display yet. I never got any Logos developer to respond to that suggestion or acknowledge that it might be something they'd look into.

  • Ron Ferguson
    Ron Ferguson Member Posts: 89 ✭✭
  • Rosie Perera
    Rosie Perera Member Posts: 26,202 ✭✭✭✭✭

    This was in an earlier forum today.  Fixed my problem, and others.

    https://community.logos.com/forums/t/181264.aspx 

    Thanks. That's a different issue.