Bug: Indexing seems to be broken.

Michael Fordham
Michael Fordham Member Posts: 163
edited November 21 in English Forum

Hi,

I added 2 new resources a couple of days ago and things seemed fine.

Today, my library started indexing and the indicator said it had finished, but search panels now contain the banner which says "Some search results may be missing or incorrect while your library is being updated" and the search results are almost empty, showing results for just one book.

I tried the "Rebuild Index" command, but it hasn't made any difference.

Should I uninstall and re-install? Or is there a quicker and easier solution?

I have attached logs. (I did check them to see if there was anything obvious and easy to fix. The logs say I am using windows 10, but it is a fresh build on windows 11.)

Tagged:
«1

Comments

  • Dave Hooton
    Dave Hooton Member, MVP Posts: 35,672 ✭✭✭

    I tried the "Rebuild Index" command, but it hasn't made any difference.

    Should I uninstall and re-install? Or is there a quicker and easier solution?

    The Indexer did not complete according to the log. How much free space do you have on the disk drive where Logos is installed?

    The logs say I am using windows 10, but it is a fresh build on windows 11.

    It is the peculiarity of Windows naming, but the build number 22631.0 says it is Windows 11.

    Dave
    ===

    Windows 11 & Android 13

  • Michael Fordham
    Michael Fordham Member Posts: 163

    Hi Dave,

    I didn't think this was posted because the web page registered an error, so I tried an alternative browser and also got an error.

    I have over 1.5Tb on the installation drive.

  • Michael Fordham
    Michael Fordham Member Posts: 163

    Because I was getting an error trying to post on the forum, I did a total uninstall, including deleting the Logos folder in the Local folder. Logos has downloaded all my resources and crashed when indexing. I am about to create more Logs and will post again (I hope).

  • Michael Fordham
    Michael Fordham Member Posts: 163

    Logos has updated to version 30.1 (which I was on before). It has also indexed my library.

    I just started Logos in normal mode and it is indexing again. It is now 1am, so I will let it finish then take a look tomorrow.

    I also noticed that there are a number of Logos .dmp files in the CrashDump folder:

  • Michael Fordham
    Michael Fordham Member Posts: 163

    Quick update before I go to bed: I have the same issue as in the original post. Search results are totally missing [:(]

  • Michael Fordham
    Michael Fordham Member Posts: 163

    I am at a loss now. I started Logos in diagnostic mode this morning. It started indexing again and was >50% but then my PC became unresponsive. It didn't blue screen so I left it, but after 30 minutes I had to force a reboot.

    I have attached the logs again and an image from the CrashDumps folder.

    I need to get back to my sermon prep, so any help would be much appreciated. I am using the web version meanwhile, but it is not the same.

    Regards, Michael7317.Logos Logs 03.zip

  • Michael Fordham
    Michael Fordham Member Posts: 163

    I decided to uninstall again and reinstall with the minimum library. Logos has installed, upgraded to 30.1 and indexed successfully, and I am very happy to report that the search panel seems to be working correctly.

    I will download more resources, but I am wondering if the problem is with the John Stott Sermons, which I purchased and downloaded shortly before this started happening.

  • Michael Fordham
    Michael Fordham Member Posts: 163

    I downloaded my resources in 2 halves, not including the John Stott sermons. Indexing has finished, but now the error is back, although I am seeing more results in the search panel.

    There are additional .dmp files in the CrashDumps folder. I didn't start Logos in diagnostic mode, but there are some log files which I have attached.

    8054.Logos Logs 04.zip

  • Dave Hooton
    Dave Hooton Member, MVP Posts: 35,672 ✭✭✭

    I downloaded my resources in 2 halves, not including the John Stott sermons. Indexing has finished, but now the error is back, although I am seeing more results in the search panel.

    There are additional .dmp files in the CrashDumps folder. I didn't start Logos in diagnostic mode, but there are some log files which I have attached.

    the Indexer file is missing as this is vital to identifying what was being indexed at the time of the crash.

    The crash dmp files are not useful.

    Was that 1.5 TB Free space?

    Dave
    ===

    Windows 11 & Android 13

  • Michael Fordham
    Michael Fordham Member Posts: 163

    The indexer file would be LogosIndexer.log? It is in Logos Logs 03.zip

    There isn't a current file of that name in the Logs folder.

    Yes, 1.5 Tb free space

  • Dave Hooton
    Dave Hooton Member, MVP Posts: 35,672 ✭✭✭

    The indexer file would be LogosIndexer.log? It is in Logos Logs 03.zip

    It needed to be in Logos04.zip as the files are overwritten when the Indexer runs (the Logos.log file was also missing).

    Dave
    ===

    Windows 11 & Android 13

  • Michael Fordham
    Michael Fordham Member Posts: 163

    Hi Dave, I zipped up the complete folder, so everything that was there is included.

    I have uninstalled again (4th time?) and tried adding my library in smaller chunks. I currently have 1300 resources downloaded with 900 left to go. The total library size is ~18Gb. I was getting the same message saying that my library was being updated even though there was apparently no indexing going on, but right now the search panel seems happy and is working as it should.

    I am off to bed now, but let me know what you need me to do and I will gladly provide what I can.

    Regards,

    Michael

  • Michael Fordham
    Michael Fordham Member Posts: 163

    I started Logos in diagnostic mode and began downloading the rest of my library.

    Another crash.

    Logs attached.

    0486.Logos Logs 05.zip

  • Michael Fordham
    Michael Fordham Member Posts: 163

    I restarted Logos in diagnostic mode. It ran through the indexing and has finished. I am now back to square 1 with the search panel saying that search results may be missing while the library is being indexed.

    Logs attached.

    I can't leave it like this though. If I search all my books, I am getting results only in the one book that isn't downloaded.

    I am going to have to uninstall AGAIN.

    4762.Logos Logs 06.zip

  • MJ. Smith
    MJ. Smith Member, MVP Posts: 53,071 ✭✭✭✭✭

    How are you reinstalling? Are you actually removing all the files or just reinstalling the software. Your problem is a corrupt index. Dave's answer to another user is:

    You have a corrupt index, so you need to remove the folder /Users/Jason/Library/Application Support/Logos4/Data/y7yekpus.99s/LibraryIndex/ then restart Logos to commence indexing (which will take a while!)

    You need to use the user name and the random id of your application (I put them in italics.)

    Orthodox Bishop Alfeyev: "To be a theologian means to have experience of a personal encounter with God through prayer and worship."; Orthodox proverb: "We know where the Church is, we do not know where it is not."

  • Michael Fordham
    Michael Fordham Member Posts: 163

    How are you reinstalling? Are you actually removing all the files or just reinstalling the software. Your problem is a corrupt index. Dave's answer to another user is:

    You have a corrupt index, so you need to remove the folder /Users/Jason/Library/Application Support/Logos4/Data/y7yekpus.99s/LibraryIndex/ then restart Logos to commence indexing (which will take a while!)

    You need to use the user name and the random id of your application (I put them in italics.)

    I am following the instructions from https://wiki.logos.com/Uninstall_Logos

    Fully uninstalling, then deleting the Logos folder from %LocalAppData%

    There is no Library folder under Users/micha/ (I think that comes from an older version of Logos.)

    The only thing I'm not doing is going through the registry, but there are no instructions saying that is necessary.

  • MJ. Smith
    MJ. Smith Member, MVP Posts: 53,071 ✭✭✭✭✭

    Here are recent instructions. Your logs show a corrupt index. 

    Hi Brian--Sorry for the trouble here. Sounds like your library index has gotten into some weird state. The solution will probably be to totally blow it away and let the application rebuild it. But if you don't mind, would you check a few things for us first? It might help us to understand how you've gotten into this state so we can prevent others from getting into the same position.

    First, close the application completely.

    If you've previously enabled logging, you might have some logs that would be helpful for us. Or if you haven't, and you're up for it, might be good to enable logging. The instructions for enabling logging and/or fetching logs can be found here. This might help us to understand what's going on, but if you don't have time right now and just want to get your problem fixed, feel free to skip this step.

    Now you'll want to go find your library index files. They're located in a folder that mac keeps hidden, so you'll want to open finder, go to /Users/{your username} and press cmd + shift + . (all at the same time) to show hidden files and folders. Once you do that, you should see the `Library` folder. From there you'll be able to get to your index files. The full path to your library index files is `/Users/{your username}/Library/Application Support/Logos4/Data/{some random folder name}/Library Index`.

    Once you're there (in the `Library Index` folder) it would be helpful for us to have a list of all the files in that folder. Could you share that with us? Also, it would be great if you could upload here the `LibraryIndex.db` file. It might help us to better understand what's happened.

    After you've (hopefully) made note of the filenames in that folder and grabbed the `LibraryIndex.db` file to share with us, go ahead and delete that entire `Library Index` folder.

    After you've deleted it, start up the application, and it should automatically start rebuilding the index. This is similar to doing a `rebuild index` in the command box, so it'll take some time, but is usually an effective way to resolve any corruption in the index, even if the problem isn't resolved by the `rebuild index` command.

    Hope this does the trick. Keep us posted. And thanks for posting the issue here.

    -Ronny

    Orthodox Bishop Alfeyev: "To be a theologian means to have experience of a personal encounter with God through prayer and worship."; Orthodox proverb: "We know where the Church is, we do not know where it is not."

  • Michael Fordham
    Michael Fordham Member Posts: 163

    Hi, I really appreciate you trying to help.

    If you've previously enabled logging, you might have some logs that would be helpful for us. Or if you haven't, and you're up for it, might be good to enable logging. The instructions for enabling logging and/or fetching logs can be found here. This might help us to understand what's going on, but if you don't have time right now and just want to get your problem fixed, feel free to skip this step.

    I have been following those instructions and have log files saved from each time I experienced issues. I have uploaded them in zipped files called Logos Logs xx.zip with sequential numbers.

    Now you'll want to go find your library index files. They're located in a folder that mac keeps hidden, so you'll want to open finder, go to /Users/{your username} and press cmd + shift + . (all at the same time) to show hidden files and folders. Once you do that, you should see the `Library` folder. From there you'll be able to get to your index files. The full path to your library index files is `/Users/{your username}/Library/Application Support/Logos4/Data/{some random folder name}/Library Index`.

    Once you're there (in the `Library Index` folder) it would be helpful for us to have a list of all the files in that folder. Could you share that with us? Also, it would be great if you could upload here the `LibraryIndex.db` file. It might help us to better understand what's happened.

    I think those instructions are for a mac, but on a PC the files are stored in a different location under /AppData/Local/Logos.

    I have just done a fresh install with minimum resources and have located the LibraryIndex.db file, but I don't have the file from previous installations because it gets deleted when I uninstall. That is good information though, because I can get this information when this happens again, which it will if I download all my resources.

    After you've deleted it, start up the application, and it should automatically start rebuilding the index. This is similar to doing a `rebuild index` in the command box, so it'll take some time, but is usually an effective way to resolve any corruption in the index, even if the problem isn't resolved by the `rebuild index` command.

    Hope this does the trick. Keep us posted. And thanks for posting the issue here.

    I did try the "Rebuild Index" command, but that didn't work. I will try deleting the LibraryIndex folder next time and see if that makes any difference.

    I would have expected the full uninstall to have worked, but it clearly doesn't. That is why I wonder if there is a problem elsewhere.

  • MJ. Smith
    MJ. Smith Member, MVP Posts: 53,071 ✭✭✭✭✭

    Basically, and I don't know the precise details, the first index failure left you in a state where the indexes must be rebuilt from scratch. The only solution that I know consistently works is the removal of the index folder and rebuilding. Reindexing does not clear all current index information - it basically works as a "repair index(es)" Reinstalls rarely work on the desktop app although they are standard practice on mobile devices.

    Orthodox Bishop Alfeyev: "To be a theologian means to have experience of a personal encounter with God through prayer and worship."; Orthodox proverb: "We know where the Church is, we do not know where it is not."

  • Michael Fordham
    Michael Fordham Member Posts: 163

    Basically, and I don't know the precise details, the first index failure left you in a state where the indexes must be rebuilt from scratch. The only solution that I know consistently works is the removal of the index folder and rebuilding. Reindexing does not clear all current index information - it basically works as a "repair index(es)" Reinstalls rarely work on the desktop app although they are standard practice on mobile devices.

    Thanks. I am downloading my library again at the moment. If I get the same issue, which I believe I will, I'll try deleting the index folder and I do hope it resolves the problem.

  • Michael Fordham
    Michael Fordham Member Posts: 163

    I reinstalled (5th or 6th time) with deleting the folders, as I have done previously, and it seems to be happy at the moment, so I am hoping that it is fixed, although I didn't do anything differently than before, but hey ho... so far so good [:)]

  • Mike Binks
    Mike Binks Member, MVP Posts: 7,428 ✭✭✭

    I reinstalled (5th or 6th time) with deleting the folders, as I have done previously, and it seems to be happy at the moment, so I am hoping that it is fixed, although I didn't do anything differently than before, but hey ho... so far so good Smile

    I hope so to Michael. I think most folk with standard installations find Logos to be reasonably steady and when it fails it fails tidily.

    It might be worth reiterating that.

    • It is a good rule of thumb to be on the most recent stable version of Logos.
    • It is almost never effective to reinstall the program in response to a failure.
    • Posting Logs here is a good way of getting somebody to pin-point the problem and suggest an effective solution.

    However we hope that you don't have to heed the advice for some considerable time.

    tootle pip

    Mike

    How to get logs and post them.   (now tagging post-apocalyptic fiction as current affairs) Latest Logos, MacOS, iOS and iPadOS

  • Michael Fordham
    Michael Fordham Member Posts: 163

    I hope so to Michael. I think most folk with standard installations find Logos to be reasonably steady and when it fails it fails tidily.

    It might be worth reiterating that.

    • It is a good rule of thumb to be on the most recent stable version of Logos.
    • It is almost never effective to reinstall the program in response to a failure.
    • Posting Logs here is a good way of getting somebody to pin-point the problem and suggest an effective solution.

    However we hope that you don't have to heed the advice for some considerable time.

    Thanks Mike. Agreed on all points.

    Logos was back to its usual stable state yesterday. I certainly learned more about the location of the folders and files that are related to indexing and what to do if this happens again in future. As you say, hopefully it won't be needed, but I'm sure the thread will be useful.

  • Michael Fordham
    Michael Fordham Member Posts: 163

    Oh dear, I'm getting the same error again [:'(]

    Logos Indexing
    I'm not going to do anything this time until advised by those who know better than me.

    Logs attached.

    0434.Logos Logs 202401292127.zip

  • Mike Binks
    Mike Binks Member, MVP Posts: 7,428 ✭✭✭

    I'm not going to do anything this time until advised by those who know better than me.

    I certainly don't know better than you and I am have so little knowledge of Windows and its ilk that any advice might be dangerous ;-)

    But a quick look at your logs shows a problem with a chrome extension called Widevine. When I searched for it on the web it seems it is a deprecated DRM module.

    So are you using the latest version of Windows?

    Are you using the latest version of Chrome?

    Is somebody who actually knows something going to jump in and tell me I have it all wrong?

    tootle pip

    Mike

    How to get logs and post them.   (now tagging post-apocalyptic fiction as current affairs) Latest Logos, MacOS, iOS and iPadOS

  • Graham Criddle
    Graham Criddle Member, MVP Posts: 32,439 ✭✭✭

    Oh dear, I'm getting the same error again

    Could you post a larger screenshot?

    I appreciate there were problems earlier but this could simply be an indication that you have new / updated resources that are being indexed.

    Is Logos indexing at this time?

  • Dave Hooton
    Dave Hooton Member, MVP Posts: 35,672 ✭✭✭

    But a quick look at your logs shows a problem with a chrome extension called Widevine. When I searched for it on the web it seems it is a deprecated DRM module.

    So are you using the latest version of Windows?

    Are you using the latest version of Chrome?

    Widevine is not popular as tech users are seeking to disable/remove it. But it is used in Logos' version of Chrome (CEF) for browsing. The error is not significant, as I see a similar error in Logos but not in Verbum (where the Widevine version may be what it is expecting).

    Dave
    ===

    Windows 11 & Android 13

  • Dave Hooton
    Dave Hooton Member, MVP Posts: 35,672 ✭✭✭

    I'm not going to do anything this time until advised by those who know better than me.

    Logs attached.

    The Indexer log shows that  Personal Books and your Library did not need to be indexed, but  it did not complete properly.

    And I can't say why.

    Try running it again on a Personal Book and upload logs.

    Dave
    ===

    Windows 11 & Android 13