Perpetual Update Re-indexing

T.P. Johnston
T.P. Johnston Member Posts: 143 ✭✭
edited November 2024 in English Forum

Logos 4 has many wonderful features, but it makes no sense to me why it has to completely re-index (consuming the computer for up to several hours) every time there is an update. Looks like there would be a way to save the index to a file each new update could retrieve, and only index to add new resources. This is an annoying and bothersome thing.

Comments

  • DominicM
    DominicM Member Posts: 2,995 ✭✭✭

    The 4.0b update implemented several improvements to the indexing including a new Bible index, and improvements to the merging of indexes, which will result in better performance and stability for the future, I know its a pain, but in this case its well worth it.

    For what its worth the indexing time from 4.0a to 4.0b on a new install (for me) has also be reduced by 25%, and I am really happy with the situation

    Never Deprive Anyone of Hope.. It Might Be ALL They Have

  • Kevin Becker
    Kevin Becker Member Posts: 5,604 ✭✭✭

    DominicM said:

    improvements to the merging of indexes

    Actually, they removed the index merge. It will be reintroduced in 4.0c. This is probably because they couldn't track down all of the index corruption bugs caused by the merge. It was the right call, it was a little monotonous [|-)] of telling people how to reindex every day.

  • Dave Hooton
    Dave Hooton MVP Posts: 36,133

    Looks like there would be a way to save the
    index to a file each new update could retrieve, and only index to add
    new resources.

    In general the 4.0b "update" will create a Bible Index which can take a few hours. Updates to resources in the Library Index can take minutes to hours to index if a supplemental index is being built. And a complete rebuild will take longer if the supplemental index gets too large.

    The supplemental index is close to what you suggest, so I'm wondering why you think a full re-index is happening with every download?

    Dave
    ===

    Windows 11 & Android 13

  • T.P. Johnston
    T.P. Johnston Member Posts: 143 ✭✭

    I thought it was a complete indexing because a message appeared across the top of the screen that said First time indexing occuring, or something like that.

  • Mark
    Mark Member Posts: 2,662 ✭✭✭

    Well I am having indexing difficulties.  First message was a short index which completed quickly.  Then a second download update which while completing the 3 hour index, a third update became available.  I downloaded the update while indexing.  When I went to bed the info said 3.5 hours of indexing left.  After 8 hours of sleep, I woke up to find I had 4 hours of indexing left.

    I paused the index, restarted the computer and then got a message of 24 hours to index.  I deleted the index file and now am indexing with only 7 hours to go, but now it shows 28 hours. 

    1.  Can someone tell me if the ....hours to go...are usually accurate? 

    2.  Can someone explain the difference between regular indexing and the Bible indexing?

     

    Thanks

  • Mark Barnes
    Mark Barnes Member Posts: 15,432 ✭✭✭

    Let me try and help:

    • Indexing times are often very inaccurate. If it says several hours it will be several hours, but exactly how many is anyone's guess.
    • Bible indexing is new to Logos 4.0b. Basically it just creates a separate Bible index to make Bible searches quicker.
    • When you upgrade to 4.0b you may appear to get multiple re-indexing. That's because:
      • It will need to do a Bible index.
      • You'll get an updated help file which will be indexed. There are other updated resources that ship with 4.0b, if you have them (e.g. the IVP pocket dictionaries).
      • There was a bug in 4.0a which could corrupt indexes. If you're affected by this bug, it's possible 4.0b might rebuild the index.
    • It shouldn't be necessary to delete the index folder unless you can't load Logos. "Rebuild index" does the same thing. Obviously this sets the index state back to zero, wasting the time you've already spend indexing.

    This is my personal Faithlife account. On 1 March 2022, I started working for Faithlife, and have a new 'official' user account. Posts on this account shouldn't be taken as official Faithlife views!

  • Mark
    Mark Member Posts: 2,662 ✭✭✭
  • Frank Bristow
    Frank Bristow Member Posts: 16 ✭✭

    I am seeing the same thing Mark Swain is seeing. Indexing time keeps increasing each time I check. Last night it showed 20 minutes when I went to bed. This morning it was still chugging away and it said it needed 21 HOURS. So I rebooted.

    Now its been 2 hours and each time I look the time remaining has increased. It moves up in increments each time I look.  Right now it says 1 hour 48 minutes remaining. 10 minutes ago it said 1 hour 20 minutes remaining...

    Thing is I have it installed on 2 pc's; On the first the reindex was completed in 45 minutes.

    Oh... just looked again now it says  2 hours 8 minutes remaining... still on its upward time estimate.

     

     

  • Mark Barnes
    Mark Barnes Member Posts: 15,432 ✭✭✭

    Oh... just looked again now it says  2 hours 8 minutes remaining... still on its upward time estimate.

    This is fairly normal, I'm afraid. The difference between the two machine is probably that one did a complete reindex, whilst the other just did the Bible index (see my post above for possible reasons for this).

    This is my personal Faithlife account. On 1 March 2022, I started working for Faithlife, and have a new 'official' user account. Posts on this account shouldn't be taken as official Faithlife views!

  • Aaron Knotts
    Aaron Knotts Member Posts: 208 ✭✭

    The update to 4.0b was smooth and fast yesterday. Today however it is deciding to 'prepare the library' and now reindex.   I am wondering if a defrag before reindexing would be useful? My laptop is only XP Pro with 2gb RAM so performance with L4 is less than stellar sadly.

    Mark....thanks so much for the videos you produce and share....already I am getting more our of L4 than I did Libronix 3.

    MacBook Pro (Retina, 15-inch, Mid 2015), 2.5 GHz Intel Core i7

    16 GB 1600 MHz DDR3, AMD Radeon R9 M370X 2048 MB

     

     

  • Dave Hooton
    Dave Hooton MVP Posts: 36,133

    I thought it was a complete indexing because a message appeared across the top of the screen that said First time indexing occuring

    If you updated to 4.0b that would be the new bible Index. Also see Mark's explanation. Have things settled down now?

    Dave
    ===

    Windows 11 & Android 13

  • Dave Hooton
    Dave Hooton MVP Posts: 36,133

    I am wondering if a defrag before reindexing would be useful?

    Any defrag is useful but it should be done regularly, not just because an L4 download is coming!

    Dave
    ===

    Windows 11 & Android 13

  • Aaron Knotts
    Aaron Knotts Member Posts: 208 ✭✭

    Any defrag is useful but it should be done regularly, not just because an L4 download is coming!


    Agreed Dave, in fact it is a necessity on my machine. I was more curious about the impact of Logos timing an index on a semi-fragmented drive in between routine maintenance.  I'll force a reindex following my next defrag and see if there is any notable change in perfomance, I suspect not.

    MacBook Pro (Retina, 15-inch, Mid 2015), 2.5 GHz Intel Core i7

    16 GB 1600 MHz DDR3, AMD Radeon R9 M370X 2048 MB

     

     

  • Dave Hooton
    Dave Hooton MVP Posts: 36,133

    I'll force a reindex following my next defrag and see if there is any notable change in perfomance, I suspect not.

    I suspect not - you'll only wear out the spindle a little more!

    Off-topic: What bike is that? My avatar shows the road but not the bike (Daytona 675)?

    Dave
    ===

    Windows 11 & Android 13

  • Aaron Knotts
    Aaron Knotts Member Posts: 208 ✭✭

    I suspect not - you'll only wear out the spindle a little more!

    Gag!  My measily 80Gb (7200) HDD just belched....Reindexing just informed me that I have insufficient disk space. Who knew?  Time to delete some stuff...goodbye Libronix 3 [:(]

    Off-topic: What bike is that? My avatar shows the road but not the bike (Daytona 675)?

    BMW R1100GS - Currently impersonating a classic Brit bike....with an annoying little oil leak.

    I keep looking at your avatar waiting for you to roar around the corner...very slow anim  [;)]  What do you ride? Wait..you answered that already....Logos and my laptop have fried my brain today.  A 'new Millennium" Brit bike....with no oil leaks :)

    MacBook Pro (Retina, 15-inch, Mid 2015), 2.5 GHz Intel Core i7

    16 GB 1600 MHz DDR3, AMD Radeon R9 M370X 2048 MB

     

     

  • Dave Hooton
    Dave Hooton MVP Posts: 36,133

    Gag!  My measily 80Gb (7200) HDD just belched....Reindexing just informed me that I have insufficient disk space. Who knew?  Time to delete some stuff...goodbye Libronix 3

    Ouch!  I'd keep L3 anyday - just get rid of the resources as the software is barely 0.5 GB.  Get/run Ccleaner to rid the system of logs, temp files and other non-useful stuff. Delete your System Restore files - there can be a few GB there!

    A 'new Millennium" Brit bike....with no oil leaks :)

    Yup!  Very competitive bike with 3 cylinders!

     

    Dave
    ===

    Windows 11 & Android 13

  • James H. Schafer
    James H. Schafer Member Posts: 167 ✭✭

    Looks like there would be a way to save the
    index to a file each new update could retrieve, and only index to add
    new resources.

    In general the 4.0b "update" will create a Bible Index which can take a few hours. Updates to resources in the Library Index can take minutes to hours to index if a supplemental index is being built. And a complete rebuild will take longer if the supplemental index gets too large.

    The supplemental index is close to what you suggest, so I'm wondering why you think a full re-index is happening with every download?

    Not sure what has taken place with my system. Yesterday after agreeing to the update the icon indicated it would take 168 Hours to complete. Of course, I figured that was wrong so it didn't bother me that much. But after running all day and night it is still showing 11 Hours to go. Not only that, but it has taken over my machine. I had to do a 'turn off'' boot then when I turned it back on used Task Manager to end the process before I could even log in to write this note. Any one with an idea as to what may be taking place?

    BroJames

  • I am so green at this version 4 and updating and such that I do not even know how to determine if my "updates" are successful, nor exactly what was included, modified, deleted, etc.  Let alone how I go about performing the actions that this latest update is supposed to provide, ie accessing more of Logos 3 to move into 4.

    by the way, in my library search box it indicates 1,296 files in the library, however this is the same count as when I first upgraded to 4.0 and increased my library from Scholar's to Gold.  I am attending the OKC Camp this month - there I hope to become some what clear minded in my endeavor to develop an affinity to my library and its plethora of scholarly growth opportunity.

  • Mark Barnes
    Mark Barnes Member Posts: 15,432 ✭✭✭

    Charles,

    If you follow the link in my signature it will take you to some videos. One of them might help you transition from L3 to L4, another shows you the new features in 4.0b

    This is my personal Faithlife account. On 1 March 2022, I started working for Faithlife, and have a new 'official' user account. Posts on this account shouldn't be taken as official Faithlife views!

  • Dave Hooton
    Dave Hooton MVP Posts: 36,133

    Not sure what has taken place with my system.

    Without knowing the specs of your machine, or any previous history of indexing,  I can only comment that it may take 2 days to complete indexing. You need to make sure there is enough hard drive space (at least 10 GB free), stop any background scans or activity and let it index.

    Dave
    ===

    Windows 11 & Android 13

  • Alex Scott
    Alex Scott Member Posts: 718 ✭✭

    I had this same problem of indexing going on and on with all the associated inconveniences.  I finally got fed up with the whole thing and deleted the Library Index folder and started again.  Indexing completed in 15 hours (5597 resources).

    Longtime Logos user (more than $30,000 in purchases) - now a second class user because I won't pay them more every month or year.

  • James H. Schafer
    James H. Schafer Member Posts: 167 ✭✭

    Without knowing the specs of your machine, or any previous history of indexing,  I can only comment that it may take 2 days to complete indexing. You need to make sure there is enough hard drive space (at least 10 GB free), stop any background scans or activity and let it index.

    Thanks Dave, the specs of my machine are in the signature box. Also, I have something over 40G of free space on my 120G HD. Today, it has finally finished indexing. It's good to have the use of my computer back and to finally be able to use Logos4.

    Thanks again,

  • Dave Hooton
    Dave Hooton MVP Posts: 36,133

    It's good to have the use of my computer back and to finally be able to use Logos4.

    Amen!

    Dave
    ===

    Windows 11 & Android 13

  • Joel
    Joel Member Posts: 142 ✭✭

    My indexing is driving me mad. It's sat on 1 hour and 15 minutes for hours, and sometimes reads a difference of five minutes both up and down. It's also chewing up half a gig of memory. That's just nuts. I have no idea if it's actually doing anything.

    I am sooo tempted to shut the thing down and shoot it in the head so it doesn't come back after every restart. Please read Logos developers: this is not the only program on my computer. I do not want it taking prisoners and hijacking my system because it wants to update, especially when I can't tell if the updater it broken and going nowhere.

    I've mentioned this before and the request has seemingly been ignored. Please fix Logos 4's self-important design for situations like this. All it does is frustrate.

  • Dave Hooton
    Dave Hooton MVP Posts: 36,133

    Joel said:

    I've mentioned this before and the request has seemingly been ignored. Please fix Logos 4's self-important design for situations like this. All it does is frustrate.

    I recommend that you change Automatically Download Updates to NO in Program Settings. You are notified of an update but you can refuse it until you are ready to download and index!

    If you have logging permanently enabled you can track the progress in Logos4Indexer.log else see http://wiki.logos.com/Diagnostic_Logging

    Note: (from your previous thread) AVG has some flexible options for updating.

    Dave
    ===

    Windows 11 & Android 13