Logos 4.5 Beta 12 Library Indexing Speed Regression - Mac is Slow

For grins after Christmas 2011 purchases, issued "rebuild index" command in Logos 4.5 Beta 12 on Mac and PC.

PC quad core i7-2630QM 2.0 GHz with 8 GB RAM indexed 6,011 resources in 1 hour, 7 minutes, 53 seconds.

In contrast. library indexing on Mac using quad core i7 running at 2.93 GHz had completed 632 out of 6,006 resources during the same time.

Forum thread => What's your benchmark? includes

Mac => http://community.logos.com/forums/p/24555/255412.aspx#255412

PC => http://community.logos.com/forums/p/24555/254929.aspx#254929

Comparing NovaBench scores, noticed Mac i7 is 40 % faster than PC i7 for floating point, however PC i7 is 14 % faster for integer calculations. The hard drives are 7200 RPM. Hence would anticipate library indexing time to be similar on Mac and PC instead of Logos 4.5 Beta 12 on Mac being significantly slower.

Looking at Apple's Activity Monitor, noticed indexer ranging from 5.3 % to 168 %, which is much less than nearly 400 % usage in older Logos 4 Mac releases (used to rebuild indexes more often with Alpha pre-releases).

Appears advice for indexing Logos 4 Mac overnight is practical since I'm currently estimating ~10 hours for library index on Mac vis 3.25 hours on PC (to index and merge postings)

Keep Smiling [:)]

Find more posts tagged with

Comments

Keep Smiling 4 Jesus :)

Logos 4.5a Beta 5 still has slow indexing on Mac.

Edit: rebuild index took 10.5 hours to complete, which is triple for the elapsed time to rebuild on PC.

Wonder if indexing has been throttled back to avoid overheating issues ?

Keep Smiling [:)]

Keep Smiling 4 Jesus :)

https://community.logos.com/discussion/comment/338551#Comment_338551

Ouch time: trying to rebuild library index using Logos 4.5b Beta 2 is needing many attempts for Latin Dictionary.

After 8 hours, 15 minutes of indexing, log shows: "Received user-specific shut down event" that effectively canceled merge of postings after an hour of merging, which was signaled from resource automatic update check in Logos4.log file since two more resources are ready to download (from a free Vyrso purchase today). Program Settings had Automatic Downloads set to No so signal to Indexer should not have been sent. Had noticed dialog box change to show 9.6 MB now ready to download.

Next relaunch of Logos 4 Mac started over to index individual resources that takes 7 hours 15 minutes to index 6,267 resources. Due to surprise indexing shut down, changed Use Internet from Yes to No.

Currently estimating over 9 hours will be needed to index library one more time, then download 5 resources, including renewal.lbxlls, sa_3ejonah.lbxlls, and sa_3erev.lbxlls since one of those three crashed the Logos 4.5b Beta 2 indexing during an earlier library rebuild (with 6,128 resources done out of 6,270 with elapsed time almost of 7 hours)

Caveat: from a Beta testing point of view, found something buggy. Looking forward to Logos 4 Mac improvements.

Keep Smiling [:)]

Keep Smiling 4 Jesus :)

https://community.logos.com/discussion/comment/345312#Comment_345312

Currently estimating over 9 hours will be needed to index library one more time, then download 5 resources, including renewal.lbxlls, sa_3ejonah.lbxlls, and sa_3erev.lbxlls since one of those three crashed the Logos 4.5b Beta 2 indexing during an earlier library rebuild (with 6,128 resources done out of 6,270 with elapsed time almost of 7 hours)

Logos 4.5b Beta 2 indexing puzzle. After hiding 3 resources, restarted Logos 4.5b Beta 2 to delete them. Unhide 3 resources plus purchase twitter special, restart Logos 4.5b Beta 2, which downloaded 4 resources (as expected). However, library indexing is skipping 3 resources and not merging them so search cannot find words in the skipped resources:

In contrast, same search using Logos 4.5b Beta 2 on Windows, finds 120 hits in 67 articles in resource "Biblical Counsel: Resources for Renewal"

Logs attached: 3515.11-Index-Search-issue.zip

Wondering if should try rebuilding library index one more time ?

Edit: some Logos counsel about biblical software usage would be appreciated. [;)] Wonder if should wait for Logos 4.5b Beta 3 before rebuilding library index ?

Keep Smiling [:)]

Keep Smiling 4 Jesus :)

https://community.logos.com/discussion/comment/345957#Comment_345957

Wondering if should try rebuilding library index one more time ?

Tried one more time, which resulted in another crash. Then moved resource sa_3erev.lbxlls to a different folder. Rebuild Library Index command completed, and set discovery flag. Moved sa_3erev.lbxlls back to Resources folder, then launched Logos 4.5b Beta 2 again, which discovered resource, but did not index. So moved corresponding LLS_29_71_5001_2002_08_08T19_04_44Z.mstidx file in ResourceManager/logos folder to the trash, then used Rebuild Library Index command again, which successfully competed (albeit elapsed time was 9 hours 19 minutes 10 seconds, which is still slow).

After indexing complete, verified "Biblical Counsel" search found many articles in resource "Biblical Counsel: Resources for Renewal" plus could find results in Revelation, an Exegetical Study (sa_3erev.lbxlls). Suspect LLS_29_71_5001_2002_08_08T19_04_44Z.mstidx file was causing library index crash:

8741.LLS_29_71_5001_2002_08_08T19_04_44Z.mstidx.zip

Keep Smiling [:)]

Mike S.

https://community.logos.com/discussion/comment/346650#Comment_346650

This is just painful to watch. Will anyone from Logos help out KS4J???

Keep Smiling 4 Jesus :)

https://community.logos.com/discussion/comment/346663#Comment_346663

At times, wonder if my avatar needs an overlay ?

Looking again, noticed dummy not smiling. Personally have wonderful reasons to Keep Smiling 4 Jesus [:D]

- - - - - - -

Thankful for Logos free resource => Dictionary of Latin Forms that is now indexed with the rest of my Logos library using Logos 4.5b Beta 2 on Mac (albeit Logos 4.5b Beta 2 on Windows 7 can rebuild library index is less than half the time).

Keep Smiling [:)]

Keep Smiling 4 Jesus :)

https://community.logos.com/discussion/comment/346671#Comment_346671

Using Logos 4.5b Beta 5 on Mac, rebuild index command worked to delete, then create Bible, Library, and Personal Book indexes. Elapsed time was 11 hours 4 minutes.

Note: used rebuild index for time comparison in thread => Indexing Problem

Keep Smiling [:)]

Keep Smiling 4 Jesus :)

https://community.logos.com/discussion/comment/352342#Comment_352342

For time comparison with thread => http://community.logos.com/forums/p/49950/369064.aspx#369064 used rebuild index command in Logos 4.5c Beta 1:

Bible Index creation took 2h 5m 59s for 1,302 resources. Library Index creation took 10h 40m 43s for 6,650 resources.

Overall elapsed time 12h (hours) 47m (minutes) 5s (seconds), which is two hours longer (20%) than original post with a Library growth of 10 % (primarily March Madness and Vyrso)

Keep Smiling [:)]

Keep Smiling 4 Jesus :)

https://community.logos.com/discussion/comment/369188#Comment_369188

Bible Index creation took 2h 5m 59s for 1,302 resources. Library Index creation took 10h 40m 43s for 6,650 resources.

Overall elapsed time 12h (hours) 47m (minutes) 5s (seconds), which is two hours longer (20%) than original post with a Library growth of 10 % (primarily March Madness and Vyrso)

Using Logos 4.5c Beta 3 on Mac OS X 10.6.8,

Bible Index creation took 2h 5m 22s for 1,303 resource. Library index creation is failing to complete after merging postings. After attempt to replace index ~/Library/Application Support/Data/<Random>/LibraryIndex/Index with ~/Library/Application Support/Data/<Random>/LibraryIndex/Index-build

Library Indexing canceled (or ran out of storage space); deleting temporary files
Forcing reindexing (of type RebuildIndex)

Puzzling because partition with Logos 4 and temporary folders has 72 GB free so am rebuilding Library index one more time (with an estimated duration ~11 hours). Earlier in Indexer.log file:

Re-indexing because the existing index seems to have been corrupted.

Wondering if Logos 4.5c Beta 3 Indexer on Mac OS X has a LibraryIndex regression for renaming index-build to index when index does not exist ?

Overall elapsed time was 10h 14m 22s, which is an improvement.

By way of comparison with Windows 7, Logos 4.5c Beta 3 rebuild index:

Bible Index creation took 49m 44.0s for 1,301 resources. Library index creation took 5h 18m 49s for 6,728 resources.

Keep Smiling [:)]

Keep Smiling 4 Jesus :)

https://community.logos.com/discussion/comment/372263#Comment_372263

Logos 4.5c Beta 4 on Mac OS X 10.6.8 used bit less CPU time while indexing, however, overall elapsed time lacked advertised speed improvement for rebuild index:

Bible Indexing took 2h 7m 18s.

Library Indexing took 10h 12m 51s.

Keep Smiling [:)]

Keep Smiling 4 Jesus :)

https://community.logos.com/discussion/comment/372263#Comment_372263

By way of comparison with Windows 7, Logos 4.5c Beta 3 rebuild index:

Bible Index creation took 49m 44.0s for 1,301 resources. Library index creation took 5h 18m 49s for 6,728 resources.

Logos 4.5c Beta 4 took 42m 50.3s for 1,307 resources, which is 14 % faster. Likewise, Library index creation took 4h 4m 9s for 6,889 resources, which is 23 % faster.

Concur complete index rebuild using Logos 4.5c Beta 4 on Windows is noticeably faster. Looking forward to Logos 4 Mac improvements.

Keep Smiling [:)]

fgh

https://community.logos.com/discussion/comment/375873#Comment_375873

Logos 4.5c Beta 4 on Mac OS X 10.6.8 used bit less CPU time while indexing, however, overall elapsed time lacked advertised speed improvement for rebuild index:

Bible Indexing took 2h 7m 18s.

I happened to see this post since you happened to link to a post above. I rebuilt my Bible Index last night and the log says 2h 18m 39s for the whole process (1h 45m 37s for just the actual indexing, before writhing postings). OK, you have a hundred resources more than I do, but you also have a way faster computer. I would have expected a reindex to be considerably faster for you than for me. Shouldn't it be?

Keep Smiling 4 Jesus :)

https://community.logos.com/discussion/comment/379803#Comment_379803

Logos 4.5c Beta 4 on Mac OS X 10.6.8 used bit less CPU time while indexing, however, overall elapsed time lacked advertised speed improvement for rebuild index:

Bible Indexing took 2h 7m 18s.

I happened to see this post since you happened to link to a post above. I rebuilt my Bible Index last night and the log says 2h 18m 39s for the whole process (1h 45m 37s for just the actual indexing, before writhing postings). OK, you have a hundred resources more than I do, but you also have a way faster computer. I would have expected a reindex to be considerably faster for you than for me. Shouldn't it be?

Using Logos 4.5c SR-2 (4.53.0.2280) on Mac OS X 10.6.8, launched to work offline, then used rebuild index command (not interested in any downloads interrupting indexing).

Bible Index took 2h 13m 7s for 1,309 resources with 18m 12s spent merging postings after 1h 54m 55s indexing Bible resources.

Library Index took 12h 20m 1s for 6,960 resources with 3h 24m 12s spent merging postings after 8h 55m 49s indexing library resources.

Logos 4.5c SR-2 (4.53.0.2280) uses significantly less CPU than earlier Logos 4 Mac releases.

Keep Smiling [:)]

fgh

https://community.logos.com/discussion/comment/379974#Comment_379974

I rebuilt my Bible Index last night and the log says 2h 18m 39s for the whole process (1h 45m 37s for just the actual indexing, before writhing postings).

Bible Index took 2h 13m 7s for 1,309 resources with 18m 12s spent merging postings after 1h 54m 55s indexing Bible resources.

Let's see:

Your indexing uses 4 threads, mine uses 2.
Your indexing isn't hampered by lack of RAM, mine definitely is.
You have a 7200 RPM HD; I have a 5400.
Your computer is 2.93 GHz, mine is 2.4.
You only have 101 more Bible resources than I do.

So how can your indexing be only 5 minutes faster than mine? Do you back up the Bible Index via Time Machine while indexing is going on?

Btw, Logos, the percentage calculation is really off. According to my log:

the first 15% took about 56 minutes.
the next 60% (the remainder of the actual indexing) took about 49 minutes.
the final 25% (writing postings) took about 33 minutes.

It seems to be built on the number of resources rather than the size of them?

Keep Smiling 4 Jesus :)

https://community.logos.com/discussion/comment/380001#Comment_380001

So how can your indexing be only 5 minutes faster than mine? Do you back up the Bible Index via Time Machine while indexing is going on?

Good question about timing ?

Personally have excluded Logos 4 Mac indexes from Time Machine backup since indexes can be rebuilt.

Pondering iMac storage configuration and upgrade.

Keep Smiling [:)]

fgh

https://community.logos.com/discussion/comment/380155#Comment_380155

Personally have excluded Logos 4 Mac indexes from Time Machine backup since indexes can be rebuilt.

That's what I thought, but it was the only thing that came to mind that might slow down your computer enough to make a real difference. It will be interesting to see how long my Library Index takes. I'm planning to rebuild it tomorrow night (so that it can run during church if it isn't finished in the morning). It won't compare as well, though, as the difference in number of resources is much larger.