Why are some "Personal Books" not indexed for searching?

Page 1 of 1 (18 items)
This post has 17 Replies | 1 Follower

Posts 582
Brent Hoefling | Forum Activity | Posted: Sun, Jul 12 2020 6:46 PM

I have dozens of Personal Books, hundreds. Until now, I have only used them in a way to find, open, and read.  Weird, right?  Anyway, I am doing a search this evening, and finding that some of my PB's aren't being searched or weren't indexed.  They are there but do not show up in the search results.

I am a Biblical Archaeology student and so more than a few of my books, articles, and whitepapers reference Jericho. but when I do a search, only two, out of at least 4/5 show up with hits.  Am I doing something wrong?

Posts 29721
Forum MVP
MJ. Smith | Forum Activity | Replied: Sun, Jul 12 2020 7:54 PM

Any chance they are images not texts? This happens if you download PDF's of some older materials to make into PB's.

Orthodox Bishop Hilarion Alfeyev: "To be a theologian means to have experience of a personal encounter with God through prayer and worship."

Posts 582
Brent Hoefling | Forum Activity | Replied: Mon, Jul 13 2020 5:33 AM

nope. text from Word Documents.

Posts 582
Brent Hoefling | Forum Activity | Replied: Mon, Jul 13 2020 6:14 AM

There may have been images in the document, but the notes, stories, writing is all text.

(I know what you mean though, I had a technical PDF with a lot of Hebrew, all the Hebrew was turned into images - I was very disappointed.)

Posts 18623
Forum MVP
Keep Smiling 4 Jesus :) | Forum Activity | Replied: Mon, Jul 13 2020 7:16 AM

Wonder if Personal Book (PB) upload and search/index have a correlation ?

Encountered a PB metadata upload bug that silently disabled PB index use => Bug: 7.2 RC 3 Regression: Personal Book Discourse Glossary so am using Scan command to copy compiled PB resource files into new installation(s). FYI: my library has 33 PB's (last PB compile was 2 Jul 2018)

Keep Smiling Smile

Posts 25875
Forum MVP
Dave Hooton | Forum Activity | Replied: Mon, Jul 13 2020 5:09 PM

Brent Hoefling:
finding that some of my PB's aren't being searched or weren't indexed.  They are there but do not show up in the search results.

You can rebuild the personal books index with the command Rebuild Personal Book Index (it won't take very long). Individual books can be rebuilt using reindex title e.g. reindex my personal book.

Dave
===

Windows 10 & Android 8

Posts 582
Brent Hoefling | Forum Activity | Replied: Mon, Jul 13 2020 7:04 PM

doing that now...

Posts 582
Brent Hoefling | Forum Activity | Replied: Mon, Jul 13 2020 7:18 PM

nope. didn't work. the indexing didn't take very long.

I opened a PB in one window. then opened a basic search for all text in that PB, then entered a simple search for something I cut/pasted from the open PB. 0 results.  Doing a full rebuild now.

Posts 8731
LogosEmployee

In this instance, it may actually help to delete the %LOCALAPPDATA%\Logos\Data\(random)\PersonalBookIndex folder entirely (then restart the application). 

If you can, save the LogosIndexer.log file so we can verify that all PBBs are indexed properly. If search still doesn't work, post the log file and the resource ID of the resource you're searching.

Finally, it's possible that there's something about that PBB that stops it being indexed properly. We'd probably need a copy of your DOCX file to build and index the PBB ourselves and see what's going on.

Posts 582
Brent Hoefling | Forum Activity | Replied: Tue, Jul 14 2020 6:12 AM

Bradley Grainger (Faithlife):

In this instance, it may actually help to delete the %LOCALAPPDATA%\Logos\Data\(random)\PersonalBookIndex folder entirely (then restart the application). 

If you can, save the LogosIndexer.log file so we can verify that all PBBs are indexed properly. If search still doesn't work, post the log file and the resource ID of the resource you're searching.

Finally, it's possible that there's something about that PBB that stops it being indexed properly. We'd probably need a copy of your DOCX file to build and index the PBB ourselves and see what's going on.

Thank you. that did it.

I also discovered that there is no group, or automatic tag or collection specifically pointing to them.  So I spent some time to tag each one and discovered that one of my older PB's said something about not having a license to open it. Wait, what?! I created that one again and it now shows up too (and is indexed).

Thank you for your help.

Posts 2056
Mark | Forum Activity | Replied: Tue, Jul 14 2020 9:43 AM

Bradley Grainger (Faithlife):
In this instance, it may actually help to delete the %LOCALAPPDATA%\Logos\Data\(random)\PersonalBookIndex folder entirely (then restart the application). 

Where do we find this file?

Are there benefits to doing this even if we do not know for sure if we have this problem?

Posts 582
Brent Hoefling | Forum Activity | Replied: Tue, Jul 14 2020 10:30 AM

Mark:

Bradley Grainger (Faithlife):
In this instance, it may actually help to delete the %LOCALAPPDATA%\Logos\Data\(random)\PersonalBookIndex folder entirely (then restart the application). 

Where do we find this file?

Are there benefits to doing this even if we do not know for sure if we have this problem?

There are actually a handful of files in that folder. That folder contains the index files for your Personal Book Builds.  When you delete the folder (after exiting L8), it should just go away.  then when you start L8 up again, it looks for, can't find, and then rebuilds them from scratch.  Depending on how many PBBs you have, how fast your computer is, and your hard drive, and how much space is available, it may take some time to rebuild the PBB index. On my computer, it took a few minutes. once it was done, it was complete.

There is no "real" danger of deleting that folder (assuming your L8 is otherwise functioning correctly). If you have PBBs, it will recreate what it needs to work.  The downside is that it may take some time to build the new index.

I am not the expert, so Faithlife folks can correct me if I am wrong here.  I believe when you add a PBB, it does an "addendum" (for a lack of a more appropriate word) index for that new book. This is how additional resources are indexed for the main L8 system.  The whole index isn't recreated every time there is a new resource. (wow, I would not be able to use my system very much if that were the case).

So, if you add new resources frequently at all, your system performance could be improved - slightly - by doing a "Rebuild Index" (and a Rebuild Personal Book Index.  It seems these are separate. I had previously assumed that when I do a full rebuild, the PBBs were included.  I was apparently incorrect.)

Posts 28580
Forum MVP
JT (alabama24) | Forum Activity | Replied: Tue, Jul 14 2020 10:44 AM

Brent Hoefling:
one of my older PB's said something about not having a license to open it. Wait, what?!

This is the expected behavior when you try to open a personal book which 1) you did not compile on the specific device used and 2) you did not manually upload the compiled file to the cloud. 

Does that describe this particular personal book? 

OSX & iOS | Logs |  Install

Posts 582
Brent Hoefling | Forum Activity | Replied: Tue, Jul 14 2020 11:11 AM

JT (alabama24):

Brent Hoefling:
one of my older PB's said something about not having a license to open it. Wait, what?!

This is the expected behavior when you try to open a personal book which 1) you did not compile on the specific device used and 2) you did not manually upload the compiled file to the cloud. 

Does that describe this particular personal book? 

yeah. nope.
I use my main computer to create the PBBs, and I always upload them. I don't know what caused it, but it is all fixed now when I deleted the PBB index folder and then allowed L8 to recreate it. woohoo, so it's all good now. I recreated that specific PBB and it all works.

Posts 2637
David Ames | Forum Activity | Replied: Tue, Jul 14 2020 12:51 PM

Brent Hoefling:

yeah. nope.

I use my main computer to create the PBBs, and I always upload them. 

""one of my older PB's said something about not having a license""

Maybe it is so old that it predated the "Upload" option??  [so that is why it was not uploaded - maybe]

Posts 25875
Forum MVP
Dave Hooton | Forum Activity | Replied: Tue, Jul 14 2020 2:17 PM

Brent Hoefling:

I believe when you add a PBB, it does an "addendum" (for a lack of a more appropriate word) index for that new book. This is how additional resources are indexed for the main L8 system.  The whole index isn't recreated every time there is a new resource. (wow, I would not be able to use my system very much if that were the case).

Logos has three resource indexes, each in their own folder:-

  1. Library Index  - for all purchased or free resources  
  2. Bible Index  - for bibles only (those included with #1.)
  3. Personal Book Index - for all your PBB's

So, when you buy a bible it will be indexed twice (at #1 and #2).

When new/updated books are indexed they are built into a temporary index which is then merged with the main index, taking much less time than rebuilding the whole index. PBB's are indexed the same way, but take much less time (tens vs. thousands of resources).

Brent Hoefling:
So, if you add new resources frequently at all, your system performance could be improved - slightly - by doing a "Rebuild Index" (and a Rebuild Personal Book Index.  It seems these are separate. I had previously assumed that when I do a full rebuild, the PBBs were included.

Do not perform a Rebuild Index command as this will affect all three indexes. There is little to be gained by Rebuild Personal Book Index. If resources are added and removed frequently (e.g. Connect monthly resources), you can improve efficiency by Rebuild Library Index every six months or so, and Rebuild Bible Index annually. You will regain several MB of disk space, but any speed/performance improvement would not be noticed.

Dave
===

Windows 10 & Android 8

Posts 582
Brent Hoefling | Forum Activity | Replied: Tue, Jul 14 2020 3:16 PM

Dave Hooton:

Brent Hoefling:

I believe when you add a PBB, it does an "addendum" (for a lack of a more appropriate word) index for that new book. This is how additional resources are indexed for the main L8 system.  The whole index isn't recreated every time there is a new resource. (wow, I would not be able to use my system very much if that were the case).

Logos has three resource indexes, each in their own folder:-

  1. Library Index  - for all purchased or free resources  
  2. Bible Index  - for bibles only (those included with #1.)
  3. Personal Book Index - for all your PBB's

So, when you buy a bible it will be indexed twice (at #1 and #2).

When new/updated books are indexed they are built into a temporary index which is then merged with the main index, taking much less time than rebuilding the whole index. PBB's are indexed the same way, but take much less time (tens vs. thousands of resources).

Brent Hoefling:
So, if you add new resources frequently at all, your system performance could be improved - slightly - by doing a "Rebuild Index" (and a Rebuild Personal Book Index.  It seems these are separate. I had previously assumed that when I do a full rebuild, the PBBs were included.

Do not perform a Rebuild Index command as this will affect all three indexes. There is little to be gained by Rebuild Personal Book Index. If resources are added and removed frequently (e.g. Connect monthly resources), you can improve efficiency by Rebuild Library Index every six months or so, and Rebuild Bible Index annually. You will regain several MB of disk space, but any speed/performance improvement would not be noticed.

great information. thank you!

Posts 8731
LogosEmployee

Mark:

Bradley Grainger (Faithlife):
In this instance, it may actually help to delete the %LOCALAPPDATA%\Logos\Data\(random)\PersonalBookIndex folder entirely (then restart the application). 

Where do we find this file?

Are there benefits to doing this even if we do not know for sure if we have this problem?

There are nine files in this folder. "Rebuild Personal Book Index" will delete and recreate seven of them. However, the two others store the list of books that should be indexed. In rare circumstances, this list can get out of sync with reality, so "rebuild personal book index" won't fix the problem.

The only workaround/solution is to delete the whole folder, which forces that list of books to be recreated from your Library Catalog. I wouldn't recommend doing this normally, as >99% of the time, the list is accurate and rebuilding it simply takes a long time for no benefit. (It's probably not as bad for Personal Books since there (usually) aren't a lot of them, but it can be time-consuming for the "LibraryIndex" folder.)

Page 1 of 1 (18 items) | RSS