Indexing woes

I have reinstalled Logos 4 on a different drive and used Dave Hooton's suggestions to try to avoid downloading all the resources.

Installation worked fine. Indexing has not. I have tried four times and the last time created a log file. Unfortunately all these crashes occur deep into the indexing (only 10 minutes left this last time). I cannot see anything that is in the log file that means anything to me.

It is attached. Logos 4 works except for searches which return no results (obviously).

If anyone has some suggestions, I'd appreciate them.

0045.Logos4Indexer.log

Find more posts tagged with

Comments

Mark Kulikovsky

This looks like the same problem I had (see the thread http://community.logos.com/forums/t/5133.aspx) with the same error message near the end of the indexing process. It is caused by corrupted resource files.

If you read through the thread you will find Bradley Grainger's checksum program (make sure you get the later version) as well as a file near the end of thr thread which has the 'official' checksum list in it. When you find a resource of yours that does not match the offical checksum - you will get the problem you have seen - with the same error message about an 'out of range exception' which happens after indexing is completed during the final stages of creating the index file.

The solution is - re-download the corrupted resource file(s) by removing it/them from your resource directory and issuing an "update resources"

CORRECTION: Wrong thread - I meant http://community.logos.com/forums/t/4302.aspx

Otto S. Carroll

Hi Mark,

Please check out this thread -> http://community.logos.com/forums/p/4448/34732.aspx#34732

I had a similar problem; Dave Hooton & Damian McGrath were able to offer insight...

Dave Hooton

Mark,

Did you install SR-7?

Mark Smith

https://community.logos.com/discussion/comment/42057#Comment_42057

Did you install SR-7?

Yes. Before all this occurred.

Mark Smith

https://community.logos.com/discussion/comment/42043#Comment_42043

see the thread http://community.logos.com/forums/t/5133.aspx)

I didn't see anything by Bradley in this thread.

Mark Smith

https://community.logos.com/discussion/comment/42043#Comment_42043

see the thread http://community.logos.com/forums/t/5133.aspx

I think this is the one you meant: http://community.logos.com/forums/p/4302/34352.aspx#34352

Mark Kulikovsky

https://community.logos.com/discussion/comment/42076#Comment_42076

Yes sorry - wrong thread

http://community.logos.com/forums/t/4302.aspx is correct

Mark

Mark Smith

https://community.logos.com/discussion/comment/42077#Comment_42077

Yes sorry - wrong thread

I read through that thread. I saw the checksum thing and ran it on my resources, but don't know what do do other than submit it.

How did your situation get resolved? I wasn't clear from what was posted.

Mark Kulikovsky

https://community.logos.com/discussion/comment/42081#Comment_42081

Mark

I submitted the checksum log to Bradley Grainger who identified the corrupt resource files (133 of them for me!) by comparing them to his official checksums for the resource files. I asked him to post the official checksum list so I could check future runs against the official checksums myself - this he has done (it is in one of the later posts on that thread). You could run Bradley's checksum program and then compare the results file with the official checksums. If a file checksum for a particualr resource does not match the checksum for that same resource in the official file then that resource file is corrupt - it may even have exactly the same byte count but if the checksum does not match it is corrupted. You should identify all corrupted resources.

Once the corrupted files were identified, I deleted them from the resource folder and then issued the command "update resources" which forces them to re-download and thenj re-index. This solved my problem.

This may not be your problem but I think it's worth investigating.

Note: If this is not your first index then instead of doing all this, if you know what files were recently downloaded, you could just delete them and get them to re-download and then see if that solves your problem. I guess you could also send the checksum file to Bradley and ask him to check it - I expect he has some matching program that quickly identifies differences - however, I expect he his VERY busy!

Mark K.

Mark Smith

https://community.logos.com/discussion/comment/42094#Comment_42094

Thanks, Mark. I found his other checksum list. Now I need an easy way to compare them. I'll check around.

Dave Hooton

https://community.logos.com/discussion/comment/42107#Comment_42107

Thanks, Mark. I found his other checksum list. Now I need an easy way to compare them. I'll check around.

Is your original installation running OK (where you got the resources from)? Do you suspect corrupt resources there? I'd be tempted to make another copy and try again after removing all the resources from the new installation.

If you care to take the time you could check the two resource folders with a checksum-enabled Sync program (Beyond Compare). It doesn't return a checksum value, but a Binary compare is faster because it stops whenever it detects a difference. It can take a while but it is automated. Unfortunately, if everything checks out OK you could still have corrupted resources in both folders!

Mark Smith

https://community.logos.com/discussion/comment/42139#Comment_42139

Is your original installation running OK

Since I reformatted and moved stuff the original isn't on my computer, but I do have it on my work desktop. That is working fine there, so I could try transferring those files. Good thought. Thanks.

Mark Smith

https://community.logos.com/discussion/comment/42139#Comment_42139

I'd be tempted to make another copy and try again after removing all the resources from the new installation.

Dave and Mark and all, thanks for the help and suggestions. I finally deleted my resources and copied them over from another computer where I had recently downloaded them. Indexing finally completed and I have search results back again. PTL.

Robert Lombardi

https://community.logos.com/discussion/comment/42448#Comment_42448

FYI, for those who have perl available on their computer I created a perl script that checks all the resources against the reference list and provides a concise list of corrupted files. All in a moments time. Let me know if you want it. Here's sample output.

lombar@lombar1 /cygdrive/c/scripts
$ perl logos4_checker.pl logos4_checksum_reference.txt ResourceChecksum.txt
Found 56 corrupted books out of 1762 books

1207.refcheck_sum.log">http://community.logos.com/cfs-file.ashx/__key/CommunityServer.Discussions.Components.Files/76/1207.refcheck_5F00_sum.log:550:0]

Dave Hooton

https://community.logos.com/discussion/comment/54102#Comment_54102

FYI, for those who have perl available on their computer I created a perl script that checks all the resources against the reference list and provides a concise list of corrupted files. All in a moments time. Let me know if you want it. Here's sample output.

lombar@lombar1 /cygdrive/c/scripts
$ perl logos4_checker.pl logos4_checksum_reference.txt ResourceChecksum.txt
Found 56 corrupted books out of 1762 books

1207.refcheck_sum.log">http://community.logos.com/cfs-file.ashx/__key/CommunityServer.Discussions.Components.Files/76/1207.refcheck_5F00_sum.log:550:0]

Robert

I'm sure it would be most helpful. If you would be prepared to make it available to the forum you could post the script in the Files forum (but use Options button at the top of the Response panel to upload the file as an attachment). You might also create a new thread in this Logos4 forum to announce that it is available.

Thanks,