Downloads should be pre-indexed

Adam Porter
Adam Porter Member Posts: 20 ✭✭
edited December 2024 in English Forum

Most of the first-time indexing could be avoided by including indices with the downloaded resources.  Then those could be combined after download, much more quickly than indexing from scratch.  Indexing only needs to be done once for each resource.  Why not do that indexing once, ever, when the resource is created and packaged?  Why waste time and electricity by doing it from scratch on every client?

Comments

  • George Somsel
    George Somsel Member Posts: 10,150 ✭✭✭


    Most of the first-time indexing could be avoided by including indices with the downloaded resources.  Then those could be combined after download, much more quickly than indexing from scratch.  Indexing only needs to be done once for each resource.  Why not do that indexing once, ever, when the resource is created and packaged?  Why waste time and electricity by doing it from scratch on every client?


    You're absolutely correct, O great one !  And to think that Logos managed to develop and ship a product which garnered a large installed base which was dependent upon the evil Microsoft product.  Microsoft bad, Linux good. 

    Cut the nonsense.

    george
    gfsomsel

    יְמֵי־שְׁנוֹתֵינוּ בָהֶם שִׁבְעִים שָׁנָה וְאִם בִּגְבוּרֹת שְׁמוֹנִים שָׁנָה וְרָהְבָּם עָמָל וָאָוֶן

  • Adam Porter
    Adam Porter Member Posts: 20 ✭✭

    If you have something reasonable to say about my suggestion, please do.  Otherwise, why are you here?

    It's strange that some who care enough about something to defend it don't care enough about it to improve it.

  • Rosie Perera
    Rosie Perera Member Posts: 26,194 ✭✭✭✭✭


    Most of the first-time indexing could be avoided by including indices with the downloaded resources.  Then those could be combined after download, much more quickly than indexing from scratch.  Indexing only needs to be done once for each resource.  Why not do that indexing once, ever, when the resource is created and packaged?  Why waste time and electricity by doing it from scratch on every client?

    Adam, I suggested that very thing from the beginning when I first started using Logos 4. It makes a lot of sense. Then it was explained to me that if they did that, we'd have more to download. I still thought I would prefer waiting for a longer download once and not having to reindex everything; just merge previously built indexes.

    Nevermind George. He can be a bit of a curmudgeon at times. He's a good guy, though. I think he just thought you came on too strong in that other thread and had his hackles up already here. Keep up your suggestions. Realize that you're a relative newcomer to an already existing online community, and some of your ideas may already have been hashed and rehashed over again. So responses to what you suggest might reflect people's experience with previous discussions you are not aware of. You can search the forums to see if something you're thinking of has already been brought up here and debated to death. The forum search feature is pretty lame, so Google is a better choice, with site:community.logos.com appended to the search criteria.

    And welcome to the Logos forums. I hope you have some better luck with your suggestions and questions in the future.

  • George Somsel
    George Somsel Member Posts: 10,150 ✭✭✭


    If you have something reasonable to say about my suggestion, please do.  Otherwise, why are you here?

    It's strange that some who care enough about something to defend it don't care enough about it to improve it.


    I was about to ask you the same question, "Why are you here?"  It seems that your sole aim is to be disagreeable.  If you have something to say that isn't simply a complaint, but is truly a suggestion, I'm sure we would all be interested in listening.  The fact is that you came in using pejorative language about Microsoft and Logos for using Microsoft as though you know more than Microsoft or Logos.  If you're such a hot shot, why don't you start from scratch and produce your own product rather than simply knocking others?

    george
    gfsomsel

    יְמֵי־שְׁנוֹתֵינוּ בָהֶם שִׁבְעִים שָׁנָה וְאִם בִּגְבוּרֹת שְׁמוֹנִים שָׁנָה וְרָהְבָּם עָמָל וָאָוֶן

  • Adam Porter
    Adam Porter Member Posts: 20 ✭✭

    Rosie, yeah, I think downloading a few more MB would happen much more quickly for the average user than indexing from scratch.

    George: almost any complaint could be evaluated as a suggestion, and indeed that's how every business should treat customer complaints: problems that were encountered and need to be fixed.  I don't understand your apologetics--are you a Logos developer?  I paid for the software and have as much right to talk about it here as you do.  You are fixating on my ideological arguments and ignoring the simple suggestions I have made.  Why don't you just ignore me?  :)

    We'd all be better off if we spent more time in the Word than arguing here.  I'm sad to say that I've spent more time doing this today than reading the Bible.



  • MJ. Smith
    MJ. Smith MVP Posts: 54,814

    I don't understand your apologetics--are you a Logos developer?

    No - Logos employees are identifiable by their own blue icon beneath their name. Most days go without arguments on the forums. Today seemed to bring the arguments out.

    We'd all be better off if we spent more time in the Word than arguing here.  

    As you will find as you spend time in the forums we can count more fingers and toes than argumentative forum dwellers < .000003% if I calculated correctly. Sorry your first forays into the forums had uncommon results.

    Orthodox Bishop Alfeyev: "To be a theologian means to have experience of a personal encounter with God through prayer and worship."; Orthodox proverb: "We know where the Church is, we do not know where it is not."

  • Damian McGrath
    Damian McGrath Member Posts: 3,050 ✭✭✭

    Adam, I suggested that very thing from the beginning when I first started using Logos 4. It makes a lot of sense. Then it was explained to me that if they did that, we'd have more to download. I still thought I would prefer waiting for a longer download once and not having to reindex everything; just merge previously built indexes.

    My Logos4 folder is 24GB - I wouldn't be too keen on downloading all of that. I'd rather my machine worked away on the index.

  • Most of the first-time indexing could be avoided by including indices with the downloaded resources.  Then those could be combined after download, much more quickly than indexing from scratch.  Indexing only needs to be done once for each resource.  Why not do that indexing once, ever, when the resource is created and packaged?  Why waste time and electricity by doing it from scratch on every client?

    Observation: this suggestion was discussed in November 2009 - Wiki page Logos Speaks includes Why no prebuilt indexes? => http://community.logos.com/forums/p/3608/27733.aspx#27733

    Concur building indexes locally provides Logos flexibility to enhance and change indexing algorithms. Looking in Indexer.log file noticed substantial time merging index files (can appear no progress being made for many minutes).

    Also appreciate initial download/index frustration and wonder how to improve => http://community.logos.com/forums/t/28259.aspx

    Keep Smiling [:)]

  • When Logos adds Personal Book Builder (PBB)  feature, local indexing should provide way to integrate personal book contents for searching on local computer with rest of Logos library.

    Keep Smiling [:)]

  • Bohuslav Wojnar
    Bohuslav Wojnar Member Posts: 3,477 ✭✭✭

    " rel="nofollow">Keep Smiling 4 Jesus :) said:

    When Logos adds Personal Book Builder (PBB)  feature, local indexing should provide way to integrate personal book contents for searching on local computer with rest of Logos library.

    Keep Smiling Smile

    You still believe in the second coming of PBBs? I try also as much as I can... [:D]

    Yes, indexing on the machine has some good reasons and future coming of PBBs is one of them.

    P.S. and by the way, indexing now is very fast, comparing to the initial one when Logos 4 started.

    Bohuslav

  • Robert Pavich
    Robert Pavich Member Posts: 5,685 ✭✭✭

    Since indexing happens infrequently and it only goes for about an hour or two...I'm of the opinion that we keep the system as is....it doesn't bother me a bit....my system (old) works fine while indexing.

    Robert Pavich

    For help go to the Wiki: http://wiki.logos.com/Table_of_Contents__

  • George Somsel
    George Somsel Member Posts: 10,150 ✭✭✭

    " rel="nofollow">Keep Smiling 4 Jesus :) said:


    When Logos adds Personal Book Builder (PBB)  feature, local indexing should provide way to integrate personal book contents for searching on local computer with rest of Logos library.

    That lends a new meaning to the term "parousia", n'est-ce pas?

    george
    gfsomsel

    יְמֵי־שְׁנוֹתֵינוּ בָהֶם שִׁבְעִים שָׁנָה וְאִם בִּגְבוּרֹת שְׁמוֹנִים שָׁנָה וְרָהְבָּם עָמָל וָאָוֶן

  • Kevin Becker
    Kevin Becker Member Posts: 5,604 ✭✭✭

    Adam,

    In the year + since Logos 4 was released there has been a lot of discussion about the design decisions made (.NET/WPF, indexing, downloading etc.). We've tried to keep an easy to use record of company responses at the Logos Speaks wiki page that Keep Smiling mentioned.

    And, almost without fail Logos has said that there was a reason for why they made the decisions that they made. Of course that does not mean they have made the best decisions, but then again I suspect that most of us are not fully attuned to the technical challenges in accomplishing Logos' goal. So when it comes to the fundamental design features I choose to trust the Bob and his developers.

    Logos is actually a very responsive company. The version you downloaded the other day is a vast improvement over the initial release. A number of features in it are solely the product of users saying "we want this." For example, the inline interlinear display was one such development. I could continue but suffice it to say that Logos has a proven track record of adjusting the to do list to give users desired features.

    So, if someone hasn't directed you there yet, check out Logos' Uservoice forum and contribute your ideas there too.

    BTW welcome to the forum.

  • DominicM
    DominicM Member Posts: 2,995 ✭✭✭


    You still believe in the second coming of PBBs? I try also as much as I can... Big Smile

    Have to say my belief is waining in this area too - must keep faith - but am begining to have doubts...

    Never Deprive Anyone of Hope.. It Might Be ALL They Have

  • Donnie Hale
    Donnie Hale Member Posts: 2,036 ✭✭✭

    Most of the first-time indexing could be avoided by including indices with the downloaded resources.  Then those could be combined after download, much more quickly than indexing from scratch.  Indexing only needs to be done once for each resource.  Why not do that indexing once, ever, when the resource is created and packaged?  Why waste time and electricity by doing it from scratch on every client?

    One practical problem with pre-indexing (a thought which has gone through my mind) is that no two users' sets of resources are identical. So even if Logos maintained a per-resource index that could be downloaded with the resource, you wouldn't end up with an "inter-resource" (my term) index. This causes problems already in that certain searches will provide two sets of results, one from your main index and one from a supplemental index. I think the "reindex all" command will rebuild everything back into a single index. But I think the point is obvious - each user's index is essentially unique.

    Donnie

     

  • DMB
    DMB Member Posts: 14,233 ✭✭✭✭

    Agree with Adam. Having seen the search speeds for the internet versions of Logos (Library/Biblia) for my library, the on-PC concept does make you wonder. I'd be willing to bet Logos (or it's next name) users will look back on when they used to literally index their books on their PCs for hours, for thousands of books. They'll each brag how long it took and how big a computer each one had to try to get some decent performance. Those will be the good days.

    "If myth is ideology in narrative form, then scholarship is myth with footnotes." B. Lincolm 1999.

  • TCBlack
    TCBlack Member Posts: 10,980 ✭✭✭

    Those will be the good days.

    Well then these are the good old days.

    <note type=mental>argg, now I have Carly Simon crooning in my head</note>

    Hmm Sarcasm is my love language. Obviously I love you. 

  • " rel="nofollow">Keep Smiling 4 Jesus :) said:


    When Logos adds Personal Book Builder (PBB)  feature, local indexing should provide way to integrate personal book contents for searching on local computer with rest of Logos library.


    That lends a new meaning to the term "parousia", n'est-ce pas?

    oui monsieur [;)]

    Wonder which arrival will happen first: PBB or Trumpet Call ?  (When the trumpet of the Lord shall sound ...)

    Keep Smiling [:)]

     

  • Matt Hamrick
    Matt Hamrick Member Posts: 1,284 ✭✭✭


    Since indexing happens infrequently and it only goes for about an hour or two...I'm of the opinion that we keep the system as is....it doesn't bother me a bit....my system (old) works fine while indexing.


     

    [Y] My systems  work fine as well.

  • Bohuslav Wojnar
    Bohuslav Wojnar Member Posts: 3,477 ✭✭✭

    Agree with Adam. Having seen the search speeds for the internet versions of Logos (Library/Biblia) for my library, the on-PC concept does make you wonder. I'd be willing to bet Logos (or it's next name) users will look back on when they used to literally index their books on their PCs for hours, for thousands of books. They'll each brag how long it took and how big a computer each one had to try to get some decent performance. Those will be the good days.

    I would not be too loud with your suggestions of not having the indexes and resources in our computers down here but in the cloud because that was the direction the president of Logos would like to take in the future, but us, most of the users, insisted we want to have our books downloaded and usable off-line. So yes, it might be in the future, when Internet will be even on the moon, but not yet, not yet... It still happens to me very often (and I think I am not alone) that I am so happy to have Logos off-line with me because I am not on the Internet.

    Bohuslav

  • Mike S.
    Mike S. Member Posts: 477 ✭✭

    Having been a DB developer with the most successful business db for years, I can tell you that the idea of pre-shipping an index with an individual resource doesn't really make sense. What you could ship, would be not really change the user experience. 

    One of the options would be to ship a "pre-indexed" version of the "boxed" product/base package, but I'm guessing they've looked at this.

    I actually think Logos has done a fantastic job with the approach they've taken, they could make the initial install for new people, from DVD(s) a bit easier with preindexing of base package, but not much more.

  • Rich DeRuiter
    Rich DeRuiter MVP Posts: 6,729

    Mike S. said:

    I actually think Logos has done a fantastic job with the approach they've taken, they could make the initial install for new people, from DVD(s) a bit easier with preindexing of base package, but not much more.

    Even then, unless someone had only the base package, it would have to be re-indexed anyway.

    Right?

     Help links: WIKI;  Logos 6 FAQ. (Phil. 2:14, NIV)

  • Rosie Perera
    Rosie Perera Member Posts: 26,194 ✭✭✭✭✭


    Mike S. said:

    I actually think Logos has done a fantastic job with the approach they've taken, they could make the initial install for new people, from DVD(s) a bit easier with preindexing of base package, but not much more.

    Even then, unless someone had only the base package, it would have to be re-indexed anyway.

    Right?


    True, but probably the vast majority of first-time buyers start with a base package only, and only add other stuff later once they've gotten used to the software. Having the out-of-the-box experience be as pain-free as possible is likely to attract more people to stick with it.

  • MJ. Smith
    MJ. Smith MVP Posts: 54,814

    I'd be willing to bet Logos (or it's next name) users will look back on when they used to literally index their books on their PCs for hours, for thousands of books

    Certainly the types and methods of indexing in db's has changed significantly - much of it driven by mathematical models of efficiency, some driven by primary use - data warehouse vs. XML doc vs. normalized data, some driven by hardware.  But what appears to be missing from the thread is that user generated data is also indexed by Logos 4. I think the data on which your index is dependent is:

    • software version - as some versions add indexing requirements
    • base package
    • resources added to base package
    • user generated data

    Personally, on these factors I'd rather generate the indexes on my machine than pay for the increased Logos overhead. I'm looking forward to admitting I've actually read books printed on paper by hand carved wooden blocks.[:D] - back in the old days, of course.

    Orthodox Bishop Alfeyev: "To be a theologian means to have experience of a personal encounter with God through prayer and worship."; Orthodox proverb: "We know where the Church is, we do not know where it is not."

  • Michael Anda
    Michael Anda Member Posts: 497 ✭✭

    I'm not sure how common this is, but some people do not have unlimited internet plans.  Bigger downloads would not be appealing to someone on one of those service plans.

     

     

     

  • TCBlack
    TCBlack Member Posts: 10,980 ✭✭✭

    I'm not sure how common this is, but some people do not have unlimited internet plans.  Bigger downloads would not be appealing to someone on one of those service plans.

    A Good point Michael, since downloading an index would be roughly the same size as your books hence doubling the download altogether from 4.2G to 8.4G in no time flat.  :-)

     

    Hmm Sarcasm is my love language. Obviously I love you. 

  • Floyd  Johnson
    Floyd Johnson Member Posts: 4,002 ✭✭✭

    True, but probably the vast majority of first-time buyers start with a base package only, and only add other stuff later once they've gotten used to the software. Having the out-of-the-box experience be as pain-free as possible is likely to attract more people to stick with it.

    But not every purchase of a Base package is by a first time user - but purchased as an upgrade.  There would need to be two sets of down loads for each Base Package - one for first time users and one for up-graders.  This may just add to the confusion some people feel when they first are introduced to LOGOS.

    Blessings,
    Floyd

    Pastor-Patrick.blogspot.com

  • DMB
    DMB Member Posts: 14,233 ✭✭✭✭

    Bohuslav ... I'm the one that whines when Bob wants to upload my settings/highlights/etc. I'm also the one that keeps my internet settings turned off, knowing full well that when I buy a resource, I dutifully turn them back on, and Bob happily uploads all my settings/highlighting/etc. I'm also the one that was populating my L3 during 2010, with the assumption that Bob will eventually pull the plug on L3. So, I'm not real thrilled with 'the cloud'.

    But that said, I also recognize Logos has to compete and users are not as backward as I am. And given the huge library that Logos offers, high-speed pattern matching will inevitably be its next forte (similar to Google books). That plus the inter-connecting to church presentation software and the eventual ability for members to also share ... the cloud is the only way it can be done. Certainly not now, but maybe L5 or L6.

    "If myth is ideology in narrative form, then scholarship is myth with footnotes." B. Lincolm 1999.

  • Bohuslav Wojnar
    Bohuslav Wojnar Member Posts: 3,477 ✭✭✭

    Bohuslav ... I'm the one that whines when Bob wants to upload my settings/highlights/etc. I'm also the one that keeps my internet settings turned off, knowing full well that when I buy a resource, I dutifully turn them back on, and Bob happily uploads all my settings/highlighting/etc. I'm also the one that was populating my L3 during 2010, with the assumption that Bob will eventually pull the plug on L3. So, I'm not real thrilled with 'the cloud'.

    But that said, I also recognize Logos has to compete and users are not as backward as I am. And given the huge library that Logos offers, high-speed pattern matching will inevitably be its next forte (similar to Google books). That plus the inter-connecting to church presentation software and the eventual ability for members to also share ... the cloud is the only way it can be done. Certainly not now, but maybe L5 or L6.

    I am afraid you are right Denise.

    Bohuslav