Searching with a wildcard character (part 2 :-)

Mark Allison
Mark Allison Member Posts: 556 ✭✭✭
edited November 21 in English Forum

If I'm performing an inline search for a word using a wildcard character at the end of a word (like του* for example), the results take a second or two (I'm using SBLGNT btw). But if I search using a wildcard character at the beginning of a word (like *υσα for example), it can take anywhere from 6-12 seconds on my M2 MacBook Air. 

The search is slower if there are more hits, but it seems to me that the search is exponentially slower if the asterisk precedes the rest of the word.

Is this normal behavior? And if it is, can it be fixed? In Accordance, both these searches are instantaneous, and as we have more users switching to Logos, they'll be uncomfortable with this performance. 

Tagged:

Comments

  • Justin Gatlin
    Justin Gatlin Member Posts: 2,051 ✭✭✭

    I get the same results that you do. The same thing happens searching English Bibles (for example *ing versus pro*). This is expected behavior for most search engines, since they generally read from left to right and so wildcards at the end require far more steps. Accordance must be smart enough to do searches from right to left when the wildcard is at the end of a word, which is cool.

  • Bradley Grainger (Logos)
    Bradley Grainger (Logos) Administrator, Logos Employee Posts: 11,969

    The search is slower if there are more hits, but it seems to me that the search is exponentially slower if the asterisk precedes the rest of the word.

    Is this normal behavior?

    Yes, this is "normal" for Logos. Wildcard searches are slower (and prefix wildcard searches are much, much slower).

    And if it is, can it be fixed? In Accordance, both these searches are instantaneous, and as we have more users switching to Logos, they'll be uncomfortable with this performance. 

    Technically, yes, it can be fixed. (There are various tricks you can use with specialised indexes, such as "rotating" a single wildcard to the end of the word, so that wil*ard becomes ardwil* which can be implemented as an efficient prefix search. I would guess that Accordance does something clever like this. Or maybe the list of terms in a single book is just so small Accordance can brute-force check them all quickly.)

    However, this has been a "known issue" in Logos searching since Logos 4 came out and it's not high on the priority list to fix any time soon.

  • Mark Allison
    Mark Allison Member Posts: 556 ✭✭✭

    However, this has been a "known issue" in Logos searching since Logos 4 came out and it's not high on the priority list to fix any time soon.

    Thanks for the detailed response Bradley. It helps to know that it's not just me or my computer. Being a new user can be pretty frustrating that way.

    Right now Accordance is a dumpster fire. I know many Accordance users who are abandoning that sinking ship (to use another metaphor) and looking at Logos as an option. There are some pretty radical differences between the two apps, mostly related to Logos' historical commitment to the pastoral market, and Accordance's to the academic market. However, Logos and Accordance have both worked hard to meet in the middle, and I think Logos is much better at original language research than most Accordance users give it credit for. 

    A lot of BibleWorks users moved to Accordance when it shut its doors. If Accordance continues on the same downwards trajectory, there will be two groups of users who work with original language research all day, are used to lightning-fast searching in both Greek and Hebrew, and are looking for other alternatives. 

    All that to say that Logos might want to take a look at adjusting some of their priorities to meet the needs of this group of users who are VERY committed to Bible software and aren't afraid to spend money on the tools they use every day. 

  • MJ. Smith
    MJ. Smith MVP Posts: 53,432

    Being a new user can be pretty frustrating that way.

    A second approach is to ask why you use wildcards? It may be that Logos solves the problem in a different way. What are you looking for that requires the use of wildcards?

    Orthodox Bishop Alfeyev: "To be a theologian means to have experience of a personal encounter with God through prayer and worship."; Orthodox proverb: "We know where the Church is, we do not know where it is not."

  • Mark Allison
    Mark Allison Member Posts: 556 ✭✭✭

    MJ. Smith said:

    What are you looking for that requires the use of wildcards?

    A user on the Accordance forums was looking for every inflected form of a Greek in the NA28 that ended with υει, and needed to also see the lexical form of each word. 

  • Justin Gatlin
    Justin Gatlin Member Posts: 2,051 ✭✭✭

    You probably know how to do the final step in Logos already, but for the sake of those who may turn up here in the future, after doing a search for *υει , you click "analysis" and drag "lemma" to the top. That can also be exported to a spreadsheet.

  • Mark Allison
    Mark Allison Member Posts: 556 ✭✭✭

    You probably know how to do the final step in Logos already, but for the sake of those who may turn up here in the future, after doing a search for *υει , you click "analysis" and drag "lemma" to the top. That can also be exported to a spreadsheet.

    Note: "Option-drag" lemma to the top. 

    Also, if you want to collapse all the results, Control-click on one of the disclosure triangles and select "Collapse All." 

  • Justin Gatlin
    Justin Gatlin Member Posts: 2,051 ✭✭✭

    Note: "Option-drag" lemma to the top. 

    Also, if you want to collapse all the results, Control-click on one of the disclosure triangles and select "Collapse All." 

    In Windows, it is just normal dragging. I did not realize Mac was different. Interesting, I wonder why.

    If you sort by lemma and then by result as a secondary category (irrelevant in this particular search), "Summary View" is better than collapse all. It collapses the contents of each layer but shows all of the categories and subcategories.

  • Mark Allison
    Mark Allison Member Posts: 556 ✭✭✭

    In Windows, it is just normal dragging. I did not realize Mac was different. Interesting, I wonder why.

    Interesting. On a Mac, you can drag the headings around to order them, but you have to use the Option key to move it to the top. 

    If you sort by lemma and then by result as a secondary category (irrelevant in this particular search), "Summary View" is better than collapse all. It collapses the contents of each layer but shows all of the categories and subcategories.

    Good to know! Thanks!
  • Mark Allison
    Mark Allison Member Posts: 556 ✭✭✭

    Also, to be fair, this sort of wildcard search is the only search I've performed in Logos that takes an inordinate amount of time. I've been very pleased with the response of pretty much everything I've done in Logos. 

    And that's saying a lot. I tried using the original version of Logos on the Mac and it was practically unusable. I gave up on it and never came back till now. It's come a long way!