SUGGESTION: Tool to identify repetition

MJ. Smith
MJ. Smith MVP Posts: 55,128
edited December 2024 in English Forum

In reading some of the prophets,  I have been struck with the reoccurrence of phrases and images. I wish I had a tool that  would identify repetitions first of single words, then of pairs of words, then of three word phrases/clusters etc. ...Yes, I know I can move the text into a linguistic package but I'd much rather do it within Logos.

Orthodox Bishop Alfeyev: "To be a theologian means to have experience of a personal encounter with God through prayer and worship."; Orthodox proverb: "We know where the Church is, we do not know where it is not."

Comments

  • George Somsel
    George Somsel Member Posts: 10,150 ✭✭✭

    MJ. Smith said:


    In reading some of the prophets,  I have been struck with the reoccurrence of phrases and images. I wish I had a tool that  would identify repetitions first of single words, then of pairs of words, then of three word phrases/clusters etc. ...Yes, I know I can move the text into a linguistic package but I'd much rather do it within Logos.


    I think I understand what you want.  If I enounter "for three transgressions" in Amos, I can search to find other instances of the use of this.  I think what you are seeking is something which will identify repetitions without doing a search for a particular phrase.  Is this correct?

    george
    gfsomsel

    יְמֵי־שְׁנוֹתֵינוּ בָהֶם שִׁבְעִים שָׁנָה וְאִם בִּגְבוּרֹת שְׁמוֹנִים שָׁנָה וְרָהְבָּם עָמָל וָאָוֶן

  • MJ. Smith
    MJ. Smith MVP Posts: 55,128

    Is this correct?

    Yes that's it. I want the search to find the repetition  of phrases rather that my having to identify them manually then do a search on each one.

    Orthodox Bishop Alfeyev: "To be a theologian means to have experience of a personal encounter with God through prayer and worship."; Orthodox proverb: "We know where the Church is, we do not know where it is not."

  • Philana Crouch
    Philana Crouch Member Posts: 2,151 ✭✭✭

    Would doing a search once and using a visual filter be a workaround?

  • Rosie Perera
    Rosie Perera Member Posts: 26,194 ✭✭✭✭✭

     

    Would doing a search once and using a visual filter be a workaround?

    The problem is, you don't know what to search for to begin with. What would it be about "for three transgressions" on first encountering it that might make you think "I ought to try searching for that and see if it's a repeated phrase"? You're not going to go through and search for every single string of three words together. Of course once you're familiar with the book of Amos you'll recognize some of the repeated phrases right away and know to search for where else they occur in the book, but there might be some that don't jump out at you right away. Such a tool/feature would be useful to show you what these repeated phrases are.

     

  • MJ. Smith
    MJ. Smith MVP Posts: 55,128

    You're not going to go through and search for every single string of three words together

    The way I would do it.

    1. Do the equivalent of the morphological searchwe currently use to find the count of each word

    2. For words occurring more than once, do a two word search for occurrence counts

    3. For two word pairs the appear more than once, do a three word search for occurrence counts

    4. For three word strings that appear more than once, do a four word search for occurrence counts ...

    etc. until  you no longer find a string of  words occurring multiple times.

    Admittedly,  I don't know how to write elegant code to make it happen, but I can make it happen. And I can get the results by reiterative use of tools I find online ... but they tend to be catering to Shakespeare not the Bible.

    I  might try to build an example this evening.

    Orthodox Bishop Alfeyev: "To be a theologian means to have experience of a personal encounter with God through prayer and worship."; Orthodox proverb: "We know where the Church is, we do not know where it is not."

  • Rosie Perera
    Rosie Perera Member Posts: 26,194 ✭✭✭✭✭

    MJ. Smith said:

    You're not going to go through and search for every single string of three words together

    The way I would do it.

    1. Do the equivalent of the morphological searchwe currently use to find the count of each word

    2. For words occurring more than once, do a two word search for occurrence counts

    3. For two word pairs the appear more than once, do a three word search for occurrence counts

    4. For three word strings that appear more than once, do a four word search for occurrence counts ...

    etc. until  you no longer find a string of  words occurring multiple times.

    Admittedly,  I don't know how to write elegant code to make it happen, but I can make it happen. And I can get the results by reiterative use of tools I find online ... but they tend to be catering to Shakespeare not the Bible.

    I  might try to build an example this evening.

    I was talking about a human in that quote of mine that you quoted. But your proposed algorithm for how the software might approach this problem seems reasonable.

  • MJ. Smith
    MJ. Smith MVP Posts: 55,128

    I was talking about a human in that quote of mine that you quoted.

    Bear in mind when I was on maternity leave I created a Chinese concordance to the I-Ching ... I just MIGHT tackle it the old-fashioned way (by hand).[:P]

    Orthodox Bishop Alfeyev: "To be a theologian means to have experience of a personal encounter with God through prayer and worship."; Orthodox proverb: "We know where the Church is, we do not know where it is not."

  • Caleb S.
    Caleb S. Member Posts: 585 ✭✭

    Having such a tool that would automatically search for repeated phrases or words in 1) one book of the Bible and 2) every book of the Bible, to see if other authors picked up on the same theme, would be amazing! Not everyone even realizes there ARE repeated words or phrases (or themes, for that matter). I definitely would like to see such a feature.

  • fgh
    fgh Member Posts: 8,948 ✭✭✭

    [Y]

    Mac Pro (late 2013) OS 12.6.2

  • Milford Charles Murray
    Milford Charles Murray Member Posts: 5,004 ✭✭✭

    bump!                               *smile*

    Philippians 4:  4 Rejoice in the Lord always; again I will say, Rejoice. 5 Let your reasonableness be known to everyone. The Lord is at hand..........