AI model

Dave Gifford
Dave Gifford Member Posts: 108 ✭✭
edited November 2024 in Books and Courses Forum

Before I post on how tokens might be counted, can Faithlife comment on what AI model you are using?

If not I understand and I will just post how openAI counts tokens.

Thanks

Dave

Tagged:

Comments

  • MJ. Smith
    MJ. Smith MVP Posts: 54,785

    Dave Gifford said:

    can Faithlife comment on what AI model you are using?

    When they first implemented some AI feature, they indicated that the interface was written so that they could easily change their service provider/LLM model. They did not say who they were currently linked to.

    Orthodox Bishop Alfeyev: "To be a theologian means to have experience of a personal encounter with God through prayer and worship."; Orthodox proverb: "We know where the Church is, we do not know where it is not."

  • Antony Brennan
    Antony Brennan Member Posts: 835 ✭✭✭

    Dave Gifford said:

    how openAI counts tokens.

    I asked OpenAI’s ChatGPT and it said:

    AI tokens are generally counted based on the number of characters (including spaces) used in both the input (what you write) and the output (what the AI responds with). In most cases, 1 token represents about 4 characters of text, which is roughly ¾ of a word in English.

    Here’s a breakdown:

    • Input tokens: Every word, punctuation mark, and space you type counts toward tokens.
    • Output tokens: The AI's response also generates tokens based on its length.

    For example, a sentence like "How are AI tokens counted?" contains about 6 words or 28 characters, which would be approximately 7 tokens.

    In general:

    • 1 token ≈ 4 characters of English text
    • 100 tokens ≈ 75 words

    👁️ 👁️

  • Alan Palmer (Logos)
    Alan Palmer (Logos) Member, Logos Employee Posts: 1,089

    We use a variety of LLMs across the various features. We strive to use the right one for the right job to ensure the highest quality for each unique job. Thus, we are also constantly evaluating new ones as they become available and reserve the right to make changes to which models are being used.

Categories