AI model

Dave Gifford

Before I post on how tokens might be counted, can Faithlife comment on what AI model you are using?

If not I understand and I will just post how openAI counts tokens.

Thanks

Dave

MJ. Smith

Dave Gifford said:

can Faithlife comment on what AI model you are using?

When they first implemented some AI feature, they indicated that the interface was written so that they could easily change their service provider/LLM model. They did not say who they were currently linked to.

Antony Brennan

Dave Gifford said:

how openAI counts tokens.

I asked OpenAI’s ChatGPT and it said:

AI tokens are generally counted based on the number of characters (including spaces) used in both the input (what you write) and the output (what the AI responds with). In most cases, 1 token represents about 4 characters of text, which is roughly ¾ of a word in English.

Here’s a breakdown:

• Input tokens: Every word, punctuation mark, and space you type counts toward tokens.
• Output tokens: The AI's response also generates tokens based on its length.

For example, a sentence like "How are AI tokens counted?" contains about 6 words or 28 characters, which would be approximately 7 tokens.

In general:

• 1 token ≈ 4 characters of English text
• 100 tokens ≈ 75 words

Alan Palmer (Logos)

We use a variety of LLMs across the various features. We strive to use the right one for the right job to ensure the highest quality for each unique job. Thus, we are also constantly evaluating new ones as they become available and reserve the right to make changes to which models are being used.