Take the Logos 4 speed test . . .

Page 1 of 2 (32 items) 1 2 Next >
This post has 31 Replies | 4 Followers

Posts 97
Greg Gray | Forum Activity | Posted: Wed, Nov 11 2009 9:11 PM

There have been a growing number of speed related issues with V4 raised since it was released (and while it was in Beta).  Since speed is very subjective (one person may be annoyed to tears with a 3 second delay on a right click and another person might see it as a nice break:-).  In order to clarify what is really going on, could we make a standard speed test?

 

Here would be my suggestion:  Divide the test into three parts.  1. Gui.  2.  Search speed.  3.  Obvious bugs.  The tests for each could be as follows:

 

1.  Gui speed.

A.  When you have multiple tabs open do you have instant response when you click on an unselected tab?  If no what is the approximate lag time?

B.  When you right click on a word in a Bible that has an interlinear, is the information in the menu displayed instantly or is there a lag (If there is a lag how many seconds until everything is displayed).

C.  When you click on a word in a Bible with an interlinear, does the word instantly become highlighted in both the text and the interlinear or is there a lag?  If a lag how long?

 

2.  Search speed.   (as speed in this area is system specific, I think it is only right to post both the speed of Logos3 and Logos4.  Logos3 is our point of reference for search efficiency and I think all of us expect Version 4 to be faster in this department)

A.  Do a passage guide search in version three for Romans 8:1 with all headings expanded.  Do the same passage guide search in V4 (make sure you only have the categories expanded that correspond to the categories in Version 3's passage guide.)  List the time in seconds for both.

B.  Do a library search for the word "God" in both V3 and V4.  Note the time it takes for both, not only to complete the search, but also to display all search results.  (NOTE: in V4 the search results will be divided into pages, and each pave initiates a new search - so to be fare you must multiply your time for page 1 by the number of pages listed at the bottom)

C.  Using an interlinear with the information tool open, hover over a word.  Record the time taken to display all information in both versions.

3.  Obvious bugs

This isn't so much a test, as a place to report obvious speed related issues (like program becoming temporarily unresponsive, etc.  If you list a bug, record your system data.  Include atleast the following:

Operating system, CPU, Memory amount, video card, hard drive, antivirus and anti-spyware software, etc.

Posts 97
Greg Gray | Forum Activity | Replied: Wed, Nov 11 2009 9:27 PM

Here are my results:

 

 

1.  Gui speed.

A.  When you have multiple tabs open do you have instant response when you click on an unselected tab?  If no what is the approximate lag time?

Lag ranges from instant to about 5 seconds.  I can't find out a consistent way to make it lag it just happens some times 

 

B.  When you right click on a word in a Bible that has an interlinear, is the information in the menu displayed instantly or is there a lag (If there is a lag how many seconds until everything is displayed).

Lag is about 5 - 6 seconds on average

 

C.  When you click on a word in a Bible with an interlinear, does the word instantly become highlighted in both the text and the interlinear or is there a lag?  If a lag how long?

Lag is 1 - 2 seconds (can be worse if information window is open)

 

2.  Search speed.   (as speed in this area is system specific, I think it is only right to post both the speed of Logos3 and Logos4.  Logos3 is our point of reference for search efficiency and I think all of us expect Version 4 to be faster in this department)

A.  Do a passage guide search in version three for Romans 8:1 with all headings expanded.  Do the same passage guide search in V4 (make sure you only have the categories expanded that correspond to the categories in Version 3's passage guide.)  List the time in seconds for both.

Version 3 = 6 seconds

Version 4 = 35 seconds (a passage guide search with all headings expanded is 80 seconds for me)

 

B.  Do a library search for the word "God" in both V3 and V4.  Note the time it takes for both, not only to complete the search, but also to display all search results.  (NOTE: in V4 the search results will be divided into pages, and each pave initiates a new search - so to be fare you must multiply your time for page 1 by the number of pages listed at the bottom)

 

Version 3 = 115 seconds

Version 4 = 500 seconds (25 seconds times 20 pages)

C.  Using an interlinear with the information tool open, hover over a word.  Record the time taken to display all information in both versions.

Version 3 = practically instant

Version 4 = 5 - 10 seconds depending on the word.


 

Posts 26962
Forum MVP
Dave Hooton | Forum Activity | Replied: Thu, Nov 12 2009 5:24 AM

Greg Gray:

B.  Do a library search for the word "God" in both V3 and V4.  Note the time it takes for both, not only to complete the search, but also to display all search results.  (NOTE: in V4 the search results will be divided into pages, and each pave initiates a new search - so to be fare you must multiply your time for page 1 by the number of pages listed at the bottom)

Version 3 = 115 seconds

Version 4 = 500 seconds (25 seconds times 20 pages)

My results were a reverse of yours as v3 took 600s and v4 took 100s. I also realised that the default in v3 is to search all word forms (Stemming), so I changed v4 to Match All Word Forms.

Dave
===

Windows 10 & Android 8

Posts 97
Greg Gray | Forum Activity | Replied: Thu, Nov 12 2009 2:03 PM

My results were a reverse of yours as v3 took 600s and v4 took 100s. I also realised that the default in v3 is to search all word forms (Stemming), so I changed v4 to Match All Word Forms.

My system should not be too far off from yours and yet your V4 is performing 5 times faster.

Did you try any of the other tests? do you have any problems with slow GUI?

 

Posts 4508
Robert Pavich | Forum Activity | Replied: Thu, Nov 12 2009 2:18 PM

I don't have v3 loaded but here are my results in V4:

 

 

1.  Gui speed.

A.  When you have multiple tabs open do you have instant response when you click on an unselected tab?  If no what is the approximate lag time?

Instant across the board.

 

B.  When you right click on a word in a Bible that has an interlinear, is the information in the menu displayed instantly or is there a lag (If there is a lag how many seconds until everything is displayed).

Lag is about 1 - 2 seconds on average

 

C.  When you click on a word in a Bible with an interlinear, does the word instantly become highlighted in both the text and the interlinear or is there a lag?  If a lag how long?

Lag is 1 second (can be worse if information window is open)

 

2.  Search speed.   (as speed in this area is system specific, I think it is only right to post both the speed of Logos3 and Logos4.  Logos3 is our point of reference for search efficiency and I think all of us expect Version 4 to be faster in this department)

A.  Do a passage guide search in version three for Romans 8:1 with all headings expanded.  Do the same passage guide search in V4 (make sure you only have the categories expanded that correspond to the categories in Version 3's passage guide.)  List the time in seconds for both.

Version4  3 - 4 seconds

 

B.  Do a library search for the word "God" in both V3 and V4.  Note the time it takes for both, not only to complete the search, but also to display all search results.  (NOTE: in V4 the search results will be divided into pages, and each pave initiates a new search - so to be fare you must multiply your time for page 1 by the number of pages listed at the bottom)

 

Version 3 = 115 seconds

Version 4 = 44 seconds (2.23 seconds times 20 pages)

C.  Using an interlinear with the information tool open, hover over a word.  Record the time taken to display all information in both versions.


Version 4 = 3-4 seconds depending on the word.

Robert Pavich

For help go to the Wiki: http://wiki.logos.com/Table_of_Contents__

Posts 8660
TCBlack | Forum Activity | Replied: Thu, Nov 12 2009 2:22 PM

1.A   0.5 second lag running Logos with 13 resources and reports. Firefox with 20 tabs, Digsby IM client, Bibleworks 8 with notes, and Openoffice.org

1.B.  0.5 or faster second delay to create a menu, it populates in about five seconds.

1.C. 0.5 second delay

2.A,B.  I don't have V3 installed.

Desktop | Windows Experience Index: | AMD 64 X2 3800+ (2.0Ghz) dual core | 4GB RAM | Dual 22" widescreen monitors at 1680x1050 | Nvidia 7300 GS 256MB video RAM |500 GB Raid Mirror. | Windows 7 Professional 64bit  - all patches. |Kaspersky Internet Security 2010 - up to date

Hmm Sarcasm is my love language. Obviously I love you. 

Posts 5573
Forum MVP
Rich DeRuiter | Forum Activity | Replied: Thu, Nov 12 2009 2:59 PM

Greg Gray:

1.  Gui speed.

A.  When you have multiple tabs open do you have instant response when you click on an unselected tab?  If no what is the approximate lag time?

Result: Instant response

Greg Gray:
B.  When you right click on a word in a Bible that has an interlinear, is the information in the menu displayed instantly or is there a lag (If there is a lag how many seconds until everything is displayed).

Result: Window pops up instantly, takes up to about 2 seconds (by the sound of the ticking of my office wall clock) to finish displaying options, depending on which item on the right side of the menu is selected.

Greg Gray:
C.  When you click on a word in a Bible with an interlinear, does the word instantly become highlighted in both the text and the interlinear or is there a lag?  If a lag how long?

Result: Instant to up to a second.

Greg Gray:

2.  Search speed.   (as speed in this area is system specific, I think it is only right to post both the speed of Logos3 and Logos4.  Logos3 is our point of reference for search efficiency and I think all of us expect Version 4 to be faster in this department)

A.  Do a passage guide search in version three for Romans 8:1 with all headings expanded.  Do the same passage guide search in V4 (make sure you only have the categories expanded that correspond to the categories in Version 3's passage guide.)  List the time in seconds for both.

Result: V3 (checking all options except my "collections"): 47 seconds; V4: hard to tell, since some of it finishes outside of screen shot. But it looks like about 12 seconds.

Greg Gray:
B.  Do a library search for the word "God" in both V3 and V4.  Note the time it takes for both, not only to complete the search, but also to display all search results.  (NOTE: in V4 the search results will be divided into pages, and each pave initiates a new search - so to be fare you must multiply your time for page 1 by the number of pages listed at the bottom)

Result (searching all unlocked/entire library): V3: I gave up after 7.5 mintes; V4: about 20 seconds to get to the bottom of the page where there were 20+ more pages waiting.

Greg Gray:
C.  Using an interlinear with the information tool open, hover over a word.  Record the time taken to display all information in both versions.

Result (using NA27 interlinear): V3: Instantaneous; V4 about 1 second after mouse stops moving.

Greg Gray:
Operating system, CPU, Memory amount, video card, hard drive, antivirus and anti-spyware software, etc.

OS: Win7 (64bit); CPU: Intel i7-920 (2.67 GHz 8MB L3 cache); RAM: 6GB; Video: ATI Radeon HD 4850 (512MB); HD: 683GB (466GB free); AV: Norton Internet Security.

 Help links: WIKI;  Logos 6 FAQ. (Phil. 2:14, NIV)

Posts 8660
TCBlack | Forum Activity | Replied: Thu, Nov 12 2009 3:18 PM

Richard DeRuiter:
OS: Win7 (64bit); CPU: Intel i7-920 (2.67 GHz 8MB L3 cache); RAM: 6GB; Video: ATI Radeon HD 4850 (512MB); HD: 683GB (466GB free); AV: Norton Internet Security.
Surprise that is a serious machine Richard.

Hmm Sarcasm is my love language. Obviously I love you. 

Posts 97
Greg Gray | Forum Activity | Replied: Thu, Nov 12 2009 3:24 PM

3.  Here is a reproducible bug on my system.  Normally on my system doing a lemma search in a Word study guide displays the results much faster than a regular Bible search does, but the following example makes my system hang anywhere  from about 20 seconds to up to 80 seconds.

The word study guide finds all results very quickly, but when I click on the wheel I get the following:

 

 

 

After about 20 to 80 seconds all returns to normal.  The same thing happens to me at times when switching between tabs, but I have not been able to consistently reproduce this.

 

 

After trying several searches. I have founds some common threads. 

1.  This only happens with words that are used over 1000 times in the NT.

2.   And if I click on a part of the circle that is only used a few times it still hangs (so it is not just the time it takes to display the results).

3.  When I go to close the tab of a Bible word study that has a word that is used over 1000 times in the NT it hangs before closing the tab the majority of the time (especially if I have multiple word study tabs open).

Posts 172
Chris Ease | Forum Activity | Replied: Thu, Nov 12 2009 3:31 PM

Richard, how much would that machine set me back, without monitor, mouse, spkrs, and keyboard.  I have hope for a machine like that in the just under $500 category.Big Smile

Posts 5573
Forum MVP
Rich DeRuiter | Forum Activity | Replied: Thu, Nov 12 2009 3:52 PM

Chris:
Richard, how much would that machine set me back, without monitor, mouse, spkrs, and keyboard.  I have hope for a machine like that in the just under $500 category

I bought mine from Dell at the end of June for just under $1500. That included a 22" flat screen (very nice too!) and a Sound Blaster X-Fi Xtreme Audio card (plus the other things I already mentioned). I got the standard keyboard. I may get another one, maybe a bluetooth keyboard & mouse. We'll see.

Logos4 screams with delight on it.

 

 Help links: WIKI;  Logos 6 FAQ. (Phil. 2:14, NIV)

Posts 5573
Forum MVP
Rich DeRuiter | Forum Activity | Replied: Thu, Nov 12 2009 3:57 PM

Thomas Black:
that is a serious machine Rich

I'm Reformed. We're known for being serious. Seriously. My goal: more dour by the hour. Wink

Thanks, though. It took me a while to save for it, but even at $1500 it wasn't that bad. I bought it directly from Dell, where I customized it to my pref's.

 Help links: WIKI;  Logos 6 FAQ. (Phil. 2:14, NIV)

Posts 26962
Forum MVP
Dave Hooton | Forum Activity | Replied: Fri, Nov 13 2009 1:17 AM

Full Test

1. A   <1s    Note: L4 in offline mode for all tests

    B. 2-3s

    C. 1-2s

2. A  L3=6s  L4=4s   Only media used was Bib. People

    B. L3=220s  L4=100s   (it was the first thing I did in L3)

    C. L3=Instant  L4=3s

Dave
===

Windows 10 & Android 8

Posts 26962
Forum MVP
Dave Hooton | Forum Activity | Replied: Fri, Nov 13 2009 1:45 AM

Greg Gray:
but when I click on the wheel I get the following:

I can confirm much the same behaviour. L4 freezes/hangs when I click on the large part of the wheel, using all of 1 core.  Also hangs on small part and hangs on Close of tab!

Dave
===

Windows 10 & Android 8

Posts 97
Greg Gray | Forum Activity | Replied: Fri, Nov 13 2009 12:45 PM

Here is a log file for the bug I detailed above:

7380.Logos4.zip

You can see two hangs - the biggest one being from when I click the "x" to close the Bible word study at  16:22:11 to when the program recovers at 16:23:47.  That is 96 seconds to close a tab.

 

The other is at 16:21:32 until 16:22:11, but again the most significant hang is when I try to close the word study.

Posts 8660
TCBlack | Forum Activity | Replied: Fri, Nov 13 2009 12:58 PM

Richard DeRuiter:
I'm Reformed. We're known for being serious. Seriously. My goal: more dour by the hour. Wink
That just belongs in a tagline or facebook posting or something.  That's funny.

Hmm Sarcasm is my love language. Obviously I love you. 

Posts 5573
Forum MVP
Rich DeRuiter | Forum Activity | Replied: Fri, Nov 13 2009 1:03 PM

Thomas Black:

Richard DeRuiter:
I'm Reformed. We're known for being serious. Seriously. My goal: more dour by the hour. Wink
That just belongs in a tagline or facebook posting or something.  That's funny.

We also have "Reserved" signs on some of our pews. We're not holding them for certain people. It's just an adjective for those who sit there. Wink

(And yes, I'm lying - er - exaggerating a bit.)

 

 Help links: WIKI;  Logos 6 FAQ. (Phil. 2:14, NIV)

Posts 97
Andreas Holmberg | Forum Activity | Replied: Mon, Nov 16 2009 10:17 AM

Hello Greg

Read about your experience. I come across the same problem a lot of the time when using the Bible Word Study. Your findings are most interesting. I'm not sure, but I think I've encountered the same problem even with words used much less than a 1000 times i NT.

I also get the "Logos not responding"-message and then Logos comes back on after a few seconds. However, my experience is that the program as a whole gets more sluggish after one or two of those "mini-crashes". Is that your experience too? I tend to close and restart the whole program in order to recover speed.

Is this a bug? Are you aware of any solution to the problem?

Kindly,

Andreas Holmberg

Pastor in Stockholm, Church of Sweden

Posts 97
Greg Gray | Forum Activity | Replied: Mon, Nov 16 2009 10:56 AM

Is this a bug? Are you aware of any solution to the problem?

To me its a bug - but nobody from logos has ever confirmed this.  

I have tried all I can think of, and nothing has helped - and as you stated - once it happens its seems to get worse (especially with more than one word study guide opened at a time).

 

I have had this happen with words used less than 1000 times as well, but I don't consistently get the "not responding message" unless it is with more frequently used words. 

Posts 386
Clinton Thomas | Forum Activity | Replied: Mon, Nov 16 2009 8:52 PM

1.  Gui speed.

1A lag - 2 Seconds
1B lag - 8-10 seconds
1C lag - 3-4 seconds

 

2.  Search speed.

2A-V4 all) 90 Seconds.
2A-V4 subset) 40 seconds
2A-V3) 25 seconds

B.  Do a library search for the word "God" in both V3 and V4.  

2B-V4) 45 second * 20 pages
My Content - 364 results
New Resources 482 Results
Library Results 1,762,305
2B-V3) - 37 minutes - 850683 found search still progressing, but I had to go have a life for a while.

C.  Using an interlinear with the information tool open, hover over a word.  Record the time taken to display all information in both versions.

2C-V4) 8 seconds
2C-V3) 2 seconds flash with info, <3 seconds all info up.

3.  Obvious bugs

In test 2A-all) I experienced a 10-12 second black screen of near death which was included in the 90 second total.

System Specs

OS Name    Microsoft® Windows Vista™ Ultimate
Version    6.0.6001 Service Pack 1 Build 6001
Other OS Description     Not Available
OS Manufacturer    Microsoft Corporation
System Name    OFFICE-PC
System Manufacturer    Dell Inc.
System Model    Dimension 4700
System Type    X86-based PC
Processor    Intel(R) Pentium(R) 4 CPU 3.00GHz, 2992 Mhz, 1 Core(s), 2 Logical Processor(s)
BIOS Version/Date    Dell Inc. A02, 7/19/2004
SMBIOS Version    2.3
Windows Directory    C:\Windows
System Directory    C:\Windows\system32
Boot Device    \Device\HarddiskVolume2
Locale    United States
Hardware Abstraction Layer    Version = "6.0.6001.18000"
Time Zone    Pacific Daylight Time
Installed Physical Memory (RAM)    4.00 GB
Total Physical Memory    3.00 GB
Available Physical Memory    1.16 GB
Total Virtual Memory    6.23 GB
Available Virtual Memory    4.12 GB
Page File Space    3.29 GB
Page File    C:\pagefile.sys


Video
Name    NVIDIA GeForce 8600 GT
PNP Device ID    PCI\VEN_10DE&DEV_0402&SUBSYS_C7563842&REV_A1\4&10D785AA&0&0008
Adapter Type    GeForce 8600 GT, NVIDIA compatible
Adapter Description    NVIDIA GeForce 8600 GT
Adapter RAM    512.00 MB (536,870,912 bytes)
Installed Drivers    nvd3dum.dll,nvwgf2um.dll
Driver Version    7.15.11.8250
INF File    oem3.inf (nv_G8x section)
Color Planes    Not Available
Color Table Entries    4294967296
Resolution    1680 x 1050 x 59 hertz
Bits/Pixel    32
Memory Address    0xDE000000-0xDEFFFFFF
Memory Address    0xC0000000-0xCFFFFFFF
Memory Address    0xDC000000-0xDFEFFFFF
I/O Port    0x0000DC80-0x0000DCFF
IRQ Channel    IRQ 16
I/O Port    0x000003B0-0x000003BB
I/O Port    0x000003C0-0x000003DF
Memory Address    0xA0000-0xBFFFF
Driver    c:\windows\system32\drivers\nvlddmkm.sys (7.15.11.8250, 7.38 MB (7,738,816 bytes), 3/28/2009 12:03 AM)

Page 1 of 2 (32 items) 1 2 Next > | RSS