Blades - a suggestion

Logos needs to consider buying a blade farm and figuring out how to multi-thread the indexing process for their customers rather than make the us pay the price...I love Logos 4, but after 14 hours of indexing today, I know there has to be a better way. I feel better now...

Find more posts tagged with

Comments

DominicM

the indexing is all done locally, on your host machine, so the farm in this case would be pointless.

There are definite indexing speed improvements with each version, my indexing originally took 30 hours on this machine, when I installed 4.0d Beta 3 this week it took 14hrs, it may still seem a long time, but its coming down

ALSO: Its not something that happens very often, for those who dont expand the package it should happen only once, depending on your library size you have thousands of titles to process.. its amaing it takes so little time really..

Indexing loves RAM, the more you have the faster it seems to index, at least thats my observation

Bryce Elliott

https://community.logos.com/discussion/comment/137824#Comment_137824

Obviously I understand that the indexing happens locally...hence my post in the 1st place. The point is: why must it happen locally? Why can't it be broken down into parts and done somewhere else then delivered to my machine as a finished product. This problem isn't going to go away. As Logos adds more and more books and people like me buy more and more it will only increase. As to it not happening that often, I understand your point, but when you have a problem like I have and you have to re-index 3 times before things work, you become acutely aware that it is not as well engineered as it needs to be.

Robert Pavich

https://community.logos.com/discussion/comment/137981#Comment_137981

As Logos adds more and more books and people like me buy more and more it will only increase.

Actually I THINK that's just the opposite of what's happening. As Logos improves the books, they are indexing faster each time.

My indexing has went from 7 or 8 hours in the early beta, to about 3 hours now or sometimes less.

I don't think that there is necessarily a "more books=longer indexing" sort of relationship going on.

Marco Warnhoff

https://community.logos.com/discussion/comment/137981#Comment_137981

I might be wrong but isn't the indexing process depending on the kind of resources we have in our individual library. If so then in my understanding it can only be done locally relative to the resources one has. If I am wrong please correct me because I would like to post a recommendation at the Logos uservoice page...

For the rest I fully agree: it is time consuming and boring.

MJ. Smith

https://community.logos.com/discussion/comment/137984#Comment_137984

If so then in my understanding it can only be done locally relative to the resources one has.

I believe that you are correct. When we have more user-created materials, it will become more evident why it is done locally. A central solution would require more network traffic. That is not to say that some mix of the two with a merge couldn't be functional.

David Wilson

https://community.logos.com/discussion/comment/137987#Comment_137987

In theory it would be possible to pre-index all new resources and all collections and bundles remotely (ie: once on a machine at Logos specifically optimized for indexing) and then provide an extra file at the time of download that comprised the index for a new resource / collection / bundle. Then all that would be needed locally would be the capability to merge new indexes with existing ones.

But theory is one thing and that may not be the current nor proposed future design for the software.

To those who have small collections to which they rarely add, and to those with the latest and greatest hardware with i7 processors and 16GB ram and 2TB hard drive arrays this may not been needed at all.

But for those trying to get as many resources as they can onto a netbook or tiny / older laptop it may make a significant difference. Most of us I suspect would rather spend more money on new Logos books than on having to upgrade existing hardware which can cope with everything except frequent re-indexing.......

Dave Hooton

https://community.logos.com/discussion/comment/137981#Comment_137981

but when you have a problem like I have and you have to re-index 3 times before things work, you become acutely aware that it is not as well engineered as it needs to be.

What was the problem and did you seek help for it?

What are the specs of your machine?

Mike S.

The sheer number of possible indexes would prohibit that approach, but what could be interesting (at least for new customers) would be a set of indexes for each "out of the box" collection. Of course, the minute you add a single resource, you enter back into index merging, and it wouldn't work for "upgrades" of existing libraries, nor would it work for features that need to change the structure of an index and rebuild it, let alone table structure.

George Somsel

https://community.logos.com/discussion/comment/138135#Comment_138135

but when you have a problem like I have and you have to re-index 3 times before things work, you become acutely aware that it is not as well engineered as it needs to be.

What was the problem and did you seek help for it?

What are the specs of your machine?

Are you using the MAC version? After the initial period when the product was still in development (Yes, I know that it is still in development -- they haven't fixed notes and the morph search stinks), I haven't experienced any excessive indexing of the PC version.

MJ. Smith

https://community.logos.com/discussion/comment/138209#Comment_138209

the morph search stinks

What hardware do you have? Mine doesn't have an olfactory mode.[:'(]

Todd Phillips

https://community.logos.com/discussion/comment/137984#Comment_137984

For the rest I fully agree: it is time consuming and boring.

Boring? That's the first time I've heard that complaint. You are aware that you can do other things while it indexes? Your attention isn't required. [;)]

George Somsel

https://community.logos.com/discussion/comment/138277#Comment_138277

the morph search stinks

What hardware do you have? Mine doesn't have an olfactory mode.

My condolences. [:D]

Marco Warnhoff

https://community.logos.com/discussion/comment/138279#Comment_138279

You are right. The real cause for this tediousness is my computer. The machine is slow of itself - but when the indexing starts its time for a coffee and lunch and dinner and...[+o(]

George Somsel

Logos needs to consider buying a blade farm and figuring out how to multi-thread the indexing process for their customers rather than make the us pay the price...I love Logos 4, but after 14 hours of indexing today, I know there has to be a better way. I feel better now...

I've hesitated to comment on this and thus reveal my ignorance, but what precisely is a "blade farm"? Is this where they produce knives or is it a wind farm with all of those whirling turbines?

JimTowler

https://community.logos.com/discussion/comment/138480#Comment_138480

what precisely is a "blade farm"?

Simple answer: A whole bunch of computers/servers!

So, the suggestion is that Logos use a pile of powerful servers to pre-index for us.

(Its a great idea for a Box-Set DVD for a fresh install, where the set of resources is fixed. Sadly, it fails when everyone has different resources and no two of us are the same. For me, I would hate it if Logos could reindex my resources in 5 minutes, but if I then needed to download the 2 GB resulting index [:)])