Is there a download bandwidth service level agreement with Amazon S3?

Hi Logos,

As Logos 4.5b RC1 becomes available, I wanted to do a complete fresh reinstall of Logos (have not done that for a long time). I have quite a few hours to do the 22.21GB to download; I am doing about 0.5MByte per second (varying in a cyclic function between 0.1 to 0.9 MByte per sec).

Clearly Amazon S3 is throttling the bandwidth, the limitation is unlikely to be at my end as I have a 200mbps fibre ISP plan.

We can give you some ground feedback, if Amazon S3 is not meeting the service level agreement.

Find more posts tagged with

Comments

BillS

Why do you believe Logos depends in any way on Amazon S3? AFAIK, Logos is ISP agnostic, unless you're on an ipad or android tablet...

And if that's the case, aren't you on something other than Logos 4.5b, which is PC/Mac only?

BriM

https://community.logos.com/discussion/comment/362379#Comment_362379

Why do you believe Logos depends in any way on Amazon S3? AFAIK, Logos is ISP agnostic, unless you're on an ipad or android tablet...

I read the question as implying that Logos is hosted on Amazon S3 cloud. It has to be hosted somewhere, so it seems reasonable. But I have no knowledge of that. Perhaps LimJK has some knowledge...

Mike S.

Maybe the better question would be: Is there any kind of SLA/SLG for Logos downloads?

(and yes, they absolutely use amazon s3 for downloads)

BillS

https://community.logos.com/discussion/comment/362391#Comment_362391

Hi Mike,

Did someone from Logos say they were using s3 for downloads? Wouldn't surprise me, but I've frequented the NGs & now the forums for a long while & this is the 1st mention I remember...

Just wondering... not challenging the info. :-)

LimJK

https://community.logos.com/discussion/comment/362441#Comment_362441

Did someone from Logos say they were using s3 for downloads? Wouldn't surprise me, but I've frequented the NGs & now the forums for a long while & this is the 1st mention I remember...

Just wondering... not challenging the info. :-)

Bill,

There are tools to do that [:)] I monitor things that comes in and gets out of my Network at home and my MacBookPro [:)]

DMB

https://community.logos.com/discussion/comment/362441#Comment_362441

The 'forum' never disappoints:

http://community.logos.com/forums/thread/334631.aspx

http://community.logos.com/forums/thread/25131.aspx

BillS

https://community.logos.com/discussion/comment/362480#Comment_362480

Thanks, LimJK & DMB.... I see now...

LimJK, I had wondered if you were using tools...

And DMB, somehow I missed those...

Thanks again, & blessings!

Bradley Grainger (Logos)

We can give you some ground feedback, if Amazon S3 is not meeting the service level agreement.

As far as I know, the S3 SLA only covers service uptime (and durability), not data transfer rate. (Questions asking about bandwidth have gone unanswered.)

Brother Mark

https://community.logos.com/discussion/comment/362577#Comment_362577

We can give you some ground feedback, if Amazon S3 is not meeting the service level agreement.

As far as I know, the S3 SLA only covers service uptime (and durability), not data transfer rate. (Questions asking about bandwidth have gone unanswered.)

For the Acronym challenged, "SLA" is an industry term for Service Level Agreement. Basically, the SLA defines the Who/What/When/How-much of a contract for services.

LimJK

https://community.logos.com/discussion/comment/362577#Comment_362577

As far as I know, the S3 SLA only covers service uptime (and durability), not data transfer rate. (Questions asking about bandwidth have gone unanswered.)

Bradley,

Thanks for the reply.

I was trying to help a Principal of a Bible College here, when his SSD goes dead.

I remember in the past in Libronix + some backup/restore batch files from Dave; the recovery can be done in 15 minutes; really missed that :-(
Now, in Logos 4, a long download followed by a long indexing process, a typical recovery would have to take a day; a significant down time.

May be there is an opportunity here for a local backup/recovery process followed by an shorter online update. Just a thought.

LimJK

https://community.logos.com/discussion/comment/362577#Comment_362577

As far as I know, the S3 SLA only covers service uptime (and durability), not data transfer rate. (Questions asking about bandwidth have gone unanswered.)

Bradley,

I just read the S3 SLA, interesting that they can get by like this?

Imagine one day the data transmission service degrades till we get 1MB data transmission in 1 hr, technically they still meet their SLA requirement between Amazon S3 and Logos. I suppose you have thought through some of the implications and considered the trade-off and have some contingency plans in place.

PS: I will not do the 22GB re-downloading again, just remember that Logos is paying for the data downloaded, sorry.

Bradley Grainger (Logos)

https://community.logos.com/discussion/comment/364711#Comment_364711

May be there is an opportunity here for a local backup/recovery process followed by an shorter online update. Just a thought.

If you copy all your resources to an external HDD, you can restore locally (though it's a bit of a manual process). The first time you run the software and log in, it will download your licenses (this is quick). It will then start downloading; you can right-click the notification area icon and choose Cancel Download. When the software starts, enter "scan E:\Resources" (where E:\ is your external drive).

This avoids the long download, but will still require the indexing.

Alternatively, Logos 4 should be compatible with most regular hard disk backup/restore programs, so we haven't invested the time in implementing local backup/restore functionality when there are several free options available.

Bradley Grainger (Logos)

https://community.logos.com/discussion/comment/364733#Comment_364733

Imagine one day the data transmission service degrades till we get 1MB data transmission in 1 hr, technically they still meet their SLA requirement between Amazon S3 and Logos. I suppose you have thought through some of the implications and considered the trade-off and have some contingency plans in place.

Right now, Amazon S3 is delivering good value for the cost. It would be reasonably trivial for us to host the resource files on our servers again (although this would be much more expensive for us) or to move them to a different cloud storage provider.

PS: I will not do the 22GB re-downloading again, just remember that Logos is paying for the data downloaded, sorry.

We're paying around 9c/GB for data transfer, so just buy something for $2 from logos.com and we'll call it even. [:)]

LimJK

https://community.logos.com/discussion/comment/364834#Comment_364834

Alternatively, Logos 4 should be compatible with most regular hard disk backup/restore programs, so we haven't invested the time in implementing local backup/restore functionality when there are several free options available.

Bradley, Thanks

I clone my MacBookPro using Carbon Copy Cloner about once a month, incremental back up is very fast; 10-20 minutes :-)

I found the information in Wiki helpful

http://wiki.logos.com/Quick_Installation_onto_Multiple_Macs

As we become more dependent on IT tools for our work, is very sad to see that some people are still very ill prepared for things like a dead harddisk and disrupting their work :-(

LimJK

https://community.logos.com/discussion/comment/365023#Comment_365023

Hi all,

Interesting read on Storm Hits Amazon Cloud

http://www.fierceenterprisecommunications.com/story/amazon-web-services-knocked-offline/2012-07-01

http://www.pingzine.com/storm-hits-amazon-cloud-netflix-instagram-pinterest-face-downtime-16504/

As a Logos user, interestingly it did not affect me, probably, I was not using Logos and not downloading anything from Logos when all these happened.

Bradley Grainger (Logos)

https://community.logos.com/discussion/comment/364835#Comment_364835

or to move them to a different cloud storage provider.

We are now serving resource downloads from a new Content Delivery Network; you should see increased download speeds for resources.

We still have some work to do in the Indexer to make better use of available bandwidth; you may see "spikes" in your download bitrate, rather than more consistent throughput. But even with that problem, it should now be quicker to install the library via download.

Bruce Dunning

https://community.logos.com/discussion/comment/541439#Comment_541439

you should see increased download speeds for resources.

Great news!

LimJK

https://community.logos.com/discussion/comment/541439#Comment_541439

We are now serving resource downloads from a new Content Delivery Network; you should see increased download speeds for resources.

We still have some work to do in the Indexer to make better use of available bandwidth; you may see "spikes" in your download bitrate, rather than more consistent throughput. But even with that problem, it should now be quicker to install the library via download.

Bradley

Thanks for the change ... much appreciated.