Is there a download bandwidth service level agreement with Amazon S3?

LimJK
LimJK Member Posts: 1,068 ✭✭
edited November 2024 in English Forum

Hi Logos,

As Logos 4.5b RC1 becomes available, I wanted to do a complete fresh reinstall of Logos (have not done that for a long time).  I have quite a few hours to do the 22.21GB to download; I am doing about 0.5MByte per second (varying in a cyclic function between 0.1 to 0.9 MByte per sec).  

Clearly Amazon S3 is throttling the bandwidth, the limitation is unlikely to be at my end as I have a 200mbps fibre ISP plan.

We can give you some ground feedback, if Amazon S3 is not meeting the service level agreement.  

JK

MacBookPro Retina 15" Late 2013 2.6GHz RAM:16GB SSD:500GB macOS Sierra 10.12.3 | iPhone 7 Plus iOS 10.2.1

Comments

  • BillS
    BillS Member Posts: 3,805 ✭✭✭

    Why do you believe Logos depends in any way on Amazon S3?  AFAIK, Logos is ISP agnostic, unless you're on an ipad or android tablet...

    And if that's the case, aren't you on something other than Logos 4.5b, which is PC/Mac only?

    Grace & Peace,
    Bill


    MSI GF63 8RD, I-7 8850H, 32GB RAM, 1TB SSD, 2TB HDD, NVIDIA GTX 1050Max
    iPhone 12 Pro Max 512Gb
    iPad 9th Gen iOS 15.6, 256GB

  • BriM
    BriM Member Posts: 287 ✭✭

    BillS said:

    Why do you believe Logos depends in any way on Amazon S3?  AFAIK, Logos is ISP agnostic, unless you're on an ipad or android tablet...

    I read the question as implying that Logos is hosted on Amazon S3 cloud. It has to be hosted somewhere, so it seems reasonable. But I have no knowledge of that. Perhaps LimJK has some knowledge...

  • Mike S.
    Mike S. Member Posts: 477 ✭✭

    Maybe the better question would be: Is there any kind of SLA/SLG for Logos downloads?  

    (and yes, they absolutely use amazon s3 for downloads)

  • BillS
    BillS Member Posts: 3,805 ✭✭✭

    Hi Mike,

    Did someone from Logos say they were using s3 for downloads? Wouldn't surprise me, but I've frequented the NGs & now the forums for a long while & this is the 1st mention I remember...

    Just wondering... not challenging the info. :-)

    Grace & Peace,
    Bill


    MSI GF63 8RD, I-7 8850H, 32GB RAM, 1TB SSD, 2TB HDD, NVIDIA GTX 1050Max
    iPhone 12 Pro Max 512Gb
    iPad 9th Gen iOS 15.6, 256GB

  • LimJK
    LimJK Member Posts: 1,068 ✭✭

    BillS said:

    Did someone from Logos say they were using s3 for downloads? Wouldn't surprise me, but I've frequented the NGs & now the forums for a long while & this is the 1st mention I remember...

    Just wondering... not challenging the info. :-)

    Bill,

    There are tools to do that [:)] I monitor things that comes in and gets out of my Network at home and my MacBookPro [:)]

    JK

    MacBookPro Retina 15" Late 2013 2.6GHz RAM:16GB SSD:500GB macOS Sierra 10.12.3 | iPhone 7 Plus iOS 10.2.1

  • DMB
    DMB Member Posts: 14,368 ✭✭✭✭

    "If myth is ideology in narrative form, then scholarship is myth with footnotes." B. Lincolm 1999.

  • BillS
    BillS Member Posts: 3,805 ✭✭✭

    Thanks, LimJK & DMB.... I see now... 

    LimJK, I had wondered if you were using tools...

    And DMB, somehow I missed those...

    Thanks again, & blessings! 

    Grace & Peace,
    Bill


    MSI GF63 8RD, I-7 8850H, 32GB RAM, 1TB SSD, 2TB HDD, NVIDIA GTX 1050Max
    iPhone 12 Pro Max 512Gb
    iPad 9th Gen iOS 15.6, 256GB

  • Bradley Grainger (Logos)
    Bradley Grainger (Logos) Administrator, Logos Employee Posts: 12,120

    LimJK said:

    We can give you some ground feedback, if Amazon S3 is not meeting the service level agreement.  

    As far as I know, the S3 SLA only covers service uptime (and durability), not data transfer rate. (Questions asking about bandwidth have gone unanswered.)

  • Brother Mark
    Brother Mark Member Posts: 945 ✭✭

    LimJK said:

    We can give you some ground feedback, if Amazon S3 is not meeting the service level agreement.  

    As far as I know, the S3 SLA only covers service uptime (and durability), not data transfer rate. (Questions asking about bandwidth have gone unanswered.)

    For the Acronym challenged, "SLA" is an industry term for Service Level Agreement.  Basically, the SLA defines the Who/What/When/How-much of a contract for services.

     

     

    "I read dead people..."

  • LimJK
    LimJK Member Posts: 1,068 ✭✭

    As far as I know, the S3 SLA only covers service uptime (and durability), not data transfer rate. (Questions asking about bandwidth have gone unanswered.)

    Bradley,

    Thanks for the reply. 

    I was trying to help a Principal of a Bible College here, when his SSD goes dead.


    • I remember in the past in Libronix + some backup/restore batch files from Dave; the recovery can be done in 15 minutes; really missed that :-(
    • Now, in Logos 4, a long download followed by a long indexing process, a typical recovery would have to take a day; a significant down time.

    May be there is an opportunity here for a local backup/recovery process followed by an shorter online update. Just a thought.

    JK

    MacBookPro Retina 15" Late 2013 2.6GHz RAM:16GB SSD:500GB macOS Sierra 10.12.3 | iPhone 7 Plus iOS 10.2.1

  • LimJK
    LimJK Member Posts: 1,068 ✭✭

    As far as I know, the S3 SLA only covers service uptime (and durability), not data transfer rate. (Questions asking about bandwidth have gone unanswered.)

    Bradley,

    I just read the S3 SLA, interesting that they can get by like this?  

    Imagine one day the data transmission service degrades till we get 1MB data transmission in 1 hr, technically they still meet their SLA requirement between Amazon S3 and Logos. I suppose you have thought through some of the implications and considered the trade-off and have some contingency plans in place.

    PS: I will not do the 22GB re-downloading again, just remember that Logos is paying for the data downloaded, sorry.

    JK

    MacBookPro Retina 15" Late 2013 2.6GHz RAM:16GB SSD:500GB macOS Sierra 10.12.3 | iPhone 7 Plus iOS 10.2.1

  • Bradley Grainger (Logos)
    Bradley Grainger (Logos) Administrator, Logos Employee Posts: 12,120

    LimJK said:

    May be there is an opportunity here for a local backup/recovery process followed by an shorter online update. Just a thought.

    If you copy all your resources to an external HDD, you can restore locally (though it's a bit of a manual process). The first time you run the software and log in, it will download your licenses (this is quick). It will then start downloading; you can right-click the notification area icon and choose Cancel Download. When the software starts, enter "scan E:\Resources" (where E:\ is your external drive).

    This avoids the long download, but will still require the indexing.

    Alternatively, Logos 4 should be compatible with most regular hard disk backup/restore programs, so we haven't invested the time in implementing local backup/restore functionality when there are several free options available.

  • Bradley Grainger (Logos)
    Bradley Grainger (Logos) Administrator, Logos Employee Posts: 12,120

    LimJK said:

    Imagine one day the data transmission service degrades till we get 1MB data transmission in 1 hr, technically they still meet their SLA requirement between Amazon S3 and Logos. I suppose you have thought through some of the implications and considered the trade-off and have some contingency plans in place.

    Right now, Amazon S3 is delivering good value for the cost. It would be reasonably trivial for us to host the resource files on our servers again (although this would be much more expensive for us) or to move them to a different cloud storage provider.

     

    LimJK said:

    PS: I will not do the 22GB re-downloading again, just remember that Logos is paying for the data downloaded, sorry.

     

    We're paying around 9c/GB for data transfer, so just buy something for $2 from logos.com and we'll call it even. [:)]

  • LimJK
    LimJK Member Posts: 1,068 ✭✭

    Alternatively, Logos 4 should be compatible with most regular hard disk backup/restore programs, so we haven't invested the time in implementing local backup/restore functionality when there are several free options available.

    Bradley, Thanks

    I clone my MacBookPro using Carbon Copy Cloner about once a month, incremental back up is very fast; 10-20 minutes :-)

    I found the information in Wiki helpful

    http://wiki.logos.com/Quick_Installation_onto_Multiple_Macs

    As we become more dependent on IT tools for our work, is very sad to see that some people are still very ill prepared for things like a dead harddisk and disrupting their work :-(

    JK

    MacBookPro Retina 15" Late 2013 2.6GHz RAM:16GB SSD:500GB macOS Sierra 10.12.3 | iPhone 7 Plus iOS 10.2.1

  • LimJK
    LimJK Member Posts: 1,068 ✭✭

    Hi all,

    Interesting read on Storm Hits Amazon Cloud

    http://www.fierceenterprisecommunications.com/story/amazon-web-services-knocked-offline/2012-07-01

    http://www.pingzine.com/storm-hits-amazon-cloud-netflix-instagram-pinterest-face-downtime-16504/

    As a Logos user, interestingly it did not affect me, probably, I was not using Logos and not downloading anything from Logos when all these happened.

    JK

    MacBookPro Retina 15" Late 2013 2.6GHz RAM:16GB SSD:500GB macOS Sierra 10.12.3 | iPhone 7 Plus iOS 10.2.1

  • Bradley Grainger (Logos)
    Bradley Grainger (Logos) Administrator, Logos Employee Posts: 12,120

    or to move them to a different cloud storage provider.

    We are now serving resource downloads from a new Content Delivery Network; you should see increased download speeds for resources.

    We still have some work to do in the Indexer to make better use of available bandwidth; you may see "spikes" in your download bitrate, rather than more consistent throughput. But even with that problem, it should now be quicker to install the library via download.

  • Bruce Dunning
    Bruce Dunning MVP Posts: 11,161

    you should see increased download speeds for resources.

    Great news!

    Using adventure and community to challenge young people to continually say "yes" to God

  • LimJK
    LimJK Member Posts: 1,068 ✭✭

    We are now serving resource downloads from a new Content Delivery Network; you should see increased download speeds for resources.

    We still have some work to do in the Indexer to make better use of available bandwidth; you may see "spikes" in your download bitrate, rather than more consistent throughput. But even with that problem, it should now be quicker to install the library via download.

    Bradley

    Thanks for the change ... much appreciated.

    JK

    MacBookPro Retina 15" Late 2013 2.6GHz RAM:16GB SSD:500GB macOS Sierra 10.12.3 | iPhone 7 Plus iOS 10.2.1