Search

Search in sorted by
  • Re: Data Center Storage Failure, 11/21

    Vicars, Thank you for your prayers. They are very helpful and appreciated as we push through this event. With respect to local visual copy templates, I'll defer that decision to our products team. I'm primarily responsible for growing the web infrastructure, so my focus will be continuing to improve the performance and availability of data center functions
    Posted to General by Jim Straatman on Sun, Nov 23 2014
  • Re: Data Center Storage Failure, 11/21

    Moving updates to this thread which does not have replies enabled, so status is easier to discover. https://community.logos.com/forums/p/96630/665802.aspx
    Posted to General by Jim Straatman on Sun, Nov 23 2014
  • Data Center Storage Failure, 11/21 (Continued)

    // 12:33 PM PST, 11/27 Email is back online and all data center systems are back in service. // 11:14 AM PST, 11/27 Unspooling email from MXLogic. // 10:51 AM PST, 11/27 Restored databases copied and mounted. Now testing. // 12:50 AM PST, 11/27 The Exchange email server was able to mount the databases, but due to file corruption and quarantine issues
    Posted to General by Jim Straatman on Sun, Nov 23 2014
  • Re: To those unhappy with Logos communication during outage

    Wayne, Thank you for your analysis. We're already discussion many of the points that you raise, and you can expect to see our operational and communication processes improve in time. For now, I'm updating the following thread with progress. https://community.logos.com/forums/p/96616/665726.aspx#665726 Jim
    Posted to General by Jim Straatman on Sun, Nov 23 2014
  • Re: Data Center Storage Failure, 11/21

    Community APIs that support Faithlife.com & groups functionality within various applications has been restored. We're currently working on alternative infrastructure for the commerce engine to get Logos.com, Verbum.com, Noet.com, & Vyrso.com online. The storage rebalance is about 50% complete. We'll continue to migrate core services off the failed storage
    Posted to General by Jim Straatman on Sun, Nov 23 2014
  • Re: Lost most of library on iPhone and ipad

    The mobile apps stream resources from our servers, which are currently experiencing significantly degraded availability. You can follow progress toward resolution at the following thread. https://community.logos.com/forums/t/96616.aspx
    Posted to iPhone/iPad Apps by Jim Straatman on Sun, Nov 23 2014
  • Re: Data Center Storage Failure, 11/21

    All Proclaim databases have migrated to a more stable deployment and are back online. We're currently adding additional web servers to accommodate peak load.
    Posted to General by Jim Straatman on Sat, Nov 22 2014
  • Re: Data Center Storage Failure, 11/21

    Yes, Sean, we'll host it somewhere completely separate from our production infrastructure.
    Posted to General by Jim Straatman on Sat, Nov 22 2014
  • Re: Data Center Storage Failure, 11/21

    Sean, My apologies for my comments regarding Sunday morning and our timezone difference. You are right, we should communicate better when things like this happen. It can be difficult to broadcast information in all the appropriate channels, especially when our attention is focused on resolving the problem. We're currently building a status dashboard
    Posted to General by Jim Straatman on Sat, Nov 22 2014
  • Re: BUG: Logos staff don't know how to use twitter

    I've posted a description of the data center problem here. https://community.logos.com/forums/p/96616/665634.aspx#665634
    Posted to General by Jim Straatman on Sat, Nov 22 2014
  • Re: Proclaim Sync Outage

    I've posted a description of the data center problem here. https://community.logos.com/forums/p/96616/665634.aspx#665634
    Posted to Proclaim: Church Presentation Software by Jim Straatman on Sat, Nov 22 2014
  • Re: Are servers still down?

    I've posted a description of the problem here. https://community.logos.com/forums/p/96616/665634.aspx#665634
    Posted to Logos 6 by Jim Straatman on Sat, Nov 22 2014
  • Re: Logos.com website down?

    I've posted a description of the problem here. https://community.logos.com/forums/p/96616/665634.aspx#665634
    Posted to General by Jim Straatman on Sat, Nov 22 2014
  • Data Center Storage Failure, 11/21

    A storage system that backs many core websites and services started failing at approximately 4:30 PM PST on Friday. The components that failed (hard drives & a RAID controller battery) have been replaced. However Ceph, the distributed object storage technology we use to run databases, application servers, and file storage requires a re-balance to heal
    Posted to General by Jim Straatman on Sat, Nov 22 2014
  • Re: Logos.com website down?

    We're currently experiencing significant performance degradation on a datacenter storage system. Many sites and services including Logos.com are impacted. We've isolated a number of hardware failures and are currently deploying replacement gear. We're hoping to have everything back to stable in the next few hours.
    Posted to General by Jim Straatman on Sat, Nov 22 2014
  • Re: HAS PROCLAIM CRASHED AGAIN

    See the following thread for updates. https://community.logos.com/forums/t/96572.aspx
    Posted to Proclaim: Church Presentation Software by Jim Straatman on Fri, Nov 21 2014
  • Re: Has Logos CRASHED AGAIN

    See the following thread for updates. https://community.logos.com/forums/t/96572.aspx
    Posted to Suggestions by Jim Straatman on Fri, Nov 21 2014
  • Re: PROCLAIM STABILITY ISSUE

    Craig, We've identified a failing object storage device (virtual drive) on a datacenter disk system which may be causing the system degradation. The storage device has been disabled and systems are stabilizing. Please attempt to sync again, and reply with your results.
    Posted to General by Jim Straatman on Fri, Nov 21 2014
  • Re: Has Logos CRASHED AGAIN

    Craig, Thank you for reporting. As I mentioned in the Proclaim thread , w e're experiencing degraded disk system performance resulting in slow or failed access to hard drives that back some production websites and services. We're actively working on the problem and hope to find a resolution soon.
    Posted to Suggestions by Jim Straatman on Fri, Nov 21 2014
  • Re: PROCLAIM STABILITY ISSUE

    Craig, Thank you for reporting. We're experiencing degraded disk system performance resulting in slow or failed access to hard drives that back some production websites and services. We're actively working on the problem and hope to find a resolution soon.
    Posted to General by Jim Straatman on Fri, Nov 21 2014
Page 4 of 4 (80 items) < Previous 1 2 3 4 |