Independent LawnMowing Contractors Of Australia Forum
Results 1 to 7 of 7

Thread: Just In Case You Where Wondering

  1. #1
    Translawner administrator's Avatar
    Join Date
    May 2004
    Location
    Australia
    Posts
    3,820

    Default Just In Case You Where Wondering

    Dear Dean Bartorelli,

    The below email contains information regarding yesterday's service disruption.

    At approximately 2:00PM on Monday, Landscaping works which were being carried out along Hepburn Avenue caused damage to the optical fibre connection which connects Hostaway to QV1 (This is known as the 'Eastern Link'). This is the first network outage that our fibre provider has experienced since the fibre was commissioned in September 2005.

    The network design employed by the optical fibre provider (Silk Telecom) uses a redundant link which is intended to automatically take over network traffic in the event of a failure. Clearly this did not occur. We are sill investigating why our supplier's alternate link (The 'Western Link') failed to provide connectivity after the damage to the fibre on Hebpurn avenue.

    When it became clear that fibre connectivity would not be restored for a considerable period of time, we decided to restore connectivity across our tertiary link, a carrier grade Microwave link between our data centre and the QV1 building.

    Due to differences in the configuration requirements of the fibre versus the microwave connection, this required a member of staff to be despatched to QV1 to remotely reconfigure the connection in conjunction with another technician at the Malaga datacentre.

    Partial connectivity was restored at approximately 5:00PM on our transit link and full connectivity, including WAIX, was achieved at approximately 7:00PM.

    Full connectivity over the fibre link was restored at approximately 9:00AM Tuesday 8th May.

    Please note that any mail sent during the outage yesterday will have been delayed. Depending on the configuration of the sending machine, that delayed mail will most likely have either arrived at our servers last night, or will arrive at some stage this morning. Since the resending schedule is determined by the sending and not the receiving server, we are unfortunately not able to provide a more precise estimate as to when delayed mail will arrive. We expect that by now, most mail should have been delivered.

    We know that for many customers yesterday's outage was a frustrating period, and we sincerely apologise for any inconvenience this outage caused. We are ourselves extremely frustrated that the backup features of the provider we have chosen did not function as they were expected to, and we are committed to ensuring the problems experienced yesterday are not repeated.

    Regards,
    The team at Hostaway

    Please Support The Sponsors www.lawnmowingdirectory.com.au

    As they support this forum




    Carrum downs Dandenong Doveton

  2. #2
    Translawner administrator's Avatar
    Join Date
    May 2004
    Location
    Australia
    Posts
    3,820

    Default Re: Just In Case You Where Wondering

    If you came across a problem with forum yesterday ,
    see below form details from our host .

    Outage Type Unscheduled
    Outage Reason Server Fault (Unscheduled disk redundancy checks)
    Time Tuesday 12/04/2011
    Intermittent timeouts from 9:15AM through 4:30PM
    Services Affected Email - POP3, SMTP, IMAP and Webmail
    Outage Explanation Our mail system runs across two of our newest Intel modular servers. In addition to internal redundancy, these servers are mirrors of each other, so that if one fails the other can take over mail duties.

    The servers run a disk redundancy check on the second Sunday of every month, to ensure that all data is being stored properly and no corruption has occurred. This causes a high load on the disk access but does not cause an issue for our mail servers, as the demand is normally low on a Sunday. Once the disk check starts it is not possible to pause or cancel.

    For some reason unknown to us and the support staff at Intel, both servers ran the disk redundancy check yesterday, which caused an extremely high load on the servers and slowed mail processes down to a crawl.

    At first we believed the problem to lie with a faulty IMAP connection, and we enlisted an outside consultant to help isolate the problem. Although our management system did not show any failed disks we suspected a hardware fault and shifted to the secondary server. Unfortunately the problem persisted and we discovered the unscheduled disk redundancy check running as a background task on both servers.

    We attempted to reduce the load on the mail servers as much as possible, and we were able to provide limited POP and SMTP service. We tried to run IMAP on the Webmail servers however this slowed both services down and eventually crashed the webmail servers.

    We are extremely disappointed with Intel's response and they have yet to explain how this could have occurred. They have recommended we update the server's firmware, as the new version will allow us to schedule the disk redundancy checks ourselves (and run them overnight when disk access demands are at their lowest). We will update the firmware on the secondary server and test this, prior to switching to the primary server and running the update.

    Staff posted updates throughout the day on the HostAway NOC twitter feed - http://www.twitter.com/HostAwayNOC. We are investigating a new notification system to advise customers of these problems in the future.

    We sincerely apologise for the inconvenience this caused you and your business.





    Regards,

    The Team @ HostAway

    Please Support The Sponsors www.lawnmowingdirectory.com.au

    As they support this forum




    Carrum downs Dandenong Doveton

  3. #3
    Senior Member MikeS's Avatar
    Join Date
    Jan 2009
    Location
    Brisbane South Side
    Posts
    174

    Default Re: Just In Case You Where Wondering

    Phew I thought it may have been this old lady again

    http://www.guardian.co.uk/world/2011...uts-web-access

  4. #4
    Senior Member cadase's Avatar
    Join Date
    Sep 2005
    Location
    Alberton SA
    Posts
    1,011

    Default Re: Just In Case You Where Wondering

    Quote Originally Posted by administrator View Post
    Dear Dean Bartorelli,

    The below email contains information regarding yesterday's service disruption.



    Full connectivity over the fibre link was restored at approximately 9:00AM Tuesday 8th May.


    Regards,
    The team at Hostaway
    What year was this ?

  5. #5
    Senior Member Bluey's Avatar
    Join Date
    Jul 2008
    Location
    Adelaide
    Posts
    5,863

    Default Re: Just In Case You Where Wondering

    Sure they weren't hacked by the latest round of Turkish hackers. They have had a red hot go at a few sites I admin lately and managed to compromise a server one of my clients is based on for a short while. Apparently there is another competition on to see how many sites they can hack.
    Cheers

    Bluey
    Adelaide Home & Garden Solutions
    http://www.ahgs.com.au


    "Success occurs when no one is looking, failure occurs when everyone is watching."

  6. #6
    Translawner administrator's Avatar
    Join Date
    May 2004
    Location
    Australia
    Posts
    3,820

    Default Re: Just In Case You Where Wondering

    well i gues it keeps em busy instead of hanging around the streets and stabbing everybody lol

    Please Support The Sponsors www.lawnmowingdirectory.com.au

    As they support this forum




    Carrum downs Dandenong Doveton

  7. #7
    Translawner administrator's Avatar
    Join Date
    May 2004
    Location
    Australia
    Posts
    3,820

    Default Re: Just In Case You Where Wondering

    Quote Originally Posted by MikeS View Post
    Phew I thought it may have been this old lady again

    http://www.guardian.co.uk/world/2011...uts-web-access
    What a sweetie she is she had no idea what www was lol

    Please Support The Sponsors www.lawnmowingdirectory.com.au

    As they support this forum




    Carrum downs Dandenong Doveton

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •