New Backup Server Deployed

Due to excessive downtime from the Atlanta datacenter which provides backup services for our business infrastructure and clients' servers, we have deployed (2) new backup servers; one in the Incero Dallas DC, as well as an off-shore server in Lithuania.  We have finished taking fresh backups of all servers - everything is current as of June 14, 2018, and new data will sync to these new servers daily.  We are once again prepared for any disaster-recovery scenario.


If you have any questions, submit a support ticket or e-mail us. 
 

90-minute downtime on some services

On the evening of May 9, 2018, we were notified that the majority of our services were "down" including some client websites, e-mail, and backup services.  This turned out to be partly true, but more of a false positive as, in an unprecidented incident, all 4 of our main DNS servers were publishing incorrect "records" for a while.  Sites are still recovering, but most customers never felt the impact, due to caching.

Since it will most likely show up on our status page as a marked period of downtime, we felt it was in our best interest to report and document it here.

Apologies for any inconvenience.

Email Software Issue - Database Rollback

Due to an error experienced during a point upgrade to our current mail server software, we had to roll back the database and message store to a version nearly 8 hours old.  If you are missing any messages, please inform all parties to re-send so they appear as new.  If you have removed older messages, they may have returned... please re-delete them.

Issues like these are precisely why we are planning a move to new hosted email provider.  PLEASE contact us using the form here:

https://ruggieroav.com/newemail

...so that we can help you migrate your email for increased reliability and more options in the months to come.

We sincerely apologize for any inconvenience caused.

More infrastructure, software changes

We have made a few more tweaks to our underlying infrastructure, both in hardware and software.  Our main website is now fully SSL compliant, and all customer sites will default to SSL with no extra cost incurred or action needed on the part of the user.  This is due to the continued use of Let's Encrypt SSL and Comodo SSL with all of our services.  Note that part of making our main website fully SSL aware involved removing the live RSS feeds from our home page; they may be added back at a later time, but for now, the links to our site news and service status pages will suffice.


We are still working on creating an end-to-end encrypted EMAIL experience for our users, and our software vendor informs us that the next released update to our mail server software should address some of the security issues, and may even fix a compatibility bug with certain webmail clients, thereby allowing us to standardize on a more robust e-mail client that is accessible on ALL devices, and is even ADA compliant.


Always growing, ever-improving... all for you, our friends and customers.  We appreciate your continued support and do reach out to us if you have any questions or concerns.  https://helpdesk.ruggieroav.net or use our CONTACT form.

Resolved: Network downtime @ LA

Network infrastructure and "Denial of Service" mitigation technology has been upgraded in our Los Angeles DC, and at this time, all sites and services that were down nearly 12 hours ago are now up and running properly.  We are still in communication with our provider to see if we can further protect our servers from such "DDOS" attacks, but they have so far assured us that they can now handle more than twice the amount of traffic as before, both legitimate and not.



As before, if you have any questions or concerns, please let us know. 

Network downtime @ Los Angeles Datacenter

One of the IP addresses associated with some of our clients' websites hosting in our Los Angeles datacenter has been having issues; we don't yet know if it's an outside block or mis-configuration on the datacenter side, but we are currently in touch with them and are investigating.  NOTHING HAS BEEN LOST, and as far as we know, the servers and sites are operating perfectly well behind an ip address that currently cannot be reached.  We will update our customers as soon as we know more.

Thank you for your patience!

Notes on network Downtime / New Secure Access

During the past 2-3 days some of our customers may have been experiencing downtime but we have gone through a process of adding additional server capacity to handle multiple connections and potential denial of service attacks.  In addition, all customer websites, and our webmail client have been re-established on secure connections using https whenever possible.  Lastly we are upgrading our forms processor to account for a recent upgrade to the Google Chrome and Apple Safari web browsers.

Thank you very much for your attention and patience.