Tuesday, July 17, 2018

Networking issues (Los Angeles) Resolved

Services are currently operational out of Los Angeles data center.  Total downtime, according to our external monitoring service, was 3 hours, 42 minutes, and 4 seconds.

Networking issues (Los Angeles) affecting some customer sites

One of our Los Angeles data centers is having network connectivity issues, and has not failed over to a backup connection as is usually the case.   They are investigating, as are we, and we will update here when we know more.

Only a subset of client sites are currently affected, but we hope all will be online shortly.

Thank you for your patience.

Thursday, June 14, 2018

New Backup Server Deployed

Due to excessive downtime from the Atlanta datacenter which provides backup services for our business infrastructure and clients' servers, we have deployed (2) new backup servers; one in the Incero Dallas DC, as well as an off-shore server in Lithuania.  We have finished taking fresh backups of all servers - everything is current as of June 14, 2018, and new data will sync to these new servers daily.  We are once again prepared for any disaster-recovery scenario.


If you have any questions, submit a support ticket or e-mail us. 
 

Thursday, May 10, 2018

90-minute downtime on some services

On the evening of May 9, 2018, we were notified that the majority of our services were "down" including some client websites, e-mail, and backup services.  This turned out to be partly true, but more of a false positive as, in an unprecidented incident, all 4 of our main DNS servers were publishing incorrect "records" for a while.  Sites are still recovering, but most customers never felt the impact, due to caching.

Since it will most likely show up on our status page as a marked period of downtime, we felt it was in our best interest to report and document it here.

Apologies for any inconvenience.

Monday, April 30, 2018

Email Software Issue - Database Rollback

Due to an error experienced during a point upgrade to our current mail server software, we had to roll back the database and message store to a version nearly 8 hours old.  If you are missing any messages, please inform all parties to re-send so they appear as new.  If you have removed older messages, they may have returned... please re-delete them.

Issues like these are precisely why we are planning a move to new hosted email provider.  PLEASE contact us using the form here:

https://ruggieroav.com/newemail

...so that we can help you migrate your email for increased reliability and more options in the months to come.

We sincerely apologize for any inconvenience caused.

Monday, April 16, 2018

More infrastructure, software changes

We have made a few more tweaks to our underlying infrastructure, both in hardware and software.  Our main website is now fully SSL compliant, and all customer sites will default to SSL with no extra cost incurred or action needed on the part of the user.  This is due to the continued use of Let's Encrypt SSL and Comodo SSL with all of our services.  Note that part of making our main website fully SSL aware involved removing the live RSS feeds from our home page; they may be added back at a later time, but for now, the links to our site news and service status pages will suffice.


We are still working on creating an end-to-end encrypted EMAIL experience for our users, and our software vendor informs us that the next released update to our mail server software should address some of the security issues, and may even fix a compatibility bug with certain webmail clients, thereby allowing us to standardize on a more robust e-mail client that is accessible on ALL devices, and is even ADA compliant.


Always growing, ever-improving... all for you, our friends and customers.  We appreciate your continued support and do reach out to us if you have any questions or concerns.  https://helpdesk.ruggieroav.net or use our CONTACT form.

Monday, March 19, 2018

Resolved: Network downtime @ LA

Network infrastructure and "Denial of Service" mitigation technology has been upgraded in our Los Angeles DC, and at this time, all sites and services that were down nearly 12 hours ago are now up and running properly.  We are still in communication with our provider to see if we can further protect our servers from such "DDOS" attacks, but they have so far assured us that they can now handle more than twice the amount of traffic as before, both legitimate and not.



As before, if you have any questions or concerns, please let us know.