Amazing Charts User Board
Most Recent Posts
how to disable chrome browser extensions, windows server domain
by JamesNT
12:21 AM
Ask an Updox Guy
by DoctorMel
11/21/17 09:53 PM
Backup Laptop
by AnneMarie
11/21/17 08:56 PM
An added feature under Harris
by AnneMarie
11/21/17 08:52 PM
Quality Payment Program Year 2: MIPS Highlights
by koby
11/21/17 08:36 AM
Medware
by Tomastoria
11/21/17 04:32 AM
Automated Vital Signs
by AmazingDave
11/20/17 08:23 PM
Upgrade to V9.4.4
by SteveH
11/19/17 07:59 PM
Cancer Registry
by DSimpson
11/19/17 03:27 AM
Censorship
by Bill
11/18/17 07:32 PM
Amazing Utilities
by GoBruins
11/17/17 06:29 PM
Problem with opening an Amazing Chart support ticket
by a_ramiz
11/17/17 03:20 PM
controlled substance electronic prescriptions
by jimmie
11/16/17 09:26 PM
Closing a Practice - Records Retention Question
by DManuele
11/16/17 03:44 PM
not sending Rx's to printer
by koby
11/16/17 01:16 PM
Topic Options
#71534 - 08/14/17 01:21 PM AC Totally Down
DrLee Offline
Member

Registered: 06/15/11
Posts: 217
Is anyone else's AC in the clouds TOTALLY NOT ACCESSIBLE??? We are seeing patients and have NO ACCESS TO CHARTS. AC not responding to our requests. HELP!!!

David Lee, MD
IM
Dallas, TX

Top
#71535 - 08/14/17 01:54 PM Re: AC Totally Down [Re: DrLee]
DrLee Offline
Member

Registered: 06/15/11
Posts: 217
Apparently the hosting company had a power outage. Don't they have backup power??? Still down.

David Lee, MD

Top
#71536 - 08/14/17 02:31 PM Re: AC Totally Down [Re: DrLee]
jimmie Offline
Member

Registered: 10/16/11
Posts: 1400
Loc: Montana
My nurse initially couldn't sign on, I just did, seems to be working now.
_________________________
jimmie
internal medicine
https://twitter.com/jimmie_vanagon

https://jimmievanagon.wordpress.com/about/






Top
#71537 - 08/14/17 02:45 PM Re: AC Totally Down [Re: DrLee]
Bill Offline
Member

Registered: 10/13/07
Posts: 651
Loc: Santa Fe, NM
Yup me too.
Awaiting the long queue at support.
Patients lining up.
Dead in the water .
Bill
_________________________
Bill Leeson, M.D.
Solo Family Medicine
Santa Fe, NM

Top
#71538 - 08/14/17 02:50 PM Re: AC Totally Down [Re: DrLee]
Bill Offline
Member

Registered: 10/13/07
Posts: 651
Loc: Santa Fe, NM
I am number 3 in the chat. I will let you know how it goes.
_________________________
Bill Leeson, M.D.
Solo Family Medicine
Santa Fe, NM

Top
#71539 - 08/14/17 02:50 PM Re: AC Totally Down [Re: DrLee]
Bill Offline
Member

Registered: 10/13/07
Posts: 651
Loc: Santa Fe, NM
http://amazingcharts.com/support/help-me-now/

Then push CHAT and you will be put in the queue
_________________________
Bill Leeson, M.D.
Solo Family Medicine
Santa Fe, NM

Top
#71540 - 08/14/17 03:06 PM Re: AC Totally Down [Re: DrLee]
Bill Offline
Member

Registered: 10/13/07
Posts: 651
Loc: Santa Fe, NM
30 minute wait then 5 minute fix
_________________________
Bill Leeson, M.D.
Solo Family Medicine
Santa Fe, NM

Top
#71541 - 08/14/17 03:15 PM Re: AC Totally Down [Re: DrLee]
DrLee Offline
Member

Registered: 06/15/11
Posts: 217
Ours is back up. When I did the online chat it was 117 minute wait! I'm still concerned the hosting company doesn't have backup power???

David Lee, MD

Top
#71542 - 08/14/17 03:22 PM Re: AC Totally Down [Re: DrLee]
Bill Offline
Member

Registered: 10/13/07
Posts: 651
Loc: Santa Fe, NM
I think each service needs to be restarted manually. The power is ok now.
They should be monitoring this and should restart everyone with a cloud connection without being asked to do so.
_________________________
Bill Leeson, M.D.
Solo Family Medicine
Santa Fe, NM

Top
#71543 - 08/14/17 03:24 PM Re: AC Totally Down [Re: DrLee]
Bill Offline
Member

Registered: 10/13/07
Posts: 651
Loc: Santa Fe, NM
If you never got through to support they must have done exactly what I suggested above. I have been in the cloud for 5 years and this is the first time this has happened.
_________________________
Bill Leeson, M.D.
Solo Family Medicine
Santa Fe, NM

Top
#71545 - 08/14/17 04:18 PM Re: AC Totally Down [Re: DrLee]
Indy Offline
Member

Registered: 06/23/09
Posts: 1710
Loc: Western US
Originally Posted By: DrLee
Ours is back up. When I did the online chat it was 117 minute wait! I'm still concerned the hosting company doesn't have backup power???

David Lee, MD


Don't know where they co-locate, but that is the reason we pay the extra to co-locate in Tier4 (Telco-grade) facilities. multiple separate fiber connections, those semi-size diesel generators, and that gas-turbine engine that spins up in seconds to keep the bus clean while the diesels auto-start. Full equipment redundancy gets expensive as well.
_________________________
Indy
"Boss"

Indy's Blog

www.BestForYourPractice.com
Our Name is Our Creed

Top
#71549 - 08/14/17 04:30 PM Re: AC Totally Down [Re: DrLee]
JBS Online   content
Member

Registered: 09/20/09
Posts: 2483
Loc: Baltimore, MD
Interesting point... so AC's hosted version went down.
Indy, when was the last time your hosted version died for clients?
_________________________
Jon
GI
Baltimore

Reduce needless clicks!

Top
#71551 - 08/14/17 11:23 PM Re: AC Totally Down [Re: DrLee]
jimmie Offline
Member

Registered: 10/16/11
Posts: 1400
Loc: Montana
Just a followup from my earlier message. We had no issues at all today other than for the first five minutes of trying to log in my nurse could not. I believe AC in the cloud is revamping to a newer modern infrastructure. I recieved an email about this on August 8, so I wonder if this may have been part of the issue today.
_________________________
jimmie
internal medicine
https://twitter.com/jimmie_vanagon

https://jimmievanagon.wordpress.com/about/






Top
#71553 - 08/15/17 02:21 PM Re: AC Totally Down [Re: DrLee]
DrLee Offline
Member

Registered: 06/15/11
Posts: 217
AC told me it was a power outage at the hosting site. Sort of scary honestly.

David Lee, MD

Top
#71559 - 08/16/17 01:57 PM Re: AC Totally Down [Re: JBS]
Indy Offline
Member

Registered: 06/23/09
Posts: 1710
Loc: Western US
Originally Posted By: JBS
Interesting point... so AC's hosted version went down.
Indy, when was the last time your hosted version died for clients?


In our seventh year now, we have never had our infrastructure go down.

We spend a significant premium for Tier4 facilities, which means they have redundant power, redundant batteries, redundant fiber connections, redundant on-site power generation.

We regularly upgrade hardware, including firewalls, switches, hosts, network storage, both growing with demand and endeavoring to make our infrastructure resistant to point failures.
_________________________
Indy
"Boss"

Indy's Blog

www.BestForYourPractice.com
Our Name is Our Creed

Top
#71581 - 08/21/17 05:04 PM Re: AC Totally Down [Re: DrLee]
[email protected] Offline
Member

Registered: 04/12/12
Posts: 24
A message from our hosting provider ITelagen:

To our valued Amazing Charts practices,

I am John O’Keefe, the CEO and founder or ITelagen Healthcare. We provide HIPAA secure hosting to over 3,000 providers nationwide including all of Amazing Charts’ hosted clients. As you know, Amazing Charts & ITelagen experienced a significant service outage this week. As CEO of ITelagen, I want to offer a profound apology.
I also want to explain what happened, what we’ve learned, and what we’re going to change. First, you should know that our services are now stable. There has been no data loss and there were no security breaches.

Here’s what we know.

Around 5:30 AM EST on Monday, August 14th, we experienced a significant issue in our VMWare cloud platform that affected 25% of our cloud infrastructure. This affected a significant number of servers in our Nevada datacenter and it prevented delivery of service to our customers. Our internal attempts at intervention were unsuccessful, and we were unable to bring that portion of our cloud infrastructure back online.

By 7 AM EST on that Monday AM, our datacenter team contacted our cloud hardware and software partners EMC and VMWare, which both immediately assigned a Rapid Response Team to address the issue. The next hour was focused on diagnosing if the issue was hardware or software related.

By 8AM EST on that Monday AM, it was determined that the issue was software related with VMWare and that there was no hardware failure and no data loss. The next several hours the Rapid Response Teams worked with the ITelagen datacenter team focusing to restore services for our clients vs. determining the root cause of the issue.
By 12PM EST on Monday, services were restored to approximately 80% of the practices affected with the balance of the 20% being restored by the end of the day. As service was restored to each practice, our system administration team focused on resolving any residual server issues caused by the outage. The final server-related issues were resolved by approximately 6:30 PM EST on Monday.

The Rapid Response Teams then started to focus on the root cause of the issue.

Around 5:30 AM EST on Tuesday, August 15th, the same issue occurred with less severity. This time the Rapid Response Teams and the ITelagen datacenter teams we were able to restore services to 90% of the affected clients by 12PM EST with the balance of the server-related issues resolved by approximately 6:30 PM EST on Tuesday.

During that time on Tuesday the Rapid Response Team from VMWare made some adjustments to the environment which we believe resolved the issue by 9PM EST on Tuesday.

Since that time, through this AM, August 21, 2017, we have been experiencing sporadic and less severe issues that we have been addressing on a case-by-case basis and we have been working with the Rapid Response Team to address them on a case-by-case basis.

What comes next.

As of now, all our services are back online. We now have two tasks ahead of us.

The first task is to complete our RFO (Reason For Outage) analysis to further identify the root causes. We’re working with our vendors to complete this analysis.

Second, we will take the recommendations from this RFO and make any changes necessary to improve our stability and resiliency.

I hope you accept my apology. On behalf of all of us at ITelagen and Amazing Charts, I offer a profound apology. We understand how essential our services are to your practice and the care of your patients. We fully appreciate the breadth of our responsibility. We live and breathe it every day.

I’d appreciate any feedback you can share. Please email [email protected] This mailbox is monitored by ITelagen’s senior management team.

Sincerely,
John O’Keefe
CEO, ITelagen

Top
#71582 - 08/21/17 08:58 PM Re: AC Totally Down [Re: DrLee]
JamesNT Offline
Member

Registered: 12/30/09
Posts: 957
Loc: North Carolina
Switch to Hyper-V. Problem solved.

JamesNT
_________________________
James Summerlin
My personal site: http://www.dataintegrationsolutions.net

Top
#71583 - 08/22/17 03:01 PM Re: AC Totally Down [Re: JamesNT]
DrLee Offline
Member

Registered: 06/15/11
Posts: 217
Hyper-V?

David Lee

Top
#71585 - 08/22/17 08:56 PM Re: AC Totally Down [Re: JamesNT]
Indy Offline
Member

Registered: 06/23/09
Posts: 1710
Loc: Western US
Originally Posted By: JamesNT
Switch to Hyper-V. Problem solved.

JamesNT


Or switch to KVM, or RedHat Virtualization. Same or better performance, 1/3 the price of Hyper-V or 1/10 the price of VMware. Go with the DOMINANT server OS where uptime is measured in years.

James and I choose different tools, though we are brothers.
_________________________
Indy
"Boss"

Indy's Blog

www.BestForYourPractice.com
Our Name is Our Creed

Top
#71586 - 08/22/17 11:33 PM Re: AC Totally Down [Re: DrLee]
Sandeep Offline
G

Registered: 04/14/11
Posts: 2192
Loc: California
Hyper-V comes with Windows server. As far as I know, there's no reduction in licensing costs between hypervisors. Only some cost extra like VMWare or Citrix XenServer.
_________________________
Sandeep Luthra | Sandeep@LTMedical.net
www.LTMedical.net | (888) 285-8812

Top
#71589 - 08/23/17 01:37 PM Re: AC Totally Down [Re: DrLee]
JamesNT Offline
Member

Registered: 12/30/09
Posts: 957
Loc: North Carolina
Indy is quite correct. Whenever you see me and Indy throwing spit balls at each other, just ignore it.

Camaro versus Mustang.

Harley Davidson versus Honda.

One thing we all agree on, and as Sandeep pointed out, there is no cost reduction in hypervisors. Only a potential cost increase. Which is why I still can't believe anyone uses VMWare. The only time I use VMWare is when I need to run legacy stuff such as Windows 2000 Server or Windows NT server or even Windows 95.

JamesNT
_________________________
James Summerlin
My personal site: http://www.dataintegrationsolutions.net

Top

Moderator:  Indy, JBS, Sandeep 
Shout Box

Who's Online
0 registered (), 6 Guests and 18 Spiders online.
Key: Admin, Global Mod, Mod
Top Posters
Bert 11201
JBS 2483
Sandeep 2192
Wendell365 2184
Leslie 2002
ryanjo 1994
Wayne 1889
Steven 1716
Indy 1710
hockeyref 1669
Newest Members
KATHYS, TM Craft, Mr.Updoxer, carolep, RichieB
4409 Registered Users
Forum Stats
4409 Members
16 Forums
7847 Topics
70553 Posts

Max Online: 172 @ 11/06/17 05:20 PM