Amazing Charts User Board
Most Recent Posts
IMPORT ITEMS/CATEGORIES
by Bert
Yesterday at 10:03 PM
Billing companies update with AC integration
by kurt
Yesterday at 01:10 AM
AC Amazing Backup Service
by JamesNT
09/22/17 12:36 AM
Endpoint and Firewall Group Buy - Sophos
by Indy
09/22/17 12:12 AM
Harris
by JamesNT
09/21/17 06:23 PM
Installation Problem
by Tomastoria
09/21/17 06:03 PM
Is anyone using patient online appointment self scheduling app?
by lynn
09/21/17 06:44 AM
APP for iPhone - AC OnCall
by Indy
09/18/17 10:44 PM
Editing ICD-10 codes
by Tomastoria
09/17/17 10:22 PM
New Wish List
by Qaiser
09/16/17 05:53 PM
MOC points, Up To Date and Pri-Med
by jimmie
09/16/17 05:12 PM
Dragon Medical One in the Cloud
by jimmie
09/15/17 05:28 PM
CVS no longer active on eprescrition
by Bert
09/14/17 02:26 PM
Still recruiting
by dgrauman
09/12/17 06:51 AM
Employee Staff Personal Use of Office Computers Facebook Cell Phones
by Bert
09/05/17 01:22 AM
Topic Options
#71534 - 08/14/17 01:21 PM AC Totally Down
DrLee Offline
Member

Registered: 06/15/11
Posts: 215
Is anyone else's AC in the clouds TOTALLY NOT ACCESSIBLE??? We are seeing patients and have NO ACCESS TO CHARTS. AC not responding to our requests. HELP!!!

David Lee, MD
IM
Dallas, TX

Top
#71535 - 08/14/17 01:54 PM Re: AC Totally Down [Re: DrLee]
DrLee Offline
Member

Registered: 06/15/11
Posts: 215
Apparently the hosting company had a power outage. Don't they have backup power??? Still down.

David Lee, MD

Top
#71536 - 08/14/17 02:31 PM Re: AC Totally Down [Re: DrLee]
jimmie Offline
Member

Registered: 10/16/11
Posts: 1385
Loc: Montana
My nurse initially couldn't sign on, I just did, seems to be working now.
_________________________
jimmie
internal medicine
https://twitter.com/jimmie_vanagon

https://jimmievanagon.wordpress.com/about/






Top
#71537 - 08/14/17 02:45 PM Re: AC Totally Down [Re: DrLee]
Bill Offline
Member

Registered: 10/13/07
Posts: 649
Loc: Santa Fe, NM
Yup me too.
Awaiting the long queue at support.
Patients lining up.
Dead in the water .
Bill
_________________________
Bill Leeson, M.D.
Solo Family Medicine
Santa Fe, NM

Top
#71538 - 08/14/17 02:50 PM Re: AC Totally Down [Re: DrLee]
Bill Offline
Member

Registered: 10/13/07
Posts: 649
Loc: Santa Fe, NM
I am number 3 in the chat. I will let you know how it goes.
_________________________
Bill Leeson, M.D.
Solo Family Medicine
Santa Fe, NM

Top
#71539 - 08/14/17 02:50 PM Re: AC Totally Down [Re: DrLee]
Bill Offline
Member

Registered: 10/13/07
Posts: 649
Loc: Santa Fe, NM
http://amazingcharts.com/support/help-me-now/

Then push CHAT and you will be put in the queue
_________________________
Bill Leeson, M.D.
Solo Family Medicine
Santa Fe, NM

Top
#71540 - 08/14/17 03:06 PM Re: AC Totally Down [Re: DrLee]
Bill Offline
Member

Registered: 10/13/07
Posts: 649
Loc: Santa Fe, NM
30 minute wait then 5 minute fix
_________________________
Bill Leeson, M.D.
Solo Family Medicine
Santa Fe, NM

Top
#71541 - 08/14/17 03:15 PM Re: AC Totally Down [Re: DrLee]
DrLee Offline
Member

Registered: 06/15/11
Posts: 215
Ours is back up. When I did the online chat it was 117 minute wait! I'm still concerned the hosting company doesn't have backup power???

David Lee, MD

Top
#71542 - 08/14/17 03:22 PM Re: AC Totally Down [Re: DrLee]
Bill Offline
Member

Registered: 10/13/07
Posts: 649
Loc: Santa Fe, NM
I think each service needs to be restarted manually. The power is ok now.
They should be monitoring this and should restart everyone with a cloud connection without being asked to do so.
_________________________
Bill Leeson, M.D.
Solo Family Medicine
Santa Fe, NM

Top
#71543 - 08/14/17 03:24 PM Re: AC Totally Down [Re: DrLee]
Bill Offline
Member

Registered: 10/13/07
Posts: 649
Loc: Santa Fe, NM
If you never got through to support they must have done exactly what I suggested above. I have been in the cloud for 5 years and this is the first time this has happened.
_________________________
Bill Leeson, M.D.
Solo Family Medicine
Santa Fe, NM

Top
#71545 - 08/14/17 04:18 PM Re: AC Totally Down [Re: DrLee]
Indy Offline
Member

Registered: 06/23/09
Posts: 1683
Loc: Western US
Originally Posted By: DrLee
Ours is back up. When I did the online chat it was 117 minute wait! I'm still concerned the hosting company doesn't have backup power???

David Lee, MD


Don't know where they co-locate, but that is the reason we pay the extra to co-locate in Tier4 (Telco-grade) facilities. multiple separate fiber connections, those semi-size diesel generators, and that gas-turbine engine that spins up in seconds to keep the bus clean while the diesels auto-start. Full equipment redundancy gets expensive as well.
_________________________
Indy
"Boss"

Indy's Blog

www.BestForYourPractice.com
Our Name is Our Creed

Top
#71549 - 08/14/17 04:30 PM Re: AC Totally Down [Re: DrLee]
JBS Offline
Member

Registered: 09/20/09
Posts: 2466
Loc: Baltimore, MD
Interesting point... so AC's hosted version went down.
Indy, when was the last time your hosted version died for clients?
_________________________
Jon
GI
Baltimore

Reduce needless clicks!

Top
#71551 - 08/14/17 11:23 PM Re: AC Totally Down [Re: DrLee]
jimmie Offline
Member

Registered: 10/16/11
Posts: 1385
Loc: Montana
Just a followup from my earlier message. We had no issues at all today other than for the first five minutes of trying to log in my nurse could not. I believe AC in the cloud is revamping to a newer modern infrastructure. I recieved an email about this on August 8, so I wonder if this may have been part of the issue today.
_________________________
jimmie
internal medicine
https://twitter.com/jimmie_vanagon

https://jimmievanagon.wordpress.com/about/






Top
#71553 - 08/15/17 02:21 PM Re: AC Totally Down [Re: DrLee]
DrLee Offline
Member

Registered: 06/15/11
Posts: 215
AC told me it was a power outage at the hosting site. Sort of scary honestly.

David Lee, MD

Top
#71559 - 08/16/17 01:57 PM Re: AC Totally Down [Re: JBS]
Indy Offline
Member

Registered: 06/23/09
Posts: 1683
Loc: Western US
Originally Posted By: JBS
Interesting point... so AC's hosted version went down.
Indy, when was the last time your hosted version died for clients?


In our seventh year now, we have never had our infrastructure go down.

We spend a significant premium for Tier4 facilities, which means they have redundant power, redundant batteries, redundant fiber connections, redundant on-site power generation.

We regularly upgrade hardware, including firewalls, switches, hosts, network storage, both growing with demand and endeavoring to make our infrastructure resistant to point failures.
_________________________
Indy
"Boss"

Indy's Blog

www.BestForYourPractice.com
Our Name is Our Creed

Top
#71581 - 08/21/17 05:04 PM Re: AC Totally Down [Re: DrLee]
[email protected] Offline
Member

Registered: 04/12/12
Posts: 24
A message from our hosting provider ITelagen:

To our valued Amazing Charts practices,

I am John O’Keefe, the CEO and founder or ITelagen Healthcare. We provide HIPAA secure hosting to over 3,000 providers nationwide including all of Amazing Charts’ hosted clients. As you know, Amazing Charts & ITelagen experienced a significant service outage this week. As CEO of ITelagen, I want to offer a profound apology.
I also want to explain what happened, what we’ve learned, and what we’re going to change. First, you should know that our services are now stable. There has been no data loss and there were no security breaches.

Here’s what we know.

Around 5:30 AM EST on Monday, August 14th, we experienced a significant issue in our VMWare cloud platform that affected 25% of our cloud infrastructure. This affected a significant number of servers in our Nevada datacenter and it prevented delivery of service to our customers. Our internal attempts at intervention were unsuccessful, and we were unable to bring that portion of our cloud infrastructure back online.

By 7 AM EST on that Monday AM, our datacenter team contacted our cloud hardware and software partners EMC and VMWare, which both immediately assigned a Rapid Response Team to address the issue. The next hour was focused on diagnosing if the issue was hardware or software related.

By 8AM EST on that Monday AM, it was determined that the issue was software related with VMWare and that there was no hardware failure and no data loss. The next several hours the Rapid Response Teams worked with the ITelagen datacenter team focusing to restore services for our clients vs. determining the root cause of the issue.
By 12PM EST on Monday, services were restored to approximately 80% of the practices affected with the balance of the 20% being restored by the end of the day. As service was restored to each practice, our system administration team focused on resolving any residual server issues caused by the outage. The final server-related issues were resolved by approximately 6:30 PM EST on Monday.

The Rapid Response Teams then started to focus on the root cause of the issue.

Around 5:30 AM EST on Tuesday, August 15th, the same issue occurred with less severity. This time the Rapid Response Teams and the ITelagen datacenter teams we were able to restore services to 90% of the affected clients by 12PM EST with the balance of the server-related issues resolved by approximately 6:30 PM EST on Tuesday.

During that time on Tuesday the Rapid Response Team from VMWare made some adjustments to the environment which we believe resolved the issue by 9PM EST on Tuesday.

Since that time, through this AM, August 21, 2017, we have been experiencing sporadic and less severe issues that we have been addressing on a case-by-case basis and we have been working with the Rapid Response Team to address them on a case-by-case basis.

What comes next.

As of now, all our services are back online. We now have two tasks ahead of us.

The first task is to complete our RFO (Reason For Outage) analysis to further identify the root causes. We’re working with our vendors to complete this analysis.

Second, we will take the recommendations from this RFO and make any changes necessary to improve our stability and resiliency.

I hope you accept my apology. On behalf of all of us at ITelagen and Amazing Charts, I offer a profound apology. We understand how essential our services are to your practice and the care of your patients. We fully appreciate the breadth of our responsibility. We live and breathe it every day.

I’d appreciate any feedback you can share. Please email [email protected] This mailbox is monitored by ITelagen’s senior management team.

Sincerely,
John O’Keefe
CEO, ITelagen

Top
#71582 - 08/21/17 08:58 PM Re: AC Totally Down [Re: DrLee]
JamesNT Offline
Member

Registered: 12/30/09
Posts: 946
Loc: North Carolina
Switch to Hyper-V. Problem solved.

JamesNT
_________________________
James Summerlin
My personal site: http://www.dataintegrationsolutions.net

Top
#71583 - 08/22/17 03:01 PM Re: AC Totally Down [Re: JamesNT]
DrLee Offline
Member

Registered: 06/15/11
Posts: 215
Hyper-V?

David Lee

Top
#71585 - 08/22/17 08:56 PM Re: AC Totally Down [Re: JamesNT]
Indy Offline
Member

Registered: 06/23/09
Posts: 1683
Loc: Western US
Originally Posted By: JamesNT
Switch to Hyper-V. Problem solved.

JamesNT


Or switch to KVM, or RedHat Virtualization. Same or better performance, 1/3 the price of Hyper-V or 1/10 the price of VMware. Go with the DOMINANT server OS where uptime is measured in years.

James and I choose different tools, though we are brothers.
_________________________
Indy
"Boss"

Indy's Blog

www.BestForYourPractice.com
Our Name is Our Creed

Top
#71586 - 08/22/17 11:33 PM Re: AC Totally Down [Re: DrLee]
Sandeep Offline
G

Registered: 04/14/11
Posts: 2191
Loc: California
Hyper-V comes with Windows server. As far as I know, there's no reduction in licensing costs between hypervisors. Only some cost extra like VMWare or Citrix XenServer.
_________________________
Sandeep Luthra | Sandeep@LTMedical.net
www.LTMedical.net | (888) 285-8812

Top
#71589 - 08/23/17 01:37 PM Re: AC Totally Down [Re: DrLee]
JamesNT Offline
Member

Registered: 12/30/09
Posts: 946
Loc: North Carolina
Indy is quite correct. Whenever you see me and Indy throwing spit balls at each other, just ignore it.

Camaro versus Mustang.

Harley Davidson versus Honda.

One thing we all agree on, and as Sandeep pointed out, there is no cost reduction in hypervisors. Only a potential cost increase. Which is why I still can't believe anyone uses VMWare. The only time I use VMWare is when I need to run legacy stuff such as Windows 2000 Server or Windows NT server or even Windows 95.

JamesNT
_________________________
James Summerlin
My personal site: http://www.dataintegrationsolutions.net

Top

Moderator:  Indy, JBS, Sandeep 
Shout Box

Who's Online
0 registered (), 13 Guests and 43 Spiders online.
Key: Admin, Global Mod, Mod
Top Posters
Bert 11166
JBS 2466
Sandeep 2191
Wendell365 2177
Leslie 2002
ryanjo 1990
Wayne 1889
Steven 1716
Indy 1683
hockeyref 1669
Newest Members
BeeNP, Reed, vinodb, LIP, SEH
4396 Registered Users
Forum Stats
4396 Members
16 Forums
7801 Topics
70283 Posts

Max Online: 160 @ 10/14/15 08:53 PM