Showing posts with label ecri institute. Show all posts
Showing posts with label ecri institute. Show all posts

Monday, March 16, 2015

An ironically titled session by ECRI Institute: "Would You Bet Your Mother's Life on the Safety of Your EHR?"

An ironically titled session by ECRI Institute "Would You Bet Your Mother's Life on the Safety of Your EHR?" is being held at the annual Health Information Management Systems Society (HIMSS) meeting by Ronni Solomon, JD and William Marella, MBA of the ECRI Institute on April 13, 2015 (http://www.himssconference.org/event.aspx?ItemNumber=36765).

It is announced in the HIMSS press release below in Healthcare IT News.

I should probably be the keynote speaker to that session, as I am suitably qualified to speak of that exact issue.  My mother and I lost such a "bet" (http://hcrenewal.blogspot.com/2013/09/on-ehr-warnings-sure-experts-think-you.html).

It's about time these topics were surfaced, but I still feel there is far too little public awareness of the risks of bad health IT.

http://www.healthcareitnews.com/news/ridding-ehrs-dangerous-often-undetectable-bad-data 
Ridding EHRs of dangerous, often undetectable, bad data
March 13, 2015
As the healthcare industry continues toward its goal of making all patient health records electronically accessible, a health system’s safety increasingly is determined by the quality of its EHR implementation.


Last November ECRI Institute, a non-profit organization that uses scientific methods to test medical products, rated “incorrect or missing data in electronic health records and other health IT systems” as the No. 2 hazard that will put patients at risk in 2015.

“Once inaccurate data gets into the electronic health record, it’s hard to get it out,” said Ronni Solomon, executive vice president and general counsel for ECRI Institute. “That’s a challenge, and the less detectable it is, the higher the risk. You don’t know it’s in there.”

Such incorrect information probably has far more impact than it did on paper, I believe; computer output is often uncritically taken as gospel, and is often cut-and-pasted to newer records without patient interaction, thus propagating an error of omission, commission or data loss or corruption (due to malfunction).

The negative impact of bad data in electronic health records is both immediate and long-lasting. “In the short-run, bad data in the system limits the effectiveness of clinical communications and the effectiveness of decision support,” added William Marella, ECRI’s executive director, PSO operations and analytics. “And basically it undermines people’s confidence in the system.”

Especially the clinicians' confidence, which is already low (e.g., see my Jan. 28, 2015 post "Multiple medical specialty societies now go on record about hazards of EHR misdirection, mismanagement and sloppy hospital computing" at http://hcrenewal.blogspot.com/2015/01/meaningful-use-not-so-meaningul.html).

Solomon and Marella will conduct an educational session at HIMSS15 in April on how healthcare organizations can apply safety science to IT and informatics to improve patient safety.

The first step they can take is to strip control of critical health IT decisions from the business-IT personnel and put heath IT under the aegis of medical leadership, especially medical leadership that contains formally-educated Medical Informatics and related professionals.  (This admittedly and unfortunately has a very low chance of happening due to hospital politics and power structures.)

“Would You Bet Your Mother's Life on the Safety of Your EHR?” is designed to help attendees create a framework for planning and implementing IT strategies, processes and tools to increase the safety of healthcare patients.

Both Ms. Solomon and Mr. Marella are aware of what happened to my mother.  I wonder out loud if the title is based on, at least in part, that incident.

... “The promise of these systems is that they’re going to make the health care system more efficient and ultimately more safe,” Marella said. “Now the administrators in hospitals and health systems that have financed these systems want a return on their investment.”


Perhaps the administrators should have done due diligence on the realities of this technology before investing the money.

The session will cover how organizations can: establish an infrastructure for identifying and responding to patient safety problems; assess safety challenges facing health IT users and implementers; identify partnerships that can accelerate safety improvements; and analyze opportunities to use informatics to prevent adverse events.


“What we’re trying to do in this talk is get in front of the IT leaders of these institutions and help them understand where patient safety people are coming from and how we can bridge these two silos within the health system, because they will both be more effective working together,” Marella said.

I add that all of these goals should have been met prior to a national rollout and, at each organization, prior to subjecting patients to these technologies, but I speak common sense, which in medicine is no longer common.  Thus, sessions like this one in 2015.



Perhaps this could be the theme poster for the session.


-- SS

Sunday, April 27, 2014

In ECRI Institute's new 2014 "Top 10 Patient Safety Concerns for Healthcare Organizations", Healthcare IT is #1. (FDA: E-cigarettes are REALLY dangerous.)

The ECRI Institute in Pennsylvania (https://www.ecri.org/About/Pages/default.aspx) has had health IT as among the "Top Ten Healthcare Technology Risks" for several years running.  Search this blog on "ECRI" for mention of those reports.

Just off the press, though, is ECRI's "Top Ten patient safety concerns for 2014".  The PDF report is available at https://www.ecri.org/EmailResources/PSRQ/Top10/Top10PSRQ.pdf.

Health IT is number one, perhaps as a result of the ECRI Deep Dive study of Health IT risk with its hair-raising numbers of 171 "IT incidents", 8 resultant injuries, and 3 possible deaths in 36 hospitals in just 9 weeks (http://hcrenewal.blogspot.com/2013/02/peering-underneath-icebergs-water-level.html).

From the new report:

CONCERN #1: Data integrity failures with health information technology systems

At page 7:


With the federal government offering financial incentives for hospitals and physician practices to adopt EHR systems, use of these systems more than tripled from 2009 through 2012. “Health IT systems are very complex,” says James P. Keller, M.S., vice president, technology evaluation and safety, ECRI Institute. “They are managing a lot of information, and it’s easy to get something wrong” if the systems are not designed and implemented well. While appropriately designed and implemented systems can provide complete, current, and accurate patient care information so that the clinician can make appropriate treatment decisions, the presence of incorrect data can lead to incorrect treatment, potentially leading to patient harm.

For example, the integrity of data in health IT systems can be compromised from any of the following: data entry errors, missing data or delayed data delivery, inappropriate use of default values, copying and pasting older information into a new report, use of both paper and electronic systems for patient care, and patient/data association errors (i.e., patient data from a medical device is mistakenly associated with another patient’s record). Key steps in safeguarding the integrity of electronic patient data include the following:


Assessing the clinical workflow to understand how the data is, or will be, used by frontline staff 
Testing the system and the associated interfaces, preferably in a simulated setting, to verify that the system is functioning as intended
Providing sufficient user training and support
Establishing a mechanism for users to report problems as they are discovered


In the Bizarro world in which we find ourselves in 2014, however:

  • FDA has decided that healthcare information technology systems "for health information and data management" (I quote) are of "sufficiently low risk", even if they "meet the statutory requirements as medical devices" and thus fall under the Food, Drug & Cosmetic Act, to not require FDA oversight, and even though FDA admits they really do not and cannot know the true level of risks (http://hcrenewal.blogspot.com/2014/04/fda-on-health-it-risk-reckless-or.html). 
(Got that?)

While:
The E-cigarette focus is For The Children, no doubt.


Bizarro World (http://en.wikipedia.org/wiki/Bizarro_World).


Note that ECRI Concerns #2 and #3 also may involve electronic medical records systems.

CONCERN #2: Poor Care Coordination with Patient’s Next Level of Care (page 8):

... Electronic health records (EHRs) can facilitate communication about a patient’s care among providers, but organizations must establish procedures that address accessing, reviewing, and acting on the findings in those records. For example, what happens if a provider who is viewing a patient’s record discovers that results of tests ordered by another provider have not been acted upon? EHRs could become a barrier “if physicians are second-guessing one another,” says Possanza. Organizations might find it helpful to develop a policy specifying procedures for a provider who finds an abnormal laboratory or pathology result with no indication that the abnormal result was acted upon.

CONCERN #3: Test Results Reporting Errors (page 10):

... Callahan observes that breakdowns in test results reporting, particularly in physician practices, typically have one of three causes or a combination of them: (1) technology limitations, such as an inadequate interface between an EHR system and a laboratory system that provides the results electronically; (2) provider-to-provider communication gaps, such as those that occur when no backup plan is in place to designate a provider to review test results for another provider who is unavailable or on vacation; and (3) staffing and training failures, such as requiring a staff member to periodically check an EHR system for test results but not informing the person of what to expect in terms of the volume of test results typically reported to the practice.

As more healthcare organizations adopt EHR systems, Callahan warns against being lulled into thinking the systems are a panacea and can prevent test reporting failures. “It’s another tool,” she says. “It won’t improve test results reporting if it’s not used correctly.”

I was involved as consultant in a related scenario, in a case that settled out of court, where an ordered lab test was never performed (probably due to an EHR-lab interface failure!) and automatically "expired" in the EHR after a year.  However, no subsequent provider acted upon the expired order, with disastrous results.

-- SS

Saturday, November 09, 2013

"We’ve resolved 6,036 issues and have 3,517 open issues": Extolling EPIC EHR Virtues at University of Arizona Health System

The public may believe that, in healthcare, only the Obamacare insurance exchange website has lots of bugs.  On those, see my Oct. 10. 2013 post "Drudge Report, Oct. 10, 2013, 9 AM EST: All that needs to be said about government, computing and healthcare" at http://hcrenewal.blogspot.com/2013/10/drudge-report-oct-10-2013-9-am-est-all.html.

Another pillar of the Affordable Care Act, electronic medical records (promoted with incentives for adopters and with penalties for non-adopters via the HITECH section of the 2009 economic recovery act or ARRA) are pretty damn bad themselves.  Only, those systems don't make it hard to find insurance.  Through bugs and other features of bad health IT, they directly interfere with safety and provision of quality care:

Bad Health IT ("BHIT") is ill-suited to purpose, hard to use, unreliable, loses data or provides incorrect data, is difficult and/or prohibitively expensive to customize to the needs of different medical specialists and subspecialists, causes cognitive overload, slows rather than facilitates users, lacks appropriate alerts, creates the need for hypervigilance (i.e., towards avoiding IT-related mishaps) that increases stress, is lacking in security, compromises patient privacy or otherwise demonstrates suboptimal design and/or implementation. 

At my Oct. 20, 2010 post "Medical center has more than 6000 'issues' with Cerner CPOE system in four months - has patient harm resulted?" (http://hcrenewal.blogspot.com/2010/10/medical-center-has-more-than-6000.html) I observed:

From the October 2010 "News for Physicians affiliated with Munson Medical Center" newsletter, a large medical center in Northern Michigan, about more than six thousand "issues" with their Cerner CPOE.

... One wonders how many of those 6,000, and how many of the 600 remaining "issues" fall into categories of "likely to cause patient harm in short term if uncorrected" or "may cause in patient harm in medium or long term."

I note that Cerner CPOE is not a new product, nor are similar products from other vendors also afflicted with long lists of "issues." That there could be more than 6,000 "issues" at a new site suggests deep rooted, severe problems with CPOE specifically and health IT design and implementation processes in general.

Here's another such multi-"issue"-laden EHR, this at University of Arizona Health Network.  Image of frequent periodic "EHR Update" below.



"We’ve resolved 6,036 issues and have 3,517 open issues."

[Ignore the 'kewl dark sunglasses' worn by the hipsters at the top of this announcement.  Not sure if this has something to do with EPIC, but I consider the wearing of dark sunglasses by clinicians or any other staff in a hospital setting - where people are sick and/or dying - to be in exceptionally bad taste.]

The text starts:

ISSUES UPDATE as of 4:00 p.m., Nov. 8
We’ve resolved 6,036 issues and have 3,517 open issues.

That's a total of nearly ten thousand "issues."  As of now, that is.  "Issue" is a euphemism for "glitch" a.k.a. "software defect" and/or "implementation error", see http://hcrenewal.blogspot.com/search/label/glitch.

These "issues" are  in a supposedly "mature" product for which this organization has spent enormous sums of money, that has undergone "innovation" for several decades now - in an environment free from regulation, I might add.

Many of the "issues" reduce patient safety, and could or already may have resulted in patient harm.  Such items on this listing, seen below, which is updated frequently, include:
  • Pharmacy Medication Mapping Errors – Making good progress: watch for further notices.  [Perhaps these should have been tested and fixed before go-live? - ed.]
  • Microbiology Results Mapping Incorrectly [does that mean "mapping" to the wrong patient? - ed.]  – all known errors fixed, monitoring and working on enhancements. [As above, perhaps these should have been tested and fixed before go-live? - ed.]
  • Prescription printing - output for prescription printing has been fixed
  • Refill requests for providers will be routed to the CLIN SUPPORT In Basket pool for the provider’s department.  This was a decision made by UAHN leadership. [Not sure why this is being done; perhaps for approval by managers? - ed.] 
  • Errors transmitting prescriptions will also be sent to the CLIN SUPPORT In Basket.  [Errors transmitting prescriptions? That's not reassuring regarding data integrity.  See ECRI report below  - ed.]

This is not to mention that all of the "reminders" that follow are a distraction to clinical personnel, who cannot be expected to remember all of them.

Bad as this is, at my April 1, 2012 post "University of Arizona Medical Center, $10 million in the red in operations, to spend $100M on new EHR system" (http://hcrenewal.blogspot.com/2012/04/university-of-arizona-medical-center-10.html) I observed that:

... $100 million+ is probably enough to pay for AN ENTIRE NEW HOSPITAL or hospital wing ... or a lot of human medical records professionals.

To add more bitter icing to this cake, I wrote about a campaign for clinicians to speak only in wonderful terms about the new U. Arizona Health System EHR at my Oct. 3, 2013 post "Words that Work: Singing Only Positive - And Often Unsubstantiated - EHR Praise As 'Advised' At The University Of Arizona Health Network."  I observed the following about the "words that work" is the shameless 'suggested' script:

Efficient - see aforementioned links as well as "Common Examples of Healthcare IT Difficulties" at http://cci.drexel.edu/faculty/ssilverstein/cases/

Convenient - as above.  According to whom?  Compared to what?  Pen and paper?

Improves patient safety and quality - see IOM report post at http://hcrenewal.blogspot.com/2011/11/iom-report-on-health-it-safety-nix-fda.html .  We as a nation are only now studying safety of this technology, and the results are not looking entirely convincing, e.g. ECRI Deep Dive Study of health IT safety at http://hcrenewal.blogspot.com/2013/02/peering-underneath-icebergs-water-level.html.  171 health IT mishaps in 36 hospitals, voluntarily reported over 9 weeks, with 8 reported injuries and 3 reported possible deaths is not what I would call something that "improves patient safety and quality" without qualifications.

The Cadillac of its kind - according to whom?

Patients at hospitals using this system love it -  Do most patients even know what it, or any EHR, looks like?  Have they provided informed consent to its use?

Exciting - clinician surveys such as by physicians at http://hcrenewal.blogspot.com/2010/01/honest-physician-survey-on-ehrs.html and by nurses at http://hcrenewal.blogspot.com/2013/07/candid-nurse-opinions-on-ehrs-at.html shed doubt on that assertion.

The best thing for our patients - again, according to whom?

Sophisticated new system - "New"?  Not so much, just new for U. Arizona Health.  "Sophisticated", as if that's a virtue?  Too much "sophistication" is in part what causes clinician stress and burnout, raising risk

Considering the near 10,000 issues, the new ECRI Institute report "Top Ten Technology Hazards in Healthcare", 2014 edition comes to mind (https://www.ecri.org/Press/Pages/2014_Top_Ten_Hazards.aspx).  Named in that report, as has been the case for the past several years, is healthcare IT. 

This year's problem description is:

#4. Data Integrity Failures in EHRs and other Health IT Systems

"Data integrity failures" include "issues" (per the bad health IT description) such as: data loss, data corruption, data attributed to the wrong patient, etc.

ECRI Institute, a nonprofit organization, dedicates itself to bringing the discipline of applied scientific research to healthcare to discover which medical procedures, devices, drugs, and processes are best to enable improved patient care. As pioneers in this science for 45 years, ECRI Institute marries experience and independence with the objectivity of evidence-based research. Strict conflict-of-interest guidelines ensure objectivity. ECRI Institute is designated an Evidence-based Practice Center by the U.S. Agency for Healthcare Research and Quality. ECRI Institute PSO is listed as a federally certified Patient Safety Organization by the U.S. Department of Health and Human Services. For more information, visit www.ecri.org.

ECRI also produced the 2012 Deep Dive Study of Health IT Risk (http://hcrenewal.blogspot.com/2013/02/peering-underneath-icebergs-water-level.html), where in a volunteer study at 36 member PSO hospitals, 171 health IT "mishaps" were reported in just 9 weeks, 8 of which caused patient injury and 3 of which may have contribute to patient death.

In summary, The University of Arizona Health System, with components in the red, is spending hundreds of millions of dollars on an EHR system, that has had decades to mature. Yet, they are finding 10,000 "issues" already, a number of which reduce patient safety and are unresolved, with many more likely to be found.

They are also 'advising' their staff to speak in glowing, unsubstantiated terms to patients about an EHR system that has 10,000 issues, and not seeking patient consent to its use in mediating and regulating their care - or giving elective patients the information that might allow them to choose another less "buggy" hospital.

If (when) patient harm results from such cavalier hospital (mis)management, the juries are going to just love the dark sunglasses, I bet.

-- SS

Friday, July 05, 2013

More Perversity on Health IT Risks, and ... EHR Sense from Nurses on "Nurse Talk", a Syndicated Radio Show

As I mentioned on July 2 at this post, in a June 25, 2013 Bloomberg News article "Digital Health Records’ Risks Emerge as Deaths Blamed on Systems" by technology reporter Jordan Robertson an EHR-harms case in which I am (unfortunately) intimately involved as substitute plaintiff is mentioned: that of the death of my mother.

I'd previously written about EHR-related electronic encounters with truly perverse individuals at my Jan. 2010 post "More on Perversity in the Healthcare IT World: Is Meditech Employing Sockpuppets?" at http://hcrenewal.blogspot.com/2010/01/more-on-perversity-in-hit-world.html.

There were quite a few thoughtful comments in the reader comments of the June 25, 2013 Bloomberg article, but also the typical callous, incompetent and/or bizarre comments that an anonymous forum invites (really, semi-anonymous, as the website tracks IP's of commenters).  The anonymous comment below stood out from the rest as a worst-case example of perverse defense of health IT (it may have been removed by now):

Pharm Aid 1 week ago

I'm surprised at the poor quality of reporting in this article. 

First, Scot Silverstein has been on jihad against electronic medical records LONG before his dear mother passed away in 2011.  According to Silverstein's own website, he opposed EMRs back as far as 2009.

Second, the article fails to mention Silverstein's conflict of interest here - he works in this space.  Essentially, Silverstein contacts a vendor of EMRs, offers his "consulting" services.  This totally smacks of a shakedown to me.  If they don't hire him, he criticizes them and claims they are killing people.  Don't take my word for it, check out his website and blog.

Third, the number of medical errors from paper-based records is staggering.  According to a study from 7 years ago, a staggering number - 23% - of patients at one health system had medication errors attributed to illegible paper-based charts.  This is roughly consistent with other studies, including the epic IOM report on errors in medicine.

Let me point out the perversities.  I am assuming the comment was not simply deliberately false character assassination and that the writer believed what he/she was writing - which if not, would show the industry's cheerleaders in an even worse light than if the assumption is the poster believes what he/she wrote:

  • No expression of sympathy or remorse at my mother's death, whatever the cause.
  • Gross and almost humorously silly caricature of my "consulting" (which is as expert witness) and defamatory comments.
  • A mysterious invocation of some unnamed article on paper records at one health system.   I note that N=1 for both the mysterious unnamed study and its subject institution, representing the absolute worst regarding drawing conclusions, especially conclusions that we need to spend hundreds of billions of healthcare dollars on what today is largely bad health IT (see definitions of good and bad health IT at the aforementioned Drexel site).
... Among the problems that commonly occur during the course of providing health care are adverse drug events and improper transfusions, surgical injuries and wrong-site surgery, suicides, restraint-related injuries or death, falls, burns, pressure ulcers, and mistaken patient identities.
  •  As to "[my] claims that EHRs are [injuring and] killing people", I merely report what others find - that still others deliberately dismiss (e.g., as "anecdotal") - or ignore. Just the latest example is the ECRI Deep Dive study (http://hcrenewal.blogspot.com/2013/02/peering-underneath-icebergs-water-level.html).  171 health information technology-related problems voluntarily reported during a nine-week period to the ECRI Institute PSO from just 36 hospitalsEight of the incidents reported involved patient harm, and three may have contributed to patient deaths, said the institute.  Other examples appear at HC Renewal.

In summary, there is someone out there who reads Bloomberg and who either 1) supports health IT, but lacks empathy, lacks judgment, and lacks scientific and critical thinking skills or 2) is simply a confabulator and liar.

Perversity regarding health IT needs sunlight - lots of it.

-----------------------

Here's some of that sunlight in a talk program on "Nurse Talk", a nationally syndicated radio show by and for nurses.

Nurse Talk is heard on the air in major metropolitan areas on both the West and East Coasts, and worldwide on the Internet, and has partnerships with the largest groups of nurses in the country.

Listen to the July 3, 2013 program "RNs DeAnn McEwen and Michelle Mahon on Electronic Medical Records" at http://nursetalksite.com/2013/07/03/rns-deann-mcewen-and-michelle-mahon/.

-- SS

Tuesday, July 02, 2013

Is ONC's definition of "Significant EHR Risk" when body bags start to accumulate on the steps of the Capitol?

In a June 25, 2013 Bloomberg News article "Digital Health Records’ Risks Emerge as Deaths Blamed on Systems" by technology reporter Jordan Robertson (http://go.bloomberg.com/tech-blog/author/jrobertson40/),  Mr. Robertson wrote:

... “So far, the evidence we have doesn’t suggest that health information technology is a significant factor in safety events,” said Jodi Daniel (http://www.healthit.gov/newsroom/jodi-daniel-jd-mph), director of ONC’s office of policy and planning. “That said, we’re very interested in understanding where there may be a correlation and how to mitigate risks that do occur.”

In my opinion this statement represents gross negligence by a government official.  Ms. Daniel is unarguably working for a government agency pushing this technology.   She makes the claim that "so far the evidence we have doesn't suggest significant risk" while surely being aware (or having the fiduciary responsibility to be aware) of the impediments to having such evidence.

From my March 2012 post "Doctors and EHRs: Reframing the 'Modernists v. Luddites' Canard to The Accurate 'Ardent Technophiles vs. Pragmatists' Reality" at http://hcrenewal.blogspot.com/2012/03/doctors-and-ehrs-reframing-modernists-v.html  (yes, this was more than a year ago):

... The Institute of Medicine of the National Academies noted this in their late 2011 study on EHR safety:


... While some studies suggest improvements in patient safety can be made, others have found no effect. Instances of health IT–associated harm have been reported. However, little published evidence could be found quantifying the magnitude of the risk.

Several reasons health IT–related safety data are lacking include the absence of measures and a central repository (or linkages among decentralized repositories) to collect, analyze, and act on information related to safety of this technology. Another impediment to gathering safety data is contractual barriers (e.g., nondisclosure, confidentiality clauses) that can prevent users from sharing information about health IT–related adverse events. These barriers limit users’ abilities to share knowledge of risk-prone user interfaces, for instance through screenshots and descriptions of potentially unsafe processes. In addition, some vendors include language in their sales contracts and escape responsibility for errors or defects in their software (i.e., “hold harmless clauses”). The committee believes these types of contractual restrictions limit transparency, which significantly contributes to the gaps in knowledge of health IT–related patient safety risks. These barriers to generating evidence pose unacceptable risks to safety.[IOM (Institute of Medicine). 2012. Health IT and Patient Safety: Building Safer Systems for Better Care (PDF). Washington, DC: The National Academies Press, pg. S-2.]

Also in the IOM report:

… “For example, the number of patients who receive the correct medication in hospitals increases when these hospitals implement well-planned, robust computerized prescribing mechanisms and use barcoding systems. But even in these instances, the ability to generalize the results across the health care system may be limited. For other products— including electronic health records, which are being employed with more and more frequency— some studies find improvements in patient safety, while other studies find no effect.

More worrisome, some case reports suggest that poorly designed health IT can create new hazards in the already complex delivery of care. Although the magnitude of the risk associated with health IT is not known, some examples illustrate the concerns. Dosing errors, failure to detect life-threatening illnesses, and delaying treatment due to poor human–computer interactions or loss of data have led to serious injury and death.”


I also noted that the 'impediments to generating evidence' effectively rise to the level of legalized censorship, as observed by Koppel and Kreda regarding gag and hold-harmless clauses in their JAMA article "Health Care Information Technology Vendors' Hold Harmless Clause: Implications for Patients and Clinicians", JAMA 2009;301(12):1276-1278. doi: 10.1001/jama.2009.398.

FDA had similar findings about impediments to knowledge of health IT risks, see my Aug. 2010 post "Internal FDA memorandum of Feb. 23, 2010 to Jeffrey Shuren on HIT risks. Smoking gun?" at http://hcrenewal.blogspot.com/2010/08/smoking-gun-internal-fda-memorandum-of.html.

I also note this from amednews.com's coverage of the ECRI Deep Dive Study (http://hcrenewal.blogspot.com/2013/02/peering-underneath-icebergs-water-level.html):


... In spring 2012, a surgeon tried to electronically access a patient’s radiology study in the operating room but the computer would show only a blue screen. The patient’s time under anesthesia was extended while OR staff struggled to get the display to function properly. That is just one example of 171 health information technology-related problems reported [voluntarily] during a nine-week period [from 36 hospitals] to the ECRI Institute PSO, a patient safety organization in Plymouth Meeting, Pa., that works with health systems and hospital associations in Kentucky, Michigan, Ohio, Tennessee and elsewhere to analyze and prevent adverse events. Eight of the incidents reported involved patient harm, and three may have contributed to patient deaths, said the institute’s 48-page report, first made privately available to the PSO’s members and partners in December 2012. The report, shared with American Medical News in February, highlights how the health IT systems meant to make care safer and more efficient can sometimes expose patients to harm.


One wonders if Ms. Daniels' definition of "significant" is when body bags start to accumulate on the steps of the Capitol.

I also note she is not a clinician but a JD/MPH.

I am increasingly of the opinion that non-clinicians need to be removed from positions of health IT leadership at regional and national levels.

In large part many just don't seem to have the experience, insights and perhaps ethics necessary to understand the implications of their decisions.

At the very least, such people who never made it to medical school or nursing school need to be kept on a very short leash by those who did.

-- SS

Sunday, May 05, 2013

AMA says EHRs create 'appalling Catch-22' for docs - And just how many experts does it take to screw in a light bulb, anyway?

(NOTE:  this post, being about minor matters like death and financial mayhem, is particularly and unusually [even for me] biting and lacking in euphemisms and political correctness.  If you are easily offended and want the latter, and/or believe we all need to be 'nice' about banal issues like patient injury and death, fraud, and other minor matters, click here:  http://www.disney.com and skip the post below.)

You were warned.

---------------------------------------

At some point, so-called EHR "experts" and pundits need to stop being accommodated for their having ignored years of warnings, complaints, "anecdotes" -a particularly egregious term that comes from those who don't understand risk management, especially academics of the echo chamber-egghead subspecies (link) - and other signs that health IT is not a beneficent, omniscient gift from the Lords of Kobol. (The latter is a pun on the business-IT programming language Cobol, of course.)

Instead, they simply need to be ridiculed for being stupid.

I will do so:  folks, you have been, and remain, stupid:


The Bovine Stare of Incomprehension (click to enlarge)

The Bovine Stare of Incomprehension describes the reactions I've gotten over the years to many warnings about health IT.  It was like talking to a cow.

So now there's this:

AMA says EHRs create 'appalling Catch-22' for docs
May 03, 2013 | Tom Sullivan, Editor

As the healthcare industry moves to EHRs, the medical record has essentially been reduced to a tool for billing, compliance, and litigation that also has a sustained negative impact on doctors' productivity, according to Steven J. Stack, MD, chair of the American Medical Association’s board of trustees.

Gee, they're only realizing and complaining about that - now?  In 2013?

“Documenting a full clinical encounter in an EHR is pure torment,” Stack said during the CMS Listening Session: Billing and Coding with Electronic Health Records on Friday.

(What, the "pure torment" in such a mission-critical function only started with the most recent patches installed last month on the nation's EHRs?  EHRs were just dandy until then?)

It's nice to know in May 2013 that “documenting a full clinical encounter [essential to avoid injurious and even lethal mistakes, I anecdotally note - ed.] in an EHR is "pure torment”, several years into an accelerated "National Program for HIT in the HHS" costing hundreds of billions of dollars.

I guess sites like this blog, this site extant since 1998, and other materials written over the years by backwards stubborn health IT iconoclast fear-mongering Luddites were beyond the comprehension level of - those now proffering the exact same pronouncements.

EHRs are also driving the industry toward charts that look remarkably similar because they’re based on templates created by the technology vendors — that includes often using the same words. And that threatens to make doctors appear to be committing fraud by the practice of record cloning, or cutting and pasting from one record to another, when they are not, in fact, acting fraudulently

I guess putting patients in mortal danger from note cloning (and to those too stupid to understand why that is, get off your rear end and look it up, I'm not going to spoon-feed you) is a step better than acting fraudulently...

Alongside the federal mandate to implement an EHR under threat of a monetary fine, that creates what Stack called “an appalling Catch-22 for physicians.”

Put another way: The government mandates that doctors use an EHR, the EHR vendors’ templates can sometimes create an appearance of fraud and that, in turn, opens the door for payers to decline reimbursement or, even worse, the government to prosecute doctors for the crime.

I guess actual fraud is just anecdotal.

As dire as that sounds, it's an exception that belies the unproven perception that EHRs perpetuate fraud. “Upcoding does not necessarily equate to fraud and abuse,” said Sue Bowman, AHIMA’s senior director of coding and compliance at the same event. “This is an area where more study is needed. We really need to know the causes. Further research is needed on the fraud risk of using EHRs.”

Sure, let's study while rolling this stuff out as frantically as we can.  We'll fix it later -- and Jesus, I guess, will heal and reanimate any patients actually harmed by the technology (link to ECRI Institute Deep Dive Study: 36 hospitals!  Nine weeks!  171 health information technology-related problems voluntarily reported!  Eight injuries!  Three possible deaths!  All mere "anecdotes", of course).

Indeed, Jacob Reider, MD, CMO of ONC, explained that the government and industry do not have good data right now proving whether or not EHRs trigger fraud and abuse.

Per the IOM, the same industry does not have good data on harms levels.  (The previous link to a recent small ECRI "Deep Dive" study's probably the most robust we've got on that score, and the figures are not encouraging).

So - let's review -
  • poor data on harms, 
  • poor data on benefits, 
  • poor data on fraud and abuse.

 The logical, ethical course of action thus is:

D'OH!  LET'S ROLL THE TECHNOLOGY OUT AS FAST AS WE CAN, AND PENALIZE NON-ADOPTERS BESIDES!



See how simple logic, ethics and clear thinking can be?

“There is concern that some doctors are using the EHR to obtain payments to which they are not entitled,” said Mickey McGlynn of Siemens Medical Solutions and HIMSS EHR Association. “Any fraud is an important issue and we, as the vendor community, take that very seriously.”

Only after independent whistleblower investigations by Fred Schulte of the Center for Public Integrity ("Cracking the Codes"), and by New York Times reporters Reed Abelson and Julie Creswell, that is...

AMA’s Stack offered a triptych of suggestions to CMS and ONC: address EHR usability concerns, provide guidance on EHR use for coding and billing, and make meaningful use stage 2 more flexible for providers.

“My purpose is not to denigrate EHRs,” Stack said, explaining that he believes CMS and ONC are genuinely trying to better the current situation.

Nice to have Caspar Milquetoast  on the side of EHR criticism.

Knock knock, anyone home, McFly?


Knock knock, anyone home, McFly?


Today's EHR systems, for the aforementioned reasons above and more, deserve denigration for patients' sake.

There are efforts underway, within the government and industry, to more comprehensively understand the unintended consequences of EHR implementation.

But let's keep rollin' em out, anyway.  Wheeee!  What fun!

Class action attorneys, are you listening?

-- SS

Thursday, February 28, 2013

Peering Underneath the Iceberg's Water Level: AMNews on the New ECRI "Deep Dive" Study of Health IT "Events"

FDA's Center for Devices and Radiological Health director Jeffrey Shuren MD JD voiced the opinion a few years ago that what FDA knows about health IT risks is the "tip of the iceberg" due to systematic impediments to knowledge gathering and diffusion.   See links to source here and to the FDA Internal Memo on HIT risk - labeled "internal document not intended for public use" and unearthed by investigative reporter Fred Schulte several years ago - here (PDF).

At my Feb. 9, 2013 post "A New ECRI Institute Study On Health Information Technology-Related Events" I opined that a new ECRI study was beginning to peer beneath the waterline of Jeff Shuren's iceberg tip, at what may reside underneath that waterline.  Iceberg tips, needless to say, are usually tiny compared to the iceberg's overall size.

Reporter Kevin O'Reilly at AMNews (amednews.com) has now written about that ECRI report.

The results of the report are concerning:

 Ways EHRs can lead to unintended safety problems

Wrong records and failures in data transfer impede physicians and harm patients, according to an analysis of health technology incidents.

By Kevin B. O'Reilly, amednews staff,
posted Feb. 25, 2013.

In spring 2012, a surgeon tried to electronically access a patient’s radiology study in the operating room but the computer would show only a blue screen. The patient’s time under anesthesia was extended while OR staff struggled to get the display to function properly.

That is just one example of 171 health information technology-related problems reported during a nine-week period to the ECRI Institute PSO, a patient safety organization in Plymouth Meeting, Pa., that works with health systems and hospital associations in Kentucky, Michigan, Ohio, Tennessee and elsewhere to analyze and prevent adverse events.

Eight of the incidents reported involved patient harm, and three may have contributed to patient deaths, said the institute’s 48-page report, first made privately available to the PSO’s members and partners in December 2012. The report, shared with American Medical News in February, highlights how the health IT systems meant to make care safer and more efficient can sometimes expose patients to harm.

 Mar. 1, 2013 addendum.  From ECRI, the denominator is this:


Participating facilities submitted health IT related events during the nine-week period starting April 16, 2012, and ending June 19, 2012. ECRI Institute PSO pulled additional health IT events that were submitted by facilities during the same nine-week period as part of their routine process of submitting event reports to ECRI Institute PSO’s reporting program. The PSO Deep Dive analysis consisted of 171 health IT-related events submitted by 36 healthcare facilities, primarily hospitals.   [I note that's 36 of 5,724 hospital in the U.S. per data from the American Hospital Association (link), or appx. 0.6 %.  A very crude correction factor in extrapolation would be about x 159 on the hospital count issue alone, not including the effects of the voluntary nature of the study, of non-hospital EHR users, etc.  Extrapolating from 9 week to a year, the figure becomes about x 1000.  Accounting for the voluntary nature of the reporting (5% of cases per Koppel), the corrective figure approaches x20,000.  Extrapolation of course would be less crude if # total beds, degree of participant EHR implementation/use, and numerous other factors were known, but the present reported numbers are a cause for concern - ed.]

Sept. 2013 addendum: 

Health Leaders Media has more on the ECRI Deep Dive study at http://www.healthleadersmedia.com/print/TEC-290834/HIT-Errors-Tip-of-the-Iceberg-Says-ECRI:

HIT Errors 'Tip of the Iceberg,' Says ECRI
Cheryl Clark, for HealthLeaders Media , April 5, 2013

Healthcare systems' transitions from paper records to electronic ones are causing harm and in so many serious ways, providers are only now beginning to understand the scope.

Computer programs truncated dosage fields, leading to morphine-caused respiratory arrest; lab test and transplant surgery records didn't talk to each other, leading to organ rejection and patient death; and an electronic systems' misinterpretation of the time "midnight" meant an infant received antibiotics one dangerous day too late.

These are among the 171 health information technology malfunctions and disconnects that caused or could have caused patient harm in a report to the ECRI Institute's Patient Safety Organization.

... The 36 hospitals that participated in the ECRI IT project are among the hospitals around the country for which ECRI serves as a Patient Safety Organization, or PSO.

The 171 events documented, break down like this:
  • 53% involved a medication management system.
    • 25% involved a computerized order entry system
    • 15% involved an electronic medication administration record
    • 11% involved pharmacy systems
    • 2% involved automated dispensing systems
  • 17% were caused by clinical documentation systems
  • 13% were caused by Lab information systems
  • 9% were caused by computers not functioning
  • 8%. Were caused by radiology or diagnostic imaging systems, including PACS
  • 1% were caused by clinical decision support systems

Karen Zimmer, MD, medical director of the institute, says the reports of so many types of errors and harm got the staff's attention in part because the program captured so many serious errors within just a nine-week project last spring.  The volume of errors in the voluntary reports was she says, "an awareness raiser."

"If we're seeing this much under a voluntary reporting program, we know this is just the tip of the iceberg; we know these events are very much underreported."

As at the opening of this post, "tip of the iceberg" is a phrase also used by FDA CDRH director Jeffrey Shuren MD JD regarding safety issues with EHRs and other health IT.

Along those lines, at my April 2010 post "If The Benefits Of Healthcare IT Can Be Guesstimated, So Can And Should The Dangers" I proposed a "thought experiment" to theoretically extrapolate limited data on health IT risk to a national audience, taking into account factors that limited transparency and thus reduced known injury and fatality counts. The results were undesirable, to say the least - but it was a thought experiment only.

Using the current data, coming from a limited, voluntary set of information over 9 weeks, I opine that the results of an extrapolation to a national (or worldwide) level, in an environment of rapidly increasing adopters (many of whom are new to the technology), on an annual basis, not a mere 9 weeks - would not look pretty.

The institute’s report did not rate whether electronic systems were any less safe than the paper records they replaced. The report is intended to alert hospitals and health systems to the unintended consequences of electronic health records.

Ethically, this is really not relevant towards national rollout, especially with penalties beginning to accrue to non-adopters of HHS "Certified" technology in a few years.

As I've written on this blog, medical ethics generally do not condone experimentation without informed consent, especially when the experimental devices are of unknown risk. Not knowing the risks of IT, it really doesn't matter, ethically, what the safety of paper is.  "Hope" is not a valid reason for medical experimentation.  (See below for what a PubMed search reveals about risks of paper records.)

The unspoken truth prevalent in healthcare today seems to be this:  the sacrifice of individual patients to a technology of unknown risk is OK, as long as - we hope -  it advances the greater good.    Perhaps that should be explicitly admitted by the HIT industry's hyper-enthusiast proponents who ignore the downsides, so the spin can be dropped and there can be clarity?

The leading cause of problems was general malfunctions [also known by the benign-sounding euphemism "glitches" - ed.]  responsible for 29% of incidents. For example, following a consultation about a patient’s wounds, a nurse at one hospital tried to enter instructions in the electronic record, but the system would not allow the nurse to type more than five characters in the comment field. Other times, medication label scanning functions failed, or an error message was incorrectly displayed every time a particular drug was ordered. One system failed to issue an alert when a pregnancy test was ordered for a male patient. [These 'general malfunctions' are thus not just computer bugs undetected due to inadequate pre-rollout testing, but also examples of design flaws due to designer-programmer-seller-buyer-implementer lack of due diligence, i.e.,  negligence - ed.]

A quarter of incidents were related to data output problems, such as retrieving the wrong patient record because the system does not ask the user to validate the patient identity before proceeding. This kind of problem led to incorrect medication orders and in one case an unnecessary chest x-ray. Twenty-four percent of incidents were linked to data-input mistakes. For example, one nurse recorded blood glucose results for the wrong patient due to typing the incorrect patient identification number to access the record.  [Many of these are likely due to what NIST has termed "use error" - user interface designs that will engender users to make errors of commission or omission - as opposed to "user error" i.e., carelessness - ed.]

Most of remaining event reports were related to data-transfer failures, such as a case where a physician’s order to stop anticoagulant medication did not properly transfer to the pharmacy system. The patient received eight extra doses of the medication before it was stopped. [Due to outright software, hardware and/or network problems and defects - ed.]

I've been writing about such issues since 1998, not because I imagined them.  As a CMIO I saw them firsthand; as teacher and mentor I heard about them from colleagues; as a writer I heard about them via (usually unsolicited) emails from concerned clinicians; as an independent expert witness on health IT harms I've heard about them from Plaintiff's attorneys, but not from the Defense side of the Bar as yet.  Of course the reasons for that are understandable -  albeit disappointing.

In fact, robust studies of a serious issue - the actual risks of paper towards harm causation - and further, whether any of the issues are remediable without spending hundreds of billions of dollars on IT - seem scarce.  I've asked the PA Patient Safety Authority about the possibility of using data in the Pennsylvania Patient Safety Reporting System (PA-PSRS) database, just as they did for EHR-related medical events, to determine incidence of paper-related medical events.  They are pondering the issue.

As an aside, I note that it would be ironic if the relative risks of both IT and paper were not really robustly known.  (I note that in a PubMed search on "risks of paper medical records", not much jumps out.)  IT hyper-enthusiasts will not even debate the issue of studying whether a good paper system might be safer for patients in some clinical environments than bad health IT.

Considering the tremendous cost and unknown risk of today's health IT (and perhaps the unknown risk of paper, too), would it not make more sense, and be consistent with the medical Oath, to leave paper in place where it is currently used - and perhaps improve its performance - until we "get the IT right" in controlled, sequestered environments, prior to national rollout?

In other words, as I've asked before on these pages, should we not slow down the IT push and adhere to traditional (and hard-learned) cautions on medical research?

Even asking such questions brings forth logical fallacies such as straw arguments (e.g., UCSF's Bob Wachter in a recent discussion I initiated with several investigative reporters: "...where we part ways is your defense of paper and pencil. I understand advocacy, and you have every right to bang this particular drum"), ad hominem attacks, etc.

... It is not enough for physicians and other health care leaders to shop carefully for IT systems, the report said. Ensuring that systems such as computerized physician order entry and electronic health records work safely has to be a continuing concern, said Karen P. Zimmer, MD, MPH, medical director of the ECRI Institute PSO.

“Minimizing the unintended consequences of health IT systems and maximizing the poten­tial of health IT to improve patient safety should be an ongoing focus of every health care organization,” she said.

I recommended that clinicians take matters into their own hands if their leaders do not, as at the bottom of my post here.  This advice bears repeating:

... When a physician or other clinician observes health IT problems, defects, malfunctions, mission hostility (e.g., poor user interfaces), significant downtimes, lost data, erroneous data, misidentified data, and so forth ... and most certainly, patient 'close calls' or actual injuries ... they should (anonymously if necessary if in a hostile management setting):

(DISCLAIMER:  I am not responsible for any adverse outcomes if any organizational policies or existing laws are broken in doing any of the following.)


  • Inform their facility's senior management, if deemed safe and not likely to result in retaliation such as being slandered as a "disruptive physician" and/or or being subjected to sham peer review (link).
  • Inform their personal and organizational insurance carriers, in writing. Insurance carriers do not enjoy paying out for preventable IT-related medical mistakes. They have begun to become aware of HIT risks. See, for example, the essay on Norcal Mutual Insurance Company's newsletter on HIT risks at this link. (Note - many medical malpractice insurance policies can be interpreted as requiring this reporting, observed occasional guest blogger Dr. Scott Monteith in a comment to me about this post.)
  • Inform the State Medical Society and local Medical Society of your locale.
  • Inform the appropriate Board of Health for your locale.
  • If applicable (and it often is), inform the Medicare Quality Improvement Organization (QIO) of your state or region. Example: in Pennsylvania, the QIO is "Quality Insights of PA."
  • Inform a personal attorney.
  • Inform local, state and national representatives such as congressional representatives. Sen. Grassley of Iowa is aware of these issues, for example.
  • As clinicians are often forced to use health IT, at their own risk even when "certified" (link), if a healthcare organization or HIT seller is sluggish or resistant in taking corrective actions, consider taking another risk (perhaps this is for the very daring or those near the end of their clinical career). Present your organization's management with a statement for them to sign to the effect of:
"We, the undersigned, do hereby acknowledge the concerns of [Dr. Jones] about care quality issues at [Mount St. Elsewhere Hospital] regarding EHR difficulties that were reported, namely [event A, event B, event C ... etc.]

We hereby indemnify [Dr. Jones] for malpractice liability regarding patient care errors that occur due to EHR issues beyond his/her control, but within the control of hospital management, including but not limited to: [system downtimes, lost orders, missing or erroneous data, etc.] that are known to pose risk to patients. We assume responsibility for any such malpractice.

With regard to health IT and its potential negative effects on care, Dr. Jones has provided us with the Joint Commission Sentinel Events Alert on Health IT at http://www.jointcommission.org/assets/1/18/SEA_42.PDF, the IOM report on HIT safety at http://www.modernhealthcare.com/Assets/pdf/CH76254118.PDF, and the FDA Internal Memorandum on H-IT Safety Issues at http://www.scribd.com/huffpostfund/d/33754943-Internal-FDA-Report-on-Adverse-Events-Involving-Health-Information-Technology.

CMO __________ (date, time)
CIO ___________ (date, time)
CMIO _________ (date, time)
General Counsel ___________ (date, time)
etc."
  • If the hospital or organizational management refuses to sign such a waiver (and they likely will!), note the refusal, with date and time of refusal, and file away with your attorney. It could come in handy if EHR-related med mal does occur.
  • As EHRs remain experimental, I note that indemnifications such as the above probably belong in medical staff contracts and bylaws when EHR use is coerced.

These recommendations still stand, although after this recent story, my caution about retaliation should be re-emphasized:

The Advisory Board Company
Feb. 14, 2013
Hospital Framed Physician; Planted a Gun

-- SS

Wednesday, February 13, 2013

Guest post by Dr. Jon Patrick, U. of Sydney: On the ECRI Institute's recommendations following a "deep-dive" study of HIT-related events

At my Feb. 9, 2013 post "ECRI Institute PSO Uncovers Health Information Technology-Related Events in Deep Dive Analysis", I wrote about an ECRI Institute study of well-defined client data submitted over a 9-week period (a "deep dive" study) on EHR problems.  Risk-creating events at a level that should be a significant concern to patients and clinicians fell into the following categories: 

  • inadequate data transfer from one HIT system to another 
  • data entry in the wrong patient record
  • incorrect data entry in the patient record
  • failure of the HIT system to function as intended 
  • configuration of the system in a way that can lead to mistakes

Dr. Jon Patrick at U. Sydney, a scientist and medical informatician who sees the issues from a number of unique perspectives (link to bio), has offered the following critique of the key recommendations made by the ECRI Institute as a result of this study of health IT events (see aforementioned post for the text of those recommendations). 

One caveat is that neither he nor I have the full report as of this writing in part due to expense:

The ECRI has produced a report on HIT errors. I was concerned about the manner in which the Key Recommendations minimised, generalised or failed to concretise important issues that I offer these comments.

On ECRI Key Recommendations:

1. Enlist leaders’ commitment and support for the organization’s health IT projects.

JP: This is clearly a comment from one level of  management to those levels above it. It doesn't seem to be a comment about the nature of the HIT itself but more about the internal processes to getting it established. There is really not much to say here because if upper management don't want to do anything about the introduction of HIT then engaging in the task is probably futile, hence it was difficult to understand why it was included.

2. Involve health IT users in system planning, design, and selection.

JP: yes, this is crucial to successful solutions.

3. Conduct a review of workflow and processes to determine how they must be modified.

JP: the missing clause at the end of this sentence is "to fit the introduced HIT system". This is putting the cart before the horse. The notion that a piece of software designed by engineers should have priority over the team of clinicians who are experts in their business is highly naive. Also this statement is in contradiction to point 2 above.

The privileging of the functioning of  the IT system as the expert over that of the clinical team, AND making a recommendation in contradiction to an earlier recommendation is absurd enough by itself  to undermine the credibility of  the report.

4. Evaluate the ability of existing IT systems within the organization to reliably exchange data with any health IT system under consideration.

JP: And after the evaluation what should be done. This is hardly an informative recommendation. It is of the form "Do Something, it doesn't matter what you do, just do something."  A more compelling statement that would have enhanced the credibility of the authors and demonstrate their knowledge of the industry would have been: " Establish unambiguously and conclusively that any health IT system under consideration has the ability to reliably exchange data with existing IT systems within the organization". Note the focus needs to be on the incoming system being the object of conformity not the incumbent systems.

5. Conduct extensive tests before full implementation to ensure that the health IT system operates as expected.

JP: this is a clearly a desirable goal and applies to point 4 above as well as all other aspects of the system functions.

6. Provide user training and ongoing support; educate users about the capabilities and limitations of the system.

JP: This is a motherhood statement that does nothing to contribute to the nub of training issues in the use of HIT. Training is an ongoing issue for two reasons: staff change and new staff come on to the roster and need to be trained, and, these systems are complex and expert advice and skill needs to be available to staff as an ongoing service so that work is not delayed due to confusion on how to use the IT. An alternative proposal to reduce training costs and investment would be to design the system so that it matches current best practice of the clinical team so that learning the system is minimised because it fits seamlessly into their work processes.

Surely the issue of educating users about the capabilities and limitations of the system is independent of the training topic. The users will discover on their own bat the limitations of the system as they try to use it.

7. Closely monitor the system’s ease of use and promptly address problems encountered by users.

JP:This is a quite inadequate description of the action that needs to be taken. The real consideration is for them to have an effective avenue for expressing the limitations in a manner that is acceptable and they are NOT chastised as malcontents [or Luddites or technophobes - ed.] AND that the unnecessary or dangerous limitations are addressed promptly.

8. Introduce alterations to a health IT system in a controlled manner.

JP: It is hard to understand what is meant by this statement. Firstly I would have said "introduce alterations to the clinical processes  in a controlled manner". Secondly, alterations to the HIT system need to be done promptly  when it is defective. Once again, as in point 3 above the technology is being preferenced over the clinical processes which I argue is back-to-front.

9. Monitor the system’s effectiveness with metrics established by the organization.

JP: This is definitely something that should be done but it also needs a more directed purpose. It is easy to say to assess patient safety but most systems don't readily capture relevant data or supply analytical devises to easily draw a picture of patient  safety. However there is an equally important factor in care that is often overlooked and that is staff productivity and by implication morale. There is a need to understand better ways of assessing staff productivity in positive ways and the effect a CIS has on staff morale.  Typical comments about CISs is that they cost staff  up to 20% more time to maintain the patient record. Staff wouldn't mind giving up that time if it was returned in some other form, but it isn't, so they feel the time is stolen from them or from their patients.

10. Require reporting of health IT- related events and near misses.

JP: This is poorly stated and is probably meant to read "health IT - related adverse events". This is a positive recommendation but does not go far enough. A more comprehensive statement would be "Install a process and technology for reporting adverse events and establish methods for evaluating the reports and recommending changes to clinical practice, or technology functionality and implementing them.

11. Conduct thorough event analysis and investigation to identify corrective measures.

JP: This  goes some way to dealing with my point in item 10 above. Its weakness is in not identifying the types of problems and taking a firm stance on completing the correct action.

SOME of the Items that have been OVERLOOKED

1. The system needs to be alterable at any time by the clinical leadership so as to immediately emplace revised work practices when they are approved.

2. The system needs to have native analytics so that the clinical leadership can monitor the activities of their teams and provide evidenced based feedback to support continuous process improvement.

3. The system needs highly accurate natural language processing so that the search for required content though the clinical record can be fast, efficient and reliable.

Professor Jon Patrick
Chair of Language Technology
School of Information Technologies
Faculty of Engineering
University of Sydney
Health Information Technologies Research Laboratory

http://www.it.usyd.edu.au/~hitru

This is excellent advice coming from perhaps the only computing expert in the world who's conducted a forensic analysis of a major commercial EHR product, one intended for high-risk ED's.  His analysis of that product, intended for government-mandated rollout in public hospitals in Dr. Patrick's Australian state of New South Wales, is at this link.

This work has largely been ignored by the health IT industry and the academic Medical Informatics community.  However, I can assure the industry and the academic community that the report will not be ignored by those in the legal community if (perhaps I should say when) patients are injured or killed by the system's deficiencies.

-- SS

Saturday, February 09, 2013

A New ECRI Institute Study On Health Information Technology-Related Events

As I wrote here, I was a reviewer of the report in the PA-based, ECRI Institute-conducted study "The Role of the Electronic Health Record in Patient Safety Events."  ECRI studied the Pennsylvania Patient Safety Reporting System database for HIT-related errors.   

The ECRI Institute is an independent organization renowned for its safety testing of medical technologies and reporting on same, and that "researches the best approaches to improving the safety, quality, and cost-effectiveness of patient care."  I've mentioned it and its bylaws in this blog in the past as a model for independent, unbiased testing and reporting of healthcare technologies.

The full report in PDF is at this link.  In the report, the Pennsylvania Patient Safety Authority analyzed reports of EHR-related events from a state database (the Pennsylvania Patient Safety Reporting System or PA-PSRS, pronounced "PAY-sirs") of reported medical errors and identified several major themes.

My review input led to a discrete "limitations" section.  Also, my invited July 2012 presentation to the PA Patient Safety Authority "Asking the Right Questions: Using Known HIT Safety Issues to Improve Risk Reporting and Analysis" with ECRI in attendance (link to PPT here) on the danger of limited datasets due to systematic impediments to information diffusion was apparently taken seriously. 

ECRI decided to do something about the knowledge gap, and they asked the right questions.

They've just released this summary of a new study they conducted.  I have a few comments which follow:
  
ECRI Institute PSO Uncovers Health Information Technology-Related Events in Deep Dive Analysis

Data transfer, data entry, system configurations, and more identified as serious problem areas
 
PLYMOUTH MEETING, Pa., Feb. 6, 2013 /PRNewswire-USNewswire/ -- The federal government is spending about $19 billion to encourage hospitals, physician practices, and other healthcare organizations to invest in their health information technology (HIT) infrastructure with the goal of improving patient safety and quality through the Health Information Technology for Economic and Clinical Health (HITECH) Act.

Concerned about the unintended consequences of HIT and the potential for errors to cause patient harm, ECRI Institute Patient Safety Organization (PSO) recently conducted a PSO Deep Dive™ analysis on HIT-related safety events. Their just-released 48-page report identified five potential problem areas, which can be assessed with the accompanying toolkit. The report and toolkit are available for purchase [appx. $350 U.S. - ed.] without membership in ECRI Institute PSO.

"Minimizing the unintended consequences of HIT systems and maximizing the potential of HIT to improve patient safety should be an ongoing focus of every healthcare organization," says Karen P. Zimmer , MD, MPH, FAAP, medical director, ECRI Institute PSO.


Based on [voluntary - ed.] reports submitted to the PSO from participating organizations, ECRI Institute PSO experts identified the following key HIT-related problems:

  • inadequate data transfer from one HIT system to another
  • data entry in the wrong patient record
  • incorrect data entry in the patient record
  • failure of the HIT system to function as intended
  • configuration of the system in a way that can lead to mistakes
To collect enough reports for meaningful evaluation, ECRI Institute PSO asked participating organizations to submit standardized data about HIT events during a nine-week period. This enabled ECRI Institute PSO to identify patterns and trends from the aggregated data and share the findings, as well as its recommendations. The data in the PSO Deep Dive represents only that collected using the Agency for Healthcare Research and Quality (AHRQ) HIT Common Formats.  [Not the improved formats developed by AHRQ in their IT Hazards Manager project, still in development - ed.]  ECRI Institute PSO data encompasses over 800 HIT-related events.

According to the report, HIT must be considered in the context of the environment in which it operates during the three phases of any HIT project: planning for new or replacement systems, system implementation, and ongoing use and evaluation of the system. "Shortsighted approaches to HIT can lead to adverse consequences," caution the authors.

"Healthcare organizations should consider the findings and recommendations in the PSO Deep Dive as part of their effort to achieve those goals," adds Zimmer.

The HIT PSO Deep Dive findings were published in a 48-page report and toolkit with self-assessment questionnaire and action plan form available to all ECRI Institute PSO Members and its partner PSO members. The table of contents of the report is available for free viewing/download. Additional information will be presented in ECRI Institute PSO's Monthly Brief free e-newsletter March edition; go to www.ecri.org/psobrief to sign up. The full report and toolkit are also available for purchase.

For questions about this topic, or for information about purchasing the report, please contact ECRI Institute PSO by telephone at (610) 825-6000, ext. 5558; by e-mail at pso@ecri.org; by fax at (610) 834-1275, or by mail at 5200 Butler Pike, Plymouth Meeting, PA 19462-1298, USA.

From the free linked TOC document:

Key Recommendations
  • Enlist leaders’ commitment and support for the organization’s health IT projects.
  • Involve health IT users in system planning, design, and selection.
  • Conduct a review of workflow and processes to determine how they must be modified.
  • Evaluate the ability of existing IT systems within the organization to reliably exchange data with any health IT system under consideration.
  • Conduct extensive tests before full implementation to ensure that the health IT system operates as expected.
  • Provide user training and ongoing support; educate users about the capabilities and limitations of the system.
  • Closely monitor the system’s ease of use and promptly address problems encountered by users.
  • Introduce alterations to a health IT system in a controlled manner.
  • Monitor the system’s effectiveness with metrics established by the organization.
  • Require reporting of health IT-related events and near misses.
  • Conduct thorough event analysis and investigation to identify corrective measures.

My comments are these:

  • The ECRI study, report and recommendations are quite welcome.
  • The case reports received were apparently voluntary and probably "conservative" and understated as hospitals are not happy to release data on problems and harms that can lead to, or support, litigation.  
  • The study was just 9 weeks long, and with a limited set of healthcare organizations participating.  800 HIT-related events were identified. 
  •  The relevant issues discovered in the events, as summarized in the bullet points above, are capable of causing clinician distraction, incorrect decisions, "use error" (as opposed to "user error", see here), patient harm, and death.  (I am aware of such issues in the press including harms and deaths, as readers here have read at links such as these and these and these and these, and others about which I am providing expert-witness consultation and cannot share.)
  • I believe ECRI has now begun to peer below the water level, through the muck of industry control of the narrative, of what FDA CDRH leader Jeffrey Shuren MD JD referred to as "the tip of the iceberg" - i.e., the current level of knowledge of health IT difficulties, defects and harms. 
  • The report is yet another red flag for a far more robust (and mandatory, in my view) post-marketing surveillance of health IT.  
  • Those who claim these findings are "anecdotes" (as here) are looking increasingly foolish and cavalier.

Finally, readers of this blog have been reading about these issues for years.  You heard it here first.

-- SS