Showing posts with label meaningful use. Show all posts
Showing posts with label meaningful use. Show all posts

Wednesday, January 13, 2016

Death of EHR "Meaningul Use" imminent. (Hopefully the death of the 'National Programme for Health IT in the HHS' is imminent, too.)

I've written a number of posts on the Orwellian-named "Meaningful Use" experiment with electronic health records systems, imposed upon United States physicians by the Department of Health and Human Services through its Office of the National Coordinator for Health Information Technology (ONC).

See these posts and others retrieved by query link http://hcrenewal.blogspot.com/search/label/meaningful%20use:

Meaningful Use Final Rule: Have the Administration and ONC Put the Cart Before the Horse on Health IT?

Meaningfully Experimental Protocols and Interfaces to Nowhere? Nagging Questions On Healthcare IT Remain

Science or Politics? The New England Journal and "The 'Meaningful Use' Regulation for Electronic Health Records"

"Meaningful Use" not so meaningul: Multiple medical specialty societies now go on record about hazards of EHR misdirection, mismanagement and sloppy hospital computing

EHRs and "Meaningful Use": Begging the Question in the New England Journal of Medicine

The Scientific Justification for Meaningul Use, Stage 2: The NWB Methodology

Meaningful Use and the Devil in the Details: A Reader's View

  
In these posts and others I expressed significant skepticism about the 'Meaningful Use' scheme.

But what did I know?  Our betters in government and academia knew far better how to seriously annoy physicians, make more burdensome (and hence more dangerous) the already onerous task of EHR use, and waste the tax money we hard-working Americans pay to an increasingly bloated bureaucracy that acts as if money grows on trees (the U.S. debt has doubled in recent years to almost $19 billion, see http://www.usdebtclock.org/).

From the horse's mouth (or perhaps the animal's other end) at https://www.healthit.gov/providers-professionals/meaningful-use-definition-objectives:

Meaningful Use Defined

Meaningful use is using certified electronic health record (EHR) technology to:
  • Improve quality, safety, efficiency, and reduce health disparities
  • Engage patients and family
  • Improve care coordination, and population and public health
  • Maintain privacy and security of patient health information

I note that none of this was backed by science at the time of its formulation.

The end result of the MU experiment is this:

CMS’s Slavitt: End of meaningful use imminent in 2016
Internal Medicine News
WHITNEY MCKNIGHT
January 12, 2016
http://www.internalmedicinenews.com/practice-economics/health-reform/single-article/cmss-slavitt-end-of-meaningful-use-imminent-in-2016/94653f2ba164a8131ca214d5325c0d74.html

Meaningful use is on its way out.

Andy Slavitt, acting administrator of the Centers for Medicare & Medicaid Services, told investors attending the annual J.P. Morgan Healthcare Conference that CMS is pulling back from the health care IT incentive program in the coming months.

“The meaningful use program as it has existed will now be effectively over and replaced with something better,” Mr. Slavitt said. Without providing full details, he said that March 25 would be an important date as concerns the rollout of the new health IT initiatives.

The waste of resources and time, and the alienation of physicians by this grand(-ly foolish) experiment is significant:

“We have to get the hearts and minds of physicians back. I think we’ve lost them,” Mr. Slavitt said.

No foolin'.  Ya think?

This was predictable by anyone with half a brain about healthcare information technology reality.  (It's a real loss that hyper-enthusiast health IT geniuses responsible can't be fired and banned from the domain of healthcare - for life.)

Perhaps the officials at HHS got their first clue about clinician unhappiness via a long January 2015 letter from about 40 medical societies, including the AMA, American College of Physicians, American College of Surgeons, and numerous others that they did not exactly love these systems and the MU experiment.  See my January 28, 2015 post "Meaningful Use not so meaningful: Multiple medical specialty societies now go on record about hazards of EHR misdirection, mismanagement and sloppy hospital computing" at http://hcrenewal.blogspot.com/2015/01/meaningful-use-not-so-meaningul.html and the letter itself at http://mb.cision.com/Public/373/9710840/9053557230dbb768.pdf.

He noted that, when the meaningful use incentive program began, few physicians and practices used electronic health records and concerns were that many would not willingly embrace information technology. Now that “virtually everywhere care is delivered has a computer,” it’s time to make health care technology serve beneficiaries and the physicians who serve them, Mr. Slavitt said.

The revealing nature of this candid statement is breathtaking.  He's admitting that 1) many physicians, rightfully reluctant to not "willingly embrace" IT, had the technology imposed upon them by government (due to its "concerns") via penalties for non-adopters and 2) with the systems in the physicians' faces at the cost of hundreds of billions of dollars that could have been better spent on healthcare itself (e.g., for those subject to 'disparities", i.e., the poor), now it's time to make the systems serve patients and physicians.

Brilliant.

The cost, however, was too high, Mr. Slavitt said. “As any physician will tell you, physician burden and frustration levels are real. Programs that are designed to improve often distract. Done poorly, measures are divorced from how physicians practice and add to the cynicism that the people who build these programs just don’t get it.”

The 'cynicism' (def: inclination to believe that people are motivated purely by self-interest; skepticism) that the builders of these programs don't "get it?"  It's not cynicism.  It's a rational conclusion arrived at via empirical observation.

I also recall in the not-so-distant past that physician complaints were dismissed as the complaints of "Luddites."  I've heard this at Informatics meetings, at medical meetings, at commercial health IT meetings (e.g., Microsoft's Health Users Group, and at HIMSS), at government meetings (e.g., GS1 healthcare), and others.

It's rewarding to finally have government officials admit those charges were, to be blunt about it, lies or delusions.

Soon, CMS will no longer reward health care providers for using technology, but will instead focus on patient outcomes through the merit-based incentive pay systems created by last year’s Medicare Access and CHIP Reauthorization Act (MACRA) legislation. 

Perhaps that's a move in the right direction; time will tell.  However, I'm sure physicians have GREAT confidence in how well that will work out, yet another government experimental project.

In addition to asking physicians to work with health care IT innovators to create systems that work best according to their practice’s respective needs, CMS is calling on the private sector to create apps and analytic tools that will keep data secure while fostering true and widespread interoperability.

This is in the realm of delusion.  Physicians "asked" to "work with" (for free?) the same "innovators" (i.e, health IT companies) whose "innovation" led to the massive disaffection for today's health IT, and the burdens that technology has placed on the medical profession, nurses and other clinicians as well?   Further, it's actually believed that the companies will listen, when they've failed to do so for several decades running?  My head spins.

Anyone seeking to block data transfer will find CMS is not their friend. Mr. Slavitt said. “We’re deadly serious about interoperability. Technology companies that look for ways to practice data blocking in opposition to new regulations will find that it will not be tolerated.”

And who, exactly, is going to enforce that edict on proprietary systems, which health IT companies view (correctly, from the business perspective) as giving them a competitive edge?  I'm sure the health IT companies, who now hold medicine captive, are shaking in their boots.

Dr. James L. Madara, CEO of the American Medical Association, echoed Mr. Slavitt’s comments on the current, negative impact of EHRs on physicians’ practices. He noted that many physicians are spending at least 2 hours each workday using their EHR and may click up to 4,000 times per 8-hour shift.

I should open a clinic for health IT-caused carpal tunnel syndrome and repetitive motion injuries.  Oh wait!  There's no ICD-10 code for that to bill (see http://hcrenewal.blogspot.com/2016/01/repeated-crushing-by-alligators-and.html).

Dr. Madara outlined three AMA goals to help restore the physician-patient relationship. The first is to restructure the medical school curriculum, which he said essentially is the same as it has been for 100 years. New generations of physicians should be taught how to deliver collaborative care that includes telemedicine, more ambulatory care, and home care. Community-based partnerships, he said, would become key to treating chronic diseases like diabetes and would have to be factored into reimbursement models. The AMA also seeks to improve health outcomes and ensure thriving physician practices.

Central to the AMA’s plan for the future: Helping physicians restructure practice via technology. He announced that the AMA is a founding partner in the Silicon Valley (Calif.) based Health2047, a company focused on supporting health IT and other entrepreneurs in their efforts to provide physicians with digital tools that improve patient outcomes, among other innovations.

As to "helping physicians restructure practice via [information] technology", this seems an example of what I termed "Heath IT hyper-enthusiasm" writ large.  See My March 11, 2012 post "Doctors and EHRs: Reframing the 'Modernists v. Luddites' Canard to The Accurate 'Ardent Technophiles vs. Pragmatists' Reality" at http://hcrenewal.blogspot.com/2012/03/doctors-and-ehrs-reframing-modernists-v.html.

What is needed, as I have repeatedly written, is not to have physicians "restructure" practice to adopt to IT, rather to restructure IT (the systems themselves, the developmental methodologies, the backgrounds of the industry leadership, the industry itself) to match the needs of physicians and patients.

The AMA holds a minority of the nation's physicians as members; a 2011 article "American Medical Association membership woes continue" (CMAJ. 2011 Aug 9; 183(11): E713–E714, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3153537/) indicated this:

In the early 1950s, about 75% of US physicians were AMA members. That percentage has steadily decreased over the years. In June, at the annual meeting of its policy-making body, the House of Delegates, the AMA announced that it lost another 12 000 members last year. That brings total membership below 216 000. Up to a third of those members don’t pay the full $420 annual dues, including medical students and residents. Not counting those members, somewhere in the neighbourhood of 15% of practising US doctors now belong to the AMA.

Hair-brained schemes to "restructure practice via technology" will likely drop those numbers further.

The National Programme for IT in the NHS (NPfIT) died several years ago (http://hcrenewal.blogspot.com/2011/09/npfit-programme-going-pffft.html).

It is my hope the death of "meaningful use" heralds the death of the equally wasteful and ill-thought-out National Program for health IT in the HHS, a.k.a. HITECH, and a return to recognition of the truth: that health IT is experimental, that it (and its subjects) must be treated with that in mind, that its progress cannot be mandated, and that the technology, as any other IT, needs to be approached with great skepticism e.g. per this article:

Pessimism, Computer Failure, and Information Systems Development in the Public Sector.  (Public Administration Review 67;5:917-929, Sept/Oct. 2007, Shaun Goldfinch, University of Otago, New Zealand).  Cautionary article on IT that should be read by every healthcare executive documenting the widespread nature of IT difficulties and failure, the lack of attention to the issues responsible, and recommending much more critical attitudes towards IT.  link to pdf

-- SS

Wednesday, January 28, 2015

"Meaningful Use" not so meaningful: Multiple medical specialty societies now go on record about hazards of EHR misdirection, mismanagement and sloppy hospital computing

The "Meaningful Use" program for EHRs is a mismanaged boondoggle causing critical issues of patient safety, EHR usability, etc. to be sidestepped.

This is on top of the unregulated U.S. boondoggle which should probably be called "the National Programme for IT in the HHS" - in recognition of the now-defunct multi-billion-pound debacle known as the National Programme for IT in the NHS (NPfIT), see my Sept. 2011 post "NPfIT Programme goes PfffT" at http://hcrenewal.blogspot.com/2011/09/npfit-programme-going-pffft.html.

The complaints are not just coming from me now.

As of January 21, 2015 in a letter to HHS at: http://mb.cision.com/Public/373/9710840/9053557230dbb768.pdf, they are now coming from the:

American Medical Association
AMDA – The Society for Post-Acute and Long-Term Care Medicine
American Academy of Allergy, Asthma and Immunology
American Academy of Dermatology Association
American Academy of Facial Plastic
American Academy of Family Physicians
American Academy of Home Care Medicine American Academy of Neurology
American Academy of Ophthalmology
American Academy of Otolaryngology—Head and Neck Surgery
American Academy of Physical Medicine and Rehabilitation
American Association of Clinical Endocrinologists
American Association of Neurological Surgeons
American Association of Orthopaedic Surgeons
American College of Allergy, Asthma and Immunology
American College of Emergency Physicians
American College of Osteopathic Surgeons
American College of Physicians
American College of Surgeons
American Congress of Obstetricians and Gynecologists
American Osteopathic Association
American Society for Radiology and Oncology
American Society of Anesthesiologists
American Society of Cataract and Refractive Surgery and Reconstructive Surgery
American Society of Clinical Oncology
American Society of Nephrology
College of Healthcare Information Management Executives
Congress of Neurological Surgeons
Heart Rhythm Society
Joint Council on Allergy, Asthma and Immunology
Medical Group Management Association
National Association of Spine Specialists
Renal Physicians Association
Society for Cardiovascular Angiography and Interventions
Society for Vascular Surgery


In the letter to Karen B. DeSalvo, National Coordinator for Health Information Technology at HHS, these organizations observe:

Dear Dr. DeSalvo:

The undersigned organizations are writing to elevate our concern about the current trajectory of the certification of electronic health records (EHRs). Among physicians there are documented challenges and growing frustration with the way EHRs are performing. Many physicians find these systems cumbersome, do not meet their workflow needs, decrease efficiency, and have limited, if any, interoperability.

Of course, my attitude is that we need basic operability before the wickedly difficult to accomplish and far less useful (to patients) interoperability. 
 
... Most importantly, certified EHR technology (CEHRT) can present safety concerns for patients. We believe there is an urgent need to change the current certification program to better align end-to-end testing to focus on EHR usability, interoperability, and safety.

Let me state what they're saying more clearly:

"This technology in its present state is putting patients at risk, harming them, and even killing them, is making practice of medicine more difficult, is putting clinicians at liability risk, and the 'certification' program is a joke."

... We understand from discussions with the Office of the National Coordinator for Health Information Technology (ONC) that there is an interest in improving the current certification program. For the reasons outlined in detail below, we strongly recommend the following changes to EHR certification:

1. Decouple EHR certification from the Meaningful Use program;
2. Re-consider alternative software testing methods;
3. Establish greater transparency and uniformity on UCD testing and process results;
4. Incorporate exception handling into EHR certification;
5. Develop C-CDA guidance and tests to support exchange;
6. Seek further stakeholder feedback; and
7. Increase education on EHR implementation.

Patient Safety
Ensuring patient safety is a joint responsibility between the physician and technology vendor and requires appropriate safety measures at each stage of development and implementation.

I would argue that it's the technologists who have butted into clinical affairs with aid from their government friends, thus the brunt of the ill effects of bad health IT should fall on them.  However, when technology-related medical misadventures occur, it's the physicians who get sued.

... While training is a key factor, the safe use of any tool originates from its inherent design and the iterative testing processes used to identify issues and safety concerns. Ultimately, physicians must have confidence in the devices used in their practices to manage patient care. Developers must also have the resources and necessary time to focus on developing safe, functional, and useable systems.

Right now, those design and testing processes compare to those in other mission-critical sectors employing IT quite poorly.

Considering fundamental stunningly-poor software quality that I've observed personally, such as lack of appropriate confirmation dialogs and notification messages supporting teamwork, lack of date constraint checking (see my report to FDA MAUDE at http://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfmaude/detail.cfm?mdrfoi__id=1729552 and many others at http://hcrenewal.blogspot.com/2011/01/maude-and-hit-risk-mother-mary-what-in.html), and other fundamentals, I would say grade schoolers could probably have done a better job of safety testing than the vendors and IT amateur-implementers of the major systems I observed did. 

... Unfortunately, we believe the Meaningful Use (MU) certification requirements are contributing to EHR system problems, and we are worried about the downstream effects on patient safety.

In other words, computers and the government thirst for data do not have more rights than patients.  In the current state of affairs, as I have observed prior, computers do seem to have more rights than patients and the clinicians who must increasingly use them.

... Physician informaticists and vendors have reported to us that MU certification has become the priority in health information technology (health IT) design at the expense of meeting physician customers’ needs, patient safety, and product innovation. We are also concerned with the lack of oversight ONC places on authorized testing and certification bodies (ATCB) for ensuring testing procedures and standards are adequate to secure and protect electronic patient information contained in EHRs.

Not just security, but patient safety also.  See for example my Feb. 2012 post "Hospitals and Doctors Use Health IT at Their Own Risk - Even if 'Certified'" at http://hcrenewal.blogspot.com/2012/02/hospitals-and-doctors-use-health-it-at.html.

Read the entire letter at http://mb.cision.com/Public/373/9710840/9053557230dbb768.pdf.

Sadly, while on the right track regarding the problems of bad health IT, the societies take a Milquetoast approach to correction:

... In May 2014, stakeholders representing accredited certification bodies and testing laboratories (ACB & ATL), EHR vendors, physicians, and health care organizations provided feedback to ONC on the complexities of the current certification system. Two main takeaways from these comments were for ONC to host a multi-stakeholder Kaizen event and to prioritize security, quality measures, and interoperability in the EHR certification criteria. We strongly support both of these ideas...

A multi-stakeholder "Kaizen event'?  (http://en.wikipedia.org/wiki/Kaizen)

That's one recommendation I find disappointing.  The industry plays hard politics, and organized medicine wants to play touchy-feely "good change" management mysticism with that industry and their government apparatchiks.  That's how organized medicine wants patients and the integrity of the medical profession to be protected from the dysfunctional health IT ecosystem (see http://cci.drexel.edu/faculty/ssilverstein/cases/?loc=cases&sloc=ecosystem)?  

When I originally created my old website called "Medical informatics and leadership of clinical computing" back in 1998, Kaizen events were not exactly what I had in mind.

Finally, the American Medical Informatics Association (http://www.amia.org) was apparently not informed of this letter, nor did it participate in its drafting.  While this is regrettable, as the organization is the best reservoir of true Healthcare Informatics expertise, I opined to that group that this may have been due to the organization's tepid response to bad health IT and to industry control of the narrative, and the problems these issues have caused for physicians and other clinicians. The lack of AMIA leadership regarding bad health IT is an issue I've been pointing out since the late 1990s. AMIA has been largely a non-critical HIT promoter.  That stance has contributed to the need for this multiple-medical specialty society letter in the first place.

Parenthetically, and for a touch of humor about an otherwise drab topic: Here's an example of how management mysticism plays out in pharma.

It's meant to be satirical, but captures reality all too well, in fact scarily so at times:


Management mysticism and muddled thinking.  See https://www.youtube.com/watch?v=kwVjftMMCIE

In pharma, as well as in hospital IT in my days as CMIO, gibberish like this was real.  I imagine it's no different in many hospital management suites these days.

-- SS

1/28/2015  Addendum:

Per a colleague:

FierceHealthIT (1/28) reports, “It’s time for the American Medical Association and more than 30 other organizations urging change in the electronic health record certification process to be part of the solution, former Deputy National Coordinator for Health IT Jacob Reider said in a blog post.” Reider said, “So far, I don’t see much [any?] engagement from the AMA or the others who signed the letter. It’s relatively easy to write a letter saying someone else is responsible for solving problems. Time to step up to the plate and participate in the solutions, folks!"

Regarding the victims of compelled use of bad health IT, this erstwhile health IT leader opines "It's relatively easy to write a letter saying someone else is responsible for solving problems?"

That is simply perverse.

I ask: why are we in the midst of a now-compelled national rollout with Medicare penalties for non-adopters when a former government official once responsible for the technology remarks that it's apparently not the makers' problem and that it's "time to step up to the plate and participate in the solutions, folks [a.k.a. end users]!"

(One wonders if Reider believes those who step up to the plate are entitled to fair compensation for their aid to an industry not exactly known for giving its products away, free.)

It seems to me it's not up to (forced) customers to find solutions to vendor product problems, some deadly.

It's the responsibility of the sellers.

Put more bluntly, Reider's statement is risible and insulting.

I've already opined the following to the AMA contact at the bottom of the letter:

... Relatively milquetoast approaches such as multi-stakeholder Kaizens are not what I had in mind ... A more powerful stance would be to advise society members to begin to avoid conversion, report on bad health IT, and even boycott bad health IT until substantive changes are realized in this industry.

That's "stepping up to the plate" to protect patients, in a very powerful way.

-- SS

Friday, April 25, 2014

Innumeracy at the Centers for Medicare & Medicaid Services (CMS)

A physician participant in an American Medical Informatics Association listserv I subscribe to had some time ago commented that the CMS, in their requirement that physicians meet certain percentages on measures regarding adherence to the "Meaningful Use" incentive program for EHRs, were calculating those percentages incorrectly.

He followed up with an actual response from CMS, and has given me permission to repost.  I am redacting his name:

... I have posted previously that the CMS calculator found at http://www.cms.gov/Regulations-and-Guidance/Legislation/EHRIncentivePrograms/Stage_2.html appears to calculate improperly.  Last night I received a response from CMS regarding my concern:

“Dear Mr. (sic) [name redacted],

Thank you for your recent inquiry. Below is the information you requested about the attestation calculator.

As adopted by CMS, measures generally require that providers achieve "more than" a specific percentage. The language in these measures is clear; "more than 50 percent" would equate to 51 percent or more. This has consistently been the policy from the beginning of the program.

The attestation calculator now rounds fractions of a percent to the closest whole number. This correctly identifies when the required performance level is reached.

The tracking number for this inquiry is 2014-XXXXX. . . . “


My examples included a numerator of 549 with a denominator of 10,000 for a metric that required “greater than 5%”.  These are screen shots of the submission:




Note that the calculator appears to use 3 significant figures, but in fact rejects the calculation by rounding to only 1 significant figure.  

Years ago at a CMS conference I remember the speaker remarking that physicians and hospitals only had to enter the numbers “and we could agree on the arithmetic.”  I learned in fourth grade how to round numbers, and how to count significant digits.  I do not agree with their arithmetic, nor do I accept their determination that “more than 50 percent" would equate to 51 percent or more”.  Granted, one hopes that those attempting to attest will not have numbers that skim so closely to the metric limit, but it could happen.

I note in the reply from CMS this statement:

"The language in these measures is clear; 'more than 50 percent' would equate to 51 percent or more."

I emphasize:   

THE - LANGUAGE - IN - THESE - MEASURES - IS - CLEAR.

Here are  actual instructions for, say, CPOE measurement on medication ordering (http://www.cms.gov/Regulations-and-Guidance/Legislation/EHRIncentivePrograms/downloads/Stage2_EPCore_1_CPOE_MedicationOrders.pdf):

Attestation Requirements
DENOMINATOR/NUMERATOR/THRESHOLD/EXCLUSION

Measure 1: Medication

DENOMINATOR: Number of medication orders created by the EP during the EHR reporting period.

NUMERATOR: The number of orders in the denominator recorded using CPOE.

THRESHOLD: The resulting percentage must be more than 60 percent in order for an EP to meet this measure.

EXCLUSION: Any EP who writes fewer than 100 medication orders during the HER (sic) reporting period.

Now, I had a perfect "800" in math on my SAT test in 1974, so (while probably excluding me from some employment in today's culture of stupid due to having "too much experience"), I do believe I am perfectly well qualified to determine that "more than 60 percent" would mean, anything more than 60.0, such as, say, 60.1%.

Let's consider possible explanations.

Possibility (1)
Perhaps CMS is performing their calculations with an old Pentium-1 computer whose CPU has the FDIV bug causing math errors (http://en.wikipedia.org/wiki/Pentium_FDIV_bug)?

On second thought:

I don't think that is a good explanation.

Possibility (2)
Perhaps I have become demented from too much exposure to the numeracy-challenged since 1974?

An experiment is in order:

In 1969, we landed men on the Moon.  It took a lot of math to perform that feat, and miscalculation would have led to disaster, for example on the 25,000-MPH re-entry into Earth's atmosphere at precisely the correct angle required to avoid burn up, or skipping off the atmosphere like a stone off a pond, back out into space to be lost forever.

I learned computing about that time on a Digital Equipment Corporation PDP-8/S, a computer from that era (http://cci.drexel.edu/faculty/ssilverstein/medinformatic1/gw-pdp8s.htm).

I wrote and ran a small program on a PDP-8 emulator WinEight (available free at http://www.sparetimegizmos.com/Software/WinEight.htm) that perfectly emulates the old PDP-8.  Here is the program in the programming language FOCAL, 1969 version:

CONGRATULATIONS!!
YOU HAVE SUCCESSFULLY LOADED 'FOCAL,1969' ON A PDP-8 COMPUTER.

SHALL I RETAIN LOG, EXP, ATN ?:YES

PROCEED.

*1.1 SET P=(601/1000)*100
*1.2 IF (P-60) 1.3, 1.4, 1.5
*1.3 TYPE "P IS LESS THAN 60%";G 1.6
*1.4 TYPE "P EQUALS 60%";G 1.6
*1.5 TYPE "P IS MORE THAN 60%"
*1.6 TYPE !;QUIT

The program sets variable "P" to 601/1000, then multiplies by 100 to derive a percent.  It then compares the result stored in "P" to 60, and branches to the correct statement regarding the relation of P to 60%.  Let's run the program:

*
*GO
P IS MORE THAN 60%
*

Good news.

I guess I am not demented after all.

Possibility (3)
Someone (or a group of people) at CMS doesn't or don't realize that in large datasets, percentages are often not integer whole numbers.

Possibility #3 can be illustrated best by a cartoon:


Click to enlarge.  1+3 = 13, right?


Or perhaps this:

Math for Underachievers.  Click to enlarge.

I leave it to the reader to determine which of the three possibilities is the explanation for the assertion by CMS that "The language in these measures is clear; 'more than 50 percent' would equate to 51 percent or more."

Note: this post was meant as satire and humor and irony, but innumeracy in our healthcare regulators is anything but funny.

-- SS

Thursday, February 21, 2013

EHRs and "Meaningful Use": Begging the Question in the New England Journal of Medicine

I used to have great respect for the New England Journal of Medicine.

No more.

That respect was reduced significantly in 2010 when I saw the following passage (as I wrote in my July 2010 post "Science or Politics? The New England Journal and The 'Meaningful Use Regulation for Electronic Health Records"):


... In the NEJM article "The 'Meaningful Use' Regulation for Electronic Health Records", David Blumenthal, M.D., M.P.P. (ONC Chair) and Marilyn Tavenner, R.N., M.H.A. (10.1056/NEJMp1006114, July 13, 2010) available at this link, the opening statement is (emphases mine):


The widespread use of electronic health records (EHRs) in the United States is inevitable. EHRs will improve caregivers’ decisions and patients’ outcomes. Once patients experience the benefits of this technology, they will demand nothing less from their providers. Hundreds of thousands of physicians have already seen these benefits in their clinical practice.


I think it fair to say those are grandiose statements and predictions presented with a tone of utmost certainty in one of the world's most respected scientific medical journals.

Even though it is a "perspectives" article, I once long ago learned that in writing in esteemed scientific journals of worldwide impact, statements of certainty were at best avoided, or if made should be exceptionally well referenced. I note the lack of footnotes showing the source(s) of these statements.

I also note the lack of mention of literature refuting or potentially refuting these statements of certainty. I can think of more than a few examples of the latter just off the top of my head [ref. 1-15 below, certainly not a comprehensive list but merely skimming the surface].

... So, did the NEJM publish fact, or political platitude?

Can someone provide a list of peer reviewed, rigorous studies that back the assertions of certainty in 10.1056/NEJMp1006114, and override the body of literature that could cast doubt on these assertions of certainty?

The negative if not bitter reader comments to yesterday's New York Times article on the health IT lobby (link) certainly cast some doubt.

My respect has dropped several more notches in 2013.

The NEJM has served as a PR journal for health IT once again.

In a correspondence piece "Early Results of the Meaningful Use Program for Electronic Health Records", N Engl J Med 2013; 368:779-780,  February 21, 2013 by Adam Wright, Ph.D., Stanislav Henkin, B.A., Joshua Feblowitz, M.S., Allison B. McCoy, Ph.D., David W. Bates, M.D. and Dean F. Sittig, Ph.D., the following statement is published (emphases mine):

... The downstream effects of meaningful use on quality, safety, and efficiency are not yet known, and further increases in EHR adoption, functionality for clinical decision support systems, and research are needed to ensure the effectiveness of the meaningful use program

I note that Begging the Question is a fallacy in which the premises include the claim that the conclusion is true or (directly or indirectly) assume that the conclusion is true.

Further, I made the following points in my Jan. 2010 post "Meaningfully Experimental Protocols and Interfaces to Nowhere? Nagging Questions On Healthcare IT Remain":

... there is a major problem with the term "meaningful use" itself:

This [term "meaningful use"] is an example of putting the cart before the horse, and is a semantically-based, self contained logical fallacy of sorts. If a health IT system is harmful, the term "meaningful use" is itself Orwellian. If we don't know if HIT is beneficial, or have doubts, then such as term presupposes that health IT is inherently beneficial. A better term would have been "good faith use" - use based on the faith or hope that health IT will have an overall positive effect. The term "meaningful use" jumps the gun and is more a political slogan than a "meaningful term."

I go further. Use of a term that a priori assumes some outcome reflects the antithesis of science. The term "meaningful use" in the domain of technology implies that those following the recipe for use of some technology, as well as their subjects, will experience meaningful outcomes. A parallel is in the logical fallacy of begging the question or circular argument, where the conclusion of an argument is among its premises.

In this current NEJM passage, the "question" of MU effectiveness is shamelessly begged like a hungry puppy begging for a Snausage doggie snack.



"Ensure the effectiveness?"  The inherent assumption is that MU (developed by consensus committee without supporting rigorous evidence of effectiveness), whose 'downstream effects' are admittedly unknown, WILL be effective - if only we spend MORE billions of dollars on the technology.

At best, the appropriate statement to have been made is this:

... The downstream effects of meaningful use on quality, safety, and efficiency are not yet known, and further increases in EHR adoption, functionality for clinical decision support systems, and research are needed to determine if meaningful use will have any positive impact on healthcare quality, safety and efficiency."

From a physician commenter overseas who excels in demolishing health IT propaganda: 

Seriously, did they proof read the last paragraph? How did the NEJM editors let that get printed? 

Given the recent food scandal in the UK, it is like the PM saying we are not quite sure that there's horsemeat in the Burgers and Lasagna so we are going to need to import a lot more of this muck from France, Poland & Romania before drawing any conclusions...

Shame on the New England Journal.  My respect for them is even lower than after the 2010 health IT advert as above.  This current letter's conclusion is a high school-level faux pas and, in my opinion, should not have been published in its present form.

-- SS

Addendum:  Let's see if they publish my Letter to the Editor on this matter, submitted today.

Second addendum:  a reader opined that MU could have a negative impact on quality, safety and efficiency (cf. yesterday's NYT article and reader comments, link).  While less likely, we just don't know.

Addendum Mar. 18, 2013

I received this today from the NEJM:

Your letter referring to the Wright article of 21-Feb-2013  has been received.  Because of the limited availability of space, we can publish only a fraction of the letters we receive.  Although we will not be able to print yours, we have forwarded a copy to the authors in case they wish to reply directly to you.
 
This is why I blog.

-- SS

Saturday, October 06, 2012

Good HIT, Bad HIT, HIMSS And Reckless Technology Advocacy: Will This Hurt President Obama?

HIMSS, the Health Information Systems Management Society, is the large vendor trade group representing healthcare IT sellers.

At the HIMSS blog entitled "Health IT is an essential element to transform the Nation’s healthcare system" (link), writes this with regard to the House  letter to HHS Secretary Sebelius asking her to suspend payments for the EHR Incentive Payments authorized in the American Recovery & Reinvestment Act of 2009:

HIMSS opposes halting the Meaningful Use EHR Incentive Program. Health IT is an essential, foundational element of any meaningful transformation of the Nation’s healthcare delivery system. 

(Of course, not mentioned is "transformed" into what, exactly; this utopian ideation is a topic for another time.)

A chart is then presented as to "how US civilian hospitals have, since the first incentive payments were made in second quarter, 2011, matured in their use of health IT."  Then this statement is made:

Healthcare providers are adopting certified EHRs and using them for meaningful purposes; thus, achieving Congressional intent to improve the quality, safety, and cost-effectiveness of care in U.S.

Really?  (See my Feb. 2012 post "Hospitals and Doctors Use Health IT at Their Own Risk - Even if Certified.")

This non-evidence based, amoral advocacy by HIMSS for health IT may cost the President the November election.  HIMSS has beguiled the president into similar unquestioning advocacy for the technology in its present form, which his opponents are now (rightfully) seizing upon as in the House letter.

The reckless mistakes made by HIMSS and their advocates include these two:

1.   The unquestioned belief that this expensive technology would save billions of dollars in healthcare costs, instead of depleting precious healthcare resources better spent on, say, improvement of healthcare services for the poor.

2.  More importantly, the appallingly naïve belief that any health IT is good health IT, and that any health IT is only capable of good, not bad.

HIMSS has thus failed to recognize - or perhaps worse, recognized but recklessly ignored - the profound difference between good health IT (GHIT) and bad health IT (BHIT).

As I defined at my teaching site on Medical Informatics:

Good Health IT ("GHIT") is defined as IT that provides a good user experience, enhances cognitive function, puts essential information as effortlessly as possible into the physician’s hands, keeps eHealth information secure, protects patient privacy and facilitates better practice of medicine and better outcomes.

Ba
d Health IT ("BHIT") is defined as IT that is ill-suited to purpose, hard to use, unreliable, loses data or provides incorrect data, causes cognitive overload, slows rather than facilitates users, lacks appropriate alerts, creates the need for hypervigilance (i.e., towards avoiding IT-related mishaps) that increases stress, is lacking in security, compromises patient privacy or otherwise demonstrates suboptimal design and/or implementation.  

I am an advocate of the former, and an opponent of the latter.

Bad health IT is prevalent in 2012 due to lack of meaningful quality control, software validation, usability standards and testing, and regulation of any type - a situation HIMSS long favored.   (The failed National Programme for HIT [NPfIT] in the NHS learned this the hard way, as will Australians needing emergency care, I predict.)

Put bluntly, in the end BHIT maims and kills patients, squanders precious healthcare resources, and drains the treasury into IT industry pockets (see my Oct. 3, 2012 post "Honesty and Good Sense on Electronic Medical Records From Down Under" and this query link on health IT risks). 

Further, the failure to recognize that the technology's downsides need to be understood and remediated before national deployment occurs and under controlled conditions, not after (which uses patients as non-consenting experimental subjects for software debugging), speaks to gross corporate negligence on the part of HIMSS.  It's not as if they did not have advance warning of all of healthcare IT's deficiencies. 

BHIT also permits record alterations after the fact that may be to conceal medical error.  I am aware of numerous instances of such alterations, fortunately caught by critical-thinking, detail-minded attorneys.  However, like health IT harms, the incidences of known alteration attempts likely reflect the "tip of the iceberg."

HIMSS and its fellow travelers have thus led this administration down the Garden Path of health IT perdition.

I warned of this in a Feb. 18, 2009 Wall Street Journal letter to the editor:

Dear Wall Street Journal:

You observe that the true political goal is socialized medicine facilitated by health care information technology. You note that the public is being deceived, as the rules behind this takeover were stealthily inserted in the stimulus bill.

I have a different view on who is deceiving whom. In fact, it is the government that has been deceived by the HIT industry and its pundits. Stated directly, the administration is deluded about the true difficulty of making large-scale health IT work. The beneficiaries will largely be the IT industry and IT management consultants.

For £12.7 billion the U.K., which already has socialized medicine, still does not have a working national HIT system, but instead has a major IT quagmire, some of it caused by U.S. HIT vendors. [That project, the NPfIT in the NHS, has now been abandoned - ed.]

HIT (with a few exceptions) is largely a disaster. I'm far more concerned about a mega-expensive IT misadventure than an IT-empowered takeover of medicine.

The stimulus bill, to its credit, recognizes the need for research on improving HIT. However this is a tool to facilitate clinical care, not a cybernetic miracle to revolutionize medicine. The government has bought the IT magic bullet exuberance hook, line and sinker.

I can only hope patients get something worthwhile for the $20 billion.


Scot Silverstein, MD

Mr. President, again, quite bluntly, the health IT industry took you for a ride, and the damage is done and is continuing due to lack of any meaningful health IT post market surveillance.   (As I wrote here, the untoward results have already been used against the current administration, with more perhaps to follow.)

In the U.S. we have the 1938 Federal Food, Drug, and Cosmetic Act (FD&C Act) in place:

The introduction of this act was influenced by the death of more than 100 patients due to a sulfanilamide medication where diethylene glycol was used to dissolve the drug and make a liquid form.  See Elixir Sulfanilamide disaster. It replaced the earlier Pure Food and Drug Act of 1906.

It should be honored, not ignored via special accommodation to the health IT industry and its trade group.

HITECH also needs to be put in dormancy until the problems with these unregulated medical devices get worked out in relatively small, controlled settings to minimize risk, with patient informed consent.  This is in accord with human rights documents dating at least to the Nuremberg Code, as in any new, experimental or partly-experimental medical device, pharmaceutical, or therapy.

-- SS
 

Wednesday, August 29, 2012

The Scientific Justification for Meaningul Use, Stage 2: The NWB Methodology

The Final Rule for Meaningful Use Stage 2 has been released.  It is at this link (PDF).  It is a mere 672 pages in length, a quick read during one's evenings of leisure.

Here is, from page 18 verbatim, the scientific justification for the program.  The finest scientific methods were used to achieve these criteria in justification of spending of $15 billion of taxpayer money in "incentives" (probably a low estimate), not counting the additional hundreds of billions the buyers themselves will spend that is diverted from your healthcare to the IT sector:

3. Summary of Costs and Benefits

This final rule is anticipated to have an annual effect on the economy of $100 million or more, making it an economically significant rule under the Executive Order and a major rule under the Congressional Review Act.

Accordingly, we have prepared a Regulatory Impact Analysis that to the best of our ability presents the costs and benefits of the final rule. The total Federal cost of the Medicare and Medicaid EHR Incentive Programs between 2014 and 2019 is estimated to be $15.4 billion (these estimates include net payment adjustments for Medicare providers who do not achieve meaningful use in 2015 and subsequent years in the amount of $2.1 billion).

In this final rule we have not quantified the overall benefits to the industry, nor to EPs, eligible hospitals, or CAHs participating in the Medicare and Medicaid EHR Incentive Programs. Information on the costs and benefits of adopting systems specifically meeting the requirements for the EHR Incentive Programs has not yet been collected and information on costs and benefits overall is limited. 

Nonetheless, we believe there are substantial benefits that can be obtained by eligible hospitals and EPs, including reductions in medical recordkeeping costs, reductions in repeat tests, decreases in length of stay, increased patient safety, and reduced medical errors. There is evidence to support the cost-saving benefits anticipated from wider adoption of EHRs.

There's no truly robust evidence of generalizable benefit, no randomized trials, there's significant evidence to the contrary (that, incidentally, is deliberately being ignored), there's risk to safety that this disruptive technology causes in its present state (but the magnitude is unknown, see quotes from 2012 IOM study here) that MU and "certification" do not address, there's a plethora of hair-raising defect reports from the only seller that reports such things, but CMS justifies the program with the line:

"Evidence [on benefits] is limited ... Nonetheless, we believe there are substantial benefits that can be obtained by eligible hospitals and EPs ... There is evidence to support the cost-saving benefits anticipated from wider adoption of EHRs."

I am deeply impressed by the level of rigorous science here.  We are truly in a golden age of science.

I recommend NIH, NSF, FDA and all other research and regulatory agencies immediately adopt this rigorous HHS methodology (called the "NWB" methodology for "nonetheless we believe") in their professional pursuits and research grant approval processes.

-- SS

Friday, March 09, 2012

Increased Lab Ordering with EHR's?

ONC has once more proffered typical politically-motivated spin with regard to the Harvard study "Giving Office-Based Physicians Electronic Access To Patients’ Prior Imaging And Lab Results Did Not Deter Ordering Of Tests" that I wrote about at "Another Health IT Mythbuster: Doctors order more X-rays, not fewer, with computer access."

That study had the rather tame, reasonable conclusion:

... These findings raise the possibility that, as currently implemented, electronic access does not decrease test ordering in the office setting and may even increase it, possibly because of system features that are enticements to ordering. We conclude that use of these health information technologies, whatever their other benefits, remains unproven as an effective cost-control strategy with respect to reducing the ordering of unnecessary tests.

The ONC response (posted here at present) to such a mild conclusion about an experimental technology seemed very splenetic.

As I mentioned at the aforementioned post, ONC has thrown good science under the bus before, for political purposes in my view:

... On the other hand, coming from a political office that clearly does not understand how to conduct qualitative research and creates political promotion pieces masquerading as "research", such a statement is not surprising. See "ONC: "The Benefits Of Health Information Technology: A Review Of The Recent Literature Shows Predominantly Positive Results" at this link, where essential research methodologies were thrown under the bus for publication in Health Affairs.
At least the deviations from rigorous research methodologies were admitted:

“... Our findings must be qualified by two important limitations: the question of publication bias [e.g., bias in evidence selection - ed.], and the fact that we implicitly gave equal weight to all studies regardless of study design or sample size.”

Unfortunately, the media, politicians, financial decisionmakers and others are likely not to really comprehend, in-depth, the full significance of that sentence.

I am in the unfortunate situation of again having to stuff ONC's - um, stuff - back into the bull.

First, hat tip to Histalk where I found the link below:

National Coordinator for HIT Farzad Mostashari, MD takes issue with the recently published report that found doctors with online access to patients’ charts ordered more tests. Mostashari disputes the study, which raised questions as to whether or not EHRs cut costs. Mostashari’s contends that the study was based on 2008 data and before the start of the Meaningful Use program and thus does not address certified EHRs’ capabilities for data exchange and clinical data support.

The fatal passage in the linked ONC piece at http://www.healthit.gov/buzz-blog/meaningful-use/study-facts/ is this:


"Also, the study data were from 2008, before the passage of the HITECH Act and the linking of payment incentives to the meaningful use of EHRs."

This seems a variation of the typical excuse-making in IT - "they were using v. 1.0; it's all fixed in the later version."

The outcomes of (Orwellian-named) "Meaningful Use" (MU) have not been studied, to my knowledge. Futher, the criteria chosen for "Meaningful Use" were primarily best guesses as to what could be beneficial. ("Meaningful Use" should have been more accurately termed "good faith use.")

Claiming that 2008 data on EHR-related test ordering is invalid because "Meaningful Use" was not in effect at the time is, in fact, jumping to an unsupported conclusion that "Meaningful Use" will counter whatever multiple medical/social factors caused the increased ordering in the first place -- because, of course, MU is "Meaningful" and deterministically guaranteed to work out, nationally, as planned, among all outpatient and inpatient settings.

This seems a form of "begging the question":

Begging the Question is a fallacy in which the premises include the claim that the conclusion is true or (directly or indirectly) assume that the conclusion is true. This sort of "reasoning" typically has the following form.

- Premises in which the truth of the conclusion is claimed or the truth of the conclusion is assumed (either directly or indirectly).
- Claim C (the conclusion) is true.

This sort of "reasoning" is fallacious because simply assuming that the conclusion is true (directly or indirectly) in the premises does not constitute evidence for that conclusion. Obviously, simply assuming a claim is true does not serve as evidence for that claim. This is especially clear in particularly blatant cases: "X is true. The evidence for this claim is that X is true."

I note that the MU criteria are themselves evolving and not finalized. Making predictions about the future is the domain of fortune tellers with crystal balls, not scientists:

Health IT WILL reduce costs and improve caregivers’ decisions and patients’ outcomes. It is written in the stars!

ONC seems to think it is capable of such certainty
, as I wrote in mid-2010 at "Science or Politics? The New England Journal and "The 'Meaningful Use' Regulation for Electronic Health Records":

... The widespread use of electronic health records (EHRs) in the United States is inevitable. EHRs will improve caregivers’ decisions and patients’ outcomes. Once patients experience the benefits of this technology, they will demand nothing less from their providers. Hundreds of thousands of physicians have already seen these benefits in their clinical practice.


In its current piece, ONC goes on to state:


Reducing Test Orders Is Not the Way that Health IT Is Meant to Reduce Costs

The ultimate impact of EHRs on reducing cost will be through improvements in the coordination and quality of care, and the prevention of unnecessary and costly complications and hospitalizations. [Note the mysterious disappearance of the word "tests" - ed.] Providers who are embracing new delivery and payment models such as Accountable Care Organizations and Patient-Centered Medical Homes know that meaningful use of EHRs is a critical foundation for being able to improve quality while reducing cost.


That is, simply, a lie. Reducing test utilization has long been claimed as a benefit of EHR's.

For example, from http://www.healthit.gov/patients-families/benefits-health-it:

EHRs reduce unnecessary tests and procedures. Have you ever had to repeat medical tests ordered by one doctor because the results weren’t readily available to another doctor? Those tests may have been uncomfortable and inconvenient or have posed some risk, and they also cost money. Repeating tests—whether a $20 blood test or a $2,000 MRI--results in higher costs to you in the form of bigger bills and increased insurance premiums. With EHRs, all of your care providers can have access to all your test results and records at once, reducing the potential for unnecessary repeat tests.

It is also another example of "moving the goalposts", a defense often used by those without a sound argument; by politicians; and sometimes by - scoundrels.

(I observed another "moving of the goalposts" at my aforementioned post "Another Health IT Mythbuster: Doctors order more X-rays, not fewer, with computer access." In that post I observed Michael Furukawa, a health economist in the ONC office, stating that the researchers’ focus was not "deep enough" to support the study’s conclusions. He wrote: “The data are sound, the methods are appropriate, but the focus is limited,” he said. “They only looked at one piece of health IT.”)

Well, yes, and the piece they looked at should set off red flags that the assumptions about health IT and savings might be erroneous - not generate excuses that the goalposts were too close, and need to be moved further away.

This is not to mention that it appears most healthcare errors have little to do with documentation, as I outlined in my Dec. 2010 post "Is Healthcare IT a Solution to the Wrong Problem?"

I particularly take issue with the ONC statement that:

... this was not a randomized trial, but an observational study (the National Ambulatory Medical Survey) that was not designed to answer the question of cost, or associations between EHRs and quality. As a result, many other variables that could affect physician behavior could not be examined in this study

Yet in the aforementioned ONC "predominantly positive results" literature survey described at this link, ONC "implicitly gave equal weight to all studies regardless of study design or sample size." Their review thus included qualitative studies that were probably not meant to be evaluative, and observational studies subject to severe methodological bias, yet all were weighted equally. Further, studies contradicting the 'narrative' of health IT efficacy and beneficence such as in this list appear to have been excluded.

This appears a prime example of, at best, "the pot calling the teakettle black", and raises doubts as to ONC's objectivity and perhaps even intellectual honesty. Of course, they are a political office with a mission, so perhaps this can be understood. (Not excused, but understood.)

ONC also views risk management-critical reports of health IT-caused harm as "anecdotal", a scientific and ethical faux pas (or is it willful blindness?) of major proportions.

As I wrote at my April 2001 post "Making a Stat Less Significant: Common Sense on "Side Effects" Lacking in Healthcare IT Sector":

... This view [of negative HIT reports being 'anecdotes'] extends all the way up to the Director of the Office of the National Coordinator for Health IT, who glibly stated per the Aug. 2010 Huffington Post Investigative Fund article FDA, Obama Digital Medical Records Team at Odds over Safety Oversight that FDA's own reports of health IT related injuries and deaths were “anecdotal":

ONC director Blumenthal, the point man for the administration, has called the FDA’s injury findings “anecdotal and fragmentary.” He told the Investigative Fund that he believed nothing in the report indicated a need for regulation.

Those "injury findings" appear in an FDA Internal Memo made available by the aforementioned Huffington Post Investigative Fund and archived at the following link:


Internal FDA memorandum on HIT risks (PDF) to Jeffrey Shuren MD JD (Director, Center for Devices and Radiological Health). Health Information Technology (H-IT) Safety Issues. "This is an Internal Document Not Intended for Public Use." Feb. 23, 2010.

(
My description/summary of the memorandum is at my Aug. 2010 post "Internal FDA memorandum of Feb. 23, 2010 to Jeffrey Shuren on HIT risks. Smoking gun?")

The definitive take-down of the "anecdote" canard is at this link.

One could wonder if a criteria for work at ONC is a Ddulite disposition ('Luddite' with first four characters reversed):


Ddulites: Hyper-enthusiastic technophiles who either deliberately ignore or are blinded to technology's downsides, ethical issues, and repeated local and mass failures.

Instead of logical fallacy and "spin", perhaps the ONC would be better served by sponsoring some (independent, objective) researchers to actually conduct research supporting their claims about the effects of the "Meaningful Use" program.

Finally, perhaps ONC should ask my mother what she thinks about EHRs. She has specially-acquired firsthand expertise. They can find her here.

-- SS

Addendum 3/9/12:

At my Feb. 2011 post "Does EHR-Incited Upcoding (Also Known as "Fraud") Need Investigation by CMS, And Could it Explain HIT Irrational Exuberance " is another side effect on costs of EHR's in inpatient settings, specifically, the ED.

-- SS

Addendum 3/11/12:

Another article in 2010 by Himmelstein, Woolhandler & Wright had reached related conclusions:


Hospital Computing and the Costs and Quality of Care: A National Study

David U. Himmelstein, MD, Adam Wright, PhD,Steffie Woolhandler, MD, MPH
The American Journal of Medicine Volume 123, Issue 1 , Pages 40-46, January 2010

Background

Many believe that computerization will improve health care quality, reduce costs, and increase administrative efficiency. However, no previous studies have examined computerization's cost and quality impacts at a diverse national sample of hospitals.

Methods

We linked data from an annual survey of computerization at approximately 4000 hospitals for the period from 2003 to 2007 with administrative cost data from Medicare Cost Reports and cost and quality data from the 2008 Dartmouth Health Atlas. We calculated an overall computerization score and 3 subscores based on 24 individual computer applications, including the use of computerized practitioner order entry and electronic medical records. We analyzed whether more computerized hospitals had lower costs of care or administration, or better quality. We also compared hospitals included on a list of the “100 Most Wired” with others.

Results

More computerized hospitals had higher total costs in bivariate analyses (r=0.06, P=.001) but not multivariate analyses (P=.69). Neither overall computerization scores nor subscores were consistently related to administrative costs, but hospitals that increased computerization faster had more rapid administrative cost increases (P=.0001). Higher overall computerization scores correlated weakly with better quality scores for acute myocardial infarction (r=0.07, P=.003), but not for heart failure, pneumonia, or the 3 conditions combined. In multivariate analyses, more computerized hospitals had slightly better quality. Hospitals on the “Most Wired” list performed no better than others on quality, costs, or administrative costs.

Conclusion

As currently implemented, hospital computing might modestly improve process measures of quality but does not reduce administrative or overall costs.

-- SS

Monday, February 27, 2012

Health IT Culture: Severe Overconfidence (Arrogance?) Shows In The Industry's Very Terminology For Their Deliverables

Health IT commentator Neil Versel notes in his piece "HIMSS12 notes" at his site Meaningful Health IT News that:

I am in 100 percent agreement with something Dr. Wendy Sue Swanson, a.k.a. Seattle Mama Doc, said during an engaging presentation Monday at the HIMSS/CHIME CIO Forum. She made the astute observation that there needs to be better distinction between expertise and merely experience when it comes to celebrities being held up as “experts” in healthcare and medicine. Let’s just say that Swanson, as a pediatrician, is no fan of some of the things Jenny McCarthy and Dr. Mehmet Oz have told wide audiences.

He posted a link to his piece in a social networking site we both visit. I commented:

To that, I add "healthcare IT" where it seems anyone who's done anything with a computer in some medical setting can get away with calling themselves a "medical informatics expert" or "health IT expert." As in ham radio levels of just a few years ago, we need distinctions between novice class, technician class, general class, advanced class, and extra class.


In his piece Neil also linked to what he correctly termed "scathing critique" of the venue for HIMSS 2012 at my HC Renewal post "
HIMSS Annual Meeting in Las Vegas - Fitting for People Who Gamble With People's Lives to Make a Buck?"

I replied to him via the social networking site that:

"I like to point out ironies that seem to escape others, although I have heard from other colleagues that I was not alone in finding Las Vegas a somewhat peculiar place for a medical meeting about improving health! However, others' mileage may vary."

Neil noted that he likes pointing out ironies, too, and gave as an example as the meetings held at the Loews Hotel near Vanderbilt University Medical Center, being that Loews Hotels is a corporate cousin of Lorrilard Tobacco.

Finally, Neil comments:

Popular topics this year were the expected meaningful use and ICD-10, plus the buzzwords of the moment, business analytics and big data. I’d be happy I never hear the word “solution” as a synonym for “product” or “service” again. To me, that represents lazy marketing. Get yourself a thesaurus.

I agreed, and replied that:

"Solution", the common term in IT for anything an IT department or company provides, is a one-word example of a language usage akin to 'begging the question.'

This term, in one mere word, reflects a stunning arrogance within the IT culture.

I also noted that:

... there needs to be terminological consistency. If the IT vendors can call their wares "solutions", then doctors should call their treatments and drugs "cures." Come to my office for your cure; I am a curer; I write cures, not prescriptions.

I also noted that the term "meaningful use" phrase selected by the U.S. government/HHS for EHR adoption according to printed guidelines is another example of terminology that, ante hoc, assumes its semantics are correct.

How do we know the use is "meaningful" until such use is studied rigorously and outcomes, costs. etc. assessed?

Answer: we don't.

And this administration criticized the previous one for politicizing science ... George Orwell could not have selected better terms than "meaningful use", "certified EHR", and "solution" as examples of "Newspeak" in 1984.

-- SS


Friday, April 22, 2011

Henry Ford Health System Decides Meaningful Use Not That Meaningful

The CMIO for inpatient services for Henry Ford Health System discusses the Michigan system's decision to hold off on applying for meaningful use funding in 2011, and what that means for its long-term vision of connecting clinical goals with IT support. April 15, 2011. Podcast running time: 3:58 (link to podcast).

Excerpts:

“The clinician experience of delivering care has never been more complicated. Implementation and adoption of these Electronic Health Records seems to be to many people an end in itself—and that’s unfortunate.

The implementation and adoption of EHR is a means to an end and one of those ends is better patient care and another one is clinician efficiency or better and more effective care. And that part feels to me that it gets lower priority and gets overlooked for the sake of adoption and implementation especially now with the federal requirements coming on.

Now we must adopt, adopt, adopt. And the clinician experience is left behind. The complexity of being a physician is almost overwhelming both in the hospital and clinic setting and that’s one of my great concerns.”

- John Frownfelter, MD CMIO, Henry Ford Health System


Health IT in its present poorly usable form only makes being a clinician more overwhelming. As I wrote at "Meaningful Use Final Rule", meaningful use initiatives before "meaningful usability" has been achieved have put the cart before the horse.

Henry Ford, inventor of the assembly line, would probably have approved. An assembly line is appropriate for building identical widgets, but inappropriate for the implementation of health IT in the extremely complex, poorly bounded, conflicted, highly variable, uncertain, high-tempo work domain of hospitals, especially if the implementation is just for implementation's sake.

-- SS