When evaluating healthcare integration engines, finding trusted sources for reviews online can be extremely complicated. Health IT publications do not provide software reviews like industries outside of healthcare and there are no sources with Amazon-like rankings and reviews available.
The most trusted, and really only, source of customer reviews for health IT products is KLAS Research, which publishes an annual “Best in KLAS” list that ranks software based on key criteria. For the past eight consecutive years, Corepoint Integration Engine has been named the highest-rated integration engine in healthcare.
— KLAS (@KLASresearch) January 31, 2017
The KLAS Software and Services report, however, is not free or readily available online without registration. You can view a summary of the report’s evaluation of the integration engine segment – including scoring – here. You can also read a post by our CTO, titled Comparing interface engines.
Because the integration engine evaluation typically is an extensive process, OTB Solutions, a group of independent healthcare consultants, put together a helpful white paper to help organizations avoid a mistake in their engine selection.
Making an uninformed decision is not in the organization’s best interest. According to the paper, there are several reasons why engine selections fail:
- Biases: toward a vendor or toward a technology
- Rushed decision making
- Only a single vendor considered
- Replacing what is known instead of what could be
- Misjudging skill level of development team
- Misjudging the level of effort required to change interface engines
- Misunderstanding the role of the interface engine in the organization’s healthcare ecosystem
- Not identifying or understanding the stakeholders
OTB created a 13-step process to help prevent a failed engine selection. This process can make up to three months for large organizations and approximately 1 month for organizations with small or outsourced interface teams. Here is their process:
- Develop requirements
- Create RFI (request for information)
- Identify vendors and submit RFI
- Score RFI
- Invite vendors for sales demo
- Score sales demo
- Invite vendors for Proof of Concept
- Score Proof of Concept
- Send out RFP (request for purchase)
- Score RFP including financial component
- Select vendor
- Negotiate the final details and obtain final signatures
- Socialize the selection in your organization
As an integration engine vendor ourselves, we’ve found that some of the strongest indicators of success are what actual engine users think about the product. We always encourage prospects to call product users who are similar in size with similar Electronic Health Record (EHR), as defined in Defining Key Health Information Technology Terms (The National Alliance for Health Information Technology, April 28, 2008): An electronic record of health-related information on an individual that conform... and health IT applications installed.
Some of the questions prospects are looking for include:
- Would you buy from the vendor again?
- Did the vendor do what they said they would do?
- How close was the expected level of complexity to the actual level of complexity?
- Have you ever been “boxed-in” with the software, not being able to solve a problem?
- How easy has the software been to maintain?
As the saying goes, if you fail to prepare you prepare to fail. Hopefully this information will help you make a decision that is right for your organization.Tags: engine evaluation