Tools that gather and analyze data often require refinements (think bug fixes for apps). The same has proved true for the new CoAEMSP Annual Report. Though the pilot conducted last year provided useful feedback, full implementation of the 2017 report revealed additional fixes to be implemented for the 2018 year.
One of the key outcome metrics is the success rate on the credentialing exam. Ideally, all graduates sit for an exam (e.g. State or National Registry) shortly after program completion. In some situations, graduates elect not to seek a credential as a Paramedic.
The new Annual Report based the success rate on the number of total graduates, rather than the number of individuals attempting the NREMT or state exam. The CoAEMSP recognizes that this approach can produce a numerical result that does not reflect the actual success of program graduates.
Since programs must accurately post the outcome success measures from the Annual Report on the home page of the Paramedic Program website, programs that choose not to publish its certification results for the 2017 calendar year will not be penalized. Programs that
do choose to publish certification results are urged to do so with caution, ensuring the data reflects the percentage of individuals passing the exam based on the number attempting the exam.
The 2018 Annual Report will address this issue by adding a row and a formula permitting the certification pass rate to be calculated based on the number of individuals attempting a certification exam rather than total graduates of the program.
Please note: Programs will still be required to post their attrition and placement statistics from the 2017 Annual Report.
Other updates to the Report are being discussed and include clarification of parameters for determining attrition dates as well as challenges of locating graduates, and identifying employers to complete the graduate and employer survey process. Credentialing reporting for programs in states that provide both the NREMT and state exam option can also be challenging, especially since some graduates complete both exams and the program receives both results but can only report one (the number of graduates attempting an exam cannot exceed the number of graduates). The CoAEMSP staff is working on solutions for these challenges in its continual effort to offer a meaningful report that provides valuable information to Programs and the public, to both reflect and act upon its outcome measures.
