Test result and evidence result disagree

Sometimes parts of an operating effectiveness check disagree. Find out why that happens and what you can do about it

With the release of citations for the operating effectiveness (OE) check, more details about how the OE check result was determined are visible.

OE checks now include extensive details which are structured like this:

As you'd expect, if any test conducted as part of an OE check fails, the entire check will be marked as failing.

If evidence under a test fails though, the test result may not actually fail. Here's why that can happen:

The evidence wasn't applicable. The OE check will sometimes look at evidence that wasn't actually relevant or applicable to the particular control test. That evidence may "fail" the test, but it wasn't actually relevant. In that case the piece of evidence will still be marked as failing, but the test result will be passing and the explanation will say why the particular piece of evidence didn't actually count towards the test result.
The test result incorrectly concluded the evidence wasn't applicable. Sometimes the test result analysis will conclude an evidence result didn't matter, but it actually did. In this case, this is a mistake. Trustero is working on making this happen as seldom as possible, but it does occur occasionally. In those cases, you can edit the OE check result. This allows the organization to enter the right answer and it is also a signal to Trustero to investigate and helps us make the product better.