Hi:
We would use more than one metrics to test the significance of a
study. The most often used ones are sensitivity (SE) and specificity
(SP). However, this pair would be affected by the disease prevalence.
In contrast, the positive/negative predictive values (P/NPVs) are not affected by the prevalence.
The first question now is: if we choose to use the P/NPVs for testing the significance, do we also test the significance for the SE and SP? Or do we only use one of the two pairs?do not test for the SE and SP?
The second question is that the value of the area under the receiver operating characteristic (AU-ROC) curve is a summary measure of the sensitivity and specificity. Does it mean that if we use the value of the AU-ROC for testing the significance, we
The third question is that is there a replacement of the value of the AU-ROC if we are concerned about the influence of the prevalence?
On Thu, 25 Nov 2021 12:36:29 -0800 (PST), Cosine <ase...@gmail.com>
wrote:
Hi:
We would use more than one metrics to test the significance of aI would not say it that way. The PPV is /based on/ the prevalence.
study. The most often used ones are sensitivity (SE) and specificity
(SP). However, this pair would be affected by the disease prevalence.
In contrast, the positive/negative predictive values (P/NPVs) are not affected by the prevalence.
It assumes a single value for the prevalence. The rarer the condition,
the more likely the Positive is False.
If you know the prevalence pretty well, you should use it for
your description. "Testing the significance" uses the same set
of numbers, same 2x2 table (I presume) for SE and SP, so you
don't expect more power from one than for the other. It should
be the same test.
If you are interested in tests across the whole ROC curve, you
test the curve. If you are interested in some specific prevalence,
you test at that value.
Sysop: | Keyop |
---|---|
Location: | Huddersfield, West Yorkshire, UK |
Users: | 293 |
Nodes: | 16 (2 / 14) |
Uptime: | 240:20:22 |
Calls: | 6,624 |
Files: | 12,173 |
Messages: | 5,320,077 |