We were interested to read the article by Maney and colleagues1  published in this issue of the Journal of Oral Implantology. The authors aimed to assess the reliability of implant surgical guides based on soft-tissue models and reported that the accuracy was evaluated using software. I found the article's title to be incorrect and misleading. Moreover, they reported that 22 sites (46.81%) were considered accurate (13 of 24 maxillary and 9 of 23 mandibular sites). As the authors point out in their conclusion, soft-tissue models do not always provide sufficient accuracy for fabricating implant surgical guides.

Reliability (precision) and validity (accuracy) are different methodological issues in researches. Sensitivity, specificity, positive predictive value, negative predictive value, likelihood ratio positive (true positive/false positive), and likelihood ratio negative (false negative/true negative), as well as odds ratio (true results/false results, preferably more than 50), are among the tests used to evaluate the validity (accuracy) of a single test compared to a gold standard.24  It is not clear that the reported 22 sites (46.81%) that were considered accurate related to any the aforementioned estimates for validity analysis. Reliability (repeatability or reproducibility) is being assessed by different statistical tests, such as Pearson r, least square, and paired t test, all of which result in common mistakes in reliability analysis.5  Briefly, for quantitative variable intraclass correlation coefficient and for qualitative variables, weighted kappa should be used with caution because kappa has its own limitation, too. Regarding reliability or agreement, it is good to know that for computing kappa value, only concordant cells are being considered, whereas discordant cells should also be taken into account to reach a correct estimation of agreement (weighted kappa).24  As a take-home message, for reliability and validity analysis, appropriate tests should be applied.

References

References
1
Maney
P
,
Simmons
DE
,
Palaiologou
A
,
Kee
E
.
Reliability of Soft Tissue Model Based Implant Surgical Guides
.
J Oral Implantol
.
2012
;
38
:
723
727
.
2
Jeckel
JF
,
Katz
DL
,
Elmore
JG
,
Wild
DMG
.
Epidemiology, Biostatistics and Preventive Medicine. 3rd ed
.
Philadelphia, Pa
:
Saunders Elsevier
;
2007
.
3
Rothman
JK
,
Greenland
S
,
Lash
TL
.
Modern Epidemiology
.
3rd ed
.
Baltimore, Md
:
Lippincott Williams & Wilkins
;
2008
.
4
Szklo
M
,
Nieto
FJ
.
Epidemiology: Beyond the Basics
.
2nd ed
.
New York, NY
:
Jones and Bartlett Publisher
;
2007
.
5
Bland
JM
,
Altman
DG
.
Agreed statistics: measurement method comparison
.
Anesthesiology
.
2012
;
116
:
182
185
.