Korean J Pain 2023; 36(3): 269-271
Published online July 1, 2023 https://doi.org/10.3344/kjp.23173
Copyright © The Korean Pain Society.
1Department of Anesthesiology and Pain Medicine, Chungnam National University Hospital, Daejeon, Korea
2Department of Anesthesiology and Pain Medicine, College of Medicine, Chungnam National University, Daejeon, Korea
Correspondence to:Boohwi Hong
Department of Anaesthesiology and Pain Medicine, Chungnam National University Hospital, 282 Munhwa-ro, Jung-gu, Daejeon 35015, Korea
Tel: +82-42-280-7840, Fax: +82-42-280-7968, E-mail: firstname.lastname@example.org
Handling Editor: Francis S. Nahm
Received: June 7, 2023; Revised: June 12, 2023; Accepted: June 12, 2023
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/), which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
According to the instructions for authors in The Korean Journal of Pain (KJP), it is recommended to provide an effect size and its corresponding estimates. Additionally, it suggests being cautious about reporting
“Confidence intervals or effect sizes should be presented with P values. P values should not be presented alone and should be presented with confidence intervals.”
Furthermore, in the consolidated standards of reporting trials (CONSORT) statement, which serves as the reporting guidelines for randomized controlled trials (RCTs), the following reporting items are recommended to be included .
“For each primary and secondary outcome, results for each group, and the estimated effect size and its precision (such as 95% confidence interval). For binary outcomes, presentation of both absolute and relative effect sizes is recommended.”
From 2020 onwards, a search in the KJP archive with the terms "randomized" or "randomised" in the title yielded a total of 23 RCTs (Supplementary Table 1). Among these studies, only three reported the effect size and confidence interval (CI) for the primary outcome [2-4]. In some studies, only the effect size according to the measurement time points within the groups was reported without the effect size and CI between the groups.
However, it is important to note that a
“A P-value, or statistical significance, does not measure the size of an effect or the importance of a result.”
Furthermore, clinical significance in research findings can be evaluated by establishing a “minimally clinically important difference (MCID)” prior to the study commencement and comparing the CI of the effect size to that predetermined difference . The term MCID refers to the smallest change in a clinical outcome that patients perceive as meaningful and significant . The emphasis is on recognizing clinically important or meaningful changes from the patient's perspective, rather than simply focusing on statistically significant differences. For example, if the MCID for a pain score is determined to be ‘1’ based on prior evidence , and the lower limit of the CI in the study is greater than ‘1’, it indicates that the study findings are not only statistically significant but also hold clinical significance. In well-designed RCTs, readers should be able to assess the clinical significance of the research findings independently of statistical significance, and the effect size and CI can play a role in facilitating this assessment .
Although readers can calculate the effect size directly using the provided data (mean, standard deviation, and sample size for continuous outcome, or a contingency table for binary outcome), providing the effect size can alleviate this burden for readers. Moreover, it enhances the clarity of research findings, promotes transparency, and facilitates a better understanding of the study’s impact.
Given these considerations, I strongly advocate for a more robust and explicit recommendation regarding reporting effect size measures and their corresponding estimates.
Supplementary materials can be found via https://doi.org/10.3344/kjp.23173.
Data sharing is not applicable to this article as no datasets were generated or analyzed for this paper.
No potential conflict of interest relevant to this article was reported.
No funding to declare.
Boohwi Hong: Writing/manuscript preparation.