| Abstract|| |
Context: Caries risk assessment (CRA) varies between students and faculty due to the subjectivity inherent in the process as well as in the critical thinking skills required for the processing of information.
Aims: The aim was to develop a paper-based, grid system, CRA-Grid, to objectivize and standardize risk assessment and to assess its rating agreement with the critical thinking process of the teachers.
Settings and Design: The CRA-Grid was developed and tested in a clinical study, in Indira Gandhi Institute of Dental Sciences, Puducherry.
Materials and Methods: Based on the currently available evidence, specific weightages were assigned to the risk factors in an existing CRA form. A 10 × 10 paper grid was created incorporating these weightages. Shading and summing up the respective squares in the grid provided a percentage score. The class interval of percentage indicating the risk status was determined using historical clinical data. After training, the students performed CRA of 57 patients by using the CRA-Grid. Six faculties were blinded to these scores and assessed the risk by critical thinking process.
Statistical Analysis Used: Cohen's weighted kappa (k) for inter-rater agreement was run using Graph Pad QuickCalcs.
Results: Cohen's weighted kappa for agreement at 95% confidence interval, between the CRA-Grid and critical thinking process, ranged from “gooda” to “very good.” Mean percentage of agreement of the six faculty was 79.6%; and with caries grid, was 80.5%.
Conclusions: Risk assessment with the paper-based, objectivized, CRA-Grid matched that done by critical thinking process.
Keywords: Critical thinking, dental caries; dental education; risk assessment
|How to cite this article:|
Ramarao S, Sathyanarayanan U. CRA Grid - A preliminary development and calibration of a paper-based objectivization of caries risk assessment in undergraduate dental education. J Conserv Dent 2019;22:185-90
|How to cite this URL:|
Ramarao S, Sathyanarayanan U. CRA Grid - A preliminary development and calibration of a paper-based objectivization of caries risk assessment in undergraduate dental education. J Conserv Dent [serial online] 2019 [cited 2019 Jul 17];22:185-90. Available from: http://www.jcd.org.in/text.asp?2019/22/2/185/257578
| Introduction|| |
Caries risk assessment (CRA) helps to identify the causative risk factors for dental caries and thus aid in tailor-made management plans.,,,, A CRA tool possesses questions on the social, behavioral, microbiologic, environmental, and clinical variables. Data collected is analyzed by critical thinking as in reason-based systems or by computer programs in algorithm-based systems. Without calibration, the faculty and the students tend to assign caries risk inconsistently. Critical thinking skills required are not similar between an expert and a novice. The variation can also be attributed to the inherent subjectivity and to the multifactorial nature of the disease.
The aim was to develop an objective system and to assess its rating agreement with the critical thinking process.
| Materials and Methods|| |
Development of the CRA-Grid
The CRA form that has been used by the authors for training in predoctoral dental education program since the year 2000 incorporated a systematic way of data collection and is broadly categorized as four sections, such as data obtained from: (1) History, (2) Habits, (3) Clinical evidence, and (4) Salivary analysis. This form was initially designed based on the previous evidence, modified to a certain extent to suit the local sociocultural issues., It was modified further with emerging new evidence such as CAMBRA, ADA guidelines, and ICCMS. The content of form was phrased in negativity, without binominal categorization as “Yes” and “No,” as currently being practiced by other systems, and therefore marking any factor indicates risk toward caries. [Table 1] shows the CRA form in use.
|Table 1: Caries risk assessment form depicting the risk factors along with weightage assigned to them|
Click here to view
Weightage was given to every factor with regard to their impact on dental caries. To assign the weightage, the authors had mapped their own critical thinking process in risk assessment by using historical database of previously recorded risk assessment forms. They reflectively and analytically, observed how and why they had arrived at specific risk status and how much of consideration they had given for the impact of a specific risk factor or a combination of risk factors, collected in the form. Current evidence on every factor was also taken into consideration for this purpose.
The salivary biomarkers such as low salivary flow, acidic pH, and low buffer have strong evidence linked to caries. The accuracy of salivary tests for mutans streptococci and lactobacilli is less, especially in low caries prevalence. They are more predictive for low caries risk than high caries risk. Thus, more weightage was given to the salivary flow, pH, and buffer than the salivary microbial count. Correlating with salivary flow rate, the history section of the form elicits drug intake that can possibly reduce salivary flow as well the head-and-neck radiation, the latter assuming more weightage.
The past clinical experience such as restorations and extractions for carious reasons assume profound predictive value. This detail is obtained in the past dental history section, as well as in the clinical examination section and has been weighted appropriately. The presence of large cavitated active lesions are considered as prime risk indicators. Therefore, maximum weightage has been given to these factors in the clinical findings.
Dental biofilm being one of the major biological risk factors, has been given considerable weight. Defective restorations and malposed or disfigured teeth that predispose to plaque stagnation have also been considered in weightage assignment. Corroborating the clinical plaque condition, the habit history part of the form, elicits the oral hygiene aids and measures being adopted by the patient.
Dietary intake of sugar has long been incriminated as the “arch criminal” in dental caries. The frequency of intake has been pointed to have profound impact on caries risk, than the quantity of sugar. Thus, the form has significant weightage placed on these factors, including the history section eliciting the use of syrup based medications and use of lozenges/chewing gums.
A recent systematic review concludes that socioeconomic factors such as education, income, and occupation are associated with caries. A consistent pattern of the severity of caries disease was found in patients with the familial-risk groups. These factors have been included in the weightage assignment. However, being confounding factors and not the biological risk factors in dental caries, all these factors have been allotted lesser weight than the other risk indicators and predictors.
Based on the above evidence and the authors' deliberation on their own critical thinking process, weightages were assigned to the major sections as well as the subfactors in each section, in percentage.
A 10 × 10 grid was made in a graph paper. The outer-most 36 squares represented the data from salivary analysis, the next inner box of 28 squares represented the data from clinical examination, the next inner 20 squares denoted the data obtained from habits, and the inner-most 16 squares denoted data from history. Under each section, the individual parameters occupied the number of squares based on the weightage assigned to them. For example, 1.1, which is susceptible age factor was assigned a weightage of 3% as opposed to 1.21 that denotes history of premature extraction due to caries, for which a weightage of 1% was assigned. Thus 1.1 occupied three squares and 1.21 occupied one square.
The data obtained for a patient, once entered in the Grid by shading the respective squares, when summed up at the end, will provide a percentage of risk factors contributing to dental caries. To finalize the class-interval of the percentage that denotes high/low/moderate risk, the authors had used the CRA-Grid on 100 previously recorded CRA forms that were analyzed by using critical thinking process. Thus, the following values were determined: low risk: <15%; moderate risk: 15%–25%; high risk: 25%–35%; and very high risk: >35%. [Figure 1] shows a sample CRA form incorporating the caries grid.
|Figure 1: Sample caries risk assessment form incorporating the caries grid and the guidelines|
Click here to view
Pilot testing inter-rater agreement between teachers and students
The final year students in an undergraduate program in were trained by the didactic method as well as clinical demonstration, to use the CRA-Grid. They assessed the caries risk status for 57 patients using the Grid. Being a novel concept, this explorative pilot study was intended to be done over a period of 3 months. Thus, the data of the patients who were assessed by the students for risk status within this period have been included in the study. A sample size of 12 has been recommended as a thumb rule for pilot clinical studies.
The score and risk assigned by the CRA-Grid were recorded. The CRA data form was separated from the Grid for blinding the teachers. These sheets were randomly distributed to six teachers for assigning risk status by using critical thinking process. The teachers who had a mean teaching experience of 8 years, had been teaching CRA in the undergraduate program. They had been trained and calibrated by the authors.
Inter-rater agreement between the teachers' critical thinking process and CRA-Grids' risk assessment was assessed. Cohen's weighted kappa (k) was run using GraphPad QuickCalcs.
| Results|| |
Mean percentage of agreement among the teachers for risk assessment using critical thinking process was 79.6% and that between the teachers' risk assessment and CRA-Grid scoring by students was 80.5%. Cohen's weighted kappa for agreement at a 95% confidence interval, between the CRA-Grid and faculty, is shown in [Table 2]. The agreement between the Grid and the teacher's assessment ranged from “very good” to “good.” [Figure 2] shows the agreement for high/low/moderate risk between the Grid and critical thinking process.
|Table 2: Inter-rater agreement between teachers' risk assessment through critical thinking and scoring by students using caries risk assessment grid|
Click here to view
|Figure 2: Percentage distribution of high/moderate and low-risk status assigned with caries risk assessment-grid and teachers' critical thinking process (L: Low/M: Moderate/H: High)|
Click here to view
| Discussion|| |
In this preliminary study, an appreciable agreement was found between the CRA-Grid and the critical thinking process of teachers. This result can be attributed to the process of development, which was based on mapping the thought process of the experts in assessing the risk. This objective model not only captured the complex process of clinical reasoning but also reproduced the outcome of the process. Assignment of the individual risk status as high/moderate/low also matched between the Grid and the critical thinking process. This observation is gratifyingly different from the previous report which stated that students usually err in identifying moderate risk status.
Use of algorithm-based system such as Cariogram reduces variation by objectivization, but it does pose a risk of compromising the training in critical thinking skills. Students tend to conclude directly without understanding the process or the significance of every risk factor., It is vital that they are trained in critical thinking skills and clinical reasoning so that they can emulate the thought process of an expert in decision making.,, Such training is best provided in a staged manner as per the Dreyfus skill acquisition model. The CRA-Grid can be considered as a training model toward independent critical thinking skills because the process of manually shading the Grid-enabled the student to understand the impact of every factor on caries risk as well as the “risky” combinations of multiple factors.
It is also stated that scheme-inductive reasoning that is based on sound knowledge is a more effective critical thinking skill, than the hypothetico-deductive reasoning. In accordance with this, the comprehensive, inclusive, and systematic CRA data collection form was educative for the students on the basic knowledge of caries etiology.
Training and implementation of CRA have been reported to be challenging and a slow process, despite extensive training of the students and the faculty. “Skepticism among the students and teachers has been reported as the main hurdle in implementation of CRA in education. However, in this preliminary validation, an improvement in the buy-in by the students as well as the faculty was observed, due to the synchronization and objectivity of using the Grid. Implementation was also smooth due to its simplicity.
It has been suggested that after identifying the potential high-risk patients, the risk can be assessed accurately for specific clinical decisions by identifying the biological risk factors, with a “full-blown model,” that included salivary tests., Accordingly, a guideline has been provided in this Grid, that salivary analysis may be done for patients with high risk. However, for this preliminary trial, salivary risk assessment tests for the high-risk patients were not included, due to the cost factor.
| Conclusions|| |
From this study, it can be concluded that CRA-Grid can be a simple, effective, and objective tool for risk assessment to be used in dental education. Further studies are required to assess the tool in different educational settings and with a different cohort of teachers.
The authors would like to acknowledge the support provided by all the faculty of Conservative Dentistry and Endodontics, Indira Gandhi Institute of Dental Sciences, Sri Balaji Vidyapeeth, Puducherry, India during the development and testing phase of the CRA-Grid. Special thanks to Dr. Saranya R, Senior lecturer, who assisted in the conceptualization.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Twetman S, Fontana M, Featherstone JD. Risk assessment – Can we achieve consensus? Community Dent Oral Epidemiol 2013;41:e64-70.
Fontana M, Zero DT. Assessing patients' caries risk. J Am Dent Assoc 2006;137:1231-9.
Twetman S, Fontana M. Patient caries risk assessment. Monogr Oral Sci 2009;21:91-101.
Zero D, Fontana M, Lennon AM. Clinical applications and outcomes of using indicators of risk in caries management. J Dent Educ 2001;65:1126-32.
Young DA, Featherstone JD. Implementing caries risk assessment and clinical interventions. Dent Clin North Am 2010;54:495-505.
Beck JD. Risk revisited. Community Dent Oral Epidemiol 1998;26:220-5.
Gao X, Di Wu I, Lo EC, Chu CH, Hsu CY, Wong MC, et al.
Validity of caries risk assessment programmes in preschool children. J Dent 2013;41:787-95.
Young DA, Alvear Fa B, Rogers N, Rechmann P. The effect of calibration on caries risk assessment performance by students and clinical faculty. J Dent Educ 2017;81:667-74.
Guzman-Armstrong S, Warren JJ, Cunningham-Ford MA, von Bergmann H, Johnsen DC. Concepts in critical thinking applied to caries risk assessment in dental education. J Dent Educ 2014;78:914-20.
Doméjean S, Léger S, Rechmann P, White JM, Featherstone JD. How do dental students determine patients' caries risk level using the caries management by risk assessment (CAMBRA) system? J Dent Educ 2015;79:278-85.
Krasse, B. Caries risk. A Practical Guide to Assessment and Control. Chicago (IL): Quintessence Publishing Co.; 1985.
Kidd EA. Caries management. Dent Clin North Am 1999;43:743-64.
Featherstone JD, Domejean-Orliaguet S, Jenson L, Wolff M, Young DA. Caries risk assessment in practice for age 6 through adult. J Calif Dent Assoc 2007;35:703-7, 710-3.
Ismail AI, Pitts NB, Tellez M; Authors of International Caries Classification and Management System, Banerjee A, Deery C, et al.
The international caries classification and management system (ICCMS™) an example of a caries management pathway. BMC Oral Health 2015;15 Suppl 1:S9.
Guo L, Shi W. Salivary biomarkers for caries risk assessment. J Calif Dent Assoc 2013;41:107-9, 112-8.
Walsh LJ. Dental plaque fermentation and its role in caries risk assessment. Int Dent S Afr 2006;1:4-13.
Zero DT. Sugars – The arch criminal? Caries Res 2004;38:277-85.
van Loveren C. Sugar restriction for caries prevention: Amount and frequency. Which is more important? Caries Res 2018;53:168-75.
Costa SM, Martins CC, Bonfim Mde L, Zina LG, Paiva SM, Pordeus IA, et al.
Asystematic review of socioeconomic indicators and dental caries in adults. Int J Environ Res Public Health 2012;9:3540-74.
Shearer DM, Thomson WM, Caspi A, Moffitt TE, Broadbent JM, Poulton R, et al.
Family history and oral health: Findings from the Dunedin study. Community Dent Oral Epidemiol 2012;40:105-15.
Julious SA. Sample size of 12 per group rule of thumb for a pilot study. Pharm Stat 2005;4:287-91.
Johnsen DC, Lipp MJ, Finkelstein MW, Cunningham-Ford MA. Guiding dental student learning and assessing performance in critical thinking with analysis of emerging strategies. J Dent Educ 2012;76:1548-58.
Khatami S, MacEntee MI, Pratt DD, Collins JB. Clinical reasoning in dentistry: A conceptual framework for dental education. J Dent Educ 2012;76:1116-28.
Peña A. The Dreyfus model of clinical problem-solving skills acquisition: A critical perspective. Med Educ Online. 2010;15:10.3402/meo.v15i0.4846.
Harasym PH, Tsai TC, Hemmati P. Current trends in developing medical students' critical thinking abilities. Kaohsiung J Med Sci 2008;24:341-55.
Doméjean-Orliaguet S, Gansky SA, Featherstone JD. Caries risk assessment in an educational environment. J Dent Educ 2006;70:1346-54.
Maupome G, Isyutina O. Dental students' and faculty members' concepts and emotions associated with a caries risk assessment program. J Dent Educ 2013;77:1477-87.
Bratthall D, Hänsel Petersson G. Cariogram – A multifactorial risk assessment model for a multifactorial disease. Community Dent Oral Epidemiol 2005;33:256-64.
Gao XL, Hsu CY, Xu Y, Hwarng HB, Loh T, Koh D, et al.
Building caries risk assessment models for children. J Dent Res 2010;89:637-43.
Prof. Usha Sathyanarayanan
Saveetha Dental College and Hospitals, Saveetha University, 162, Poonamallee High Road, Velappanchavadi, Chennai . 600 077, Tamil Nadu
Source of Support: None, Conflict of Interest: None
[Figure 1], [Figure 2]
[Table 1], [Table 2]