Next Article in Journal
The Neurochemistry of Autism
Next Article in Special Issue
Neurophysiological Correlates of a Single Session of Prefrontal tDCS in Patients with Prolonged Disorders of Consciousness: A Pilot Double-Blind Randomized Controlled Study
Previous Article in Journal
Efficacy of Dronabinol for Acute Pain Management in Adults with Traumatic Injury: Study Protocol of A Randomized Controlled Trial
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Joint Neuropsychological Assessment through Coma/Near Coma and Level of Cognitive Functioning Assessment Scales Reduces Negative Findings in Pediatric Disorders of Consciousness

1
School of Biomedical Engineering & Imaging Sciences, and Centre for Medical Engineering, King’s College, London SE1 7EU, UK
2
Neuropsychological and Cognitive-behavioral Service, Neurophysiatric Department, Scientific Institute, I.R.C.C.S. Eugenio Medea, 23842 Bosisio Parini, Italy
3
Neurophysiatric Department, Scientific Institute, I.R.C.C.S. Eugenio Medea, 23842 Bosisio Parini, Italy
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Brain Sci. 2020, 10(3), 162; https://doi.org/10.3390/brainsci10030162
Submission received: 1 February 2020 / Revised: 28 February 2020 / Accepted: 10 March 2020 / Published: 12 March 2020
(This article belongs to the Special Issue Recent Advances in the Study of Altered State of Consciousness)

Abstract

:
The present study aimed to: (a) characterize the emergence to a conscious state (CS) in a sample of children and adolescents with severe brain injury during the post-acute rehabilitation and through two different neuropsychological assessment tools: the Rappaport Coma/Near Coma Scale (CNCS) and Level of Cognitive Functioning Assessment Scale (LOCFAS); (b) compare the evolution in patients with brain lesions due to traumatic and non-traumatic etiologies; and (c) describe the relationship between the emergence to a CS and some relevant clinical variables. In this observational prospective longitudinal study, 92 consecutive patients were recruited. Inclusion criteria were severe disorders of consciousness (DOC), Glasgow Coma Scale (GCS) score ≤8 at insult, age 0 to 18 years, and direct admission to inpatient rehabilitation from acute care. The main outcome measures were CNCS and LOCFAS, both administered three and six months after injury. The cohort globally shifted towards milder DOC over time, moving from overall ‘moderate/near coma’ at three months to ‘near/no coma’ at six months post-injury. The shift was captured by both CNCS and LOCFAS. CNCS differentiated levels of coma at best, while LOCFAS was superior in characterizing the emergence from coma. Agreement between scales was fair, and reduced negative findings at less than 10%. Patients with traumatic brain injury (TBI) vs. non-traumatic brain injury (NTBI) were older and had neurosurgical intervention more frequently. No relation between age and the level of consciousness was found overall. Concurrent administration of CNCS and LOCFAS reduced the rate of false negatives and better detected signs of arousal and awareness. This provides indication to administer both tools to increase measurement precision.

1. Introduction

The assessment of the state of consciousness (CS) in patients emerging from coma is a major challenge for all centers delivering acute and post-acute inpatient rehabilitation to victims of acquired brain injury (ABI). Due to the need for frequent inspection of the CS at the bedside and in optimal arousal state, behavioral assessment remains essential [1], despite a high rate of misdiagnoses [2]. A number of tools specifically designed for accurate behavioral assessment of the CS [3] have been validated [4,5,6,7,8], and some have become a standard [1,3]. In parallel, the availability of unprecedentedly refined diagnostic resources has fostered deeper exploration of the disorders of consciousness (DOC). This led to the reconsideration of the vegetative state (VS), now called unresponsive wakefulness syndrome (UWS) [9], to the definition of the minimally conscious state (MCS) [10,11], and to the distinction of MCS +/- depending on residual capabilities to follow commands and communicate [12]. To date, evidence of leftover command following is regarded as the key feature of good evolution of the CS, and is assigned a relevant prognostic value [12].
The pediatric field has only partially benefited from all these advancements. Novel assessment tools are generally designed for and calibrated on adult cohorts. Validation in children remains sporadic, sized on small samples and aimed to the ‘wide’ pediatric age [13,14]. A recent survey and the most updated guidelines have both highlighted a lack of appropriate tools and standards for pediatrics [1,15]. Additionally, the behavioral assessment is intrinsically harder, due to the yet limited behavioral repertoire of infants and very young children [16,17], the dependence of outcome on the age at injury [18,19], and the overlap of the evolution of the CS with the physiological growth curve [20,21,22]. Normative datasets for adjusting young children’s scores are often needed (e.g., [23]), though not always available, and the outcome prediction is then drawn by inference from adult data. However, at least among children with traumatic brain injury (TBI), there is initial support for the use of command following as a predictor for emergence to CS [24,25]. The Coma Recovery Scale—Revised [26] has emerged as the gold standard neurobehavioral measure for assessment of adult cases; nevertheless, it has only been adapted and tested on healthy children so far [27]. Albeit lacking wide validation in children, the Rappaport Coma/Near Coma Scale (CNCS) [28,29] has been successfully applied in a few pediatric cases and small cohorts [14,30,31]. Ease of administration, basic behavioral cognitive and motor requirements of items, and suitability for a wide spectrum of ages are the main reasons for its increasing application. These factors make CNCS a competing option to the Levels of Cognitive Functioning Assessment Scale (LOCFAS) [32]. Indeed, LOCFAS was previously validated in children with both traumatic and non-traumatic ABI by our group [33,34], but showed to be inapplicable to patients younger than 48 months in practice.
The aims of this study are:
  • To describe the emergence to a CS in a sample of children and adolescents with severe brain lesions of traumatic and non-traumatic etiologies during the post-acute rehabilitation. The CNCS [28,29] and LOCFAS [32,35] were employed as tools for behavioral assessment;
  • To explore the agreement between the CNCS and LOCFAS;
  • To quantify the practical advantage of administering both CNCS and LOCFAS instead of only one tool.

2. Materials and Methods

2.1. Participants

Ninety-two patients with diagnosis of UWS/VS or MCS (according to [36], see Table S1 in the supplementary material) were recruited from a cohort of children and adolescents with acquired brain injury (ABI) referred to the Scientific Institute Eugenio Medea for post-acute rehabilitation.
Inclusion criteria were: (i) age at first assessment between 0 and 18 years; (ii) time between injury and first assessment <3 months; (iii) documented evidence of a severe ABI with DOC of traumatic, anoxic, vascular or infectious etiology, as confirmed by a Glasgow Coma Scale (GCS) [37] score ≤ 8 at insult; (iv) absence of congenital pathology or disability previous to the injury; (v) medical records sufficiently detailed to determine the injury severity and neurological findings.

2.2. Measures

Patients received two neurobehavioral evaluations 3 and 6 months after injury (T0 and T1 respectively) ± 7 days tolerance. Patients younger than 48 months (n = 38) received assessment through the Rappaport Coma/Near Coma Scale (CNCS). Older patients received both the CNCS [28] and the Level of Cognitive Functioning Assessment Scale (LOCFAS) [32,35] (Figure 1). CNCS and LOCFAS were delivered in random order by two experienced neuropsychologists (K.C. and C.F.) blinded to each other and in the morning of the same day (when both were delivered). The recruiter (S.S.) remained blinded to all the assessments. Diagnosis, assessments, further bibliography and standardization of the rehabilitation treatment are detailed in the Supplementary Material. The relationship between the patients’ consciousness condition and CNCS and LOCFAS data was mapped (by E.M., Supplementary Material).
Separately, a theoretical framework linking the clinical status and CNCS and LOCFAS levels was established (F.L. and S.G.) on the basis of items/domains contained in each scale. The clinical status was labelled as either ‘coma’, ‘vegetative state (VS)’, ‘minimally conscious state minus (MCS-)’, ‘minimally conscious state plus (MCS+)’, or ‘emergence to a conscious state (CS)’. This theoretical framework was used to compare CNCS and LOCFAS on a common ground (Table 1).
The study was approved by the Ethics Committee of Istituto di Ricovero e Cura a Carattere Scientifico Eugenio Medea on 15 February 2008, and registered with code PS-RIABIL Ex56/05/14 and protocol 07/08-CE; informed consent was signed by all caregivers, in line with the Declaration of Helsinki and subsequent amendments.
Importantly, being associated to CNCS Level 4 and LOCFAS Level 1, ‘coma’ is clinically defined here as lack of eye opening [10] (and lack of any electroencephalographic modulation over 24 h), while at a neurobehavioral level, it is defined as the absence of any specific response to stimuli administered through the scales. Additionally, the distinction in between ‘MCS+’ and ‘MCS-’ was based on motor requests (command responsivity or command following) and not on verbal performance. Despite item 11 of the CNCS being successfully administered to all cases for probing intelligible verbalizations, verbal responsivity was systematically observed to be a less reliable marker than motor responsivity. This was especially seen when involving intelligible cues and in younger aged patients. This is because several patients gradually developed response codes different from verbalization, and mainly motor-based (eye blink, finger movements, etc.).

2.3. Data Analysis

Continuous data is presented as means, standard deviations (SDs) and percentages; discrete data is presented as medians and modes. Qualitative variables were investigated by chi-square statistics. Age was assumed to be normally distributed. Normality was assessed for average and total CNCS scores. Parametric tests were thus applied to these measures. Non-parametric tests were applied otherwise. Spearman’s rank correlation coefficients, adjusted for the age at injury, were obtained to determine the relationship between quantitative variables. Clinical agreement between LOCFAS and CNCS was measured through Cohen-Kappa score. Agreement was graphically displayed in matrices based on the mathematical concept of “confusion”. All statistical analysis was carried out using the SPSS statistical package v.25 (IBM Corp., Armonk, NY, USA). Significance was assumed at a p-value < 0.05; high significance at p-value < 0.001.

3. Results

3.1. Patients

A cohort of 92 consecutive patients (60 males, 65.2%) was recruited in the 2008–2016 period from children and adolescents who attended our institute for rehabilitation. Inclusion criteria were age between seven months and 18 years, and UWS/VS or MCS in the post-acute stage. No measure was missed as they were in-patients; hence, the database is complete. Two groups of patients were formed consisting of 44 patients with TBI and 48 patients with non-traumatic brain injury (NTBI). In this second clinical group, eight patients (16.7%) presented with brain lesions due to vascular etiology, 18 (37.5%) due infectious etiology, and 22 (45.8%) due anoxic etiology. All patients received CNCS administration at three and six months post-injury.
The clinical characteristics of the overall, TBI and NTBI groups are reported in Table 2.
In order to verify the homogeneity of the two subgroups (TBI vs. NTBI), statistical analysis was performed. Significant differences were found for the variables: “age at injury” (t-value = 6.8, p < 0.001) and “need for neurosurgery” (χ2 = 13.6, p < 0.001). Indeed, patients with TBI were older at the time of insult. They had also undergone a neurosurgical intervention more frequently than NTBI patients.
Fifty-four of the 92 patients received both CNCS and LOCFAS at T0 and T1. The clinical characteristics of this subgroup, including both TBI and NTBI patients, are reported in Supplementary Table S1.

3.2. The Level of Awareness and Responsivity at Three and Six Months after Injury

The level of awareness and responsivity of each patient was assessed three (T0) and six months after injury (T1). At T0, patients older than 48 months were scored through CNCS and LOCFAS. The majority of them were diversely allocated in Levels 1, 2 and 3 of the CNCS, which corresponds to ‘near, moderate and marked coma’. However, most of them scored at Level 2, or ‘generalized response’ (66.7% of the sample) of LOCFAS. At T1, almost half of the patients scored ‘no coma’ at the CNCS. At LOCFAS, half scored into the Level 3, or ‘localized response’, a quarter fell into Level 5 ‘inappropriate, not agitated behavior’, and one out of five remained at Level 2 ‘generalized response’. The probability to fall into a certain CNCS or LOCFAS level was not significantly influenced by the variable etiology. Patients younger than 48 months, as well as the overall cohort, showed distributions comparable to those observed in older children (see Supplementary Results 3.2e and Supplementary Tables S2–S4). Figure 2 shows the confusion matrices (joint representation of scores at CNCS and LOCFAS) at T0 and T1, for patients aged older than 48 months. At T0, patients in CNCS Levels 2 and 3 ‘moderate and marked coma’ were mainly scored at LOCFAS Level 2 ‘generalized response’. Patients in CNCS Level 1 ‘near coma’ were split between LOCFAS Levels 2 and 3 ‘generalized and localized response’. At T1, patients in CNCS Level 0 scored between 3 and 5 at LOCFAS (‘localized response’ and above).

3.3. The Evolution of the State of Consciousness from Three to Six Months after Injury

In the total sample, the average CNCS Level was 2.9 (SD = 0.9) at T0. It decreased to 1.8 (SD = 0.8) at T1 (t = 11.0, p < 0.001), indicating that patients showed higher levels of awareness and responsivity at six months with respect to three months after injury. All 11 items of the CNCS significantly changed between T0 and T1 in the direction of higher awareness and responsivity. Nevertheless, medians remained unchanged for the olfactory item, and pain was already saturated at T0. For details see Supplementary Results 3.3e and Supplementary Table S5. The LOCFAS provided analogous results (see Supplementary Table S6).
Figure 3 shows the comparison of the CNCS and LOCFAS levels at T0 and T1. According to CNCS evaluation, patients in Level 3 ‘marked coma’ at T0 mainly moved to Levels 2 and 1 ‘moderate and near coma’ at T1. Patients who were in Levels 2 and 1 ‘moderate and near coma’ at T0, chiefly moved to Levels 1 and 0 ‘near and no coma’ at T1. Considering LOCFAS, patients scoring at Level 2 ‘generalized response’ at T0 split between Levels 2 and 3 ‘generalized and localized response’ at T1. Patients scoring at Level 3 ‘localized response’ at T0 split between Levels 3 and 5 ‘localized response and inappropriate behavior’ at T1.

3.4. The Evolution of the State of Consciousness in Patients with Stable Score at Three and Six Months after Injury

Of the 92 patients in the cohort, 24 (26.1%) scored the same CNCS Level at T0 and T1. This indicated no change in their classification at the two time points. Nevertheless, in this subgroup, the average CNCS score (mean at T0 = 1.8; mean at T1 = 1.5; t-value = 3.6; p = 0.002) and total CNCS score (mean at T0 = 20.1; mean at T1 = 16.2; t-value = 5.3; p < 0.001) were significantly lower at T1 vs. T0. Of the 54 patients assessed with both scales, 18 (33.3%) failed to show a change in LOCFAS level at T1. Five patients showed both the same CNCS and LOCFAS score at T0 and T1 (see details in Supplementary Material 3.4e).

3.5. Clinical Agreement between CNCS and LOCFAS

Out of 54 cases, clinical agreement between CNCS and LOCFAS at T0 was found for 34 (63.0%) patients (Cohen-K = 0.40). Ten cases were rated ‘MCS-’ according to the CNCS and ‘vegetative state’ with LOCFAS, among others. Of note, three cases were rated ‘MCS-’ according to the CNCS and ‘emerged from coma’ with LOCFAS. These patients received high scores for the attention for environment and responses to stimuli items in the LOCFAS scale. Clinical agreement at T1 was found for 27 (50.0%) patients (Cohen-K = 0.33). Ten cases were rated ‘emerged from coma’ according to CNCS and ‘MCS+’ with LOCFAS. Seven cases were rated ‘MCS-’ according to the CNCS and ‘vegetative state’ with LOCFAS. Seven cases were rated ‘MCS-’ according to the CNCS and ‘MCS+’ with LOCFAS, among others. For a full description, see Figure 4.

3.6. The Evolution of the State of Consciousness with Respect to the Initial Ability to Follow Commands

‘High command responsivity’ at T0 resulted in lower total CNCS scores at T0 (t = 7.8, p < 0.001) and at T1 (t = 2.9, p = 0.005) with respect to the ‘low command responsivity’ group. This indicated better CS at both T0 and T1 when ‘high command responsivity’ was initially observed (see Supplementary Figure S3.6e for more details).

3.7. The Evolution of the State of Consciousness in the Sample Divided by Etiology

Table 3 reports the scores of each CNCS item at the two assessment times (T0 and T1) and their comparison, both for patients with TBI and NTBI. The TBI group had 10 out of 11 items significantly shifted towards higher awareness and responsivity at T1 vs. T0. Only the two items probing pain had unchanged medians and modes, as the descriptors were already saturated at T0. Similarly, the NTBI group had all items significantly improved. Further details and scores for LOCFAS in TBI and NTBI are reported in Supplementary Material 3.7e and related Table S7.

3.8. Effect of Age

After correction by gender, the effect of age was tested through correlations between “age at injury” and CNCS level, total CNCS score and LOCFAS level at both T0 and T1. Analysis showed no relation between age and the level of consciousness.

3.9. Correlations between the Clinical Characteristics and the CNCS and LOCFAS Scales

Negative correlations were found between total CNCS score at T0 and Glasgow Outcome Score -Extended (GOS-E), neurosurgery, and feeding disorders. CNCS positively correlated with tracheotomy and paroxysmal sympathetic hyperactivity. LOCFAS level at T0 positively correlated with feeding disorders and GOS-E.
At T1, CNCS negatively correlated with GOS-E. LOCFAS level negatively correlated with paroxysmal sympathetic hyperactivity, and positively correlated with feeding disorders and GOS-E (see Supplementary Material 3.9e).

4. Discussion

The evolution of the state of consciousness (CS) in 92 children and adolescents with a severe ABI due to traumatic and non-traumatic events was described through two different scales: CNCS and LOCFAS. The emergence from a DOC to CS was fathomed against several clinical variables at three and six months after injury. The aim was to understand the factors mostly influencing the evolution.
CNCS and LOCFAS were administered with no dropout, as none of the patients missed any sessions, nor died by the end of the study. No specific scale adaptation was needed. CNCS was applicable to the youngest patients, in agreement with previous cases of effective employment in pediatrics [14,30,31]. LOCFAS was administered to all 54 children older than 48 months.
The cohort progressed from overall ‘moderate/near coma’ at three months to ‘near/no coma’ at six months post-injury. Progression towards milder DOC corresponded to one net CNCS level decrease (i.e., improvement) on average. The LOCFAS provided similar results. This is in agreement with our previous work [33], independent studies [13,38,39], and systematic reports [40].
At three months, a large subgroup of patients who showed ‘generalized response’ in the LOCFAS could be differentiated into either ‘near’, ‘moderate’ or ‘marked coma’ through the CNCS. This hints towards the superior capability of the CNCS to further differentiate generalized responses into finer coma levels. Conversely, the LOCFAS offered better resolution at T1 for discriminating localized, confused/agitated and non-agitated responses. These were all grouped as ‘no coma’ by the CNCS.
In line with previous findings by our group [33], the probability to fall into certain CNCS or LOCFAS levels was comparable for TBI and NTBI survivors at both time points. One independent study reports trends close to equality [13].
The only CNCS item already saturated at three months after injury was pain. Our interpretation is that pain items are crucial to add sensitivity and provide discrimination over the highest (i.e., severest) levels of the scale. Conversely, they hardly contribute to the discrimination of the lowest (i.e., mild) levels. As a result, pain items are often observed to be the earliest items to reach saturation when the patient recovers throughout the spectrum of DOC from coma towards consciousness. Nociception can travel through multiple ascending tracts, and can occur in the absence of awareness of pain [41]. It is possible that our patients experienced non-specific pain at that time. Moreover, in patients with extensive thalamic damage, the activation of nociceptors could have triggered mainly reflexive motor withdrawal. Reflexive withdrawal can be behaviorally congruent per se, but its association to painful experience is often uncertain in this context [42]. This has important implications for analgesic treatment [43], as emphasized in recent recommendations [1].
The LOCFAS showed that the domains changing the least were ‘ability to perform self-care activities’, ‘time orientation’ and ‘ability to learn new information’. These abilities correspond to complete recovery of consciousness, and are commonly the latest to be regained. Considering the overall extreme severity of this cohort, a longer follow-up could have shown stronger improvements in these domains. Longer observations are needed to confirm this hypothesis.
One quarter of patients demonstrated no change in their CNCS level between the two measurements at three and six months, but they had average CNCS score improvement in the same period. The CNCS has essential duality: (1) CNCS level allows classification, i.e., assignment of one patient’s status to a category of consciousness, and (2) average and total CNCS scores allow evaluation of subtle clinical changes. Indeed, total CNCS score sounds out both the frequency and extent of behavioral signs in great detail. Changes in score of single CNCS items provides magnification on specific modifications of the (re)emerging behavioral repertoire. By fully exploiting information from these two measures, therapists can utilize the sensitivity and specificity of the CNCS to interpret changes in single items as a proof of efficacy of specific treatments.
The concurrent employment of CNCS and LOCFAS assessments reduced the number of patients showing no level modification at either scale from 25% to less than 10%. In our opinion, this result provides strong indication for the administration of both tools to pediatric patients in clinical practice. Joint administration of the CNCS and LOCFAS will increase measurement precision and possibly reduce false negatives.
Although the correspondence between scale scores and the patient’s clinical condition was not exact, CNCS and LOCFAS showed fair in-between agreement at both three and six months. At T0, three cases rated ‘MCS-’ by CNCS were rated ‘emerged from coma’ by LOCFAS. LOCFAS might have overestimated attention for environment and responses to stimuli. Alternatively, it might have captured sings of arousal and awareness which remained undetected by CNCS.
Children with the initial ability to follow commands later demonstrated overall better CNCS and LOCFAS scores, and thus CS, at six months. This confirms the adequacy and suitability of the MCS+/- nosology for pediatrics [44]. It also underpins the prognostic role of the early ability to follow commands, in line with findings in adults [12].
Conversely, the need for a tracheotomy and the occurrence of paroxysmal sympathetic hyperactivity appear to be the main factors of co-morbidity. While the penalizing effect of tracheotomy is well-established [45], prognostic evidence of paroxysmal sympathetic hyperactivity is still controversial [46,47]. However, a greater incidence among younger patients was found [48]. The presence and type of feeding disorder also correlated with CNCS and LOCFAS scores. Oral feeding implies a full and complex oral phase, which as a whole is considered a sign of consciousness. However, it is not known which of its components are necessary to infer the presence of ‘conscious’ swallowing as opposed to reflex [49].
In line with previous epidemiological literature [50], this study found that patients with TBI were older at the time of insult, and needed neurosurgical intervention more frequently than NTBI patients. No relation between age and the level of consciousness was found overall.

Study Limitations

This study has some limitations. The time span under neurobehavioral investigation is three months (T1–T0); this period is clearly too short for long-term changes in the CS to be surveyed. The cohort size allowed us to study patients with TBI vs. NTBI; however, further subdivision of the NTBI group into specific etiologies was prevented by a loss in statistical power. Although previously applied in pediatrics, the LOCFAS and CNCS have not been adequately validated for such usage yet.

5. Conclusions

In children, CNCS and LOCFAS show fair agreement, and their concurrent employment reduces negative findings from 25% to less than 10%. This advocates for the joint administration of both tools. It will reduce false negatives and increase standardization and precision.
The CNCS proved to differentiate levels of coma at best. Particularly, it allowed discrimination between ‘extreme’, ‘marked’ and ‘moderate’ coma states. Such fine discrimination among severe patients would have remained undetected through the LOCFAS. Consequently, the CNCS should be employed with patients of extreme severity, or with those in the early stages of the recovery. The LOCFAS was superior in characterizing the emergence from coma, and particularly in disentangling confused/agitated and not agitated behavioral profiles. For this reason, maximal utility is envisaged in less severe cases, and in patients already well under way to recovery.
However, more validation is needed for measures that are appropriate for administration to children with DOC, and specific guidelines for assessing severe DOC are needed in pediatrics.

Supplementary Materials

The following are available online at https://www.mdpi.com/2076-3425/10/3/162/s1, Table S1: Clinical and demographic characteristics of the sub-sample of patients having both CNCS and LOCFAS assessments, three and six months after injury. Table includes data divided by etiology, Table S2: Frequencies and percent distribution of the patients’ scores into the CNCS and LOCFAS levels at T0 and at T1. Results refer to patients older than 48 months (n = 54), Table S3: Frequencies and percent distribution of the patients’ scores into the CNCS levels at T0 and at T1. Results refer to patients younger than 48 months (n = 38), Table S4: Frequencies and percent distribution of the patients’ scores into the CNCS levels at T0 and at T1. Results refer to the whole sample (n = 92), Table S5: Scores for 11 single CNCS items at T0 and T1 (reported as median and mode), and results of the comparison of each item at T0 vs. T1. Results refer to the whole sample (n = 92), Table S6: Scores for 10 single LOCFAS domains at T0 and T1 (reported as median and mode), and results of the comparison of each item at T0 vs. T1. Results refer to patients older than 48 months (n = 54), Table S7: Scores for 10 single LOCFAS domains at T0 and T1 (reported as median and mode), and results of the comparison of each item at T0 vs. T1. Results refer to samples with TBI (n = 37) and NTBI (n = 17).

Author Contributions

Conceptualization, S.S.; methodology, S.S. and E.M.; software, E.M.; formal analysis, E.M.; investigation, K.C., V.P., M.R. and S.G. (Susanna Galbiati); data curation, K.C. and C.F.; writing—original draft preparation, E.M., K.C., S.G. (Sara Galbiati); writing—review and editing, S.S. and F.L.; project administration S.S.; funding acquisition, S.S. and E.M. All authors have read and agreed to the published version of the manuscript.

Funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Project ex art. 56 L 289/2002, funds year 2005 to Scientific Institute ‘IRCCS E. Medea’ (PS-RIABIL Ex56/05/14 approved on 15 February 2008 and prot 07/08-CE); Ricerca Corrente years 2010–2012 (ID RC 2010 approved on 20 April 2010 and prot 61/10-CE), 2015–2016 (ID 027/15 approved on 24 March 2015 and prot 027/15), and 2019–2020 (ID n. 607 Rev.1–version n.1/25.02.2019 approved on 7 March 2019 and prot N. 05/19–CE) to Scientific Institute ‘IRCCS E. Medea’, awarded to Sandra Strazzer and Valentina Pastore as Principal Investigators; ‘KCL-Medical Research Council Skills Development Scheme’ funds awarded to Erika Molteni, NIHR BRC based at Guy’s and St Thomas Trust and King’s College London (KCL) and The Wellcome/EPSRC Centre for Medical Engineering (WT 203148/Z/16/Z).

Acknowledgments

The authors would like to acknowledge Irme Groothuis for the careful grammar review of this text.

Conflicts of Interest

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

References

  1. Giacino, J.T.; Katz, D.I.; Schiff, N.D.; Whyte, J.; Ashman, E.J.; Ashwal, S.; Barbano, R.; Hammond, F.M.; Laureys, S.; Ling, G.S.F.; et al. Practice guideline update recommendations summary: Disorders of consciousness. Neurology 2018, 99, 1699–1709. [Google Scholar] [CrossRef]
  2. Peterson, A.; Cruse, D.; Naci, L.; Weijer, C.; Owen, A.M. Risk, diagnostic error, and the clinical science of consciousness. NeuroImage Clin. 2015, 7, 588–597. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Seel, R.T.; Sherer, M.; Whyte, J.; Katz, D.I.; Giacino, J.T.; Rosenbaum, A.M.; Hammond, F.M.; Kalmar, K.; Pape, T.L.B.; Zafonte, R.; et al. Assessment scales for disorders of consciousness: Evidence-based recommendations for clinical practice and research. Arch. Phys. Med. Rehabil. 2010, 91, 1795–1813. [Google Scholar] [CrossRef] [PubMed]
  4. Eken, C.; Kartal, M.; Bacanli, A.; Eray, O. Comparison of the Full Outline of Unresponsiveness Score Coma Scale and the Glasgow Coma Scale in an emergency setting population. Eur. J. Emerg. Med. 2009, 16, 29–36. [Google Scholar] [CrossRef] [PubMed]
  5. Schnakers, C.; Majerus, S.; Giacino, J.; Vanhaudenhuyse, A.; Bruno, M.A.; Boly, M.; Moonen, G.; Damas, P.; Lambermont, B.; Lamy, M.; et al. A French validation study of the Coma Recovery Scale-Revised (CRS-R). Brain Inj. 2008, 22, 786–792. [Google Scholar] [CrossRef] [PubMed]
  6. Wijdicks, E.F.M.; Bamlet, W.R.; Maramattom, B.V.; Manno, E.M.; McClelland, R.L. Validation of a new coma scale: The FOUR score. Ann. Neurol. 2005, 58, 585–593. [Google Scholar] [CrossRef]
  7. Hall, K.; Cope, D.; Rappaport, M. Glasgow Outcome Scale and Disability Rating Scale: Comparative usefulness in following recovery in traumatic head injury. Arch. Phys. Med. Rehabil. 1985, 66, 35–37. [Google Scholar]
  8. Stanczak, D.E.; White, J.G.; Gouview, W.D.; Moehle, K.A.; Daniel, M.; Novack, T.; Long, C.J. Assessment of level of consciousness following severe neurological insult. A comparison of the psychometric qualities of the Glasgow Coma Scale and the Comprehensive Level of Consciousness Scale. J. Neurosurg. 1984, 60, 955–960. [Google Scholar] [CrossRef]
  9. Laureys, S.; Celesia, G.G.; Cohadon, F.; Lavrijsen, J.; León-Carrión, J.; Sannita, W.G.; Sazbon, L.; Schmutzhard, E.; von Wild, K.R.; Zeman, A.; et al. Unresponsive wakefulness syndrome: A new name for the vegetative state or apallic syndrome. BMC Med. 2010, 8, 68. [Google Scholar] [CrossRef] [Green Version]
  10. Giacino, J.T.; Ashwal, S.; Childs, N.; Cranford, R.; Jennett, B.; Katz, D.I.; Kelly, J.P.; Rosenberg, J.H.; Whyte, J.; Zafonte, R.D.; et al. The minimally conscious state: Definition and diagnostic criteria. Neurology 2002, 58, 349–353. [Google Scholar] [CrossRef] [PubMed]
  11. Bates, D. The vegetative state: Guidance on diagnosis and management. Clin. Med. (Northfield. Il) 2003, 3, 249. [Google Scholar]
  12. Bruno, M.A.; Vanhaudenhuyse, A.; Thibaut, A.; Moonen, G.; Laureys, S. From unresponsive wakefulness to minimally conscious PLUS and functional locked-in syndromes: Recent advances in our understanding of disorders of consciousness. J. Neurol. 2011, 258, 1373–1384. [Google Scholar] [CrossRef] [PubMed]
  13. Eilander, H.J.; Wijnen, V.J.M.; Scheirs, J.G.M.; de Kort, P.L.M.; Prevo, A.J.H. Children and young adults in a prolonged unconscious state due to severe brain injury: Outcome after an early intensive neurorehabilitation programme. Brain Inj. 2005, 19, 425–436. [Google Scholar] [CrossRef] [PubMed]
  14. Pham, K.; Kramer, M.E.; Slomine, B.S.; Suskauer, S.J. Emergence to the Conscious State During Inpatient Rehabilitation After Traumatic Brain Injury in Children and Young Adults: A Case Series. J. Head Trauma Rehabil. 2014, 29, 44–48. [Google Scholar] [CrossRef]
  15. Molteni, E.; Slomine, B.S.; Castelli, E.; Zasler, N.; Schnakers, C.; Estraneo, A. International survey on diagnostic and prognostic procedures in pediatric disorders of consciousness. Brain Inj. 2019, 33, 1–12. [Google Scholar] [CrossRef] [Green Version]
  16. Philbin, M.K.; Klaas, P. Hearing and Behavioral Responses to Sound in Full-Term Newborns. J. Perinatol. 2000, 20, S68–S76. [Google Scholar] [CrossRef]
  17. Alvarez, G.; Suskauer, S.J.; Slomine, B. Clinical Features of Disorders of Consciousness in Young Children. Arch. Phys. Med. Rehabil. 2019, 100, 687–694. [Google Scholar] [CrossRef]
  18. Kriel, R.L.; Krach, L.E.; Panser, L.A. Closed head injury: Comparison of children younger and older than 6 years of age. Pediatr. Neurol. 1989, 5, 296–300. [Google Scholar] [CrossRef]
  19. Donders, J.; Warschausky, S. Neurobehavioral outcomes after early versus late childhood traumatic brain injury. J. Head Trauma Rehabil. 2007, 22, 296–302. [Google Scholar] [CrossRef]
  20. Haley, S.M.; Fragala-Pinkham, M.A.; Ni, P.S.; Skrinar, A.M.; Kaye, E.M. Pediatric physical functioning reference curves. Pediatr. Neurol. 2004, 31, 333–341. [Google Scholar] [CrossRef]
  21. Shaklai, S.; Peretz, R.; Spasser, R.; Simantov, M.; Groswasser, Z. Long-term functional outcome after moderate-to-severe paediatric traumatic brain injury. Brain Inj. 2014, 28, 915–921. [Google Scholar] [CrossRef] [PubMed]
  22. Anderson, V.; Godfrey, C.; Rosenfeld, J.V.; Catroppa, C. Predictors of cognitive function and recovery 10 years after traumatic brain injury in young children. Pediatrics 2012, 129, e254–e261. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Msall, M.E.; DiGaudio, K.; Duffy, L.C.; LaForest, S.; Braun, S.; Granger, C. V WeeFIM. Normative sample of an instrument for tracking functional independence in children. Clin. Pediatr. (Phila) 1994, 33, 431–438. [Google Scholar] [CrossRef] [PubMed]
  24. Suskauer, S.J.; Slomine, B.S.; Inscore, A.B.; Lewelt, A.J.; Kirk, J.W.; Salorio, C.F. Injury severity variables as predictors of WeeFIM scores in pediatric TBI: Time to follow commands is best. J. Pediatr. Rehabil. Med. 2009, 2, 297–307. [Google Scholar] [CrossRef] [PubMed]
  25. Austin, C.; Slomine, B.; De Matt, E.; Salorio, C.; Suskauer, S. Time to follow commands remains the most useful injury severity variable for predicting WeeFIM® scores 1 year after paediatric TBI. Brain Inj. 2013, 27, 1056–1062. [Google Scholar] [CrossRef] [Green Version]
  26. Giacino, J.T.; Kalmar, K.; Whyte, J. The JFK Coma Recovery Scale-Revised: Measurement characteristics and diagnostic utility. Arch. Phys. Med. Rehabil. 2004, 85, 2020–2029. [Google Scholar] [CrossRef]
  27. Slomine, B.S.; Suskauer, S.J.; Nicholson, R.; Giacino, J.T.; Slomine, B.S.; Suskauer, S.J.; Nicholson, R.; Giacino, J.T. Preliminary validation of the coma recovery scale for pediatrics in typically developing young children. Brain Inj. 2019, 33, 1640–1645. [Google Scholar] [CrossRef]
  28. Rappaport, M.; Dougherty, A.M.; Kelting, D.L. Evaluation of coma and vegetative states. Arch. Phys. Med. Rehabil. 1992, 73, 628–634. [Google Scholar]
  29. Rappaport, M. The Coma/Near Coma Scale. The center for outcome measurement in brain injury. Available online: https://www.tbims.org/combi/cnc (assessed on 10 January 2020).
  30. Patrick, P.D.; Blackman, J.A.; Mabry, J.L.; Buck, M.L.; Gurka, M.J.; Conaway, M.R. Dopamine agonist therapy in low-response children following traumatic brain injury. J. Child Neurol. 2006, 20, 879–885. [Google Scholar] [CrossRef]
  31. McMahon, M.A.; Vargus-Adams, J.N.; Michaud, L.J.; Bean, J. Effects of amantadine in children with impaired consciousness caused by acquired brain injury: A pilot study. Am. J. Phys. Med. Rehabil. 2009, 88, 525–532. [Google Scholar] [CrossRef]
  32. Hagen, C.; Malkmus, D.; Durham, P. The Rancho Los Amigos Levels of Cognitive Functioning. Commun. Disord. Serv. Available online: https://www.neuroskills.com/education-and-resources/rancho-los-amigos-revised/ (assessed on 10 January 2020).
  33. Villa, F.; Colombo, K.; Pastore, V.; Locatelli, F.; Molteni, E.; Galbiati, S.; Galbiati, S.; Strazzer, S. LOCFAS-assessed evolution of cognitive and behavioral functioning in a sample of pediatric patients with severe acquired brain injury in the postacute phase. J. Child Neurol. 2015, 9, 1125–1134. [Google Scholar] [CrossRef] [PubMed]
  34. Liscio, M.; Adduci, A.; Galbiati, S.; Poggi, G.; Sacchi, D.; Strazzer, S.; Castelli, E.; Flannery, J. Cognitive-behavioural stimulation protocol for severely brain-damaged patients in the post-acute stage in developmental age. Disabil. Rehabil. 2008, 30, 274–285. [Google Scholar] [CrossRef] [PubMed]
  35. Flannery, J. Using the levels of cognitive functioning assessment scale with patients with traumatic brain injury in an acute care setting. Rehabil. Nurs. 1998, 23, 88–94. [Google Scholar] [CrossRef] [PubMed]
  36. Aubinet, C.; Larroque, S.K.; Heine, L.; Martial, C.; Majerus, S.; Laureys, S.; Di Perri, C. Clinical subcategorization of minimally conscious state according to resting functional connectivity. Hum. Brain Mapp. 2018, 39, 4519–4532. [Google Scholar] [CrossRef] [Green Version]
  37. Teasdale, G.; Jennett, B. Assessment of Coma and Impared Conciousness. Lancet 1974, 304, 81–84. [Google Scholar] [CrossRef]
  38. Brink, J.D.; Imbus, C.; Woo-Sam, J. Physical recovery after severe closed head trauma in children and adolescents. J. Pediatr. 1980, 97, 721–727. [Google Scholar] [CrossRef]
  39. Stover, S.L.; Zeiger, H.E., Jr. Head injury in children and teenagers; functional recovery correlated with the duration of coma. Arch. Phys. Med. Rehabil. 1976, 57, 201–205. [Google Scholar]
  40. The Multi-Society Task Force on PVS Medical aspects of the persistent vegetative state. N. Engl. J. Med. 1994, 330, 1499–1508. [CrossRef]
  41. Garland, E.L. Pain Processing in the Human Nervous System. A Selective Review of Nociceptive and Biobehavioral Pathways. Prim. Care Clin. Off. Pract. 2012, 39, 561–571. [Google Scholar] [CrossRef] [Green Version]
  42. Iannetti, G.D.; Mouraux, A. From the neuromatrix to the pain matrix (and back). Exp. Brain Res. 2010, 205, 1–12. [Google Scholar] [CrossRef]
  43. Schnakers, C.; Zasler, N. Assessment and Management of Pain in Patients with Disorders of Consciousness. PM R 2015, 7, S270–S277. [Google Scholar] [CrossRef] [PubMed]
  44. Bruno, M.A.; Schnakers, C.; Boly, M.; Hustinx, R.; Vanhaudenhuyse, A.; Kirsch, M.; Bernard, C.; Moonen, G.; Laureys, S. Subcategorizing the minimally conscious state based on cerebral metabolism PET studies. In Proceedings of the 19th Meeting of the European Neurological Society, Milan, Italy, 5–9 June 2009. [Google Scholar]
  45. Godbolt, A.K.; Stenberg, M.; Jakobsson, J.; Sorjonen, K.; Krakau, K.; Stålnacke, B.M.; Nygren DeBoussard, C. Subacute complications during recovery from severe traumatic brain injury: Frequency and associations with outcome. BMJ Open 2015, 5, e007208. [Google Scholar] [CrossRef] [PubMed]
  46. Fernandez-Ortega, J.F.; Prieto-Palomino, M.A.; Garcia-Caballero, M.; Galeas-Lopez, J.L.; Quesada-Garcia, G.; Baguley, I.J. Paroxysmal Sympathetic Hyperactivity after Traumatic Brain Injury: Clinical and Prognostic Implications. J. Neurotrauma 2011, 29, 1364–1370. [Google Scholar] [CrossRef] [PubMed]
  47. Pignolo, L.; Rogano, S.; Quintieri, M.; Leto, E.; Dolce, G. Decreasing incidence of paroxysmal sympathetic hyperactivity syndrome in the vegetative state. J. Rehabil. Med. 2012, 44, 502–504. [Google Scholar] [CrossRef] [Green Version]
  48. Pozzi, M.; Conti, V.; Locatelli, F.; Galbiati, S.; Radice, S.; Clementi, E.; Strazzer, S. Paroxysmal Sympathetic Hyperactivity in Pediatric Rehabilitation. J. Head Trauma Rehabil. 2016, 30, 357–363. [Google Scholar] [CrossRef]
  49. Mélotte, E.; Maudoux, A.; Delhalle, S.; Martial, C.; Antonopoulos, G.; Larroque, S.K.; Wannez, S.; Faymonville, M.E.; Kaux, J.F.; Laureys, S.; et al. Is oral feeding compatible with an unresponsive wakefulness syndrome? J. Neurol. 2018, 265, 954–961. [Google Scholar] [CrossRef]
  50. Corrigan, J.D.; Selassie, A.W.; Orman, J.A. The epidemiologyo of traumatic brain injury. J. Head Trauma Rehabil. 2010, 21, 375–378. [Google Scholar]
Figure 1. Flow diagram of the study indicating enrollment, exclusions, and group allocation. CNCS: Rappaport Coma/Near Coma Scale; LOCFAS: Level of Cognitive Functioning Assessment Scale.
Figure 1. Flow diagram of the study indicating enrollment, exclusions, and group allocation. CNCS: Rappaport Coma/Near Coma Scale; LOCFAS: Level of Cognitive Functioning Assessment Scale.
Brainsci 10 00162 g001
Figure 2. Confusion matrices at three months (T0) and at six months (T1) after injury for patients aged older than 48 months. At T0, patients in CNCS Levels 2 and 3 ‘moderate and marked coma’ were mainly scored at LOCFAS Level 2 ‘generalized response’. Patients in CNCS Level 1 ‘near coma’ were split between LOCFAS Levels 2 and 3 ‘generalized and localized response’. At T1, patients in CNCS 0 scored between 3 and 5 in the LOCFAS (‘localized response’ and above). Total LOCFAS is total number of patients who received a LOCFAS score; Total CNCS is total number of patients who received a CNCS score.
Figure 2. Confusion matrices at three months (T0) and at six months (T1) after injury for patients aged older than 48 months. At T0, patients in CNCS Levels 2 and 3 ‘moderate and marked coma’ were mainly scored at LOCFAS Level 2 ‘generalized response’. Patients in CNCS Level 1 ‘near coma’ were split between LOCFAS Levels 2 and 3 ‘generalized and localized response’. At T1, patients in CNCS 0 scored between 3 and 5 in the LOCFAS (‘localized response’ and above). Total LOCFAS is total number of patients who received a LOCFAS score; Total CNCS is total number of patients who received a CNCS score.
Brainsci 10 00162 g002
Figure 3. Evolution of the CS from T0 to T1, according to both CNCS and LOCFAS. Results refer to patients older than 48 months. The CNCS table shows that patients who were at Levels 2 and 1 ‘moderate and near coma’ at T0 chiefly moved to Levels 1 and 0 ‘near and no coma’ at T1. The LOCFAS table illustrates that patients scoring at Level 2 ‘generalized response’ at T0 split between Levels 2 and 3 ‘generalized and localized response’ at T1. Patients scoring at Level 3 ‘localized response’ at T0 split between Levels 3 and 5 ‘localized response and inappropriate behavior’ at T1.
Figure 3. Evolution of the CS from T0 to T1, according to both CNCS and LOCFAS. Results refer to patients older than 48 months. The CNCS table shows that patients who were at Levels 2 and 1 ‘moderate and near coma’ at T0 chiefly moved to Levels 1 and 0 ‘near and no coma’ at T1. The LOCFAS table illustrates that patients scoring at Level 2 ‘generalized response’ at T0 split between Levels 2 and 3 ‘generalized and localized response’ at T1. Patients scoring at Level 3 ‘localized response’ at T0 split between Levels 3 and 5 ‘localized response and inappropriate behavior’ at T1.
Brainsci 10 00162 g003
Figure 4. Clinical agreement between CNCS and LOCFAS at T0 and T1 for patients aged older than 48 months. At T0, agreement was 63.0% (yellow boxes, Cohen-Kappa = 0.40), and 50% at T1 (Cohen-Kappa = 0.33). VS: vegetative state.
Figure 4. Clinical agreement between CNCS and LOCFAS at T0 and T1 for patients aged older than 48 months. At T0, agreement was 63.0% (yellow boxes, Cohen-Kappa = 0.40), and 50% at T1 (Cohen-Kappa = 0.33). VS: vegetative state.
Brainsci 10 00162 g004
Table 1. Framework for theoretical association between clinical status and CNCS and LOCFAS levels. MCS: minimally conscious state.
Table 1. Framework for theoretical association between clinical status and CNCS and LOCFAS levels. MCS: minimally conscious state.
Clinical StatusCNCS LevelCNCS Additional CriteriaLOCFAS LevelLOCFAS Additional Criteria
EmergeLevel 0-Level 5
Level 4
MCS+Level 1And ‘Command responsivity’ is 0Level 3If specific score at item ‘Execution of commands’ is 2, 3 or 4
MCS-Level 1And ‘Command responsivity’ is 2 or 4Level 3If specific score at item ‘Execution of commands’ is 1
Level 2If ‘Auditory’ is 0, or if ‘Visual (item n.3 or 4)’ is 0, or both
Vegetative StateLevel 2If ‘Auditory’ is not 0 and ‘Visual (item n.3 or 4)’ is not 0Level 2
Level 3
ComaLevel 4 Level 1
CNCS: Rappaport Coma/Near Coma Scale; LOCFAS: Level of Cognitive Functioning Assessment Scale. MCS: minimally conscious state.
Table 2. Clinical and demographic characteristics of the total sample and the two groups divided by etiology. SD: standard deviation; GCS: Glasgow Coma Scale; GOS-E: Glasgow Outcome Scale Extended.
Table 2. Clinical and demographic characteristics of the total sample and the two groups divided by etiology. SD: standard deviation; GCS: Glasgow Coma Scale; GOS-E: Glasgow Outcome Scale Extended.
Total Sample (n = 92)Traumatic (TBI) (n = 44)Non-Traumatic (NTBI) (n = 48)Statistics
MeanSDMeanSDMeanSDp (t-Test)
Age at injury (months)87.066.1127.765.050.141.2<1 × 10−4 **
MedianRangeMedianRangeMedianRangep (Wilcoxon test)
GCS score43–843–743–80.892
GOS-E score22–322–322–30.141
n%n%n%p (2)
Gender
Male6065.22965.93164.60.535
Female3234.81534.11735.4
Need for neurosurgery4852.23272.71735.4<1 × 10−4 **
Tracheotomy4650.02761.42041.70.060
Feeding disorders
Absence of disorders11.100.012.10.251
Dysphagia55.449.124.2
Nasogastric tube (NGT)3841.31431.82450.0
Percutaneous endoscopic gastrostomy (PEG)4852.22659.12143.7
Paroxysmal sympathetic hyperactivity episodes3841.32045.51837.50.529
Motor impairment
Absence of impairment11.112.300.00.370
Motor retardation11.112.300.0
Quadriparesis8996.74295.44797.9
Ataxia11.100.012.1
Previous rehabilitation44.324.524.20.572
** highly significant at p-value < 0.001.
Table 3. Scores for 11 single CNCS items at T0 and T1, and results of the comparison of each item at T0 vs. T1. Results refer to the samples with TBI (n = 44) and NTBI (n = 48).
Table 3. Scores for 11 single CNCS items at T0 and T1, and results of the comparison of each item at T0 vs. T1. Results refer to the samples with TBI (n = 44) and NTBI (n = 48).
Traumatic (TBI)Non-Traumatic (NTBI)
ItemIndividual ParametersT0T1Z (p)T0T1Z (p)
MedianModeMedianMode MedianModeMedianMode
1Auditory22003.5 (0.001) *22004.2 (<0.001) **
2Command responsivity44004.3 (<0.001) **44204.5 (<0.001) **
3Visual24004.4 (<0.001) **44204.4 (<0.001) **
4Visual24004.2 (<0.001) **44204.0 (<0.001) **
5Threat24003.5 (<0.001) **44004.3 (<0.001) **
6Olfactory44204.0 (<0.001) **24202.1 (0.033) *
7Tactile44224.8 (<0.001) **44224.7 (<0.001) **
8Tactile20004.2 (<0.001) **00002.1 (0.038) *
9Pain00001.5 (0.132)00003.1 (0.002) *
10Pain00002.3 (0.021) *00003.3 (0.001) *
11Vocalization44224.1 (<0.001) **34224.3 (<0.001) **
** highly significant at p-value < 0.001. * significant at p-value < 0.05.

Share and Cite

MDPI and ACS Style

Molteni, E.; Colombo, K.; Pastore, V.; Galbiati, S.; Recla, M.; Locatelli, F.; Galbiati, S.; Fedeli, C.; Strazzer, S. Joint Neuropsychological Assessment through Coma/Near Coma and Level of Cognitive Functioning Assessment Scales Reduces Negative Findings in Pediatric Disorders of Consciousness. Brain Sci. 2020, 10, 162. https://doi.org/10.3390/brainsci10030162

AMA Style

Molteni E, Colombo K, Pastore V, Galbiati S, Recla M, Locatelli F, Galbiati S, Fedeli C, Strazzer S. Joint Neuropsychological Assessment through Coma/Near Coma and Level of Cognitive Functioning Assessment Scales Reduces Negative Findings in Pediatric Disorders of Consciousness. Brain Sciences. 2020; 10(3):162. https://doi.org/10.3390/brainsci10030162

Chicago/Turabian Style

Molteni, Erika, Katia Colombo, Valentina Pastore, Susanna Galbiati, Monica Recla, Federica Locatelli, Sara Galbiati, Claudia Fedeli, and Sandra Strazzer. 2020. "Joint Neuropsychological Assessment through Coma/Near Coma and Level of Cognitive Functioning Assessment Scales Reduces Negative Findings in Pediatric Disorders of Consciousness" Brain Sciences 10, no. 3: 162. https://doi.org/10.3390/brainsci10030162

APA Style

Molteni, E., Colombo, K., Pastore, V., Galbiati, S., Recla, M., Locatelli, F., Galbiati, S., Fedeli, C., & Strazzer, S. (2020). Joint Neuropsychological Assessment through Coma/Near Coma and Level of Cognitive Functioning Assessment Scales Reduces Negative Findings in Pediatric Disorders of Consciousness. Brain Sciences, 10(3), 162. https://doi.org/10.3390/brainsci10030162

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop