Show simple item record

Clinical validation of the parent‐report Toronto Obsessive–Compulsive Scale (TOCS): A pediatric open‐source rating scale

dc.contributor.authorLambe, Laura J.
dc.contributor.authorBurton, Christie L.
dc.contributor.authorAnagnostou, Evdokia
dc.contributor.authorKelley, Elizabeth
dc.contributor.authorNicolson, Robert
dc.contributor.authorGeorgiades, Stelios
dc.contributor.authorSoreni, Noam
dc.contributor.authorSchachar, Russell J.
dc.contributor.authorHanna, Gregory L.
dc.contributor.authorArnold, Paul D.
dc.contributor.authorCrosbie, Jennifer
dc.date.accessioned2022-01-06T15:52:49Z
dc.date.available2023-01-06 10:52:48en
dc.date.available2022-01-06T15:52:49Z
dc.date.issued2021-12
dc.identifier.citationLambe, Laura J.; Burton, Christie L.; Anagnostou, Evdokia; Kelley, Elizabeth; Nicolson, Robert; Georgiades, Stelios; Soreni, Noam; Schachar, Russell J.; Hanna, Gregory L.; Arnold, Paul D.; Crosbie, Jennifer (2021). "Clinical validation of the parent‐report Toronto Obsessive–Compulsive Scale (TOCS): A pediatric open‐source rating scale." JCPP Advances 1(4): n/a-n/a.
dc.identifier.issn2692-9384
dc.identifier.issn2692-9384
dc.identifier.urihttps://hdl.handle.net/2027.42/171258
dc.description.abstractBackgroundThere is a need to develop a multipurpose obsessive–compulsive disorder (OCD) measure that is useful for cross disorder research and as a reliable clinical rating scale. The current study examined the psychometric properties and established clinical cutoffs for the parent‐report version of the Toronto Obsessive–Compulsive Scale (TOCS), a 21‐item rating scale of obsessive–compulsive traits.MethodParticipants ranged in age from 6 to 21 years old and had a primary diagnosis of OCD (n = 350, 50% female), attention‐deficit/hyperactivity disorder (ADHD) (n = 820, 25% female), autism spectrum disorder (ASD) (n = 794, 22% female), or were typically developing controls (n = 391, 51% female). Confirmatory factor analyses, internal consistency reliability, and convergent and divergent validity of the TOCS were examined in the OCD group. Using various scoring approaches, receiver operating characteristic (ROC) analyses were used to establish a clinical cut‐off by splitting the OCD group into a discovery sample (166 OCD cases, 164 controls) and a validation sample (184 OCD cases, 227 controls). Classification accuracy and TOCS scores were compared across OCD, ADHD, and ASD groups.ResultsThe psychometric properties of the TOCS were confirmed. ROC analyses across TOCS scoring approaches in the discovery sample indicated excellent diagnostic discrimination (AUC ≥0.95, sensitivity 77%–92%, specificity 92%–98%). Established cutoffs, when applied in the independent validation sample of OCD cases and controls, showed an overall classification accuracy of 85%–90%. The TOCS total score and symptom count showed good discrimination of OCD from ADHD (AUC ≥0.86) and ASD (AUC ≥0.81). The OCD group scored significantly higher on all TOCS dimensions (except Hoarding) than the ADHD and ASD groups.ConclusionThe TOCS is a reliable and valid rating scale with strong sensitivity and specificity in discriminating OCD cases from controls, as well as from ASD and ADHD. It is a quantitative OCD measure with important clinical and research applications, with particular relevance for cross disorder phenotyping and population‐based studies.
dc.publisherWestern Psychological Services
dc.publisherWiley Periodicals, Inc.
dc.subject.otherneurodevelopmental disorders
dc.subject.otherobsessive–compulsive traits
dc.subject.otherobsessive–compulsive disorder
dc.subject.otherscale development
dc.subject.othercross‐disorder phenotyping
dc.subject.otherROC analysis
dc.titleClinical validation of the parent‐report Toronto Obsessive–Compulsive Scale (TOCS): A pediatric open‐source rating scale
dc.typeArticle
dc.rights.robotsIndexNoFollow
dc.subject.hlbsecondlevelPsychiatry
dc.subject.hlbsecondlevelPsychology
dc.subject.hlbtoplevelHealth Sciences
dc.subject.hlbtoplevelSocial Sciences
dc.description.peerreviewedPeer Reviewed
dc.description.bitstreamurlhttp://deepblue.lib.umich.edu/bitstream/2027.42/171258/1/jcv212056_am.pdf
dc.description.bitstreamurlhttp://deepblue.lib.umich.edu/bitstream/2027.42/171258/2/jcv212056.pdf
dc.identifier.doi10.1002/jcv2.12056
dc.identifier.sourceJCPP Advances
dc.identifier.citedreferenceRachman, S., Elliott, C. M., Shafran, R., & Radomsky, A. S. ( 2009 ). Separating hoarding from OCD. Behaviour Research and Therapy, 47 ( 6 ), 520 – 522. https://doi.org/10.1016/j.brat.2009.02.014
dc.identifier.citedreferenceBurton, C. L., Lemire, M., Xiao, B., Corfield, E. C., Erdman, L., Bralten, J., Poelmans, G., Yu, D., Shaheen, S.‐M., Goodale, T., Sinopoli, V. M., Soreni, N., Hanna, G. L., Fitzgerald, K. D., Rosenberg, D., Nestadt, G., Paterson, A. D., Strug, L. J., Schachar, R. J., … Zai, G. ( 2021 ). Genome‐wide association study of pediatric obsessive‐compulsive traits: Shared genetic risk between traits and disorder. Translational Psychiatry, 11 ( 1 ), 1 – 10. https://doi.org/10.1038/s41398‐020‐01121‐9
dc.identifier.citedreferenceBurton, C. L., Park, L. S., Corfield, E. C., Forget‐Dubois, N., Dupuis, A., Sinopoli, V. M., Shan, J., Goodale, T., Shaheen, S.‐M., Crosbie, J., Schachar, R. J., & Arnold, P. D. ( 2018 ). Heritability of obsessive–compulsive trait dimensions in youth from the general population. Translational Psychiatry, 8 ( 1 ), 1 – 10. https://doi.org/10.1038/s41398‐018‐0249‐9
dc.identifier.citedreferenceBurton, C. L., Wright, L., Shan, J., Xiao, B., Dupuis, A., Goodale, T., Shaheen, S.‐M., Corfield, E. C., Arnold, P. D., Schachar, R. J., & Crosbie, J. ( 2019 ). SWAN scale for ADHD trait‐based genetic research: A validity and polygenic risk study. Journal of Child Psychology and Psychiatry, 60 ( 9 ), 988 – 997. https://doi.org/10.1111/jcpp.13032
dc.identifier.citedreferenceFoa, E. B., Coles, M., Huppert, J. D., Pasupuleti, R. V., Franklin, M. E., & March, J. ( 2010 ). Development and validation of a child version of the Obsessive Compulsive Inventory. Behavior Therapy, 41 ( 1 ), 121 – 132. https://doi.org/10.1016/j.beth.2009.02.001
dc.identifier.citedreferenceGeller, D. A. ( 2006 ). Obsessive‐compulsive and spectrum disorders in children and adolescents. Psychiatric Clinics, 29 ( 2 ), 353 – 370. https://doi.org/10.1016/j.psc.2006.02.012
dc.identifier.citedreferenceGrisham, J. R., Brown, T. A., Liverant, G. I., & Campbell‐Sills, L. ( 2005 ). The distinctiveness of compulsive hoarding from obsessive–compulsive disorder. Journal of Anxiety Disorders, 19 ( 7 ), 767 – 779. https://doi.org/10.1016/j.janxdis.2004.09.003
dc.identifier.citedreferenceHudziak, J. J., Althoff, R. R., Stanger, C., van Beijsterveldt, C. E. M., Nelson, E. C., Hanna, G. L., Boomsma, D. I., & Todd, R. D. ( 2006 ). The Obsessive Compulsive Scale of the Child Behavior Checklist predicts obsessive‐compulsive disorder: A receiver operating characteristic curve analysis. Journal of Child Psychology and Psychiatry, 47 ( 2 ), 160 – 166. https://doi.org/10.1111/j.1469‐7610.2005.01465.x
dc.identifier.citedreferenceIckowicz, A., Schachar, R. J., Sugarman, R., Chen, S. X., Millette, C., & Cook, L. ( 2006 ). The parent interview for child symptoms: A situation‐specific clinical research interview for attention‐deficit hyperactivity and related disorders. Canadian Journal of Psychiatry, 51 ( 5 ), 325 – 328. https://doi.org/10.1177/070674370605100508
dc.identifier.citedreferenceJorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. ( 2020 ). semTools: Useful tools for structural equation modeling (R package version 0.5‐3.) [Computer software]. https://CRAN.R‐project.org/package=semTools
dc.identifier.citedreferenceKaufman, J., Birmaher, B., Brent, D., Rao, U., Flynn, C., Moreci, P., Williamson, D., & Ryan, N. ( 1997 ). Schedule for affective disorders and schizophrenia for school‐age children‐present and lifetime version (K‐SADS‐PL): Initial reliability and validity data. Journal of the American Academy of Child & Adolescent Psychiatry, 36 ( 7 ), 980 – 988. https://doi.org/10.1097/00004583‐199707000‐00021
dc.identifier.citedreferenceKhan, R. A., & Brandenburger, T. ( 2020 ). Rocit: Performance assessment of binary classifier with visualization (R package 2.1.1.) [Computer software]. https://CRAN.R‐project.org/package=ROCit
dc.identifier.citedreferenceKushki, A., Anagnostou, E., Hammill, C., Duez, P., Brian, J., Iaboni, A., Schachar, R., Crosbie, J., Arnold, P., & Lerch, J. P. ( 2019 ). Examining overlap and homogeneity in ASD, ADHD, and OCD: A data‐driven, diagnosis‐agnostic approach. Translational Psychiatry, 9 ( 1 ), 1 – 11. https://doi.org/10.1038/s41398‐019‐0631‐2
dc.identifier.citedreferenceLord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., Pickles, A., & Rutter, M. ( 2000 ). The Autism Diagnostic Observation Schedule—Generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30 ( 3 ), 205 – 223. https://doi.org/10.1023/A:1005592401947
dc.identifier.citedreferenceMathes, B. M., Morabito, D. M., & Schmidt, N. B. ( 2019 ). Epidemiological and clinical gender differences in OCD. Current Psychiatry Reports, 21 ( 5 ), 36. https://doi.org/10.1007/s11920‐019‐1015‐2
dc.identifier.citedreferenceMorris, S. H., Jaffee, S. R., Goodwin, G. P., & Franklin, M. E. ( 2016 ). Hoarding in children and adolescents: A review. Child Psychiatry and Human Development, 47 ( 5 ), 740 – 750. https://doi.org/10.1007/s10578‐015‐0607‐2
dc.identifier.citedreferenceNelson, E. C., Hanna, G. L., Hudziak, J. J., Botteron, K. N., Heath, A. C., & Todd, R. D. ( 2001 ). Obsessive‐compulsive scale of the Child Behavior Checklist: Specificity, sensitivity, and predictive power. Pediatrics, 108 ( 1 ), e14. https://doi.org/10.1542/peds.108.1.e14
dc.identifier.citedreferencePark, L. S., Burton, C. L., Dupuis, A., Shan, J., Storch, E. A., Crosbie, J., Schachar, R. J., & Arnold, P. D. ( 2016 ). The Toronto Obsessive‐Compulsive Scale: Psychometrics of a dimensional measure of obsessive‐compulsive traits. Journal of the American Academy of Child & Adolescent Psychiatry, 55 ( 4 ), 310 – 318. https://doi.org/10.1016/j.jaac.2016.01.008
dc.identifier.citedreferencePlomin, R., Haworth, C. M. A., & Davis, O. S. P. ( 2009 ). Common disorders are quantitative traits. Nature Reviews Genetics, 10 ( 12 ), 872 – 878. https://doi.org/10.1038/nrg2670
dc.identifier.citedreferencePutnick, D. L., & Bornstein, M. H. ( 2016 ). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71 – 90. https://doi.org/10.1016/j.dr.2016.06.004
dc.identifier.citedreferenceRodríguez‐Jiménez, T., Piqueras, J. A., Lázaro, L., Moreno, E., Ortiz, A. G., & Godoy, A. ( 2016 ). Metric invariance, reliability, and validity of the child version of the Obsessive Compulsive Inventory (OCI‐CV) in community and clinical samples. Journal of Obsessive‐Compulsive and Related Disorders, 9, 1 – 8. https://doi.org/10.1016/j.jocrd.2016.01.003
dc.identifier.citedreferenceRosseel, Y. ( 2012 ). Lavaan: An r package for structural equation modeling. http://www.jstatsoft.org/v48/i02/
dc.identifier.citedreferenceRough, H. E., Hanna, B. S., Gillett, C. B., Rosenberg, D. R., Gehring, W. J., Arnold, P. D., & Hanna, G. L. ( 2020 ). Screening for pediatric obsessive–compulsive disorder using the obsessive–compulsive inventory‐child version. Child Psychiatry and Human Development, 51 ( 6 ), 888 – 899. https://doi.org/10.1007/s10578‐020‐00966‐x
dc.identifier.citedreferenceRuta, L., Mugno, D., D’Arrigo, V. G., Vitiello, B., & Mazzone, L. ( 2009 ). Obsessive–compulsive traits in children and adolescents with Asperger syndrome. European Child & Adolescent Psychiatry, 19 ( 1 ), 17 – 24. https://doi.org/10.1007/s00787‐009‐0035‐6
dc.identifier.citedreferenceRutter, M., Bailey, A., & Lord, C. ( 2003a ). The Social Communication Questionnaire (SCQ). Western Psychological Services.
dc.identifier.citedreferenceRutter, M., Le Couteur, A., & Lord, C. ( 2003b ). Autism‐Diagnostic Interview ‐ Revised. Western Psychological Services.
dc.identifier.citedreferenceScahill, L., Riddle, M. A., McSwiggin‐Harden, M., Ort, S. I., King, R. A., Goodman, W. K., Cicchetti, D., & Leckman, J. F. ( 1997 ). Children’s Yale‐Brown Obsessive Compulsive Scale: Reliability and validity. Journal of the American Academy of Child & Adolescent Psychiatry, 36 ( 6 ), 844 – 852. https://doi.org/10.1097/00004583‐199706000‐00023
dc.identifier.citedreferenceŠimundić, A.‐M. ( 2009 ). Measures of diagnostic accuracy: Basic definitions. EJIFCC, 19 ( 4 ), 203 – 211.
dc.identifier.citedreferenceStewart, S. E., Geller, D. A., Jenike, M., Pauls, D., Shaw, D., Mullin, B., & Faraone, S. V. ( 2004 ). Long‐term outcome of pediatric obsessive–compulsive disorder: A meta‐analysis and qualitative review of the literature. Acta Psychiatrica Scandinavica, 110 ( 1 ), 4 – 13. https://doi.org/10.1111/j.1600‐0447.2004.00302.x
dc.identifier.citedreferenceStorch, E. A., Khanna, M., Merlo, L. J., Loew, B. A., Franklin, M., Reid, J. M., Goodman, W. K., & Murphy, T. K. ( 2009 ). Children’s Florida Obsessive Compulsive Inventory: Psychometric properties and feasibility of a self‐report measure of obsessive–compulsive symptoms in youth. Child Psychiatry and Human Development, 40 ( 3 ), 467 – 483. https://doi.org/10.1007/s10578‐009‐0138‐9
dc.identifier.citedreferenceSwanson, J. M., Schuck, S., Porter, M. M., Carlson, C., Hartman, C. A., Sergeant, J. A., Clevenger, W., Wasdell, M., McCleary, R., Lakes, K., & Wigal, T. ( 2012 ). Categorical and dimensional definitions and evaluations of symptoms of ADHD: History of the SNAP and the SWAN rating scales. The International Journal of Educational and Psychological Assessment, 10 ( 1 ), 51 – 70.
dc.identifier.citedreferenceUher, R., Heyman, I., Turner, C. M., & Shafran, R. ( 2008 ). Self‐, parent‐report and interview measures of obsessive–compulsive disorder in children and adolescents. Journal of Anxiety Disorders, 22 ( 6 ), 979 – 990. https://doi.org/10.1016/j.janxdis.2007.10.001
dc.identifier.citedreferencevan der Plas, E., Dupuis, A., Arnold, P., Crosbie, J., & Schachar, R. ( 2016 ). Association of autism spectrum disorder with obsessive‐compulsive and attention‐deficit/hyperactivity traits and response inhibition in a community sample. Journal of Autism and Developmental Disorders, 46 ( 9 ), 3115 – 3125. https://doi.org/10.1007/s10803‐016‐2853‐y
dc.identifier.citedreferencevan Grootheest, D. S., Cath, D. C., Beekman, A. T., & Boomsma, D. I. ( 2005 ). Twin studies on obsessive–compulsive disorder: A review. Twin Research and Human Genetics, 8 ( 5 ), 9.
dc.identifier.citedreferenceZhu, W., Zeng, N. N., & Wang, N. ( 2010 ). Sensitivity, specificity, accuracy, associated confidence interval and ROC analysis with practical SAS implementations. NESUG Proceedings: Health Care and Life Sciences, 19.
dc.identifier.citedreferenceAbramowitz, J. S., Fabricant, L. E., Taylor, S., Deacon, B. J., McKay, D., & Storch, E. A. ( 2014 ). The relevance of analogue studies for understanding obsessions and compulsions. Clinical Psychology Review, 34 ( 3 ), 206 – 217. https://doi.org/10.1016/j.cpr.2014.01.004
dc.identifier.citedreferenceBerg, C. J., Rapoport, J. L., & Flament, M. ( 1986 ). The Leyton Obsessional Inventory‐Child Version. Journal of the American Academy of Child Psychiatry, 25 ( 1 ), 84 – 91. https://doi.org/10.1016/S0002‐7138(09)60602‐6
dc.identifier.citedreferenceBurton, C. L., Crosbie, J., Dupuis, A., Mathews, C. A., Soreni, N., Schachar, R., & Arnold, P. D. ( 2016 ). Clinical correlates of hoarding with and without comorbid obsessive‐compulsive symptoms in a community pediatric sample. Journal of the American Academy of Child & Adolescent Psychiatry, 55 ( 2 ), 114 – 121. https://doi.org/10.1016/j.jaac.2015.11.014
dc.working.doiNOen
dc.owningcollnameInterdisciplinary and Peer-Reviewed


Files in this item

Show simple item record

Remediation of Harmful Language

The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.

Accessibility

If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.