2013/2014
Daniela Vilas Boas Rosa Linhares
Validation of Control of Allergic
Rhinitis and Asthma Test for Children
(CARATKids) – a prospective
multicenter study
Mestrado Integrado em Medicina
Área: Alergologia
Trabalho efetuado sob a Orientação de:
Professor Doutor João A Fonseca
Trabalho organizado de acordo com as normas da revista:
Pediatric Allergy and Immunology
Daniela Vilas Boas Rosa Linhares
Validation of Control of Allergic
Rhinitis and Asthma Test for Children
(CARATKids) – a prospective
multicenter study
!
!
!
!
!
!
!
!
!
!
!
!
Declarações!
P O R T O Projeto de Opcao do 6° ano - DECLARACAO DE INTEGRIDADE
F M U P FACULOADE DE MEDICINA
I ] UNIVERSIDADE DO PORTO
U N I O A D f C U R R C J L A s P R O J E T O DE O P C A O
Eu, Daniela Vilas Boas Rosa Linhares abaixo assinado, n° mecanografico 200806655 (080801070), estudante do 6° ano do Ciclo de Estudos Integrado em Medicina, na Faculdade de Medicina da Universidade do Porto, declaro ter atuado com absoluta integridade na elaboracao deste projeto de opcao.
Neste sentido, confirmo que NAO incorri em plagio (ato pelo qual urn individuo, mesmo por omissao, assume a autoria de urn determinado trabalho intelectual, ou partes dele). Mais declaro que todas as frases que retirei de trabalhos anteriores pertencentes a outros autores, foram referenciadas, ou redigidas com novas palavras, tendo colocado, neste caso, a citacao da fonte bibliografica.
Faculdade de Medicina da Universidade do Porto, 10/03/2014
PORTO
Projecto de Opcao do 6 ° ano - DECLARACAO DE REPRODUCAO p p FACUIDADE DE MEDICINA I UNIVERSIDAOE DO PORTO U N I D A D £ C U R R I C U L A R P R O J E T O DE O P 5 & 0 NOMEDaniela Vilas Boas Rosa Linhares
CARTAO DE CIDADAO ou PASSAPORTE (se estrangeiro) E-MAIL TELEFONE OU TELEMOVEL
13800065 Daniela_linhares@sapo.pt 916092772
NUMERO DE ESTUDANTE
200806655
DATA DE CONCLUSAO
2014
DESIGNACAO DA AREA DO PROJECTO
Alergologia
TITULO DISSERTACAO
Validation of Control of Allergic Rhinitis and Asthma Test for Children (CARATKids) - a prospective multicenter study
ORIENTADOR
Prof. Dr. Joao A Fonseca
E autorizada a reproducao integral desta Dissertacao para efeitos de investigacao e de divulgacao pedagogica, em programas e projectos coordenados pela FMUP.
Faculdade de Medicina da Universidade do Porto, 10/03/2014
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
Dedicado(aos(meus(pais(que(sempre(me(apoiaram( e(que(às(vezes(acreditaram(mais(em(mim(do(que(eu(mesma( ( Dedicado(ao(meu(irmão(João,(de(quem(muito(me(orgulho,(( que(me(ajuda(mesmo(sem(saber(que(está(a(ajudar(!
!
!
!
!
!
!
!
!
!
!
Trabalho(de(acordo!
com#as#normas#da#
revista!
Full$Title:!Validation!of!Control!of!Allergic!Rhinitis!and!Asthma!Test!for!Children!(CARATKids)!–!a! 1! prospective!multicenter!study! 2! ! 3! Authors:$ 4! Daniela$Vilas$Boas$Rosa$Linhares$ 5! CINTESIS!–!Faculty!of!Medicine!of!University!of!Porto! 6! Porto,!Portugal! 7! João$Almeida$Lopes$da$Fonseca$ 8! CINTESIS!–!Faculty!of!Medicine!of!University!of!Porto! 9! Immunoallergy!Department,!CUF!Porto!Institute! 10! Immunoallergy!Department,!CUF!Porto!Hospital! 11! Porto,!Portugal! 12! Luís$Miguel$Borrego$ 13! Immunoallergy!Department,!CUF!Descobertas!Hospital,!Lisbon! 14! Faculty!of!Medical!Sciences,!Department!of!Immunology,!NOVA,!CEDOC,!Lisbon! 15! Lisbon,!Portugal! 16! Águeda$Matos$ 17! Pediatric!Department,!Guimarães!Hospital! 18! Guimarães,!Portugal! 19! Ana$Margarida$Pereira$ 20! CINTESIS!–!Faculty!of!Medicine!of!University!of!Porto! 21! Immunoallergy!Department,!CUF!Porto!Institute! 22! Immunoallergy!Department,!CUF!Porto!Hospital! 23! Immunoallergy!Department,!Centro!Hospitalar!S.!João,!Porto! 24! Porto,!Portugal! 25! Ana$Sá$e$Sousa$ 26! CINTESIS!–!Faculty!of!Medicine!of!University!of!Porto! 27! Porto,!Portugal! 28! Ângela$Gaspar$ 29! Immunoallergy!Department,!CUF!Descobertas!Hospital,!Lisbon! 30! Lisbon,!Portugal! 31! Cândida$Mendes$ 32! Pediatric!Department,!Vila!Franca!de!Xira!Hospital! 33! Vila!Franca!de!Xira,!Portugal! 34! Carla$Moreira$ 35! Pediatric!Department,!Braga!Hospital! 36! Braga,!Portugal! 37! Eva$Gomes$ 38! Centro!Hospitalar!do!Porto,!Immunoallergy!Department! 39! CUF!Porto!Hospital,!Immunoallergy!Department! 40! Porto,!Portugal! 41! ! 42!
Filomena$Fernandes$Rebelo$ 43! Pediatric!Department,!Centro!Hospitalar!Oeste!Norte,!Caldas!da!Rainha!! 44! Caldas!da!Rainha,!Portugal! 45! José$Carlos$Cidrais$Rodrigues$ 46! Pediatric!Department,!Hospital!Pedro!Hispano,!Matosinhos!! 47! Matosinhos,!Portugal! 48! José$Manuel$Onofre$ 49! Pediatric!Department,!Santarém!Hospital! 50! Santarém,!Portugal! 51! Luís$Filipe$Azevedo$ 52! CINTESIS!–!Faculty!of!Medicine!of!University!of!Porto! 53! Porto,!Portugal! 54! Maria$Alfaro$ 55! Pediatric!Department,!Faro!Hospital! 56! Faro,!Portugal! 57! Maria$José$Calix$ 58! Pediatric!Department,!Hospital!São!Teotónio,!Viseu! 59! Viseu,!Portugal! 60! Rita$Amaral$ 61! CINTESIS!–!Faculty!of!Medicine!of!University!of!Porto! 62! Porto,!Portugal! 63! Rodrigo$RodriguesOAlves$ 64! Immunoallergy!Department,!Hospital!Divino!Espírito!Santo,!Ponta!Delgada! 65! Ponta!Delgada,!Açores,!Portugal! 66! Jaime$Correia$de$Sousa$ 67! Life!and!Health!Sciences!Research!Institute!(ICVS),!School!of!Health!Sciences,!University!of!Minho,! 68! Braga! 69! ICVS/3B's,!PT!Government!Associate!Laboratory,!Braga/Guimarães! 70! Braga,!Portugal! 71! Mário$MoraisOAlmeida$ 72! Immunoallergy!Department,!CUF!Descobertas!Hospital,!Lisbon! 73! CINTESIS!–!Faculty!of!Medicine!of!University!of!Porto,!Porto! 74! Lisbon,!Portugal! 75! ! 76! Running$Title:!Validation!of!CARATKids!! 77! Corresponding$Author:$ 78! João!Almeida!Lopes!da!Fonseca! 79! Faculty!of!Medicine!of!University!of!Porto,!! 80! Alameda!Hernâni!Monteiro!! 81! 4200]319!Porto,!Portugal! 82! fonseca.ja@gmail.com! 83! ! 84!
Word$Count:$ 85! • Abstract:!250!words! 86! • Main!Text:!2633!words! 87! ! 88! Tables$and$Figures:$ 89! • 3!tables! 90! • 2!figures! 91! ! 92! 1$Supplementary$file:$ 93! • 3!tables! 94! • 1!figure! 95! 96!
Authors:!Linhares!D,!Fonseca!JA,!Borrego!LM,!Azevedo!LF,!Pereira!AM,!Matos!A,!Sá]Sousa!A,!Gaspar! 97! A,!Mendes!C,!Moreira!C,!Gomes!E,!Fernandes!F,!Cidrais]Rodrigues!J,!Onofre!JM,!Alfaro!M,!Calix!MJ,! 98! Amaral!R,!Rodrigues]Alves!R,!Sousa!JC,!Morais]Almeida!M!for!the!CARATKids!study!group! 99! ! 100! Title:!Validation!of!Control!of!Allergic!Rhinitis!and!Asthma!Test!for!Children!(CARATKids)!–!a! 101! prospective!multicenter!study! 102! Journal$Title:!Pediatr!Allergy!Immunol! 103!
Abstract$
104! Background:!Control!of!Allergic!Rhinitis!and!Asthma!Test!for!Children!(CARATKids)!is!the!first! 105! questionnaire!that!assesses!simultaneously!allergic!rhinitis!and!asthma!control!in!children.!It!was! 106! recently!developed,!but!redundancy!of!questions!and!its!psychometric!properties!were!not!assessed.! 107! This!study!aimed!to!(i)establish!the!final!version!of!the!CARATKids!questionnaire!and!(ii)evaluate!its! 108! reliability,!responsiveness,!cross]sectional!validity,!and!longitudinal!validity.! 109! Methods:!A!prospective!observational!study!was!conducted!in!11!Portuguese!centers.!During!two! 110! visits!separated!by!6wk,!CARATKids,!visual!analog!scale!scales!and!childhood!asthma!control!test! 111! were!completed,!and!participant’s!asthma!and!rhinitis!were!evaluated!by!his/her!physician!without! 112! knowing!the!questionnaires’!results.!Data]driven!item!reduction!was!conducted,!and!internal! 113! consistency,!responsiveness!analysis,!and!associations!with!external!measures!of!disease!status!were! 114! assessed.!! 115! Results:!Of!the!113!children!included,!101!completed!both!visits.!After!item!reduction,!the!final! 116! version!of!the!questionnaire!has!13!items,!eight!to!be!answered!by!the!child!and!five!by!the! 117! caregiver.!Its!Cronbach’s!alpha!was!0.80,!the!Guyatt’s!responsiveness!index!was!]1.51,!and!a! 118! significant!(p<0.001)!within]patient!change!of!CARATKids!score!in!clinical!unstable!patients!was! 119! observed.!Regarding!cross]sectional!validity,!correlation!coefficients!of!CARATKids!with!the!external! 120! measures!of!control!were!between!0.45!and!]0.69!and!met!the!a!priori!predictions.!In!the! 121! longitudinal!validity!assessment,!the!correlation!coefficients!between!the!score!changes!of! 122! CARATKids!and!those!of!external!measures!of!control!ranged!from!0.34!to!0.46.! 123! Conclusion:!CARATKids!showed!adequate!psychometric!properties!and!is!ready!to!be!used!in!clinical! 124! practice.! 125!Keywords$
126! Allergic!rhinitis,!Asthma,!Child,!Questionnaires,!Patient]reported!outcomes! 127! ! 128! Offprint$Requests:$ 129! João!Almeida!Lopes!da!Fonseca! 130! Faculty!of!Medicine!of!University!of!Porto,!! 131! Alameda!Hernâni!Monteiro!! 132! 4200]319!Porto,!Portugal! 133! fonseca.ja@gmail.com 134!Introduction$
135! Asthma!and!allergic!rhinitis!(ARA)!are!chronic!inflammatory!diseases!of!the!airways!that!often! 136! coexist!in!children!(1).!Rhinitis!increases!the!risk!of!asthma!and!impairs!its!control!(2–4).!When!non] 137! controlled,!these!conditions!are!responsible!for!a!significant!decrease!in!patient’s!quality!of!life!(1).! 138! Currently,!clinical!asthma!control!is!defined!as!the!frequency!and!intensity!of!symptoms!and! 139! functional!limitations!that!a!patient!experiences!or!has!recently!experienced!as!a!consequence!of! 140! the!disease!and!includes!day!and!night!symptoms,!use!of!reliever!therapy,!activity!limitations,!and! 141! lung!function!measurements!(5).!Rhinitis!control!has!never!been!formally!defined.!Nevertheless,! 142! Demoly!et!al.!(6)!recently!argued!for!the!use!of!the!concept!of!rhinitis!control!as!a!way!to!improve! 143! clinical!decisions.! 144! CARAT10!was!the!first!tool!that!was!developed!and!validated!to!assess!ARA!control!in!adults!(age≥18! 145! yr)!(6–8).!In!children,!until!recently,!there!were!several!available!tools!evaluating!asthma!control,!but! 146! as!far!as!we!know,!there!was!no!tool!assessing!the!control!of!rhinitis!or!ARA.!Control!of!Allergic! 147! Rhinitis!and!Asthma!Test!for!Children!(CARATKids)!was!developed!to!evaluate!ARA!control!in! 148! children!with!6–12yr!old.!This!initial!version!of!CARATKids!has!17]item!and!was!developed!from! 149! CARAT!and!other!pediatric!questionnaires,!in!a!two]phase!study!with!consensus!meetings!between! 150! specialized!physicians!on!the!area,!and!cognitive!interviews!of!children!and!their!caregivers!(7);!it! 151! uses!a!dichotomic!scale!(Yes/No!answers),!with!easily!understandable!questions!and!images!for! 152! children.! 153! This!study!aims!to!(i)define!the!final!version!of!the!CARATKids!questionnaire!(item!reduction!and! 154! content!structure!and!layout!improvement)!and!(ii)to!evaluate!its!reliability,!responsiveness,!and! 155! cross]sectional!and!longitudinal!validity.! 156! ! 157!Methods$
158! Study$design$and$setting$$
159! A!multicentric!prospective!observational!study!was!conducted!in!eleven!centers!located!in!five!of!the! 160! seven!Portuguese!regions.!Allergists!and!pediatricians!were!invited!to!participate,!and!one!to!five! 161! physicians!at!each!center!joined!the!study.!This!study!comprised!two!visits,!3–6wk!apart,!and!was! 162! conducted!between!July!2012!and!February!2013.! 163! Participants$ 164! All!patients!between!6!and!12!yr!old,!with!a!previous!medical!diagnosis!of!asthma!and!allergic! 165! rhinitis,!followed!at!the!participating!centers,!for!at!least!three!months,!were!eligible.!Children!with! 166! other!respiratory!or!chronic!diseases!that!could!interfere!with!the!study!measurements,!as!well!as! 167! parents!and!children!unable!to!fill!the!questionnaire,!were!excluded.!The!study!was!approved!by!the! 168! Hospital!CUF!Descobertas’!ethics!committee,!and!each!patient’s!parents!gave!their!written!informed! 169! consent.! 170! Data$Collection$ 171! Questionnaires!were!completed!at!each!visit!by!children!and!their!caregivers,!namely!CARATKids,! 172! childhood!Asthma!Control!Test!(cACT),!and!visual!analog!scale!(VAS)!of!rhinitis!and!asthma!control.! 173! CARATKids’!initial!version!has!17!questions,!with!two!answer!options!–!‘Yes’,!scored!as!1!=!no!control! 174!(symptom/item!present);!and!‘No’,!scored!as!0!=!control!(symptom/item!not!present).!The!attending! 175! physician!performed!a!medical!evaluation!and!filled!out!VAS!of!rhinitis!and!asthma!control.! 176! Physicians!were!blinded!to!patient/caregiver’s!questionnaire!responses.!Characteristics!of!the! 177! questionnaire!according!to!patient]reported!outcomes!Ga2len!recommendations!are!presented!on! 178! Table!S1!(8).! 179! Data$Analysis$ 180! Sample!size!was!established!using!COSMIN!recommendations!(9).!To!assess!over!100!participants,! 181! with!an!attrition!rate!of!10%,!115!patients!were!planned!to!be!included.!Sample!characteristics!were! 182! described!by!standard!descriptive!statistics.!The!variables’!distribution!was!plotted!to!visually!assess! 183! the!distribution,!and!parametric!and!nonparametric!tests!were!used!as!appropriate.! 184! The!physicians’!VAS!assessing!asthma!or!rhinitis!control!were!categorized!as!dichotomous!variables,! 185! classifying!the!patient!as!controlled!or!uncontrolled.!Disease!control!was!defined!as!a!VAS! 186! measurement!to!be!greater!than!six!out!of!a!scale!ranging!from!0!(bad)!to!10!(good),!according!to! 187! previous!reports!(10).!This!was!applied!for!the!control!of!allergic!rhinitis!as!well!as!asthma!control.! 188! Asthma!control!was!also!classified!according!to!the!Global!Initiative!for!Asthma!(GINA)!guidelines!(5)! 189! and!to!cACT,!with!controlled!asthma!defined!as!a!score!of!19!or!less!(11).!A!patient!was!considered! 190! controlled!when!both!asthma!and!rhinitis!were!controlled,!taking!into!account!the!GINA! 191! classification!for!asthma!and!physician!VAS!classification!for!rhinitis.!The!rhinitis!severity!was! 192! classified!according!to!Allergic!Rhinitis!and!its!Impact!on!Asthma!(ARIA)!recommendations!(12).! 193! Patients!who!were!graded!between!5.0!and!6.0!in!the!second!visit’s!control!variation!VAS!of!both! 194! asthma!and!rhinitis!were!considered!to!be!clinically!stable.! 195! All!answers!were!analyzed!and!response!rates!computed.!Results!from!physician!assessment! 196! measures!and!children/caregiver’s!answers!in!each!visit!were!pooled!and!plotted!against!CARATKids! 197! scores!and!factors.! 198! Item$Reduction$ 199! Item!reduction!was!based!on!statistical!criteria!and!on!a!consensus!meeting!with!an!expert!panel! 200! held!in!May!2013.!Stepwise!logistic!regression!was!performed!to!reduce!the!17]item!working! 201! questionnaire.!Exploratory!factor!analysis!and!internal!consistency!analysis!were!also!performed!and! 202! taken!into!account!for!the!item!reduction.!An!item!was!considered!redundant,!and!it!was!discarded,! 203! if!one!of!the!following!occurred:!a)responses!over!95%!in!a!single!category!of!a!variable;!b)a!p]value! 204! of!less!than!0.10!in!logistic!regression!analysis;!c)considerable!cross]loading!(>0.300!in!more!than! 205! one!factor)!or!low!item]total!correlation!(<0.400)!or!increased!Cronbach’s!alpha!if!the!item!was! 206! deleted.! ! 207!
Evaluation$of$CARATKids$ 208! Control!of!Allergic!Rhinitis!and!Asthma!Test!for!Children!measurement!properties!were!assessed! 209! according!to!the!COSMIN!checklist!(9):!(i)reliability!(internal!consistency,!using!Cronbach’s!a;!test– 210! retest!reliability,!using!intraclass!correlation!coefficient!(ICC)),!(ii)responsiveness!(within]!patient! 211! change!in!CARATKids!score;!Guyatt’s!responsiveness!index!(GRI)),!(iii)discriminative!properties!and! 212! validity!–!(iii.a)concurrent!validity!(physician!assessment,!self]assessment,!and!cACT);! 213! (iii.b)longitudinal!validity!(physician!assessment,!self]!assessment,!and!cACT);!and!(iii.c)hypothesis! 214! testing,!with!a!priori!predictions!for!concurrent!validity!for!the!correlation!defined!as:!(i)0.5–0.7!with! 215! cACT;!(ii)0.4–0.7!with!the!symptoms!VAS;!(iii)0.4–0.6!with!the!physician’s!assessment).!Confidence! 216! intervals!(CI)!for!correlation!coefficients!were!calculated!using!bootstrap!methods.!Lower!and!upper! 217! limits!of!the!95%CI!corresponded!to!the!percentiles!2.5!and!97.5!of!the!distribution!of!the!sample! 218! statistics!after!thousand!replicates!(random!samples!with!replacement!of!the!same!size!as!the! 219! original!sample)!for!each!estimate.! 220! The!statistical!analysis!was!carried!out!using!SPPS!21.0!(SPSS!Inc.,!Chicago,!IL,!USA).!The!level!of! 221! significance!was!set!at!p<0.05.! 222! ! 223!
Results$
224! The!113!patients!included!were!assessed!by!23!physicians!at!11!outpatients’!clinics.!Twelve!patients! 225! (10.6%)!did!not!attend!the!second!visit.!The!general!characteristics!of!patients!are!summarized!in! 226! Table!1.!Of!the!103!with!complete!data!on!allergy,!98!were!positive!to!house!dust!mites!and!32!for! 227! pollens,!mostly!grass!pollen,!and!13!sensitized!to!cat!or!dog.! 228! Overall,!0.3%!of!all!CARATKids!questions!were!not!answered.!The!items!with!more!missing!items! 229! each!with!two!missings!(1.8%)!were!‘Wheezing’,!by!both!children!and!parents,!‘Rhinorrhoea’!and! 230! ‘Throat!symptoms’!by!children,!and!‘Nasal!Obstruction’!and!‘Dyspnoea’!by!parents.! 231! For!longitudinal!analysis,!full!data!on!disease!control!were!available!for!80!patients.!Twenty]nine! 232! patients!(36%)!were!classified!as!having!clinically!stable!asthma!and!rhinitis.!The!unstable!group! 233! included!51!patients,!15!with!both!unstable!asthma!and!rhinitis,!16!with!only!unstable!rhinitis,!and! 234! 20!with!only!unstable!asthma.! 235! Item$Reduction$ 236! Internal!consistency!was!better!when!questions!were!answered!by!the!parents!and!children! 237! separately!than!when!answered!together.!Moreover,!the!responses!of!parents!and!children! 238! separately!had!better!correlation!coefficients!with!comparative!measures!than!questions!answered! 239! by!parents!and!children!together!(data!not!shown).!The!expert!panel,!held!to!discuss!item!selection,! 240! decided!the!questions!should!be!answered!by!the!children!and!the!parents!separately!(Fig.!S1).!The! 241! item!‘Hospitalization’!was!eliminated,!because!it!had!more!than!95%!of!answers!‘No’.!Then,!using! 242! stepwise!logistic!regression,!the!items!‘Nasal!pruritus’,!‘Throat!symptoms’,!and!‘Ocular!symptoms’! 243! were!excluded!(Fig.!S1).!Internal!consistency!analysis!was!in!agreement!with!this!13]item!version!of! 244! the!questionnaire.!Exploratory!factor!analysis!identified!four!factors!and!had!no!contribution!to!the! 245! item!reduction.!The!final!questionnaire!had!13!questions.!Based!on!the!data!from!internal! 246! consistency!and!logistic!regression!analysis!and!the!associations!with!external!comparison!measures,! 247! eight!questions!are!best!answered!by!the!children!and!five!by!the!parents.! ! 248!Properties$and$Evaluation$of$CARATKids$ 249! Control!of!Allergic!Rhinitis!and!Asthma!Test!for!Children!had!a!median!(P25]P75)!score!of!4!(2–7)!in! 250! the!first!visit!and!of!3!(1–5)!in!the!second!one.!Nine!patients!(8.2%)!in!visit!1!and!13!(15.6%)!in!visit!2! 251! had!the!minimum!score!of!0,!and!2!(1.8%)!in!visit!1!and!1!(0.9%)!in!visit!2!had!the!maximum!score!of! 252! 13.!The!mean!(s.d.)!score!difference!between!the!two!visits!was!of!]1.46!(3.34),!p<0.001.!Control!of! 253! Allergic!Rhinitis!and!Asthma!Test!for!Children!scores!were!significantly!different!when!comparing! 254! patients!with!controlled,!uncontrolled,!and!partly!controlled!asthma,!and!when!comparing!children! 255! with!mild!rhinitis!with!those!with!moderate!to!severe!disease!(p<0.05).!Scores!differed!significantly! 256! between!physician’s!treatment!decision!groups!(reduction,!maintenance,!or!increase),!GINA! 257! classification!of!asthma!control,!and!ARIA!classification!of!severity!(Fig.!1!and!Table!S2).!In!both!visits,! 258! significant!differences!are!observed!in!CARATKids!scores!between!control!groups!defined!by!cACT! 259! (Fig.!1).! 260! In!the!internal!consistency!analysis,!the!Cronbach’s!alpha!was!0.80!for!CARATKids.! 261! All!correlation!coefficients!met!the!a!priori!predictions!(Table!2).!Coefficients!varied!between!0.430! 262! and!]0.689!(all!p<0.001).!Correlation!coefficient!of!CARATKids!scores!with!GINA!classification!of! 263! asthma!control!was!of!]0.60!(95%CI!]0.728;!]0.442)!and!of!0.430!(0.235;!0.584)!with!ARIA! 264! classification!of!rhinitis!severity!(p<0.001).! 265! Receiver!operating!characteristic!curves!for!CARATKids!are!shown!in!Fig.!2.!The!areas!under!the! 266! curve!for!CARATKids!ranged!from!0.761!(physician!evaluation!of!rhinitis!control)!to!0.826!(cACT).! 267! In!the!test–retest!reliability!analysis,!the!ICC!was!0.80!in!the!stable!group.!When!evaluating! 268! responsiveness,!we!observed!a!significant!within]patient!change!of!CARATKids!score!in!clinically! 269! unstable!patients,!not!only!when!both!the!conditions!were!unstable!(mean(s.d.)!change!of!] 270! 3.8(2.83),!p!<!0.001)!but!also!when!at!least!one!was!unstable!(]2.1(3.54),!p<0.001).!In!the!stable! 271! group,!there!was!a!non]significant!difference!(mean(s.d.)!of!]0.59(2.52),!p=0.23)!between!CARATKids! 272! scores!in!the!two!visits.!The!GRI!was!of!1.51!in!the!group!with!both!conditions!unstable.! 273! The!range!of!the!correlation!coefficients!between!the!variation!in!CARATKids!scores!and!the! 274! variation!in!physician!assessment!of!control!using!VAS!was!0.454!and!0.446,!meeting!the!a!priori! 275! prediction!(Table!2).! 276!
Discussion$
277! This!article!describes!the!clinical!evaluation!of!CARATKids,!the!first!questionnaire!developed!to! 278! concurrently!assess!asthma!and!allergic!rhinitis!control!in!6]!to!12]yr]old!children.!A!process!of!item! 279! reduction!from!the!initial!17]item!version!of!CARATKids!was!performed!to!reduce!redundancy!and! 280! improve!the!questionnaire’s!reliability!and!validity.!The!13]item!questionnaire!showed!to!have!good! 281! discriminative!properties.! 282! Of!the!13!items,!five!are!to!be!answered!by!parents!and!eight!by!children!(Fig.!S1).!Although!this! 283! method!of!a!twofold!answer!was!found!to!be!the!most!adequate!solution,!the!usability!of!the! 284! questionnaire!is!somehow!reduced!by!the!parent!and!child!response!method.!However,!previous! 285! studies!on!asthma!also!observed!divergence!between!children!and!parent]reported!variables,!with! 286! some!sets!of!questions!being!better!answered!by!each!of!them!(11,!13,!14).!In!fact,!cACT!also!has!a! 287! twofold!answer!method!(11).!The!questions!on!sneezing!and!other!nasal!symptoms!had!better! 288!results!when!answered!by!the!children,!while!parents!may!be!less!aware!of!the!frequency!of!these! 289! symptoms.!In!the!cognitive!interviews!performed!in!the!initial!stages!of!CARATKids!development,! 290! this!lack!of!concordance!was!already!observed!(7).! 291! The!internal!consistency!was!satisfactory!(15),!being!similar!or!better!than!other!questionnaires! 292! evaluating!asthma!control!in!children,!such!as!cACT!(11),!Asthma!Control!Questionnaire!(ACQ)!in! 293! Children!(CAN)!(16),!Test!for!Respiratory!and!Asthma!Control!in!Kids!(TRACK)!(17),!ACQ!in!children! 294! (18),!or!Asthma!Quiz!(19)!(Table!3);!however,!it!was!slightly!lower!than!the!one!in!adult’s! 295! questionnaires,!as!CARAT!(20)!and!Asthma!Control!Test!(ACT)!(21)!(Table!3).!The!areas!under!the! 296! curve!were!high!(0.761–0.826),!namely!when!compared!with!physician!assessment!of!control!and! 297! cACT!(Fig.!2)!assumed!as!comparators.!These!are!in!the!same!range!of!those!previously!observed!in! 298! studies!on!adults!and!are!higher!than!the!ones!reported!for!cACT!(Table!3).! 299! A!gold!standard!for!ARA!control!has!not!been!established!yet.!Therefore,!concurrent!validity!was! 300! assessed!using!different!external!measures!of!control,!based!on!physicians,!children,!and!caregivers’! 301! assessments.!A!priori!predictions!were!met,!and!all!coefficients!are!in!the!same!range!as!those! 302! observed!with!other!tools!to!assess!control,!both!in!children!and!adults!(Table!3).! 303! In!test–retest!reliability!analysis,!CARATKids!scores!showed!an!ICC!similar!or!better!than!those!of! 304! ACQ!in!children,!TRACK,!CAN,!ACT,!and!CARAT!(Table!3).! 305! Large!responsiveness,!greater!than!0.8!was!observed!(22).!Moreover,!the!magnitude!of!GRI!of! 306! CARATKids!(1.51)!was!similar!to!the!one!of!CARAT!(1.54).! 307! Regarding!longitudinal!validity,!correlation!coefficients!were!higher!than!a!priori!predictions!for! 308! physician!and!children!VAS!of!both!asthma!and!rhinitis!control!(Table!2),!but!not!for!cACT.!As!we! 309! could!not!find!longitudinal!validity!assessment!of!cACT,!it!is!difficult!to!interpret!the!low!correlation! 310! coefficient!we!observed!between!ΔCARATKids!scores!and!ΔcACT.!This!low!correlation!may!be! 311! related!to!differences!in!sensitivities!or!responsiveness!of!the!questionnaires.!In!any!case,!in!both! 312! visits,!significant!differences!were!observed!in!CARATKids!scores!between!cACT!control!groups!(Fig.! 313! 1).!The!only!control!questionnaires!for!children!with!published!longitudinal!validity!results!are!ACQ! 314! in!children!and!CAN.!The!CARATKids!longitudinal!results!are!similar!to!CAN!and!worse!than!ACQ!in! 315! children!(Table!3).!This!may!be!related!to!differences!in!the!study!design,!as!ACQ!for!children!was! 316! evaluated!in!a!single!center,!with!3!visits!in!4wk!(0,!1,!and!4wk)!that!included!only!35!children!(18).! 317! Moreover,!a!guideline]based!assessment!of!asthma!control!is!already!available,!while!the!control!of! 318! rhinitis!was!defined!by!physician]derived!measures!because!no!gold!standard!measure!is!available! 319! yet.!It!is!known!that!there!is!a!bias!associated!with!the!physician!assessment!of!control!(23),!which! 320! can!partly!explain!the!somewhat!lower!CARATKids!scores.!Nevertheless,!CARATKids!longitudinal! 321! validity!results!were!similar!to!those!of!control!questionnaires!in!adults!and!of!the!CAN! 322! questionnaire!(Table!3).! 323! This!study!has!several!limitations.!Interobserver!agreement!may!have!been!reduced!by!the!high! 324! number!of!observes!included,!as!data!were!collected!by!23!physicians!at!11!outpatients’!clinics.! 325! Nevertheless,!this!dispersion!of!data!collection!may!improve!the!generalizability!to!the!real]world! 326! clinical!practice.!Also,!patients!were!not!equally!distributed!across!the!range!of!asthma!and!rhinitis! 327! severity,!and!for!some!subgroups,!the!number!of!patients!was!low.!This!was!specially!relevant!for! 328! uncontrolled!asthma!subgroup!for!which!only!12!patients!were!accessed.!Furthermore,!CARATKids! 329! was!only!assessed!in!children!established!asthma!and!allergic!rhinitis!diagnosis;!therefore,!its! 330! performance!in!children!with!only!one!of!the!diseases!remains!unknown.! 331! Minimal!important!difference!and!cutoff!values!are!important!properties!that!were!not!objectives!of! 332!
this!study!and!should!be!defined!in!future!studies.!This!would!be!specially!important!to!use! 333! CARATKids!in!intervention!studies.!Nevertheless,!we!conducted!exploratory!analysis!of!the!cutoff! 334! values.!We!considered!one!point!for!each!‘Yes’!answer!and!classified!the!CARATKids!scores!as! 335! controlled!(<4),!insufficiently!controlled!(4,!5),!and!uncontrolled!(>5).!Uncontrolled!asthma!or!rhinitis! 336! can!be!ruled!out!with!a!score!of!three!or!less!and!ruled!in!with!a!score!higher!than!five!with!good! 337! sensitivity!and!specificity!(Table!S3).!The!clinical!usefulness!of!routine!assessment!of!control!in! 338! children,!using!questionnaires,!also!needs!to!be!assessed!in!long]term!studies.! 339! In!conclusion,!CARATKids,!the!first!questionnaire!assessing!allergic!rhinitis!and!asthma!control!for! 340! children!6–12!yr!old,!showed!adequate!psychometric!properties!to!be!used!in!clinical!practice.
!
341! Acknowledgments$ 342! We!thank!the!heads!of!the!departments!where!the!study!was!conducted,!the!physicians!that! 343! participated!in!the!data!collection:!Alberto!Gomes!Costa,!Cristina!Arede,!Graça!Sampaio,!Helder! 344! Ferreira,!Isabel!Andrade,!Luís!Araújo,!Susana!Piedade.! 345! Disclosure$ 346! None!of!the!authors!received!payments!or!services,!either!directly!or!indirectly,!from!a!third!party!in! 347! support!of!any!aspect!of!this!work. 348!Tables$
349! $ Visit$1$$ n=113$ Visit$2$n=101$ Age$mean$(SD)$years$ 8.75!(1.86)! 8.84!(1.82)! Gender$n$(%)$ ! ! Male$ 69!(61.1%)! 64!(63.4%)! Female$ 44!(38.9%)! 37!(36.6%)! cACT$score$(p25Op75)$ 23!(19]25)! 24!(21.3]26)! Physician$Assessment$n$(%)$ ! ! Asthma$Control$O$GINA$ ! ! Uncontrolled$ 12!(10.6%)! 4!(3.5%)! Partly$Controlled$ 36!(31.9%)! 18!(15.9%)! Controlled$ 46!(40.7%)! 65!(57.5%)! Rhinitis$O$ARIA$ ! ! Intermittent$ 43!(38.1%)! 50!(44.2%)! Persistent$ 66!(58.4%)! 49!(43.4%)! Mild$ 73!(64.6%)! 82!(72.6%)! Moderate/Severe$ 37!(32.7%)! 19!(16.8%)! VAS$Control$median$(p25Op75)$ ! ! Asthma$ 5!(8]9)! 9!(8]9.5)! Rhinitis$ 6!(4]8)! 8!(6]9)! Treatment$Decision$n$(%)$ ! ! Reduce$ 8!(7.1%)! 9!(9.1%)! Maintain$ 51!(45.5%)! 68!(68.7%)! Increase$ 53!(47.3%)! 22!(22.2%)! $ 350! Table$1$Characteristics!of!participants.!cACT,!childhood!Asthma!Control!Test;!GINA,!Global!Initiative! 351! for!Asthma;!ARIA,!Allergic!Rhinitis!and!its!Impact!on!Asthma;!VAS,!Visual!Analogue!Scale.! ! 352!$ Physician$Assessment$–$VAS/ΔVAS$ Children$Assessment$–$VAS/ΔVAS$ cACT/ΔcACT$ Asthma$Control$ Rhinitis$Control$ Asthma$Control$ Rhinitis$Control$
CARATKids$ (]0.678;]0.371)!]0.548! (]0.648;]0.308)!]0.499! (0.439;0.74)!0.608! (0.266;0.591)!0.446! (]0.805;]0.543)!]0.689! ΔCARATKids$ (]0.656;]0.163)!]0.446! (]0.687;]0.177)!]0.454! (0.19;0.687)!0.466! (0.172;0.663)!0.447! (]0.633;]0.033)!]0.344! $ 353! Table$2$Correlation!coefficients!between!CARATKids!with!external!measures!of!control!and!of! 354! between]visits!changes!(variation)!of!CARATKids!scores!(ΔCARATKids)!and!between]visits!changes!of! 355! external!measures!of!control.$Data!is!presented!as!Spearmen!correlation!coefficients!(95%CI).! 356! CARATKids,!Control!of!Allergic!Rhinitis!and!Asthma!Test!for!Children;!VAS,!Visual!Analog!Scale;!cACT,! 357! childhood!Asthma!Control!Test! ! 358!
$ consistency$Internal$ Concurrent$validity$ ROC$curves$(AUC)$ retest$ICC$TestO Responsiveness$ Longitudinal$validity$
For$Children$ ! ! ! ! ! !
CARATKids$ 0.80! 0.37]0.73,!all!p<0.001! 0.76]0.83! 0.80! Significant!within]patient!change! 0.32]0.44,!all!p<0.05! cACT$(11)$ 0.79! 0.47]0.68,!all!p<0.001! 0.67]0.71! NA! NA! NA! ACQ$in$children$
(18,$24)$ 0.75! 0.52]0.83! 0.60! 0.79! Significant!within]patient!change! 0.66]0.89! TRACK(17,$25)$ 0.75! NA! 0.78! 0.63! Significant!within]patient!change! NA! Asthma$
Quiz(19)$ 0.73! NA! NA! NA! NA! NA! CAN(16)$ 0.82! ]0.18];0.14! 0.73]0.77! 0.73! Significant!within]patient!change! ]0.34;]0.23!
For$Adults$ ! ! ! ! ! !
CARAT$(20,$26)$ 0.85! 0.48]0.71,!all!p<0.001! 0.82! 0.82! Significant!within]patient!change! 0.31]0.65! ACT$(21,$27)$ 0.85! 0.31]0.89,!all!p<0.001! 0.69! 0.77! Significant!within]patient!change! 0.29]0.81,!all!p<0.001! ACQ$(27,$28)$ NA! 0.19]0.76! 0.85]0.90! 0.90! Significant!within]patient!change! 0.15]0.73!
! 359! Table$3!When!available,!data!from!different!sources!were!used!and!the!higher!values!on!each! 360! questionnaire!description!are!presented.!CARATKids,!Control!of!Allergic!Rhinitis!and!Asthma!Test!for! 361! Children;!cACT,!childhood!Asthma!Control!Test;!ACQ,!Asthma!Control!Questionnaire;!TRACK,!Test!for! 362! Respiratory!and!Asthma!Control!in!Kids;!CAN,!Asthma!Control!Questionnaire!for!Children;!CARAT,! 363! Control!of!Allergic!Rhinitis!and!Asthma!Test;!ACT,!Asthma!Control!Test;!NA,!not!available.*Values!are! 364! for!patient!and!carer’s!versions,!respectively. 365!
Figures
! 366! $ 367! Figure$1$Mean!and!95%!confidence!intervals!of!CARATKids!scores!in!both!visits!1!and!2!with:!(a)! 368! physician’s!decision!of!treatment!reduction,!maintenance,!or!increase;!(b)!asthma!control!classified! 369! by!cACT;!(c)!GINA!classification!of!asthma!control;!and!(d)!ARIA!classification!of!rhinitis!severity.! 370! CARATKids,!Control!of!Allergic!Rhinitis!and!Asthma!Test!for!Children;!cACT,!childhood!Asthma! 371! Control!Test;!ARIA,!Allergic!Rhinitis!and!its!Impact!on!Asthma;!GINA,!Global!Initiative!for!Asthma.! ! 372!! 373! Figure$2!Receiver!operating!characteristic!curves!of!CARAT10!score!against!(a)!asthma!control! 374! classified!by!cACT;!physician!assessment!of!(b)!rhinitis!and!(c)!asthma!control.!ROC,!receiver! 375! operating!characteristic;!cACT,!childhood!Asthma!Control!Test;!VAS,!visual!analog!scale;!AUC,!area! 376! under!curve.
377! improve the questionnaire’s reliability and validity. The 13-item questionnaire showed to have good discriminative properties.
Of the 13 items, five are to be answered by parents and eight by children (Fig. S1). Although this method of a twofold answer was found to be the most adequate solution, the usability of the questionnaire is somehow reduced by the parent and child response method. However, previous studies on asthma also observed divergence between children and parent-reported variables, with some sets of questions being better answered by each of them (11, 13, 14). In fact, cACT also has a twofold answer method (11). The questions on sneezing and other nasal symptoms had better results when answered by the children, while parents may be less aware of the frequency of these symptoms. In the cognitive interviews performed in the initial stages of CARATKids development, this lack of concordance was already observed (7).
The internal consistency was satisfactory (15), being similar or better than other questionnaires evaluating asthma control in children, such as cACT (11), Asthma Control Questionnaire (ACQ) in Children (CAN) (16), Test for Respiratory and Asthma Control in Kids (TRACK) (17), ACQ in children (18), or Asthma Quiz (19) (Table 3); however, it was slightly lower than the one in adult’s questionnaires, as CARAT (20) and Asthma Control Test (ACT) (21) (Table 3). The areas under the curve were high (0.761–0.826), namely when compared with physician assessment of control and cACT (Fig. 2) assumed as
comparators. These are in the same range of those previously observed in studies on adults and are higher than the ones reported for cACT (Table 3).
A gold standard for ARA control has not been established yet. Therefore, concurrent validity was assessed using different external measures of control, based on physicians, children, and caregivers’ assessments. A priori predictions were met, and all coefficients are in the same range as those observed with other tools to assess control, both in children and adults (Table 3).
In test–retest reliability analysis, CARATKids scores showed an ICC similar or better than those of ACQ in children, TRACK, CAN, ACT, and CARAT (Table 3).
Large responsiveness, greater than 0.8 was observed (22). Moreover, the magnitude of GRI of CARATKids (1.51) was similar to the one of CARAT (1.54).
Regarding longitudinal validity, correlation coefficients were higher than a priori predictions for physician and children VAS of both asthma and rhinitis control (Table 2), but not for cACT. As we could not find longitudinal validity assessment of cACT, it is difficult to interpret the low correlation coefficient we observed between DCARATKids scores and DcACT. This low correlation may be related to differences in sensitivities or responsiveness of the question-naires. In any case, in both visits, significant differences were observed in CARATKids scores between cACT control groups (Fig. 1). The only control questionnaires for children with published longitudinal validity results are ACQ in Table 2 Correlation coefficients between CARATKids with external measures of control and of between-visits changes (variation) of CARATKids scores (DCARATKids) and between-visits changes of external measures of control
Physician Assessment– VAS/DVAS Children Assessment– VAS/DVAS
cACT/DcACT Asthma Control Rhinitis Control Asthma Control Rhinitis Control
CARATKids !0.548 (!0.678; !0.371) !0.499 (!0.648; !0.308) 0.608 (0.439;0.74) 0.446 (0.266;0.591) !0.689 (!0.805; !0.543) DCARATKids !0.446 (!0.656; !0.163) !0.454 (!0.687; !0.177) 0.466 (0.19;0.687) 0.447 (0.172;0.663) !0.344 (!0.633; !0.033) Data are presented as Spearmen correlation coefficients (95%CI). CARATKids, Control of Allergic Rhinitis and Asthma Test for Children; VAS, visual analog scale; cACT, childhood Asthma Control Test.
0.0 0.2 0.4 Sensi vity 1 - Specificity 0.6 0.8 1.0 ROC Curve cACT ROC Curve
Physician Assessment - VAS of Rhini s Control
ROC Curve
Physician Assessment - VAS of Asthma Control
0.0 0.2 0.4 0.6 0.8 1.0 1 - Specificity 0.0 0.2 0.4 0.6 0.8 1.0 1 - Specificity 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0
AUC = 0.826 AUC = 0.761 AUC = 0.814
(a) (b) (c)
Figure 2 Receiver operating characteristic curves of CARAT10 score against (a) asthma control classified by cACT; physician assessment of (b) rhinitis and (c) asthma control. ROC, receiver operating characteristic; cACT, childhood Asthma Control Test; VAS, visual analog scale; AUC, area under curve.
ª 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd 5
$References$
378! 1! Jeffery!PK,!Haahtela!T.!Allergic!rhinitis!and!asthma:!inflammation!in!a!one]airway!condition.! 379! BMC$Pulm$Med.!2006;!6$Suppl$1:!S5.! 380! 2! Chawes!BL,!Bonnelykke!K,!Kreiner]Moller!E,!Bisgaard!H.!Children!with!allergic!and! 381! nonallergic!rhinitis!have!a!similar!risk!of!asthma.!J$Allergy$Clin$Immunol.!2010;!126:!567]73!e1]8.! 382! 3! Ohta!K,!Bousquet!PJ,!Aizawa!H,$et$al.!Prevalence!and!impact!of!rhinitis!in!asthma.!SACRA,!a! 383! cross]sectional!nation]wide!study!in!Japan.!Allergy.!2011;!66:!1287]95.! 384! 4! Morais]Almeida!M,!Santos!N,!Pereira!AM,$et$al.!Prevalence!and!classification!of!rhinitis!in! 385! preschool!children!in!Portugal:!a!nationwide!study.!Allergy.!2013;!68:!1278]88.! 386! 5! From!the!Global!Strategy!for!Asthma!Management!and!Prevention,!Global!Initiative!for! 387! Asthma!(GINA)!2012.!Available!from:!http://www.ginasthma.org/.! 388! 6! Demoly!P,!Calderon!M,!Casale!T,$et$al.!Assessment!of!disease!control!in!allergic!rhinitis.! 389! Clinical$and$Translational$Allergy.!2013;!3:!7.! 390! 7! Borrego!LM,!Fonseca!JA,!Pereira!AM,!Pinto!VR,!Linhares!D,!Morais]Almeida!M.!Development! 391! process!and!cognitive!testing!of!CARATkids!]!Control!of!Allergic!Rhinitis!and!Asthma!Test!for!children.! 392! BMC$Pediatr.!2014;!14:!34.! 393! 8! Baiardini!I,!Bousquet!PJ,!Brzoza!Z,$et$al.!Recommendations!for!assessing!patient]reported! 394! outcomes!and!health]related!quality!of!life!in!clinical!trials!on!allergy:!a!GA(2)LEN!taskforce!position! 395! paper.!Allergy.!2010;!65:!290]5.! 396! 9! Mokkink!LB,!Terwee!CB,!Patrick!DL,$et$al.!The!COSMIN!checklist!for!assessing!the! 397! methodological!quality!of!studies!on!measurement!properties!of!health!status!measurement! 398! instruments:!an!international!Delphi!study.!Quality$of$life$research$:$an$international$journal$of$ 399! quality$of$life$aspects$of$treatment,$care$and$rehabilitation.!2010;!19:!539]49.!GINA]defined!asthma! 400! control.!The!SACRA!study!in!Japan.!J!Asthma!2013:!50:!514–21.! 401! 10! Ohta!K,!Jean!Bousquet!P,!Akiyama!K,!et!al.!Visual!analog!scale!as!a!predictor!of! 402! 11! Liu!AH,!Zeiger!R,!Sorkness!C,$et$al.!Development!and!cross]sectional!validation!of!the! 403! Childhood!Asthma!Control!Test.!J$Allergy$Clin$Immunol.!2007;!119:!817]25.! 404! 12! Brożek!JL,!Bousquet!J,!Baena]Cagnani!CE,$et$al.!Allergic!Rhinitis!and!its!Impact!on!Asthma! 405! (ARIA)!guidelines:!2010!Revision.!The$Journal$of$allergy$and$clinical$immunology.!2010;!126:!466]76.! 406! 13! Lara!M,!Duan!N,!Sherbourne!C,$et$al.!Differences!between!child!and!parent!reports!of! 407! symptoms!among!Latino!children!with!asthma.!Pediatrics.!1998;!102:!E68.! 408! 14! Panditi!S,!Silverman!M.!Perception!of!exercise!induced!asthma!by!children!and!their!parents.! 409! Archives$of$disease$in$childhood.!2003;!88:!807]11.! 410! 15! Cronbach!LJ,!Warrington!WG.!Time]limit!tests:!estimating!their!reliability!and!degree!of! 411! speeding.!Psychometrika.!1951;!16:!167]88.! 412! 16! Perez]Yarza!EG,!Badia!X,!Badiola!C,$et$al.!Development!and!validation!of!a!questionnaire!to! 413! assess!asthma!control!in!pediatrics.!Pediatric$pulmonology.!2009;!44:!54]63.! 414! 17! Chipps!B,!Zeiger!RS,!Murphy!K,$et$al.!Longitudinal!validation!of!the!Test!for!Respiratory!and! 415! Asthma!Control!in!Kids!in!pediatric!practices.!Pediatrics.!2011;!127:!e737]47.! 416! 18! Juniper!EF,!Gruffydd]Jones!K,!Ward!S,!Svensson!K.!Asthma!Control!Questionnaire!in!children:! 417! validation,!measurement!properties,!interpretation.!The$European$respiratory$journal.!2010;!36:! 418! 1410]6.! 419! 19! Ducharme!FM,!Davis!GM,!Noya!F,!Rich!H,!Ernst!P.!The!Asthma!Quiz!for!Kidz:!a!validated!tool! 420! to!appreciate!the!level!of!asthma!control!in!children.!Canadian$respiratory$journal$:$journal$of$the$ 421! Canadian$Thoracic$Society.!2004;!11:!541]6.! 422! 20! Fonseca!JA,!Nogueira]Silva!L,!Morais]Almeida!M,$et$al.!Validation!of!a!questionnaire! 423! (CARAT10)!to!assess!rhinitis!and!asthma!in!patients!with!asthma.!Allergy.!2010;!65:!1042]8.! 424! 21! Schatz!M,!Sorkness!CA,!Li!JT,$et$al.!Asthma!Control!Test:!reliability,!validity,!and! 425! responsiveness!in!patients!not!previously!followed!by!asthma!specialists.!J$Allergy$Clin$Immunol.! 426! 2006;!117:!549]56.! 427!22! Lan!TY,!Deeg!DJ,!Guralnik!JM,!Melzer!D.!Responsiveness!of!the!index!of!mobility!limitation:! 428! comparison!with!gait!speed!alone!in!the!longitudinal!aging!study!amsterdam.!The$journals$of$ 429! gerontology$Series$A,$Biological$sciences$and$medical$sciences.!2003;!58:!721]7.! 430! 23! Juniper!EF,!Chauhan!A,!Neville!E,$et$al.!Clinicians!tend!to!overestimate!improvements!in! 431! asthma!control:!an!unexpected!observation.!Primary$care$respiratory$journal$:$journal$of$the$General$ 432! Practice$Airways$Group.!2004;!13:!181]4.! 433! 24! Nguyen!JM,!Holbrook!JT,!Wei!CY,!Gerald!LB,!Teague!WG,!Wise!RA.!Validation!and! 434! psychometric!properties!of!the!Asthma!Control!Questionnaire!among!children.!J!Allergy!Clin! 435! Immunol!2014:!133:!91–7.! 436! 25! Murphy!KR,!Zeiger!RS,!Kosinski!M,$et$al.!Test!for!respiratory!and!asthma!control!in!kids! 437! (TRACK):!a!caregiver]completed!questionnaire!for!preschool]aged!children.!J$Allergy$Clin$Immunol.! 438! 2009;!123:!833]9!e9.! 439! 26! Fonseca!JA,!Nogueira]Silva!L,!Morais]Almeida!M,$et$al.!Control!of!Allergic!Rhinitis!and! 440! Asthma!Test!(CARAT)!can!be!used!to!assess!individual!patients!over!time.!Clin$Transl$Allergy.!2012;!2:! 441! 16.! 442! 27! Jia!CE,!Zhang!HP,!Lv!Y,$et$al.!The!Asthma!Control!Test!and!Asthma!Control!Questionnaire!for! 443! assessing!asthma!control:!Systematic!review!and!meta]analysis.!J$Allergy$Clin$Immunol.!2013;!131:! 444! 695]703.! 445! 28! Juniper!EF,!O'Byrne!PM,!Guyatt!GH,!Ferrie!PJ,!King!DR.!Development!and!validation!of!a! 446! questionnaire!to!measure!asthma!control.!The$European$respiratory$journal.!1999;!14:!902]7.! 447! ! ! 448!
Supplementary$File$
449! Name$of$the$tool$$ Control$of$Allergic$Rhinitis$and$Asthma$Test$for$Children$ Acronym$ CARATKids$ Author! Fonseca!JA,!Borrego!LM,!Linhares!D,!Morais]Almeida!A!for!the! CARATKids!study!group! Bibliographic!references!of!the! original!questionnaire!! Borrego!LM!et!al.!BMC!Pediatr.!2014!(7)! Linhares!D!et!al.!Pediatr!Allergy!Immunol.!2014! Target! Allergic!Rhinitis!and!Asthma! Population! Children!from!6!to!12!years!old! Administration! Self]administration! Original!language! Portuguese! Existing!translations! Under!development! Numbers!of!items! 13!(8!to!be!answer!by!children!and!5!by!parents)! Tool!dimensions! Not!available! Scaling!of!items! Yes!(1)!or!No!(0)! Scoring!of!items! 0!(Best)!to!13!(Worst)! List!of!items! Children!answer:!Nasal!Obstruction,!Sneezing,!Rinorrhoeae,! Dyspnoeae,!Wheezing,!Cough,!Symptoms!with!laught!or! exercise,!Daily!activities!limitation! Parents!answer:!Waking!up!at!night,!Symptoms!in!the!morning,! Missing!school/activities,!Medication!increase,!Nonscheduled! consultation! Minimal!important!difference! Not!assessed! Shortened!versions! Current!version! Performed!trials! Not!available! Copyright! Copyrighted:!its!use!for!individual!purposes!is!free!and!does!not! requires!any!authorization;!the!use!of!the!questionnaire!by!any! research!group,!to!aggregate!data!from!different!patients,! requires!a!communication!to!the!CARAT!group;!for]profit! organizations!or!the!use!of!the!questionnaire!with! commercial/marketing!purposes!will!require!case]by]case! authorization!from!the!CARAT!group!(www.caratnetwork.org)! Contact!information! João!A!Fonseca! Faculty!of!Medicine!of!University!of!Porto,!! Alameda!Hernâni!Monteiro!! 4200]319!Porto,!Portugal! fonseca.ja@gmail.com! Supplementary$File$–$Table$A.$Questionnaire!characteristics!according!to!Patient]reported! Outcomes’!recommendations!of!Ga2len!(8).!$ CARATKIDS$Scores$$ $ Visit$1$ Visit$2$ All$ 4!(0]13)! 3!(0]13)! Gender$ ! ! ! ! Male$ 4!(0]13)! p=0.577! 3!(0]11)! p=0.497! Female$ 5!(0]11)! 3!(0]13)! Physician$Assessment$ ! ! ! ! $$$Asthma$Control$O$GINA$ ! ! ! Uncontrolled$ 8.5!(5]13)! p<0.001$ 6.5!(3]11)! p=0.002$ Partly$Controlled$ 5!(2]13)! 5!(1]9)! Controlled$ 3!(0]11)! 2!(0]13)! $$$Rhinitis$O$ARIA$ ! ! ! ! Intermittent$ 4!(0]13)! p=0.341! 3!(0]9)! p=0.661! Persistent$ 5!(0]11)! 3!(0]13)! Mild$ 3!(0]11)! P<0.001$ 3!(0]13)! p=0.001$ Moderate/Severe$ 7.5!(0]13)! 7!(0]11)! $$$Treatment$Decision$ ! ! ! ! Reduce$ 3!(0]9)! p<0.001$ 2!(0]4)! p<0.001$ Maintain$ 3!(0]11)! 2!(0]11)! Increase$ 5.5!(0]13)! 6!(1]13)! $ 450! Supplementary$File$–$Table$B!CARATKids!scores!in!visit!1!and!2!by!gender,!by!GINA!and!ARIA! 451! classifications!and!by!physician!treatment!decision.!Results!are!presented!as!median!(min]max).! 452! GINA!]!Global!Initiative!for!Asthma;!ARIA!]!Allergic!Rhinitis!and!its!Impact!on!Asthma$ ! 453!
$ CutOoff$values$ Uncontrolled$ 3$ 5$ Asthma$OR$Rhinits$ Sensitivity! 0.803! ! Specificity! ! 0.929! Asthma$AND$Rhinitis$ Sensitivity! 0.914! ! Specificity! ! 0.929! $ 454! Supplementary$File$–$Table$C!Sensitivity!and!Specificity!for!CARATKids’!3!and!5!cut]off!values.!Each! 455! “yes”!answer!was!considered!1!point!and!CARATKids’!scores!were!classified!as!controlled!(<4),! 456! insufficiently!controlled!(4]5)!and!uncontrolled!(>5).!Specificity!and!Sensitivity!of!this!categorization! 457! was!computed,!both!when!uncontrolled!was!defined!as!uncontrolled!asthma!and!uncontrolled! 458! rhinitis!and!when!uncontrolled!was!defined!as!uncontrolled!asthma!or!uncontrolled!rhinitis.
$
! 459!$ 460! Supplementary$File$–$Figure$A$CARATKids!initial!17!items!and!final!13]item.!The!lowlighted!items! 461! were!excluded!at!the!item!reduction!process;!the!orange!lined!boxes!contain!the!items!to!be! 462! answered!by!children!and!the!blue!ones!by!caregivers.!!Exclusion!of!items!was!based!on:!95%!of! 463! answer!“No”!for!“Hospitalization”!and!by!stepwise!logistic!regression!for!the!other!item
!
464! ! ! Nasal Obstruction Nasal Pruritus ! Sneezing Rhinorrhoea Ocular Symptoms Cough Daily activities limitation Hospitalization ! Wheezing ! ! ! Missing school/ activities ! ! Nonscheduled consultation Throat Symptoms Dyspnoea Symptoms w/ laugh or exercise ! Waking up at night Symptoms in the morning Medication increase!
!
!
!
!
!
!
!
Agradecimentos!
!
Antes&de&&mais&gostaria&de&agradecer&à&pessoa&que&me&guiou&e&me&deu&a&oportunidade&de&fazer&parte& de&um&projeto&tão&desafiante&e&inovador&como&foi&o&desenvolvimento&deste&questionário:&o&Prof.&Dr.& João&Fonseca,&que&é&não&menos&do&que&a&pessoa&responsável&pelo&meu&contacto&com&a&investigação,& tendoCme&acompanhado&desde&o&meu&primeiro&ano.&DevoClhe&sem&dúvida&o&meu&interesse&por&esta& parte&mais&curiosa&da&medicina,&tendoCme&ensinado&a&importância&que&gerar&novo&conhecimento&tem& no&diaCaCdia&do&profissional&de&saúde.&Nos&6&anos&que&trabalhei&com&ele,&é&de&louvar&a&paciência&e& generosidade&com&que&sempre&me&recebeu,&tendoCme&passado&conhecimentos&inestimáveis,&e& valores&que&pretendo&e&espero&seguir&no&futuro.&A&entrega&que&tem&por&cada&projeto&e&a&vontade&de& conseguir&sempre&mais&e&melhor,&são&perspectivas&que&adquiri&como&minhas,&e&que&espero&um&dia& conseguir&reproduzir.&Adicionalmente,&o&facto&de&me&ter&permitido&contactar&desde&cedo&com&toda&a& maquinaria&da&investigação&médica,&marcou&e,&sem&dúvida,&direcionou&o&meu&processo&académico.& Por&isso&lhe&devo&um&grande&obrigada.& Tenho&de&agradecer&ainda&a&todos&os&coautores,&médicos&e&diretores&dos&serviços&onde&o&estudo&de& validação&do&CARATKids&foi&conduzido,&bem&como&a&alguns&investigadores&do&CIDES,&que& disponibilizaram&tempo&das&suas&atarefadas&rotinas&diárias¶&ajudar&no&desenvolvimento&deste& questionário.& E&porque¶&mim&esta&tese&representa&o&resultado&de&um&projeto&que&se&desenvolveu&ao&longo&de&3& anos,&não&posso&deixar&de&agradecer&também&às&pessoas&que&me&foram&acompanhando&no&processo,& como&os&meus&pais,&o&João,&ao&Francisco&e&à&Carla,&que&nestes&3&anos&ouviram&incontáveis&vezes&a& descrição&do&projeto,&os&avanços&e&recuos,&os&objetivos&e&as&frustrações,&e&que&com&muita&paciência&e& carinho,&me&foram&aconselhando&e&ajudando&a&cada&passo.&Por&último&um&obrigado&à&equipa&B’&que& me&pôs&a&pensar&o&que&fazer&a&seguir.& & & Daniela'Linhares' & & '!
!
!
!
!
!
!
!
!
!
!
!
Anexo!
!
Normas'de'Publicação'da'Revista'' Pediatric)Allergy)and)Immunology)! Pediatric!Allergy!and!Immunology! ©"John"Wiley"&"Sons"A/S."Published"by"John"Wiley"&"Sons"Ltd" " Edited"By:"Ulrich"Wahn,"Berlin,"Germany" Impact"Factor:"3.376" ISI"Journal"Citation"Reports"©"Ranking:"2012:"7/23"(Allergy);"9/122" (Pediatrics);"56/137"(Immunology)" Online"ISSN:"1399V3038" ! ! ! Author!Guidelines! " PAI"is"only"accepting"manuscripts"electronically"via"ScholarOne"Manuscripts,"an"online" submission"site:"http://mc.manuscriptcentral.com/pai" Complete"instructions"for"preparing"and"submitting"manuscripts"online"are"provided"at"the" submission"site."If"you"need"assistance,"please"phone"1"434"817"2040"x"167"or"eVmail" Support@Scholarone.com." Authors"submitting"a"paper"do"so"on"the"understanding"that"the"work"has"not"been" published"before,"is"not"being"considered"for"publication"elsewhere"and"has"been"read"and" approved"by"all"authors."All"human"and"animal"studies"must"be"approved"by"an"appropriate" ethics"committee"or"review"board"(depending"on"local"arrangements),"and"a"statement"to" this"effect"should"be"included"in"the"methods"section,"or"the"reasons"why"it"was"not" necessary"if"this"is"the"case."All"clinical"investigations"must"have"been"conducted"according" to"the"principles"expressed"in"the"Declaration"of"Helsinki"(http://www.wma.net)." The"vested"interests"of"authors"(such"as"company"affiliations"or"funding"relevant"to"the" study)"must"be"declared." Articles"must"be"written"in"correct!scientific!English"suitable"for"publication."Authors"whose" primary"language"is"not"English"should"obtain"assistance"with"writing"to"avoid"grammatical" problems."Although"articles"are"subject"to"review"and"editing,"the"journal"does"not"hold"itself" responsible"for"all"statements"made"by"contributors." Upon"submission"of"a"manuscript"all"coVauthors"should"also"be"registered"with"correct!and! updated!e9mail!addresses!and!academic!titles." The"work"shall"not"be"published"elsewhere"in"any"language"without"the"written"consent"of" the"publisher."The"articles"published"in"this"journal"are"protected"by"copyright,"which"covers" translation"rights"and"the"exclusive"right"to"reproduce"and"distribute"all"of"the"articles" printed"in"the"journal."No"material"published"in"the"journal"may"be"stored"on"microfilm"or" videocassettes"or"in"electronic"databases"and"the"like"or"reproduced"photographically" without"the"prior"written"permission"of"the"publisher." "
PAI"employs"a"plagiarism!detection!system."By"submitting"your"manuscript"to"this"journal" you"accept"that"your"manuscript"may"be"screened"for"plagiarism"against"previously" published"works." After"submission"of"a"manuscript"please"address"queries,"if"any,"concerning"the"status"of"the" manuscript"to"the"editorial"office"–"paieditorial@charite.de." As"the"journal"follows"the"Vancouver"system"for"biomedical"manuscripts,"the"author"is" referred"to"the"publication"of"the"International"Committee"of"Medical"Journal"Editors:" Uniform"requirements"for"manuscripts"submitted"to"biomedical"journals."BMJ"1991;302:" 338V41." Line!numbering"All"texts"submitted"to"PAI"have"to"display"line"numbers"(1,"2,"3,"and"so"forth)" in"the"left"margin"of"the"manuscript."(Line"numbering"can"be"added"from"the""Page"Setup""or" "Format""menu"of"word"processing"programs.)"The"line"numbering"should"be"continuous" throughout"the"entire"text."Start"with"the"title"page"up"to"the"final"page."Do"not"begin" numbering"from"1"again"at"the"top"of"each"page." ! ORIGINAL!PAPERS!Information"concerning"the"format"of"the"manuscripts"for"all"original" papers:" Title!page"The"title"page"should"contain"the"following"information"in"the"order"given:" 1. full"title"of"manuscript,"concise"and"informative,"not"exceeding"100"characters;" 2. authors'"full"names;" 3. authors'"institutional"affiliations"including"city"and"country;" 4. a"running"title,"not"exceeding"40"characters"and"spaces;" 5. the"name,"address"and"eVmail"address"of"the"author"responsible"for"correspondence" about"the"manuscript;" 6. word"count;"number"of"tables"and"figures;" 7. material"in"the"electronic"repository,"if"applicable." " Abstract!page"A"separate"abstract"page"should"contain"the"following:" 1. authors'"surnames"and"initials;" 2. title"of"manuscript;" 3. title"of"journal"abbreviated"as"in"reference"list;" 4. the"word"Abstract"followed"by"a"summary"of"the"complete"manuscript"structured"as" follows"(max!250!words):" 1. background:"problem"that"prompted"the"study"and"aim(s)"of"the"study" 2. methods:if"the"sapece"is"short.,"only"the"primary"outcomes" 3. results:the"most"important"findings"only" 4. conclusions:the"most"important"conclusion"only" 5. key"words"(max"10);"listed"in"alphabetical"order;" 6. name"and"address"of"the"author"to"whom"requests"for"offprints"should"be"sent." " ! ! !
Main!text!The"text"is"limited"to:" • less"than"2,500"words"(not"including"abstract,"figure"legends"and"references" • structured"in"introduction,"methods,"results"and"discussion" • general"acknowledgments"for"consultations,"statistical"analyses,"and"the"like"should"be" listed"at"the"end"of"the"text," • up"to"30"references"in"the"Journal's"style"(see"below)" • up"to"6"among"figures"(or"panels"of"figures)"and/or"tables" If"the"manuscript"is"longer,"reasons"for"increase"in"length,"figure"or"table"number"or" reference"number"should"be"stated"in"the"cover"letter."In"general,"the"printed"version"of"the" manuscript"should"not"occupy"more"than"6"pages." References:!Number"references"consecutively"in"the"order"in"which"they"are"first"mentioned" in"the"text."List"all"authors"when"six"or"less;"when"seven"or"more,"list"first"three"and"add"et"al." Identify"references"in"text,"tables,"and"legends"by"Arabic"numerals"(in"parentheses)." References"(with"the"exception"of"review"articles)"must"not"exceed"30"in"number."Use"the" style"of"the"examples"below"which"are"based"on"the"format"used"by"US"National"Library"of" Medicine"in"Index"Medicus."For"abbreviations"of"journals,"consult"the"List"of"Journals" Indexed"printed"annually"in"the"January"issue"of"Index"Medicus."Avoid"using"abstracts"of" articles"as"references."Unpublished"observations,"personal"communications,"and"unaccepted" papers"may"not"be"used"as"references,"although"references"to"written,"not"verbal," communications"may"be"inserted"(in"parentheses)"in"the"text." Examples"of"correct"forms"of"references"are"given"below:" Journals:Chiba"Y,"Minagawa"T,"Mito"K,"et"al."Effect"of"breast"feeding"on"responses"of" systemic"interferon"and"virusVspecific"lymphocyte"transformation"in"infants"with"respiratory" syncytial"virus"infection."J"Med"Virol"1987:"21:"7V14." Books!and!monographs:!Stiehm"ER,"Fulginiti"VA."Immunologic"disorders"in"infants"and" children."Philadelphia:"WB"Saunders"1973." Chapter!in!book:!Holt"PG,"Turner"KJ."Regulation"of"IgE"synthesis"in"man"and"experimental" animals."In:"Lessof"MH,"Lee"TH,"Kemeny"DM,"eds."Allergy,"an"international"textbook."New" York:"John"Wiley"1987:"69V87." References"in"Articles"–"We"recommend"the"use"of"a"tool"such"as"EndNote"or"Reference" Manager"for"reference"management"and"formatting."EndNote"reference"styles"can"be" searched"for"here:"http://www.endnote.com/support/enstyles.asp."Reference"Manager" reference"styles"can"be"searched"for"here:"http://www.refman.com/support/rmstyles.asp" Figures!All"graphs,"drawings"and"photographs"are"considered"figures"and"should"be" numbered"in"sequence"with"Arabic"numerals"and"abbreviated"Fig(s)."Each"figure"should"have" a"legend"and"all"legends"should"be"typed"on"a"separate"sheet"and"numbered" correspondingly."Letters"on"figures"should"be"in"capitals."Figures"should"be"planned"to"fit"the" proportions"of"the"printed"page."It"is"the"policy"of"the"journal"for"authors"to"pay"for"the"full" cost"for"the"reproduction"of"their"colour"artwork."Therefore,"please"note"that"if"there"is" colour"artwork"in"your"manuscript"when"it"is"accepted"for"publication,"you"are"required" to"complete"and"return"a"Colour!Work!Agreement!form"before"your"paper"can"be" published."This"form"can"be"downloaded"online"here."Any"article"received"at"Wiley"with" colour"work"will"not"be"published"until"the"form"has"been"returned.""
Tables"!"Tables"may"be"placed"within"the"manuscript"file"and"they"should"supplement,"not" duplicate,"the"information"contained"in"the"text."They"should"be"on"separate"pages,"one" table"per"page,"and"should"be"numbered"consecutively"with"Arabic"numbers."Each"table" should"be"typed"on"a"separate"sheet,"with"due"regard"for"the"proportions"of"the"printed" page."A"brief"title"should"be"provided"directly"above"each"table."Any"abbreviations"should"be" defined"at"the"bottom"of"the"table." Offprints"Authors"will"receive"a"PDF"offprint"free"of"charge." Pediatric*Allergy*and*Immunology"collaborates"with"Wiley’s"open"access"journal"Immunity,* Inflammation*and*Disease"to"enable"rapid"publication"of"good"quality"research"that"we"are" unable"to"accept"for"publication"in"Pediatric*Allergy*and*Immunology."Authors"will"be"offered" the"option"of"having"the"paper,"along"with"any"related"peer"reviews,"automatically" transferred"for"consideration"by"the"Editor"of"Immunity,*Inflammation*and*Disease."Authors" will"not"need"to"reformat"or"rewrite"their"manuscript"at"this"stage,"and"publication"decisions" will"be"made"a"short"time"after"the"transfer"takes"place."The"Editor"of"Immunity,* Inflammation*and*Disease"will"accept"submissions"that"report"wellVconducted"research" which"reaches"the"standard"acceptable"for"publication."Immunity,*Inflammation*and*Disease" is"a"Wiley"Open"Access"journal"and"article"publication"fees"apply."For"more"information" please"go"to"www.immunityinflammationdisease.com."