• Nenhum resultado encontrado

Seriously Ill Hospitalized Patients

N/A
N/A
Protected

Academic year: 2021

Share "Seriously Ill Hospitalized Patients"

Copied!
9
0
0

Texto

(1)

A

Controlled

Trial

to

Improve

Care

for

Seriously

III

Hospitalized

Patients

The

Study

to

Understand

Prognoses

and

Preferences

for Outcomes and Risks of

Treatments

(SUPPORT)

The SUPPORT

Principal Investigators

Objectives.\p=m-\To

improve

end-of-life decision

making

and reduce the

frequency

ofa

mechanically

supported,

painful,

and

prolonged

process of

dying.

Design.\p=m-\A2-year prospective

observational

study (phase I)

with 4301

patients

followed

by

a

2-year

controlledclinical trial

(phase

II)

with 4804

patients

and their

physicians

randomized

by specialty

group tothe intervention group

(n=2652)

or

control group

(n=2152).

Setting.\p=m-\Fiveteaching

hospitals

in the UnitedStates.

Patients.\p=m-\A

total of 9105 adults

hospitalized

with one or more of nine

life-threatening diagnoses;

an overall 6-month

mortality

rateof47%.

Intervention.\p=m-\Physicians

in the intervention group received estimates of the

likelihoodof 6-monthsurvivalforevery

day

upto6

months,

outcomesof

cardiopul-monaryresuscitation

(CPR),

and functional

disability

at2 months. A

specially

trained

nursehad

multiple

contacts with the

patient, family, physician,

and

hospital

staffto

elicit

preferences,

improve

understanding

of

outcomes,

encourageattention to

pain

control,

andfacilitateadvancecare

planning

and

patient-physician

communication.

Results.\p=m-\The

phase

I observation documented

shortcomings

in

communica-tion,

frequency

of

aggressive

treatment,

and thecharacteristics of

hospital

death:

only

47% of

physicians

knew when their

patients preferred

toavoid

CPR;

46% of do-not-resuscitate

(DNR)

orderswerewritten within 2

days

of

death;

38% of

patients

who died

spent

atleast 10

days

inanintensivecareunit

(ICU);

and for 50% of

con-scious

patients

who diedinthe

hospital,

family

members

reported

moderateto se-vere

pain

atleast half thetime.

During

the

phase

II

intervention,

patients experienced

no

improvement

in

patient-physician

communication

(eg,

37%ofcontrol

patients

and40%ofintervention

patients

discussed CPR

preferences)

orin the five

targeted

outcomes,

ie,

incidenceor

timing

ofwritten DNR orders

(adjusted

ratio, 1.02;

95%

confidenceinterval

[Cl],

0.90to

1.15), physicians' knowledge

oftheir

patients'pref-erencesnot toberesuscitated

(adjusted

ratio,

1.22;

95%

Cl,

0.99 to

1.49),

number

of

days

spent

inan

ICU,

receiving

mechanical

ventilation,

orcomatosebeforedeath

(adjusted

ratio,

0.97;

95%

Cl,

0.87 to

1.07),

orlevel of

reported pain (adjusted

ratio,

1.15;

95%

Cl,

1.00 to

1.33).

The intervention alsodidnotreduceuseof

hospital

re-sources

(adjusted

ratio,

1.05;

95%

Cl,

0.99to

1.12).

Conclusions.\p=m-\The

phase

I observation of SUPPORT confirmed substantial

shortcomings

incarefor

seriously

ill

hospitalized

adults. The

phase

II intervention

failed to

improve

care or

patient

outcomes.

Enhancing

opportunities

for more

patient-physician

communication,

although

advocatedasthe

major

methodfor

im-proving patient

outcomes,

may be

inadequate

to

change

established

practices.

To

improve

the

experience

of

seriously

ill and

dying patients,

greater

individual and societal commitment and more

proactive

andforcefulmeasures may be needed.

(JAMA.1995;274:1591-1598)

Acomplete list of the SUPPORTprincipal

investi-gators and collaborators appearsatthe end of this article.

Theopinionsandfindingscontained in this articleare

those of the authors and donotnecessarily represent

the views of the Robert Wood Johnson Foundationor

their Board of Trustees.

Reprintrequests toICU Research Unit,Box600,

UniversityofVirginiaHealthSciencesCenter,

Char-lottesville,VA 22908(WilliamA.Knaus,MD).

PUBLIC HEALTH and clinical medi¬ cine

during

this

century

have

given

Americans the

opportunity

tolive

longer

andmore

productive

lives,

despite

pro¬

gressive

illness. Forsome

patients,

how¬

ever,this progress has resulted in pro¬

longed dying, accompanied

by

substan¬ tial emotional and financial

expense.1

Many

Americans

today

fear

they

will lose controlovertheir lives if

they

be¬ come

critically

ill,

and their

dying

will

be

prolonged

and

impersonal.2

This has led to an

increasingly

visible

right-to-diemovement. Twoyears aftervoters inCalifornia and

Washington

Statenar¬

rowly

defeatedreferendaon

physician-assisted

euthanasia,

Oregon

voters ap¬

proved physician prescription

of lethal medications for persons withaterminal

disease.3·4

Physicians

and ethicistshave

debated whentousecardiac resuscita¬

tion and other

aggressive

treatments

for

patients

with advanced illnesses.6,6

Many

worryabout the economic and hu¬

man cost of

providing

life-sustaining

treatment near the end oflife.79

Foreditorialcommentsee 1634.

In response,

professional organiza¬

tions,

the

judiciary,

consumer

organiza¬

tions,

anda

president's

commission have

all advocated more

emphasis

onrealis¬

tically forecasting

outcomes of

life-sustaining

treatment andon

improved

communication between

physician

and

patient.21016

Statutes

requiring

informed

consentand

communication,

like the Pa¬ tient Self-determination

Act,17

have been

passed.

Advancecare

planning

and ef¬

fective

ongoing

communication among

clinicians,

patients,

and familiesare es¬

sentialtoachieve these

goals.

Previous

studies

indicate, however,

thatcommu¬

nication is often absentor occurs

only

during

a crisis.1820

Physicians today

of¬

ten

perceive

deathas

failure,1

they

tend

(2)

prog-noses,21

and

they provide

more exten¬

sivetreatment to

seriously

ill

patients

than

they

would choose forthemselves.22

PhaseI of the

Study

toUnderstand

Prognoses

and Preferences for Outcomes and Risks of Treatments

(SUPPORT)

confirmed barriersto

optimal

manage¬ mentand shortfallsin

patient-physician

communication.23·24The

phase

II inter¬ vention

sought

to address these defi¬ ciencies

by providing physicians

with

accurate

predictive

information on fu¬

ture functional

ability,26

survival

prob¬

ability

for each

day

upto6

months,26

and

patient preferences

for end-of-lifecare;

askillednurse

augmented

thecareteam to elicit

patient preferences, provide

prognoses,enhance

understanding,

en¬

able

palliative

care, and facilitate ad¬

vance

planning.

We

hypothesized

that

increased communication and under¬

standing

ofprognosesand

preferences

would resultin earliertreatmentdeci¬

sions,

reductions in time

spent

inunde¬ sirablestatesbefore

death,

and reduced

resourceuse.Thisarticle describes the

effect of theSUPPORTinterventionon

five

specific

outcomes:

physician

under¬

standing

of

patient preferences;

inci¬ dence and timeof documentation of do-not-resuscitate

(DNR)

orders;

pain;

time

spent

in an intensive care unit

(ICU),

comatose,or

receiving

mechanicalven¬

tilation before

death;

and

hospital

re¬

source use

(Figure

1).

METHODS

Phase I was a

prospective

observa¬

tional

study

that described theprocess of decision

making

and

patient

outcomes.

Phase II was acluster randomizedcon¬

trolled clinical trialto testthe effect of the intervention.

Enrollment,

data col¬

lection,

and

interviewing

were

virtually

identical

during

thetwo

phases.21,23"28

Enrollment

Qualified patients

were in the ad¬

vanced

stages

ofone or more ofnine

illnesses:acute

respiratory

failure,

mul¬

tiple

organ

system

failure with

sepsis,

multiple

organ

system

failure withma¬

lignancy,

coma,chronic obstructive

lung

disease,

congestive

heart

failure,

cirrho¬

sis,

metastatic colon cancer, and

non-small cell

lung

cancer. Patients were

excluded if

they

were youngerthan 18

years, were

discharged

or died within

48hours of

qualifying

for the

study,

were

admitted with a scheduled

discharge

within 72

hours,

didnot

speak

English,

wereadmittedtothe

psychiatric

ward,

had

acquired immunodeficiency

syn¬

drome,

or were

pregnant

or sustained an acute

burn, head,

or other trauma

(unless

they

later

developed

acuteres¬

piratory

failure or

multiple

organ sys¬

tem

failure).26·28

Nurses trained in the

SUPPORT

eligibility

criteriareviewed

hospital

admissions and ICU

patients

daily

to

identify

newly

qualified patients.

Phase I enrolled

patients

fromJune

1989toJune

1991,

and

phase

II enrolled

patients

from

January

1992

through

January

1994. Patientswererecruited

fromfive medical centers: Beth Israel

Hospital,

Boston, Mass;

MetroHealth Medical

Center, Cleveland, Ohio;

Duke

University

Medical

Center, Durham,

NC;

Marshfield Clinic/St

Joseph's

Hos¬

pital,

Marshfield, Wis;

and the Univer¬

sity

of CaliforniaatLos

Angeles

Medi¬ cal Center. An

independent

committee monitored

potential

adverse

events,

in¬

cluding

6-month

mortality

for interven¬ tion

patients

and

changes

in

patient

sat¬

isfaction with medical care.

Mortality

follow-up

to6monthswas

complete

for

all

phase

I

patients.

In

phase II,

22 pa¬

tients

(0.5%)

wereunavailable for

follow-up atamedian of 80

days.

DataCollectionMethods

Data collectionwasbasedonbothcon¬

current and

retrospective

medical re¬

cord reviews andoninterviews withpa¬

tients,

patient

surrogates (defined

asthe

person who would make decisionsif the

patient

was unable to do

so),

and pa¬ tients'

physicians.

Medical Record-Based Data.—We collected

physiological

indicators of disease

severity,29,30

length

of

stay,

a

modified version of the

Therapeutic

In¬ tervention

Scoring

System,31

and

comor-bidities from the medical recordson

days

1,3, 7,14,

and25.The

permanent

medi¬ cal recordwas

retrospectively

reviewed

for discussionsordecisions

concerning

18

important

issues,

suchastheuseof

dialysis,

withdrawal from a

ventilator,

and DNR orders.

Reliability testing

on

10% of the medical records showed at

least90%

agreement

onabstracted data.

Interview Data.—Patients and their

designated

surrogates

wereinterviewed

in the

hospital

between

days

2 and 7

(median,

day

4)

and

again

between

days

6 and 15

(median,

day

12)

after

study

enrollment,

whetherornotthe

patient

remained

hospitalized.

The

surrogate

wasinterviewed4to10weeks after the

patient's

death.

Among

the45% ofpa¬ tients who wereable to

communicate,

theresponse rate for thefirstinterview

was85%. The

surrogate

response rate

for the first interviewwas87%.Forthe

second-week

interviews,

the

patient

re¬

sponseratewas71%and the

surrogate

response ratewas78%.The interviews

collectedinformation on

patient

demo¬

graphics,

functional

status,

self-assessed

quality

of

life,

communicationwith

phy¬

sicians,

frequency

and

severity

of

pain,

satisfaction with medical

care,32

and the

patient's preferences

for

cardiopulmo-nary resuscitation

(CPR).

When a pa¬

tient interviewwasnot

possible,

thesur¬

rogate's

responseswere

substituted,

a

strategy

that mirrors clinical

practice.

Important

elements of the

patient/sur¬

rogate

questionnaires

wereretested for

reliability.

Initial and

repeat

responses

had

greater

than80%

agreement.

The most senior available

physician

acknowledging responsibility

forthepa¬ tient's medical decisionswasinterviewed

in thefirst and second weeks afterpa¬ tient enrollment

(median

days,

3and

11,

respectively).

In both

interviews,

we

asked the

physician's understanding

of the

patient's preferences

for CPR. In the second

interview,

physicians

as¬

signed

tothe interventionwere

queried

aboutitsinfluenceonthe

patient's

care.

Physician

response rateswere86%for

the first interview and82%for thesec¬

ond interview.

Phase IIIntervention

Presented with

early findings

from

phase

I

documenting

substantial short¬

comings

in

communication,

decision mak¬

ing,

and

outcomes,23,24 physicians

atthe

participating

institutions voiced inter¬

estin

attempting

change. Physician

lead¬

ersand

study investigators

atthe sites

met todiscusshowdecision

making

could be

improved

tomore

closely

reflectboth

probable

outcomesand

patient prefer¬

encesandways to

improve patient,

fam¬

ily,

and

physician

communication.

Phy¬

sicians

suggested

that communication could

improve

if there weremorereli¬

able and

prompt

information

generated

by

the

study

and if

study

personnel

would make it more efficient to have

conversations. Inresponse tothesesug¬

gestions,

the

phase

IIintervention aimed

to

improve

communication and decision

making by providing timely

and reliable

prognostic

information,

by eliciting

and

documenting patient

and

family

prefer¬

encesand

understanding

of diseaseprog¬

nosis and

treatment,

and

by providing

a

skillednurseto

help

carry outthe needed

discussions,

convenethe

meetings,

and

bring

tobear the relevant information. The elements of the intervention and their

timing

are

presented

inTable 1.

In each case, the nurse was free to

shape

her roleso astoachieve the best

possible

careandoutcome. For

example,

she sometimes

engaged

in extensive emotional

support.

Other

times,

she

mainly provided

information and en¬

sured that all

parties

heardoneanother

effectively.

All of the nurses' involve¬

ment

required approval

of the attend¬

ing

physicians.

In

virtually

allcases,the

physician approval

camewithnolimits.

Physicians

were

free, however,

tolimit the intervention in any waythat

they

feltwasbest for the

patient,

and there

(3)

ObjectivesandOrganizationofSUPPORT

PhaseI(1989to1991)

Study4301 PatientsatFiveTeaching Hospitals

Describe Outcomes

• Develop PrognosticModels • Identify Shortcomingsof Care • EstablishAdjustmentMethods • DesignIntervention

Control

11Physician Groups

2152 Patients(45%)

Phasell(1992to1994)

ApplyInterventionto4804 Patients

Randomizedby27Physician Groups

Intervention

16PhysicianGroups

2652Patients(55%)

Adjusted Analysesof InterventionvsControl forFiveOutcomes

Incidence andTimingofWrittenDNROrders

• Patient-PhysicianAgreementonCPR Preferences

DaysinanICU, Comatose,orReceivingMechanical VentilationBeforeDeath

Pain

• HospitalResource Use

Figure1.—Overall schematicpresentationofphasesI andII oftheStudyto UnderstandPrognosesand

Preferences forOutcomesand Risks ofTreatment(SUPPORT) project,1989to1994. DNR indicates do

notresuscitate;CPR, cardlopulmonaryresuscitation;andICU,Intensivecareunit.

was no

requirement

for themtoshareor

discuss the information with the

patient

or

family

ortoallow the nurse's involve¬

mentto continue. Thenursewasiden¬

tified on her

badge

andintheconsent processas

part

ofaresearch

effort,

but

she had the role and appearance ofa

typical

clinical

specialist.

Randomization.—To limit contami¬

nation,

patients

were

assigned

tointer¬ vention or control

(usual care)

status

basedonthe

specialty

oftheir

attending

physician.

Physician

specialties

weredi¬

vided into five groups: internal medi¬

cine,

pulmonology/medical

ICU,

oncol¬

ogy, surgery,and

cardiology.

We useda

cluster randomization schemeto

assign

the intervention

randomly

to27

physi¬

cian

group-site

combinations,

restricted

by

the conditions that 50% to 60% of

patients

would be

assigned

intervention

status,

and that atleast one interven¬

tion andonecontrol

physician

specialty

group be at each of thefive

study

in¬

stitutions. This resulted in11

physician

specialty

groups

assigned

tocontrol and 16

assigned

totheintervention

(Figure

1).

Analyses

werebasedonallocationto

intervention

(ie,

intention to

treat),

ir¬

respective

of whether· a

given patient

received the intervention.

Investigators

wereblindedtothe

phase

IIresults dur¬

ing

data collection.

Analytic

Methods.—Five measures were chosen to evaluate the interven¬ tion:

(1)

The

timing

ofwrittenDNRor¬

derswas

analyzed

witha

log-normal

re-gression

modeltoprepare

Kaplan-Meier

predicted

median time untilthefirst DNR

orderwaswritten. Ifa DNRorderwas

not

written,

DNR order

timing

was

censoredatthe

day

of deathor

hospital

discharge.

(2)

Patient and

physician

agree¬

menton

preferences

to withhold resus¬

citationwasbasedonthefirst interview

of the

patient

(or

surrogate

ifthe

patient

was unable tobe

interviewed)

and the

responsible physician. Agreement

wasde¬

finedasaresponseto

forgo

resuscitation from both

patient

and

physician, analyzed

with

binary logistic regression,

andap¬

plied

toall interviewed

patients

or sur¬

rogates

who had

matching physician

interviews.

(3)

Days spent

in an

ICU,

receiving

mechanical

ventilation,

or co¬

matosebefore deathwere

analyzed

using

ordinary least-squares

regression

(after

taking

the

log

of0.5

plus

the number of

days)

and

only

included

phase

II

patients

who died

during

the index

hospitaliza-tion.(4)

Frequency

and

severity

of

pain

analyses

were based on all

patients

or

surrogates

interviewed in the second week withacombinedmeasure

(moder¬

ate or severe

pain

all,

most,

orhalf the

time)

and

analyzed using

a

single,

ordinal

logistic regression

model.

(5)

Hospital

re¬

sourceuse wasdefinedasthe

log

of the

product

of theaverage

Therapeutic

In¬

tervention

Scoring System

rating

and

length

of

hospital

stay

after the second

day

of the

study.

In

regression analyses

on

phase

I

data,

thismeasure

closely

es¬

timated

hospital

billsacrossthe five

study

institutions

(Pearson

ñ2=0.93on

log prod¬

uct).Weused

ordinary

least-squares

re¬

gression

tomodel the

log

ofresourceuse,

which was then converted to 1993 dol¬ lars. This method allows

comparisons

of

groupsandinstitutionsacrosstime with¬

out

having

to

adjust

for

varying hospital

billing practices.

Power and

Safety

Calculations Power calculations basedon

phase

I

data indicated

greater

than 90% power

(a=.05)

to detect a

1-day

decrease in

days

untilaDNR orderwas

written,

a

5%increasein the

proportion

of

physi¬

cians and

patients agreeing

on aDNR

order,

a 20% decrease in undesirable

days,

a 10% decreasein

reported pain,

anda5% decrease inresource use.Ef¬

fects of the intervention on

mortality

rateswere

quantified

by

the estimated

intervention,

controlhazard ratio from

adjusted

Cox models.33

Adjustment

Methods for Phase II Results

Because

patients

were

assigned

toin¬ terventionorcontrolstatusbasedona

limited number of

specialty

groups,the

resulting

cohorts

might

be unbalanced

in

patient

baseline risk factors. Further¬

more,

practice

patterns

amongthe

phy¬

sician

specialty

groups in

phase

I dif¬ fered

substantially.

We controlled for these

expected preintervention

differ¬

ences

using

baseline multivariable risk

scoresthatwerederived

by generating

modelsto

predict phase

Ioutcomes,each of which

incorporated

interactions be¬

tween

physician specialty

and

hospitals.

Observed imbalances in

phase

II base¬ line

patient

characteristicswerealso ad¬

justed

using

a

propensity

scorethatcor¬

rectedforselection bias associated with

being assigned

tointerventionstatus.34

Further details onthe construction of

both of these riskscores areavailableon

request.

Imputation

methods for miss¬

ing

data have been

published.25

Finally,

we simulated the

phase

II randomiza¬

tion schemeonthe

phase

I datatoevalu¬

ate secular trends. To

adjust

for mul¬

tiple

outcomes, ourmethods

prespeci-fied

adjusting

confidence intervals

(CIs)

using

the method of

Hochberg

and

Ben-jamini35

ifmore thanone value was

less than.05.Allstatistical

analyses

were

done with UNIX

S-Plus,

version 3.2 soft¬ ware36 and the

Design

library.37

RESULTS

Phase I Observations

Phase I enrolled4301

patients (Fig¬

ure1)withamedianageof65 yearsand

other characteristics summarized in Table 2. The mean

predicted

6-month

survival

probability

was 52% with an

(4)

Table1.—Content, Recipient,andTimingof PhaseII SUPPORTIntervention*

Content Providedto Timing

Feedback ofphaseIresults

Benchmarkinginformation

describingphaseIIncidence ofpatient-physician

communication,pain,

andtimingof DNR order

All interventionphysicians Early phaseI

Prognosticinformation Survival time estimates for up

to6mo26

Interventionphysiciansand

medical record Study daysand 26 2, 4, 8, 15,

Prognosisfor outcome for CPR ifneeded26

Interventionphysiciansand

medical record Study day

2

Survivalestimates,enhanced

by physician26

Interventionphysicians

and medical record Study day

4

Prognosis, probabilityofsevere

disability,at 2mo25 Interventionphysicians

and

medical record Studyday 8 Interview information

Patient andsurrogate reportof

prognosis, preferencesabout

CPR,advancedirectives,quality oflife,informationdesires,and

pain

Interventionphysiciansand medical record

First and secondstudyweeks Interviewonknowledgeof

preferencest

Interventionphysicians Study day10

Nurse involvement

Explainingprognosticestimates

and interviewreports Patient,family,staff,

intervention

physicians,andmedical records Studyday

3 andcontinuously until deathor6mo

Enhancingunderstandingoflikely

outcomes/preferences Patient, family,staff,

intervention

physicians,and medical records Studyday

3 andcontinuously until deathor6mo

Elicitinganddocumenting

preferences/advancedirectives Patient,family,staff,

intervention

physicians,and medical records Studyday

3 andcontinuously until deathor6mo

Assessingpainandenabling

treatment

Patient,family,staff,intervention

physicians,and medical records Studyday

3 andcontinuously until deathor6mo

Voicingpatient/familypreferences

and values Patient,family,staff,

Intervention

physicians,and medical record Study day

3andcontinuously until deathor6mo

Conveningmeetings, negotiating agreements

Patient,family,staff,intervention

physicians,and medical records Study dayuntil death3 andor6continuouslymo

Encouragingplanningfor future

decisions Patient,family,staff,

intervention

physicians,andmedical records Studyday

3 andcontinuously until deathor6mo "SUPPORTindicatesStudytoUnderstandPrognosesand Preferences for Outcomes and Risks ofTreatment;

DNR,donotresuscitate;CPR, cardiopulmonaryresuscitation;andICU,intensivecareunit.

tPhysicianinterviewonday10wasforevaluation,notpartoftheintervention.

48%

(Table 2).

Thirty-one

percent

of

phase

I

patients

with interviews pre¬ ferred that CPR be

withheld,

but

only

47% of their

physicians

accurately

re¬

ported

this

preference during

the first

interview.

Nearly

half

(49%)

of the960

phase

I

patients

whoindicatedadesire

for CPRtobe withheld didnothave a

DNR order written

during

that

hospi-talization.

Nearly

onethird of thesepa¬

tients

(278

[29%])

died before

discharge.

Among

all

phase

I

patients

who died

during

the index

hospitalization

(n=1150),

79%died withaDNR

order,

but 46% of

these orderswerewrittenwithin2

days

of death.

Among

all

phase

I

deaths,

the median number of

days

spent

inan

ICU,

comatose,

or

receiving

mechanical venti¬

lation was

8,

morethanonethird

(38%)

spent

atleast10

days

inan

ICU,

and 46%

received mechanicalventilationwithin 3

days

of death. In the second

week,

22%of

patients reported being

in moderate to

severe

pain

atleast half the time. In in¬ terviews conducted aftera

patient

died,

surrogates

indicated that 50% of allcon¬

scious

phase

I

patients

whodied in the

hospital experienced

moderateorsevere

pain

atleast halfthetime

during

their last

3

days

of life.

We found substantial variation in the fiveoutcomesamong

physician specialty

groups and across the five institutions.

Across

institutions,

the median number of

days spent

inanICU before deathvar¬

ied from5 to 9.The

proportion

of

patients

reporting

moderatetosevere

pain

atleast halfthe time varied

by

afactor of

2.7,

from

12%to32%across

study

institutions. The

predicted

median number of

days

untila

DNR order waswritten fora standard

patient

varied

by

afactor of

3.5,

from 73

days

for

patients

on a

surgical

serviceto 22for

oncology.

One

study

institution had

a

predicted

median time until DNRwas

written forastandard

patient

of28

days,

and another institution had a

predicted

median time of 49

days. Agreement

on

DNR varied from8%for

cardiology

pa¬ tientsto 24% for

oncology patients

and fromalow of8% atone

study

institution

toa

high

of 27%atanother. The median

number of

days

spent

in anICU before

death

ranged

from14inthe

surgical

spe¬ cialties to 5 for

patients

in

pulmonary/

ICU and

oncology

services. Phase II

Demographics

PhaseIIenrolled4804

patients,

2152

assigned

tousual medicalcareand 2652

assigned

tointerventionstatus

(Figure

1).

Their characteristicswere

generally

similar to those of

phase

I

patients

(Table 2).

Delivery

of theIntervention

Ninety-five

percent

ofinterventionpa¬ tients receivedoneormore

patient-spe¬

cific

components

oftheintervention. The SUPPORT nurse was involved in the care of all but 133

patients,

and 75 of

thesewere

patients

who died or were

discharged

on the

day

of enrollment.

The SUPPORT nurse communicated

with the

physician

in

virtually

allcases.

She talked

directly

with the

patient

or

family

in mostcases

(eg,

with 84%con¬

cerning prognosis,

77% about

pain,

63% about

likely

outcomes or

resuscitation,

and 73%

concerning

written advance

directives).

For

patients

inthe

hospital

for 7 or more

days

after

qualifying

for the

study,

the median number of SUPPORTnursecontactswith thepa¬

tient,

family,

or

physician

wasfour and

themean wassix.Documentation in the

progressnotesofdiscussionsaboutpa¬ tients'

preferences

with

regard

to re¬

suscitationwasincreased from 38.5% in

phase

Ito 50.3% among

phase

II inter¬ vention

patients.

The

patient's physician

received at

least one

prognostic

report

for 94% of

patients,

and the

report

was

put

in the

medical record of80%. The

patient's phy¬

sician receivedatleastone

printed

re¬

port

of

patient

or

surrogate

understand¬

ing

and

preferences

in 78% ofcases.

No

physician

refused toreceive the

printed

reports

ortohavethemshared with other

professional

staff. The

phy¬

sicians for43

patients

refused toallow the SUPPORT nurse to have contact

with the

patient

and

family,

and seven

patients

or

surrogates

refusedto

speak

with the SUPPORTnurse.

Effect of InterventiononOutcomes

The

prevalence

or

timing

of documen¬

tation of DNR orders for the 2534 in¬

tervention

patients

wasthesameasfor

the2208control

patients (adjusted

ratio

of median

time,

1.02;

95%

CI,

0.90 to

1.15) (Table 3).

Therewas asmallasso¬

ciation of the intervention with

improved

patient-physician

DNR

agreement

for the1480intervention

patients

who had

patient

or

surrogate

and

matching phy¬

sician

interviews,

compared

with 1159 control

patients (adjusted

ratio, 1.22;

95%

CI,

0.99 to

1.49).

The number of

days

spent

inan

ICU,

comatose,

or

receiving

mechanical ventilation before death for the 680intervention

patients

who died

inthe

hospital

wasthesameasfor the

530 control

patients (adjusted

ratio of median

days,

0.97;

95%

CI,

0.87to

1.07).

(5)

Table 2.—Characteristics of 9105 SUPPORTPatients, 1989to 1994* Phase II Total PhaseI (n=4301) PhaseII (n=4804) I-Control Group (n=2152) Intervention Group (n=2652) Median age, y 65 64 66 Sex,%female 43.0 44.3 43.0 45.4 Race,% White 79.5 79.0 82.1 Black 15.3 15.4 11.5 19 Other 5.3 5.6 6.4 5.0 Annual income<$11000,%

Educationhighschoolormore, % 53.4 59.0 63.2 56

Primaryinsurance,% Private 29.2 29.6 32.7 27.1 Medicare 56.0 53.5 Medicaid 11.8 10.8 11.2 10.6 None 5.3 3.6 2.6 4.4 Diseaseclass,%

Acute organsystemfailuret 42.9 49.6 52.8

Chronicdiseased 34.4 28.8 25.0 31.8

Nontraumaticcoma 5.7 7.3 5.9 8.4

Cancer§ 16.9

MeanADL Scalescorelffl 1.6 1.5 1.5 1.5 Median APS of APACHElll||# 33 32 32

SUPPORT 6-momeansurvivalestimateli 0.52 0.52 0.51 0.52

Hospital mortality,% 26.7 25.2 24.6 25.6

6-moMortality,%

Medianhospitalcharges,$thousands 21 29 33 27

*SUPPORTindicatesStudytoUnderstandPrognosesand Preferences for Outcomes and RisksofTreatment.

tlncludesacuterespiratoryfailure andmultipleorgansystemfailure withorwithoutsepsis.

^Includes

end-stage cirrhosis andacute exacerbations ofsevere congestiveheart failureor severe chronic

obstructivepulmonarydisease.

(¡IncludescoloncancerwithlivermétastasesandstageIIIorstageIVnon-small celllungcancer.

IIMeasuredonthe thirdstudy day.

UADLindicates activities ofdaily livingscorefrom0 to7,witheachpoint representinganimpairmentinbasic

function, reflecting patientstatus 2weeks before admission.

#APS indicatesacutephysiologyscore;and APACHEIII,AcutePhysiology,Age,Chronic Health EvaluationIII.29

The APS varies from0 to252 withahigherscoreindicatinggreaterphysiological instabilityand risk of death.

Reported

pain

increased for the 1677in¬ tervention

patients

and

surrogates

inter¬ viewed in the second

week,

compared

with the control group

(adjusted

ratio,

1.15;

95%

CI,

1.00to1.33)

(Table 3).

Therewas

no

change

in

hospital

resourcesused for

2593 intervention

patients

not dead or

discharged

before the third

study day

com¬

pared

with 2129 control

patients (adjusted

ratio of averageresourceuse,

1.05;

95%

CI,

0.99to

1.12).

The

unadjusted

differences between in¬ tervention and control

patients

forme¬

dian

days

until the first DNR orderwas

writtenwere

large, especially

for

patients

with coloncancerand non-small cell

lung

cancerfor whom the median number of

days

untilawrittenDNR orderwas80%

lower in intervention

patients. Adjust¬

ment for baseline imbalances reduced

much of the difference in each

category

(Table 4).

The differences that

persist

in thecancer

category

areof uncertain im¬

portance,

being

oneamong

multiple

com¬

parisons

and

being

basedon asmallnum¬

ber of

patients

(Table 4).

Figure

2illustrates the secular trends of each outcomein the

phase

II inter¬ vention and controlgroups,aswellasin

phase

I,

using

simulations of the

physi¬

cian

specialty groupings

used in

phase

II.None of the five outcomes

changed

significantly

during

the 5 years of the

study.

The differences between those who would have been

assigned

tointer¬

vention and control in

phase

I

persisted

throughout

the SUPPORT

study,

un¬

affected

by

timeor

by

the intervention.

Communicationand Preferences The intervention didnot

change

the

unadjusted

proportion

of

patients

or sur¬

rogates

reporting

a discussion about

CPR;

37%of control

patients

and40%of intervention

patients

reported

discuss¬

ing

their

preference.

Of

patients

who did nothave sucha

discussion,

41%of

eachgroupsaid

they

would liketodis¬

cussCPR. Seventeen

percent

ofcontrol

patients

and20%of intervention

patients

changed

their resuscitation

preferences

to

forgo

CPR

by

the second week after

enrollment,

and39%of control

patients

and 41% of intervention

patients

re¬

ported having

a discussion about their

prognosis

witha

physician.

Of those who

didnotdiscuss their

prognosis,

44% of control

patients

and42%ofintervention

Table 3.—Effectofthe SUPPORT PhaseII Inter¬ ventionon FiveOutcomes:InterventionGroupvs ControlGroup,1992to1994

Adjusted

Ratio

_(95%

CI)

Median time until DNR order

waswritten,d 1.02(0.90-1.15) DNRagreement,% 1.22(0.99-1.49)

Undesirable states, median d 0.97(0.87-1.07)

Pain,% 1.15(1.00-1.33)

ResourceUse,median

1993 dollars 1.05(0.99-1.12)

'SUPPORTindicatesStudytoUnderstandPrognoses and Preferences for Outcomes and Risks ofTreatment; DNR,donotresuscitate;andCI,confidence interval.

patients reported

that

they

would like

tohave such adiscussion.

Physician's

Perspective

onIntervention

In the second

physician

interview,

59%

acknowledged

receiving

the

prognostic

reports

and34%

acknowledged

receiv¬

ing

the

preference

reports.

Fifteenper¬

cent

reported discussing

this

specific

in¬ formation with

patients

or families.

Nearly

a

quarter

of

respondents

(22%)

said

they thought

theSUPPORT nurses' involvement

improved patient

care.

Safety Monitoring

After

adjusting

for baseline differ¬

ences,the 6-month

mortality

for

phase

II control

patients

wasthesameasfor

intervention

patients (adjusted

relative

hazard, 0.95;

95%

CI,

0.87to

1.04).

Both control

(68%)

and intervention

(69%)

pa¬

tientsor

surrogates

rated theircare as

excellent orvery

good.

COMMENT

Findings

from

phase

I of SUPPORT

documented many

shortcomings

ofcare.

The SUPPORT

"patients

were all seri¬

ously

ill,

and their

dying proved

to be

predictable,

yet

discussions anddecisions

substantially

in advance of death were

uncommon.

Nearly

half of all DNR orders

werewritteninthe last2

days

of life. The final

hospitalization

for half of

patients

included morethan 8

days

in

generally

undesirablestates:in an

ICU,

receiving

mechanical

ventilation,

orcomatose.Fami¬ lies

reported

that half of the

patients

who

were able to communicate in their last few

days spent

mostof thetime inmod¬

erateor severe

pain.

Basedon a

study

in adefined

population

atourWisconsin

site,

weestimate that

patients meeting

SUP¬

PORT criteriaaccountfor

approximately

400 000 admissions peryearinthe United

States and that another 925000

people

are

similarly

ill but wouldnotmeetSUP¬

PORT

entry

requirements

of

being

hos¬

pitalized

or in intensive care.38 Patients

withSUPPORT illnesses and

severity

ac¬

countfor about40% ofpersons

dying

in the defined

population.

(6)

Table 4.—Effect of theSUPPORTInterventiononFive Outcomes Within theMajorDiseaseCategories*

UnadjustedOutcomes AdjustedOutcomes Acute Acute

Respiratory Exacerbation Advanced

orMultiple ofCirrhosis, LungorColon

SystemFailure COPD,orCHF Coma Cancer

Acute Acute

Respiratory Exacerbation Advanced

orMultiple ofCirrhosis, LungorColon

SystemFailure COPD,orCHF Coma Cancer Median time until DNRorderwaswritten,d

Control 46 40 10 58 38 34

DNRagreement,%

Control 13 33 17 25

13 14 21 32 Undesirable states,median d

Control 10 9.5 6.5

10

Pain,%

Control 16 20

Intervention 17 18 23 16 12 26

Resourceuse,median 1993 dollars

Control 20 900 5100

19 500 5600 33 400 8900 22 000 6100

*SUPPORTindicatesStudytoUnderstand Prognosesand Preferences for Outcomes and Risks ofTreatments; COPD,chronic obstructive pulmonarydisease; CHF,

congestiveheartfailure;andDNR,donotresuscitate.

Building

on the

findings

in

phase

I,

observations of

others,1"16'23·24·39"'6

the

opin¬

ions of

physicians

atthe five

sites,

and the marked variation in their baseline

practices,

the

phase

IIintervention aimed

tomake iteasierto achievebetter deci¬ sion

making

for these

seriously

ill pa¬ tients.The intervention gave

physicians

reliable

prognostic

information and

timely

reports

of

patient

and

surrogate

percep¬

tions,

the two most

important

factors

cited

recently by physicians

when con¬

sidering life-support

decisions for criti¬

cally

ill

patients.44

The interventionnurse

also undertook

time-consuming

discus¬

sions,

arranged meetings,

provided

in¬

formation,

supplied

forms,

and didany¬

thing

elseto encouragethe

patient

and

family

to engageinaninformed and col¬

laborative

decision-making

processwith

awell-informed

physician

(Table 1).

The interventionwaslimited

by

itsap¬

plication

toadiverse group of

physicians

and

patients,

all of whom had to

comply

voluntarily.

The intervention had to be

perceived

as

helpful, polite,

and appro¬

priate.

As an initial

attempt

to

change

outcomesfor

seriously

ill

patients,

wedid

notseek

authority

tobecoerciveormore

than

minimally

disruptive.

As

designed,

however,

the interventionwas

vigorously

applied.

TheSUPPORTnurses werecom¬

mitted,

energetic,

and

highly

trained.

They

engaged

in the care of

virtually

all our

patients,

and

nearly

everyonehad

printed

reports

delivered

promptly.

Because we

thought

that

changes

in

the

decision-making

processesthatwere

not reflected in

improved

patient

out¬

comeswouldnotbe worth muchexpense,

we

specified

five

outcomes,

each indi¬

cating

an

important

improvement

inpa¬

tient

experience,

asthe main

targets

of

the intervention.

The intervention had no

impact

on

anyof these

designated

targets

(Tables

3and

4).

Furthermore,

even

though

the

targeted

outcomes are

objectives

of

much ethical and

legal

writing

and of

some

explicit

social

policy

(such

as in¬

formed consent

statutes,

the Patient

Self-determination

Act,

and

guidelines

on

pain),1017

therewere nosecular trends

toward

improvement

for intervention

orcontrol

patients during

the5 yearsof

SUPPORT data collection

(Figure

2).

These results raisefundamentalques¬ tions about the intent and

design

of this trial.Do

patients

and

physicians

seethe

documented

shortcomings

as

troubling?

Can enhanced decision

making

improve

the

experience

of

seriously

ill and

dying

patients?

Were the inevitable limitations of this

project

too

great

todraw

strong

conclusions?

Because therewas no movement to¬

ward what wouldseemtobe betterprac¬

tices,

onecouldconclude that

physicians,

patients,

and families are

fairly

com¬

fortable with thecurrentsituation. Cer¬

tainly,

most

patients

and families indi¬ cated

they

were

satisfied,

no matter

what

happened

tothem.

Physicians

have their established

patterns

ofcare, and

while

they

were

willing

to have the SUPPORTnurse

present

and

carrying

on

conversations,

physician

behaviorap¬

peared unchanged. Perhaps physicians

and

patients

inthis

study acknowledged

problems

with thecare of

seriously

ill

patients

as agroup.

However,

when in¬

volved with their own situation or en¬

gaged

in thecareof their individualpa¬

tients,

they

felt

they

were

doing

the

best

they

could,

weresatisfied

they

were

doing

well,

and didnotwishto

directly

confront

problems

orface choices.46·47

The

study certainly

castsa

pall

over

anyclaim

that,

ifthe healthcare

system

is

given

additionalresourcesfor collabo¬

rative decision

making

in the form of skilled

professional

time,

improvements

will occur. In

phase

II of

SUPPORT,

improved

information,

enhancedconver¬

sation,

andan

explicit

efforttoencour¬

ageuseofoutcomedata and

preferences

in decision

making

were

completely

in¬

effectual,

despite

the fact that the

study

had

enough

power to detect small ef¬ fects.

It is

possible

that the intervention would have beenmoreeffective if

imple¬

mented in different

settings,

earlier in

the courseof

illness,

or with

physician

leaders rather thannurses as

implement-ers.

Perhaps,

it would have been effec¬

tive if continued formoretimeortested

atlaterend

points.48

However,

theover¬

all results of this

study

arenotencour¬

aging.

No

pattern

emerged

that

implied

that the interventionwassuccessful for

some set of

patients

or

physicians

or

that its

impact

increasedovertime. The

five

hospitals

had been chosen for their

diversity

and their

willingness

to un¬

dertakeasubstantial and controversial

challenge.

Yetnoneshoweda

tendency

toward

improvement

in theseoutcomes.

SUPPORT did

demonstrate, however,

that issues this

complex

canbe studied

withsufficient scientific

rigor

tobecon¬

fident of the

findings.

We achieved

good

interviewresponse rates among

seriously

ill

patients,

their

families,

and

physicians,

widespread

acceptance

of the interven¬ tion in diverse

hospitals,

and

high-qual¬

ity

data. Consent and

confidentiality

is¬

sues were

complex

but amenableto so¬

lution. The

analytic

issues

required

ap¬

plication

of

relatively

novel

approaches,

but

they proved

effective. The

study

also demonstrated the need for such methods

(7)

60 50- 40-30 Phase I Phase II -1-1—-1-1-1— 1989 1990 1991 1992 1993 1994 Year 60 40 I 20 Phase I Phase II 1989 1990 1991 1992 Year 1993 1994 2>c 30

oil25

g c 20 «œ >>is Q .

5as

15 10 5- 0-PhaseI -1-1989 1990 Phase I 1991 1992 Year 1993 1994 •a 80 0. £ 60 > en 40 o 20 Phase I PhaseI -1-1—-1-1-1— 1989 1990 1991 1992 1993 1994 Year 80 60- 40-» 20-PhaseI Phase II -1- 1989 1990 1991 1992 1993 Year 1994 InterventionGroup ControlGroup

Figure2.—Seculartrends infivepatientoutcomes In theStudyto UnderstandPrognosesandPreferences for OutcomesandRisks of Treatment(SUPPORT)from June1989through January1994. The horizontalaxesrepresentthe yearsofSUPPORT(1989to1994).The time betweenphaseIandphaseIIisrepresented

byaspace. The intervention and controlgroup lineshavebeensmoothednonparametrically.ThephaseIIresultsrepresentthe actualimpactof thetrial,and the

phaseI resultsarethe baselineorhistorical differences. Therewere nosignificantdifferencesinInterventionpatientsbetweenphasesIandII,andafteradjustment, nosignificantdifferenceswerenotedbetweenphaseIIcontrol and interventionpatientsfor the five mainoutcomes. DNRIndicates donotresuscitate,andICU,

intensivecareunit.(Seetextfor detailed definitions andexactsample sizes.)

when

performing

evaluations of

complex

interventions in

seriously

ill

patients.

We would have concluded that the interven¬

tion

positively

influenced all outcomes

hadwenothad

phase

I results for base¬

line

adjustment

and

phase

II controlpa¬ tientstoevaluate secular trends

(Table

4

and

Figure

2).

In

conclusion,

we areleft withatrou¬

bling

situation. The

picture

wedescribe

of the careof

seriously

illor

dying

per¬

sons is not attractive. One would

certainly prefer

to envision

that,

when confronted with

life-threatening

illness,

the

patient

and

family

would be included

in

discussions,

realistic estimates ofout¬

come would be

valued,

pain

would be

treated,

and

dying

would not be pro¬

longed.

Thatis still a

worthy

vision.2·49

However,

it isnot

likely

tobe achieved

through

an intervention such as that

implemented by

SUPPORT. Success will

require

reexamination ofourindividual

and collective commitmenttothese

goals,

morecreative effortsat

shaping

thetreat¬ ment process,

and,

perhaps,

morepro¬

active and forceful

attempts

at

change.

The SUPPORTprincipalinvestigators:Alfred F.Connors, Jr, MD, and Neal V. Dawson, MD,

MetroHealth Medical Center, Cleveland, Ohio; Norman A.Desbiens, MD,Marshfield(Wis)Medi¬ cal ResearchFoundation;William J.Fulkerson, Jr, MD, Duke University Medical Center, Durham,

NC;LeeGoldman, MD,MPH,Beth IsraelHospi¬

tal, Boston, Mass;William A.Knaus, MD,George

WashingtonUniversityMedicalCenter,Washing¬

ton, DC;Joanne Lynn, MD, Dartmouth Medical

School, Hanover, NH;and Robert K. Oye, MD,

Universityof CaliforniaatLosAngeles Medical Center.

National Coordinating Center: William A.

Knaus, MD,George WashingtonUniversityMedicai

Center, Washington,DC, and JoanneLynn, MD,

Dartmouth Medical School, Hanover, NH

(co-principal investigators); Marilyn Bergner, PhD

(deceased),and AnneDamiano, ScD,JohnsHopkins University,Baltimore, Md;RosemarieHakim, PhD, George Washington University Medical Center,

Donald J. Murphy, MD, Presbyterian-St Lukes MedicalCenter, Denver, Colo;JoanTeno, MD,and BethVirnig,PhD,Dartmouth MedicalSchool;Doug¬ las P.Wagner,PhD,George Washington University MedicalCenter;and Albert W.Wu, MD, MPH,and YutakaYasui, PhD,JohnsHopkins University (coin-vestigators);Detra K.Robinson, MA,GeorgeWash¬

ingtonUniversityMedical Center(chartabstraction

supervisor);BarbaraKreling, BA,GeorgeWashing¬

tonUniversityMedical Center(survey coordinator); JennieDulac, BSN, RN,DartmouthMedical School

(intervention implementation coordinator); Rose

Baker, MSHyg, George Washington University

Medical Center (database manager); and Sam

Holayel,BS,ThomasMeeks, BA,MazenMustafa, MS,and JuanVegarra,BS(programmers).

National Statistical Center,DukeUniversity

MedicalCenter, Durham,NC: CarlosAlzóla, MS,

and Frank E.Harrell,Jr,PhD.

Beth IsraelHospital,Boston,Mass:LeeGold¬

man,MD,MPH(principal investigator);E. Francis

Cook, ScD,MaryBethHamel, MD,LynnPeterson, MD, Russell S. Phillips, MD, Joel Tsevat, MD, LachlanForrow, MD,LindaLesky,MD,andRoger

Davis, ScD(coinvestigators); NancyKressin, MS,

andJeanmarieSolzan,BA(interviewsupervisors);

Ann Louise Puopolo,BSN, RN (chartabstractor

supervisor);LauraQuimbyBarrett, BSN,RN,Nora

Bucko, BSN, RN, Deborah Brown, MSN, RN,

Maureen Burns,BSN, RN,CathyFoskett, BSN, RN,AmyHozid, BSN, RN,CarolKeohane, BSN, RN, ColleenMartinez, BSN, RN, Dorcie

McWee-ney, BSN, RN, DebraMelia, BSN, RN, Shelley

Otto, MSN, RN,KathySheehan, BSN, RN,Alice

Smith, BSN, RN,and LaurenTofias, MS,RN(chart

abstractors);BerniceArthur, BA,CarolCollins, BA,

MaryCunnion, BA, DeborahDyer, BA, Corinne

Kulak, BS, Mary Michaels, BA,MaureenO'Keefe, BA,MarianParker, AB, MBA,LaurenTuchin, BA, Dolly Wax, BA,andDianaWeld, A(interviewers);

Liz Hiltunen, MS, RN, CS, Geòrgie Marks, MS,

MEd, RN,Nancy Mazzapica,MSN, RN,andCindy

Medich,MS,RN(SUPPORTnurseclinicians);and JaneSoukup,MS(analyst/datamanager).

DukeUniversityMedicalCenter, Durham,NC: WilliamJ.Fulkerson, Jr,MD(principal investiga¬

tor); Robert M. Califf, MD, AnthonyN. Galanos,

MD, PeterKussin, MD,and Lawrence H.

Muhl-baier,PhD(coinvestigators);MariaWinchell, MS

(projectdirector); LeeMallatratt, RN(chartab¬

stractorsupervisor); EllaAkin, BA(interviewer

supervisor); LynneBelcher, RN,ElizabethBuller,

BSN, RN,EileenClair, RN,LauraDrew, BSN,

RN, Libby Fogelman, BSN, RN, Dianna Frye,

BSN, RN,BethFraulo, BSN,RN,DebbieGessner, BSN, RN,JillHamilton, BSN, RN,KendraKruse,

BSN, RN,DawnLandis,BSN, RN,LouiseNobles,

BSN, RN,Rene Oliverio, BSN, RN,and Carroll

Wheeler, BSN, RN (chart abstractors); Nancy

Banks, MA, Steven Berry, BA,Monie Clayton,

Patricia Hartwell, MAT, Nan Hubbard, Isabel

Kussin, BA,BarbaraNorman, BA,JackieNoveau, BSN, Heather Read, BA,and Barbara Warren, MSW(interviewers);JaneCastle, MSN, RN,Beth

Fraulo, BSN, RN,ReneOliverio, BSN, RN,and

KathyTurner, MSN,RN(SUPPORTnurseclini¬

cians);and Rosalie Perdue(datamanager).

MetroHealth MedicalCenter, Cleveland,Ohio: Alfred F.Connors, Jr, MD,and Neal V.Dawson, MD(co-principal investigators);ClaudiaCoulton, PhD, C. SethLandefeld, MD,TheodoreSperoff,

PhD,and StuartYoungner,MD(coinvestigators); Mary J. Kennard, MSN, and Mary Naccaratto,

MSN (chart abstractor supervisors); Mary Jo

Roach,PhD(interviewersupervisor);Maria

Blink-horn, RN,Cathy Corrigan,RNC,ElsieGeric, RN,

LauraHaas, RN,JenniferHam, RN,Julie

Jer-donek, RN, Marilyn Landy, RN, ElaineMarino, RN,PattiOlesen, RN,SherryPatzke, RN,Linda

Referências

Documentos relacionados