Antonio Luiz RibeiroI
Samuel Vianney da Cunha PereiraI
Kaiser BergmannI
Roberto Marini LadeiraI
Rackel Aguiar Mendes OliveiraI
Paulo Andrade LotufoII
José Geraldo MillIII
Sandhi Maria BarretoI
I Hospital das Clínicas e Faculdade de
Medicina. Universidade Federal de Minas Gerais. Belo Horizonte, MG, Brasil
II Centro de Pesquisa Clínica e
Epidemiológica. Hospital Universitário. Universidade de São Paulo. São Paulo, SP, Brasil
III Departamento de Ciências Fisiológicas.
Centro de Ciências da Saúde. Universidade Federal do Espírito Santo. Vitória, ES, Brasil Correspondence:
Antonio Luiz Ribeiro
Universidade Federal de Minas Gerais R. Campanha, 98/101 – Carmo 30310-770 Belo Horizonte, MG, Brasil E-mail: tom1963br@yahoo.com.br Received: 6/7/2012
Approved: 9/6/2012
Article available from: www.scielo.br/rsp
Challenges to implementation
of the ECG reading center in
ELSA-Brazil
ABSTRACT
Electrocardiography is an established low-cost method of cardiovascular assessment, utilized for decades large epidemiological studies. Nonetheless, its use in large epidemiological studies presents challenges, especially when seeking to develop a reading center. This article describes the process, diffi culties and challenges of implementing an electrocardiogram reading center in Brazilian Longitudinal Study for Adulth Health (ELSA-Brasil). Among the issues discussed, we have emphasized: the criteria for selection of the electrocardiography machine and the central for storage and management of the machines; the required personnel; the procedures for acquisition and transmission of electrocardiographs to the Reading Center; coding systems, with emphasis on the Minnesota code; ethical and practical issues regarding the delivery of reports to study participants; and aspects related to quality control.
DESCRIPTORS: Electrocardiography. Diagnostic Techniques,
Electrocardiography is a low-cost, easy to perform method of investigation of the cardiovascular system with diagnostic and prognostic value and great clinical usefulness. Used in many different care provision contexts, from the Primary Care Unit to the Intensive Care Unit, the electrocardiogram (ECG) is a basic tool for several health professionals. Additionally, the progressive complexity and the increasing costs of modern medicine with invasive examinations reveal the need of a rational utilization of the available resources, prioritizing techniques and procedures that have a favo-rable cost-effectiveness ratio, like the ECG.15
The systematic utilization of the ECG in epidemiological studies began in the 1940s, with the fi rst cardiovascular epidemiology cohorts.6 However, it was soon verifi ed
that there were substantial diffi culties in standardizing readings and coding, and these diffi culties derived from variations between successive readings performed by different observers and also from the lack of an esta-blished coding, appropriate to epidemiological and population-based studies.4 The Minnesota Code was
created in this context. Published in 1960,3 it aimed to
provide an objective, reproducible and safe system of electrocardiographic diagnoses that enabled the compa-rison of epidemiological studies carried out in different populations and countries. The code was validated in subsequent studies and has become the method chosen in epidemiological studies that use electrocardiography.19
In the following decades, countless papers were publi-shed on the use of ECG in population-based studies, showing the prognostic value of different electrocar-diographic alterations to predict death and cardiac events.5,9 An aggregate analysis of data from eight
population-based studies, published in 1978,17 involved
a total of 8,390 male individuals with an average follow--up of eight years. This study confi rmed the importance of major ECG abnormalities (which included alterations related to myocardial ischemia, bundle branch blocks, atrial fi brillation and ventricular ectopy) as markers of subclinical cardiovascular disease and predictors of cardiac events, like myocardial infarction and sudden death. Subsequent population-based studies confi rmed the prognostic importance of electrocardiographic alte-rations, including those originally classifi ed as minor alterations.7,16,26,27 In population-based studies, the ECG
is also useful to defi ne prevalent cases at baseline and to detect outcomes, such as silent myocardial infarctions, when it is performed in subsequent visits.
Simultaneously, the evolution of signal processing techniques, with the use of microelectronics and computers, the miniaturization of devices, digitization of signals and automatic interpretation of ECGs, had a great impact on cardiovascular epidemiological studies.13,24 Systems that are capable of transmitting
INTRODUCTION
electrocardiographic tracings over the Internet and software packages that enable automatic analysis and coding of tracings have revolutionized the elec-trocardiography of population-based studies, enhan-cing its applications and allowing the study of large populations.
The Estudo Longitudinal de Saúde do Adulto
(ELSA-Brasil - Brazilian Longitudinal Study for Adult Health) included more than 15 thousand participants aged 35-74 years at baseline. The aim was to monitor participants in order to identify outcomes related to the develop-ment and evolution of the main chronic diseases that affect adults, particularly cardiovascular diseases and diabetes. Baseline assessment (2008-2010) included detailed interviews and clinical and laboratory tests to obtain physiological data, especially concerning the cardiovascular system. The follow-up combines annual telephone contacts and re-tests and interviews every three to four years.2
The ECG is one of the methods performed at baseline in the ELSA-Brasil study, and it is repeated in the subsequent waves. In view of the complexity of its analysis and coding, it was decided to create a Centro
de Leitura de ECG (CL-ECG − ECG Reading Center),
so as to guarantee the quality of the records and the uniformity and comparability of coding. However, the specifi c literature describing basic requirements and diffi culties related to the implementation of a CL-ECG is scarce.1,18 The implementation was preceded by a visit
to two of the largest ECG reading centers in the world, EPICARE, which was coordinated at the time by Prof. Prineas, at Wake Forest University, in Winston-Salem, North Carolina, USA, and CARE, coordinated by Prof. MacFarlane, in Glasgow, University of Glasgow, Scotland. The present paper describes the process, diffi -culties and challenges concerning the implementation of the CL-ECG in the ELSA-Brasil.
EQUIPMENT
The centralized reading of the ECG is based on tracings obtained by different electrocardiographs, digital or analog, with the record of one, three or 12 simultaneous leads, with or without automatic inter-pretation. However, the best tracings are obtained by robust equipment that is exclusively dedicated to electrocardiography, with simultaneous acquisition of 12 high-frequency leads (>500 samples/s per channel), high-resolution thermal print head and automatic measurements of ECG defl ections and intervals.
organizing the tracings, enabling their editing and detailed analysis. Automatic coding and analyses of electrocardiographic parameters derived from compu-terized measurements depend on the availability of the tracings at such management and storage centers. Only a few companies have such systems, like GE, Philips, Mortara and Cardiac Science. Apart from these systems’ intrinsic characteristics, the way in which tracing transmission is performed between the electro-cardiographs and the storage center is relevant. With the current ubiquitous availability of the Internet, the best systems are the ones that send tracings electronically, in a network or using internet protocols.
In the ELSA-Brasil, the 12-lead ECG was recorded in a digital device (Atria 6100, Burdick, Cardiac Science Corporation, Bothel, WA, USA) with automatic reading of the heart rate; duration, amplitude and axes of the P, QRS and T waves; and also of the QT and QTC inter-vals and QT dispersion. The ECGs were transmitted from the Atria 6100 electrocardiograph to a server of the CL-ECG, located in the Centro de Investigação de
Minas Gerais (CI MG – Investigation Center of Minas
Gerais), where they were stored for subsequent analysis in a Pyramis ECG management system (version 6.2.b, Cardiac Science Corporation, Bothel, WA, USA), with the possibility of editing tracings and measuring intervals beat by beat.
PERSONNEL
The current guidelines indicate that a CL-ECG must have at least one physician experienced in clinical research or cohort studies and in electrocardiography, to assume the function of direction and coordination, with clinical and administrative responsibility.1,18 The
coordination activities can be shared with one or more coordinators, who supervise the technicians’ activities, perform quality control and revise the coding.1 The
technical team is composed of electrocardiography professionals who supervise the fi eld activities, and primary and secondary ECG analysts, who are respon-sible for manual coding (primary analysts), when it is performed, and for reviewing abnormal codes, both in manual and in automatic coding (secondary analysts).1,18 In addition, the CL-ECG needs to have
administrative and information technology support.
The CL-ECG of the ELSA-Brasil had the administrative and information technology support that is provided for the other activities of the CI MG. General coordina-tion (equivalent to the direccoordina-tion described above) was exercised by a senior medical researcher experienced in electrocardiography and clinical research, and the coordination of the works was performed by a cardiolo-gist experienced in electrocardiography and in specifi c technical coordination, and by secondary analysts.
ELECTROCARDIOGRAM ACQUISITION PROCEDURES
Performing an ECG is a routine procedure in clinical practice and it is described in reference texts available in the medical literature. In the case of epidemiological studies, especially the multicenter ones, it is necessary to standardize procedures and ensure the quality of the resulting tracings, thus minimizing the chance of errors or loss of records. ECG performance in the ELSA-Brasil study followed a routine established in the Operations Manual (Figure), and the electrocar-diography technicians of the ELSA ICs were trained and certifi ed by the ECG Reading Center team. The confi guration of the electrocardiograph was performed by the CL-ECG when the equipment was installed.
The ECG was performed according to a fl ow defi ned by the ICs, during the mornings, at an appropriate place that had low environmental noise and adequate lighting and temperature. Alcohol abstinence since the previous day was recommended; also, the participant should not smoke on the day of the test. The stages of the test were:
• Preparation of the participant for the ECG record, guaranteeing their comfort and that they were informed about the procedure. The participant should feel neither excessive cold nor excessive heat to avoid tension and muscle tremor, which interfere in the record.
• Preparation of the participant’s skin, with removal, through mild abrasion, of the skin’s most
super-fi cial corneal layer, to improve the conduction of the electrical impulse. In the ELSA study, we used the skin preparation sandpaper 3M Red Dot Trace Prep. The tape has a sticky side that adheres to the examiner’s index fi nger, and a rough side, used to abrade the skin. With a small piece of tape adhered to the tip of the index fi nger, the examiner used the rough side to remove the corneal layer of the skin on which the electrodes would be placed. The prepared skin should become pink, without solution of continuity and without the participant feeling pain. If the obtained trace was not adequate, hair was removed (in men with excessive hair on the chest) and the skin was prepared again, using a piece of gauze soaked with 70% liquid alcohol to abrade the skin.
Figure. Routine to perform electrocardiograms in the ELSA-Brasil study.
1 – Check the Atria 6100 machine.
Power cord - Patient cable - Paper - Connection to the computer network
2 – Be sure that the machine’s configuration is in accordance with the Reading Center’s instructions
Gauze – Alcohol – Electrodes – Paper towels – Felt tip pen – Heart square – Support for the patient’s cable
4 – Make sure that the environment is silent, with adequate lighting and temperature (21o to 25oC)
5 – Call the participant. Identify yourself and inform him about the procedure
6 – Place the participant on the litter. Ask the women to take the bra off
7 - Identify the points of the chest leads using the heart square to identify V4 and V6. Do not move the breasts. Mark the points with the pen.
8 – Place the electrodes on the chest with the clip indication turned downwards and on the limbs with the clip indication turned to the participant’s head
9 – Connect the lead cables with the electrodes using the clips
10 – Enter the data that will be printed together with the ECG tracing: Participant’s Identifying Number – Date of Birth – Sex – Technician – Room
11 – Wait 2 to 3 minutes after placing the electrodes on the skin
12 – Meanwhile, observe the stability of the tracing and the heart rate displayed on the screen
13 – Print one or two copies of the ECG, depending on how your Center is sending the ECGs to the Reading Center (if sending by mail, print two copies; if sending by electronic means, print one copy)
To locate the V3 to V6 electrodes, a heart square was used, as it helps to standardize the positions.20 The electrodes’ positions in women with large or pendulous breasts were determined in relation to the anatomical points, a procedure used in all the participants. Thus, the electrodes were placed on the breast (in the correct position).
• Electrode placement and cable connection. The four electrodes of the limbs were placed on the anterior region of the ankle or pulse, in areas with more subcutaneous tissue, avoiding bone surfaces. The six chest electrodes were placed on the chest marks without overlapping or contact between electrodes. The leads should not apply torsional strain to the electrodes. The cables were connected to record the ECG.
• ECG recording. It was performed in the electrocar-diograph by means of a simplifi ed procedure and the 12-lead tracing was printed on A4 paper.
• Transmission of the ECG to the Management and Storage Center, registering and checking the transmission.
• Storage and organization of the ECG at the Management Center for clinical assessment (to be returned to the participant) and coding, for the research purposes.
TRACE CODING SYSTEMS
The ECG coding system that is most frequently used in epidemiological and population-based studies, and also in clinical research, is the Minnesota Code.3 Divided
into classifi cations that are grouped into nine groups, with rigidly defi ned criteria, the code has undergone only a few modifi cations since its initial description.19
A published manual that is already in its second edition aids in the code application, with detailed explanations about how to perform the measurements and obtain the
fi nal coding.19 The Minnesota code has been used in the
majority of the large epidemiological, population-based studies and its prognostic value is already establi-shed.5,7,9,16,17,19,26,27 The Novacode classifi cation system
was developed from the Minnesota code, so as to be utilized in serial assessments, and since its conception it has been adapted to automated interpretation.22,23 In
many aspects Novacode is comparable to the Minnesota code, both in terms of the coding system19 and
concer-ning their prognostic impact.26,27 The experience that has
been accumulated with the Minnesota code, together with its greater simplicity, have made it become the standard coding system in modern epidemiological studies.
In recent years, advances in information technology and in the knowledge that has been acquired about
automatic interpretation of the ECG have enabled the development of programs for the automatic coding of tracings through the Minnesota code.11,12,14,19 Such
methods have proved to be particularly attractive to be used in population-based studies, which started to have increasingly large samples. Comparisons between the manual and automatic methods have shown that automatic coding presents lower variability and greater accuracy and it has been recommended for epidemio-logical studies.11,12,14,19
At the CL-ECG, the automatic coding system developed at the University of Glasgow by Prof. MacFarlane14 was adopted. The software was installed
by Cardiac Science in the Pyramis system (version 6.2.b) available at the CL-ECG. The resulting codes were extracted and reviewed by secondary coders, to confi rm the results. Next, the records were transferred to the ELSA-Brasil Datacenter. In 382 cases, there was a failure in the transmission of the ECG from the IC to the CL-ECG. In these cases, manual coding was performed at the University of Glasgow, under the supervision of Prof. MacFarlane.
ETHICAL AND PRACTICAL ASPECTS RELATED TO THE DELIVERY OF REPORTS
The literature documents the existence of a strong controversy about the pertinence and need of delive-ring test results to participants in epidemiological and clinical studies, and also about the way in which the results are delivered.25 On the one hand, the majority
of participants want to receive the results, which can be useful to the early diagnosis of treatable conditions. On the other hand, the meaning of asymptomatic alterations obtained through casual tests is questio-nable, even regarding established methods such as the ECG.8,25
The ELSA-Brasil decided to deliver tests and reports on complementary tests whose clinical use is establi-shed, such as the ECG. The reports were made by an experienced cardiologist and both the tracing and the report were delivered to the participants. The results were handed personally, by doctors or qualifi ed health professionals, who provided explanations based on the report. In specifi c situations, the participant was advised to make an appointment with his/her private doctor in order to follow the propedeutics. In case the ECG result was normal and the participant wanted to receive the report at home, it would be sent by mail.
QUALITY CONTROL
CL-ECG of the ELSA-Brasil included the following activities, based on recommendations found in the literature:1,18,19,21,25
• Training and certifi cation of the electrocardiography technicians. An initial training with technicians and doctors from the ICs was carried out at the CL-ECG, and the Operations Manual was used as the basic text. The procedures were revised, with extensive practice at the use of the electrocardiograph. At the end of training, a theoretical and practice evaluation was performed. Certifi cation was granted after the professional sent at least fi ve high-quality ECGs. At each clinic, at least one professional was trained to certify new technicians. The local training and certifi cation of professionals followed the program of the CL-ECG, utilizing classroom material and tests provided by the CL. Certifi cation was renewed on an annual basis.
• Quality control procedures regarding the ECGs performed at the investigation centers. Each IC maintained a routine so as to guarantee the quality control of the obtained records. The local ECG technicians fi lled in the quality control form to each examined participant. The form included informa-tion on the use of the heart square, the posiinforma-tioning of the precordial electrodes, and the evaluation of trace quality, with a scale that ranged from 1 to 5 (1 = poor and 5 = excellent). Traces with scores < 3 were repeated. Every two weeks, the local super-visors monitored the performance of one ECG by the professional, using the step-by-step form as a checklist. Finally, the control of the transmission of the ECGs was performed through a weekly record of the ECGs sent by the Atria 6100 electrocardio-graphs to the Pyramis system. The list of sent ECGs was made by fax to be checked at the CL-ECG. The CL-ECG has spare electrocardiographs for the immediate replacement of defective equipment in the investigation centers.
• Quality control procedures of the CL-ECG. All the ECGs received by the CL-ECG were evaluated concerning the quality of the tracing and the possibi-lity of misplacing the electrodes, especially among the limbs and among the precordial electrodes. In case of a trace of inferior quality or if there was the suspicion that the electrodes had been misplaced, the repetition of the record was requested. The control of the receipt of the tracings was also performed, ensuring that all the transmitted records were received and processed. Finally, the abnormal codes of the obtained and analyzed tracings were reviewed by medical coders.
DIFFICULTIES AND CHALLENGES
The process of creating the CI-ECG underwent a series of diffi culties and challenges. We listed below some critical aspects of the creation of the CL, briefl y discussing the diffi culties.
• Choice of equipment. Although there are dozens of electrocardiograph brands available in the market, only a few devices present the technical characte-ristics that are adequate to the study, either due to strength and intrinsic characteristics, or because of the need of safe transmission of the tracings to an ECG management and storage center. There are few management and storage centers in commer-cial systems. The choice should also consider the existence and quality of distributors and technical assistance.
• Team formation. The CL-ECG team must be formed by professionals who have experience in clinical cardiology and electrocardiography, and also in epidemiology and management; good results, in turn, depend on the concatenation of clinical, epide-miological and administrative processes.
• Standardization of the procedure. Standardization is essential so that all the ECGs performed at the different centers have the same quality and can be compared. The routine must be described in detail in a specifi c manual and the entire team needs to be involved, with period training and certifi cation. The inputs (for example, electrodes, paper) must also be standardized, guaranteeing the uniformity of the results.
• Choice of the coding methodology. Although the advantages of using the Minnesota Code are clear, manual coding is slow and laborious, and requires that coders are trained and experienced in it. This is only justifi ed if the center has a large volume of tracings for coding. On the other hand, automatic reading requires specifi c analysis software, which is not available in the existing ECG management and storage systems. The practical and technical advan-tages of automatic reading (with or without a
poste-riori revision) favor the choice of this solution.11,12
• Quality assurance. Quality control procedures should be incorporated into the daily practice, in order to avoid the loss of records and to guarantee the obtention of tracings that can be analyzed.
FINAL REMARKS
In the present study, we described the implementation of an ECG reading center in Brazil, discussing the diffi -culties and challenges that were faced. It is an original report, for as far as we know, there is no other reading center of academic nature in Brazil or in other Latin American countries that has followed the international recommendations for its implementation.
We would like to emphasize the utilization of a totally digitized system and the automatic coding of the ECGs
1. Anderson ST, Pahlm O, Bacharova L, Barbagelata A, Chaitman BR, Clemmensen P, et al. Standards for the function of an academic 12-lead electrocardiographic core laboratory. J Electrocardiol. 2001;34(1):41-7. DOI:10.1054/jelc.2001.22028
2. Aquino EM, Barreto SM, Bensenor IM, Carvalho MS, Chor D, Duncan BB, et al. Brazilian Longitudinal Study of Adult Health (ELSA-Brasil): objectives and design. Am J Epidemiol. 2012;175(4):315-24. DOI:10.1093/aje/kwr294
3. Blackburn H, Keys A, Simonson E, Rautaharju P, Punsar S. The electrocardiogram in population studies: a classifi cation system. Circulation. 1960;21:1160-75.
4. Blackburn H. The electrocardiogram in cardiovascular epidemiology: problems in standarized application. Ann N Y Acad Sci. 1965;126(2):882-905.
5. Blackburn H, Taylor HL, Keys A. Coronary heart disease in seven countries. XVI. The electrocardiogram in prediction of fi ve-year coronary heart disease incidence among men aged forty through fi fty-nine. Circulation. 1970;41(4 Suppl):I154-61.
6. Dawber TR, Kannel WB, Love DE, Streeper RB. The electrocardiogram in heart disease detection: a comparison of the multiple and single lead procedures. Circulation. 1952;5(4):559-66.
7. Greenland P, Xie X, Liu K, Colangelo L, Liao Y, Daviglus ML, et al. Impact of minor electrocardiographic ST-segment and/or T-wave abnormalities on cardiovascular mortality during long-term follow-up. Am J Cardiol. 2003;91(9):1068-74.
8. Greenland P. Should the resting electrocardiogram be ordered as a routine risk assessment test in healthy asymptomatic adults? JAMA. 2012;307(14):1530-1. DOI:10.1001/jama.2012.441
9. Kannel WB, Gordon T, Castelli WP, Margolis JR. Electrocardiographic left ventricular hypertrophy and risk of coronary heart disease. The Framingham study. Ann Intern Med. 1970;72(6):813-22.
10. Kligfi eld P, Gettes LS, Bailey JJ, Childers R, Deal BJ, Hancock EW, et al. Recommendations for the standardization and interpretation of the electrocardiogram. Part I: The electrocardiogram and its technology: a scientifi c statement from the American Heart Association Electrocardiography and Arrhythmias Committee, Council on Clinical Cardiology; the American College of Cardiology Foundation; and the Heart Rhythm Society. Heart Rhythm. 2007;4(3):394-412. DOI:10.1016/j.hrthm.2007.01.027
11. Kors JA, Crow RS, Hannan PJ, Rautaharju PM, Folsom AR. Comparison of computer-assigned Minnesota Codes with the visual standard method for new coronary heart disease events. Am J Epidemiol. 2000;151(8):790-7.
12. Kors JA, van Herpen G. The coming of age of computerized ECG processing: can it replace the cardiologist in epidemiological
studies and clinical trials? Stud Health Technol Inform. 2001;84(Pt 2):1161-7. DOI:10.3233/978-1-60750-928-8-1161
13. Macfarlane PW. A brief history of computer-assisted electrocardiography. Methods Inf Med. 1990;29(4):272-81.
14. MacFarlane PW, Latif S. Automated serial ECG comparison based on the Minnesota code. J Electrocardiol. 1996;29(Suppl):29-34.
15. Macfarlane PW, Oosterom A, Pahlm O, Kligfi eld P, Janse M, Camm A, editors. Comprehensive electrocardiology. 2.ed. London: Springer; 2011.
16. Machado DB, Crow RS, Boland LL, Hannan PJ, Taylor Jr HA, Folsom AR. Electrocardiographic fi ndings and incident coronary heart disease among participants in the Atherosclerosis Risk in Communities (ARIC) study. Am J Cardiol. 2006;97(8):1176-81. DOI:10.1016/j.amjcard.2005.11.036
17. Pooling Project Research Group. Relationship of blood pressure, serum cholesterol, smoking habit, relative weight and ECG abnormalities to incidence of major coronary events: fi nal report of the pooling project. J Chronic Dis. 1978;31(4):201-306.
18. Prineas RJ, Blackburn H. The Coronary Drug Project. Role and methods of the ECG Reading Center. Control Clin Trials. 1983;4(4):389-407.
19. Prineas RJ, Crow RS, Zhang ZM. The Minnesota code manual of electrocardiographic fi ndings. 2.ed. London: Springer; 2010.
20. Rautaharju PM, Wolf HK, Eifl er WJ, Blackburn H. A simple procedure for positioning precordial ECG and VCG electrodes using an electrode locator. J Electrocardiol. 1976;9(1):35-40.
21. Rautaharju PM, Broste SK, Prineas RJ, Eifl er WJ, Crow RS, Furberg CD. Quality control procedures for the resting electrocardiogram in the Multiple Risk Factor Intervention Trial. Control Clin Trials. 1986;7(3 Suppl):46S-65S.
22. Rautaharju PM, Calhoun HP, Chaitman BR. NOVACODE serial ECG classifi cation system for clinical trials and epidemiologic studies. J Electrocardiol. 1992;24(Suppl):179-87.
23. Rautaharju PM, Park LP, Chaitman BR, Rautaharju F, Zhang ZM. The Novacode criteria for classifi cation of ECG abnormalities and their clinically signifi cant progression and regression. J Electrocardiol. 1998;31(3):157-87.
24. Savage DD, Rautaharju PM, Bailey JJ, Horton MR, Hadden W, LaCroix AZ, et al. The emerging prominence of computer electrocardiography in large population-based surveys. J Electrocardiol. 1987;20(Suppl):48-52.
25. Shalowitz DI, Miller FG. Communicating the results of clinical research to participants: attitudes, practices, and future directions. PLoS Med. 2008;5(5):e91. DOI:10.1371/journal.pmed.0050091
Research funded by the Program of Support to Excellence Nuclei of the Fundação de Apoio à Pesquisa do Estado de Minas Gerais (PRONEX/FAPEMIG – Process n. CDS 505/07) and by Financiadora de Estudos e Projetos (FINEP – Funding for Studies and Projects, Process n. 4242/05).
The Brazilian Longitudinal Study of Adult Health (ELSA-Brasil) was funded by the Ministry of Health (DECIT – Departamento de Ciência e Tecnologia – Science and Technology Department) and by the Ministry of Science and Technology (FINEP – Financiadora de Estudos e Projetos [Funding Agency for Studies and Projects] and CNPq – Conselho Nacional de Desenvolvimento Científi co e Tecnológico [National Council for Scientifi c and Technological Development] − Processes N. 01 06 0010.00 RS, 01 06 0212.00 BA, 01 06 0300.00 ES, 01 06 0278.00 MG, 01 06 0115.00 SP, 01 06 0071.00 RJ). The authors declare that there are no confl icts of interest.
This manuscript was submitted for publication and underwent a peer review process as any other manuscripts submitted to this publication, and anonymity was guaranteed for authors and reviewers. Editors and reviewers declare no confl icts of interest that may affect the peer-review process.
comparison of the Minnesota Code and Novacode for electrocardiographic Q-ST wave abnormalities for the independent prediction of incident coronary heart disease and total mortality (from the Women’s Health Initiative). Am J Cardiol. 2010;106(1):18-25. DOI:10.1016/j.amjcard.2010.02.007
