- Open Access
- Open Peer Review
Combination of single quantitative parameters into multiparametric model for ischemia detection is not superior to visual assessment during dobutamine stress echocardiography
Cardiovascular Ultrasound volume 14, Article number: 13 (2016)
To evaluate if the combination of several quantitative parameters into a mathematical model would enhance the detection of myocardial ischemia during dobutamine stress echocardiography (DSE) when compared to conventional wall motion analysis.
In a prospective study design 151 patients (age 61.8 ± 9.2) in test group and 105 patients (age 64.0 ± 10.6) in validation group were selected and underwent DSE between January 2008 and December 2012. In all patients coronary angiography was performed within 6-8 weeks from DSE, considering at least one stenosis ≥50 % per patient as significant coronary artery disease (CAD). Results of DSE visual assessment and myocardial velocity, strain and strain rate parameters derived from speckle tracking imaging were imported automatically to an originally created software. A mathematical model calculating prognosis of at least one stenosis per patient and stenosis in separate arteries was constructed.
Myocardial ischemia was visually detected in 60 (39.7 %) and in 58 (54.2 %) patients of the test and validation group, respectively. A total of 76 (50.3 %) patients in the test group and 69 patients (65.7 %) in the validation group had ≥50 % coronary stenosis. Sensitivity and specificity of the mathematical model per patient in the test group were 91.6 % and 86.3 % compared to 76.8 % and 89.0 % of the visual assessment, respectively. However, in the validation group the sensitivity, specificity, positive predictive value and negative predictive value dropped down significantly becoming lower to visual assessment.
Myocardial deformation imaging may potentially replace visual assessment with an automated predictive model for stress-induced ischemia detection. However, a multiparametric mathematical model based on quantitative deformation markers did not demonstrate incremental value to visual assessment of wall motion.
Several studies have proposed a number of quantitative parameters vs. visual assessment for ischemia detection during dobutamine stress echocardiography (DSE) [1–7]. However, most of these quantitative tools have remained in the research laboratory and are not implemented in the routine clinical practice. In a previous report we tried to identify a single powerful quantitative parameter for the prediction of coronary stenosis studying multiple velocity and deformation parameters during DSE but we could not demonstrate that such an approach was better than expert visual wall motion reading . Several previous reports were consistent with our findings showing that visual assessment was equally accurate as quantitative assessment. However, the main limitation of stress echocardiography is related to operator’s experience and a more objective and quantitative approach is needed. The purpose of this study was to evaluate if the combination of several quantitative parameters into a mathematical model would enhance the detection of myocardial ischemia during DSE. The study hypothesis is that a multiparametric approach would provide a sound and effective diagnostic tool.
One hundred fifty-one prospectively enrolled consecutive patients in the test group underwent DSE between January 2008 and December 2010 and 105 patients in the validation group underwent DSE between January 2011 and December 2012. Decision for DSE indication was made by consulting cardiologists not involved in the research project, in the course of routine diagnostic workup. DSE was performed for recurrent symptoms in patients with known coronary artery disease (CAD) (n = 35 in the test group and n = 40 in the validation group) or suspected CAD (n = 116 and n = 65, respectively). Patients were included in the study if coronary angiography was performed within 6-8 weeks after DSE. Exclusion criteria were: previous myocardial infarction, previous cardiac surgery, non-sinus rhythm, significant valvular disease, left ventricular hypertrophy [9–11], atrial or ventricular arrhythmias, bundle branch block or reduced left ventricular (LV) ejection fraction (EF) <50 %. Beta-blocking medications were discontinued 48 hours, nitrates and other antianginal medications – 24 hours prior to the DSE in all patients. Stress echocardiography was performed on medical therapy in 94 (62 %) patients in the test group and 82 (78 %) in the validation group (calcium-antagonists in 56 and 41, or nitrates in 38 and 21, respectively) and off therapy in 57 (38 %) and 23 (22 %) patients. Informed consent was obtained from all patients before testing, and the study protocol was approved by the Vilnius regional Bioethics committee (Approval No.158200-11-254-58). Stress echo data were collected and analysed by stress echocardiographers not involved in patient care. Hypertension and hypercholesterolemia were defined according to standard definitions [9, 11].
Dobutamine echocardiography and visual assessment
Each study patient underwent a standard DSE protocol with incremental dobutamine infusion rates 5, 10, 20, 30, and 40 μg/kg/min for 3 minutes each stage under continuous ECG, blood pressure (BP), and echocardiographic monitoring. When no end point was reached, atropine (up to a maximum of 1 mg) was added to the continuing 40 μg/kg/min dobutamine infusion. Non-echocardiographic diagnostic end-points were the following: peak atropine dose; 85 % of target heart rate; development or deterioration of wall-motion abnormalities, severe chest pain and/or diagnostic ST segment changes. The test was also stopped for one of the following reasons: intolerable symptoms, systolic blood pressure increase to >220 mmHg or hypotension, severe arrhythmias.
Transthoracic stress echocardiographic studies were performed with commercially available ultrasound machine (System Vivid 7, GE Healthcare, Horten, Norway) with 1,5 – 4,6 MHz transducer. The long and short axis of the LV from parasternal window, 4- and 2-chamber views from apical window were acquired for comparison in four stages of stress test. Regional wall motion was assessed according to the recommendations of the European Association of Echocardiography dividing LV into 16 myocardial segments. In all studies, segmental wall motion was semiquantitatively graded as follows: normal = 1; hypokinetic, marked reduction of endocardial motion and thickening = 2; akinetic, virtual absence of inward motion and thickening = 3; and dyskinetic, paradoxic wall motion away from the center of the left ventricle in systole = 4. It was considered that in some cases of normal variant basal inferior and basal inferoseptal segments could be scored as hypokinetic. The sum of all segment scores divided by the number of interpretable segments made WMSI. Test positivity was defined as the occurrence of at least one of the following conditions: 1) new dyssynergy in a region with normal resting function (i.e., normokinesis becoming hypo, aki or dyskinetic); 2) worsening of a resting dyssynergy (i.e., a hypokinesia becoming aki or dyskinesia).
Speckle tracking myocardial imaging
Speckle tracking images (STI) were recorded at baseline and peak dobutamine levels with breath-holding. The frame rate of stored apical 2 and 4-chamber cine-loops for speckle tracking analysis was in the range of 70–90 frames/sec. The loops were stored digitally and analysed off-line using customised software (Echopac PCBT08, GE Healthcare). After manual tracing of endocardium borders in the end-systolic frame of the 2-D images, the software automatically tracked myocardial motion, creating 6 regions of interest in each apical image, with tracking quality labelled as verified or unacceptable. In segments with unacceptable tracking, the observer readjusted the endocardium trace line until a verified tracking was achieved. If this was not attainable, that segment was excluded from analysis. Graphical displays of deformation parameters (reflecting the average value of all of the acoustic markers in each segment) were then automatically generated for 6 segments in each view.
Measurement of quantitative parameters
Peak longitudinal systolic (S’), diastolic (E’, A’) velocities, time to peak systolic velocity, peak longitudinal and radial systolic, post-systolic and maximal strain, peak longitudinal systolic and diastolic strain rate, radial systolic displacement at rest and during stress were measured using automated vendor-suggested software. Maximal strain coincided with systolic or post-systolic strain whichever was found larger. Parameters of 12 myocardial segments (6 in 4-chamber and 6 in 2-chamber views) were manually approved and automatically exported to Excel tables using commercially available software (Echopac PCBT08, GE, Healthcare). Post-systolic index (PSI) was defined by formula PSI = peak post-systolic strain - peak systolic strain. Speckle tracking parameters were automatically imported to multiparametric model integrated in local Access DSE database.
Coronary angiography was performed in all patients of both groups referred to DSE within 6–8 weeks after dobutamine challenge according to the standard Judkins technique adopting femoral or radial approach with Inova2100 (GE Healthcare). Clinical decision to perform coronary angiography was made independently of the study by consulting cardiologists, who were aware of DSE test results for conventional wall motion criteria. At least five views (including two orthogonal views) were acquired for the left and at least two orthogonal views for the right coronary artery, respectively. Additional appropriate projections were obtained in case of superimposition of side branches or foreshortening of the segment of interest. Coronary angiographic data were analysed by 2 experts blinded to the clinical data and the results of DSE. Obstructive CAD was defined as a quantitatively assessed coronary stenosis ≥ 50 %.
Statistical analysis, multiparametric model construction and implementation
Study variables are presented as mean values ± SD. Interobserver agreement was determined by having two independent investigators measure representative parameters using STI and assess WMSI in 15 randomly selected patients. Intraobserver agreement was determined by having 1 investigator repeat STI measurements and WMSI evaluation in other 15 randomly selected patients 1 month later, while being blinded to the previous measurements. Reproducibility is expressed as the mean percentage difference (value of observer 1 - value of observer 2/mean of the values of observer 1 and 2).
Construction of the underlying statistical model consisted of two steps. The first step was intended for selection of predictive visual assessment and speckle tracking variables. As the amplitude of quantitative covariants depends on the location of the segment in the left ventricle, analysis was performed separately for each segment location. The level of significance was set at 0.05. Simple logistic regression model was fitted for each of the study variable. If a parameter was significant it was included into the set of predictors used in the second step (Table 1). Moreover, for each significant parameter optimal threshold of classification was computed. In the second step all raw values of covariants were replaced by new ones as follows. We denoted optimal logistic regression threshold corresponding to parameter a and obtained in the first step, whereas β α0 , β α1 denote the estimated model parameters. For a particular value x dependent of parameter a calculated in step 1, we defined new rescaled logistic regression response (step 2).
with φ(y) = ey /(1 + ey). Now for observation number i with particular value of a equal to x i put
Transformation allows use missing values set as zero, otherwise calculated rescale transformation (positive/negative) is more informative in logistic regression. Multiparametric mathematical model construction steps are shown in Fig. 1.
After replacement the data set did not contain missing values and included only those covariants which were selected in the first step. For this full data set stepwise logistic regression was applied. Hence final model could be treated as some kind of voting neural network with unusual fitting method. Described procedure was applied for prognosis of stenosis in separate arteries: left ascending artery (LAD), right coronary artery (RCA), left circumflex artery (LCX) as well as for prognosis of presence of at least one stenosis per patient. Covariants and cutoff included in models are shown in Table 1.
“Test group” provided a dataset used for model construction (151 consecutive patients enrolled between January 2008 and December 2010); “validation group” yielded an independent dataset used to estimate how accurately the model will perform in practice (105 consecutive enrolled between January 2011 and December 2012).
To make model convenient for practitioners a software was incorporated within an existing Access data collection form. Calculations of sensitivity, specificity and accuracy were performed according to standard definitions. The 95 % CIs were calculated and the individual intervals were compared. Differences were considered significant at the 0.05 level when 95 % CI did not overlap.
Clinical and echocardiographic characteristics of the study population are reported in Table 2. No major complications occurred during DSE. The 85 % age-predicted maximum heart rate was achieved in 137 (90.7 %) and 94 (89.5 %) test and validation group, respectively. Ischemia was visually detected in 60 (39.7 %) and in 58 (54.2 %) patients of the test and validation group, respectively.
Feasibility and reproducibility of quantitative data
After exclusion of poorly visualized segments, the stored data of 1466 (97.1 %) and 1017 (96.9 %) myocardial segments in the test and validation group, respectively, were finally analysed. The prevalence of uninterpretable signals due to inadequate tracking in the segments included in the final analysis was found to be 2.1 % and 2.5 % at rest and 5 % and 5.2 % during stress in the test and validation group, respectively.
The mean percentage differences of inter- and intraobserver measurements of velocity, strain, strain rate and WMSI are summarized in Table 3.
A total of 76 (50.3 %) patients in the test group and 69 patients (65.7 %) in the validation group had ≥50 % coronary stenosis, see Table 4.
Diagnostic accuracy of multiparametric model and visual wall motion analysis
Diagnostic performance of models created per patient and per vessel in the test group appeared to be superior to visual assessment (Table 5, Figs. 2, 3, 4 and 5). Sensitivity and specificity of the model per patient in the test group were 91.6 % and 86.3 % compared to 76.8 % and 89.0 % of visual assessment, respectively. However, when we applied the same models in the new validation group, sensitivity, specificity, positive predictive value and negative predictive value were significantly reduced and became lower to visual evaluation (Table 5, Figs. 2, 3, 4 and 5).
This study represents further consecutive step in attempts to implement quantitative tools in the detection of myocardial ischemia during stress echocardiography. It is based on the number of previous investigations showing the significant links of several myocardial motion and deformation markers with induced ischemia [1–8, 12–15].
However, in the vast majority of publications the diagnostic accuracy of the quantitative markers is demonstrated to be lower or only comparable to the visual assessment of stress echocardiography [1, 2, 8, 12–14]. Current lack of evidence on effective application of quantitative methods in routine practice is reflected in recommendation documents and consensus statement of EAE and ASE [3, 15, 16].
Prior research [1, 4–8] was mostly focused on single parameters, segment-specific or averaged for all myocardial segments that carry only fragmental information of regionally impaired myocardial mechanics. Therefore, we hypothesized that a multiparametric model, including a substantial list of informative quantitative parameters, would demonstrate better performance than separate markers alone or visual DSE assessment.
Theoretically, such mathematical model could better reflect the complicated nature of the biological phenomenon of regional ischemia and incorporate relevant interdependencies between physiologically different parameters. The feasibility was considered as one of the main requirements to the quantitative tool for routine clinical practice, therefore automatically obtainable data of speckle tracking were chosen for model creation.
In parallel with previous studies the set of predictive markers included blunted response of systolic velocity, prolonged time to peak systolic velocity [1, 12, 14], decreased E’ wave velocity [4, 5, 17], longitudinal and radial systolic, post-systolic and maximal strain, post-systolic index [6, 7, 13], systolic and diastolic longitudinal and radial strain rate, radial systolic displacement. In this study we followed the methodology of defining thresholds separately for each evaluated myocardial segment, taking into account known base-to-apex and wall-to-wall differences of myocardial velocity and strain/strain rate [10, 18, 19]. Model user should only approve peak velocity, strain, strain rate and displacement values in the commercially available 2D strain analysis software and then export data set through Excel tables to the constructed system. Originally created classifier was incorporated in daily used Access database of DSE. Visual assessment data were eligible for automatic import, and changes in scores of selected segments entered the model, too. Of note, the lower sensitivity of visual assessment in the present and some previous reports  reflects the limitations of subjective interpretation of regional wall motion and justifies the search of quantitative tools.
The constructed mathematical analysis tool represents a kind of machine learning methodology, namely a type of neural network with unusual fitting method. Machine learning technology is currently well suited for analysing medical data, and in particular there is a lot of work done in medical diagnosis in small specialized diagnostic problems [20–22]. This system provides a possibility to handle an unusually large amount of data in a relatively short period of time. The created classifier automatically made the prognosis of significant coronary stenosis, and in the test group it demonstrated promising results. However, the attempt to validate the model in the similar population of consecutive patients gave disappointing results.
Failure of model validation recalls the shortcomings of single quantitative markers, having rather modest predictive ability of significant coronary stenosis (AUCs 0.60-0.72) [8, 14]. Limited value of distinguished indices could be largely attributed to known technical challenges of quantitative imaging: potentially inadequate spatial and temporal resolution, higher speckle decorrelation between subsequent frames at higher heart rates, noise and artefacts . Similar to our findings, considerable inter- and intra-observer variability of 7-12 % is reported for speckle tracking technology [8, 24–26]. Possibly, mutual interaction of ischemic and non-ischemic segments and load-dependency of deformation parameters may diminish the differences between markers of these two groups [26, 27]. Furthermore, previously demonstrated significant heterogeneity of left ventricular wall thickening during dobutamine stress even in the absence of CAD may contribute to insufficient accuracy of created model .
In this study coronary angiography was used as the reference method. However, relationship between stenosis severity and physiological reduction of coronary flow is quite variable. Angiographic coronary stenosis does not always reflect the potential alteration in the regional myocardial perfusion.
Acquisition of quantitative parameters was based on the commercially available software, therefore relying on implemented methods of noise and artefacts handling. Creating a multiparametric mathematical model, the main challenges remain related to identifying the best methodology for data transformation and critical clinical data. Finally, there is need to understand how to deal with missing data. The study model was constructed on a relatively small data base with possible over fitting.
Myocardial deformation imaging provides potential for creation of automated predictive model for stress-induced ischemia detection. However, a multiparametric mathematical model based on quantitative deformation markers did not demonstrate incremental value to visual assessment of wall motion.
Coronary artery disease
Dobutamine stress echocardiography
Left ascending artery
Left circumflex artery
Right coronary artery
Speckle tracking imag
Wall motion score index
Mädler CF, Payne N, Wilkenshoff U, Cohen A, Derumeaux GA, Piérard LA, et al. Myocardial Doppler in Stress Echocardiography (MYDISE) Study Investigators: Non-invasive diagnosis of coronary artery disease by quantitative stress echocardiography: optimal diagnostic models using off-line tissue Doppler in the MYDISE study. Eur Heart J. 2003;24:1584–94.
Ingul CB, Stoylen A, Slordahl SA, Wiseth R, Burgess M, Marwick TH. Automated Analysis of Myocardial Deformation at Dobutamine Stress Echocardiography. An Angiographic Validation. J Am Coll Cardiol. 2007;49(15):1651–60.
Mor-Avi V, Lang RM, Badano LP, Belohlavek M, Cardim NM, Derumeaux G, et al. Current and Evolving Echocardiographic Techniques for the Quantitative Evaluation of Cardiac Mechanics: ASE/EAE Consensus Statement on Methodology and Indications. J Am Soc Echocardiogr. 2011;24:277–313.
von Bibra H, Tuchnitz A, Klein A, Schneider-Eicke J, Schömig A, Schwaiger M. Regional diastolic function by pulsed Doppler myocardial mapping for the detection of left ventricular ischemia during pharmacologic stress testing: a comparison with stress echocardiography and perfusion scintigraphy. J Am Coll Cardiol. 2000;36:444–52.
Ishii K, Miwa K, Sakurai T, Kataoka K, Imai M, Kintaka A, et al. Detection of post-ischemic regional left ventricular delayed outward wall motion or diastolic stunning after exercise-induced ischemia in patients with stable effort angina by using color kinesis. J Am Soc Echocardiogr. 2008;21:309–14.
Armstrong G, Pasquet A, Fukamachi K, Cardon L, Olstad B, Marwick T. Use of peak systolic strain as an index of regional left ventricular function: comparison with tissue Doppler velocity during dobutamine stress and myocardial ischemia. J Am Soc Echocardiogr. 2000;13(8):731–7.
Yip G, Khandheria B, Belohlavek M, Pislaru C, Seward J, Bailey K, et al. Strain echocardiography tracks dobutamine induced decrease in regional myocardial perfusion in nonocclusive coronary stenosis. J Am Coll Cardiol. 2004;44:1664–71.
Celutkiene J, Zakarkaite D, Skorniakov V, Zvironaite V, Grabauskiene V, Burca J et al. Quantitative approach using multiple single parameters versus visual assessment in dobutamine stress echocardiography. Cardiovasc Ultrasound. 31. doi: 10.1186/1476-7120-10-31.
Mancia G, Fagard R, Narkiewicz K, Redon J, Zanchetti A, Bohm M, et al. 2013 ESH/ESC Guidelines for the management of arterial hypertension. The Task Force for the management of arterial hypertension of theEuropean Society of Hypertension (ESH) and of the European Society of Cardiology (ESC). Eur Heart J. 2013;34:2159–219. doi:10.1093/eurheartj/eht151.
Lang RM, Bierig M, Devereux RB, Flachskampf FA, Foster E, Pelikka PA, et al. Recommendations for chamber quantification. Eur J Echocardiogr. 2006;7:79–108.
Rydén L, Standl E, Bartnik M, Van den Berghe G, Betteridge J, de Boer MJ, et al. Task Force on Diabetes and Cardiovascular Diseases of the European Society of Cardiology (ESC); European Association for the Study of Diabetes (EASD). Guidelines on diabetes, pre-diabetes, and cardiovascular diseases: executive summary. The Task Force on Diabetes and Cardiovascular Diseases of the European Society of Cardiology (ESC) and of the European Association for the Study of Diabetes (EASD). Eur Heart J. 2007;28:88–136.
Cain P, Baglin T, Case C, Spicer D, Short L, Marwick TH. Application of tissue Doppler to interpretation of dobutamine echocardiography and comparison with quantitative coronary angiography. Am J Cardiol. 2001;87:525–31.
Voigt J-U, Exner B, Schmiedehausen K, Huchzermeuer C, Reulbach U, Nixdorff U, et al. Strain-Rate Imaging During Dobutamine Stress Echocardiography Provides Objective Evidence of Inducible Ischemia. Circulation. 2003;107:2120–6.
Hanekom L, Cho GY, Leano R, Jeffriess L, Marwick TH. Comparison of two-dimensional speckle and tissue Doppler strain measurement during dobutamine stress echocardiography: an angiographic correlation. Eur Heart J. 2007;28:1765–72.
Sicari R, Nihoyannopoulos P, Evangelista A, Kasprzak J, Lancellotti P, Poldermans D, et al. Zamorano JL on behalf of the European Association of Echocardiography: Stress echocardiography expert consensus statement. Eur J Echocardiography. 2008;9:417–37.
Douglas PS, Garcia MJ, Haines DE, Lai WW, Manning WJ, Patel AR, et al. ACCF/ASE/AHA/ASNC/HFSA/HRS/SCAI/SCCM/SCCT/SCMR 2011 Appropriate Use Criteria for Echocardiography. J Am Soc Echocardiogr. 2011;24:229–67.
Garcia-Fernandez MA, Azevedo J, Moreno M, Bermejo J, Moreno R. Regional left ventricular diastolic dysfunction evaluated by pulsed-tissue Doppler echocardiography. Echocardiography. 1999;16:491–500.
Bogaert J, Rademakers FE. Regional nonuniformity of normal adult human left ventricle. Am J Physiol Heart Circ Physiol. 2001;280:H610–20.
Edvardsen T, Skulstad H, Aakhus S, Urheim S, Ihlen H. Regional myocardial systolic function during acute myocardial ischemia assessed by strain doppler echocardiography. J Am Coll Cardiol. 2001;37:726–30.
Kononenko I. Machine learning for medical diagnosis: history state of the art and perspective. Artif Intell Med. 2001;23:89–109.
Jaafar J, Atwell E, Johnson O, Clamp S, Ahmad W. Evaluation of Machine Learning Techniques in Predicting Acute Coronary Syndrome Outcome. Research and Development of Intelligent Systems. 2013. p. 321-333. (http://link.springer.com/chapter/10.1007/978-3-319-02621-3_24). Accessed 7 Nov 2013.
Calle-Alonso F, Perez CJ, Arias-Nicolas JP, Martin J. 478 Computer-aided diagnosis system: a Bayesian hybrid classification method, Comput. Methods Programs Biomed. 2013;112:104–13.
Argyle RA, Ray SG. Stress and strain: double trouble or useful tool? Eur J Echocardiography. 2009;10(6):716–22.
Tscope C, Kasner M. Can speckle-tracking imaging improve the reliability of echocardiographic parameters for outcome evaluation in clinical trials? Eur H J. 2013. doi:10.1093/eurheartj/eht217.
Bansal M, Sengupta PP. Longitudinal and Circumferential Strain in Patients with Regional LV Dysfunction. Curr Cardiol Rep. 2013;15:339.
Sicari R. Relevance of tissue Doppler in the quantification of stress chocardiography for the detection of myocardial ischemia in clinical practice. Cardiovasc Ultrasound. 2005;3:2.
Mak S, Van Spall HCG, Wainstein RV, Sasson Z. Strain, Strain Rate, and the Force Frequency Relationship in Patients with and without Heart Failure. Am Soc Echocardiogr. doi:10.1016/j.echo.2011.11.008.
Borges AC, Pingitore A, Cordovil A, Sicari R, Baumann G, Picano E. Heterogeneity of left ventricular regional wall thickening following dobutamine infusion in normal human subjects. Eur Heart J. 1995;16(11):1726-30.
This research was funded by a grant (No. LIG-27/2010) from the Research Council of Lithuania.
Relationship with industry: no.
The authors declare that they have no competing interests.
JC participated in conception and design creation, acquisition, analysis and interpretation of data, drafting the manuscript and revising it critically for important intellectual content. GB participated in analysis and interpretation of data, drafting the manuscript. LP participated in analysis and interpretation of data, drafting the manuscript. LB participated in analysis and interpretation of data, drafting the manuscript. AL participated in conception and design creation, drafting the manuscript and revising it critically for important intellectual content and final approval of the manuscript submission. All authors read and approved the final manuscript.