Quantification of multicontrast vascular MR images with NLSnake, an active contour model: In vitro...

31
26/03/13 page 1 of 31 The definitive version of the full paper is available from: http://onlinelibrary.wiley.com/doi/10.1002/mrm.10722/abstract Quantification of multi-contrast vascular MR Images with the NLSnake, an active contour model: in vitro validation and in vivo evaluation Catherine Desbleds Mansard 1 , Emmanuelle P. Canet Soulas 1 , Alfred Anwander 1 , Linda Chaabane 2 , Bruno Neyran 1 , Jean-Michel Serfaty 1 , Isabelle E. Magnin 1 , Philippe C. Douek 1 , Maciej Orkisz 1 1 CREATIS CNRS Research Unit 5515, affiliated to INSERM, Lyon, France. 2 Laboratoire RMN CNRS Research Unit 5012, Villeurbanne, France. Grant sponsors: This work has been supported by Rhone-Alpes Region project ADeMo and by Incentive Concerted Action CIVAREM. It is within the scope of scientific topics of GdR PRC ISIS. Author for correspondence: Maciej Orkisz CREATIS, INSA de Lyon, bât. Blaise Pascal 69621 Villeurbanne Cedex, France. e-mail: {maciej.orkisz,catherine.mansard}@creatis.insa-lyon.fr Fax: (33) 472438526 Phone: (33) 472438782 Short Title: Quantification of MR Images by Active Contour

Transcript of Quantification of multicontrast vascular MR images with NLSnake, an active contour model: In vitro...

26/03/13 – page 1 of 31

The definitive version of the full paper is available from:

http://onlinelibrary.wiley.com/doi/10.1002/mrm.10722/abstract

Quantification of multi-contrast vascular MR Images

with the NLSnake, an active contour model:

in vitro validation and in vivo evaluation

Catherine Desbleds Mansard 1, Emmanuelle P. Canet Soulas

1, Alfred Anwander

1, Linda

Chaabane 2, Bruno Neyran

1, Jean-Michel Serfaty

1, Isabelle E. Magnin

1, Philippe C. Douek

1,

Maciej Orkisz 1

1 CREATIS CNRS Research Unit 5515, affiliated to INSERM, Lyon, France.

2 Laboratoire RMN CNRS Research Unit 5012, Villeurbanne, France.

Grant sponsors: This work has been supported by Rhone-Alpes Region project ADeMo and by

Incentive Concerted Action CIVAREM. It is within the scope of scientific topics of GdR PRC

ISIS.

Author for correspondence: Maciej Orkisz

CREATIS, INSA de Lyon, bât. Blaise Pascal

69621 Villeurbanne Cedex, France.

e-mail: {maciej.orkisz,catherine.mansard}@creatis.insa-lyon.fr

Fax: (33) 472438526

Phone: (33) 472438782

Short Title: Quantification of MR Images by Active Contour

26/03/13 – page 2 of 31

Abstract

Vessel wall measurements from multi-contrast MRI provide information on plaque structure

and evolution. This requires an extraction of numerous contours. In this paper a contour-

extraction method is proposed, which uses an active contour model (NLSnake) adapted for a

wide range of MR vascular images. Its originality resides in length normalization for the

purpose of deformation computation. This implementation confers to the model several

interesting properties: simplified parameter tuning, fast convergence and minimum user

interaction. The model can be initialized far from the boundaries of the region to be segmented,

even by only one pixel. Accuracy and reproducibility of NLSnake endoluminal contours was

assessed on vascular phantom MR angiography and on high-resolution in vitro MR images of

rabbit aorta. In vivo evaluation was performed on rabbit and clinical data for both internal and

external vessel wall contours. In phantoms with 95% stenoses NLSnake gave 94.3 3.8% and

the accuracy was even better for milder stenoses. In rabbit aorta images variability between

NLSnake and experts was less than inter-observer variability, while maximum intra-variability

of NLSnake was equal to 1.25%. In conclusion, NLSnake was successfully applied to quantify

the vessel lumen in multi-contrast MR images using unchanged parameters.

KEY WORDS

image processing, active contour model, MR vascular images, quantification.

26/03/13 – page 3 of 31

INTRODUCTION

Lumen narrowing determined by an angiographic technique is still the reference measurement

for the evaluation of atherosclerosis. However, measurements in the vessel wall would be more

predictive. High-resolution MRI has emerged as a powerful noninvasive technique for the

evaluation of vessel wall abnormalities. Its usefulness for the in vitro and in vivo study of

plaque evolution has been demonstrated in humans and in animal models [1-7]. Multi-contrast

MRI with measurements of lumen and outer vessel wall circumferences, areas, wall thickness,

contrast and signal-to-noise ratio in the vessel wall provides information on plaque structure

and evolution [8, 9]. Up-to-now, these measurements are generally based on a manual

extraction of numerous contours, requiring at least two medical experts to preserve objectivity.

Thus, with the increasing number of MRI exams, a fast, automated post-processing algorithm is

necessary for multi-center longitudinal studies. However, there are several difficulties due to

the characteristics of the MR data. Acquisition is performed in a multi-contrast mode, i.e.

typically MR angiography (MRA), high-resolution T1, T2 and proton density with lumen blood

appearing black or white. Signal-to-noise and contrast-to-noise with the surrounding tissues

highly depend on the acquisition parameters, i.e. spatial resolution, fat saturation…, and on

vessel-wall composition. Vessel-wall signal is often heterogeneous in pathological cases. Thus,

automatic inner and outer contour detection is a challenging task. Moreover, a minimal user

interaction is required and the process should be fast and reproducible.

We propose in this article a method based on an active contour model adapted for a wide range

of MR vascular images. Active-contour models, also known as snakes [10], are the basis of

most tools currently used for a semi-automatic segmentation of medical images [11]. An active

contour is a curve evolving from an initial shape towards a final solution, under external-forces

action and internal-forces reaction. This curve is usually approximated either by a set of nodes

26/03/13 – page 4 of 31

that form the vertices of a polygon [12], or by a parametric curve described using a polynomial

(spline) function [13] or by a harmonic model [14].

The success of these models is due to their great adaptability: active contours can conform to a

large variety of shapes and they include mechanisms for interactive correction of errors.

However, the best results are obtained when the initialization is close to the actual location of

the boundaries. It is difficult to find a trade-off between quick convergence towards the final

solution, accuracy of this solution and its independence from the initialization. Hence, operator

interaction is usually required for initialization, for tuning of the model's parameters or for

corrections. In the vascular cross-sectional image analysis the interactive initialization of the

active contour is usually done either by clicking several points close to the desired boundary

[12, 15] or by manually setting the center and the radius of a circle approximating this boundary

[16]. Several attempts to the automation of the initialization process have been published. A

multi-scale scanning of the entire image in order to find the most circular shape [17] leads to

full automation but may fail when the cross-sectional shape is deformed by the pathology. A

pre-segmentation of the image, based on the Markov Random Fields theory, has also been

proposed for the initialization of an active contour [18]. The initial nodes of the active contour

can also be sought radially, as the maximum contrast points, starting from an interactively

indicated point within the vessel lumen [13, 19]. In all these developments a distinct algorithm,

more or less complicated, carries out the initialization.

We have developed an original implementation of closed active contour that starts from a single

point, without any additional initialization algorithm [20]. From the methodological point of

view, its originality resides in the length normalization of the snake when computing the

internal forces. From the point of view of medical interest, the user interaction is reduced to a

single-point initialization, while the parameters are pre-tuned and do not need to be modified

for a large variety of MR images. Another possible strategy would be to use level-sets approach

26/03/13 – page 5 of 31

[21] that is also able to make evolve active contours towards the final solution starting from a

distant initialization. However, this choice is usually done to cope with complex-topology

objects in low-noise images, while vascular cross-sectional topology is relatively simple and the

high-resolution MR images often are noisy.

In this article, a validation of our model was performed on both phantoms and in vitro vascular

MR images. NLSnake was also evaluated on various in vivo MR images from animal and

human studies.

METHODS AND MATERIALS

An active contour is a curve evolving from an initial shape towards a final solution, under

external-forces action and internal-forces reaction. The main external force attracts the curve

towards the boundaries in the image, while the internal forces tend to preserve its expected

shape. In the absence of more detailed a priori knowledge of the expected shape, the internal

forces control the continuity and the smoothness of the resulting curve. The final solution

corresponds to equilibrium between these forces, which is attained by an iterative minimization

of a weighted sum of associated potential energies.

Mathematical description of snakes

Let the active contour be expressed by the following parametric curve:

Ttsytsxts

,,,, , (1)

where t represents the time and s [0,1] is the arc-length parameter. Energy E is associated

with . This energy is a sum of an internal component intE and an external component

extE :

26/03/13 – page 6 of 31

extEEE int . (2)

The energy intE , corresponding to the internal forces, imposes constraints on the first and

second derivatives of the curve:

dss

tsds

s

tsEEE flexelastint

21

0 2

221

0

,,

, (3)

where 1,0 controls its elasticity, while 1,0 controls its flexibility. Setting a large

value of prevents excessive local elongation of the contour, while a large value of prevents

strong local curvature (it has a smoothing effect).

The potential energy )(extE corresponds to external forces. The link between potentials P

and forces is given by:

PF . (4)

There are two kinds of external forces: image force and balloon force, respectively weighted by

the coefficients gw and bw . The image force is associated with the intensity gradient by means

of the potentials Pg. The balloon force [22], associated with the potentials Pb, inflates the

contour outwards. To see the usefulness of the balloon force, let us consider an initialization

within the vessel lumen, i.e. in a uniform region. The intensity gradient is then almost zero and

so is the force supposed to attract the contour towards the boundary. Without the balloon force,

the contour would not grow, due to its internal tension force.

The external forces can be expressed as:

bbggext PwPwF , (5)

and the corresponding external energy is:

dsPwPwE bbggext 1

0 )()()( . (6)

26/03/13 – page 7 of 31

The contour moves until equilibrium is reached between the external and internal forces, i.e.

until the associated potential energy E is minimum. This equilibrium state is expressed by

the Euler-Lagrange equation:

)(2

2

2

2

extFssss

. (7)

The motion towards the energy minimum is described by the Lagrange equation:

)(2

2

2

2

2

2

extFsssstt

. (8)

The physical meaning of is the mass density of the contour, while the damping parameter

represents the viscosity of the environment. In practice however, these are two adjustable

parameters of the model, as well as , , wb and wg. To simplify the behavior of the model is

generally set equal to zero.

For the sake of computations, the model has to be discretized. This leads to representing the

contour by a set of N points ),( ki (nodes), parameterized by an arc-length parameter i (i = 1,

2… N) and by a time parameter k (iteration index). To this purpose, the partial spatial

derivatives in the equations (3), (7) and (8) are approximated by finite differences:

khkikis

2/,1,1

, (9)

where hk is the distance between nodes, called spatial discretization step. Spatial and temporal

discretization of the equation (8) leads to an iterative shifting of the nodes, according to the

following evolution equation:

1,1,),(1

kiFkiki ext AI . (10)

This equation corresponds to = 0. The matrix A is a discretized formulation of the internal

forces. Note that the damping parameter controls the magnitude of the deformations (shift per

iteration).

26/03/13 – page 8 of 31

The discretization step hk within the matrix A depends on the number of snake points N and,

initially, is equal to the distance between the snake points. The evolution equation (10) is only

valid if the snake points are equally spaced and the step hk is unchanged. However, after each

iteration the snake length grows due to the external forces, and hk does not correspond to the

real distance between the snake points. The internal energy, especially the term elastE

associated with the contour's tension, grows with the snake's length and can stop the snake

before the boundary is reached. This is particularly apparent if the initialization is far from the

final position. In this case, the model needs to be resampled with a new (larger) number of

snake points N, or/and with a new step hk+1. The N × N matrices, AI and its inverse, have

to be recomputed, which is a time-consuming task. The number of these computations can be

significantly reduced when using a modified version of the evolution equation (10) with a

careful implementation that avoids numerical instability [23] .

Originality of the NLSnake

The originality of our implementation resides in:

1) initializing the model with a single pixel and

2) in computing the deformations on a normalized-length copy 1,' ki of the actual

contour (fig. 1):

1/1,1,' khkiki . (11)

The nodes are initially distributed in equal distances on the perimeter of a small circle (diameter

= 1 pixel) around the initialization point. Note that one can have many nodes within a single

pixel, as their locations are real numbers, while the pixels' locations are integers. The

deformations are then computed on the normalized-length copy of the contour, according to the

following equation:

26/03/13 – page 9 of 31

Figure 1: One iteration of the NLSnake deformation. Step (I): normalization of

the current contour (k-1) to '(k-1). Step (II): deformation of the normalized

contour. Step (III): addition of the deformation (k) to obtain the updated

contour (k).

)1,('1,1,'),(1

kikiFkiki ext AI .

(12)

These deformations are applied directly to the actual contour 1, ki :

kikiki ,1,, . (13)

After the deformation, the nodes are evenly redistributed along the contour in order to ensure a

spatially constant discretization step hk. Note that the matrix A is computed with a normalized

discretization step h = 1. The normalization process only changes the length of the contour for

the computation of the internal energy, while the external forces remain unchanged. The

number of nodes N has to be large enough to permit a good approximation of the largest

26/03/13 – page 10 of 31

contours in the image series. In our experimentation, N was set equal to 20 and never changed.

Unlike the existing implementations, the NLSnake keeps the number of nodes constant from

one iteration to another, despite the growth of the actual contour ki, . Therefore, the N N

matrices, AI and its inverse, are computed only once, thus making the entire process very

fast. Indeed, as the discretization step of the normalized-length contour ki,' is spatially and

temporally constant (h = 1), the evolution equation (12) remains valid and the re-discretization

is not required.

Application to vessel-wall contour extraction

The above-described NLSnake model is first used to extract the endoluminal contour. The

initialization is interactive: the user clicks a point within the vessel lumen. Once the NLSnake

has converged to the inner vessel-wall boundary it is stored, and then it can be pushed outwards

by one pixel so as to initialize the outer-contour search. To avoid collapsing towards the

endoluminal contour, the inwards-directed displacements are inhibited and the balloon force

coefficient is increased. Thus the model only grows until it reaches the outer boundary of the

vessel wall. The model parameters were empirically pre-tuned, i.e. the values that had given the

best results on a training set of images were kept unchanged during all the hereafter described

experimentation on multi-contrast images: = 0.058, 0.02, 0.03, wg 0.4, wb 0.020

for the endoluminal contour and wb 0.025 for the outer contour. The gradient intensity was

calculated by simple finite difference.

Phantom data

Vascular phantoms were manufactured using Computer Assisted Design [24]. They represent

the endoluminal shape of vascular segments. Each of them has a reference diameter of 6 mm

and comprises two stenoses with different shapes (circular, elliptic, semi-lunar, concentric or

eccentric) and severities (50%, 75% and 95% of area reduction) [25].

26/03/13 – page 11 of 31

During image acquisition the phantoms were filled with a dilution of Gadolinium [26]

corresponding to the arterial peak after intra-vascular injection of 0.1 mmol/kg GdDOTA

(DOTAREM, Guerbet, France). CE MRA images of phantoms were acquired on a clinical

MRI system (1.5 T, Vision, Siemens, Erlangen Germany) using a body coil and 3D Gradient

Echo FISP (Fast Imaging with Steady state Precession) sequence used with two different sets of

acquisition parameters (TR/TE 5 ms/2.1 ms, resolution: 0.780.781 mm3) and (TR/TE:

4.4 ms/1.4 ms, resolution: 0.780.780.75 mm3).

Animal Data

A group of watanabe heritable hyperlipidaemic (WHHL) rabbits underwent a comparative

study of atherosclerotic-plaque evolution with and without lipid-rich diet [27]. High-resolution

MR images of the thoracic aorta were first acquired in vivo. Animals were then sacrificed and

their entire aorta, heart and kidneys were removed after fixation under perfusion with

paraformaldehyde. Before proceeding to histological preparation, in vitro high-resolution MRI

was performed. This study complied with our institutional guidelines for the care and use of

laboratory animals.

In vivo high-resolution MR images of the thoracic aorta were acquired on a clinical MRI

system (1.5 T, Vision, Siemens, Erlangen Germany). T1 weighted MR images were obtained

with a 2D spin-echo sequence (TR/TE=855 ms/20 ms) and a spatial resolution of

0.20.22 mm3. T2 and proton density images were acquired with a fast 2D spin-echo sequence

with TR/TE=2500 ms/54 ms and TR/TE=2500 ms/15 ms, respectively, with an in plane spatial

resolution of 390 m and 310 µm, respectively, and with a slice thickness of 2 mm. All MR

images were acquired with fat saturation and ECG triggering.

In vitro high-resolution MR imaging of the aorta was performed on a research MRI system

(2 T, Oxford magnet, MRRS console). T1 and T2 weighted images were acquired with a multi-

slice 2D spin-echo sequence with TR/TE: 600ms/21ms and 1800 ms/50 ms, respectively. In

26/03/13 – page 12 of 31

both cases, the spatial resolution was from 78 to 97m and the slice thickness varied from 0.8

to 1 mm, depending on the arterial wall size.

Human Data

Human data were drawn from a multi-center (10 hospital centers in France) clinical trial

CARMEDAS [28] (supported by a grant of the French Public Health Ministry), aiming at the

definition of the best cost-effective diagnostic strategy for the assessment of symptomatic and

asymptomatic carotid stenoses. The main inclusion criterion is a significant stenosis in

Doppler-ultrasound (greater than 50 % for symptomatic patients and greater than 60 % for

asymptomatic patients). In all patients CE MRA and high-resolution MRI are performed.

Data analysis

Data analysis was first carried out on cross-sectional endoluminal contour area and shape in

MRA images of phantoms and on 46 T2 in vitro high-resolution MR images of rabbit aorta.

Then both internal and external vessel wall contours were evaluated on in vivo data. On animal

in vivo data we quantitatively evaluated the endoluminal area and vessel-wall thickness. Human

data were assessed qualitatively, by visual inspection, as a preliminary step towards a thorough

evaluation.

Accuracy and reproducibility

Phantom data

Accuracy of the automatically extracted contours was assessed by comparing their actual

endoluminal diameter with the diameters measured in the reference sections (fig. 2) and by

comparing theoretical and measured stenosis degrees of each phantom. The reproducibility was

evaluated by measuring the endoluminal diameter variations within the reference sections. As

all the reference sections have the same diameter 6 mm), the accuracy and reproducibility of the

diameter measurements were evaluated simultaneously (mean, standard deviation and

maximum difference).

26/03/13 – page 13 of 31

Figure 2: Reference and minimum cross-sections for stenosis quantification.

The stenosis severity was computed as the following ratio, involving the minimum cross-

sectional area minS and the average of the measured reference areas referenceS (fig. 2):

%100%reference

minreference

S

SSS .

(14)

Animal data

Accuracy of the automatically extracted contours on the animal data was assessed by comparing

them with manually traced contours (as done by [16]). Two experts did the manual tracing in a

blinded manner. To simultaneously capture the reproducibility the automatic extraction was run

three times with varying initialization. Both experts carried out the manual tracing twice with at

least one-week delay. Agreement of the endoluminal contour shape was assessed on in vitro

images by measuring distances between automatic and manual contours. The distances were

measured radially, starting from each point of the NLSnake. The vessel-wall thickness was

evaluated on in vivo data. We compared the average thickness calculated in 8 sectors defined

starting from the endoluminal contour gravity center and from the sagittal orientation (fig. 7).

Statistical Analysis

To study the agreement of the area difference between manual tracing and the NLSnake, the

statistical method described by Bland and Altman [29] has been used. The results calculated by

26/03/13 – page 14 of 31

the Bland and Altman method are the mean difference, the standard deviation of the difference

and the 95% confidence interval. The normal distribution of the data was verified.

Operating and processing time

The operating time was compared with that needed by the experts for manual tracing of the

contours on the same computer and for the same data set. It included interaction time, clicking

in the vessel lumen (NLSnake initialization) or contour tracing, but also (in both scenarios)

image loading from disk. The processing time was evaluated by an empirical comparison, on

the same computer and for the same data, between the computational time of NLSnake and of a

conventional snake with re-discretization followed by a numerical inversion of the system

matrix at each iteration.

RESULTS

Phantom data

An example of NLSnake segmentation and quantification is shown in figure 3. The diameter of

reference sections (6 mm, i.e. reference area of 28.27 mm²), measured by NLSnake, was equal

to 6.01 0.10 mm (n = 144 slices). The maximum difference between the true and measured

diameters was equal to 0.22 mm, i.e. 3.7 % of the true diameter. This difference represents 0.28

pixel compared to the image resolution.

The results of stenosis quantification are displayed in figure 4. The absolute difference between

the true and estimated stenosis degrees was less than 2% on average and the maximum

difference was equal to 6.4%. The largest errors occurred for the most severe (95%) stenoses

where the diameter was less than one pixel.

26/03/13 – page 15 of 31

a)

b)

c)

Figure 3: Segmentation/quantification of an MRA image of a phantom with two 95%

stenoses: translucent rendering of the phantom with rings corresponding to the extracted

contours (a), example of a contour extracted in a reference slice with automatically

detected maximum and minimum diameter (b), resulting quantification curves (c) with

abscissa representing the arc-length and two ordinate scales: area (left) and stenosis

percentage (right).

26/03/13 – page 16 of 31

Figure 4: Results (mean and standard deviation) of stenosis quantification in phantoms,

represented separately for three different stenosis degrees (50, 75 and 95%). The central

box represents the values from the lower to upper quartile (25 to 75 percentile). The

middle line represents the median. The horizontal lines represent the minimum and the

maximum values.

In vitro animal data

Examples of NLSnake contours superimposed onto in vitro images are displayed in figure 5.

The inter-variability of area measurements between the experts was equal to 5.56% (n = 46

slices), while the intra-variability was equal to 2.30% and to 6.41% for experts 1 and 2

respectively. The Bland and Altman test was performed using the measurements done by the

expert having the smallest intra-variability (fig.6). These results show a good agreement

between the NLSnake measurement and the manual tracing (mean difference: 0.065 mm², 95%

confidence interval: from -0.25 to 0.12 mm², agreement interval: from -1.26 to 1.13 mm²). The

reproducibility of NLSnake is expressed through its intra-variability: 1.23%.

26/03/13 – page 17 of 31

a)

b)

c)

d)

e)

f)

Figure 5: Examples of contours extracted with NLSnake in high resolution MR in vitro

T2-weighted images of rabbit aorta for various signal-to-noise levels (a = 8.15, b = 8.05, c

= 6.44, d = 6.00, e = 5.76, f = 3.71) and lumen-shape complexities

26/03/13 – page 18 of 31

Figure 6: Results of the Bland and Altman test between the Expert1 and NLSnake on

endoluminal contours area (mm2) of 46 in vitro slices.

The average distance between NLSnake and the contours traced by the expert was equal to 0.67

0.64 pixels (n = 920 points). The largest distance was equal to 4.7 pixels, which corresponds

to 272 m.

In vivo data

Examples of internal and external NLSnake contours superimposed onto in vivo images of

rabbit aorta are shown in figure 7. The inter-variability and the intra-variability of the two

criteria on T2-weighted images (n = 20 slices) are presented in table 1. The Bland and Altman

test (fig.8) on endoluminal area measured by the expert with the smallest intra-variability shows

a good agreement between the NLSnake measure and the manual tracing (mean difference:

0.187 mm², 95% confidence interval: from –0.62 to 0.99 mm², agreement interval: from –3.6 to

3.2 mm²). The reproducibility of NLSnake is expressed through its intra-variability: 1.25%.

26/03/13 – page 19 of 31

a) b) c)

d)

Figure 7: NLSnake applied to internal contour (plain line) and external contour (dots)

extraction in multi-contrast in vivo images of a rabbit aorta:

a) T1, SNR = 3.01 b) T2, SNR = 3.63, c) proton-density, SNR = 2.83, d) sectors used for

local measurements, superimposed onto a T2 image, SNR = 3.55.

Figure 9 shows typical results obtained on a human data set: CE MRA and high-resolution

MRI.

Operating Time

For 15 in vitro images (slices) from a single vascular segment the operating time of the

NLSnake (endoluminal contour) extraction was 30 seconds, compared to 20 minutes required

by the manual tracing. Figure 10 illustrates an empirical comparison, on the same computer,

between the computational time of the NLSnake and of a conventional snake.

26/03/13 – page 20 of 31

Figure 8: Results of the Bland and Altman test between the Expert1 and NLSnake on

endoluminal contours area (mm2) of 20 in vivo high resolution MR images of rabbit aorta.

Table 1: Intra- and inter-variability on T2-weighted in vivo images (n = 20 slices).

Criteria Intra-

variability

Expert1

Intra-

variability

Expert 2

Intra-

variability

NLSnake

Inter-

variability

Experts

Inter-

varibility

Expert-

NLSnake

Endoluminal area 4.5% 9.26% 1,25% 11.3% 5.52%

Sectorial vessel wall

thickness

38.5% 41.44% 26.7% 47.2% 36.3%

26/03/13 – page 21 of 31

a)

b)

c)

Figure 9: NLSnake applied to a human data set: a) – b) surface-rendered MRA image of a

patient's carotid artery with rings corresponding to the extracted contours and the

resulting stenosis quantification curves with abscissa scaled in mm and two ordinate

scales: area in mm² (left) and stenosis percentage (right), c) high resolution MR T2

weighted in vivo image of a patient's carotid artery (internal and external boundaries

extracted by NLSnake), SNR = 4.26.

DISCUSSION

An active contour model (NLSnake) was implemented for the purpose of semi-automatic

segmentation of vascular MR images. It was validated on endoluminal boundary segmentation

in MRA images of phantoms and in high-resolution MR T2-weighted in vitro images of rabbit

26/03/13 – page 22 of 31

aorta. It was further evaluated on internal and external vessel-wall boundary extraction in multi-

contrast in vivo images of rabbit aorta and of human carotid arteries.

An automated segmentation tool is useful if the results are reproducible, accurate and available

more quickly than with an interactive tool. NLSnake demonstrated its reproducibility in two

ways: 1) its intra-variability with different initializations was significantly lower than the

experts’ intra-variability, 2) cross-sectional area measurements along the reference sections

(constant diameter) of the phantoms were very stable. As for the accuracy, variations between

areas measured with NLSnake and those measured by the experts were not larger than the

variations between the experts. Differences between measurements with NLSnake and true

dimensions of the phantoms were significantly smaller than the variations between NLSnake

and the experts in high-resolution MR vascular images. This can be explained both by a better

contrast-to-noise ratio in the MRA images and by the variability of the experts on high-

resolution MRI. In particular, detection of the outer vessel wall boundary on in vivo high-

resolution MRI is difficult due to local absence of contrast and to low signal-to-noise ratio. This

partly explains the large variability of wall thickness measurements. Furthermore, this thickness

typically corresponds to 3 or 4 pixels, i.e. placing the contour at one-pixel distance inside or

beyond the actual boundary, all along its circumference, leads to 25% error, at least.

There are two timesaving mechanisms, when using NLSnake: reduction of user interaction and

fast convergence of the algorithm. Typical interaction scenario of active-contour initialization

consists of several mouse-clicks that roughly place the snake's nodes along the boundary to be

extracted. Obviously, a single click within the vessel lumen is faster than manual tracing, even

approximate, of an entire contour. Further reduction of the interaction is achieved by using the

current contour's center to initialize the contours in the neighboring slices and so on. In some

existing general-purpose software tools the snakes in the neighboring slices are initialized by

the final contour from the current slice. However, for oblique vessels, the contour location from

26/03/13 – page 23 of 31

one slice to another may significantly vary in the context of typical vascular high-resolution

MRI, where the slice thickness is not negligible compared to the vessel diameter. Nevertheless,

the projection of the current contour center usually remains within the lumen boundaries in the

neighboring slices and NLSnake is able to correctly expand from this point to the actual

boundary. Furthermore, the timesaving increases significantly with the length of the vessel

(number of slices) to be segmented, e.g. for a sequence of 15 slices, interaction and

computation time with NLSnake has been 40 times shorter (30 seconds) than with manual

tracing (20 minutes).

Figure 10: Comparison of the computational time (on a PC Pentium III 600 MHz,

Windows NT) between NLSnake deformation and a conventional implementation of

active contour (with re-computation of the matrix AI and of its inverse at each re-

discretization)

26/03/13 – page 24 of 31

Computational time is negligible, compared to the interaction time. Nevertheless, it is to be

mentioned that NLSnake converges faster than the conventional implementations of snakes and

the gain quickly increases with the initial number of nodes (fig.10). Indeed, without length-

normalization, the snake has to be frequently re-discretized during its growth, as the evolution

equation (10) only holds when the discretization step h is constant. The system matrices

AI and its inverse, have to be re-computed when the number of nodes is changed.

Difficulty in using active contour models resides in the choice of weighting coefficient values

, , wb and wg of each part of the energy (3), (6). In conventional implementations of the

snakes this choice is particularly difficult for the energy parts associated with two opposed

forces: tension and balloon force, as these energies respectively depend on the snake length and

number of nodes. In large cross-sections the contour growth may be stopped before reaching the

boundary if the balloon coefficient is not large enough. Indeed, equilibrium between the balloon

force and the internal tension is then reached too early. Conversely, in a small cross-section, the

balloon force may blow the contour beyond the boundary, if its coefficient is too large. The

damping factor has also to be appropriately chosen according to the current discretization, as

its value determines the growth speed of the contour (shift per iteration). It should make fast

convergence possible but avoid stepping over the boundary (if the shift per iteration is too

large). With NLSnake the number of nodes and the contour length that is used to compute the

evolution are constant. Therefore, it is easier to set the coefficients. In particular, the damping

factor can be chosen so that the shift magnitude is approximately one pixel per iteration.

Consequently, the same set of experimentally determined parameters was successfully used for

vessel wall boundaries segmentation in various dark blood and white blood images such as

MRA and multi-contrast high-resolution MRI (T1, T2, proton density) in vitro and in vivo, in

animals and in humans.

26/03/13 – page 25 of 31

Our objective is the extraction of both boundaries, internal and external, of the vascular wall in

high-resolution MRI. Two interdependent NLSnakes are used. The internal boundary usually

has better contrast, hence it is extracted at first. It is then used to initialize the external contour.

The resulting segmentation (fig. 7) gives access to local thickness measurements and is a

prerequisite for automated studies of plaque composition [8, 15, 16]. However, reliability of the

external-boundary extraction is limited by local absence of contrast and by the low signal-to-

noise ratio of the vessel wall in vivo. This is confirmed by the large variability of the vessel wall

external boundary tracing done by the experts. Consequently, although the pre-tuned model

parameters give satisfactory results for the endoluminal boundary in a wide range of images it

may be useful to seek a specific set of model parameters adapted to the external boundary.

Furthermore, in the cases where only a small part of the boundary is contrasted, an application-

specific growth-stopping criterion is to be found in order to replace the gradient-based boundary

detection criterion.

CONCLUSION

We have developed a tool for the extraction of vessel wall boundaries from MR images, based

on an original implementation of active contour model (NLSnake). One of the interesting

aspects of this tool is minimum user-interaction. The contour-length normalization process used

for the computation of the active-contour forces makes the model easier to use. NLSnake can

therefore be used in a wide variety of images (MRA, multi-contrast high-resolution MRI with

various spatial resolutions and SNR) with a fixed parameter set. Furthermore, initialization by a

single pixel is highly timesaving in the context of blood-vessel segmentation and quantification,

where large series of planar images along the vessels are involved. Although the model is

initialized far from the final solution, the results are reproducible and accurate. However, the

accuracy of the outer boundary extraction decreases in very noisy images of small arteries. The

26/03/13 – page 26 of 31

extraction of the vessel-wall boundaries is the first step towards an analysis of its composition

from multi-contrast and dynamic contrast high-resolution MRI. Reliability of the outer

boundary detection could be improved by finding a specific parameter set or a specific edge-

detection criterion better suited to the external boundaries. Another strategy will also be

considered, which simultaneously exploits all the available multi-contrast images of the same

slice, provided that registration of these images can previously be carried out.

REFERENCES

[1] C. Yuan, S.-X. Zhang, N. L. Polissar, D. Echelard, G. Ortiz, J. W. Davis, E. Ellington,

M. S. Ferguson, and T. S. Hatsukami, “Identification of fibrous cap rupture with

Magnetic Resonance Imaging is highly associated with recent transient ischemic attack

or stroke,” Circulation, vol. 105, pp. 181-185, 2002.

[2] R. Corti, V. Fuster, Z. A. Fayad, S. G. Worthley, G. Helft, D. Smith, J. Weinberger, J.

Wentzel, G. Mizsei, M. Mercuri, and J. J. Badimon, “Lipid lowering by simvastatin

induces regression of human atherosclerotic lesions: two years' follow-up by High-

Resolution noninvasive Magnetic Resonance Imaging,” Circulation, vol. 106, pp. 2884-

2887, 2002.

[3] W. Y. Kim, M. Stuber, P. Bornert, K. V. Kissinger, W. J. Manning, and R. M. Botnar,

“Three-dimensional black-blood cardiac Magnetic Resonance coronary vessel wall

imaging detects positive arterial remodeling in patients with nonsignificant coronary

artery disease,” Circulation, vol. 106, pp. 296-299, 2002.

[4] C. M. Kramer, “Magnetic resonance imaging to identify the high-risk plaque,” Am J

Cardiol, vol. 90, pp. L15-L17, 2002.

26/03/13 – page 27 of 31

[5] J. M. Serfaty, L. Chaabane, A. Tabib, J. M. Chevallier, A. Briguet, and P. C. Douek,

“Atherosclerotic plaques: classification and characterization with T2-weighted high-

spatial-resolution MR Imaging - an in vitro study,” Radiology, vol. 219, pp. 403-410,

2001.

[6] L. Chaabane, E. Canet Soulas, F. Contard, A. Salah, D. Guerrier, and P. C. Douek,

“High Resolution Magnetic Resonance imaginig at 2T: potential for artherosclerotic

lesions exploration in the apolipoprotein E-knockout mouse,” Invest Radiol, 2003.

[7] B. D. Coombs, J. H. Rapp, P. C. Ursell, L. M. Reilly, and D. Saloner, “Structure of

plaque at carotid bifurcation. High resolution MRI with histological correlation,” Stroke,

vol. 32, pp. 2516-2521, 2001.

[8] X. Kang, N. L. Polissar, C. Han, E. Lin, and C. Yuan, “Analysis of the measurement

precision of arterial lumen and wall areas using high-resolution MRI,” Magn Reson

Med, vol. 44, pp. 968-972, 2000.

[9] D. Xu, J.-N. Hwang, and C. Yuan, “Atherosclerotic plaque segmentation at human

carotid artery based on multiple contrast weighting MR images,” presented at Int. Conf.

Image Processing, 2001.

[10] M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active Contour Models,” Int J

Comput Vision, vol. 1, pp. 321-331, 1987.

[11] T. McInerney and D. Terzopoulos, “Deformable models in medical image analysis: a

survey,” Med Image Analysis, vol. 1, pp. 91-108, 1996.

[12] J. Thomas, B. Rutt, H. Ladak, and D. Steinman, “Effect of black blood MR image

quality on vessel wall segmentation,” Magn Reson Med, vol. 46, pp. 299-304, 2001.

[13] A. Sebbahi, A. Herment, A. de Cesare, and E. Mousseaux, “Multimodality

cardiovascular image segmentation using a deformable contour model,” Comput Med

Imaging Graph, vol. 21, pp. 79-89, 1997.

26/03/13 – page 28 of 31

[14] L. H. Staib and J. S. Duncan, “Boundary finding with parametrically deformable

models,” IEEE Pattern Analysis Machine Intell., vol. 14, pp. 1061-1075, 1992.

[15] S. Zhang, T. S. Hatsukami, N. L. Polissar, C. Han, and C. Yuan, “Comparison of carotid

vessel wall area measurements using three different contrast-weighted black blood MR

imaging techniques,” Magn Reson Imaging, vol. 19, pp. 795-802, 2001.

[16] C. Yuan, E. Lin, J. Millard, and J.-N. Hwang, “Closed contour edge detection of blood

vessel lumen and outer wall boundaries in black-blood MR images,” Magn Reson

Imaging, vol. 17, pp. 257-266, 1999.

[17] D. Rueckert, P. Burger, S. M. Forbat, R. D. Mohiaddin, and G. Z. Yang, “Automatic

tracking of the aorta in cardiovascular MR images using deformable models,” IEEE

Trans. Med. Imaging, vol. 16, pp. 581-590, 1997.

[18] W. Kerwin, C. Han, B. Chu, D. Xu, Y. Luo, J.-N. Hwang, T. Hatsukami, and C. Yuan,

“A quantitative vascular analysis system for evaluation of atherosclerosis lesions by

MRI,” presented at MICCAI, Utrecht (NL), 2001.

[19] S. Kozerke, R. Botnar, S. Oyre, M. Scheidegger, E. Pedersen, and P. Boesiger,

“Automatic vessel segmentation using active contours in cine phase contrast flow

measurements,” J Magn Reson Imaging, vol. 10, pp. 41-51, 1999.

[20] C. Desbleds-Mansard, A. Anwander, L. Chaabane, M. Orkisz, B. Neyran, P. C. Douek,

and I. E. Magnin, “Size independent active contour model for blood vessel lumen

quantification in High-Resolution Magnetic Resonance Images,” presented at MICCAI,

Utrecht (NL), 2001.

[21] K. C. Wang, R. W. Dutton, and C. A. Taylor, “Level sets for vascular model

construction in computational hemodynamics,” IEEE Engineering in Med and Biol, vol.

18, pp. 33-39, 1999.

26/03/13 – page 29 of 31

[22] L. D. Cohen, “On active contour models and balloons,” Comput Vision Graphics Image

Process: Image Understand, vol. 53, pp. 211-218, 1991.

[23] N. Ray, B. Chanda, and J. Das, “A fast and flexible multiresolution snake with a definite

termination criterion,” Pattern Recogn, vol. 34, pp. 1483-1490, 2001.

[24] C. P. Renaudin, B. Barbier, R. Roriz, D. Revel, and M. Amiel, “Coronary arteries: new

design for three-dimensional arterial phantom,” Radiology, vol. 190, pp. 579-582, 1994.

[25] M. Hernández-Hoyos, M. Orkisz, P. Puech, C. Mansard-Desbleds, P. C. Douek, and M.

I.E., “Computer assisted analysis of three-dimensional MR angiograms,”

RadioGraphics, vol. 22, pp. 421-436, 2002.

[26] B. Marchand, P. C. Douek, P. Robert, C. Corot, J. P. Roux, P. Adeleine, M. Hernández-

Hoyos, Y. Crémillieux, M. Orkisz, and E. Canet, “Standardized MR protocol for the

evaluation of MRA sequences and/or contrast agents effects in high-degree arterial

stenosis analysis,” MAGMA, vol. 14, pp. 259-267, 2002.

[27] L. Chaabane, F. Contard, P. C. Douek, C. Corot, D. Guerrier, A. Briguet, and E. Canet,

“MR contrast-enhancement of atherosclerotic plaque in watanabe rabbits: effects of a

lipid-rich diet,” presented at ISMRM 10th Scientific Meeting, Honolulu, Hawaii, USA,

2002.

[28] M. Nonent, J.-M. Serfaty, C. Pachai, J. Linard, A. Pasco-Papon, J.-F. Heautot, Y. Le

Bras, I. Jars, V. Buthion, M. Lamure, and P. Douek, “Intermediate results of the

CARMEDAS Multicenter study: Comparison of different imaging strategies for the

diagnosis of carotid artery stenosis,” presented at XIV Annual International Workshop

on MR Angiography, Essen, Germany, 2002.

[29] J. Bland and D. Altman, “Statistical method for assessing agreement between two

methods of clinical measurement,” The Lancet, vol. I, pp. 307-310, 1986.

26/03/13 – page 30 of 31

Figure captions

Figure 11: One iteration of the NLSnake deformation. Step (I): normalization of the current

contour (k-1) to '(k-1). Step (II): deformation of the normalized contour. Step (III): addition

of the deformation (k) to obtain the updated contour (k).

Figure 12: Reference and minimum cross-sections for stenosis quantification.

Figure 13: Segmentation/quantification of an MRA image of a phantom with two 95%

stenoses: translucent rendering of the phantom with rings corresponding to the extracted

contours (a), example of a contour extracted in a reference slice with automatically detected

maximum and minimum diameter (b), resulting quantification curves (c) with abscissa

representing the arc-length and two ordinate scales: area (left) and stenosis percentage (right).

Figure 14: Results (mean and standard deviation) of stenosis quantification in phantoms,

represented separately for three different stenosis degrees (50, 75 and 95%). The central box

represents the values from the lower to upper quartile (25 to 75 percentile). The middle line

represents the median. The horizontal lines represent the minimum and the maximum values.

Figure 15: Examples of contours extracted with NLSnake in high resolution MR in vitro T2-

weighted images of rabbit aorta for various signal-to-noise levels (a = 8.15, b = 8.05, c = 6.44, d

= 6.00, e = 5.76, f = 3.71) and lumen-shape complexities

Figure 16: Results of the Bland and Altman test between the Expert1 and NLSnake on

endoluminal contours area (mm2) of 46 in vitro slices.

Figure 17: NLSnake applied to internal contour (plain line) and external contour (dots)

extraction in multi-contrast in vivo images of a rabbit aorta: a) T1, SNR = 3.01 b) T2, SNR =

3.63, c) proton-density, SNR = 2.83, d) sectors used for local measurements, superimposed

onto a T2 image, SNR = 3.55.

Figure 18: Results of the Bland and Altman test between the Expert1 and NLSnake on

endoluminal contours area (mm2) of 20 in vivo high resolution MR images of rabbit aorta.

26/03/13 – page 31 of 31

Figure 19: NLSnake applied to a human data set: a) – b) surface-rendered MRA image of a

patient's carotid artery with rings corresponding to the extracted contours and the resulting

stenosis quantification curves with abscissa scaled in mm and two ordinate scales: area in mm²

(left) and stenosis percentage (right), c) high resolution MR T2 weighted in vivo image of a

patient's carotid artery (internal and external boundaries extracted by NLSnake), SNR = 4.26.

Figure 20: Comparison of the computational time (on a PC Pentium III 600 MHz, Windows

NT) between NLSnake deformation and a conventional implementation of active contour (with

re-computation of the matrix AI and of its inverse at each re-discretization)

Table 1: Intra- and inter-variability on T2-weighted in vivo images (n = 20 slices).