Research - Diagnostic Pathology

25
Research Automatic quantifica slide images, applied C. Deroulers 1* , V. Dangouloff- Affiliation: 1 - Univ Paris Diderot, Laboratoir 2 - Department of Paediatric Rad 3 - INSERM U1000, Paris, France 4 - Univ Paris Descartes, Paris, Fr 5 - Department of Neuropatholo 6 -UMR 1163, Institut Imagine, P * - corresponding author: derou Abstract Background: Angiogenesis i treatment in brain tumours quantitative assessment can vascular endothelial cells. But the computer since digitised around ten gigapixels. Methods: We define and imp objective magnification 40×, large puddles of red blood ce WSI. Then it calibrates automatica walls and of the counterstain free tissue, and finds the ves from the colour deconvolut thresholds involved are autom staining and digitisation param C. Deroulers et al., diagnosti DOI: http://dx.doi.org/10.17629/www.diagnosticp ation of the microvascular densit to paediatric brain tumours -Ros 2, 3 , M. Badoual 1 , P. Varlet 3, 4, 5 , N. Boddaert 2, 3 re IMNC, UMR 8165 CNRS, Univ Paris-Sud, F-91405 Or diology, Hôpital Necker Enfants Malades, AP-HP, 7510 e; rance; ogy, Centre Hospitalier Sainte-Anne, Paris, France; Paris, France. [email protected] is a key phenomenon for tumour progressio s and more generally in oncology. Presently, i only be done on whole tissue sections immuno t this is a tremendous task for the pathologist an whole tissue sections, whole slide images (WSI) plement an algorithm that determines automati the regions of tissue, the regions without blur a ells, and constructs the mask of blur-free, signific ally the optical density ratios of the immunostai ning, performs a colour deconvolution inside th ssel walls inside these regions by selecting, on th tion, zones which satisfy a double-threshold cr matically computed from the WSI so as to cope meters. A mask of vessel wall regions on the WSI tic pathology 2016, 2:209 ISSN 2364-4893 pathology.eu-2016-2:209 1 ty on whole 3, 4, 6 rsay, France; 05 Paris, France; on, diagnosis and its precise, direct ostained to reveal nd a challenge for ), contain typically ically, on a WSI at and the regions of cant tissue on the ining of the vessel he regions of blur- he image resulting riterion. The two with variations in I is produced.

Transcript of Research - Diagnostic Pathology

Research

Automatic quantification of the microvascular density on whole

slide images applied to paediatric brain tumours

C Deroulers1 V Dangouloff-

Affiliation

1 - Univ Paris Diderot Laboratoire IMNC UMR 8165 CNRS Univ Paris

2 - Department of Paediatric Radiology Hocircpital Necker Enfants Malades AP

3 - INSERM U1000 Paris France

4 - Univ Paris Descartes Paris France

5 - Department of Neuropathology Centre Hospitalier Sainte

6 -UMR 1163 Institut Imagine Paris France

- corresponding author deroulersimncin2p3fr

Abstract

Background Angiogenesis is a key phenomenon for tumour progression diagnosis and

treatment in brain tumours and more generally in oncology Presently its precise direct

quantitative assessment can only be done on whole tissue sections immunostained to

vascular endothelial cells But this is a tremendous task for the pathologist and a challenge for

the computer since digitised whole tissue sections whole slide images (WSI) contain typically

around ten gigapixels

Methods We define and implement

objective magnification 40times the regions of tissue the regions without blur and the regions of

large puddles of red blood cells and constructs the mask of blur

WSI

Then it calibrates automatically the optical density ratios of the immunostaining of the vessel

walls and of the counterstaining performs a colour deconvolution inside the regions of blur

free tissue and finds the vessel walls inside these regions by sel

from the colour deconvolution zones which satisfy a double

thresholds involved are automatically computed from the WSI so as to cope with variations in

staining and digitisation parameters A mas

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Automatic quantification of the microvascular density on whole

slide images applied to paediatric brain tumours

-Ros2 3 M Badoual1 P Varlet3 4 5 N Boddaert2 3 4 6

Univ Paris Diderot Laboratoire IMNC UMR 8165 CNRS Univ Paris-Sud F-91405 Orsay France

Department of Paediatric Radiology Hocircpital Necker Enfants Malades AP-HP 75105 Paris France

U1000 Paris France

Univ Paris Descartes Paris France

Department of Neuropathology Centre Hospitalier Sainte-Anne Paris France

Institut Imagine Paris France

deroulersimncin2p3fr

Angiogenesis is a key phenomenon for tumour progression diagnosis and

treatment in brain tumours and more generally in oncology Presently its precise direct

quantitative assessment can only be done on whole tissue sections immunostained to

vascular endothelial cells But this is a tremendous task for the pathologist and a challenge for

the computer since digitised whole tissue sections whole slide images (WSI) contain typically

We define and implement an algorithm that determines automatically on a WSI at

objective magnification 40times the regions of tissue the regions without blur and the regions of

large puddles of red blood cells and constructs the mask of blur-free significant tissue on the

Then it calibrates automatically the optical density ratios of the immunostaining of the vessel

walls and of the counterstaining performs a colour deconvolution inside the regions of blur

free tissue and finds the vessel walls inside these regions by selecting on the image resulting

from the colour deconvolution zones which satisfy a double-threshold criterion The two

thresholds involved are automatically computed from the WSI so as to cope with variations in

staining and digitisation parameters A mask of vessel wall regions on the WSI is produced

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

1

Automatic quantification of the microvascular density on whole

 3 4 6

91405 Orsay France

HP 75105 Paris France

Angiogenesis is a key phenomenon for tumour progression diagnosis and

treatment in brain tumours and more generally in oncology Presently its precise direct

quantitative assessment can only be done on whole tissue sections immunostained to reveal

vascular endothelial cells But this is a tremendous task for the pathologist and a challenge for

the computer since digitised whole tissue sections whole slide images (WSI) contain typically

an algorithm that determines automatically on a WSI at

objective magnification 40times the regions of tissue the regions without blur and the regions of

free significant tissue on the

Then it calibrates automatically the optical density ratios of the immunostaining of the vessel

walls and of the counterstaining performs a colour deconvolution inside the regions of blur-

ecting on the image resulting

threshold criterion The two

thresholds involved are automatically computed from the WSI so as to cope with variations in

k of vessel wall regions on the WSI is produced

The density of microvessels is finally computed as the fraction of the area of significant tissue

which is occupied by vessel walls

We apply this algorithm to a set of 186 WSI of paediatric brain tumours fr

Organisation grades I to IV

Results The algorithm and its implementation are able to distinguish on the WSI the

significant tissue and the vessel walls The segmentations are of very good quality although the

set of slides is very heterogeneous (in tumour type in staining and digitisation parameters

and inside WSI themselves where the tissue was often very fragmented) The computation

time is of the order of a fraction of an hour for each WSI even though a modest desktop

computer is used (a 2012 Mac mini) and the average size of WSI is 7

microvascular density is found to be robust We find that it strongly correlates with the tumour

grade

Conclusions We have introduced a method of automatic segmentation of sign

tissue and of vessel walls and of quantification of the density of microvessels in WSI We

successfully tested it on a large variety of brain tumour tissue samples This method requires

no training and estimates automatically several i

is robust and can easily be applied to other tumour types and other stainings It should

improve the reproducibility of quantitative estimates in pathology while sparing the

pathologist time and effort

Keywords Digital Pathology

Microvessels Brain Tumour

Introduction

Angiogenesis is one of the key features of tumour progression sustaining growth and

sometimes enabling a change of aggressiveness when it starts

crucial histology criterion used in diagnosis and to classify the disease into the proper World

Health Organisation (WHO) grade

quantify in a reliable and robust way the status of the tumou

exist several noninvasive macroscopic imaging techniques

(they may use ionising radiations or contrast agents) and they donrsquot yield a direct access to

the geometric parameters of the

staining [8 9] biopsy samples reveal directly the tumour microvessels It has been shown that

the microvascular density as measured on histology sections is of prognostic significance in

several brain tumours [10 11

However assessing manually the density of microvessels on whole histology sections is a

tremendous task very hard to perform for a human and prone to much inter

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

The density of microvessels is finally computed as the fraction of the area of significant tissue

which is occupied by vessel walls

We apply this algorithm to a set of 186 WSI of paediatric brain tumours fr

The algorithm and its implementation are able to distinguish on the WSI the

significant tissue and the vessel walls The segmentations are of very good quality although the

eneous (in tumour type in staining and digitisation parameters

and inside WSI themselves where the tissue was often very fragmented) The computation

time is of the order of a fraction of an hour for each WSI even though a modest desktop

d (a 2012 Mac mini) and the average size of WSI is 7 gigapixels The computed

microvascular density is found to be robust We find that it strongly correlates with the tumour

We have introduced a method of automatic segmentation of sign

tissue and of vessel walls and of quantification of the density of microvessels in WSI We

successfully tested it on a large variety of brain tumour tissue samples This method requires

no training and estimates automatically several important parameters of the segmentation It

is robust and can easily be applied to other tumour types and other stainings It should

improve the reproducibility of quantitative estimates in pathology while sparing the

Digital Pathology Image Processing Whole Slide Images

Angiogenesis is one of the key features of tumour progression sustaining growth and

sometimes enabling a change of aggressiveness when it starts [1] In brain tumours

crucial histology criterion used in diagnosis and to classify the disease into the proper World

Health Organisation (WHO) grade [4] Therefore it is of great importance to be able to

quantify in a reliable and robust way the status of the tumour vascular system Although there

exist several noninvasive macroscopic imaging techniques [5-7] not all of them are innocuous

(they may use ionising radiations or contrast agents) and they donrsquot yield a direct access to

the geometric parameters of the vasculature In contrast after proper immunohistochemical

] biopsy samples reveal directly the tumour microvessels It has been shown that

the microvascular density as measured on histology sections is of prognostic significance in

10 11]

However assessing manually the density of microvessels on whole histology sections is a

tremendous task very hard to perform for a human and prone to much inter

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

2

The density of microvessels is finally computed as the fraction of the area of significant tissue

We apply this algorithm to a set of 186 WSI of paediatric brain tumours from World Health

The algorithm and its implementation are able to distinguish on the WSI the

significant tissue and the vessel walls The segmentations are of very good quality although the

eneous (in tumour type in staining and digitisation parameters

and inside WSI themselves where the tissue was often very fragmented) The computation

time is of the order of a fraction of an hour for each WSI even though a modest desktop

gigapixels The computed

microvascular density is found to be robust We find that it strongly correlates with the tumour

We have introduced a method of automatic segmentation of significant blur-free

tissue and of vessel walls and of quantification of the density of microvessels in WSI We

successfully tested it on a large variety of brain tumour tissue samples This method requires

mportant parameters of the segmentation It

is robust and can easily be applied to other tumour types and other stainings It should

improve the reproducibility of quantitative estimates in pathology while sparing the

Whole Slide Images Angiogenesis

Angiogenesis is one of the key features of tumour progression sustaining growth and

] In brain tumours [23] it is a

crucial histology criterion used in diagnosis and to classify the disease into the proper World

] Therefore it is of great importance to be able to

r vascular system Although there

] not all of them are innocuous

(they may use ionising radiations or contrast agents) and they donrsquot yield a direct access to

In contrast after proper immunohistochemical

] biopsy samples reveal directly the tumour microvessels It has been shown that

the microvascular density as measured on histology sections is of prognostic significance in

However assessing manually the density of microvessels on whole histology sections is a

tremendous task very hard to perform for a human and prone to much inter- (and even intra-

) individual variability and lack of reproducibil

randomly chosen regions or on a few ldquorepresentativerdquo regions on the section

the task easier (shorter) for the pathologist but will increase the measurement variability and

might reinforce the subjectivity of the task

Luckily virtual microscopy and the digitisation of pathology slides have become quite common

over the last few years allowing the use of the computer to perform various quantitative and

reproducible measurements on histology sec

cost and material reasons it was not possible to measure the parameters of microvessels at

full resolution (20x or 40x) and it was suggested to use images at resolution around 1x

15] However slide scanners produce now high resolution microscopy images of whole slides

in a short time (at most a few minutes) and for a reasonable price

quantification should improve the precision of the results The drawback of this high res

is the very large size of the resulting files which require specific software tools to be managed

like the ones some of us have already developed

Such a quantification of microvessels on high

by several groups [20-22] However most of them were limited to small excerpts of the whole

slide images (WSI) and possibly to relatively homogeneous sets of slides Here we report on a

set of techniques we have developed to assess the density of micro

few tens of gigapixels immunostained with CD34 (to reveal vascular endotheli

few minutes in a robust way with a careful determination of zones of tissue without blur and

with as little intervention of the pa

algorithm is necessary hence the time

of vessels to feed to the computer is spared

Although immunofluorescence is able to provide valuable additiona

about the vasculature such as 3D aspects

microscopy and it not yet compatible with clinical routine Therefore we stick to classical

bright field microscopy of immunostained pathology

To demonstrate the versatility and scalability of our method we applied it to a series of 129

human patients (186 WSI in total) suffering brain tumours of 19 different combinations of

histological type and location ranging from WHO grade I to grade IV S

(our largest image had 162688times98816 pixels) they canrsquot be opened in full in a standard

computerrsquos memory (we would need up to 60 GiB of RAM) and we had to develop strategies

to treat them entirely without restricting ourselves to

source software or software we developed based on existing open source libraries to avoid

black-box algorithms to promote interoperability and reproducibility to reduce costs and to

avoid conflicts of interest [24

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

) individual variability and lack of reproducibility Quantifying the vascularity only on a few

randomly chosen regions or on a few ldquorepresentativerdquo regions on the section

the task easier (shorter) for the pathologist but will increase the measurement variability and

subjectivity of the task

Luckily virtual microscopy and the digitisation of pathology slides have become quite common

over the last few years allowing the use of the computer to perform various quantitative and

reproducible measurements on histology sections [13] In the beginning of this digital era for

cost and material reasons it was not possible to measure the parameters of microvessels at

full resolution (20x or 40x) and it was suggested to use images at resolution around 1x

ide scanners produce now high resolution microscopy images of whole slides

in a short time (at most a few minutes) and for a reasonable price [16] and using them for

quantification should improve the precision of the results The drawback of this high res

is the very large size of the resulting files which require specific software tools to be managed

like the ones some of us have already developed [17-19]

Such a quantification of microvessels on high-resolution images has already been undertaken

However most of them were limited to small excerpts of the whole

slide images (WSI) and possibly to relatively homogeneous sets of slides Here we report on a

set of techniques we have developed to assess the density of microvessels on WSI of sizes a

few tens of gigapixels immunostained with CD34 (to reveal vascular endotheli

in a robust way with a careful determination of zones of tissue without blur and

with as little intervention of the pathologist as possible In particular no training of an

algorithm is necessary hence the time-consuming task of manual segmentation of a number

of vessels to feed to the computer is spared

Although immunofluorescence is able to provide valuable additional quantitative information

about the vasculature such as 3D aspects [23] it requires the use of more elaborate

microscopy and it not yet compatible with clinical routine Therefore we stick to classical

bright field microscopy of immunostained pathology thin sections

To demonstrate the versatility and scalability of our method we applied it to a series of 129

human patients (186 WSI in total) suffering brain tumours of 19 different combinations of

histological type and location ranging from WHO grade I to grade IV Since WSI are very large

(our largest image had 162688times98816 pixels) they canrsquot be opened in full in a standard

computerrsquos memory (we would need up to 60 GiB of RAM) and we had to develop strategies

to treat them entirely without restricting ourselves to small excerpts We used only open

source software or software we developed based on existing open source libraries to avoid

box algorithms to promote interoperability and reproducibility to reduce costs and to

24]

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

3

ity Quantifying the vascularity only on a few

randomly chosen regions or on a few ldquorepresentativerdquo regions on the section [12] will make

the task easier (shorter) for the pathologist but will increase the measurement variability and

Luckily virtual microscopy and the digitisation of pathology slides have become quite common

over the last few years allowing the use of the computer to perform various quantitative and

] In the beginning of this digital era for

cost and material reasons it was not possible to measure the parameters of microvessels at

full resolution (20x or 40x) and it was suggested to use images at resolution around 1x [14

ide scanners produce now high resolution microscopy images of whole slides

] and using them for

quantification should improve the precision of the results The drawback of this high resolution

is the very large size of the resulting files which require specific software tools to be managed

resolution images has already been undertaken

However most of them were limited to small excerpts of the whole

slide images (WSI) and possibly to relatively homogeneous sets of slides Here we report on a

vessels on WSI of sizes a

few tens of gigapixels immunostained with CD34 (to reveal vascular endothelial cells) within a

in a robust way with a careful determination of zones of tissue without blur and

thologist as possible In particular no training of an

consuming task of manual segmentation of a number

l quantitative information

] it requires the use of more elaborate

microscopy and it not yet compatible with clinical routine Therefore we stick to classical

To demonstrate the versatility and scalability of our method we applied it to a series of 129

human patients (186 WSI in total) suffering brain tumours of 19 different combinations of

ince WSI are very large

(our largest image had 162688times98816 pixels) they canrsquot be opened in full in a standard

computerrsquos memory (we would need up to 60 GiB of RAM) and we had to develop strategies

small excerpts We used only open

source software or software we developed based on existing open source libraries to avoid

box algorithms to promote interoperability and reproducibility to reduce costs and to

Material and Methods

Our goal is to quantify the density of microvessels on a WSI as the ratio of the area occupied by

vascular endothelial cells to the area occupied by the tissue We assume that the WSI was

obtained as a (possibly pyramidal) tiled TIFF o

magnification 20times or 40times of a 5

tissue and that immunostaining with a CD34 antibody was performed so that microvessels

appear brown whereas cell n

square centimetres

If some deviation from this protocol is in order it should be easy to adapt our method Eg if

the WSI is stored in another format it can be converted to TIFF using t

NDPITools [1719] that we developed or OpenSlide

are different two parameters can be changed (see below)

Method overview

The aim is first to select the zone of tissue on the WSI then the zone

zone of tissue and finally to measure the areas of the two and compute their ratio Because of

unavoidable slide-to-slide variations in staining and digitisation parameters (eg light intensity

or temperature colour) both zon

technical details the work flow will be slightly more complex We must

bull exclude from the WSI regions where the image is not sharp enough to recognise vessel

walls accurately

bull exclude from the WSI regions which look like tissue but should not be counted as such

essentially large puddles of red blood cells coverslip boundaries and dust

bull not count as vessel walls extra

A scheme of the whole process is shown in

Preparatory steps

From the full-resolution 40times image a 20times image was generated by bilinear interpolation and

stored into a JPEG-compressed

sufficient quality for several of the steps below while saving computation time

Then a mosaic of the 20times image was made and stored into JPEG files This is a decomposition

of the original image in rectangular pieces of equal sizes stored into independent f

independent treatment such that the original image is recovered if the pieces are

reassembled together We requested that each piece need at most 128

(uncompressed) in RAM and that the dimensions of each piece be multiples o

can be easily achieved using the

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Our goal is to quantify the density of microvessels on a WSI as the ratio of the area occupied by

vascular endothelial cells to the area occupied by the tissue We assume that the WSI was

obtained as a (possibly pyramidal) tiled TIFF or BigTIFF [25] file by digitisation at objective

magnification 20times or 40times of a 5μm-thick tissue section of formalin-fixed paraffin

tissue and that immunostaining with a CD34 antibody was performed so that microvessels

appear brown whereas cell nuclei appear blue The total area of tissue is typically of a few

If some deviation from this protocol is in order it should be easy to adapt our method Eg if

the WSI is stored in another format it can be converted to TIFF using t

] that we developed or OpenSlide [2627] If the colours after immunostaining

are different two parameters can be changed (see below)

The aim is first to select the zone of tissue on the WSI then the zone of vessel walls inside the

zone of tissue and finally to measure the areas of the two and compute their ratio Because of

slide variations in staining and digitisation parameters (eg light intensity

or temperature colour) both zone selections will require prior calibration steps And due to

technical details the work flow will be slightly more complex We must

exclude from the WSI regions where the image is not sharp enough to recognise vessel

exclude from the WSI regions which look like tissue but should not be counted as such

essentially large puddles of red blood cells coverslip boundaries and dust

not count as vessel walls extra-vascular CD34-positive tumour cells

A scheme of the whole process is shown in ltFigure 1gt

resolution 40times image a 20times image was generated by bilinear interpolation and

compressed [28] tiled TIFF [29] file Indeed such an image proved of

ficient quality for several of the steps below while saving computation time

Then a mosaic of the 20times image was made and stored into JPEG files This is a decomposition

of the original image in rectangular pieces of equal sizes stored into independent f

independent treatment such that the original image is recovered if the pieces are

reassembled together We requested that each piece need at most 128 MiB to be stored

(uncompressed) in RAM and that the dimensions of each piece be multiples o

can be easily achieved using the -m and -M options of the tiffmakemosaic software

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

4

Our goal is to quantify the density of microvessels on a WSI as the ratio of the area occupied by

vascular endothelial cells to the area occupied by the tissue We assume that the WSI was

] file by digitisation at objective

fixed paraffin-embedded

tissue and that immunostaining with a CD34 antibody was performed so that microvessels

uclei appear blue The total area of tissue is typically of a few

If some deviation from this protocol is in order it should be easy to adapt our method Eg if

the WSI is stored in another format it can be converted to TIFF using the free software

If the colours after immunostaining

of vessel walls inside the

zone of tissue and finally to measure the areas of the two and compute their ratio Because of

slide variations in staining and digitisation parameters (eg light intensity

e selections will require prior calibration steps And due to

exclude from the WSI regions where the image is not sharp enough to recognise vessel

exclude from the WSI regions which look like tissue but should not be counted as such

resolution 40times image a 20times image was generated by bilinear interpolation and

] file Indeed such an image proved of

ficient quality for several of the steps below while saving computation time

Then a mosaic of the 20times image was made and stored into JPEG files This is a decomposition

of the original image in rectangular pieces of equal sizes stored into independent files for easy

independent treatment such that the original image is recovered if the pieces are

MiB to be stored

(uncompressed) in RAM and that the dimensions of each piece be multiples of 8 pixels This

software [1719]

Figure 1 - Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

sharp tissue (bottom)

The blue boxes represent real full colour images the checkerboard boxes represent masks (black

white images resulting from the selection of objects) the red boxes represent automatically determined

quantitative parameters the brown box represents the image of the

the original 20times image the green boxes represent the final measured quantities

Selection of sufficiently sharp zones

We used a variation of the method of blur quantification of

mosaic after decompression into RGB colour space we applied a colour space transformation

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

represent real full colour images the checkerboard boxes represent masks (black

white images resulting from the selection of objects) the red boxes represent automatically determined

quantitative parameters the brown box represents the image of the brown optical densities of pixels of

the original 20times image the green boxes represent the final measured quantities

Selection of sufficiently sharp zones

We used a variation of the method of blur quantification of [3031] On each piece of the 20times

mosaic after decompression into RGB colour space we applied a colour space transformation

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

5

Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

represent real full colour images the checkerboard boxes represent masks (black-on-

white images resulting from the selection of objects) the red boxes represent automatically determined

brown optical densities of pixels of

On each piece of the 20times

mosaic after decompression into RGB colour space we applied a colour space transformation

into HSV colour space as defined by the

convoluted the resulting image with the Laplacian ke

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

computed thescore [31] namely the ratio of the sum of pixel intensities which are at least

10 of the maximum intensity in the block to the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

the 20times image while saving disk space artefacts due to this blocking are already present in the

original WSI

We generated a graylevel image where the

encoded as the intensity of one pixel (between 0 and 255 included) The resulting i

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

opened at once in the computerrsquos RAM

Finally this 25times sharpness map was transformed (using the ImageJ software

mask of sharp regions in the following way pixel intensities were averaged over regions of

radius 2 pixels a mask of regions where the resulting intensity is 43 and above was created

(these are the sharp regions) sharp regions of less than 20

were turned into blurred regions then blurred regions of less than 20

turned into sharp regions The final mask of sharp regions was written

Selection of tissue zones

We used as a first criterion to distinguish tissue from background the value of brightness of

pixels (B in HSB colour space as defined by ImageJ

brightness of pixels in the background

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

coverslip on a downscaled 0625times image and stored the

as ImageJrsquos roi files which will be subsequently read at the proper stage

We generated a 25times image from the full resolution image With ImageJ we selected on this

image the non-excluded zones (sides of the coverslip

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

plusmn12 from the Gaussian-weighted average (with standard deviation σ=0005) over their vicinity

We selected connected regions

the intersection with regions where the brightness was 127 or above This defined the

reference regions for the background

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

into HSV colour space as defined by the vips program [32] extracted the V channel and

convoluted the resulting image with the Laplacian kernel 1 1 11 8 11 1 1

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

] namely the ratio of the sum of pixel intensities which are at least

10 of the maximum intensity in the block to the sum of all 64 pixel intensities (or 0 if the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

ving disk space artefacts due to this blocking are already present in the

We generated a graylevel image where thevalue of each block of the 20times image was

encoded as the intensity of one pixel (between 0 and 255 included) The resulting i

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

opened at once in the computerrsquos RAM

ness map was transformed (using the ImageJ software

mask of sharp regions in the following way pixel intensities were averaged over regions of

pixels a mask of regions where the resulting intensity is 43 and above was created

hese are the sharp regions) sharp regions of less than 20 pixels of area (at resolution 25times)

were turned into blurred regions then blurred regions of less than 20 pixels of area were

turned into sharp regions The final mask of sharp regions was written on the disk

We used as a first criterion to distinguish tissue from background the value of brightness of

pixels (B in HSB colour space as defined by ImageJ [33]) Therefore we needed to calibrate the

e background

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

coverslip on a downscaled 0625times image and stored the resulting contour (union of polygons)

files which will be subsequently read at the proper stage

We generated a 25times image from the full resolution image With ImageJ we selected on this

excluded zones (sides of the coverslip) then we extracted the brightness of

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

weighted average (with standard deviation σ=0005) over their vicinity

We selected connected regions of at least 160 pixels among these ldquouniformrdquo pixels and took

the intersection with regions where the brightness was 127 or above This defined the

reference regions for the background

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

6

] extracted the V channel and

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

] namely the ratio of the sum of pixel intensities which are at least

pixel intensities (or 0 if the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

ving disk space artefacts due to this blocking are already present in the

value of each block of the 20times image was

encoded as the intensity of one pixel (between 0 and 255 included) The resulting image

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

ness map was transformed (using the ImageJ software [33 34]) into a

mask of sharp regions in the following way pixel intensities were averaged over regions of

pixels a mask of regions where the resulting intensity is 43 and above was created

pixels of area (at resolution 25times)

pixels of area were

on the disk

We used as a first criterion to distinguish tissue from background the value of brightness of

]) Therefore we needed to calibrate the

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

resulting contour (union of polygons)

We generated a 25times image from the full resolution image With ImageJ we selected on this

) then we extracted the brightness of

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

weighted average (with standard deviation σ=0005) over their vicinity

pixels among these ldquouniformrdquo pixels and took

the intersection with regions where the brightness was 127 or above This defined the

We measured the histogram of the brightness value of the pixels in the

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

the right endof this peak as the largest brightness level which occurs at least once Then

we measured the left end

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

far and either was zero or was larger than the last seen occurrence number

These left- and right-end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

each WSI because of marked variability the left

end ranged from 232 to 249

In addition we selected pixels within the reference regions which had a brightness between

the left-end of the peak and the left

values of R G and B (hereafter called

later use

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with

than 100 MiB of RAM to be opened with overlap of 256

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way

brightness of which was outside the interval measured previously as ldquobackground intensity

peakrdquo mdash call them A

pixels we selected those which containe

space) was larger than the average of the saturation of all A

regions This was to prevent selecting uniform regions with unusual high or low brightness

which could be a large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than

magnification) had to be considered as tissue Therefore we included in the B

holes of area less than 10000

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

10000 pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256

concern only small holes (less than 10000

that is rather elongated holes which was rather uncommon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We measured the histogram of the brightness value of the pixels in the reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

of this peak using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

r was larger than the last seen occurrence number

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

marked variability the left-end ranged from 212 to 234 while the right

In addition we selected pixels within the reference regions which had a brightness between

end of the peak and the left-end plus three (included) and computed their average

values of R G and B (hereafter called ) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with tiffmakemosaic a mosaic such that no piece required more

MiB of RAM to be opened with overlap of 256 pixels between adjacent

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

call them A-pixels Then among the connected regions formed by these

pixels we selected those which contained at least one pixel the saturation of which (in HSB

space) was larger than the average of the saturation of all A-pixels mdash thus constructing the B

regions This was to prevent selecting uniform regions with unusual high or low brightness

large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than asymp 10000

on) had to be considered as tissue Therefore we included in the B

holes of area less than 10000 pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256 pixels The exception would

concern only small holes (less than 10000 pixels) a dimension of which exceeded 256 pixels

that is rather elongated holes which was rather uncommon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

7

reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

k using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

end ranged from 212 to 234 while the right-

In addition we selected pixels within the reference regions which had a brightness between

and computed their average

) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

a mosaic such that no piece required more

pixels between adjacent pieces

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

pixels Then among the connected regions formed by these

d at least one pixel the saturation of which (in HSB

thus constructing the B-

regions This was to prevent selecting uniform regions with unusual high or low brightness

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

asymp 10000 pixels (at 20times

on) had to be considered as tissue Therefore we included in the B-regions the

pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (more than

pixels) extending on another mosaic piece which should not be restored into the B-

regions or a small part of a small hole which would quite probably be entirely included into an

pixels The exception would

pixels) a dimension of which exceeded 256 pixels

Similarly we found that holes having a fractal

the B-regions They were characterised in the following way after we performed an

then a dilate operation on them their area was less than 10000

the boundary of the mosaic piece

Then we made the boundaries of the B

then a dilate on their mask This eliminated the small overhangs or invaginations of a few

pixels

We eliminated from the B-regions the connected regions of less than 20000

at a distance 30 pixels or larger from a region or 20000

were found to be non significant (dust isolated cells small pieces of tis

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ

operations including thresholding at 15 the distance map from the B

Finally we found that B-regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3

the saturation in HSB colour space we applied the

threshold on this image and we defined as high

which was above the isodata

high-saturation pixel were kept as tissue regions

The mask (binary image) of the tissue

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

stored on the disk as a 1-bit-per

high level of compression Then the pieces of the mosaic with overlap were erased from the

disk

If there existed for this WSI a

mask of the region to exclude was formed as a binary image of resolution

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up t

was performed thanks to another in

and RAM economy

Finally the logical and of the mask of sharp regions and of the mask of tissue was computed

through the same C program and stored on the disk as a bilevel Deflate

Again although the resulting mask is a very large image (176

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Similarly we found that holes having a fractal-like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an

operation on them their area was less than 10000 pixels and they did not touch

the boundary of the mosaic piece

Then we made the boundaries of the B-regions (tissue regions) more regular applying an

on their mask This eliminated the small overhangs or invaginations of a few

regions the connected regions of less than 20000 pixels which were

at a distance 30 pixels or larger from a region or 20000 pixels or more Indeed most of those

were found to be non significant (dust isolated cells small pieces of tissue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ by a combination of morphological

operations including thresholding at 15 the distance map from the B-regions

regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at least blue cell nuclei or brown vessel walls)

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3 pixels the image of

the saturation in HSB colour space we applied the isodata algorithm [35] to find an automatic

image and we defined as high-saturation pixels the pixels the saturation of

isodata threshold and above 30 Only B-regions containing at least one

saturation pixel were kept as tissue regions

The mask (binary image) of the tissue regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

per-pixel Deflate-compressed [29] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

If there existed for this WSI a roi file defining the side(s) of the coverslip on th

mask of the region to exclude was formed as a binary image of resolution 0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up to resolution 20times This logical operation

was performed thanks to another in-house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

e C program and stored on the disk as a bilevel Deflate-compressed TIFF file

Again although the resulting mask is a very large image (176 gigapixels in average) this form

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

8

like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an erode

and they did not touch

regions (tissue regions) more regular applying an erode

on their mask This eliminated the small overhangs or invaginations of a few

pixels which were

pixels or more Indeed most of those

sue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

by a combination of morphological

regions

regions with too low saturation (greyish regions) could exist and

least blue cell nuclei or brown vessel walls)

pixels the image of

] to find an automatic

saturation pixels the pixels the saturation of

regions containing at least one

regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in-

house developed C program for the sake of speed and RAM economy The whole mask was

] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

file defining the side(s) of the coverslip on the image the

0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

20times This logical operation

house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

compressed TIFF file

gigapixels in average) this form

of compression is very efficient the average disk size of the mask was 436

026 MiB to 1638 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

corresponding WSI in ltFigure

Figure 2 - Example of a determination of tissue without blur

Top left excerpt of the original image (one of our WSI)

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One c

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

scanner They will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region

regions is superimposed onto the detail of the WSI shown on the b

between ldquofully blurredrdquo on the left

image Green scale bar = 20 microns

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

of compression is very efficient the average disk size of the mask was 436 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

Figure 2gt

Example of a determination of tissue without blur

excerpt of the original image (one of our WSI) Top right the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One can see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region Bottom right

regions is superimposed onto the detail of the WSI shown on the bottom left One sees the transition

between ldquofully blurredrdquo on the left-hand side of the image to ldquofully sharprdquo on the right

microns

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

9

MiB ranging from

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

an see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1 mm Bottom left

the mask of sharp

ottom left One sees the transition

hand side of the image to ldquofully sharprdquo on the right-hand side of the

Removal of puddles of red blood cells

This part of the method is rather c

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

regions of blur-free tissue It was developed on two example WSI but proved efficient on all

We constructed a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

Find Edges command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these re

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

close operation on the resulting mask This is to select t

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold

defined during backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

bit-per-pixel Deflate-compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in

Removing from the mask of sharp tissue pixels considered acco

of red blood cells we built the mask of significant blur

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Removal of puddles of red blood cells

This part of the method is rather cumbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these regions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

operation on the resulting mask This is to select the sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold = 255 035255

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above b and of circularity at most 02 We also added the connect

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in ltFigure 3gt

Removing from the mask of sharp tissue pixels considered according to this mask of puddles

of red blood cells we built the mask of significant blur-free tissue

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

10

umbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

gions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

he sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

were was

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

and of circularity at most 02 We also added the connected

regions of 2800 pixels and above which were constructed by added to these latter regions

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1-

A detail from an example of such a mask of large puddles of red blood cells is shown

rding to this mask of puddles

w

Figure 3 - Example of a determination of large puddles of red blood cells

Top original image (excerpt of one of our WSI)

large puddles of red blood cells was superimposed Scale bar = 20

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

counterstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution

To perform this linear change in colour space we needed to know the optical densities (od) in

R G and B channels (or more precisely only the ratios of these three od to form their vector

in the RGB space [36]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25

measured the average optical densities in the R G and

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and

contribution of markedly blue areas

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Example of a determination of large puddles of red blood cells

original image (excerpt of one of our WSI) Bottom the same image over which the mask of the

large puddles of red blood cells was superimposed Scale bar = 20 microns

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution [36]

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide-to-slide variability as can be seen on

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25 pixels Finally we

measured the average optical densities in the R G and B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and with hue inside the interval [80199] to get the

contribution of markedly blue areas

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

11

the same image over which the mask of the

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of the

slide variability as can be seen on ltFigure 4gt

We used the following procedure on each piece of the 20times mosaic without overlap formed

On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

pixels Finally we

B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

with hue inside the interval [80199] to get the

Figure 4 - Slide-to-slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green

(CD34) staining as defined in [36

the blue optical density to the red optical density

distribution of the values of Δ over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to comput

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

them to a text file

The precise values of the thresholds above are irrelevant the important thing is that the loose

limits on the hue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

calibration of the optical densities of the brown staining rested on 154

563 kilopixels max 288 megapixels) and the calibration of the optical densities of the blue

rested on 104 megapixels (min 109

Selection of vessel walls

The whole process of actual selection of vessel walls operated only on the areas of significant

blur-free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

First the histogram of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in

which took as input the WSI at resolution

the colour deconvolution (average od determined earlier) and operated independently on

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green and blue channels of the brown

36] according to the procedure described in the main text we subtracted

the blue optical density to the red optical density mdash letrsquos call this difference Δ This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to compute the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

ibration of the optical densities of the brown staining rested on 154

megapixels) and the calibration of the optical densities of the blue

megapixels (min 109 megapixels max 842 megapixels)

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in-house developed C program

which took as input the WSI at resolution 20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

12

and blue channels of the brown

] according to the procedure described in the main text we subtracted

This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

e the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

megapixels (min

megapixels) and the calibration of the optical densities of the blue

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

house developed C program

20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

The density of microvessels is finally computed as the fraction of the area of significant tissue

which is occupied by vessel walls

We apply this algorithm to a set of 186 WSI of paediatric brain tumours fr

Organisation grades I to IV

Results The algorithm and its implementation are able to distinguish on the WSI the

significant tissue and the vessel walls The segmentations are of very good quality although the

set of slides is very heterogeneous (in tumour type in staining and digitisation parameters

and inside WSI themselves where the tissue was often very fragmented) The computation

time is of the order of a fraction of an hour for each WSI even though a modest desktop

computer is used (a 2012 Mac mini) and the average size of WSI is 7

microvascular density is found to be robust We find that it strongly correlates with the tumour

grade

Conclusions We have introduced a method of automatic segmentation of sign

tissue and of vessel walls and of quantification of the density of microvessels in WSI We

successfully tested it on a large variety of brain tumour tissue samples This method requires

no training and estimates automatically several i

is robust and can easily be applied to other tumour types and other stainings It should

improve the reproducibility of quantitative estimates in pathology while sparing the

pathologist time and effort

Keywords Digital Pathology

Microvessels Brain Tumour

Introduction

Angiogenesis is one of the key features of tumour progression sustaining growth and

sometimes enabling a change of aggressiveness when it starts

crucial histology criterion used in diagnosis and to classify the disease into the proper World

Health Organisation (WHO) grade

quantify in a reliable and robust way the status of the tumou

exist several noninvasive macroscopic imaging techniques

(they may use ionising radiations or contrast agents) and they donrsquot yield a direct access to

the geometric parameters of the

staining [8 9] biopsy samples reveal directly the tumour microvessels It has been shown that

the microvascular density as measured on histology sections is of prognostic significance in

several brain tumours [10 11

However assessing manually the density of microvessels on whole histology sections is a

tremendous task very hard to perform for a human and prone to much inter

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

The density of microvessels is finally computed as the fraction of the area of significant tissue

which is occupied by vessel walls

We apply this algorithm to a set of 186 WSI of paediatric brain tumours fr

The algorithm and its implementation are able to distinguish on the WSI the

significant tissue and the vessel walls The segmentations are of very good quality although the

eneous (in tumour type in staining and digitisation parameters

and inside WSI themselves where the tissue was often very fragmented) The computation

time is of the order of a fraction of an hour for each WSI even though a modest desktop

d (a 2012 Mac mini) and the average size of WSI is 7 gigapixels The computed

microvascular density is found to be robust We find that it strongly correlates with the tumour

We have introduced a method of automatic segmentation of sign

tissue and of vessel walls and of quantification of the density of microvessels in WSI We

successfully tested it on a large variety of brain tumour tissue samples This method requires

no training and estimates automatically several important parameters of the segmentation It

is robust and can easily be applied to other tumour types and other stainings It should

improve the reproducibility of quantitative estimates in pathology while sparing the

Digital Pathology Image Processing Whole Slide Images

Angiogenesis is one of the key features of tumour progression sustaining growth and

sometimes enabling a change of aggressiveness when it starts [1] In brain tumours

crucial histology criterion used in diagnosis and to classify the disease into the proper World

Health Organisation (WHO) grade [4] Therefore it is of great importance to be able to

quantify in a reliable and robust way the status of the tumour vascular system Although there

exist several noninvasive macroscopic imaging techniques [5-7] not all of them are innocuous

(they may use ionising radiations or contrast agents) and they donrsquot yield a direct access to

the geometric parameters of the vasculature In contrast after proper immunohistochemical

] biopsy samples reveal directly the tumour microvessels It has been shown that

the microvascular density as measured on histology sections is of prognostic significance in

10 11]

However assessing manually the density of microvessels on whole histology sections is a

tremendous task very hard to perform for a human and prone to much inter

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

2

The density of microvessels is finally computed as the fraction of the area of significant tissue

We apply this algorithm to a set of 186 WSI of paediatric brain tumours from World Health

The algorithm and its implementation are able to distinguish on the WSI the

significant tissue and the vessel walls The segmentations are of very good quality although the

eneous (in tumour type in staining and digitisation parameters

and inside WSI themselves where the tissue was often very fragmented) The computation

time is of the order of a fraction of an hour for each WSI even though a modest desktop

gigapixels The computed

microvascular density is found to be robust We find that it strongly correlates with the tumour

We have introduced a method of automatic segmentation of significant blur-free

tissue and of vessel walls and of quantification of the density of microvessels in WSI We

successfully tested it on a large variety of brain tumour tissue samples This method requires

mportant parameters of the segmentation It

is robust and can easily be applied to other tumour types and other stainings It should

improve the reproducibility of quantitative estimates in pathology while sparing the

Whole Slide Images Angiogenesis

Angiogenesis is one of the key features of tumour progression sustaining growth and

] In brain tumours [23] it is a

crucial histology criterion used in diagnosis and to classify the disease into the proper World

] Therefore it is of great importance to be able to

r vascular system Although there

] not all of them are innocuous

(they may use ionising radiations or contrast agents) and they donrsquot yield a direct access to

In contrast after proper immunohistochemical

] biopsy samples reveal directly the tumour microvessels It has been shown that

the microvascular density as measured on histology sections is of prognostic significance in

However assessing manually the density of microvessels on whole histology sections is a

tremendous task very hard to perform for a human and prone to much inter- (and even intra-

) individual variability and lack of reproducibil

randomly chosen regions or on a few ldquorepresentativerdquo regions on the section

the task easier (shorter) for the pathologist but will increase the measurement variability and

might reinforce the subjectivity of the task

Luckily virtual microscopy and the digitisation of pathology slides have become quite common

over the last few years allowing the use of the computer to perform various quantitative and

reproducible measurements on histology sec

cost and material reasons it was not possible to measure the parameters of microvessels at

full resolution (20x or 40x) and it was suggested to use images at resolution around 1x

15] However slide scanners produce now high resolution microscopy images of whole slides

in a short time (at most a few minutes) and for a reasonable price

quantification should improve the precision of the results The drawback of this high res

is the very large size of the resulting files which require specific software tools to be managed

like the ones some of us have already developed

Such a quantification of microvessels on high

by several groups [20-22] However most of them were limited to small excerpts of the whole

slide images (WSI) and possibly to relatively homogeneous sets of slides Here we report on a

set of techniques we have developed to assess the density of micro

few tens of gigapixels immunostained with CD34 (to reveal vascular endotheli

few minutes in a robust way with a careful determination of zones of tissue without blur and

with as little intervention of the pa

algorithm is necessary hence the time

of vessels to feed to the computer is spared

Although immunofluorescence is able to provide valuable additiona

about the vasculature such as 3D aspects

microscopy and it not yet compatible with clinical routine Therefore we stick to classical

bright field microscopy of immunostained pathology

To demonstrate the versatility and scalability of our method we applied it to a series of 129

human patients (186 WSI in total) suffering brain tumours of 19 different combinations of

histological type and location ranging from WHO grade I to grade IV S

(our largest image had 162688times98816 pixels) they canrsquot be opened in full in a standard

computerrsquos memory (we would need up to 60 GiB of RAM) and we had to develop strategies

to treat them entirely without restricting ourselves to

source software or software we developed based on existing open source libraries to avoid

black-box algorithms to promote interoperability and reproducibility to reduce costs and to

avoid conflicts of interest [24

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

) individual variability and lack of reproducibility Quantifying the vascularity only on a few

randomly chosen regions or on a few ldquorepresentativerdquo regions on the section

the task easier (shorter) for the pathologist but will increase the measurement variability and

subjectivity of the task

Luckily virtual microscopy and the digitisation of pathology slides have become quite common

over the last few years allowing the use of the computer to perform various quantitative and

reproducible measurements on histology sections [13] In the beginning of this digital era for

cost and material reasons it was not possible to measure the parameters of microvessels at

full resolution (20x or 40x) and it was suggested to use images at resolution around 1x

ide scanners produce now high resolution microscopy images of whole slides

in a short time (at most a few minutes) and for a reasonable price [16] and using them for

quantification should improve the precision of the results The drawback of this high res

is the very large size of the resulting files which require specific software tools to be managed

like the ones some of us have already developed [17-19]

Such a quantification of microvessels on high-resolution images has already been undertaken

However most of them were limited to small excerpts of the whole

slide images (WSI) and possibly to relatively homogeneous sets of slides Here we report on a

set of techniques we have developed to assess the density of microvessels on WSI of sizes a

few tens of gigapixels immunostained with CD34 (to reveal vascular endotheli

in a robust way with a careful determination of zones of tissue without blur and

with as little intervention of the pathologist as possible In particular no training of an

algorithm is necessary hence the time-consuming task of manual segmentation of a number

of vessels to feed to the computer is spared

Although immunofluorescence is able to provide valuable additional quantitative information

about the vasculature such as 3D aspects [23] it requires the use of more elaborate

microscopy and it not yet compatible with clinical routine Therefore we stick to classical

bright field microscopy of immunostained pathology thin sections

To demonstrate the versatility and scalability of our method we applied it to a series of 129

human patients (186 WSI in total) suffering brain tumours of 19 different combinations of

histological type and location ranging from WHO grade I to grade IV Since WSI are very large

(our largest image had 162688times98816 pixels) they canrsquot be opened in full in a standard

computerrsquos memory (we would need up to 60 GiB of RAM) and we had to develop strategies

to treat them entirely without restricting ourselves to small excerpts We used only open

source software or software we developed based on existing open source libraries to avoid

box algorithms to promote interoperability and reproducibility to reduce costs and to

24]

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

3

ity Quantifying the vascularity only on a few

randomly chosen regions or on a few ldquorepresentativerdquo regions on the section [12] will make

the task easier (shorter) for the pathologist but will increase the measurement variability and

Luckily virtual microscopy and the digitisation of pathology slides have become quite common

over the last few years allowing the use of the computer to perform various quantitative and

] In the beginning of this digital era for

cost and material reasons it was not possible to measure the parameters of microvessels at

full resolution (20x or 40x) and it was suggested to use images at resolution around 1x [14

ide scanners produce now high resolution microscopy images of whole slides

] and using them for

quantification should improve the precision of the results The drawback of this high resolution

is the very large size of the resulting files which require specific software tools to be managed

resolution images has already been undertaken

However most of them were limited to small excerpts of the whole

slide images (WSI) and possibly to relatively homogeneous sets of slides Here we report on a

vessels on WSI of sizes a

few tens of gigapixels immunostained with CD34 (to reveal vascular endothelial cells) within a

in a robust way with a careful determination of zones of tissue without blur and

thologist as possible In particular no training of an

consuming task of manual segmentation of a number

l quantitative information

] it requires the use of more elaborate

microscopy and it not yet compatible with clinical routine Therefore we stick to classical

To demonstrate the versatility and scalability of our method we applied it to a series of 129

human patients (186 WSI in total) suffering brain tumours of 19 different combinations of

ince WSI are very large

(our largest image had 162688times98816 pixels) they canrsquot be opened in full in a standard

computerrsquos memory (we would need up to 60 GiB of RAM) and we had to develop strategies

small excerpts We used only open

source software or software we developed based on existing open source libraries to avoid

box algorithms to promote interoperability and reproducibility to reduce costs and to

Material and Methods

Our goal is to quantify the density of microvessels on a WSI as the ratio of the area occupied by

vascular endothelial cells to the area occupied by the tissue We assume that the WSI was

obtained as a (possibly pyramidal) tiled TIFF o

magnification 20times or 40times of a 5

tissue and that immunostaining with a CD34 antibody was performed so that microvessels

appear brown whereas cell n

square centimetres

If some deviation from this protocol is in order it should be easy to adapt our method Eg if

the WSI is stored in another format it can be converted to TIFF using t

NDPITools [1719] that we developed or OpenSlide

are different two parameters can be changed (see below)

Method overview

The aim is first to select the zone of tissue on the WSI then the zone

zone of tissue and finally to measure the areas of the two and compute their ratio Because of

unavoidable slide-to-slide variations in staining and digitisation parameters (eg light intensity

or temperature colour) both zon

technical details the work flow will be slightly more complex We must

bull exclude from the WSI regions where the image is not sharp enough to recognise vessel

walls accurately

bull exclude from the WSI regions which look like tissue but should not be counted as such

essentially large puddles of red blood cells coverslip boundaries and dust

bull not count as vessel walls extra

A scheme of the whole process is shown in

Preparatory steps

From the full-resolution 40times image a 20times image was generated by bilinear interpolation and

stored into a JPEG-compressed

sufficient quality for several of the steps below while saving computation time

Then a mosaic of the 20times image was made and stored into JPEG files This is a decomposition

of the original image in rectangular pieces of equal sizes stored into independent f

independent treatment such that the original image is recovered if the pieces are

reassembled together We requested that each piece need at most 128

(uncompressed) in RAM and that the dimensions of each piece be multiples o

can be easily achieved using the

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Our goal is to quantify the density of microvessels on a WSI as the ratio of the area occupied by

vascular endothelial cells to the area occupied by the tissue We assume that the WSI was

obtained as a (possibly pyramidal) tiled TIFF or BigTIFF [25] file by digitisation at objective

magnification 20times or 40times of a 5μm-thick tissue section of formalin-fixed paraffin

tissue and that immunostaining with a CD34 antibody was performed so that microvessels

appear brown whereas cell nuclei appear blue The total area of tissue is typically of a few

If some deviation from this protocol is in order it should be easy to adapt our method Eg if

the WSI is stored in another format it can be converted to TIFF using t

] that we developed or OpenSlide [2627] If the colours after immunostaining

are different two parameters can be changed (see below)

The aim is first to select the zone of tissue on the WSI then the zone of vessel walls inside the

zone of tissue and finally to measure the areas of the two and compute their ratio Because of

slide variations in staining and digitisation parameters (eg light intensity

or temperature colour) both zone selections will require prior calibration steps And due to

technical details the work flow will be slightly more complex We must

exclude from the WSI regions where the image is not sharp enough to recognise vessel

exclude from the WSI regions which look like tissue but should not be counted as such

essentially large puddles of red blood cells coverslip boundaries and dust

not count as vessel walls extra-vascular CD34-positive tumour cells

A scheme of the whole process is shown in ltFigure 1gt

resolution 40times image a 20times image was generated by bilinear interpolation and

compressed [28] tiled TIFF [29] file Indeed such an image proved of

ficient quality for several of the steps below while saving computation time

Then a mosaic of the 20times image was made and stored into JPEG files This is a decomposition

of the original image in rectangular pieces of equal sizes stored into independent f

independent treatment such that the original image is recovered if the pieces are

reassembled together We requested that each piece need at most 128 MiB to be stored

(uncompressed) in RAM and that the dimensions of each piece be multiples o

can be easily achieved using the -m and -M options of the tiffmakemosaic software

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

4

Our goal is to quantify the density of microvessels on a WSI as the ratio of the area occupied by

vascular endothelial cells to the area occupied by the tissue We assume that the WSI was

] file by digitisation at objective

fixed paraffin-embedded

tissue and that immunostaining with a CD34 antibody was performed so that microvessels

uclei appear blue The total area of tissue is typically of a few

If some deviation from this protocol is in order it should be easy to adapt our method Eg if

the WSI is stored in another format it can be converted to TIFF using the free software

If the colours after immunostaining

of vessel walls inside the

zone of tissue and finally to measure the areas of the two and compute their ratio Because of

slide variations in staining and digitisation parameters (eg light intensity

e selections will require prior calibration steps And due to

exclude from the WSI regions where the image is not sharp enough to recognise vessel

exclude from the WSI regions which look like tissue but should not be counted as such

resolution 40times image a 20times image was generated by bilinear interpolation and

] file Indeed such an image proved of

ficient quality for several of the steps below while saving computation time

Then a mosaic of the 20times image was made and stored into JPEG files This is a decomposition

of the original image in rectangular pieces of equal sizes stored into independent files for easy

independent treatment such that the original image is recovered if the pieces are

MiB to be stored

(uncompressed) in RAM and that the dimensions of each piece be multiples of 8 pixels This

software [1719]

Figure 1 - Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

sharp tissue (bottom)

The blue boxes represent real full colour images the checkerboard boxes represent masks (black

white images resulting from the selection of objects) the red boxes represent automatically determined

quantitative parameters the brown box represents the image of the

the original 20times image the green boxes represent the final measured quantities

Selection of sufficiently sharp zones

We used a variation of the method of blur quantification of

mosaic after decompression into RGB colour space we applied a colour space transformation

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

represent real full colour images the checkerboard boxes represent masks (black

white images resulting from the selection of objects) the red boxes represent automatically determined

quantitative parameters the brown box represents the image of the brown optical densities of pixels of

the original 20times image the green boxes represent the final measured quantities

Selection of sufficiently sharp zones

We used a variation of the method of blur quantification of [3031] On each piece of the 20times

mosaic after decompression into RGB colour space we applied a colour space transformation

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

5

Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

represent real full colour images the checkerboard boxes represent masks (black-on-

white images resulting from the selection of objects) the red boxes represent automatically determined

brown optical densities of pixels of

On each piece of the 20times

mosaic after decompression into RGB colour space we applied a colour space transformation

into HSV colour space as defined by the

convoluted the resulting image with the Laplacian ke

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

computed thescore [31] namely the ratio of the sum of pixel intensities which are at least

10 of the maximum intensity in the block to the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

the 20times image while saving disk space artefacts due to this blocking are already present in the

original WSI

We generated a graylevel image where the

encoded as the intensity of one pixel (between 0 and 255 included) The resulting i

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

opened at once in the computerrsquos RAM

Finally this 25times sharpness map was transformed (using the ImageJ software

mask of sharp regions in the following way pixel intensities were averaged over regions of

radius 2 pixels a mask of regions where the resulting intensity is 43 and above was created

(these are the sharp regions) sharp regions of less than 20

were turned into blurred regions then blurred regions of less than 20

turned into sharp regions The final mask of sharp regions was written

Selection of tissue zones

We used as a first criterion to distinguish tissue from background the value of brightness of

pixels (B in HSB colour space as defined by ImageJ

brightness of pixels in the background

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

coverslip on a downscaled 0625times image and stored the

as ImageJrsquos roi files which will be subsequently read at the proper stage

We generated a 25times image from the full resolution image With ImageJ we selected on this

image the non-excluded zones (sides of the coverslip

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

plusmn12 from the Gaussian-weighted average (with standard deviation σ=0005) over their vicinity

We selected connected regions

the intersection with regions where the brightness was 127 or above This defined the

reference regions for the background

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

into HSV colour space as defined by the vips program [32] extracted the V channel and

convoluted the resulting image with the Laplacian kernel 1 1 11 8 11 1 1

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

] namely the ratio of the sum of pixel intensities which are at least

10 of the maximum intensity in the block to the sum of all 64 pixel intensities (or 0 if the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

ving disk space artefacts due to this blocking are already present in the

We generated a graylevel image where thevalue of each block of the 20times image was

encoded as the intensity of one pixel (between 0 and 255 included) The resulting i

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

opened at once in the computerrsquos RAM

ness map was transformed (using the ImageJ software

mask of sharp regions in the following way pixel intensities were averaged over regions of

pixels a mask of regions where the resulting intensity is 43 and above was created

hese are the sharp regions) sharp regions of less than 20 pixels of area (at resolution 25times)

were turned into blurred regions then blurred regions of less than 20 pixels of area were

turned into sharp regions The final mask of sharp regions was written on the disk

We used as a first criterion to distinguish tissue from background the value of brightness of

pixels (B in HSB colour space as defined by ImageJ [33]) Therefore we needed to calibrate the

e background

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

coverslip on a downscaled 0625times image and stored the resulting contour (union of polygons)

files which will be subsequently read at the proper stage

We generated a 25times image from the full resolution image With ImageJ we selected on this

excluded zones (sides of the coverslip) then we extracted the brightness of

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

weighted average (with standard deviation σ=0005) over their vicinity

We selected connected regions of at least 160 pixels among these ldquouniformrdquo pixels and took

the intersection with regions where the brightness was 127 or above This defined the

reference regions for the background

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

6

] extracted the V channel and

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

] namely the ratio of the sum of pixel intensities which are at least

pixel intensities (or 0 if the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

ving disk space artefacts due to this blocking are already present in the

value of each block of the 20times image was

encoded as the intensity of one pixel (between 0 and 255 included) The resulting image

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

ness map was transformed (using the ImageJ software [33 34]) into a

mask of sharp regions in the following way pixel intensities were averaged over regions of

pixels a mask of regions where the resulting intensity is 43 and above was created

pixels of area (at resolution 25times)

pixels of area were

on the disk

We used as a first criterion to distinguish tissue from background the value of brightness of

]) Therefore we needed to calibrate the

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

resulting contour (union of polygons)

We generated a 25times image from the full resolution image With ImageJ we selected on this

) then we extracted the brightness of

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

weighted average (with standard deviation σ=0005) over their vicinity

pixels among these ldquouniformrdquo pixels and took

the intersection with regions where the brightness was 127 or above This defined the

We measured the histogram of the brightness value of the pixels in the

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

the right endof this peak as the largest brightness level which occurs at least once Then

we measured the left end

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

far and either was zero or was larger than the last seen occurrence number

These left- and right-end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

each WSI because of marked variability the left

end ranged from 232 to 249

In addition we selected pixels within the reference regions which had a brightness between

the left-end of the peak and the left

values of R G and B (hereafter called

later use

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with

than 100 MiB of RAM to be opened with overlap of 256

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way

brightness of which was outside the interval measured previously as ldquobackground intensity

peakrdquo mdash call them A

pixels we selected those which containe

space) was larger than the average of the saturation of all A

regions This was to prevent selecting uniform regions with unusual high or low brightness

which could be a large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than

magnification) had to be considered as tissue Therefore we included in the B

holes of area less than 10000

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

10000 pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256

concern only small holes (less than 10000

that is rather elongated holes which was rather uncommon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We measured the histogram of the brightness value of the pixels in the reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

of this peak using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

r was larger than the last seen occurrence number

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

marked variability the left-end ranged from 212 to 234 while the right

In addition we selected pixels within the reference regions which had a brightness between

end of the peak and the left-end plus three (included) and computed their average

values of R G and B (hereafter called ) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with tiffmakemosaic a mosaic such that no piece required more

MiB of RAM to be opened with overlap of 256 pixels between adjacent

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

call them A-pixels Then among the connected regions formed by these

pixels we selected those which contained at least one pixel the saturation of which (in HSB

space) was larger than the average of the saturation of all A-pixels mdash thus constructing the B

regions This was to prevent selecting uniform regions with unusual high or low brightness

large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than asymp 10000

on) had to be considered as tissue Therefore we included in the B

holes of area less than 10000 pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256 pixels The exception would

concern only small holes (less than 10000 pixels) a dimension of which exceeded 256 pixels

that is rather elongated holes which was rather uncommon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

7

reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

k using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

end ranged from 212 to 234 while the right-

In addition we selected pixels within the reference regions which had a brightness between

and computed their average

) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

a mosaic such that no piece required more

pixels between adjacent pieces

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

pixels Then among the connected regions formed by these

d at least one pixel the saturation of which (in HSB

thus constructing the B-

regions This was to prevent selecting uniform regions with unusual high or low brightness

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

asymp 10000 pixels (at 20times

on) had to be considered as tissue Therefore we included in the B-regions the

pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (more than

pixels) extending on another mosaic piece which should not be restored into the B-

regions or a small part of a small hole which would quite probably be entirely included into an

pixels The exception would

pixels) a dimension of which exceeded 256 pixels

Similarly we found that holes having a fractal

the B-regions They were characterised in the following way after we performed an

then a dilate operation on them their area was less than 10000

the boundary of the mosaic piece

Then we made the boundaries of the B

then a dilate on their mask This eliminated the small overhangs or invaginations of a few

pixels

We eliminated from the B-regions the connected regions of less than 20000

at a distance 30 pixels or larger from a region or 20000

were found to be non significant (dust isolated cells small pieces of tis

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ

operations including thresholding at 15 the distance map from the B

Finally we found that B-regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3

the saturation in HSB colour space we applied the

threshold on this image and we defined as high

which was above the isodata

high-saturation pixel were kept as tissue regions

The mask (binary image) of the tissue

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

stored on the disk as a 1-bit-per

high level of compression Then the pieces of the mosaic with overlap were erased from the

disk

If there existed for this WSI a

mask of the region to exclude was formed as a binary image of resolution

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up t

was performed thanks to another in

and RAM economy

Finally the logical and of the mask of sharp regions and of the mask of tissue was computed

through the same C program and stored on the disk as a bilevel Deflate

Again although the resulting mask is a very large image (176

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Similarly we found that holes having a fractal-like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an

operation on them their area was less than 10000 pixels and they did not touch

the boundary of the mosaic piece

Then we made the boundaries of the B-regions (tissue regions) more regular applying an

on their mask This eliminated the small overhangs or invaginations of a few

regions the connected regions of less than 20000 pixels which were

at a distance 30 pixels or larger from a region or 20000 pixels or more Indeed most of those

were found to be non significant (dust isolated cells small pieces of tissue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ by a combination of morphological

operations including thresholding at 15 the distance map from the B-regions

regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at least blue cell nuclei or brown vessel walls)

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3 pixels the image of

the saturation in HSB colour space we applied the isodata algorithm [35] to find an automatic

image and we defined as high-saturation pixels the pixels the saturation of

isodata threshold and above 30 Only B-regions containing at least one

saturation pixel were kept as tissue regions

The mask (binary image) of the tissue regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

per-pixel Deflate-compressed [29] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

If there existed for this WSI a roi file defining the side(s) of the coverslip on th

mask of the region to exclude was formed as a binary image of resolution 0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up to resolution 20times This logical operation

was performed thanks to another in-house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

e C program and stored on the disk as a bilevel Deflate-compressed TIFF file

Again although the resulting mask is a very large image (176 gigapixels in average) this form

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

8

like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an erode

and they did not touch

regions (tissue regions) more regular applying an erode

on their mask This eliminated the small overhangs or invaginations of a few

pixels which were

pixels or more Indeed most of those

sue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

by a combination of morphological

regions

regions with too low saturation (greyish regions) could exist and

least blue cell nuclei or brown vessel walls)

pixels the image of

] to find an automatic

saturation pixels the pixels the saturation of

regions containing at least one

regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in-

house developed C program for the sake of speed and RAM economy The whole mask was

] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

file defining the side(s) of the coverslip on the image the

0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

20times This logical operation

house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

compressed TIFF file

gigapixels in average) this form

of compression is very efficient the average disk size of the mask was 436

026 MiB to 1638 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

corresponding WSI in ltFigure

Figure 2 - Example of a determination of tissue without blur

Top left excerpt of the original image (one of our WSI)

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One c

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

scanner They will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region

regions is superimposed onto the detail of the WSI shown on the b

between ldquofully blurredrdquo on the left

image Green scale bar = 20 microns

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

of compression is very efficient the average disk size of the mask was 436 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

Figure 2gt

Example of a determination of tissue without blur

excerpt of the original image (one of our WSI) Top right the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One can see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region Bottom right

regions is superimposed onto the detail of the WSI shown on the bottom left One sees the transition

between ldquofully blurredrdquo on the left-hand side of the image to ldquofully sharprdquo on the right

microns

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

9

MiB ranging from

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

an see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1 mm Bottom left

the mask of sharp

ottom left One sees the transition

hand side of the image to ldquofully sharprdquo on the right-hand side of the

Removal of puddles of red blood cells

This part of the method is rather c

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

regions of blur-free tissue It was developed on two example WSI but proved efficient on all

We constructed a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

Find Edges command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these re

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

close operation on the resulting mask This is to select t

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold

defined during backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

bit-per-pixel Deflate-compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in

Removing from the mask of sharp tissue pixels considered acco

of red blood cells we built the mask of significant blur

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Removal of puddles of red blood cells

This part of the method is rather cumbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these regions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

operation on the resulting mask This is to select the sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold = 255 035255

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above b and of circularity at most 02 We also added the connect

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in ltFigure 3gt

Removing from the mask of sharp tissue pixels considered according to this mask of puddles

of red blood cells we built the mask of significant blur-free tissue

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

10

umbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

gions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

he sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

were was

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

and of circularity at most 02 We also added the connected

regions of 2800 pixels and above which were constructed by added to these latter regions

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1-

A detail from an example of such a mask of large puddles of red blood cells is shown

rding to this mask of puddles

w

Figure 3 - Example of a determination of large puddles of red blood cells

Top original image (excerpt of one of our WSI)

large puddles of red blood cells was superimposed Scale bar = 20

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

counterstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution

To perform this linear change in colour space we needed to know the optical densities (od) in

R G and B channels (or more precisely only the ratios of these three od to form their vector

in the RGB space [36]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25

measured the average optical densities in the R G and

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and

contribution of markedly blue areas

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Example of a determination of large puddles of red blood cells

original image (excerpt of one of our WSI) Bottom the same image over which the mask of the

large puddles of red blood cells was superimposed Scale bar = 20 microns

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution [36]

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide-to-slide variability as can be seen on

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25 pixels Finally we

measured the average optical densities in the R G and B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and with hue inside the interval [80199] to get the

contribution of markedly blue areas

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

11

the same image over which the mask of the

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of the

slide variability as can be seen on ltFigure 4gt

We used the following procedure on each piece of the 20times mosaic without overlap formed

On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

pixels Finally we

B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

with hue inside the interval [80199] to get the

Figure 4 - Slide-to-slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green

(CD34) staining as defined in [36

the blue optical density to the red optical density

distribution of the values of Δ over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to comput

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

them to a text file

The precise values of the thresholds above are irrelevant the important thing is that the loose

limits on the hue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

calibration of the optical densities of the brown staining rested on 154

563 kilopixels max 288 megapixels) and the calibration of the optical densities of the blue

rested on 104 megapixels (min 109

Selection of vessel walls

The whole process of actual selection of vessel walls operated only on the areas of significant

blur-free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

First the histogram of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in

which took as input the WSI at resolution

the colour deconvolution (average od determined earlier) and operated independently on

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green and blue channels of the brown

36] according to the procedure described in the main text we subtracted

the blue optical density to the red optical density mdash letrsquos call this difference Δ This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to compute the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

ibration of the optical densities of the brown staining rested on 154

megapixels) and the calibration of the optical densities of the blue

megapixels (min 109 megapixels max 842 megapixels)

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in-house developed C program

which took as input the WSI at resolution 20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

12

and blue channels of the brown

] according to the procedure described in the main text we subtracted

This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

e the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

megapixels (min

megapixels) and the calibration of the optical densities of the blue

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

house developed C program

20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

) individual variability and lack of reproducibil

randomly chosen regions or on a few ldquorepresentativerdquo regions on the section

the task easier (shorter) for the pathologist but will increase the measurement variability and

might reinforce the subjectivity of the task

Luckily virtual microscopy and the digitisation of pathology slides have become quite common

over the last few years allowing the use of the computer to perform various quantitative and

reproducible measurements on histology sec

cost and material reasons it was not possible to measure the parameters of microvessels at

full resolution (20x or 40x) and it was suggested to use images at resolution around 1x

15] However slide scanners produce now high resolution microscopy images of whole slides

in a short time (at most a few minutes) and for a reasonable price

quantification should improve the precision of the results The drawback of this high res

is the very large size of the resulting files which require specific software tools to be managed

like the ones some of us have already developed

Such a quantification of microvessels on high

by several groups [20-22] However most of them were limited to small excerpts of the whole

slide images (WSI) and possibly to relatively homogeneous sets of slides Here we report on a

set of techniques we have developed to assess the density of micro

few tens of gigapixels immunostained with CD34 (to reveal vascular endotheli

few minutes in a robust way with a careful determination of zones of tissue without blur and

with as little intervention of the pa

algorithm is necessary hence the time

of vessels to feed to the computer is spared

Although immunofluorescence is able to provide valuable additiona

about the vasculature such as 3D aspects

microscopy and it not yet compatible with clinical routine Therefore we stick to classical

bright field microscopy of immunostained pathology

To demonstrate the versatility and scalability of our method we applied it to a series of 129

human patients (186 WSI in total) suffering brain tumours of 19 different combinations of

histological type and location ranging from WHO grade I to grade IV S

(our largest image had 162688times98816 pixels) they canrsquot be opened in full in a standard

computerrsquos memory (we would need up to 60 GiB of RAM) and we had to develop strategies

to treat them entirely without restricting ourselves to

source software or software we developed based on existing open source libraries to avoid

black-box algorithms to promote interoperability and reproducibility to reduce costs and to

avoid conflicts of interest [24

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

) individual variability and lack of reproducibility Quantifying the vascularity only on a few

randomly chosen regions or on a few ldquorepresentativerdquo regions on the section

the task easier (shorter) for the pathologist but will increase the measurement variability and

subjectivity of the task

Luckily virtual microscopy and the digitisation of pathology slides have become quite common

over the last few years allowing the use of the computer to perform various quantitative and

reproducible measurements on histology sections [13] In the beginning of this digital era for

cost and material reasons it was not possible to measure the parameters of microvessels at

full resolution (20x or 40x) and it was suggested to use images at resolution around 1x

ide scanners produce now high resolution microscopy images of whole slides

in a short time (at most a few minutes) and for a reasonable price [16] and using them for

quantification should improve the precision of the results The drawback of this high res

is the very large size of the resulting files which require specific software tools to be managed

like the ones some of us have already developed [17-19]

Such a quantification of microvessels on high-resolution images has already been undertaken

However most of them were limited to small excerpts of the whole

slide images (WSI) and possibly to relatively homogeneous sets of slides Here we report on a

set of techniques we have developed to assess the density of microvessels on WSI of sizes a

few tens of gigapixels immunostained with CD34 (to reveal vascular endotheli

in a robust way with a careful determination of zones of tissue without blur and

with as little intervention of the pathologist as possible In particular no training of an

algorithm is necessary hence the time-consuming task of manual segmentation of a number

of vessels to feed to the computer is spared

Although immunofluorescence is able to provide valuable additional quantitative information

about the vasculature such as 3D aspects [23] it requires the use of more elaborate

microscopy and it not yet compatible with clinical routine Therefore we stick to classical

bright field microscopy of immunostained pathology thin sections

To demonstrate the versatility and scalability of our method we applied it to a series of 129

human patients (186 WSI in total) suffering brain tumours of 19 different combinations of

histological type and location ranging from WHO grade I to grade IV Since WSI are very large

(our largest image had 162688times98816 pixels) they canrsquot be opened in full in a standard

computerrsquos memory (we would need up to 60 GiB of RAM) and we had to develop strategies

to treat them entirely without restricting ourselves to small excerpts We used only open

source software or software we developed based on existing open source libraries to avoid

box algorithms to promote interoperability and reproducibility to reduce costs and to

24]

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

3

ity Quantifying the vascularity only on a few

randomly chosen regions or on a few ldquorepresentativerdquo regions on the section [12] will make

the task easier (shorter) for the pathologist but will increase the measurement variability and

Luckily virtual microscopy and the digitisation of pathology slides have become quite common

over the last few years allowing the use of the computer to perform various quantitative and

] In the beginning of this digital era for

cost and material reasons it was not possible to measure the parameters of microvessels at

full resolution (20x or 40x) and it was suggested to use images at resolution around 1x [14

ide scanners produce now high resolution microscopy images of whole slides

] and using them for

quantification should improve the precision of the results The drawback of this high resolution

is the very large size of the resulting files which require specific software tools to be managed

resolution images has already been undertaken

However most of them were limited to small excerpts of the whole

slide images (WSI) and possibly to relatively homogeneous sets of slides Here we report on a

vessels on WSI of sizes a

few tens of gigapixels immunostained with CD34 (to reveal vascular endothelial cells) within a

in a robust way with a careful determination of zones of tissue without blur and

thologist as possible In particular no training of an

consuming task of manual segmentation of a number

l quantitative information

] it requires the use of more elaborate

microscopy and it not yet compatible with clinical routine Therefore we stick to classical

To demonstrate the versatility and scalability of our method we applied it to a series of 129

human patients (186 WSI in total) suffering brain tumours of 19 different combinations of

ince WSI are very large

(our largest image had 162688times98816 pixels) they canrsquot be opened in full in a standard

computerrsquos memory (we would need up to 60 GiB of RAM) and we had to develop strategies

small excerpts We used only open

source software or software we developed based on existing open source libraries to avoid

box algorithms to promote interoperability and reproducibility to reduce costs and to

Material and Methods

Our goal is to quantify the density of microvessels on a WSI as the ratio of the area occupied by

vascular endothelial cells to the area occupied by the tissue We assume that the WSI was

obtained as a (possibly pyramidal) tiled TIFF o

magnification 20times or 40times of a 5

tissue and that immunostaining with a CD34 antibody was performed so that microvessels

appear brown whereas cell n

square centimetres

If some deviation from this protocol is in order it should be easy to adapt our method Eg if

the WSI is stored in another format it can be converted to TIFF using t

NDPITools [1719] that we developed or OpenSlide

are different two parameters can be changed (see below)

Method overview

The aim is first to select the zone of tissue on the WSI then the zone

zone of tissue and finally to measure the areas of the two and compute their ratio Because of

unavoidable slide-to-slide variations in staining and digitisation parameters (eg light intensity

or temperature colour) both zon

technical details the work flow will be slightly more complex We must

bull exclude from the WSI regions where the image is not sharp enough to recognise vessel

walls accurately

bull exclude from the WSI regions which look like tissue but should not be counted as such

essentially large puddles of red blood cells coverslip boundaries and dust

bull not count as vessel walls extra

A scheme of the whole process is shown in

Preparatory steps

From the full-resolution 40times image a 20times image was generated by bilinear interpolation and

stored into a JPEG-compressed

sufficient quality for several of the steps below while saving computation time

Then a mosaic of the 20times image was made and stored into JPEG files This is a decomposition

of the original image in rectangular pieces of equal sizes stored into independent f

independent treatment such that the original image is recovered if the pieces are

reassembled together We requested that each piece need at most 128

(uncompressed) in RAM and that the dimensions of each piece be multiples o

can be easily achieved using the

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Our goal is to quantify the density of microvessels on a WSI as the ratio of the area occupied by

vascular endothelial cells to the area occupied by the tissue We assume that the WSI was

obtained as a (possibly pyramidal) tiled TIFF or BigTIFF [25] file by digitisation at objective

magnification 20times or 40times of a 5μm-thick tissue section of formalin-fixed paraffin

tissue and that immunostaining with a CD34 antibody was performed so that microvessels

appear brown whereas cell nuclei appear blue The total area of tissue is typically of a few

If some deviation from this protocol is in order it should be easy to adapt our method Eg if

the WSI is stored in another format it can be converted to TIFF using t

] that we developed or OpenSlide [2627] If the colours after immunostaining

are different two parameters can be changed (see below)

The aim is first to select the zone of tissue on the WSI then the zone of vessel walls inside the

zone of tissue and finally to measure the areas of the two and compute their ratio Because of

slide variations in staining and digitisation parameters (eg light intensity

or temperature colour) both zone selections will require prior calibration steps And due to

technical details the work flow will be slightly more complex We must

exclude from the WSI regions where the image is not sharp enough to recognise vessel

exclude from the WSI regions which look like tissue but should not be counted as such

essentially large puddles of red blood cells coverslip boundaries and dust

not count as vessel walls extra-vascular CD34-positive tumour cells

A scheme of the whole process is shown in ltFigure 1gt

resolution 40times image a 20times image was generated by bilinear interpolation and

compressed [28] tiled TIFF [29] file Indeed such an image proved of

ficient quality for several of the steps below while saving computation time

Then a mosaic of the 20times image was made and stored into JPEG files This is a decomposition

of the original image in rectangular pieces of equal sizes stored into independent f

independent treatment such that the original image is recovered if the pieces are

reassembled together We requested that each piece need at most 128 MiB to be stored

(uncompressed) in RAM and that the dimensions of each piece be multiples o

can be easily achieved using the -m and -M options of the tiffmakemosaic software

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

4

Our goal is to quantify the density of microvessels on a WSI as the ratio of the area occupied by

vascular endothelial cells to the area occupied by the tissue We assume that the WSI was

] file by digitisation at objective

fixed paraffin-embedded

tissue and that immunostaining with a CD34 antibody was performed so that microvessels

uclei appear blue The total area of tissue is typically of a few

If some deviation from this protocol is in order it should be easy to adapt our method Eg if

the WSI is stored in another format it can be converted to TIFF using the free software

If the colours after immunostaining

of vessel walls inside the

zone of tissue and finally to measure the areas of the two and compute their ratio Because of

slide variations in staining and digitisation parameters (eg light intensity

e selections will require prior calibration steps And due to

exclude from the WSI regions where the image is not sharp enough to recognise vessel

exclude from the WSI regions which look like tissue but should not be counted as such

resolution 40times image a 20times image was generated by bilinear interpolation and

] file Indeed such an image proved of

ficient quality for several of the steps below while saving computation time

Then a mosaic of the 20times image was made and stored into JPEG files This is a decomposition

of the original image in rectangular pieces of equal sizes stored into independent files for easy

independent treatment such that the original image is recovered if the pieces are

MiB to be stored

(uncompressed) in RAM and that the dimensions of each piece be multiples of 8 pixels This

software [1719]

Figure 1 - Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

sharp tissue (bottom)

The blue boxes represent real full colour images the checkerboard boxes represent masks (black

white images resulting from the selection of objects) the red boxes represent automatically determined

quantitative parameters the brown box represents the image of the

the original 20times image the green boxes represent the final measured quantities

Selection of sufficiently sharp zones

We used a variation of the method of blur quantification of

mosaic after decompression into RGB colour space we applied a colour space transformation

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

represent real full colour images the checkerboard boxes represent masks (black

white images resulting from the selection of objects) the red boxes represent automatically determined

quantitative parameters the brown box represents the image of the brown optical densities of pixels of

the original 20times image the green boxes represent the final measured quantities

Selection of sufficiently sharp zones

We used a variation of the method of blur quantification of [3031] On each piece of the 20times

mosaic after decompression into RGB colour space we applied a colour space transformation

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

5

Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

represent real full colour images the checkerboard boxes represent masks (black-on-

white images resulting from the selection of objects) the red boxes represent automatically determined

brown optical densities of pixels of

On each piece of the 20times

mosaic after decompression into RGB colour space we applied a colour space transformation

into HSV colour space as defined by the

convoluted the resulting image with the Laplacian ke

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

computed thescore [31] namely the ratio of the sum of pixel intensities which are at least

10 of the maximum intensity in the block to the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

the 20times image while saving disk space artefacts due to this blocking are already present in the

original WSI

We generated a graylevel image where the

encoded as the intensity of one pixel (between 0 and 255 included) The resulting i

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

opened at once in the computerrsquos RAM

Finally this 25times sharpness map was transformed (using the ImageJ software

mask of sharp regions in the following way pixel intensities were averaged over regions of

radius 2 pixels a mask of regions where the resulting intensity is 43 and above was created

(these are the sharp regions) sharp regions of less than 20

were turned into blurred regions then blurred regions of less than 20

turned into sharp regions The final mask of sharp regions was written

Selection of tissue zones

We used as a first criterion to distinguish tissue from background the value of brightness of

pixels (B in HSB colour space as defined by ImageJ

brightness of pixels in the background

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

coverslip on a downscaled 0625times image and stored the

as ImageJrsquos roi files which will be subsequently read at the proper stage

We generated a 25times image from the full resolution image With ImageJ we selected on this

image the non-excluded zones (sides of the coverslip

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

plusmn12 from the Gaussian-weighted average (with standard deviation σ=0005) over their vicinity

We selected connected regions

the intersection with regions where the brightness was 127 or above This defined the

reference regions for the background

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

into HSV colour space as defined by the vips program [32] extracted the V channel and

convoluted the resulting image with the Laplacian kernel 1 1 11 8 11 1 1

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

] namely the ratio of the sum of pixel intensities which are at least

10 of the maximum intensity in the block to the sum of all 64 pixel intensities (or 0 if the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

ving disk space artefacts due to this blocking are already present in the

We generated a graylevel image where thevalue of each block of the 20times image was

encoded as the intensity of one pixel (between 0 and 255 included) The resulting i

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

opened at once in the computerrsquos RAM

ness map was transformed (using the ImageJ software

mask of sharp regions in the following way pixel intensities were averaged over regions of

pixels a mask of regions where the resulting intensity is 43 and above was created

hese are the sharp regions) sharp regions of less than 20 pixels of area (at resolution 25times)

were turned into blurred regions then blurred regions of less than 20 pixels of area were

turned into sharp regions The final mask of sharp regions was written on the disk

We used as a first criterion to distinguish tissue from background the value of brightness of

pixels (B in HSB colour space as defined by ImageJ [33]) Therefore we needed to calibrate the

e background

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

coverslip on a downscaled 0625times image and stored the resulting contour (union of polygons)

files which will be subsequently read at the proper stage

We generated a 25times image from the full resolution image With ImageJ we selected on this

excluded zones (sides of the coverslip) then we extracted the brightness of

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

weighted average (with standard deviation σ=0005) over their vicinity

We selected connected regions of at least 160 pixels among these ldquouniformrdquo pixels and took

the intersection with regions where the brightness was 127 or above This defined the

reference regions for the background

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

6

] extracted the V channel and

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

] namely the ratio of the sum of pixel intensities which are at least

pixel intensities (or 0 if the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

ving disk space artefacts due to this blocking are already present in the

value of each block of the 20times image was

encoded as the intensity of one pixel (between 0 and 255 included) The resulting image

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

ness map was transformed (using the ImageJ software [33 34]) into a

mask of sharp regions in the following way pixel intensities were averaged over regions of

pixels a mask of regions where the resulting intensity is 43 and above was created

pixels of area (at resolution 25times)

pixels of area were

on the disk

We used as a first criterion to distinguish tissue from background the value of brightness of

]) Therefore we needed to calibrate the

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

resulting contour (union of polygons)

We generated a 25times image from the full resolution image With ImageJ we selected on this

) then we extracted the brightness of

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

weighted average (with standard deviation σ=0005) over their vicinity

pixels among these ldquouniformrdquo pixels and took

the intersection with regions where the brightness was 127 or above This defined the

We measured the histogram of the brightness value of the pixels in the

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

the right endof this peak as the largest brightness level which occurs at least once Then

we measured the left end

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

far and either was zero or was larger than the last seen occurrence number

These left- and right-end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

each WSI because of marked variability the left

end ranged from 232 to 249

In addition we selected pixels within the reference regions which had a brightness between

the left-end of the peak and the left

values of R G and B (hereafter called

later use

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with

than 100 MiB of RAM to be opened with overlap of 256

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way

brightness of which was outside the interval measured previously as ldquobackground intensity

peakrdquo mdash call them A

pixels we selected those which containe

space) was larger than the average of the saturation of all A

regions This was to prevent selecting uniform regions with unusual high or low brightness

which could be a large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than

magnification) had to be considered as tissue Therefore we included in the B

holes of area less than 10000

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

10000 pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256

concern only small holes (less than 10000

that is rather elongated holes which was rather uncommon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We measured the histogram of the brightness value of the pixels in the reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

of this peak using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

r was larger than the last seen occurrence number

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

marked variability the left-end ranged from 212 to 234 while the right

In addition we selected pixels within the reference regions which had a brightness between

end of the peak and the left-end plus three (included) and computed their average

values of R G and B (hereafter called ) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with tiffmakemosaic a mosaic such that no piece required more

MiB of RAM to be opened with overlap of 256 pixels between adjacent

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

call them A-pixels Then among the connected regions formed by these

pixels we selected those which contained at least one pixel the saturation of which (in HSB

space) was larger than the average of the saturation of all A-pixels mdash thus constructing the B

regions This was to prevent selecting uniform regions with unusual high or low brightness

large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than asymp 10000

on) had to be considered as tissue Therefore we included in the B

holes of area less than 10000 pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256 pixels The exception would

concern only small holes (less than 10000 pixels) a dimension of which exceeded 256 pixels

that is rather elongated holes which was rather uncommon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

7

reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

k using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

end ranged from 212 to 234 while the right-

In addition we selected pixels within the reference regions which had a brightness between

and computed their average

) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

a mosaic such that no piece required more

pixels between adjacent pieces

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

pixels Then among the connected regions formed by these

d at least one pixel the saturation of which (in HSB

thus constructing the B-

regions This was to prevent selecting uniform regions with unusual high or low brightness

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

asymp 10000 pixels (at 20times

on) had to be considered as tissue Therefore we included in the B-regions the

pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (more than

pixels) extending on another mosaic piece which should not be restored into the B-

regions or a small part of a small hole which would quite probably be entirely included into an

pixels The exception would

pixels) a dimension of which exceeded 256 pixels

Similarly we found that holes having a fractal

the B-regions They were characterised in the following way after we performed an

then a dilate operation on them their area was less than 10000

the boundary of the mosaic piece

Then we made the boundaries of the B

then a dilate on their mask This eliminated the small overhangs or invaginations of a few

pixels

We eliminated from the B-regions the connected regions of less than 20000

at a distance 30 pixels or larger from a region or 20000

were found to be non significant (dust isolated cells small pieces of tis

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ

operations including thresholding at 15 the distance map from the B

Finally we found that B-regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3

the saturation in HSB colour space we applied the

threshold on this image and we defined as high

which was above the isodata

high-saturation pixel were kept as tissue regions

The mask (binary image) of the tissue

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

stored on the disk as a 1-bit-per

high level of compression Then the pieces of the mosaic with overlap were erased from the

disk

If there existed for this WSI a

mask of the region to exclude was formed as a binary image of resolution

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up t

was performed thanks to another in

and RAM economy

Finally the logical and of the mask of sharp regions and of the mask of tissue was computed

through the same C program and stored on the disk as a bilevel Deflate

Again although the resulting mask is a very large image (176

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Similarly we found that holes having a fractal-like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an

operation on them their area was less than 10000 pixels and they did not touch

the boundary of the mosaic piece

Then we made the boundaries of the B-regions (tissue regions) more regular applying an

on their mask This eliminated the small overhangs or invaginations of a few

regions the connected regions of less than 20000 pixels which were

at a distance 30 pixels or larger from a region or 20000 pixels or more Indeed most of those

were found to be non significant (dust isolated cells small pieces of tissue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ by a combination of morphological

operations including thresholding at 15 the distance map from the B-regions

regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at least blue cell nuclei or brown vessel walls)

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3 pixels the image of

the saturation in HSB colour space we applied the isodata algorithm [35] to find an automatic

image and we defined as high-saturation pixels the pixels the saturation of

isodata threshold and above 30 Only B-regions containing at least one

saturation pixel were kept as tissue regions

The mask (binary image) of the tissue regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

per-pixel Deflate-compressed [29] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

If there existed for this WSI a roi file defining the side(s) of the coverslip on th

mask of the region to exclude was formed as a binary image of resolution 0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up to resolution 20times This logical operation

was performed thanks to another in-house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

e C program and stored on the disk as a bilevel Deflate-compressed TIFF file

Again although the resulting mask is a very large image (176 gigapixels in average) this form

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

8

like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an erode

and they did not touch

regions (tissue regions) more regular applying an erode

on their mask This eliminated the small overhangs or invaginations of a few

pixels which were

pixels or more Indeed most of those

sue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

by a combination of morphological

regions

regions with too low saturation (greyish regions) could exist and

least blue cell nuclei or brown vessel walls)

pixels the image of

] to find an automatic

saturation pixels the pixels the saturation of

regions containing at least one

regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in-

house developed C program for the sake of speed and RAM economy The whole mask was

] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

file defining the side(s) of the coverslip on the image the

0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

20times This logical operation

house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

compressed TIFF file

gigapixels in average) this form

of compression is very efficient the average disk size of the mask was 436

026 MiB to 1638 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

corresponding WSI in ltFigure

Figure 2 - Example of a determination of tissue without blur

Top left excerpt of the original image (one of our WSI)

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One c

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

scanner They will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region

regions is superimposed onto the detail of the WSI shown on the b

between ldquofully blurredrdquo on the left

image Green scale bar = 20 microns

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

of compression is very efficient the average disk size of the mask was 436 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

Figure 2gt

Example of a determination of tissue without blur

excerpt of the original image (one of our WSI) Top right the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One can see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region Bottom right

regions is superimposed onto the detail of the WSI shown on the bottom left One sees the transition

between ldquofully blurredrdquo on the left-hand side of the image to ldquofully sharprdquo on the right

microns

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

9

MiB ranging from

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

an see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1 mm Bottom left

the mask of sharp

ottom left One sees the transition

hand side of the image to ldquofully sharprdquo on the right-hand side of the

Removal of puddles of red blood cells

This part of the method is rather c

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

regions of blur-free tissue It was developed on two example WSI but proved efficient on all

We constructed a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

Find Edges command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these re

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

close operation on the resulting mask This is to select t

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold

defined during backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

bit-per-pixel Deflate-compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in

Removing from the mask of sharp tissue pixels considered acco

of red blood cells we built the mask of significant blur

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Removal of puddles of red blood cells

This part of the method is rather cumbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these regions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

operation on the resulting mask This is to select the sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold = 255 035255

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above b and of circularity at most 02 We also added the connect

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in ltFigure 3gt

Removing from the mask of sharp tissue pixels considered according to this mask of puddles

of red blood cells we built the mask of significant blur-free tissue

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

10

umbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

gions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

he sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

were was

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

and of circularity at most 02 We also added the connected

regions of 2800 pixels and above which were constructed by added to these latter regions

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1-

A detail from an example of such a mask of large puddles of red blood cells is shown

rding to this mask of puddles

w

Figure 3 - Example of a determination of large puddles of red blood cells

Top original image (excerpt of one of our WSI)

large puddles of red blood cells was superimposed Scale bar = 20

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

counterstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution

To perform this linear change in colour space we needed to know the optical densities (od) in

R G and B channels (or more precisely only the ratios of these three od to form their vector

in the RGB space [36]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25

measured the average optical densities in the R G and

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and

contribution of markedly blue areas

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Example of a determination of large puddles of red blood cells

original image (excerpt of one of our WSI) Bottom the same image over which the mask of the

large puddles of red blood cells was superimposed Scale bar = 20 microns

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution [36]

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide-to-slide variability as can be seen on

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25 pixels Finally we

measured the average optical densities in the R G and B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and with hue inside the interval [80199] to get the

contribution of markedly blue areas

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

11

the same image over which the mask of the

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of the

slide variability as can be seen on ltFigure 4gt

We used the following procedure on each piece of the 20times mosaic without overlap formed

On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

pixels Finally we

B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

with hue inside the interval [80199] to get the

Figure 4 - Slide-to-slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green

(CD34) staining as defined in [36

the blue optical density to the red optical density

distribution of the values of Δ over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to comput

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

them to a text file

The precise values of the thresholds above are irrelevant the important thing is that the loose

limits on the hue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

calibration of the optical densities of the brown staining rested on 154

563 kilopixels max 288 megapixels) and the calibration of the optical densities of the blue

rested on 104 megapixels (min 109

Selection of vessel walls

The whole process of actual selection of vessel walls operated only on the areas of significant

blur-free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

First the histogram of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in

which took as input the WSI at resolution

the colour deconvolution (average od determined earlier) and operated independently on

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green and blue channels of the brown

36] according to the procedure described in the main text we subtracted

the blue optical density to the red optical density mdash letrsquos call this difference Δ This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to compute the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

ibration of the optical densities of the brown staining rested on 154

megapixels) and the calibration of the optical densities of the blue

megapixels (min 109 megapixels max 842 megapixels)

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in-house developed C program

which took as input the WSI at resolution 20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

12

and blue channels of the brown

] according to the procedure described in the main text we subtracted

This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

e the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

megapixels (min

megapixels) and the calibration of the optical densities of the blue

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

house developed C program

20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

Material and Methods

Our goal is to quantify the density of microvessels on a WSI as the ratio of the area occupied by

vascular endothelial cells to the area occupied by the tissue We assume that the WSI was

obtained as a (possibly pyramidal) tiled TIFF o

magnification 20times or 40times of a 5

tissue and that immunostaining with a CD34 antibody was performed so that microvessels

appear brown whereas cell n

square centimetres

If some deviation from this protocol is in order it should be easy to adapt our method Eg if

the WSI is stored in another format it can be converted to TIFF using t

NDPITools [1719] that we developed or OpenSlide

are different two parameters can be changed (see below)

Method overview

The aim is first to select the zone of tissue on the WSI then the zone

zone of tissue and finally to measure the areas of the two and compute their ratio Because of

unavoidable slide-to-slide variations in staining and digitisation parameters (eg light intensity

or temperature colour) both zon

technical details the work flow will be slightly more complex We must

bull exclude from the WSI regions where the image is not sharp enough to recognise vessel

walls accurately

bull exclude from the WSI regions which look like tissue but should not be counted as such

essentially large puddles of red blood cells coverslip boundaries and dust

bull not count as vessel walls extra

A scheme of the whole process is shown in

Preparatory steps

From the full-resolution 40times image a 20times image was generated by bilinear interpolation and

stored into a JPEG-compressed

sufficient quality for several of the steps below while saving computation time

Then a mosaic of the 20times image was made and stored into JPEG files This is a decomposition

of the original image in rectangular pieces of equal sizes stored into independent f

independent treatment such that the original image is recovered if the pieces are

reassembled together We requested that each piece need at most 128

(uncompressed) in RAM and that the dimensions of each piece be multiples o

can be easily achieved using the

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Our goal is to quantify the density of microvessels on a WSI as the ratio of the area occupied by

vascular endothelial cells to the area occupied by the tissue We assume that the WSI was

obtained as a (possibly pyramidal) tiled TIFF or BigTIFF [25] file by digitisation at objective

magnification 20times or 40times of a 5μm-thick tissue section of formalin-fixed paraffin

tissue and that immunostaining with a CD34 antibody was performed so that microvessels

appear brown whereas cell nuclei appear blue The total area of tissue is typically of a few

If some deviation from this protocol is in order it should be easy to adapt our method Eg if

the WSI is stored in another format it can be converted to TIFF using t

] that we developed or OpenSlide [2627] If the colours after immunostaining

are different two parameters can be changed (see below)

The aim is first to select the zone of tissue on the WSI then the zone of vessel walls inside the

zone of tissue and finally to measure the areas of the two and compute their ratio Because of

slide variations in staining and digitisation parameters (eg light intensity

or temperature colour) both zone selections will require prior calibration steps And due to

technical details the work flow will be slightly more complex We must

exclude from the WSI regions where the image is not sharp enough to recognise vessel

exclude from the WSI regions which look like tissue but should not be counted as such

essentially large puddles of red blood cells coverslip boundaries and dust

not count as vessel walls extra-vascular CD34-positive tumour cells

A scheme of the whole process is shown in ltFigure 1gt

resolution 40times image a 20times image was generated by bilinear interpolation and

compressed [28] tiled TIFF [29] file Indeed such an image proved of

ficient quality for several of the steps below while saving computation time

Then a mosaic of the 20times image was made and stored into JPEG files This is a decomposition

of the original image in rectangular pieces of equal sizes stored into independent f

independent treatment such that the original image is recovered if the pieces are

reassembled together We requested that each piece need at most 128 MiB to be stored

(uncompressed) in RAM and that the dimensions of each piece be multiples o

can be easily achieved using the -m and -M options of the tiffmakemosaic software

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

4

Our goal is to quantify the density of microvessels on a WSI as the ratio of the area occupied by

vascular endothelial cells to the area occupied by the tissue We assume that the WSI was

] file by digitisation at objective

fixed paraffin-embedded

tissue and that immunostaining with a CD34 antibody was performed so that microvessels

uclei appear blue The total area of tissue is typically of a few

If some deviation from this protocol is in order it should be easy to adapt our method Eg if

the WSI is stored in another format it can be converted to TIFF using the free software

If the colours after immunostaining

of vessel walls inside the

zone of tissue and finally to measure the areas of the two and compute their ratio Because of

slide variations in staining and digitisation parameters (eg light intensity

e selections will require prior calibration steps And due to

exclude from the WSI regions where the image is not sharp enough to recognise vessel

exclude from the WSI regions which look like tissue but should not be counted as such

resolution 40times image a 20times image was generated by bilinear interpolation and

] file Indeed such an image proved of

ficient quality for several of the steps below while saving computation time

Then a mosaic of the 20times image was made and stored into JPEG files This is a decomposition

of the original image in rectangular pieces of equal sizes stored into independent files for easy

independent treatment such that the original image is recovered if the pieces are

MiB to be stored

(uncompressed) in RAM and that the dimensions of each piece be multiples of 8 pixels This

software [1719]

Figure 1 - Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

sharp tissue (bottom)

The blue boxes represent real full colour images the checkerboard boxes represent masks (black

white images resulting from the selection of objects) the red boxes represent automatically determined

quantitative parameters the brown box represents the image of the

the original 20times image the green boxes represent the final measured quantities

Selection of sufficiently sharp zones

We used a variation of the method of blur quantification of

mosaic after decompression into RGB colour space we applied a colour space transformation

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

represent real full colour images the checkerboard boxes represent masks (black

white images resulting from the selection of objects) the red boxes represent automatically determined

quantitative parameters the brown box represents the image of the brown optical densities of pixels of

the original 20times image the green boxes represent the final measured quantities

Selection of sufficiently sharp zones

We used a variation of the method of blur quantification of [3031] On each piece of the 20times

mosaic after decompression into RGB colour space we applied a colour space transformation

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

5

Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

represent real full colour images the checkerboard boxes represent masks (black-on-

white images resulting from the selection of objects) the red boxes represent automatically determined

brown optical densities of pixels of

On each piece of the 20times

mosaic after decompression into RGB colour space we applied a colour space transformation

into HSV colour space as defined by the

convoluted the resulting image with the Laplacian ke

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

computed thescore [31] namely the ratio of the sum of pixel intensities which are at least

10 of the maximum intensity in the block to the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

the 20times image while saving disk space artefacts due to this blocking are already present in the

original WSI

We generated a graylevel image where the

encoded as the intensity of one pixel (between 0 and 255 included) The resulting i

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

opened at once in the computerrsquos RAM

Finally this 25times sharpness map was transformed (using the ImageJ software

mask of sharp regions in the following way pixel intensities were averaged over regions of

radius 2 pixels a mask of regions where the resulting intensity is 43 and above was created

(these are the sharp regions) sharp regions of less than 20

were turned into blurred regions then blurred regions of less than 20

turned into sharp regions The final mask of sharp regions was written

Selection of tissue zones

We used as a first criterion to distinguish tissue from background the value of brightness of

pixels (B in HSB colour space as defined by ImageJ

brightness of pixels in the background

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

coverslip on a downscaled 0625times image and stored the

as ImageJrsquos roi files which will be subsequently read at the proper stage

We generated a 25times image from the full resolution image With ImageJ we selected on this

image the non-excluded zones (sides of the coverslip

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

plusmn12 from the Gaussian-weighted average (with standard deviation σ=0005) over their vicinity

We selected connected regions

the intersection with regions where the brightness was 127 or above This defined the

reference regions for the background

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

into HSV colour space as defined by the vips program [32] extracted the V channel and

convoluted the resulting image with the Laplacian kernel 1 1 11 8 11 1 1

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

] namely the ratio of the sum of pixel intensities which are at least

10 of the maximum intensity in the block to the sum of all 64 pixel intensities (or 0 if the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

ving disk space artefacts due to this blocking are already present in the

We generated a graylevel image where thevalue of each block of the 20times image was

encoded as the intensity of one pixel (between 0 and 255 included) The resulting i

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

opened at once in the computerrsquos RAM

ness map was transformed (using the ImageJ software

mask of sharp regions in the following way pixel intensities were averaged over regions of

pixels a mask of regions where the resulting intensity is 43 and above was created

hese are the sharp regions) sharp regions of less than 20 pixels of area (at resolution 25times)

were turned into blurred regions then blurred regions of less than 20 pixels of area were

turned into sharp regions The final mask of sharp regions was written on the disk

We used as a first criterion to distinguish tissue from background the value of brightness of

pixels (B in HSB colour space as defined by ImageJ [33]) Therefore we needed to calibrate the

e background

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

coverslip on a downscaled 0625times image and stored the resulting contour (union of polygons)

files which will be subsequently read at the proper stage

We generated a 25times image from the full resolution image With ImageJ we selected on this

excluded zones (sides of the coverslip) then we extracted the brightness of

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

weighted average (with standard deviation σ=0005) over their vicinity

We selected connected regions of at least 160 pixels among these ldquouniformrdquo pixels and took

the intersection with regions where the brightness was 127 or above This defined the

reference regions for the background

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

6

] extracted the V channel and

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

] namely the ratio of the sum of pixel intensities which are at least

pixel intensities (or 0 if the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

ving disk space artefacts due to this blocking are already present in the

value of each block of the 20times image was

encoded as the intensity of one pixel (between 0 and 255 included) The resulting image

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

ness map was transformed (using the ImageJ software [33 34]) into a

mask of sharp regions in the following way pixel intensities were averaged over regions of

pixels a mask of regions where the resulting intensity is 43 and above was created

pixels of area (at resolution 25times)

pixels of area were

on the disk

We used as a first criterion to distinguish tissue from background the value of brightness of

]) Therefore we needed to calibrate the

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

resulting contour (union of polygons)

We generated a 25times image from the full resolution image With ImageJ we selected on this

) then we extracted the brightness of

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

weighted average (with standard deviation σ=0005) over their vicinity

pixels among these ldquouniformrdquo pixels and took

the intersection with regions where the brightness was 127 or above This defined the

We measured the histogram of the brightness value of the pixels in the

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

the right endof this peak as the largest brightness level which occurs at least once Then

we measured the left end

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

far and either was zero or was larger than the last seen occurrence number

These left- and right-end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

each WSI because of marked variability the left

end ranged from 232 to 249

In addition we selected pixels within the reference regions which had a brightness between

the left-end of the peak and the left

values of R G and B (hereafter called

later use

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with

than 100 MiB of RAM to be opened with overlap of 256

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way

brightness of which was outside the interval measured previously as ldquobackground intensity

peakrdquo mdash call them A

pixels we selected those which containe

space) was larger than the average of the saturation of all A

regions This was to prevent selecting uniform regions with unusual high or low brightness

which could be a large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than

magnification) had to be considered as tissue Therefore we included in the B

holes of area less than 10000

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

10000 pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256

concern only small holes (less than 10000

that is rather elongated holes which was rather uncommon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We measured the histogram of the brightness value of the pixels in the reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

of this peak using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

r was larger than the last seen occurrence number

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

marked variability the left-end ranged from 212 to 234 while the right

In addition we selected pixels within the reference regions which had a brightness between

end of the peak and the left-end plus three (included) and computed their average

values of R G and B (hereafter called ) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with tiffmakemosaic a mosaic such that no piece required more

MiB of RAM to be opened with overlap of 256 pixels between adjacent

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

call them A-pixels Then among the connected regions formed by these

pixels we selected those which contained at least one pixel the saturation of which (in HSB

space) was larger than the average of the saturation of all A-pixels mdash thus constructing the B

regions This was to prevent selecting uniform regions with unusual high or low brightness

large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than asymp 10000

on) had to be considered as tissue Therefore we included in the B

holes of area less than 10000 pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256 pixels The exception would

concern only small holes (less than 10000 pixels) a dimension of which exceeded 256 pixels

that is rather elongated holes which was rather uncommon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

7

reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

k using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

end ranged from 212 to 234 while the right-

In addition we selected pixels within the reference regions which had a brightness between

and computed their average

) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

a mosaic such that no piece required more

pixels between adjacent pieces

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

pixels Then among the connected regions formed by these

d at least one pixel the saturation of which (in HSB

thus constructing the B-

regions This was to prevent selecting uniform regions with unusual high or low brightness

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

asymp 10000 pixels (at 20times

on) had to be considered as tissue Therefore we included in the B-regions the

pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (more than

pixels) extending on another mosaic piece which should not be restored into the B-

regions or a small part of a small hole which would quite probably be entirely included into an

pixels The exception would

pixels) a dimension of which exceeded 256 pixels

Similarly we found that holes having a fractal

the B-regions They were characterised in the following way after we performed an

then a dilate operation on them their area was less than 10000

the boundary of the mosaic piece

Then we made the boundaries of the B

then a dilate on their mask This eliminated the small overhangs or invaginations of a few

pixels

We eliminated from the B-regions the connected regions of less than 20000

at a distance 30 pixels or larger from a region or 20000

were found to be non significant (dust isolated cells small pieces of tis

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ

operations including thresholding at 15 the distance map from the B

Finally we found that B-regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3

the saturation in HSB colour space we applied the

threshold on this image and we defined as high

which was above the isodata

high-saturation pixel were kept as tissue regions

The mask (binary image) of the tissue

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

stored on the disk as a 1-bit-per

high level of compression Then the pieces of the mosaic with overlap were erased from the

disk

If there existed for this WSI a

mask of the region to exclude was formed as a binary image of resolution

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up t

was performed thanks to another in

and RAM economy

Finally the logical and of the mask of sharp regions and of the mask of tissue was computed

through the same C program and stored on the disk as a bilevel Deflate

Again although the resulting mask is a very large image (176

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Similarly we found that holes having a fractal-like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an

operation on them their area was less than 10000 pixels and they did not touch

the boundary of the mosaic piece

Then we made the boundaries of the B-regions (tissue regions) more regular applying an

on their mask This eliminated the small overhangs or invaginations of a few

regions the connected regions of less than 20000 pixels which were

at a distance 30 pixels or larger from a region or 20000 pixels or more Indeed most of those

were found to be non significant (dust isolated cells small pieces of tissue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ by a combination of morphological

operations including thresholding at 15 the distance map from the B-regions

regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at least blue cell nuclei or brown vessel walls)

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3 pixels the image of

the saturation in HSB colour space we applied the isodata algorithm [35] to find an automatic

image and we defined as high-saturation pixels the pixels the saturation of

isodata threshold and above 30 Only B-regions containing at least one

saturation pixel were kept as tissue regions

The mask (binary image) of the tissue regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

per-pixel Deflate-compressed [29] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

If there existed for this WSI a roi file defining the side(s) of the coverslip on th

mask of the region to exclude was formed as a binary image of resolution 0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up to resolution 20times This logical operation

was performed thanks to another in-house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

e C program and stored on the disk as a bilevel Deflate-compressed TIFF file

Again although the resulting mask is a very large image (176 gigapixels in average) this form

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

8

like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an erode

and they did not touch

regions (tissue regions) more regular applying an erode

on their mask This eliminated the small overhangs or invaginations of a few

pixels which were

pixels or more Indeed most of those

sue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

by a combination of morphological

regions

regions with too low saturation (greyish regions) could exist and

least blue cell nuclei or brown vessel walls)

pixels the image of

] to find an automatic

saturation pixels the pixels the saturation of

regions containing at least one

regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in-

house developed C program for the sake of speed and RAM economy The whole mask was

] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

file defining the side(s) of the coverslip on the image the

0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

20times This logical operation

house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

compressed TIFF file

gigapixels in average) this form

of compression is very efficient the average disk size of the mask was 436

026 MiB to 1638 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

corresponding WSI in ltFigure

Figure 2 - Example of a determination of tissue without blur

Top left excerpt of the original image (one of our WSI)

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One c

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

scanner They will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region

regions is superimposed onto the detail of the WSI shown on the b

between ldquofully blurredrdquo on the left

image Green scale bar = 20 microns

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

of compression is very efficient the average disk size of the mask was 436 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

Figure 2gt

Example of a determination of tissue without blur

excerpt of the original image (one of our WSI) Top right the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One can see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region Bottom right

regions is superimposed onto the detail of the WSI shown on the bottom left One sees the transition

between ldquofully blurredrdquo on the left-hand side of the image to ldquofully sharprdquo on the right

microns

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

9

MiB ranging from

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

an see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1 mm Bottom left

the mask of sharp

ottom left One sees the transition

hand side of the image to ldquofully sharprdquo on the right-hand side of the

Removal of puddles of red blood cells

This part of the method is rather c

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

regions of blur-free tissue It was developed on two example WSI but proved efficient on all

We constructed a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

Find Edges command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these re

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

close operation on the resulting mask This is to select t

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold

defined during backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

bit-per-pixel Deflate-compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in

Removing from the mask of sharp tissue pixels considered acco

of red blood cells we built the mask of significant blur

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Removal of puddles of red blood cells

This part of the method is rather cumbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these regions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

operation on the resulting mask This is to select the sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold = 255 035255

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above b and of circularity at most 02 We also added the connect

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in ltFigure 3gt

Removing from the mask of sharp tissue pixels considered according to this mask of puddles

of red blood cells we built the mask of significant blur-free tissue

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

10

umbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

gions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

he sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

were was

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

and of circularity at most 02 We also added the connected

regions of 2800 pixels and above which were constructed by added to these latter regions

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1-

A detail from an example of such a mask of large puddles of red blood cells is shown

rding to this mask of puddles

w

Figure 3 - Example of a determination of large puddles of red blood cells

Top original image (excerpt of one of our WSI)

large puddles of red blood cells was superimposed Scale bar = 20

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

counterstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution

To perform this linear change in colour space we needed to know the optical densities (od) in

R G and B channels (or more precisely only the ratios of these three od to form their vector

in the RGB space [36]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25

measured the average optical densities in the R G and

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and

contribution of markedly blue areas

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Example of a determination of large puddles of red blood cells

original image (excerpt of one of our WSI) Bottom the same image over which the mask of the

large puddles of red blood cells was superimposed Scale bar = 20 microns

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution [36]

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide-to-slide variability as can be seen on

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25 pixels Finally we

measured the average optical densities in the R G and B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and with hue inside the interval [80199] to get the

contribution of markedly blue areas

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

11

the same image over which the mask of the

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of the

slide variability as can be seen on ltFigure 4gt

We used the following procedure on each piece of the 20times mosaic without overlap formed

On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

pixels Finally we

B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

with hue inside the interval [80199] to get the

Figure 4 - Slide-to-slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green

(CD34) staining as defined in [36

the blue optical density to the red optical density

distribution of the values of Δ over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to comput

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

them to a text file

The precise values of the thresholds above are irrelevant the important thing is that the loose

limits on the hue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

calibration of the optical densities of the brown staining rested on 154

563 kilopixels max 288 megapixels) and the calibration of the optical densities of the blue

rested on 104 megapixels (min 109

Selection of vessel walls

The whole process of actual selection of vessel walls operated only on the areas of significant

blur-free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

First the histogram of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in

which took as input the WSI at resolution

the colour deconvolution (average od determined earlier) and operated independently on

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green and blue channels of the brown

36] according to the procedure described in the main text we subtracted

the blue optical density to the red optical density mdash letrsquos call this difference Δ This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to compute the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

ibration of the optical densities of the brown staining rested on 154

megapixels) and the calibration of the optical densities of the blue

megapixels (min 109 megapixels max 842 megapixels)

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in-house developed C program

which took as input the WSI at resolution 20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

12

and blue channels of the brown

] according to the procedure described in the main text we subtracted

This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

e the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

megapixels (min

megapixels) and the calibration of the optical densities of the blue

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

house developed C program

20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

Figure 1 - Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

sharp tissue (bottom)

The blue boxes represent real full colour images the checkerboard boxes represent masks (black

white images resulting from the selection of objects) the red boxes represent automatically determined

quantitative parameters the brown box represents the image of the

the original 20times image the green boxes represent the final measured quantities

Selection of sufficiently sharp zones

We used a variation of the method of blur quantification of

mosaic after decompression into RGB colour space we applied a colour space transformation

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

represent real full colour images the checkerboard boxes represent masks (black

white images resulting from the selection of objects) the red boxes represent automatically determined

quantitative parameters the brown box represents the image of the brown optical densities of pixels of

the original 20times image the green boxes represent the final measured quantities

Selection of sufficiently sharp zones

We used a variation of the method of blur quantification of [3031] On each piece of the 20times

mosaic after decompression into RGB colour space we applied a colour space transformation

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

5

Overview of the whole method of selection of sharp tissue (top) and of vessel walls inside

represent real full colour images the checkerboard boxes represent masks (black-on-

white images resulting from the selection of objects) the red boxes represent automatically determined

brown optical densities of pixels of

On each piece of the 20times

mosaic after decompression into RGB colour space we applied a colour space transformation

into HSV colour space as defined by the

convoluted the resulting image with the Laplacian ke

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

computed thescore [31] namely the ratio of the sum of pixel intensities which are at least

10 of the maximum intensity in the block to the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

the 20times image while saving disk space artefacts due to this blocking are already present in the

original WSI

We generated a graylevel image where the

encoded as the intensity of one pixel (between 0 and 255 included) The resulting i

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

opened at once in the computerrsquos RAM

Finally this 25times sharpness map was transformed (using the ImageJ software

mask of sharp regions in the following way pixel intensities were averaged over regions of

radius 2 pixels a mask of regions where the resulting intensity is 43 and above was created

(these are the sharp regions) sharp regions of less than 20

were turned into blurred regions then blurred regions of less than 20

turned into sharp regions The final mask of sharp regions was written

Selection of tissue zones

We used as a first criterion to distinguish tissue from background the value of brightness of

pixels (B in HSB colour space as defined by ImageJ

brightness of pixels in the background

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

coverslip on a downscaled 0625times image and stored the

as ImageJrsquos roi files which will be subsequently read at the proper stage

We generated a 25times image from the full resolution image With ImageJ we selected on this

image the non-excluded zones (sides of the coverslip

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

plusmn12 from the Gaussian-weighted average (with standard deviation σ=0005) over their vicinity

We selected connected regions

the intersection with regions where the brightness was 127 or above This defined the

reference regions for the background

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

into HSV colour space as defined by the vips program [32] extracted the V channel and

convoluted the resulting image with the Laplacian kernel 1 1 11 8 11 1 1

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

] namely the ratio of the sum of pixel intensities which are at least

10 of the maximum intensity in the block to the sum of all 64 pixel intensities (or 0 if the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

ving disk space artefacts due to this blocking are already present in the

We generated a graylevel image where thevalue of each block of the 20times image was

encoded as the intensity of one pixel (between 0 and 255 included) The resulting i

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

opened at once in the computerrsquos RAM

ness map was transformed (using the ImageJ software

mask of sharp regions in the following way pixel intensities were averaged over regions of

pixels a mask of regions where the resulting intensity is 43 and above was created

hese are the sharp regions) sharp regions of less than 20 pixels of area (at resolution 25times)

were turned into blurred regions then blurred regions of less than 20 pixels of area were

turned into sharp regions The final mask of sharp regions was written on the disk

We used as a first criterion to distinguish tissue from background the value of brightness of

pixels (B in HSB colour space as defined by ImageJ [33]) Therefore we needed to calibrate the

e background

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

coverslip on a downscaled 0625times image and stored the resulting contour (union of polygons)

files which will be subsequently read at the proper stage

We generated a 25times image from the full resolution image With ImageJ we selected on this

excluded zones (sides of the coverslip) then we extracted the brightness of

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

weighted average (with standard deviation σ=0005) over their vicinity

We selected connected regions of at least 160 pixels among these ldquouniformrdquo pixels and took

the intersection with regions where the brightness was 127 or above This defined the

reference regions for the background

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

6

] extracted the V channel and

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

] namely the ratio of the sum of pixel intensities which are at least

pixel intensities (or 0 if the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

ving disk space artefacts due to this blocking are already present in the

value of each block of the 20times image was

encoded as the intensity of one pixel (between 0 and 255 included) The resulting image

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

ness map was transformed (using the ImageJ software [33 34]) into a

mask of sharp regions in the following way pixel intensities were averaged over regions of

pixels a mask of regions where the resulting intensity is 43 and above was created

pixels of area (at resolution 25times)

pixels of area were

on the disk

We used as a first criterion to distinguish tissue from background the value of brightness of

]) Therefore we needed to calibrate the

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

resulting contour (union of polygons)

We generated a 25times image from the full resolution image With ImageJ we selected on this

) then we extracted the brightness of

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

weighted average (with standard deviation σ=0005) over their vicinity

pixels among these ldquouniformrdquo pixels and took

the intersection with regions where the brightness was 127 or above This defined the

We measured the histogram of the brightness value of the pixels in the

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

the right endof this peak as the largest brightness level which occurs at least once Then

we measured the left end

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

far and either was zero or was larger than the last seen occurrence number

These left- and right-end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

each WSI because of marked variability the left

end ranged from 232 to 249

In addition we selected pixels within the reference regions which had a brightness between

the left-end of the peak and the left

values of R G and B (hereafter called

later use

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with

than 100 MiB of RAM to be opened with overlap of 256

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way

brightness of which was outside the interval measured previously as ldquobackground intensity

peakrdquo mdash call them A

pixels we selected those which containe

space) was larger than the average of the saturation of all A

regions This was to prevent selecting uniform regions with unusual high or low brightness

which could be a large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than

magnification) had to be considered as tissue Therefore we included in the B

holes of area less than 10000

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

10000 pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256

concern only small holes (less than 10000

that is rather elongated holes which was rather uncommon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We measured the histogram of the brightness value of the pixels in the reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

of this peak using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

r was larger than the last seen occurrence number

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

marked variability the left-end ranged from 212 to 234 while the right

In addition we selected pixels within the reference regions which had a brightness between

end of the peak and the left-end plus three (included) and computed their average

values of R G and B (hereafter called ) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with tiffmakemosaic a mosaic such that no piece required more

MiB of RAM to be opened with overlap of 256 pixels between adjacent

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

call them A-pixels Then among the connected regions formed by these

pixels we selected those which contained at least one pixel the saturation of which (in HSB

space) was larger than the average of the saturation of all A-pixels mdash thus constructing the B

regions This was to prevent selecting uniform regions with unusual high or low brightness

large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than asymp 10000

on) had to be considered as tissue Therefore we included in the B

holes of area less than 10000 pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256 pixels The exception would

concern only small holes (less than 10000 pixels) a dimension of which exceeded 256 pixels

that is rather elongated holes which was rather uncommon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

7

reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

k using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

end ranged from 212 to 234 while the right-

In addition we selected pixels within the reference regions which had a brightness between

and computed their average

) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

a mosaic such that no piece required more

pixels between adjacent pieces

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

pixels Then among the connected regions formed by these

d at least one pixel the saturation of which (in HSB

thus constructing the B-

regions This was to prevent selecting uniform regions with unusual high or low brightness

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

asymp 10000 pixels (at 20times

on) had to be considered as tissue Therefore we included in the B-regions the

pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (more than

pixels) extending on another mosaic piece which should not be restored into the B-

regions or a small part of a small hole which would quite probably be entirely included into an

pixels The exception would

pixels) a dimension of which exceeded 256 pixels

Similarly we found that holes having a fractal

the B-regions They were characterised in the following way after we performed an

then a dilate operation on them their area was less than 10000

the boundary of the mosaic piece

Then we made the boundaries of the B

then a dilate on their mask This eliminated the small overhangs or invaginations of a few

pixels

We eliminated from the B-regions the connected regions of less than 20000

at a distance 30 pixels or larger from a region or 20000

were found to be non significant (dust isolated cells small pieces of tis

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ

operations including thresholding at 15 the distance map from the B

Finally we found that B-regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3

the saturation in HSB colour space we applied the

threshold on this image and we defined as high

which was above the isodata

high-saturation pixel were kept as tissue regions

The mask (binary image) of the tissue

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

stored on the disk as a 1-bit-per

high level of compression Then the pieces of the mosaic with overlap were erased from the

disk

If there existed for this WSI a

mask of the region to exclude was formed as a binary image of resolution

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up t

was performed thanks to another in

and RAM economy

Finally the logical and of the mask of sharp regions and of the mask of tissue was computed

through the same C program and stored on the disk as a bilevel Deflate

Again although the resulting mask is a very large image (176

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Similarly we found that holes having a fractal-like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an

operation on them their area was less than 10000 pixels and they did not touch

the boundary of the mosaic piece

Then we made the boundaries of the B-regions (tissue regions) more regular applying an

on their mask This eliminated the small overhangs or invaginations of a few

regions the connected regions of less than 20000 pixels which were

at a distance 30 pixels or larger from a region or 20000 pixels or more Indeed most of those

were found to be non significant (dust isolated cells small pieces of tissue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ by a combination of morphological

operations including thresholding at 15 the distance map from the B-regions

regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at least blue cell nuclei or brown vessel walls)

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3 pixels the image of

the saturation in HSB colour space we applied the isodata algorithm [35] to find an automatic

image and we defined as high-saturation pixels the pixels the saturation of

isodata threshold and above 30 Only B-regions containing at least one

saturation pixel were kept as tissue regions

The mask (binary image) of the tissue regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

per-pixel Deflate-compressed [29] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

If there existed for this WSI a roi file defining the side(s) of the coverslip on th

mask of the region to exclude was formed as a binary image of resolution 0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up to resolution 20times This logical operation

was performed thanks to another in-house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

e C program and stored on the disk as a bilevel Deflate-compressed TIFF file

Again although the resulting mask is a very large image (176 gigapixels in average) this form

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

8

like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an erode

and they did not touch

regions (tissue regions) more regular applying an erode

on their mask This eliminated the small overhangs or invaginations of a few

pixels which were

pixels or more Indeed most of those

sue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

by a combination of morphological

regions

regions with too low saturation (greyish regions) could exist and

least blue cell nuclei or brown vessel walls)

pixels the image of

] to find an automatic

saturation pixels the pixels the saturation of

regions containing at least one

regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in-

house developed C program for the sake of speed and RAM economy The whole mask was

] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

file defining the side(s) of the coverslip on the image the

0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

20times This logical operation

house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

compressed TIFF file

gigapixels in average) this form

of compression is very efficient the average disk size of the mask was 436

026 MiB to 1638 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

corresponding WSI in ltFigure

Figure 2 - Example of a determination of tissue without blur

Top left excerpt of the original image (one of our WSI)

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One c

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

scanner They will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region

regions is superimposed onto the detail of the WSI shown on the b

between ldquofully blurredrdquo on the left

image Green scale bar = 20 microns

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

of compression is very efficient the average disk size of the mask was 436 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

Figure 2gt

Example of a determination of tissue without blur

excerpt of the original image (one of our WSI) Top right the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One can see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region Bottom right

regions is superimposed onto the detail of the WSI shown on the bottom left One sees the transition

between ldquofully blurredrdquo on the left-hand side of the image to ldquofully sharprdquo on the right

microns

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

9

MiB ranging from

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

an see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1 mm Bottom left

the mask of sharp

ottom left One sees the transition

hand side of the image to ldquofully sharprdquo on the right-hand side of the

Removal of puddles of red blood cells

This part of the method is rather c

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

regions of blur-free tissue It was developed on two example WSI but proved efficient on all

We constructed a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

Find Edges command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these re

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

close operation on the resulting mask This is to select t

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold

defined during backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

bit-per-pixel Deflate-compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in

Removing from the mask of sharp tissue pixels considered acco

of red blood cells we built the mask of significant blur

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Removal of puddles of red blood cells

This part of the method is rather cumbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these regions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

operation on the resulting mask This is to select the sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold = 255 035255

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above b and of circularity at most 02 We also added the connect

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in ltFigure 3gt

Removing from the mask of sharp tissue pixels considered according to this mask of puddles

of red blood cells we built the mask of significant blur-free tissue

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

10

umbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

gions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

he sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

were was

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

and of circularity at most 02 We also added the connected

regions of 2800 pixels and above which were constructed by added to these latter regions

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1-

A detail from an example of such a mask of large puddles of red blood cells is shown

rding to this mask of puddles

w

Figure 3 - Example of a determination of large puddles of red blood cells

Top original image (excerpt of one of our WSI)

large puddles of red blood cells was superimposed Scale bar = 20

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

counterstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution

To perform this linear change in colour space we needed to know the optical densities (od) in

R G and B channels (or more precisely only the ratios of these three od to form their vector

in the RGB space [36]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25

measured the average optical densities in the R G and

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and

contribution of markedly blue areas

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Example of a determination of large puddles of red blood cells

original image (excerpt of one of our WSI) Bottom the same image over which the mask of the

large puddles of red blood cells was superimposed Scale bar = 20 microns

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution [36]

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide-to-slide variability as can be seen on

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25 pixels Finally we

measured the average optical densities in the R G and B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and with hue inside the interval [80199] to get the

contribution of markedly blue areas

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

11

the same image over which the mask of the

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of the

slide variability as can be seen on ltFigure 4gt

We used the following procedure on each piece of the 20times mosaic without overlap formed

On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

pixels Finally we

B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

with hue inside the interval [80199] to get the

Figure 4 - Slide-to-slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green

(CD34) staining as defined in [36

the blue optical density to the red optical density

distribution of the values of Δ over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to comput

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

them to a text file

The precise values of the thresholds above are irrelevant the important thing is that the loose

limits on the hue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

calibration of the optical densities of the brown staining rested on 154

563 kilopixels max 288 megapixels) and the calibration of the optical densities of the blue

rested on 104 megapixels (min 109

Selection of vessel walls

The whole process of actual selection of vessel walls operated only on the areas of significant

blur-free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

First the histogram of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in

which took as input the WSI at resolution

the colour deconvolution (average od determined earlier) and operated independently on

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green and blue channels of the brown

36] according to the procedure described in the main text we subtracted

the blue optical density to the red optical density mdash letrsquos call this difference Δ This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to compute the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

ibration of the optical densities of the brown staining rested on 154

megapixels) and the calibration of the optical densities of the blue

megapixels (min 109 megapixels max 842 megapixels)

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in-house developed C program

which took as input the WSI at resolution 20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

12

and blue channels of the brown

] according to the procedure described in the main text we subtracted

This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

e the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

megapixels (min

megapixels) and the calibration of the optical densities of the blue

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

house developed C program

20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

into HSV colour space as defined by the

convoluted the resulting image with the Laplacian ke

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

computed thescore [31] namely the ratio of the sum of pixel intensities which are at least

10 of the maximum intensity in the block to the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

the 20times image while saving disk space artefacts due to this blocking are already present in the

original WSI

We generated a graylevel image where the

encoded as the intensity of one pixel (between 0 and 255 included) The resulting i

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

opened at once in the computerrsquos RAM

Finally this 25times sharpness map was transformed (using the ImageJ software

mask of sharp regions in the following way pixel intensities were averaged over regions of

radius 2 pixels a mask of regions where the resulting intensity is 43 and above was created

(these are the sharp regions) sharp regions of less than 20

were turned into blurred regions then blurred regions of less than 20

turned into sharp regions The final mask of sharp regions was written

Selection of tissue zones

We used as a first criterion to distinguish tissue from background the value of brightness of

pixels (B in HSB colour space as defined by ImageJ

brightness of pixels in the background

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

coverslip on a downscaled 0625times image and stored the

as ImageJrsquos roi files which will be subsequently read at the proper stage

We generated a 25times image from the full resolution image With ImageJ we selected on this

image the non-excluded zones (sides of the coverslip

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

plusmn12 from the Gaussian-weighted average (with standard deviation σ=0005) over their vicinity

We selected connected regions

the intersection with regions where the brightness was 127 or above This defined the

reference regions for the background

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

into HSV colour space as defined by the vips program [32] extracted the V channel and

convoluted the resulting image with the Laplacian kernel 1 1 11 8 11 1 1

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

] namely the ratio of the sum of pixel intensities which are at least

10 of the maximum intensity in the block to the sum of all 64 pixel intensities (or 0 if the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

ving disk space artefacts due to this blocking are already present in the

We generated a graylevel image where thevalue of each block of the 20times image was

encoded as the intensity of one pixel (between 0 and 255 included) The resulting i

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

opened at once in the computerrsquos RAM

ness map was transformed (using the ImageJ software

mask of sharp regions in the following way pixel intensities were averaged over regions of

pixels a mask of regions where the resulting intensity is 43 and above was created

hese are the sharp regions) sharp regions of less than 20 pixels of area (at resolution 25times)

were turned into blurred regions then blurred regions of less than 20 pixels of area were

turned into sharp regions The final mask of sharp regions was written on the disk

We used as a first criterion to distinguish tissue from background the value of brightness of

pixels (B in HSB colour space as defined by ImageJ [33]) Therefore we needed to calibrate the

e background

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

coverslip on a downscaled 0625times image and stored the resulting contour (union of polygons)

files which will be subsequently read at the proper stage

We generated a 25times image from the full resolution image With ImageJ we selected on this

excluded zones (sides of the coverslip) then we extracted the brightness of

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

weighted average (with standard deviation σ=0005) over their vicinity

We selected connected regions of at least 160 pixels among these ldquouniformrdquo pixels and took

the intersection with regions where the brightness was 127 or above This defined the

reference regions for the background

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

6

] extracted the V channel and

Then considering the result of the convolution as a mosaic of blocks of 8times8 pixels we

] namely the ratio of the sum of pixel intensities which are at least

pixel intensities (or 0 if the

denominator is vanishing) Such a division into blocks of 8times8 pixels is natural since it is at the

basis of the JPEG compression used by most slide scanners and used by our method to store

ving disk space artefacts due to this blocking are already present in the

value of each block of the 20times image was

encoded as the intensity of one pixel (between 0 and 255 included) The resulting image

which can be deemed a sharpness map is 16 times smaller (in linear dimension) than the

original 40times image thus has 256 times less pixels and could easily be stored in a single file and

ness map was transformed (using the ImageJ software [33 34]) into a

mask of sharp regions in the following way pixel intensities were averaged over regions of

pixels a mask of regions where the resulting intensity is 43 and above was created

pixels of area (at resolution 25times)

pixels of area were

on the disk

We used as a first criterion to distinguish tissue from background the value of brightness of

]) Therefore we needed to calibrate the

This calibration may be influenced by the sides of the coverslip (and zones beyond) which are

visible on 10 of our WSI For each of these few images we manually contoured the side of the

resulting contour (union of polygons)

We generated a 25times image from the full resolution image With ImageJ we selected on this

) then we extracted the brightness of

pixels (between 0 and 255) and selected pixels the brightness of which differed by less than

weighted average (with standard deviation σ=0005) over their vicinity

pixels among these ldquouniformrdquo pixels and took

the intersection with regions where the brightness was 127 or above This defined the

We measured the histogram of the brightness value of the pixels in the

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

the right endof this peak as the largest brightness level which occurs at least once Then

we measured the left end

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

far and either was zero or was larger than the last seen occurrence number

These left- and right-end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

each WSI because of marked variability the left

end ranged from 232 to 249

In addition we selected pixels within the reference regions which had a brightness between

the left-end of the peak and the left

values of R G and B (hereafter called

later use

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with

than 100 MiB of RAM to be opened with overlap of 256

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way

brightness of which was outside the interval measured previously as ldquobackground intensity

peakrdquo mdash call them A

pixels we selected those which containe

space) was larger than the average of the saturation of all A

regions This was to prevent selecting uniform regions with unusual high or low brightness

which could be a large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than

magnification) had to be considered as tissue Therefore we included in the B

holes of area less than 10000

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

10000 pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256

concern only small holes (less than 10000

that is rather elongated holes which was rather uncommon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We measured the histogram of the brightness value of the pixels in the reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

of this peak using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

r was larger than the last seen occurrence number

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

marked variability the left-end ranged from 212 to 234 while the right

In addition we selected pixels within the reference regions which had a brightness between

end of the peak and the left-end plus three (included) and computed their average

values of R G and B (hereafter called ) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with tiffmakemosaic a mosaic such that no piece required more

MiB of RAM to be opened with overlap of 256 pixels between adjacent

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

call them A-pixels Then among the connected regions formed by these

pixels we selected those which contained at least one pixel the saturation of which (in HSB

space) was larger than the average of the saturation of all A-pixels mdash thus constructing the B

regions This was to prevent selecting uniform regions with unusual high or low brightness

large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than asymp 10000

on) had to be considered as tissue Therefore we included in the B

holes of area less than 10000 pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256 pixels The exception would

concern only small holes (less than 10000 pixels) a dimension of which exceeded 256 pixels

that is rather elongated holes which was rather uncommon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

7

reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

k using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

end ranged from 212 to 234 while the right-

In addition we selected pixels within the reference regions which had a brightness between

and computed their average

) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

a mosaic such that no piece required more

pixels between adjacent pieces

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

pixels Then among the connected regions formed by these

d at least one pixel the saturation of which (in HSB

thus constructing the B-

regions This was to prevent selecting uniform regions with unusual high or low brightness

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

asymp 10000 pixels (at 20times

on) had to be considered as tissue Therefore we included in the B-regions the

pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (more than

pixels) extending on another mosaic piece which should not be restored into the B-

regions or a small part of a small hole which would quite probably be entirely included into an

pixels The exception would

pixels) a dimension of which exceeded 256 pixels

Similarly we found that holes having a fractal

the B-regions They were characterised in the following way after we performed an

then a dilate operation on them their area was less than 10000

the boundary of the mosaic piece

Then we made the boundaries of the B

then a dilate on their mask This eliminated the small overhangs or invaginations of a few

pixels

We eliminated from the B-regions the connected regions of less than 20000

at a distance 30 pixels or larger from a region or 20000

were found to be non significant (dust isolated cells small pieces of tis

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ

operations including thresholding at 15 the distance map from the B

Finally we found that B-regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3

the saturation in HSB colour space we applied the

threshold on this image and we defined as high

which was above the isodata

high-saturation pixel were kept as tissue regions

The mask (binary image) of the tissue

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

stored on the disk as a 1-bit-per

high level of compression Then the pieces of the mosaic with overlap were erased from the

disk

If there existed for this WSI a

mask of the region to exclude was formed as a binary image of resolution

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up t

was performed thanks to another in

and RAM economy

Finally the logical and of the mask of sharp regions and of the mask of tissue was computed

through the same C program and stored on the disk as a bilevel Deflate

Again although the resulting mask is a very large image (176

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Similarly we found that holes having a fractal-like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an

operation on them their area was less than 10000 pixels and they did not touch

the boundary of the mosaic piece

Then we made the boundaries of the B-regions (tissue regions) more regular applying an

on their mask This eliminated the small overhangs or invaginations of a few

regions the connected regions of less than 20000 pixels which were

at a distance 30 pixels or larger from a region or 20000 pixels or more Indeed most of those

were found to be non significant (dust isolated cells small pieces of tissue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ by a combination of morphological

operations including thresholding at 15 the distance map from the B-regions

regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at least blue cell nuclei or brown vessel walls)

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3 pixels the image of

the saturation in HSB colour space we applied the isodata algorithm [35] to find an automatic

image and we defined as high-saturation pixels the pixels the saturation of

isodata threshold and above 30 Only B-regions containing at least one

saturation pixel were kept as tissue regions

The mask (binary image) of the tissue regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

per-pixel Deflate-compressed [29] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

If there existed for this WSI a roi file defining the side(s) of the coverslip on th

mask of the region to exclude was formed as a binary image of resolution 0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up to resolution 20times This logical operation

was performed thanks to another in-house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

e C program and stored on the disk as a bilevel Deflate-compressed TIFF file

Again although the resulting mask is a very large image (176 gigapixels in average) this form

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

8

like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an erode

and they did not touch

regions (tissue regions) more regular applying an erode

on their mask This eliminated the small overhangs or invaginations of a few

pixels which were

pixels or more Indeed most of those

sue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

by a combination of morphological

regions

regions with too low saturation (greyish regions) could exist and

least blue cell nuclei or brown vessel walls)

pixels the image of

] to find an automatic

saturation pixels the pixels the saturation of

regions containing at least one

regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in-

house developed C program for the sake of speed and RAM economy The whole mask was

] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

file defining the side(s) of the coverslip on the image the

0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

20times This logical operation

house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

compressed TIFF file

gigapixels in average) this form

of compression is very efficient the average disk size of the mask was 436

026 MiB to 1638 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

corresponding WSI in ltFigure

Figure 2 - Example of a determination of tissue without blur

Top left excerpt of the original image (one of our WSI)

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One c

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

scanner They will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region

regions is superimposed onto the detail of the WSI shown on the b

between ldquofully blurredrdquo on the left

image Green scale bar = 20 microns

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

of compression is very efficient the average disk size of the mask was 436 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

Figure 2gt

Example of a determination of tissue without blur

excerpt of the original image (one of our WSI) Top right the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One can see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region Bottom right

regions is superimposed onto the detail of the WSI shown on the bottom left One sees the transition

between ldquofully blurredrdquo on the left-hand side of the image to ldquofully sharprdquo on the right

microns

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

9

MiB ranging from

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

an see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1 mm Bottom left

the mask of sharp

ottom left One sees the transition

hand side of the image to ldquofully sharprdquo on the right-hand side of the

Removal of puddles of red blood cells

This part of the method is rather c

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

regions of blur-free tissue It was developed on two example WSI but proved efficient on all

We constructed a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

Find Edges command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these re

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

close operation on the resulting mask This is to select t

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold

defined during backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

bit-per-pixel Deflate-compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in

Removing from the mask of sharp tissue pixels considered acco

of red blood cells we built the mask of significant blur

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Removal of puddles of red blood cells

This part of the method is rather cumbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these regions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

operation on the resulting mask This is to select the sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold = 255 035255

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above b and of circularity at most 02 We also added the connect

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in ltFigure 3gt

Removing from the mask of sharp tissue pixels considered according to this mask of puddles

of red blood cells we built the mask of significant blur-free tissue

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

10

umbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

gions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

he sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

were was

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

and of circularity at most 02 We also added the connected

regions of 2800 pixels and above which were constructed by added to these latter regions

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1-

A detail from an example of such a mask of large puddles of red blood cells is shown

rding to this mask of puddles

w

Figure 3 - Example of a determination of large puddles of red blood cells

Top original image (excerpt of one of our WSI)

large puddles of red blood cells was superimposed Scale bar = 20

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

counterstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution

To perform this linear change in colour space we needed to know the optical densities (od) in

R G and B channels (or more precisely only the ratios of these three od to form their vector

in the RGB space [36]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25

measured the average optical densities in the R G and

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and

contribution of markedly blue areas

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Example of a determination of large puddles of red blood cells

original image (excerpt of one of our WSI) Bottom the same image over which the mask of the

large puddles of red blood cells was superimposed Scale bar = 20 microns

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution [36]

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide-to-slide variability as can be seen on

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25 pixels Finally we

measured the average optical densities in the R G and B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and with hue inside the interval [80199] to get the

contribution of markedly blue areas

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

11

the same image over which the mask of the

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of the

slide variability as can be seen on ltFigure 4gt

We used the following procedure on each piece of the 20times mosaic without overlap formed

On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

pixels Finally we

B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

with hue inside the interval [80199] to get the

Figure 4 - Slide-to-slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green

(CD34) staining as defined in [36

the blue optical density to the red optical density

distribution of the values of Δ over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to comput

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

them to a text file

The precise values of the thresholds above are irrelevant the important thing is that the loose

limits on the hue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

calibration of the optical densities of the brown staining rested on 154

563 kilopixels max 288 megapixels) and the calibration of the optical densities of the blue

rested on 104 megapixels (min 109

Selection of vessel walls

The whole process of actual selection of vessel walls operated only on the areas of significant

blur-free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

First the histogram of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in

which took as input the WSI at resolution

the colour deconvolution (average od determined earlier) and operated independently on

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green and blue channels of the brown

36] according to the procedure described in the main text we subtracted

the blue optical density to the red optical density mdash letrsquos call this difference Δ This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to compute the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

ibration of the optical densities of the brown staining rested on 154

megapixels) and the calibration of the optical densities of the blue

megapixels (min 109 megapixels max 842 megapixels)

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in-house developed C program

which took as input the WSI at resolution 20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

12

and blue channels of the brown

] according to the procedure described in the main text we subtracted

This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

e the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

megapixels (min

megapixels) and the calibration of the optical densities of the blue

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

house developed C program

20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

We measured the histogram of the brightness value of the pixels in the

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

the right endof this peak as the largest brightness level which occurs at least once Then

we measured the left end

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

far and either was zero or was larger than the last seen occurrence number

These left- and right-end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

each WSI because of marked variability the left

end ranged from 232 to 249

In addition we selected pixels within the reference regions which had a brightness between

the left-end of the peak and the left

values of R G and B (hereafter called

later use

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with

than 100 MiB of RAM to be opened with overlap of 256

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way

brightness of which was outside the interval measured previously as ldquobackground intensity

peakrdquo mdash call them A

pixels we selected those which containe

space) was larger than the average of the saturation of all A

regions This was to prevent selecting uniform regions with unusual high or low brightness

which could be a large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than

magnification) had to be considered as tissue Therefore we included in the B

holes of area less than 10000

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

10000 pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256

concern only small holes (less than 10000

that is rather elongated holes which was rather uncommon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We measured the histogram of the brightness value of the pixels in the reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

of this peak using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

r was larger than the last seen occurrence number

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

marked variability the left-end ranged from 212 to 234 while the right

In addition we selected pixels within the reference regions which had a brightness between

end of the peak and the left-end plus three (included) and computed their average

values of R G and B (hereafter called ) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

resolution 20times We produced with tiffmakemosaic a mosaic such that no piece required more

MiB of RAM to be opened with overlap of 256 pixels between adjacent

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

to produce a mask of the tissue zones in the following way We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

call them A-pixels Then among the connected regions formed by these

pixels we selected those which contained at least one pixel the saturation of which (in HSB

space) was larger than the average of the saturation of all A-pixels mdash thus constructing the B

regions This was to prevent selecting uniform regions with unusual high or low brightness

large piece of dust or a pen stroke (uniformly black region)

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

a region of tissue We noticed that almost all holes of less than asymp 10000

on) had to be considered as tissue Therefore we included in the B

holes of area less than 10000 pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (mo

pixels) extending on another mosaic piece which should not be restored into the B

regions or a small part of a small hole which would quite probably be entirely included into an

adjacent mosaic piece because mosaic pieces overlapped by 256 pixels The exception would

concern only small holes (less than 10000 pixels) a dimension of which exceeded 256 pixels

that is rather elongated holes which was rather uncommon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

7

reference regions It

always exhibits a peak of occurrence numbers of levels between 200 and 255 We measured

of this peak as the largest brightness level which occurs at least once Then

k using the following algorithm starting from the

right end we scanned occurrence numbers of decreasing brightness levels We stopped when

the current occurrence number was below half of the largest observed occurrence number so

end define rather accurately the brightness of pixels belonging to the

background and we stored them in a text file for later reuse They had to be determined for

end ranged from 212 to 234 while the right-

In addition we selected pixels within the reference regions which had a brightness between

and computed their average

) We stored these values in a text file for

The actual selection of tissue zones was performed on pieces of a mosaic of the image at

a mosaic such that no piece required more

pixels between adjacent pieces

Pieces were stored as TIFF files with zip compression (rather than JPEG compression to avoid

another information loss and to facilitate opening by ImageJ) On each piece ImageJ was used

We selected the pixels the

brightness of which was outside the interval measured previously as ldquobackground intensity

pixels Then among the connected regions formed by these

d at least one pixel the saturation of which (in HSB

thus constructing the B-

regions This was to prevent selecting uniform regions with unusual high or low brightness

The resulting regions could contain ldquoholesrdquo some of which were regions of background inside

asymp 10000 pixels (at 20times

on) had to be considered as tissue Therefore we included in the B-regions the

pixels and which did not touch the boundaries of the mosaic

piece Indeed a hole touching a boundary either was a small part of a bigger hole (more than

pixels) extending on another mosaic piece which should not be restored into the B-

regions or a small part of a small hole which would quite probably be entirely included into an

pixels The exception would

pixels) a dimension of which exceeded 256 pixels

Similarly we found that holes having a fractal

the B-regions They were characterised in the following way after we performed an

then a dilate operation on them their area was less than 10000

the boundary of the mosaic piece

Then we made the boundaries of the B

then a dilate on their mask This eliminated the small overhangs or invaginations of a few

pixels

We eliminated from the B-regions the connected regions of less than 20000

at a distance 30 pixels or larger from a region or 20000

were found to be non significant (dust isolated cells small pieces of tis

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ

operations including thresholding at 15 the distance map from the B

Finally we found that B-regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3

the saturation in HSB colour space we applied the

threshold on this image and we defined as high

which was above the isodata

high-saturation pixel were kept as tissue regions

The mask (binary image) of the tissue

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

stored on the disk as a 1-bit-per

high level of compression Then the pieces of the mosaic with overlap were erased from the

disk

If there existed for this WSI a

mask of the region to exclude was formed as a binary image of resolution

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up t

was performed thanks to another in

and RAM economy

Finally the logical and of the mask of sharp regions and of the mask of tissue was computed

through the same C program and stored on the disk as a bilevel Deflate

Again although the resulting mask is a very large image (176

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Similarly we found that holes having a fractal-like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an

operation on them their area was less than 10000 pixels and they did not touch

the boundary of the mosaic piece

Then we made the boundaries of the B-regions (tissue regions) more regular applying an

on their mask This eliminated the small overhangs or invaginations of a few

regions the connected regions of less than 20000 pixels which were

at a distance 30 pixels or larger from a region or 20000 pixels or more Indeed most of those

were found to be non significant (dust isolated cells small pieces of tissue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ by a combination of morphological

operations including thresholding at 15 the distance map from the B-regions

regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at least blue cell nuclei or brown vessel walls)

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3 pixels the image of

the saturation in HSB colour space we applied the isodata algorithm [35] to find an automatic

image and we defined as high-saturation pixels the pixels the saturation of

isodata threshold and above 30 Only B-regions containing at least one

saturation pixel were kept as tissue regions

The mask (binary image) of the tissue regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

per-pixel Deflate-compressed [29] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

If there existed for this WSI a roi file defining the side(s) of the coverslip on th

mask of the region to exclude was formed as a binary image of resolution 0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up to resolution 20times This logical operation

was performed thanks to another in-house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

e C program and stored on the disk as a bilevel Deflate-compressed TIFF file

Again although the resulting mask is a very large image (176 gigapixels in average) this form

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

8

like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an erode

and they did not touch

regions (tissue regions) more regular applying an erode

on their mask This eliminated the small overhangs or invaginations of a few

pixels which were

pixels or more Indeed most of those

sue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

by a combination of morphological

regions

regions with too low saturation (greyish regions) could exist and

least blue cell nuclei or brown vessel walls)

pixels the image of

] to find an automatic

saturation pixels the pixels the saturation of

regions containing at least one

regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in-

house developed C program for the sake of speed and RAM economy The whole mask was

] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

file defining the side(s) of the coverslip on the image the

0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

20times This logical operation

house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

compressed TIFF file

gigapixels in average) this form

of compression is very efficient the average disk size of the mask was 436

026 MiB to 1638 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

corresponding WSI in ltFigure

Figure 2 - Example of a determination of tissue without blur

Top left excerpt of the original image (one of our WSI)

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One c

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

scanner They will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region

regions is superimposed onto the detail of the WSI shown on the b

between ldquofully blurredrdquo on the left

image Green scale bar = 20 microns

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

of compression is very efficient the average disk size of the mask was 436 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

Figure 2gt

Example of a determination of tissue without blur

excerpt of the original image (one of our WSI) Top right the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One can see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region Bottom right

regions is superimposed onto the detail of the WSI shown on the bottom left One sees the transition

between ldquofully blurredrdquo on the left-hand side of the image to ldquofully sharprdquo on the right

microns

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

9

MiB ranging from

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

an see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1 mm Bottom left

the mask of sharp

ottom left One sees the transition

hand side of the image to ldquofully sharprdquo on the right-hand side of the

Removal of puddles of red blood cells

This part of the method is rather c

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

regions of blur-free tissue It was developed on two example WSI but proved efficient on all

We constructed a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

Find Edges command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these re

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

close operation on the resulting mask This is to select t

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold

defined during backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

bit-per-pixel Deflate-compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in

Removing from the mask of sharp tissue pixels considered acco

of red blood cells we built the mask of significant blur

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Removal of puddles of red blood cells

This part of the method is rather cumbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these regions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

operation on the resulting mask This is to select the sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold = 255 035255

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above b and of circularity at most 02 We also added the connect

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in ltFigure 3gt

Removing from the mask of sharp tissue pixels considered according to this mask of puddles

of red blood cells we built the mask of significant blur-free tissue

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

10

umbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

gions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

he sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

were was

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

and of circularity at most 02 We also added the connected

regions of 2800 pixels and above which were constructed by added to these latter regions

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1-

A detail from an example of such a mask of large puddles of red blood cells is shown

rding to this mask of puddles

w

Figure 3 - Example of a determination of large puddles of red blood cells

Top original image (excerpt of one of our WSI)

large puddles of red blood cells was superimposed Scale bar = 20

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

counterstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution

To perform this linear change in colour space we needed to know the optical densities (od) in

R G and B channels (or more precisely only the ratios of these three od to form their vector

in the RGB space [36]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25

measured the average optical densities in the R G and

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and

contribution of markedly blue areas

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Example of a determination of large puddles of red blood cells

original image (excerpt of one of our WSI) Bottom the same image over which the mask of the

large puddles of red blood cells was superimposed Scale bar = 20 microns

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution [36]

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide-to-slide variability as can be seen on

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25 pixels Finally we

measured the average optical densities in the R G and B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and with hue inside the interval [80199] to get the

contribution of markedly blue areas

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

11

the same image over which the mask of the

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of the

slide variability as can be seen on ltFigure 4gt

We used the following procedure on each piece of the 20times mosaic without overlap formed

On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

pixels Finally we

B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

with hue inside the interval [80199] to get the

Figure 4 - Slide-to-slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green

(CD34) staining as defined in [36

the blue optical density to the red optical density

distribution of the values of Δ over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to comput

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

them to a text file

The precise values of the thresholds above are irrelevant the important thing is that the loose

limits on the hue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

calibration of the optical densities of the brown staining rested on 154

563 kilopixels max 288 megapixels) and the calibration of the optical densities of the blue

rested on 104 megapixels (min 109

Selection of vessel walls

The whole process of actual selection of vessel walls operated only on the areas of significant

blur-free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

First the histogram of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in

which took as input the WSI at resolution

the colour deconvolution (average od determined earlier) and operated independently on

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green and blue channels of the brown

36] according to the procedure described in the main text we subtracted

the blue optical density to the red optical density mdash letrsquos call this difference Δ This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to compute the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

ibration of the optical densities of the brown staining rested on 154

megapixels) and the calibration of the optical densities of the blue

megapixels (min 109 megapixels max 842 megapixels)

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in-house developed C program

which took as input the WSI at resolution 20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

12

and blue channels of the brown

] according to the procedure described in the main text we subtracted

This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

e the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

megapixels (min

megapixels) and the calibration of the optical densities of the blue

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

house developed C program

20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

Similarly we found that holes having a fractal

the B-regions They were characterised in the following way after we performed an

then a dilate operation on them their area was less than 10000

the boundary of the mosaic piece

Then we made the boundaries of the B

then a dilate on their mask This eliminated the small overhangs or invaginations of a few

pixels

We eliminated from the B-regions the connected regions of less than 20000

at a distance 30 pixels or larger from a region or 20000

were found to be non significant (dust isolated cells small pieces of tis

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ

operations including thresholding at 15 the distance map from the B

Finally we found that B-regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3

the saturation in HSB colour space we applied the

threshold on this image and we defined as high

which was above the isodata

high-saturation pixel were kept as tissue regions

The mask (binary image) of the tissue

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

stored on the disk as a 1-bit-per

high level of compression Then the pieces of the mosaic with overlap were erased from the

disk

If there existed for this WSI a

mask of the region to exclude was formed as a binary image of resolution

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up t

was performed thanks to another in

and RAM economy

Finally the logical and of the mask of sharp regions and of the mask of tissue was computed

through the same C program and stored on the disk as a bilevel Deflate

Again although the resulting mask is a very large image (176

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Similarly we found that holes having a fractal-like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an

operation on them their area was less than 10000 pixels and they did not touch

the boundary of the mosaic piece

Then we made the boundaries of the B-regions (tissue regions) more regular applying an

on their mask This eliminated the small overhangs or invaginations of a few

regions the connected regions of less than 20000 pixels which were

at a distance 30 pixels or larger from a region or 20000 pixels or more Indeed most of those

were found to be non significant (dust isolated cells small pieces of tissue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

tissue This last operation was performed in ImageJ by a combination of morphological

operations including thresholding at 15 the distance map from the B-regions

regions with too low saturation (greyish regions) could exist and

should be disregarded as tissue (tissue contains at least blue cell nuclei or brown vessel walls)

Therefore after convoluting by a Gaussian kernel of standard deviation σ=3 pixels the image of

the saturation in HSB colour space we applied the isodata algorithm [35] to find an automatic

image and we defined as high-saturation pixels the pixels the saturation of

isodata threshold and above 30 Only B-regions containing at least one

saturation pixel were kept as tissue regions

The mask (binary image) of the tissue regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in

house developed C program for the sake of speed and RAM economy The whole mask was

per-pixel Deflate-compressed [29] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

If there existed for this WSI a roi file defining the side(s) of the coverslip on th

mask of the region to exclude was formed as a binary image of resolution 0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

inverse of the mask of the region to exclude blown up to resolution 20times This logical operation

was performed thanks to another in-house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

e C program and stored on the disk as a bilevel Deflate-compressed TIFF file

Again although the resulting mask is a very large image (176 gigapixels in average) this form

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

8

like shape should also be restored as tissue in

regions They were characterised in the following way after we performed an erode

and they did not touch

regions (tissue regions) more regular applying an erode

on their mask This eliminated the small overhangs or invaginations of a few

pixels which were

pixels or more Indeed most of those

sue torn apart) And in

the end we are interested only in the fraction of tissue area covered by vessels which we

neither overestimate nor underestimate by mistakenly removing a small significant area of

by a combination of morphological

regions

regions with too low saturation (greyish regions) could exist and

least blue cell nuclei or brown vessel walls)

pixels the image of

] to find an automatic

saturation pixels the pixels the saturation of

regions containing at least one

regions of each mosaic piece was saved as PNG files

then all PNG files were combined into a large 20times resolution mask of tissue thanks to an in-

house developed C program for the sake of speed and RAM economy The whole mask was

] TIFF file which achieves a very

high level of compression Then the pieces of the mosaic with overlap were erased from the

file defining the side(s) of the coverslip on the image the

0625times and the mask

of tissue was replaced by the result of a logical and of the former mask of the tissue and the

20times This logical operation

house developed C program again for the sake of speed

of the mask of sharp regions and of the mask of tissue was computed

compressed TIFF file

gigapixels in average) this form

of compression is very efficient the average disk size of the mask was 436

026 MiB to 1638 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

corresponding WSI in ltFigure

Figure 2 - Example of a determination of tissue without blur

Top left excerpt of the original image (one of our WSI)

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One c

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

scanner They will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region

regions is superimposed onto the detail of the WSI shown on the b

between ldquofully blurredrdquo on the left

image Green scale bar = 20 microns

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

of compression is very efficient the average disk size of the mask was 436 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

Figure 2gt

Example of a determination of tissue without blur

excerpt of the original image (one of our WSI) Top right the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One can see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region Bottom right

regions is superimposed onto the detail of the WSI shown on the bottom left One sees the transition

between ldquofully blurredrdquo on the left-hand side of the image to ldquofully sharprdquo on the right

microns

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

9

MiB ranging from

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

an see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1 mm Bottom left

the mask of sharp

ottom left One sees the transition

hand side of the image to ldquofully sharprdquo on the right-hand side of the

Removal of puddles of red blood cells

This part of the method is rather c

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

regions of blur-free tissue It was developed on two example WSI but proved efficient on all

We constructed a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

Find Edges command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these re

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

close operation on the resulting mask This is to select t

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold

defined during backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

bit-per-pixel Deflate-compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in

Removing from the mask of sharp tissue pixels considered acco

of red blood cells we built the mask of significant blur

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Removal of puddles of red blood cells

This part of the method is rather cumbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these regions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

operation on the resulting mask This is to select the sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold = 255 035255

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above b and of circularity at most 02 We also added the connect

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in ltFigure 3gt

Removing from the mask of sharp tissue pixels considered according to this mask of puddles

of red blood cells we built the mask of significant blur-free tissue

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

10

umbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

gions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

he sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

were was

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

and of circularity at most 02 We also added the connected

regions of 2800 pixels and above which were constructed by added to these latter regions

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1-

A detail from an example of such a mask of large puddles of red blood cells is shown

rding to this mask of puddles

w

Figure 3 - Example of a determination of large puddles of red blood cells

Top original image (excerpt of one of our WSI)

large puddles of red blood cells was superimposed Scale bar = 20

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

counterstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution

To perform this linear change in colour space we needed to know the optical densities (od) in

R G and B channels (or more precisely only the ratios of these three od to form their vector

in the RGB space [36]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25

measured the average optical densities in the R G and

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and

contribution of markedly blue areas

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Example of a determination of large puddles of red blood cells

original image (excerpt of one of our WSI) Bottom the same image over which the mask of the

large puddles of red blood cells was superimposed Scale bar = 20 microns

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution [36]

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide-to-slide variability as can be seen on

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25 pixels Finally we

measured the average optical densities in the R G and B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and with hue inside the interval [80199] to get the

contribution of markedly blue areas

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

11

the same image over which the mask of the

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of the

slide variability as can be seen on ltFigure 4gt

We used the following procedure on each piece of the 20times mosaic without overlap formed

On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

pixels Finally we

B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

with hue inside the interval [80199] to get the

Figure 4 - Slide-to-slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green

(CD34) staining as defined in [36

the blue optical density to the red optical density

distribution of the values of Δ over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to comput

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

them to a text file

The precise values of the thresholds above are irrelevant the important thing is that the loose

limits on the hue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

calibration of the optical densities of the brown staining rested on 154

563 kilopixels max 288 megapixels) and the calibration of the optical densities of the blue

rested on 104 megapixels (min 109

Selection of vessel walls

The whole process of actual selection of vessel walls operated only on the areas of significant

blur-free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

First the histogram of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in

which took as input the WSI at resolution

the colour deconvolution (average od determined earlier) and operated independently on

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green and blue channels of the brown

36] according to the procedure described in the main text we subtracted

the blue optical density to the red optical density mdash letrsquos call this difference Δ This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to compute the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

ibration of the optical densities of the brown staining rested on 154

megapixels) and the calibration of the optical densities of the blue

megapixels (min 109 megapixels max 842 megapixels)

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in-house developed C program

which took as input the WSI at resolution 20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

12

and blue channels of the brown

] according to the procedure described in the main text we subtracted

This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

e the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

megapixels (min

megapixels) and the calibration of the optical densities of the blue

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

house developed C program

20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

of compression is very efficient the average disk size of the mask was 436

026 MiB to 1638 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

corresponding WSI in ltFigure

Figure 2 - Example of a determination of tissue without blur

Top left excerpt of the original image (one of our WSI)

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One c

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

scanner They will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region

regions is superimposed onto the detail of the WSI shown on the b

between ldquofully blurredrdquo on the left

image Green scale bar = 20 microns

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

of compression is very efficient the average disk size of the mask was 436 MiB

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

Figure 2gt

Example of a determination of tissue without blur

excerpt of the original image (one of our WSI) Top right the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

considered after our method as sharp tissue are shaded One can see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1

detail of the top right image at the boundary of a blurred region Bottom right

regions is superimposed onto the detail of the WSI shown on the bottom left One sees the transition

between ldquofully blurredrdquo on the left-hand side of the image to ldquofully sharprdquo on the right

microns

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

9

MiB ranging from

A detail from an example of such a mask of sharp tissue is shown superimposed onto the

the mask (logical and combination of

the mask of tissue and of the mask of sharp regions) is superimposed onto the WSI Only regions

an see in particular that tears inside the

tissue are properly not counted as tissue (some of them are marked lsquoTrsquo) Blurred regions (some of them

are marked rsquoBrsquo) tend to form three vertical bands because of the way the image was acquired by the

ey will be excluded from the quantification process Orange scale bar = 1 mm Bottom left

the mask of sharp

ottom left One sees the transition

hand side of the image to ldquofully sharprdquo on the right-hand side of the

Removal of puddles of red blood cells

This part of the method is rather c

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

regions of blur-free tissue It was developed on two example WSI but proved efficient on all

We constructed a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

Find Edges command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these re

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

close operation on the resulting mask This is to select t

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold

defined during backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

bit-per-pixel Deflate-compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in

Removing from the mask of sharp tissue pixels considered acco

of red blood cells we built the mask of significant blur

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Removal of puddles of red blood cells

This part of the method is rather cumbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these regions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

operation on the resulting mask This is to select the sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold = 255 035255

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above b and of circularity at most 02 We also added the connect

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in ltFigure 3gt

Removing from the mask of sharp tissue pixels considered according to this mask of puddles

of red blood cells we built the mask of significant blur-free tissue

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

10

umbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

gions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

he sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

were was

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

and of circularity at most 02 We also added the connected

regions of 2800 pixels and above which were constructed by added to these latter regions

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1-

A detail from an example of such a mask of large puddles of red blood cells is shown

rding to this mask of puddles

w

Figure 3 - Example of a determination of large puddles of red blood cells

Top original image (excerpt of one of our WSI)

large puddles of red blood cells was superimposed Scale bar = 20

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

counterstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution

To perform this linear change in colour space we needed to know the optical densities (od) in

R G and B channels (or more precisely only the ratios of these three od to form their vector

in the RGB space [36]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25

measured the average optical densities in the R G and

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and

contribution of markedly blue areas

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Example of a determination of large puddles of red blood cells

original image (excerpt of one of our WSI) Bottom the same image over which the mask of the

large puddles of red blood cells was superimposed Scale bar = 20 microns

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution [36]

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide-to-slide variability as can be seen on

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25 pixels Finally we

measured the average optical densities in the R G and B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and with hue inside the interval [80199] to get the

contribution of markedly blue areas

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

11

the same image over which the mask of the

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of the

slide variability as can be seen on ltFigure 4gt

We used the following procedure on each piece of the 20times mosaic without overlap formed

On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

pixels Finally we

B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

with hue inside the interval [80199] to get the

Figure 4 - Slide-to-slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green

(CD34) staining as defined in [36

the blue optical density to the red optical density

distribution of the values of Δ over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to comput

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

them to a text file

The precise values of the thresholds above are irrelevant the important thing is that the loose

limits on the hue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

calibration of the optical densities of the brown staining rested on 154

563 kilopixels max 288 megapixels) and the calibration of the optical densities of the blue

rested on 104 megapixels (min 109

Selection of vessel walls

The whole process of actual selection of vessel walls operated only on the areas of significant

blur-free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

First the histogram of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in

which took as input the WSI at resolution

the colour deconvolution (average od determined earlier) and operated independently on

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green and blue channels of the brown

36] according to the procedure described in the main text we subtracted

the blue optical density to the red optical density mdash letrsquos call this difference Δ This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to compute the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

ibration of the optical densities of the brown staining rested on 154

megapixels) and the calibration of the optical densities of the blue

megapixels (min 109 megapixels max 842 megapixels)

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in-house developed C program

which took as input the WSI at resolution 20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

12

and blue channels of the brown

] according to the procedure described in the main text we subtracted

This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

e the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

megapixels (min

megapixels) and the calibration of the optical densities of the blue

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

house developed C program

20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

Removal of puddles of red blood cells

This part of the method is rather c

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

regions of blur-free tissue It was developed on two example WSI but proved efficient on all

We constructed a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

Find Edges command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these re

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

close operation on the resulting mask This is to select t

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold

defined during backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

bit-per-pixel Deflate-compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in

Removing from the mask of sharp tissue pixels considered acco

of red blood cells we built the mask of significant blur

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Removal of puddles of red blood cells

This part of the method is rather cumbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

ImageJ) and operated on the B channel

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

above and pixels at the distance at most 10 pixels from these regions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

operation on the resulting mask This is to select the sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

and eliminated the connected regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

less than 20000 pixels Defining the threshold = 255 035255

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

more with brightness above b and of circularity at most 02 We also added the connect

regions of 2800 pixels and above which were constructed by added to these latter regions

pixels at distance at most 2800

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

pixels at distance at most 20 pixels of these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1

compressed tiled TIFF image as before

A detail from an example of such a mask of large puddles of red blood cells is shown

superimposed onto the corresponding WSI in ltFigure 3gt

Removing from the mask of sharp tissue pixels considered according to this mask of puddles

of red blood cells we built the mask of significant blur-free tissue

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

10

umbersome and empirical but we found it useful since on

several WSI of brain tumours the puddles of red blood cells occupied more than 30 of the

free tissue It was developed on two example WSI but proved efficient on all

d a mask of large puddles of red blood cells on the WSI at objective

magnification 40times in the following way We changed the colour space to HSB (as defined in

First (step 1) on the result of the contour detection (application of a 3times3 Sobel filter ImageJrsquos

command) we selected connected regions of at least 20 pixels at levels 250 and

gions then retained from

these enlarged connected regions only those which had at least 10000 pixels

Second (step 2) we selected pixels of brightness exactly 255 and performed a morphological

he sides of the red blood cells which

appear very bright in bright field microscopy (because of the refringence property of these

cells) and elongated (because of the circular shape of these cells) We skeletonised the result

regions of at most 9 pixels Then we extended the remaining

skeletons to pixels within the distance of 20 pixels and eliminated the connected regions of

were was

ring backgroundrsquos brightness calibration (see above) we retained among the

remaining regions only those which contained at least one connected regions of 40 pixels or

and of circularity at most 02 We also added the connected

regions of 2800 pixels and above which were constructed by added to these latter regions

We took the union of the regions defined in the two preceding steps (1 and 2) We added the

these regions and inside the convex hull of at least one

of these regions This formed a mask of puddles of red blood cells Finally we added to the

mask the holes of less than 100000 pixels if contained and stored the mask on the disk as a 1-

A detail from an example of such a mask of large puddles of red blood cells is shown

rding to this mask of puddles

w

Figure 3 - Example of a determination of large puddles of red blood cells

Top original image (excerpt of one of our WSI)

large puddles of red blood cells was superimposed Scale bar = 20

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

counterstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution

To perform this linear change in colour space we needed to know the optical densities (od) in

R G and B channels (or more precisely only the ratios of these three od to form their vector

in the RGB space [36]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25

measured the average optical densities in the R G and

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and

contribution of markedly blue areas

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Example of a determination of large puddles of red blood cells

original image (excerpt of one of our WSI) Bottom the same image over which the mask of the

large puddles of red blood cells was superimposed Scale bar = 20 microns

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution [36]

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide-to-slide variability as can be seen on

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25 pixels Finally we

measured the average optical densities in the R G and B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and with hue inside the interval [80199] to get the

contribution of markedly blue areas

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

11

the same image over which the mask of the

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of the

slide variability as can be seen on ltFigure 4gt

We used the following procedure on each piece of the 20times mosaic without overlap formed

On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

pixels Finally we

B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

with hue inside the interval [80199] to get the

Figure 4 - Slide-to-slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green

(CD34) staining as defined in [36

the blue optical density to the red optical density

distribution of the values of Δ over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to comput

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

them to a text file

The precise values of the thresholds above are irrelevant the important thing is that the loose

limits on the hue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

calibration of the optical densities of the brown staining rested on 154

563 kilopixels max 288 megapixels) and the calibration of the optical densities of the blue

rested on 104 megapixels (min 109

Selection of vessel walls

The whole process of actual selection of vessel walls operated only on the areas of significant

blur-free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

First the histogram of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in

which took as input the WSI at resolution

the colour deconvolution (average od determined earlier) and operated independently on

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green and blue channels of the brown

36] according to the procedure described in the main text we subtracted

the blue optical density to the red optical density mdash letrsquos call this difference Δ This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to compute the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

ibration of the optical densities of the brown staining rested on 154

megapixels) and the calibration of the optical densities of the blue

megapixels (min 109 megapixels max 842 megapixels)

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in-house developed C program

which took as input the WSI at resolution 20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

12

and blue channels of the brown

] according to the procedure described in the main text we subtracted

This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

e the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

megapixels (min

megapixels) and the calibration of the optical densities of the blue

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

house developed C program

20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

w

Figure 3 - Example of a determination of large puddles of red blood cells

Top original image (excerpt of one of our WSI)

large puddles of red blood cells was superimposed Scale bar = 20

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

counterstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution

To perform this linear change in colour space we needed to know the optical densities (od) in

R G and B channels (or more precisely only the ratios of these three od to form their vector

in the RGB space [36]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25

measured the average optical densities in the R G and

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and

contribution of markedly blue areas

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Example of a determination of large puddles of red blood cells

original image (excerpt of one of our WSI) Bottom the same image over which the mask of the

large puddles of red blood cells was superimposed Scale bar = 20 microns

Calibration of optical density ratios of stains

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

brown channel after we perform a colour deconvolution [36]

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of

background above there was a strong slide-to-slide variability as can be seen on

We used the following procedure on each piece of the 20times mosaic without overlap formed

earlier Using ImageJ we performed a change of colour space to HSB On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

[80199] Among them we kept only connected regions of at least 25 pixels Finally we

measured the average optical densities in the R G and B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

saturation of which was at least 70 and with hue inside the interval [80199] to get the

contribution of markedly blue areas

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

11

the same image over which the mask of the

Since the vascular endothelial cells were marked with a brown staining over a blue

erstaining information relevant to the microvessels are be entirely contained in the

To perform this linear change in colour space we needed to know the optical densities (od) in

annels (or more precisely only the ratios of these three od to form their vector

]) of the two stains brown and blue We couldnrsquot use standard values

from the literature nor common values for all WSI since as for the brightness of the

slide variability as can be seen on ltFigure 4gt

We used the following procedure on each piece of the 20times mosaic without overlap formed

On one hand we

selected pixels with brightness at most 198 saturation at least 70 and hue outside the interval

pixels Finally we

B channels of these pixels and the

number of remaining pixels and wrote these numbers to a text file This gave the contribution

of markedly brown areas On the other hand we repeated the procedure with pixels the

with hue inside the interval [80199] to get the

Figure 4 - Slide-to-slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green

(CD34) staining as defined in [36

the blue optical density to the red optical density

distribution of the values of Δ over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to comput

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

them to a text file

The precise values of the thresholds above are irrelevant the important thing is that the loose

limits on the hue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

calibration of the optical densities of the brown staining rested on 154

563 kilopixels max 288 megapixels) and the calibration of the optical densities of the blue

rested on 104 megapixels (min 109

Selection of vessel walls

The whole process of actual selection of vessel walls operated only on the areas of significant

blur-free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

First the histogram of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in

which took as input the WSI at resolution

the colour deconvolution (average od determined earlier) and operated independently on

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green and blue channels of the brown

36] according to the procedure described in the main text we subtracted

the blue optical density to the red optical density mdash letrsquos call this difference Δ This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to compute the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

ibration of the optical densities of the brown staining rested on 154

megapixels) and the calibration of the optical densities of the blue

megapixels (min 109 megapixels max 842 megapixels)

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in-house developed C program

which took as input the WSI at resolution 20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

12

and blue channels of the brown

] according to the procedure described in the main text we subtracted

This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

e the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

megapixels (min

megapixels) and the calibration of the optical densities of the blue

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

house developed C program

20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

Figure 4 - Slide-to-slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green

(CD34) staining as defined in [36

the blue optical density to the red optical density

distribution of the values of Δ over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to comput

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

them to a text file

The precise values of the thresholds above are irrelevant the important thing is that the loose

limits on the hue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

calibration of the optical densities of the brown staining rested on 154

563 kilopixels max 288 megapixels) and the calibration of the optical densities of the blue

rested on 104 megapixels (min 109

Selection of vessel walls

The whole process of actual selection of vessel walls operated only on the areas of significant

blur-free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

First the histogram of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in

which took as input the WSI at resolution

the colour deconvolution (average od determined earlier) and operated independently on

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability of the optical densities of the brown staining

For each WSI after calibrating the optical densities in the red green and blue channels of the brown

36] according to the procedure described in the main text we subtracted

the blue optical density to the red optical density mdash letrsquos call this difference Δ This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

Then we aggregated the results from all mosaic pieces to compute the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

ibration of the optical densities of the brown staining rested on 154

megapixels) and the calibration of the optical densities of the blue

megapixels (min 109 megapixels max 842 megapixels)

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

deconvolution was constructed This was achieved through an in-house developed C program

which took as input the WSI at resolution 20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

12

and blue channels of the brown

] according to the procedure described in the main text we subtracted

This histogram shows the

over the 186 WSI One can see that there is a strong variability which

prevents one to use a single set of optical densities to perform colour deconvolution on all WSI

e the average over the whole

slide of the optical densities in R G and B channels of the brown and blue stains and wrote

The precise values of the thresholds above are irrelevant the important thing is that the loose

ue 80 and 199 clearly separate brown from blue (they can of course be adapted

to other colours) and that the loose limits on the saturation and brightness select as

representative areas for calibration regions markedly brown resp blue In average the

megapixels (min

megapixels) and the calibration of the optical densities of the blue

The whole process of actual selection of vessel walls operated only on the areas of significant

free (sharp) tissue of the WSI which were indicated by the mask constructed earlier

of the brown optical density (od) of each pixel after colour

house developed C program

20times the mask of sharp tissue and the parameters of

deconvolution (average od determined earlier) and operated independently on

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Figure 5 - Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining a

Then a global (but WSI-specific) threshold on the brown od for vessel walls on the WSI

hereafter called was automatically determined from the histogram in the following way

First we computed the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

the isodata automatic method of threshold computation

concerning od above

We could not rely on the full histogram to determine

were so dense in the tissue that they would manifest themselves as a peak in the low od

region of the histogram so that

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

efficient way to solve this problem

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias

histogram with values from irrelevant pixels (eg dust)

Example of a segmentation of tissue and vessel walls (detail)

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

walls on the basis of the CD34 immunostaining are contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

the brown od of a pixel with colour

(average colour of the darkest pixels of the background reference regions) Then we applied

automatic method of threshold computation [35] on the part of the histogram

We could not rely on the full histogram to determine since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

so that the value computed by the isodata algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

way to solve this problem

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

13

each tile of the WSI to save RAM and allow the use of parallel processing on a computer with

multicore CPUs Here the restriction to areas of sharp tissue also avoided to bias the

On this excerpt of a WSI at resolution 40times the final result of the segmentation by our method is shown

The areas considered as sharp tissue are shaded and the areas inside sharp tissue considered as vessel

re contoured in cyan Scale bar = 20 microns

specific) threshold on the brown od for vessel walls on the WSI

was automatically determined from the histogram in the following way

stored earlier

(average colour of the darkest pixels of the background reference regions) Then we applied

] on the part of the histogram

since on some of the WSI cell nuclei

were so dense in the tissue that they would manifest themselves as a peak in the low od

algorithm would be

influenced by them instead on yielding information on the vessel walls only Disregarding the

low od values of brown that is od values below those of the background was a simple and

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

Then a second global (but also WSI

application of the isodata algorithm on the part of the histogram

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equa

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34

This was performed by treating in turn each rectangular zone of size roughl

WSI at resolution 20times The zone was extracted using the

LargeTIFFTools [17 18] (which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of

conditions the brown od is above (or equal to)

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

conditions were necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

missed by the first condition

The mask was post-processed in the following way Let us cal

of pixels selected so far on the basis of

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and

pixels Finally we kept as vessel walls in the current rectangular zone the A

at least a B-region We recorded their mask on the disk as a PNG file

As in an earlier step we used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate

file where vessel walls were black and the background was white

Review of the segmentation

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

using vips We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom forma

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server a

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Then a second global (but also WSI-dependent) threshold called was computed by a new

algorithm on the part of the histogram concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to)

contained at least a small region where brown od was above (or equal to)

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

concerned for instance a few isolated CD34-positive tumour cells)

This was performed by treating in turn each rectangular zone of size roughly 3840times3840 of the

WSI at resolution 20times The zone was extracted using the tifffastcrop program from the

(which can extract very quickly a rectangular zone from a (possibly

huge) tiled TIFF image twice as fast as the extract_area command of vips) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

deconvolution and created a mask of the brown od of pixels which satisfy one of the three

conditions the brown od is above (or equal to) the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

may have low values of brown od (as already noticed for brown staining

processed in the following way Let us call A-regions the connected regions

of pixels selected so far on the basis of (discarding regions of less than 75

convoluted the image of brown od with a Gaussian kernel of standard deviation 05

then kept pixels with intensity and above then connected regions of at least 25

pixels Finally we kept as vessel walls in the current rectangular zone the A-regions containing

region We recorded their mask on the disk as a PNG file

used our C program to merge all masks of vessel walls in rectangular

zones into a single mask at 20times resolution stored in a bilevel Deflate-compressed tiled TIFF

file where vessel walls were black and the background was white

Review of the segmentation results

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

the mask of vessel walls And we produced in DeepZoom format the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

a vessel wall (black pixels surrounded by at least one white pixel)

These sets of files were uploaded to a secured web server along with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

14

was computed by a new

concerning od above

The actual segmentation of the vessel walls consisted essentially in looking for connected sets

of pixels inside the sharp tissue which had brown od above (or equal to) and which

l to) The second

condition avoided that pale brown regions be inaccurately recognised as vessel walls (this

y 3840times3840 of the

program from the

(which can extract very quickly a rectangular zone from a (possibly

) The corresponding

zone from the mask of sharp tissue was extracted Then an ImageJ macro selected pixels from

the extract of the WSI inside the sharp tissue zones according to the mask performed colour

the brown od of pixels which satisfy one of the three

the brightness (in HSB colour space) is at

most 30 or the brightness is at most 40 and the saturation at most 127 The two latter

e necessary because almost black pixels composing some of the vessel walls

[36]) and may be

regions the connected regions

(discarding regions of less than 75 pixels) We

convoluted the image of brown od with a Gaussian kernel of standard deviation 05 pixel

above then connected regions of at least 25 pixels of these

regions containing

used our C program to merge all masks of vessel walls in rectangular

compressed tiled TIFF

For each slide we produced a set of files in DeepZoom format from the WSI at resolution 40times

We also produced sets of files in DeepZoom format for the mask of sharp tissue and

t the image of the contours of

vessel walls where all pixels are transparent except the pixels which belong to a boundary of

long with a simple HTML file

(automatically generated by a simple Perl script) calling the JavaScript OpenSeadragon [37]

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

This allowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on

Figure 6 - A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top o

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

Material of our cohort

We applied our method to a

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in

served as a challenge to our method (see if it is really robust even without human

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

library to display the superimposition of the slide and according to what the user selects of

the different masks or contours

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality check is displayed on ltFigure 6gt

A typical session of quality control of the segmentation in a standard web

The user is viewing in the window of his JavaScript-capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

vessel walls (displayed in cyan on top of the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

slide to explore it with his mouse

We applied our method to a cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

hemispheres The detailed numbers are given in ltTable 1gt Such a variety of tumour types

llenge to our method (see if it is really robust even without human

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

15

library to display the superimposition of the slide and according to what the user selects of

llowed a convenient quality control of the segmentation of tissue and vessels by the

pathologist from his office or a meeting room at the Hospital even though the whole image

processing was performed on a computer in a physics laboratory Indeed all that was needed

for this visualisation was a standard desktop computer with a JavaScript capable web browser

A typical session of quality control of the segmentation in a standard web browser

capable web browser (here Firefox) a detail of one

of the whole slide images at full resolution (40times) on which he has superimposed the contours of the

f the slide) He can interactively addremove contours and masks

(displayed by shading the slide) tofrom the list of displayed information zoom in and out and drag the

cohort of 129 human patients suffering from brain tumours

ranging from WHO grade I to grade IV and in various locations posterior fossa thalamus and

Such a variety of tumour types

llenge to our method (see if it is really robust even without human

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

intervention) and was also meant to check how much the microvascular density was correlated

with tumour grade

Each sample was prepared the same way a 5μm

paraffin-embedded tissue was immunostained with a monoclonal mouse anti

antibody (QBend-10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

size of the files was 7485 MiB (max 254

data The average size of the images was 703

Table 1 - Types and locations of the 129 paediatric brain tumours in our study

Results

Quality of the segmentation

The quality of the segmentation was rev

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

from our web server Out of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra

On a few other slides the pathologist was able to select zones free from extra

signal These zones were def

versions of the WSI and stored on the disk as ImageJrsquos

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

selection

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

intervention) and was also meant to check how much the microvascular density was correlated

Each sample was prepared the same way a 5μm-thick tissue section of formalin

embedded tissue was immunostained with a monoclonal mouse anti

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchma

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

MiB (max 254 GiB) representing in total asymp100 Gi

data The average size of the images was 703 gigapixels (max 1608 gigapixels)

Types and locations of the 129 paediatric brain tumours in our study

Quality of the segmentation

The quality of the segmentation was reviewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

displayed extensive areas of extra-vascular CD34-positive cells

On a few other slides the pathologist was able to select zones free from extra

signal These zones were defined using ImageJ as unions of polygons on the 25times resolution

versions of the WSI and stored on the disk as ImageJrsquos roi files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

16

intervention) and was also meant to check how much the microvascular density was correlated

thick tissue section of formalin-fixed

embedded tissue was immunostained with a monoclonal mouse anti-human CD34

10 Dakoreg Agilent Technologies Santa Clara California USA) The reaction

was carried out in an automated immunohistochemistry instrument (Benchmark Ventana

Medical Systemsreg Hoffman La Roche Basel Switzerland) Patients were excluded if the

pathological sample was insufficient to perform CD34 immunohistochemical analysis

The resulting 186 tissue sections mounted on glass slides were digitised by a Hamamatsu

NanoZoomer at objective resolution 40times which produced a NDPI file per slide The average

GiB of compressed

gigapixels)

iewed during a collective meeting in the hospital

(involving pathologist radiologists and physicists) Each slide was displayed thanks to an

overhead projector connected to a computer itself using a web browser to retrieve images

of the 186 slides 30 had unfortunately to be excluded because they

On a few other slides the pathologist was able to select zones free from extra-vascular CD34

ined using ImageJ as unions of polygons on the 25times resolution

files The corresponding slides were

reprocessed by disregarding all pixels outside the selected zones for tissue and vessel wall

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

positive cells

Otherwise the segmentation was judged of very go

of the complete segmentation is shown in

Density of microvessels

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in

again treating images tile-wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in

remarkably correlated with the tumour grade

Figure 7 - Distribution of the denresp low-grade tumour

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

tissue area covered with CD34-

from high-grade (resp low-grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

high-grade tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

On two other slides it proved sufficient to manually raise slightly the threshold

reprocess the slide (vessel selection step) to prevent selecting most extra

Otherwise the segmentation was judged of very good quality by the pathologist An example

of the complete segmentation is shown in ltFigure 5gt

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

measurements were done by an in-house C program for the sake of speed and RAM e

wise to enable multicore parallel processing

The distribution (histogram) of the densities is displayed in ltFigure 7gt We find that it is

remarkably correlated with the tumour grade

Distribution of the density of microvessels in the tissue for patients suffering a high

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

-stained vessel walls) measured by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log

are relatively broad there is a clear distinction between the typical microvascular densities of low

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

17

On two other slides it proved sufficient to manually raise slightly the thresholdand to

reprocess the slide (vessel selection step) to prevent selecting most extra-vascular CD34-

od quality by the pathologist An example

On each WSI we counted the number of selected pixels on the mask of sharp tissue and on

the mask of vessel walls and we took the ratio to get the density of microvessels The

house C program for the sake of speed and RAM economy

We find that it is

sity of microvessels in the tissue for patients suffering a high-grade

The red (resp blue) histogram shows the distribution of the microvascular density (fraction of sharp

by our method on the WSI of samples

grade) tumours Although the two histograms (here shown in log-lin scale)

are relatively broad there is a clear distinction between the typical microvascular densities of low- and

tumours We argue that the measurement uncertainties of the microvascular density (see

Discussion in the main text) are much lower than the difference between these typical values

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

Computation time performance

All processing of the WSI was done on a Mac

core i7 CPU at 23 GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

ltFigure 8gt shows the distributio

(including colour deconvolution) which is one of the most time

can see that most WSI could be treated in less than 15

the time necessary to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

saved a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Figure 8 - Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

in less than 15 min on the rather modest computer we used for this study

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Computation time performance

All processing of the WSI was done on a Mac mini computer with 16 GiB of RAM and a quad

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

shows the distribution of the computing time of the vessel wall segmentation

(including colour deconvolution) which is one of the most time-consuming operations One

can see that most WSI could be treated in less than 15 minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

the WSI was usually background empty space

Distribution of the duration of the process of colour deconvolution and vessel wall selection

of all WSI on our Mac mini computer

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

min on the rather modest computer we used for this study

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

18

GiB of RAM and a quad-

GHz bought in October 2012 Although this computer was rather modest in

regard of todayrsquos standards we found the overall treatment time to be quite acceptable

n of the computing time of the vessel wall segmentation

consuming operations One

minutes This has to be compared to

to transfer to the web server the OpenSeadragon files of the WSI and of

the masks the latter was larger even using a large bandwidth network connection

Let us also notice that selecting the vessel walls only in the areas of sharp tissue of the WSI

a substantial amount of computation time since the average fraction of the WSI

occupied by the sharp tissue was only 268 (ranging from 19 to 636) Most of the rest of

Distribution of the duration of the process of colour deconvolution and vessel wall selection

Although a few WSI can request anomalously large treatment times a vast majority of them are treated

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

Discussion

Inter-slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

slides In our heterogeneous set of 186 slides this would yield wrong results For instance the

thresholdsresp on brown od for vessel segmentation have the following statistics

average 932 min 44 max 160 resp average 1785 min

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fal

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

tissue (the minimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and t

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible li

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist

slides We prefer to save the

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

it very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

slide variability and robustness

As we already discussed several of the physical parameters of the WSI (colour temperature of

the background optical densities of the stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

160 resp average 1785 min 159 max 250

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

might influence the final result of the WSI In the first category fall eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

hence the vessel segmentation It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set o

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

than in the case of calibrated parameters (like stainsrsquo od) and that it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

Finally let us remark that even with these possible limitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

each slide even by a trained pathologist [15] if the latter is at all doable on such a large set of

slides We prefer to save the pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

tissue area of our slides (min 58 max 72614)

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

19

As we already discussed several of the physical parameters of the WSI (colour temperature of

stains) vary largely from one slide to the next This is

why our method includes several steps of calibration Some previous studies [22] used values

of the parameters of the segmentation common to all slides but this was for smaller sets of

n our heterogeneous set of 186 slides this would yield wrong results For instance the

on brown od for vessel segmentation have the following statistics

We believe that other parameters (parameters which were not chosen after a calibration) fall

in two categories parameters the value of which is not very relevant and parameters which

l eg the precise limits of the

interval of hue used to define the reference areas for the calibration of brown and blue optical

densities Changing these limits will alter only very marginally (if at all) the measured od

It is therefore not worth to give too much attention to them

Parameters in the second category include eg the threshold used to fix the limit between

sharp and blurred tissue and most of the geometrical parameters of the segmentation of

nimal maximal number of pixels of connected regions to be kept disregarded

the maximal distance of a small piece of tissue to a large piece to be considered as

significant) We did only a manual calibration of them based on a representative set of a

few slides or a few excerpts of slides But even if a different choice for their value could

change the final measured microvessel density we think that this change is less important

hat it would be systematic

affecting the measure roughly in the same way on all WSI Hence fixing these values doesnrsquot

preclude the use of our automatic measurement for assistance to tumour grading

mitations in mind our method should be

much more reproducible than manual measurements performed on a few chosen excerpts in

] if the latter is at all doable on such a large set of

pathologistrsquos time for quality control and make our overall study

cheaper by the extensive use of the computer Notice also that among our 186 slides many

have very fragmented tissue (all the more that we are dealing with fragile brain tissue) making

t very difficult to estimate accurately the area of tissue And of course a systematic manual

vessel segmentation is not in order there is an average of 16571 vessel fragments in the sharp

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

Impact of red blood cells

The fraction of blur-free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

occupied 487 of the blur-free tissue so they were not a cruc

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we co

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low

tumours (ltFigure 7gt)

Therefore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

reduction

Uncertainties

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters

bull Changing by one (over 255) the brown od threshold

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation on

bull Eroding or dilating either the

recognised as tissue by one pixel at resolution 20times changed by

serious and means that one has little latitude on morphological post

segmented regions However

microvessel density to distinguish between low

large spreading of the density (see

measurement using the WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

free tissue so they were not a crucial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

apparent tissue For these slides had we counted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

comparison eg to the difference of microvascular density between low-grade and high

efore we believe that the step of automatic detection of puddles of red blood cells

although cumbersome and time-consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

the most important parameters of the method in the following way

Changing by one (over 255) the brown od thresholdchanged by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty on

determined automatically by a thresholding algorithm [35] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

strongly from one slide to the next one the standard deviation onis 211

Eroding or dilating either the regions recognised as vessel walls or the regions

recognised as tissue by one pixel at resolution 20times changed by asymp7 the area This is more

serious and means that one has little latitude on morphological post-processing of the

segmented regions However a change by 7 is still acceptable if one wants to use the

microvessel density to distinguish between low-grade and high-grade tumours owing to the

large spreading of the density (see ltFigure 7gt) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on wh

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

with especially low or high vessel density

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

20

free tissue occupied by puddles of red blood cells as determined by the

method above ranged from 004 to 372 In average such spreads of red blood cells

ial issue for the determination

of the microvascular density for most slides But for 8 of our 186 slides they occupied more

than 25 of the apparent tissue and for 21 of them they occupied more than 10 of the

unted the puddles of red blood cells as tissue we

would have underestimated the density of microvessels by 10 to 25 which is huge in

grade and high-grade

efore we believe that the step of automatic detection of puddles of red blood cells

consuming is necessary We couldnrsquot save time by performing

it on the 10times magnification WSI instead of the 40times WSI because the specifically high intensity

pixels of the red blood cellsrsquo sides (due to their refringence) was lost during the resolution

We tried to assess the uncertainties on the measurement of the microvessel density against

changed by 05 the total area

of the regions recognised as vessel walls Therefore the uncertainty onand as

] up to a few units over 255 has little

influence on the final result But remember once again this automatic threshold varies

regions recognised as vessel walls or the regions

asymp7 the area This is more

processing of the

a change by 7 is still acceptable if one wants to use the

grade tumours owing to the

) It should be interesting to redo the

WSI at magnification 40times and see if the uncertainty against eroding or

dilating is smaller as one could expect at the expense of a computation time four times larger

In a context of strongly heterogeneous tissue measuring the microvessel density on whole

tissue sections also contributes to reduce the uncertainties by allowing the measurement to

rest on a large zone of tumour tissue hence reducing the risk to measure accidentally a zone

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

Additionally if one wants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1

measurement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI

Further development

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of eac

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

adult low-grade gliomas [39]

On the other hand no informati

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels

morphometry etc

And beyond morphometry on the black

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value

more generally in oncology

tumours with the same of similar immunostainings (CD31 CD34)

Conclusions

We have introduced an automatic and training

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

resolution is routinely of the order of 1 mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation w

noninvasive macroscopic measurement using the ASL modality of MRI [11]

We plan to extend this work in several directions First of all the overall process can still be

optimised to reduce the treatment time of each slide

Then much information is still left unexploited on one hand we plan to perform

morphometry analyses on the segmented vessel walls [20 22 38] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And thi

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

]

On the other hand no information about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

and get quantitative parameters in the same way as for vessels density of nuclei

beyond morphometry on the black-and-white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A

this way a series of segmentations is built and can be analysed as would be a time series

revealing more aspects of the disease than a static picture taken at a single time point

Finally angiogenesis has been shown to be of significant value for diagnosis and prognostic

[41-43] so that our method can readily be applied to other

tumours with the same of similar immunostainings (CD31 CD34)

We have introduced an automatic and training-free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to inc

determination of areas of tissue without blur and puddles of red blood cells before the proper

segmentation of vessel walls

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

21

ants to draw a link between measurements at the microscopic scale (on

WSI) where individual cells are resolved and at macroscopic scale (using eg MRI) where the

mm one has to perform the microvessel density

surement on the largest (but still relevant) piece of tissue In this spirit and to further

confirm the quality and relevance of our measurement on brain tumour tissues it has been

shown that the microvascular density we measured is in good correlation with the result of a

We plan to extend this work in several directions First of all the overall process can still be

Then much information is still left unexploited on one hand we plan to perform

] This could serve as a basis

for a system of computer aided diagnosis of some of the tumours And this would yield

precious data to develop a theoretical model of angiogenesis in brain tumours which

hopefully could guide treatments in the long term in the spirit of what is being done eg for

on about cell nuclei has been exploited yet It should be

relatively easy to perform segmentation on eg the blue channel after colour deconvolution

density of nuclei

white masks resulting from the mere

segmentation (thresholding) of biological objects it could also be possible to extract more

information from the virtual slides by continuously varying the threshold defining A-regions In

this way a series of segmentations is built and can be analysed as would be a time series [40]

revealing more aspects of the disease than a static picture taken at a single time point

for diagnosis and prognostic

] so that our method can readily be applied to other

free method of quantification of the density of

microvessels on whole tissue sections immunostained with the CD34 antibody and digitised by

a slide scanner This method is to our knowledge the first one to include a careful

determination of areas of tissue without blur and puddles of red blood cells before the proper

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

reasonable amount of computation time on a quite affordable computer system (an Intel Core

i7 CPU with 16 MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

of extra-vascular CD34-positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

Competing interests

The authors declare that they have no competing interests

Acknowledgements

We thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

References

1 Carmeliet P Jain R

407(6801)249ndash57

2 Onishi M Ichikawa T

Tumor Pathol 2011 2813

3 Plate KH Scholz A Dumont D

malignant gliomas revisited

4 Louis DN Perry A Reifenberger G

WK Ohgaki H Wiestler O

Organization Classification of Tumors of

Neuropathol 2016 131

5 Sun H Xu Y Yang Q

Colorectal Cancer Whole

6 Cha S Knopp EA Johnson G

Lesions Dynamic Contrast

MR Imaging Radiology 2002 22311

7 Peet AC Arvanitis T

paediatric brain tumours

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer

systems and easily reused for other stainingstumours especially because it uses only open

source software (like ImageJ or vips) or well-described algorithms and because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

other colours than brown and blue)

The authors declare that they have no competing interests

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

control the quality of segmentation

CD and MB belong to the CNRS consortium CellTiss and to the Labex P2IO

Jain RK Angiogenesis in cancer and other diseases

Ichikawa T Kurozumi K Date I Angiogenesis and invasion in glioma

Tumor Pathol 2011 2813ndash24

Dumont DJ Tumor angiogenesis and anti-angiogenic therapy in

malignant gliomas revisited Acta Neuropathol 2012 124(6)763ndash75

Reifenberger G von Deimling A Figarella-Branger D

Wiestler OD Kleihues P Ellison DW The 2016 World Health

Organization Classification of Tumors of the Central Nervous System a summary

Neuropathol 2016 131(6)803ndash820

Yang Q Wang W Assessment of Tumor Grade and Angiogenesis in

Colorectal Cancer Whole-volume Perfusion CT Acad Radiol 2014 21(6)750

Johnson G Wetzel SG Litt AW Zagzag D

Lesions Dynamic Contrast-enhanced Susceptibility-weighted Echo

Radiology 2002 22311ndash29

Arvanitis TN Leach MO Waldman AD Functional imaging in adult and

paediatric brain tumours Nat Rev Clin Oncol 2012 9700ndash11

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

22

We tested in on a large set of WSI (186) of a very large variety of brain tumours Using a very

computation time on a quite affordable computer system (an Intel Core

MiB of RAM) this method produced results of very good quality even though

an overall check of the segmented WSI by the pathologist was necessary in particular because

positive tumour cells It should be helpful in computer-aided diagnosis

systems and easily reused for other stainingstumours especially because it uses only open

nd because its architecture

is simple and modular and its parameters easy to understand and modify (eg to adapt it to

thank the CNRSIN2P3 computing centre for hosting the website we used to view WSI and

Angiogenesis in cancer and other diseases Nature 2000

Angiogenesis and invasion in glioma Brain

angiogenic therapy in

Branger D Cavenee

The 2016 World Health

the Central Nervous System a summary Acta

Assessment of Tumor Grade and Angiogenesis in

Acad Radiol 2014 21(6)750ndash757

Intracranial Mass

weighted Echo-planar Perfusion

maging in adult and

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

8 Parums DV Cordell J

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections

9 Fina L Molgaard H Robertson D

Baker M Greaves M

1990 75(12)2417ndash2426

10 Folkerth RD Descriptive analysis

tumors J Neurooncol 2000 50165

11 Dangouloff-Ros V Deroulers C

R Pagegraves M Grill J Dufour C

Brunelle F Varlet P Boddaert N

in children Correlations between histopathologic

Imaging Radiology 2016 281

12 Kayser K Nwoye JO

Gabius HJ Atypical adenomatous hyperplasia of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization

13 Guumlrcan MN Boucheron L

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

2009 2147ndash171

14 Kim NT Elie N Plancoulaine B

Quantification of Blood Vessels on the Whole Tumour Section

25(2)63ndash75

15 Franccediloise R Michels J

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459

16 Diamond J McCleary D

cellular pathology Edited by Hannon

Wiley amp Sons Ltd 2009

17 Deroulers C Ameisen D

pathology images with open source software

18 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

19 Deroulers C

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

20 Reyes-Aldasoro C Williams L

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections

21 Niazi MKK Hemminger J

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

In Proc SPIE Volume 9041

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Cordell JL Micklem K Heryet AR Gatter KC Mason D

monoclonal antibody that detects vascular endothelium associated antigen on

routinely processed tissue sections J Clin Pathol 1990 43(9)752ndash757

Robertson D Bradley N Monaghan P Delia D

Greaves M Expression of the CD34 gene in vascular endothelial cells

2426

Descriptive analysis and quantification of angiogenesis in human brain

J Neurooncol 2000 50165ndash72

Deroulers C Foissac F Badoual M Shotar E Greacutevent D

Dufour C Blauwblomme T Puget S Zerah M

Boddaert N Arterial Spin Labeling to predict brain tumor grading

in children Correlations between histopathologic vascular density and perfusion MR

Radiology 2016 281

O Kosjerina Z Goldmann T Vollmer E Kaltner H

Atypical adenomatous hyperplasia of lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

regulators and vascularization Lung Cancer 2003 42171ndash182

cheron LE Can A Madabhushi A Rajpoot N

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

Plancoulaine B Herlin P Coster M An Original Approach for

Quantification of Blood Vessels on the Whole Tumour Section Anal Cell Pathol 2003

Michels JJ Plancoulaine B Herlin P Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section

Anal Stereol 2005 2459ndash67

McCleary D Virtual Microscopy In Advanced techniques in diagnostic

r pathology Edited by Hannon-Fletcher M Maxwell P Chichester U

Wiley amp Sons Ltd 2009

Ameisen D Badoual M Gerin C Granier A Lartaud M

pathology images with open source software Diagn Pathol 2013 892

LargeTIFFTools 2013ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools

NDPITools 2011ndash2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools

Williams L Akerman S Kanthou C Tozer G

algorithm for the segmentation and morphological analysis of microvessels in

immunostained histological tumour sections J Microsc 2011 242(3)262

Hemminger J Kurt H Lozanski G Guumlrcan MN Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

n Proc SPIE Volume 9041 201490410Cndash90410Cndash7

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

23

Mason DY JC70 a new

monoclonal antibody that detects vascular endothelium associated antigen on

757

Delia D Sutherland D

Expression of the CD34 gene in vascular endothelial cells Blood

and quantification of angiogenesis in human brain

Greacutevent D Calmon

Zerah M Sainte-Rose C

Arterial Spin Labeling to predict brain tumor grading

vascular density and perfusion MR

Kaltner H Andreacute S

lung its incidence and analysis of

clinical glycohistochemical and structural features including newly defined growth

Rajpoot NM Yener B

Histopathological Image Analysis A Review Biomedical Engineering IEEE Reviews in

An Original Approach for

Anal Cell Pathol 2003

Optimal resolution for automatic

quantification of blood vessels on digitized images of the whole cancer section Image

Virtual Microscopy In Advanced techniques in diagnostic

Chichester UK John

Lartaud M Analyzing huge

92

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarelargetifftools]

2016 [Available from

httpwwwimncin2p3frpagespersoderoulerssoftwarendpitools]

Tozer G An automatic

algorithm for the segmentation and morphological analysis of microvessels in

J Microsc 2011 242(3)262ndash278

Grading Vascularity

from Histopathological Images based on Traveling Salesman Distance and Vessel Size

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

22 Fernaacutendez-Carrobles M

Bueno G A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1

23 Morin K Carlson P

quantification of microv

24 Kayser K Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe

25 BigTIFF Design

httpwwwremotesensingorglibtiffbigtiffdesignhtml

26 Goode A Satyanarayanan M

Images Tech Rep Technical Report CMU

Carnegie Mellon University 2008 [

archiveadmcscmueduanon2008CMU

27 Goode A Gilbert B

Neutral Software Foundation for Digital Pathology

28 Lane TG Vollbeding G

[Available from httpwwwijgorg

29 Sam Leffler S the authors

[Available from httpwwwremotesensingorglibtiff

30 Ameisen D Deroulers C Perrier V Yunegraves JB

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl

31 Ameisen D Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

thesis Univ Paris Diderot

32 Martinez K Cupitt J

Proc IEEE International Conference on Image Processing 2 2005574

33 Rasband WS ImageJ

34 Schneider CA Rasband W

analysis Nature Methods 2012 9671

35 Ridler TW Calvard S

Transactions on Systems Man and Cybernetics 1978 8(8)630

36 Ruifrok A Johnston D

Deconvolution Anal Quant Cyt Hist 2001 23291

37 CodePlex Foundation OpenSeadragon contributors

from httpopenseadragongithubio

38 Sharma H Zerbe N Lohmann S

based methods for image analysis in digital histopathology

161

39 Badoual M Gerin C

P Pallud J Oedema

cases under radiotherapy Cell Proliferation 2014 47

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Carrobles MM Tadeo I Noguera R Garciacutea-Rojo M Deacuteniz O

A morphometric tool applied to angiogenesis research based on vessel

segmentation Diagn Pathol 2013 8(Suppl 1)S20

Carlson P Tranquillo R Automated image analysis programs for the

quantification of microvascular network characteristics Methods 2015 8476

Introduction of virtual microscopy in routine surgical pathology

hypothesis and personal view from Europe Diagnostic pathology 2012 748

BigTIFF Design 2012 [Available from

httpwwwremotesensingorglibtiffbigtiffdesignhtml]

Satyanarayanan M A Vendor-Neutral Library and Viewer for Whole

Tech Rep Technical Report CMU-CS-08-136 Computer Science Department

Carnegie Mellon University 2008 [Available from

archiveadmcscmueduanon2008CMU-CS-08-136pdf]

Harkes J Jukic D Satyanarayanan M OpenSlide A Vendor

Neutral Software Foundation for Digital Pathology J Pathol Inform 2013 427

Vollbeding G The Independent JPEG Grouprsquos JPEG software

httpwwwijgorg]

the authors of LibTIFF LibTIFF ndash TIFF Library and Utilities

httpwwwremotesensingorglibtiff]

Ameisen D Deroulers C Perrier V Yunegraves JB Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Pathology 2013 8(Suppl 1)S23

Inteacutegration des lames virtuelles dans le dossier patient eacutelectroni

Diderot-Paris 7 2013

VIPS - a highly tuned image processing software architecture In

Proc IEEE International Conference on Image Processing 2 2005574ndash

ImageJ 1997ndash2016 [Available from httpimagejnihgovij

Rasband WS Eliceiri KW NIH Image to ImageJ 25 years of image

Nature Methods 2012 9671ndash675

Calvard S Picture Thresholding Using an Iterative Selection Method

Transactions on Systems Man and Cybernetics 1978 8(8)630ndash632

Johnston D Quantification of Histochemical Staining by Color

Anal Quant Cyt Hist 2001 23291ndash299

CodePlex Foundation OpenSeadragon contributors OpenSeadragon

httpopenseadragongithubio]

Lohmann S Kayser K Hellwich O Hufnagl P A review of graph

based methods for image analysis in digital histopathology Diagnostic Pathology 2016

Deroulers C Grammaticos B Llitjos JF Oppenheim C

-based model for diffuse low-grade gliomas application to clinical

cases under radiotherapy Cell Proliferation 2014 47(4)369ndash380

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

24

Deacuteniz O Salido J

A morphometric tool applied to angiogenesis research based on vessel

Automated image analysis programs for the

Methods 2015 8476ndash83

Introduction of virtual microscopy in routine surgical pathology mdash a

Diagnostic pathology 2012 748

Available from

d Viewer for Whole-Slide

Computer Science Department

Available from httpreports-

OpenSlide A Vendor-

J Pathol Inform 2013 427

The Independent JPEG Grouprsquos JPEG software 2013

TIFF Library and Utilities 2012

Battistella M Bouhidel F Legregraves L Janin

A Bertheau P Stack or Trash Quality assessment of virtual slides Diagnostic

Inteacutegration des lames virtuelles dans le dossier patient eacutelectronique PhD

a highly tuned image processing software architecture In

ndash577

httpimagejnihgovij]

geJ 25 years of image

Picture Thresholding Using an Iterative Selection Method IEEE

Staining by Color

OpenSeadragon 2015 [Available

A review of graph-

Diagnostic Pathology 2016

Oppenheim C Varlet

grade gliomas application to clinical

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic

40 Kayser K Borkenfeld S

and Function in Tissue

41 Labiche A Elie N Herlin P

Gauduchon P Henry

survival of patients with advanced ovarian carcinoma

24425ndash435

42 Konda VJA Hart J

Bissonnette M Seewald S

associated neoplasia

43 Szoumlke T Kayser K Trojan I

HJ The role of microvascularization and growthadhesion

prognosis of non-small cell lung cancer in stage II European Journal of Cardio

Surgery 2007 31(5)783

C Deroulers et al diagnostic

DOI httpdxdoiorg1017629wwwdiagnosticpathologyeu

Borkenfeld S Carvalho R Djenouni A Kayser G How to analyze Structure

and Function in Tissue - based Diagnosis Diagnostic Pathology 2016 2106

Herlin P Denoux Y Crouet H Heutte N Joly F

Henry-Amar M Prognostic significance of tumor vascularisation on

survival of patients with advanced ovarian carcinoma Histol Histopathol 2009

Hart J Lin S Tretiakova M Gordon IO Campbell L

Seewald S Waxman I Evaluation of microvascular density in Barrettrsquos

Modern Pathology 2013 26125ndash130

Trojan I Kayser G Furak J Tiszlavicz L Baumhaumlkel J

The role of microvascularization and growthadhesion-regulatory lectins

small cell lung cancer in stage II European Journal of Cardio

(5)783ndash787

diagnostic pathology 2016 2209 ISSN 2364-4893

httpdxdoiorg1017629wwwdiagnosticpathologyeu-2016-2209

25

How to analyze Structure

Diagnostic Pathology 2016 2106

Joly F Heacuteron JF

Prognostic significance of tumor vascularisation on

Histol Histopathol 2009

Campbell L Kulkarni A

Evaluation of microvascular density in Barrettrsquos

Baumhaumlkel JD Gabius

regulatory lectins in the

small cell lung cancer in stage II European Journal of Cardio-Thoracic