A simple example illustrating how finite-context models are implemented. The rows of the table correspond to probability models at a given instant
The use of medical imaging has increased in the last years, especially with magnetic resonance imaging (MRI) and computed tomography (CT). Microarray imaging and images that can be extracted from RNA interference (RNAi) experiments also play an important role for large-scale gene sequence and gene expression analysis, allowing the study of gene function, regulation, and interaction across a large number of genes and even across an entire genome. These types of medical image modalities produce huge amounts of data that, for several reasons, need to be stored or transmitted at the highest possible fidelity between various hospitals, medical organizations, or research units.
- Image coding
- Lossless coding
- Progressive decoding
- Biomedical images
- Image coding standards
- Image decomposition
- Arithmetic coding
- Finite-context modeling
Image compression is a very important research field. It is fundamental in many different areas, such as biomedical imaging, consumer electronics, and Internet, among others. The goal of an image compression method is to represent an arbitrary image using the smallest possible number of bits.
The use of medical imaging has increased in the last years, especially with magnetic resonance imaging (MRI) and computed tomography (CT) . These types of medical image modalities produce huge amounts of data that, for several reasons, need to be stored or transmitted with the highest possible fidelity between various hospitals and medical organizations.
Also related to biomedical imaging, microarray images play an important role for large-scale gene sequence and gene expression analysis, allowing the study of gene function, regulation, and interaction across a large number of genes and even across an entire genome [2, 3]. The output of a microarray experiment is a pair of 16-bits-per-pixel images, usually with a very high resolution, sometimes exceeding 13,000×4,000 pixels. Consequently, over 200 MB can be required to store a single microarray image. Due to the development of these digital imaging technologies, some concerns appeared regarding efficient ways of storing and transmitting the images. In order to overcome these problems, sophisticated compression methods are required.
Another type of images that are addressed in this chapter are those that can be extracted from RNA interference (RNAi) experiments. Those experiments involve marking cells with various fluorescent dyes to capture three components of interest, namely, DNA, actin, and PH3 channels .
Typically, lossless compression algorithms are recommended for dealing with these types of images. In fact, lossless methods are generally required in applications where cost, legal issues, and value play a decisive role, such as in medical imaging or in image archiving . On one hand, the use of lossless algorithms avoids problems of losing diagnostic information vital to identify life-threatening illnesses in the early stages. On the other hand, if a given image is lossless compressed, it is possible to recompress it in the future, using a more efficient algorithm and without losing any information.
Usually, the performance of image coding standards, such as JPEG, JBIG, JPEG-LS, and JPEG2000, falls short when they are applied to certain types of biomedical images. In order to overcome this lower-performance issue, specific compression algorithms are essential. In the class of lossless compression algorithms, there is a specific type that has progressive decoding capabilities. This type of compression is usually designated as "lossy-to-lossless compression." These algorithms are very flexible, because they allow stopping decoding at a certain point, according to the available resources or user requirements. However, the original image can also be obtained, without any loss, if the decoding process goes until the end.
In this chapter, we study the performance of several specific compression methods developed by the authors, as well as of image coding standards, when applied to medical images (computed radiography, computed tomography, magnetic resonance, and ultrasound), RNAi images, and microarray images. The addressed compression algorithms are based on image decomposition, finite-context models, and arithmetic coding. We can divide these algorithms into two categories. In the first one, the input image is split into several bitplanes and each bitplane is encoded individually. This approach is combined with several preprocessing techniques in order to improve the compression efficiency. In the second approach, the intensity levels of a given image are organized in a binary-tree structure, where each leaf node is associated with an image intensity.
We start by presenting the compression algorithms, namely, bitplane decomposition and binary-tree decomposition. We include a brief explanation about finite-context models and arithmetic coding, the entropy coding block used in both approaches. Then, we present a set of experiments that have been performed using the compression algorithms described in Sect. 4, as well as experimental results using the most important image coding standards (e.g., PNG, JBIG, JPEG-LS, and JPEG2000). At the end, we draw some conclusions.
This chapter intends to be a reference for comparison of new compression algorithms that may be developed in the future, for two main reasons. On one hand, the experimental results presented in Sect. 5.2 are state of the art regarding the compression of some of these types of images. On the other hand, several approaches and preprocessing techniques are presented, giving hints about new developments that can be done.
2. Compression methods
The compression algorithms that we address here can be classified into two different categories. One based on bitplane decomposition and the other one based on binary-tree decomposition. For the first category, we use a sophisticated bitplane decomposition approach that was successfully developed for the compression of microarray images . Furthermore, we include some preprocessing techniques, such as segmentation and histogram reduction, in order to improve the compression results. An alternative bitplane decomposition approach based on
The other approach, based on binary-tree decomposition, was developed with success for the compression of medical images  and microarray images . In this decomposition approach, the intensity levels of a given image are organized in a binary-tree structure, where each leaf node is associated with an image intensity.
In the following subsections, we address these two decomposition approaches and give a brief explanation regarding finite-context models and arithmetic coding. The implementation of the compression algorithms can be found in .
2.1. Finite-context models
Markov modeling is widely used in several fields, including image [7, 8, 10, 11, 12] and DNA [13, 14, 15] compression. Finite-context models rely on the Markov property, since an order- finite-context model gives a probability distribution for the next symbol, in a sequence of symbols from an alphabet , taking into account a recent past of depth . Hence, the finite-context model assigns probability estimates for each symbol, regarding the next outcome, according to a conditioning context, , computed over a finite and fixed number of past outcomes (order- finite-context model [16, 17, 18] with states). In the example illustrated in Fig. 1, where and then , an order- model implies having conditioning states. In this case, , so the number of conditioning states is .
The probability estimates are calculated using symbol counts that are accumulated while processing each pixel of the input image, making them dependent not only on the past symbols but also on . The estimator used is
where represents the number of times that, in the past, symbol was found having as the conditioning context and where
is the total number of events that has occurred so far in association with context . Parameter allows balancing between the maximum likelihood estimator and a uniform distribution (when the total number of events, , is large, it behaves as a maximum likelihood estimator). For , (1) is the well-known Laplace estimator.
Initially, all counters are set to zero, i.e., the symbols are assumed to be equally probable. The counters are updated each time a symbol is encoded. However, it is possible to update the counters according to a specific rule. Since the context templates are causal, the decoder is able to reproduce the same probability estimates without needing additional side information.
Table 1 presents a simple example of how a finite context is typically implemented. In this example, we are dealing with an order-5 finite-context model, which means that the context uses the last five encoded symbols to assign the symbol probabilities. Each row of Table 1 represents a probability model that is used to encode the current symbol, using the last five encoded ones. For example, if the last symbols were "11000," i.e., , then the model sends the following probabilities to the arithmetic encoder (denoted as "Encoder" in Fig. 1): and .
One important aspect that must be considered is the size of the context. For an order- model and (binary alphabet), the table has entries and, therefore, its size grows exponentially with . Using a deeper context, we might achieve higher performance, but this requires also more memory.
2.1.1. Mixtures of finite-context models
In order to attain better compression results, the previous approach can be used in a more robust scheme. The goal here is to use a model mixture with more than one finite-context model. In our case, we decided to use only two different models: the one used by  and another one based on
The per symbol information content average provided by the finite-context model of order- , after having processed symbols, is given by
bits per symbol (or bits per pixel, bpp, in the case of images). Hence, the can be viewed as a measure of the performance of the model until that instant. When using several models simultaneously, the probability estimate can be given by a weighted average of the probabilities provided by each model, according to
where denotes the weight assigned to model and
In order to compute the probability estimate for a certain symbol, it is necessary to combine the probability estimates given by (1) using (4). The weight assigned to model can be computed according to
i.e., by considering the probability that model generated the sequence until that point. In that case, we would get
where denotes the likelihood of sequence being generated by model and denotes the prior probability of model . Assuming
where denotes the number of models, we also obtain
Calculating the logarithm, we get
which is related to the code length that would be required by model for representing the sequence . It is, therefore, the accumulated measure of the performance of model until instant . In order to improve the global performance, we decided to use a mechanism that progressively forgets past performances of the models. This mechanism allows each model to progressively forget the past and, consequently, to give more importance to the most recent past. Therefore, we rewrite (11) as
where dictates the forgetting factor to be used. Defining
and removing the logarithms, we can rewrite () as
and, finally, set the weights to
Usually, a compression algorithm can be divided into two parts, modeling and coding. The Markov models are responsible for providing a statistical model as reliable as possible to be used later in the coding stage. The coding stage is where the statistical model is used to compress the data. Arithmetic coding is usually the technique that is used. In the following section, we give a brief explanation on how arithmetic coding works.
2.1.2. Arithmetic coding
Arithmetic coding is a compression technique developed by Rissanen  in the late 1970s. This method is a good alternative to Huffman coding , because it usually generates better compression results. In order to obtain better results, an appropriate probability estimator must be used in the arithmetic encoder (e.g., based on finite-context models, as described above).
This method represents a set of symbols using a single number in the interval [0,1). As the number of symbols of the message grows, the initial interval [0,1) will shrink and the number of bits necessary to represent the interval will increase. When we are processing the pixels of an image in a raster scan order, the probabilities of the intensities of the pixels are conditioned by the context determined by a combination of the already encoded neighboring pixels. The encoder and the decoder estimate this context model dynamically adapting it to the input data, during the encoding/decoding process. According to [16, 17, 18], this arithmetic encoding method generates output bitstreams with average bitrates almost identical to the entropy of the source model.
2.2. Bitplane decomposition
The technique to separate an image into different planes (bitplanes), known as bitplane decomposition, plays an important role in image compression. Usually, each pixel of a grayscale image is represented by 8 bits, or 16 bits as the case of some biomedical images used in the experimental results presented in this chapter. Suppose that the image has pixels and each one is composed of eight bitplanes, ranging from bitplane 0 for the least significant bitplane (LSBP) to bitplane 7 for the most significant bitplane (MSBP). In fact, plane 0 contains all the lowest-order bits in the bytes comprising the pixels in the image as well as plane 7 holds the most significant bits . Figure 2 illustrates these ideas and Fig. 3 shows the various bitplanes for the image presented on the left. As we can see, the MSBPs (especially 7-4) contain the majority of the visually significant data. On the other hand, the lower planes (namely, planes 0-3) contribute to more subtle details in the image.
The bitplane decomposition technique is very useful on image compression. On one hand, it allows some bi-level compression methods, such as JBIG, to be applied to typical grayscale images. The compression method is applied to each bitplane after the decomposition. On the other hand, it is possible to create sophisticated models that take advantage of this decomposition. For instance, it is possible to use information of the previous bitplanes (usually the MSBPs) to improve the compression performance of the LSBPs.
In , an embedded image-domain adaptive compression (EIDAC) scheme used with success on simple images (with a reduced number of active intensity values) is presented. EIDAC uses a context-adaptive bitplane coder, where each bitplane is encoded using a binary arithmetic coder. Later, in , a compression method inspired from EIDAC for microarrays image is proposed. The same authors improved their method using a more robust 3D context modeling . We used this last approach in our experiments and also other alternative versions using some preprocessing techniques, namely, segmentation and bitplane reduction.
In the literature, we can find several algorithms for image segmentation. In our approach, we decided to use a threshold-based method inspired from the work presented in . The segmentation is attained by means of a dynamic thresholding scheme. By applying a threshold value, the pixels of the image can be split in two sets (background and foreground). For each threshold value, it is possible to obtain the number of pixels and the standard deviation of the intensities of these pixels in each set. The desired threshold is calculated according to (17). Using (17), it is always guaranteed that the weighted sum of the standard deviation of both the background and foreground is minimal,
represents the set of pixels in the background section, represents the set of pixels in the foreground section, is the standard deviation of , and is the number of pixels of set . Instead of testing all possible threshold values to find the minimum value of , a recursive search algorithm is used to accelerate the search routine. It is possible to use this recursive search algorithm because plunges down at a certain threshold value, which is chosen as the final threshold value. After the threshold search is completed, a binary map is created where the foreground pixels will be set to "1" and the background pixels to "0."
2.2.2. Bitplane reduction
Bitplane reduction is an interesting method that can further improve compression efficiency by eliminating redundancy in the pixel precision for simple images. Simple images are images where the number of different intensities that occur is very small, compared to the total number of possible intensities. For example, if we have only 24 different intensities out of 256 for an 8-bit image, we only need 5 bits to represent each pixel intensity. This means that, when we are encoding the image, we only need to encode five bitplanes instead of the original eight bitplanes.
Yoo et al.  have shown that it is possible to obtain compression gains using the simplest form of bitplane reduction, known as histogram compaction (HC). Later,  presented a more robust bitplane reduction method called scalable bitplane reduction (SBR). This approach finds the reduced bitplane codeword by growing a binary tree. The method splits each node of the binary tree into two nodes using a simple MINMAX metric to measure the distortion.
In order to better understand the SBR algorithm, we present a small example in Fig. 4. Initially, we associate all the active pixel values to the root node. In this small example, the image only has four active pixel values. Starting in the root node, the algorithm splits all the children sub-nodes using a MINMAX criterion. The split process in the root node starts by computing the value 32,767 from . The computed value is then used to split the node. All the intensities that are lower or equal to 32,767 are inserted in the left sub-node. On the other hand, the remaining intensities (>32,767) are associated with the right sub-node. After splitting the root node, the SBR algorithm adds a zero to the left node codeword and a one to the right node codeword. This splitting process is repeated until all sub-nodes have only one intensity associated with them. In this specific example, "0" is a complete codeword for the original pixel value zero, due to the fact that the first left node or partition does not have more sub-nodes. As a result of the variable-length codewords, the average codeword length can be less than 3 bits. This is useful because during the encoding process, it is possible to skip some bitplanes of the pixel codewords with a lower length.
Taking as example the intensities presented in Fig. 4, we present in Table 2 the codewords for the two histogram reduction methods. As can be seen, the codewords obtained using the HC algorithm are dependent on the number of active intensities. The codeword size can be computed according to
where denotes the number of active intensities. In the example presented in Fig. 4, we have four different intensities, so the codeword size is . The codeword size is constant for all intensities for the HC method. On the contrary, the resulting codewords obtained using the SBR algorithm have different sizes (see Table 2).
2.2.3. Simple bitplane coding
In , Kikuchi et al. introduced the concept of bit modeling by the pixel value estimates. In their approach, instead of using the true bit values of each bitplane, they used the expectation values of the pixels to build up the contexts. This approach is known as
Let us consider that a given pixel value at location () in a given image to be encoded is denoted as . Its decoded value is denoted by . In order to facilitate the explanation, the location indexes () are omitted from now on. A typical raster scan order is used to process each pixel of a given image. Similar to Kikuchi's method, as the process of the bitplane coding proceeds to lower bitplanes, the decoded value, , of the target pixel approaches the true pixel value where denotes the bit of in the case of a 16-bit grayscale image.
Contrarily to Kikuchi's method, our approach uses only one type of context, denoted as
where denotes the spatial location on the template illustrated in Fig. 5. and represent the most recent estimates of the neighboring pixels and the target pixel, respectively.
In Kikuchi's method, the inter-bit correlation on a bitplane is not used. Instead, for modeling a target bit, the authors used the pixel value estimates of which more significant bits have been already available at the decoder. Their method is referred to as
Let us consider that we are coding an -bit depth image, where . Suppose that the bitplane is being encoded at present, where . For every pixel, the higher bits from the until bitplane are known at the decoder. The other lower bits are unknown. The value of the unknown part can be distributed over the interval of . Similar to Kikuchi's method, the values zero and one occur with equal probability in the unknown less significant bits. Under this assumption, the pixel value estimate of the target pixel is expressed by
at the bitplane encoding/decoding, where is the latest decoded value and denotes truncation. In Fig. 6, we illustrate an example of a binary representation of the pixel value estimate in the case .
Initially, all the pixel estimate values are set to . The encoding procedure starts at the MSBP and stops at the LSBP. Assuming a target pixel of bitplane is the one being encoded, under the context of , the pixel estimate of the target pixel is immediately updated by a simple bit operation as
The pixel value estimate is used in a coming chance of reference and will be the decoded pixel value, when the decoding is stopped (after all the bitplanes are processed). The most recent estimate of a given pixel is always made up of two parts: its significant bits are those already encoded/decoded true bits and the other less significant bits are 0 (zero) followed by a successive 1s (ones). The value of the less significant bits is equal to the expectation value of the unknown lower bits, if binary symbols of zero and one are assumed to occur in those bits with equal probability.
2.3. Binary-tree decomposition
Binary trees are also an important data structure that can be used in several algorithms. In the case of image compression, we can associate each leaf node of the binary tree to an image intensity. The binary tree can be viewed as a simple nonlinear generalization of lists; instead of having one way to continue to another element, there are two alternatives that lead to two different elements . Every node (or vertex) in an arbitrary tree has at least two children (see Fig. 7). Each child is designated as left child or right child, according to the position in relation to the tree root.
One of the first methods where binary trees were used for image compression was proposed by Chen et al.  regarding the compression of color-quantized images. Chen's method uses a binary-tree structure of color indexes instead of a linear list structure. Using this binary-tree structure, Chen's method can progressively recover an image from two colors to all of the colors contained in the original image. Inspired by the work done by , a few years later, the authors of [7, 11, 12] developed a lossy-to-lossless method based on binary-tree decomposition and context-based arithmetic coding. In the last approach, the authors studied the performance of their method in several kinds of grayscale images, including medical images. As can been seen, this decomposition approach is very versatile because it can be applied in color-quantized images and also in grayscale images.
This binary-tree decomposition approach was intended to be used in images with a small number of intensities, usually with eight or less bits per pixel, due to a tight relation between the processing time and the number of different intensities of the image. In this work, we intend to study the performance of this approach to compress biomedical images, such as microarray images, RNAi, etc. Another interesting feature of this approach is its capability of progressive decoding, which means that the decoding process can be stopped at any moment according to a specific distortion metric, obtaining an image with some loss. Moreover, it is possible to obtain the original image without any loss if the full decoding process is performed. In the next two sections, we describe in more detail the compression algorithm that is based on a binary-tree decomposition and context-based arithmetic coding.
2.3.1. Hierarchical organization of the intensity levels
This method is based on a hierarchical organization of the intensity levels of the image. This organization of the intensity levels is attained by means of a binary tree. Each node of the binary tree, , represents a certain subset, , of the intensities of the image. The root node contains all active pixel values of the image , where represents the number of different intensities that occur in the image. Therefore, and . Each node possesses a representative intensity, , given by
where and are, respectively, the smallest and largest pixel value in and where denotes the largest integer less than or equal to . Computing the value of according to (23) leads to the smallest possible reconstruction error when the intensities associated to node (those in ) are all substituted by . The error is given by
In order to better understand the construction of the binary tree, we present in Fig. 7 a small example for an image with only five active pixel values . The construction of this tree begins with the association to the root node of the set of intensities that occur in the original image. After this association, it is necessary to compute according to (23). In the example depicted in Fig. 8, and , for the root node. The next step consists of splitting the root node into two sub-nodes and, therefore, splitting into two subsets. In order to split , we need only to compare the intensity with . The intensities lower than are associated with the left node and the other ones with the right one. This procedure is repeated until all nodes are expanded, i.e., until having a tree with leaves ( is the number of active intensities presented in the original image). The next node to expand is chosen, taking into consideration the smallest possible reconstruction error. In case of a tie, one is arbitrarily chosen, although it is necessary that the decoder picks the same one.
In order for the decoder to be able to build the same tree, it is necessary to send the information of the active pixel values to the decoder using a 65,536-bit indicator. In order to encode this indicator, the encoder uses the following strategy. First, the maximum intensity value is sent. After that, a string of bits is transmitted, such that if the bit of the string is one, it means that the intensity is present in the image and zero otherwise. The previous 65,536-bit indicator is enough for the decoder to construct exactly the same binary tree.
2.3.2. Encoding pixel locations
After each node is expanded, two new nodes are created, each one with a representative intensity ( for the left node and for the right node). This step can be seen as a region of arbitrary shape, containing zeros (relative to the left node) and ones (regarding the right node), that needs to be communicated to the decoder. The position where the pixels in the image are associated with the parent node that was expanded is known by the decoder. However, it is necessary to communicate to the decoder the zeros and ones that correspond to the pixels that after the expand procedure will be associated to the left and right nodes, respectively. Since the decoder has access to the pixels associated to the parent node that was expanded, it is enough to encode a binary mask, where zero indicates that the pixel needs to change its intensity to and one indicates a change to . This binary mask is encoded using arithmetic coding based on variable-size finite-context models [16, 17, 18].
The performance of the compression method is directly dependent on the encoding of these binary masks. The encoding efficiency of these binary masks can be controlled by a carefully chosen context modeling that will then drive the binary arithmetic encoder. The context is constructed based on the template depicted in Fig. 9. The number of context pixels can go up to 16 at most, and they are numbered according to their distance to the encoding pixel (represented in gray in Fig. 9). A particular context is represented using a sequence of bits,
and where denotes the intensity of the pixel in the current reconstructed image corresponding to position of the context template.
The value defines the model order used. In this case, the value varies as the encoding proceeds. This variation is necessary in order to improve the compression performance. Furthermore, it is expected to have larger mask regions initially in the first nodes that are expanded and smaller regions when . This variation is also useful to avoid the problem of context dilution. In this research work, we present two modes of context creation. One is denoted as "greedy" where the context size is first chosen using a value according to . After that, the method tests incrementally several context sizes bigger and smaller than and stops when it reaches one context that produces worse results than the previous best. In the end, the algorithm has two context sizes. One attained when applying an increment to and the other one when applying a decrement to . The best context size is then chosen to encode the binary mask. The other mode is slower because it tests all possible context sizes. This second mode, denoted as "best," always attains the best context size that minimizes the bitrate. For both cases, the context size needs to be sent to the decoder, for each node that is expanded.
There is also an alternative way to encode the binary mask. If the number of bits required to encode the mask and the context size is bigger than the total number of pixels associated with the node to be expanded, the encoder sent the binary mask as a binary string, without compression. In order for the decoder to differentiate between these two modes, a binary stream is needed to be encoded for each node that is expanded.
3. Evaluation of the compression methods
In this section, we present compression results obtained by the compression methods presented earlier in Sect. 4. We decided to present only the results of the best version of each method in order to avoid extending this section. We start with the description of the data sets used in this work. Then, we provide the obtained compression results. At the end of this section, we present a study of the rate distortion, comparing the two compression approaches described in Sect. 4 and two image coding standards, JBIG and JPEG2000.
3.1. Data sets
To evaluate the compression methods presented in this chapter, we used three types of images: microarray, medical, and RNAi. The output data obtained in a microarray experiment is a pair of 16-bits-per-pixel grayscale images, one from the so-called red channel and the other from the green channel (see Fig. 10). We use a total of 298 microarray images of nine different data sets as described in Table 3.
Regarding the medical images, we used images of four modalities: computed radiography (CR), computed tomography (CT), magnetic resonance (MR), and ultrasound (US). In Fig. 11, we can find five examples of medical images used in this work. The data set used in  was also considered as a medical reference data set. All the medical image data sets are depicted in Table 4, a total of 370 images.
Finally, we also used a recent and popular image type that can be extracted from RNA interference (RNAi) experiments. Those experiments involve marking of cells with various fluorescent dyes to capture three components of interest, namely, DNA, actin, and PH3 channels . In Table 5, we can find the RNAi image data sets used in this work, a total of 34,560 images. The images were retrieved from the RNAi experiments without any kind of transformation (no normalization was applied). For us, it does not make sense to perform a normalization operation in order to reduce the image depth from 10 to 8 bits per pixel. The normalization is a lossy process, and hence, applying a lossless compression method to images that suffered some loss is not appropriate. In Fig. 12 we present some examples of RNAi images.
In Tables 3-5, we can see several important measures: image size, depth, entropy, intensity usage, and a sparsity measure called Gini index or GI . The GI is a normalized measure that assumes values between zero and one. Values close to zero means that image has a lower sparsity histogram. On the other hand, values close to one represent an image that has a very sparse histogram.
|RNAi D1||∣ (DNA)||2,304||7.408||4.140%||0.274|
|RNAi D2||∣ (DNA)||2,304||6.617||2.925%||0.172|
|RNAi D3||∣ (DNA)||2,304||7.210||4.195%||0.257|
|RNAi D4||∣ (DNA)||2,304||7.530||4.249%||0.286|
|RNAi D5||∣ (DNA)||2,304||7.281||4.046%||0.256|
|RNAi all||∣ (DNA)||11,520||7.209||3.911%||0.249|
Taking into consideration Table 3, we can see that the image sizes of the microarray data sets are very large (ranging from to ) and the bit depth is 16 for all the data sets. The average entropy goes from bpp to 11 bpp, and the percentage of active intensities varies from 5.4% to 98.1%. The GI measures are all higher than 0.49 for all data sets reaching values close to 0.89 (very sparse) for the
Regarding the medical image data sets (see Table 4), we can see that the image sizes are lower when compared to the microarray images (except for the
Finally, we provide 5 RNAi image data sets in Table 5. We split each data set into three channels (DNA, PH3, and actin). All the images have size and depth of 12 bits. Globally, the average entropy is about 6.77 bpp and the average intensity usage is around 2.5%. Regarding the GI, the values are very low , which means that these images are not very sparse.
3.2. Experimental results
In this subsection, we present the results obtained using several general purpose compression tools (e.g., gzip, bzip2, PPMd, and LZMA), image coding standards (e.g., PNG, JBIG, JPEG-LS, and JPEG2000), and the methods described in Sect. 4. In Tables 6-8, we can find the compression results for all data set described earlier in Sect. 5.1, using several general compression tools and image coding standards. Default parameters were used in all compression tools. Hence, we did not try to adjust some parameters in order to improve the compression results. Only the lossless mode was imposed.
JBIG results were obtained using version 2.0 of the JBIG-Kit package http://www.cl.cam.ac.uk/ mgk25/jbigkit The original website of this codec, http://spmg.ece.ubc.ca, is currently unavailable. However, it can be obtained from http://sweet.ua.pt/luismatos/codecs/jpeg_ls_v2.2.tar.gz The original website of this codec, http://jj2000.epfl.ch, is currently unavailable. Nevertheless, this codec can be obtained from http://sweet.ua.pt/luismatos/codecs/jj2000_5.1-src.zip
The original website of this codec, http://spmg.ece.ubc.ca, is currently unavailable. However, it can be obtained from http://sweet.ua.pt/luismatos/codecs/jpeg_ls_v2.2.tar.gz
The original website of this codec, http://jj2000.epfl.ch, is currently unavailable. Nevertheless, this codec can be obtained from http://sweet.ua.pt/luismatos/codecs/jj2000_5.1-src.zip
|RNAi D1||∣ (DNA)||9.120||6.846||6.832||7.314||9.857||6.802||6.311||6.533|
|RNAi D2||∣ (DNA)||8.358||6.469||6.389||6.714||9.421||6.469||6.094||6.233|
|RNAi D3||∣ (DNA)||8.948||6.735||6.637||7.153||9.665||6.704||6.238||6.436|
|RNAi D4||∣ (DNA)||6.243||6.925||6.915||7.415||10.014||6.878||6.372||6.612|
|RNAi D5||∣ (DNA)||9.007||6.765||6.745||7.198||9.775||6.729||6.259||6.459|
|RNAi all||∣ (DNA)||8.935||6.748||6.703||7.159||9.746||6.716||6.255||6.455|
According to the results depicted in Tables 6-8, it seems that, globally, JPEG-LS is the best image coding standard. Among the general compression methods used, PPMd is the one that attained the best compression results.
Tables 9-11 provide lossless compression results using the methods described in Sect. 4. BPD (bitplane decomposition) corresponds to the results using method ; BFS (background-foreground separation) corresponds to using the previous approach with segmentation. The columns HC (histogram compaction) and SBR (scalable bitplane reduction) correspond to the approaches that use bitplane reduction in method . The SBC-Mix (simple bitplane coding-mixture) corresponds to the approach described in Sect. 4.2.3 using a mixture of finite-context models. The last column, denoted as BTD (binary-tree decomposition), corresponds to the results obtained using the method described in Sect. 4.3.
If we look closely to Table 9, we can see that the method based on binary-tree decomposition is the one that attained the best compression results among all the others, for the case of microarray images. The best method is about 11% better than JPEG-LS. However, the method SBC-Mix is the best for three data sets:
Regarding the experiments performed on medical images and taking into consideration the results presented in Table 10, we can conclude once again that the method based on binary-tree decomposition outperforms all the others and is about 9% better than JPEG-LS.
|RNAi D1||∣ (DNA)||6.250||6.293||6.250||6.255||6.225||
|RNAi D2||∣ (DNA)||5.959||5.986||5.968||5.968||5.960||
|RNAi D3||∣ (DNA)||6.175||6.213||6.169||6.164||6.145||
|RNAi D4||∣ (DNA)||6.309||6.355||6.312||6.317||6.289||
|RNAi D5||∣ (DNA)||6.195||6.233||6.194||6.198||6.166||
|RNAi all||∣ (DNA)||6.178||6.216||6.179||6.182||6.157||
Finally, in Table 11, we present the results for the RNAi images, and in this case, method SBC-Mix is the one that attained the best compression results, almost 3% better than JPEG-LS. The difference between the SBC-Mix and BTD is very low (close to 0.01 bpp). In our opinion, it seems that the methods described in Sect. 4 attain better compression results when compared to JPEG-LS for images with higher GI values (sparse images). This is the reason why the binary-tree decomposition approach attains between 9% to 11% better results than JPEG-LS for the microarray and medical images. On the other hand, the RNAi images have a lower GI (around 0.17), therefore the lower performance of our methods when compared to JPEG-LS.
In Figs. 15 and 16, we can see the encoding and decoding speed in kilobytes per second for the compression methods described in Sect. 4. In the encoding phase, it seems that the method based on binary-tree decomposition is the fastest one among all the others for all data sets. In the decoding phase, the fastest method is different from data set to data set. For the microarray and medical image data sets, the methods based on bitplane decomposition are faster than the method based on binary-tree decomposition. On the other hand, for the RNAi images, the method based on binary-tree decomposition is faster than all the others. The SBC-Mix method is the slowest one in all data sets. The lower decoding speed for the SBC-Mix is due to the mixture procedure. For each symbol that is processed, the model weights need to be updated, which is a very time-consuming task.
3.3. Rate distortion study
The two decomposition approaches described in Sect. 4 have progressive decoding capabilities (also known as lossy to lossless). Due to that, it is important to understand what is the error induced in the image during the decoding phase when only part of the data is decoded. This characteristic allows also to obtain the original image without any loss.
In Figs. 15 and 16, we present the rate distortion curves of two images, "array1" from the
Regarding Fig. 15, we can notice that the method based on binary-tree decomposition outperforms all the other methods in terms of -norm and -norm. JBIG and method  have a similar performance in terms of rate distortion. The JPEG2000 standard attains globally worse results in terms of . Furthermore, we can notice a sudden degradation of the rate distortion, for higher bitrates . We believe that this phenomenon is probably related to the default parameters used by the encoder, which might not be well suited for microarray images.
In Fig. 16, we can see in the first plot, related to the -norm, that method  attains the worse distortion results. JBIG is slightly better but worse than JPEG2000 and the method . We can also see that JPEG2000 outperforms all the other methods in terms of -norm for lower bitrates. For bitrates higher than 2 bpp, the best method is the one based on binary-tree decomposition. For the -norm, JPEG2000 and method  are the ones that attained the worse results. On the other hand, method  outperforms all the others, regardless of the bitrate. We did not include results for other images to avoid extending this chapter, but the results obtained with the medical images are very similar with the results obtained using RNAi images. On the other hand, we can conclude that the rate distortion results for the microarray images are not similar to the other data set types (medical and RNAi).
The use of biomedical imaging has increased in the last years. These biomedical images include microarray, medical, and RNAi images. In this chapter, we have studied two image decomposition approaches to be applied to this type of images in order to compress them efficiently.
We presented a set of comprehensive results regarding the lossless compression of biomedical images using general coding methods (e.g., gzip), image coding standards (e.g., JPEG2000), and the two image decomposition approaches that rely on finite-context models and arithmetic coding.
From the obtained experimental results, we conclude that JPEG-LS gives the best compression results, among the image coding standards, but lacks lossy-to-lossless capability, which may be a decisive functionality if remote transmission over possibly slow links is a requirement.
We developed compression algorithms based on two decomposition approaches: bitplane decomposition and binary-tree decomposition. In the bitplane decomposition, we also used segmentation, bitplane Reduction, and an approach based on bit modeling by the pixel value estimates. All the developed methods allow lossy-to-lossless compression and are based on finite-context models and arithmetic coding. According to the obtained results, the approach based on binary-tree decomposition seems to be the one that attains the best compression results. The only exceptions are the RNAi images, for which the best method is the one based on a mixture of finite-context models.
In terms of coding speed, the compression algorithm based on a binary-tree decomposition seems to be the fastest one among all the others in the encoding phase. In the decoding stage, the approaches based on bitplane decomposition seem to be faster for the microarray and medical image data sets. For the RNAi images, the method based on binary-tree decomposition seems to be the fastest one.
A rate distortion study was also performed and, according to the obtained results, it seems that the method based on binary-tree decomposition attains the best results for the majority of the cases. The results obtained by the developed compression algorithms have been compared with general-purpose compression methods and also with image coding standards. According to the results, we can conclude that these compression methods have better compression performance in all the image test sets used.
This work was developed at IEETA (Institute of Electronics and Telematics Engineering of Aveiro).It was partially supported by FEDER, through the Operational Program Competitiveness Factors (COMPETE), and by National Funds through FCT (Foundation for Science and Technology) in the context of a PhD Grant (FCT reference SFRH/BD/85855/2012) and projects PEst-OE/EEI/UI0127/2014 and Incentivo/EEI/UI0127/2014.
A. Nait-Ali and C. Cavaro-Menard. Compression of Biomedical Images and Signals. Wiley-ISTE, 1st edition, 2008.
P. Hegde, R. Qi, K. Abernathy, C. Gay, S. Dharap, R. Gaspard, J. Earle-Hughes, E. Snesrud, N. Lee, and John Q. A concise guide to cDNA microarray analysis. Biotechniques, 29(3):548–562, September 2000.
S. K. Moore. Making chips to probe genes. IEEE Spectrum, 38(3):54–60, March 2001.
C. Falschlehner, S. Steinbrink, G. Erdmann, and M. Boutros. High-throughput RNAi screening to dissect cellular pathways: a how-to guide. Biotechnology Journal, 5(4):368–376, 2010.
D. S. Taubman and M. W. Marcellin. JPEG2000: Image Compression Fundamentals, Standards and Practice. Kluwer Academic Publishers, 2002.
A. J. R. Neves and A. J. Pinho. Lossless compression of microarray images using image-dependent finite-context models. IEEE Transactions on Medical Imaging, 28(2):194–201, February 2009.
A. J. Pinho and A. J. R. Neves. Progressive lossless compression of medical images. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP-2009, Taipei, Taiwan, April 2009.
L. M. O. Matos, A. J. R. Neves, and A. J. Pinho. Compression of microarrays images using a binary-tree decomposition. In Proceedings of the 22th European Signal Processing Conference, EUSIPCO-2014, pages 531–535, Lisbon, Portugal, September 2014.
MENT, 2014. Last accessed on February, 2015. http://bioinformatics.ua.pt/software/ment.
A. J. R. Neves and A. J. Pinho. Compression of microarray images. In S. Miron, editor, Signal Processing, pages 429–448. INTECH, March 2010.
A. J. Pinho and A. J. R. Neves. L-infinity progressive image compression. In Proceedings of the Picture Coding Symposium, PCS-07, Lisbon, Portugal, November 2007.
A. J. Pinho and A. J. R. Neves. Lossy-to-lossless compression of images based on binary tree decomposition. In Proceedings of the IEEE International Conference on Image Processing, ICIP-2006, pages 2257–2260, Atlanta, Georgia, USA, October 2006.
A. J. Pinho, D. Pratas, and P. J. S. G. Ferreira. Bacteria DNA sequence compression using a mixture of finite-context models. In Proceedings of the IEEE Workshop on Statistical Signal Processing, Nice, France, June 2011.
A. J. Pinho, A. J. R. Neves, D. A. Martins, C. A. C. Bastos, and P. J. S. G. Ferreira. Finite-context models for DNA coding. In S. Miron, editor, Signal Processing, pages 117–130. INTECH, March 2010.
A. J. Pinho, A. J. R. Neves, V. Afreixo, Carlos A. C. Bastos, and P. J. S. G. Ferreira. A three-state model for DNA protein-coding regions. IEEE Transactions on Biomedical Engineering, 53(11):2148–2155, November 2006.
T. C. Bell, J. G. Cleary, and I. H. Witten. Text Compression. Prentice Hall, 1990.
K. Sayood. Introduction to Data Compression. Morgan Kaufmann, 3rd edition, 2006.
D. Salomon. Data Compression - The Complete Reference. Springer, 4th edition, 2007.
J. Rissanen and G. G. Langdon, Jr. Arithmetic coding. IBM Journal of Research and Development, 23(2):149–162, March 1979.
David Huffman. A method for the construction of minimum-redundancy codes. Proceedings of the IRE, 40(9):1098–1101, September 1952.
R. C. Gonzalez and R. E. Woods. Digital Image Processing. Prentice Hall, 2nd edition, 2002.
P. Buonora and F. Liberati. A format for digital preservation of images: a study on JPEG 2000 file robustness. D-Lib Magazine, 14(7/8), August 2008.
Y. Yoo, Y. G. Kwon, and A. Ortega. Embedded image-domain compression using context models. In Proceedings of the IEEE International Conference on Image Processing, ICIP-99, volume I, pages 477–481, Kobe, Japan, October 1999.
A. J. R. Neves and A. J. Pinho. Lossless compression of microarray images. In Proceedings of the IEEE International Conference on Image Processing, ICIP-2006, pages 2505–2508, Atlanta, Georgia, USA, October 2006.
A. Neekabadi, S. Samavi, S. A. Razavi, N. Karimi, and S. Shirani. Lossless microarray image compression using region based predictors. In Proceedings of the IEEE International Conference on Image Processing, ICIP-2007, volume 2, pages 349–352, San Antonio, Texas, USA, September 2007.
Y. Yoo, Y. G. Kwon, and A. Ortega. Embedded image-domain adaptive compression of simple images. In Proceedings of the 32nd Asilomar Conference on Signals, Systems, and Computers, volume 2, pages 1256–1260, Pacific Grove, California, USA, November 1998.
H. Kikuchi, K. Funahashi, and S. Muramatsu. Simple bit-plane coding for lossless image compression and extended functionalities. In Proceedings of the Picture Coding Symposium, PCS-09, pages 1–4, Chicago, Illinois, USA, May 2009.
H. Kikuchi, R. Abe, and S Muramatsu. Simple bitplane coding and its application to multi-functional image compression. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, E95.A(5):938–951, 2012.
H. Kikuchi, T. Deguchi, and M. Okuda. Lossless compression of LogLuv32 HDR images by simple bitplane coding. In Picture Coding Symposium, PCS-2013, pages 265–268, San Jose, California, USA, December 2013.
S. Baase and A. V. Gelder. Computer Algorithms: Introduction to Design and Analysis. Addison Wesley, 3rd edition, November 1999.
X. Chen, S. Kwong, and J.-F. Feng. A new compression scheme for color-quantized images. IEEE Transactions on Circuits and Systems for Video Technology, 12(10):904–908, October 2002.
A. J. Pinho and A. J. R. Neves. A context adaptation model for the compression of images with a reduced number of colors. In Proceedings of the IEEE International Conference on Image Processing, ICIP-2005, volume 2, pages 738–741, Genova, Italy, September 2005.
mini-MIAS, 1995. Last accessed on February, 2015. http://peipa.essex.ac.uk/pix/mias.
D. Zonoobi, A. A. Kassim, and Y. V. Venkatesh. Gini index as sparsity measure for signal reconstruction from compressive samples. IEEE Journal of Selected Topics in Signal Processing, 5(5):927–932, September 2011.
ApoA1, 2001. Last accessed on February, 2015. http://www.stat.berkeley.edu/ terry/zarray/Html/apodata.html or http://sweet.ua.pt/luismatos/microarrays/apoa1.html.
Arizona, 2011. Last accessed on February, 2015. http://deic.uab.es/ mhernandez/media/imagesets/arizona.tar.bz2 or http://sweet.ua.pt/luismatos/microarrays/arizona.html.
IBB, 2013. Last accessed on February, 2015. http://deic.uab.es/ mhernandez/media/imagesets/ibb.tar.bz2 or http://sweet.ua.pt/luismatos/microarrays/ibb.html.
ISREC, 2001. Last accessed on February, 2015. http://ccg.vital-it.ch/DEA/module8/P5_chip_image/images or http://sweet.ua.pt/luismatos/microarrays/isrec.html.
Omnibus-LM, 2006. Last accessed on February, 2015. http://deic.uab.es/ mhernandez/media/imagesets/omnibus.txt or http://sweet.ua.pt/luismatos/microarrays/omnibus-lm.html.
Omnibus-HM, 2006. Last accessed on February, 2015. http://deic.uab.es/ mhernandez/media/imagesets/omnibus.txt or http://sweet.ua.pt/luismatos/microarrays/omnibus-hm.html.
Stanford, 2001. Last accessed on February, 2015. ftp://smd-ftp.stanford.edu/pub/smd/transfers/Jenny or http://sweet.ua.pt/luismatos/microarrays/stanford.html.
Yeast, 1998. Last accessed on February, 2015. http://genome-www.stanford.edu/cellcycle/data/rawdata/individual.html or http://sweet.ua.pt/luismatos/microarrays/yeast.html.
YuLou, 2004. Last accessed on February, 2015. http://www.cs.ucr.edu/yuluo/MicroZip or http://sweet.ua.pt/luismatos/microarrays/yulou.html.
MEDNAT, 2004. Last accessed on February, 2015. http://sun.aei.polsl.pl/ rstaros/mednat.
BBBC017v1, 2006. Last accessed on February, 2015. http://www.broadinstitute.org/bbbc/BBBC017.
- http://www.cl.cam.ac.uk/ mgk25/jbigkit
- The original website of this codec, http://spmg.ece.ubc.ca, is currently unavailable. However, it can be obtained from http://sweet.ua.pt/luismatos/codecs/jpeg_ls_v2.2.tar.gz
- The original website of this codec, http://jj2000.epfl.ch, is currently unavailable. Nevertheless, this codec can be obtained from http://sweet.ua.pt/luismatos/codecs/jj2000_5.1-src.zip