- Open Access
Detection of biomarkers for Hepatocellular Carcinoma using a hybrid univariate gene selection methods
Theoretical Biology and Medical Modelling volume 9, Article number: 34 (2012)
Discovering new biomarkers has a great role in improving early diagnosis of Hepatocellular carcinoma (HCC). The experimental determination of biomarkers needs a lot of time and money. This motivates this work to use in-silico prediction of biomarkers to reduce the number of experiments required for detecting new ones. This is achieved by extracting the most representative genes in microarrays of HCC.
In this work, we provide a method for extracting the differential expressed genes, up regulated ones, that can be considered candidate biomarkers in high throughput microarrays of HCC. We examine the power of several gene selection methods (such as Pearson’s correlation coefficient, Cosine coefficient, Euclidean distance, Mutual information and Entropy with different estimators) in selecting informative genes. A biological interpretation of the highly ranked genes is done using KEGG (Kyoto Encyclopedia of Genes and Genomes) pathways, ENTREZ and DAVID (Database for Annotation, Visualization, and Integrated Discovery) databases. The top ten genes selected using Pearson’s correlation coefficient and Cosine coefficient contained six genes that have been implicated in cancer (often multiple cancers) genesis in previous studies. A fewer number of genes were obtained by the other methods (4 genes using Mutual information, 3genes using Euclidean distance and only one gene using Entropy). A better result was obtained by the utilization of a hybrid approach based on intersecting the highly ranked genes in the output of all investigated methods. This hybrid combination yielded seven genes (2 genes for HCC and 5 genes in different types of cancer) in the top ten genes of the list of intersected genes.
To strengthen the effectiveness of the univariate selection methods, we propose a hybrid approach by intersecting several of these methods in a cascaded manner. This approach surpasses all of univariate selection methods when used individually according to biological interpretation and the examination of gene expression signal profiles.
Microarray is a powerful technology for gene profiling. Being able to retrieve the gene expression values of the whole genome and thus studying the molecular biology of tissues can lead to diagnosis of different diseases. Next to the value of microarrays in understanding the biological processes underlying a specific disease, it has a great role in discovering new biomarkers for cancers. A biomarker in the biomedical field is a substance that has a characteristic feature as an objective indicator of a biological state, such as normal physiological processes. The most important advantage of Insilco prediction of biomarkers using microarrays is minimizing the number of experimental work required for detecting new biomarkers and thus saving much time and money.
In liver cancer, exploring gene expression patterns of samples from healthy patients and others infected with Hepatocellular Carcinoma (HCC) has revealed a significant difference in the expression of some genes from normal to tumour samples. Genes having high variance between both classes of samples in their expression are informative features that should be used in any further analysis as suggested biomarkers. Discovering new biomarkers of HCC can help in early detection of this type of cancer. Early detection of HCC is a vital issue as it can help patients in receiving therapeutic benefits rather than curative surgery. Unfortunately, there is no effective biomarker for early detection of HCC. The current diagnosing of HCC relies on detection of an inaccurate biomarker, alpha-fetoprotein (AFP). Therefore, there is a need for detecting new reliable biomarkers for HCC.
Detection of biomarkers in the context of machine learning can be treated as a feature selection problem that tries to select features (markers) that can distinguish between different classes of data. The selected features are a list of genes that might be informative for discriminating different types and subtypes of diseases. So we will refer to feature selection all through this paper by gene selection.
A widely used approach for gene selection is the univariate selection approach[4, 5]. Univariate selection approaches yield consistently better results than multivariate approaches. In the univariate approach, the relevance of each gene is determined individually. However, the multivariate approach such as Singular Value Decomposition (SVD) and Principal Component Analysis (PCA) considers the interactions between genes. Some of the univariate methods are: Pearson’s correlation coefficients, Euclidean distance, Cosine coefficient, Entropy and Mutual information.
Discovery of biomarkers from microarrays data was studied in several publications[4–7]. All of these research efforts were seeking for selecting informative genes as a prerequisite step of a high performance classifier. None have assessed the quality of the gene selection methods from the point of retrieving relevant biomarkers known in the biological databases. A research paper made a comparison between the univariate and multivariate approaches in improving the accuracy of classification. This work employed seven microarrays datasets representing different types of cancer. They found that the univariate methods surpassed the multivariate with five datasets. This was due to the small number of samples relative to the number of genes being studied which is always the case in microarrays. Another research work offered a combination between the Correlation Coefficient, as a univariate selection approach, and the singular value decomposition (SVD), as a multivariate approach. However, they did not attain high classification accuracy due to the dependency between samples of the microarrays data being studied. So in our research, we focused on testing the Correlation Coefficient as a gene selection method individually or integrated with other univariate gene selection methods. A robust method of discovering new biomarker using the ensemble feature selection techniques in support vector machine (SVM) classifier was also presented. This method improved the performance of the classification of microarrays data. However this was achieved only in cases when studying a few tens of genes. So, this method is not suitable for studying high throughput microarrays data that almost contain more than 20,000 genes. Another study by Cho et al. presented a comparative study of different gene selection methods (Pearson’s correlation coefficients, Euclidean distance, Cosine coefficient, Mutual information and information gain). They used three benchmarking datasets and tested the impact of using such gene selection methods on different classifiers. An ideal biomarker was assumed that had two values of 0 and 1, which might produce irrelevant correlation and cosine coefficient. So, in this study we rather preferred to propose different values than those ones as well as normalize the gene expression values when the Euclidean Distance and the Cosine Coefficient are being calculated.
To conclude, the scope of those previous publications was focused on benchmarking data sets, which contains a few thousands of genes, to compare the adequacy of different gene selection methods and usually assessed using different classifiers. Therefore, we were motivated to expand the research to cover microarrays of HCC comprising a huge number of genes by means of the proposed hybrid technique. We examined the power of some of the previous methods (cf.) in addition to different Entropy estimators. Biological validation of the retained top ten lists of genes is proposed in our work too. Moreover, the significance of signal profiles of the selected genes in both normal and tumor samples were validated using t-test.
Briefly, we defined an ideal biomarker as a gene that has two discrete values, minus one in normal samples and one in tumour samples. Genes with similar profile to the ideal biomarker are selected using Pearson’s correlation coefficients, Euclidean distance, Cosine coefficient, Entropy and Mutual information. Then they are ranked according to their similarity with the ideal gene. Highly ranked genes from all methods are intersected in a cascaded manner. Finally, the top ranked genes are examined by checking their signal profiles and mining the biological databases for their existence as known biomarkers.
The steps of the proposed framework include pre-processing of Affymetrix files, gene selection, gene ranking, finding common genes and gene validation through biological interpretation and signal profiling. These steps are shown in Figure1.
Thirty five microarray samples were downloaded from Gene Expression Omnibus (GEO). Nineteen of theses samples are taken from normal subjects. The remaining sixteen samples are for subjects with HCC as a complication of HCV cirrhosis. This data were collected on the Affymetrix HG-U133A 2.0 platform. The raw data in “.CEL” format was collected from GEO are pre-processed using the Affy package provided by Bioconductor.
Suppose we have a gene expression matrix that contains a set of genes' expression values measured in Q samples. The first k samples are taken from normal persons and the remaining L samples are taken from HCC patients. Each gene in this matrix can be defined as a vector of Q values. An ideal up regulated biomarker can be defined as a gene that having a value of minus one in normal samples and a value of one in tumour samples. The ideal up regulated biomarker is a step up signal as shown in Figure2.
Pearson's correlation coefficient
The similarity between the ideal up regulated biomarker, B Ideal , and a gene Y can be determined by computing the Pearson's correlation coefficient as stated in Equation 1.
The Pearson's correlation coefficient, r, is always between −1 and +1. The closer the correlation is to +/−1, the closer to a perfect linear relationship.
The similarity between two vectors can be determined by measuring the distance between them in the space. So, we used the Euclidean distance between B Ideal and all genes as another measure of similarity between them. See the following equation.
The gene expression values were first normalized (by subtracting the mean value of each gene from all its values) before calculating the Euclidean distance between them and B Ideal . In this manner, all values will be in the same range from −1 to 1 and an accurate distance will be calculated.
The Cosine coefficient can measure the dependency between B Ideal , and a gene Y as seen in Equation 3. If the Cosine coefficient is zero, then they are independent and if one, then they are pointing in the same direction.
In the same manner, all genes expression values were first normalized as mentioned above.
In this formula, we need firstly need to calculate, the entropy of B Ideal , and the conditional entropy between B Ideal and a gene Y:.
The Entropy is a measure of the uncertainty of a discrete random variable x. It is calculated via estimators. The estimator that is most commonly used is the Empirical estimator. It is also called Maximum likelihood. It is defined by,
where, is the number of data points in bin k, m is number of observations (the number of gene expression values) and n is the number of bins. This method estimates the probability of each gene by counting the number of values in each bin of comparable values. In this paper, the number of bins equals two as the informative genes should have different expression values in normal samples than those in tumour samples. Other entropy's estimators are: Miller-Madow, Shrink and Schurmann-Grassberger. The Miller-Madow Entropy estimator adds a correction bias to the Empirical estimator. The Shrinkage Entropy estimator is a combination of two different estimators: one with low variance and the other with low bias. The last examined estimator is the Schurmann-Grassberger Entropy estimator. It uses the Dirichlet distribution which is a generalization of Beta distribution[13–16].
For each gene selection method, we calculated the similarity between the ideal gene and 22277 genes comprising the original data set. Genes that have a strong association with the ideal gene should have Pearson correlation coefficient values from ±0.7-1. So, the number of retrieved genes using this method was 2284 genes. We restricted the number of selected genes using the other methods to the same number of genes. The functional annotations of the top ten genes are mined through DAVID's functional annotation, ENTREZ and KEGG pathways. The results obtained from each method are listed in Tables1,2,3,4 and5. In each table, we listed for each gene in the top ten lists its Affy ID, symbol, ENTREZ ID, type, Gene Ontology (GO) processes, Oncology term and pathways. Signal profiles of first four genes in the top ten genes are charted as shown in the figures section.
As observed from the biological details listed in Table1, it is clear that top ten genes selected by the Pearson correlation coefficient and Cosine coefficient are the same. This is due to the high similarity between them according to Equations 1 and 3. Six of the top ten genes selected using these two methods have been previously implicated in different types of cancers according to their oncology term. Four genes (RGS1, LGALS3, IL7R and C7) have immune response process as one of their GO processes. Moreover, two genes (IL7R and LGALS3) are related to liver disease as they were manipulated in the literature of HCV and HCC. This derives the attention to the importance of carrying up further biological investigation on these discovered genes.
In Table2, a different set of genes were retrieved using Mutual information. Four genes (DAB2, DCN, CELF2 and COL1A2) have appeared previously in cancers. Another gene (GPNMB) appeared to be involved with the liver inflammation. Two genes (DCN and C7) as shown in Table3 are common genes in the list retrieved using Euclidean distance and Pearson's correlation coefficient methods. These two genes have been involved in colon and breast carcinoma. DAB2 which is a regulator of ovarian carcinoma and has been implicated in prostate and breast cancer is a common gene in the top ten genes selected using Euclidean distance and Mutual information.
The last method, Entropy using Empirical estimator, gave the lowest performance as shown in Table4. Only one gene (DDX5) of the top ten genes has been previously implicated in prostate cancer.
For genes selected by the proposed hybrid technique, we can notice from Table5 that there are 7 genes (2 genes for HCC and 5 genes in different types of cancer) are yielded. High portion of genes (LGALS3, CELF2, CYTIP, C7, DCN, CXCR4) retrieved by Pearson's correlation coefficient appeared in the top ten list retrieved by the hybrid technique. One gene (DCN) is common in the top ten list retrieved by Pearson's correlation coefficient, Mutual information, Euclidean distance and the proposed hybrid technique. This reveals the high importance of these genes as candidate biomarker for HCC.
Examination of signal profiles
The signal profiles charted in Figures3,4 and5 of genes selected using Pearson's correlation coefficient, Cosine coefficient; Euclidean distance and Mutual information show a high similarity with the signal profile of the ideal biomarker. In these figures, all signals have a step up shape. This derives us to consider these genes as up regulated biomarkers for HCC. The significance level of these signals according to their p-values in Table6 shows the significance of the selected genes.
The signal profiles of genes selected using Entropy using Empirical estimator shown in Figure6a have a random shape. Also as seen in Figure6b,6c and6d, the other estimators of Entropy: Miller-Madow, Shrink, Schurmann-Grassberger gave a random shapes too for their selected genes. These signals have comparable p-values as in Table6. These results reveal a low performance of Entropy. Without generalization, we conclude that the Entropy is an inadequate gene selection method in our application.
The investigated methods of gene selection when used individually gave a comparable performance while Entropy method provided fairly acceptable result with respect to validating the results using the biological databases. Even more, by examining the signal profiles of genes retrieved using Entropy with different estimators, the signals are found to be visually non discriminating normal and tumour samples and this inspection was emphasised using t-test statistics. Nevertheless, the proposed hybrid approach surpassed all of the proposed methods when used solely. We conclude that the proposed technique is feasible when mining in a huge number of genes in high throughput microarrays. The proposed framework has detected a list of only 172 informative genes out of 22777 genes being studied. This list contains novel informative genes that are suggested as biomarkers for HCC and thus deserve further lab investigation as a future work.
Li L, Ying L, Naesens M, Xiao W, Sigdel T, Hsieh S, Martin J, Chen R, Liu K, Mindrinos M: Interference of globin genes with biomarker discovery for allograft rejection in peripheral blood samples. Physiol Genom. 2008, 32 (2): 190-197.
Abeel T, Helleputte T, Van de Peer Y, Dupont P, Saeys Y: Robust biomarker identification for cancer diagnosis with ensemble feature selection methods. Bioinformatics. 2010, 26 (3): 392-398. 10.1093/bioinformatics/btp630.
Lee IN, Chen CH, Sheu JC, Lee HS, Huang GT, Chen DS, Yu CY, Wen CL, Lu FJ, Chow LP: Identification of complement C3a as a candidate biomarker in human chronic hepatitis C and HCV-related hepatocellular carcinoma using a proteomics approach. Proteomics. 2006, 6 (9): 2865-2873. 10.1002/pmic.200500488.
Mahmoodian H, HamiruceMarhaban M, Rahim RA, Rosli R, Iqbal Saripan M: A combinatory algorithm of univariate and multivariate gene selection. J Theor Appl Inform Technol. 2009, 5 (2): 113-118.
Cho SB, Won HH: Machine learning in DNA microarray analysis for cancer classification. Proc First Asia-Pacific Bioinform Conf. 2003, 19: 189-198.
Lai C, Reinders M, Van't Veer L, Wessels L: A comparison of univariate and multivariate gene selection techniques for classification of cancer datasets. BMC Bioinformatics. 2006, 7 (1): 235-10.1186/1471-2105-7-235.
Glazko GV, Emmert-Streib F: Unite and conquer: univariate and multivariate approaches for finding differentially expressed gene sets. Bioinformatics. 2009, 25 (18): 2348-2354. 10.1093/bioinformatics/btp406.
Edgar R, Domrachev M, Lash AE: Gene Expression Omnibus: NCBI gene expression and hybridization array data repository. Nucleic Acids Res. 2002, 30: 207-210. 10.1093/nar/30.1.207.
Gentleman RCCVBD, Bolstad BM, Dettling M, Dudoit S, Ellis BGL, Ge Y, Gentry J, Hornik K, Hothorn T, Huber W, Iacus SIR, Leisch F, Li C, Maechler M, Rossini AJ, Sawitzki G, Smith CSG, Tierney L, Yang YH, Zhang J: Bioconductor:open software development for computational biology and bioinformatics. Genome Biol. 2004, 5 (10): R80-10.1186/gb-2004-5-10-r80.
You Z, Wang S, Gui J, Zhang S: A Novel Hybrid Method of Gene Selection and Its Application on Tumor Classification. ICIC '08 Proceedings of the 4th international conference on Intelligent Computing: Advanced Intelligent Computing Theories and Applications - with Aspects of Artificial Intelligence. 2008, 1055-1068.
Daub CO SR, Selbig J, Kloska S: Estimating mutual information using B-spline functions – an improved similarity measure for analysing gene expression data. BMC Bioinformatics. 2004, 5: 118-10.1186/1471-2105-5-118.
Paninski L: Estimation of entropy and mutual information. Neural Comput. 2003, 15 (6): 1191-1253. 10.1162/089976603321780272.
Meyer PE, Lafitte F, Bontempi G: minet: A R/Bioconductor Package for Inferring Large Transcriptional Networks Using Mutual Information. BMC Bioinformatics. 2008, 9: 461-470. 10.1186/1471-2105-9-461.
Schafer J, Strimmer K: A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics. Stat Appl Genet Mol Biol. 2005, 4 (1): -10.2202/1544-6115.1175.
Schäfer J, Strimmer K: An empirical Bayes approach to inferring large-scale gene association networks. Bioinformatics. 2005, 21: 6-
Nemenman I, Bialek W, Steveninck RR: Entropy and information in neural spike trains: progress on the sampling problem. Phys Rev E. 2004, 69: 5-
Dennis G, Sherman BT, Hosack DA, Yang J, Gao W, Lane HC, Lempicki RA: DAVID: Database for Annotation, Visualization, and Integrated Discovery. Genome Biol. 2003, 4: P3-10.1186/gb-2003-4-5-p3.
Maglott D, Ostell J, Pruitt KD, Tatusova T: Entrez Gene: gene-centered information at NCBI. Nucleic Acids Res. 2007, 35: D26-D31. 10.1093/nar/gkl993.
Kanehisa M, Goto S: KEGG: Kyoto Encyclopedia of Genes and Genomes. Nucleic Acids Res. 2000, 28 (1): 27-30. 10.1093/nar/28.1.27.
The authors declare that they have no competing interest.
NA collected the biological data, participated in data implementation and drafted the manuscript. NS and YK supervised the study, and participated in its design and coordination. All authors read and approved the final manuscript.
Nagwan M Abdel Samee, Nahed H Solouma and Yasser M Kadah contributed equally to this work.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Abdel Samee, N.M., Solouma, N.H. & Kadah, Y.M. Detection of biomarkers for Hepatocellular Carcinoma using a hybrid univariate gene selection methods. Theor Biol Med Model 9, 34 (2012). https://doi.org/10.1186/1742-4682-9-34
- Mutual Information
- Singular Value Decomposition
- Signal Profile
- Informative Gene
- Entropy Estimator