Skip to main content

A simple powerful bivariate test for two sample location problems in experimental and observational studies

Abstract

Background

In many areas of medical research, a bivariate analysis is desirable because it simultaneously tests two response variables that are of equal interest and importance in two populations. Several parametric and nonparametric bivariate procedures are available for the location problem but each of them requires a series of stringent assumptions such as specific distribution, affine-invariance or elliptical symmetry.

The aim of this study is to propose a powerful test statistic that requires none of the aforementioned assumptions. We have reduced the bivariate problem to the univariate problem of sum or subtraction of measurements. A simple bivariate test for the difference in location between two populations is proposed.

Method

In this study the proposed test is compared with Hotelling's T2 test, two sample Rank test, Cramer test for multivariate two sample problem and Mathur's test using Monte Carlo simulation techniques. The power study shows that the proposed test performs better than any of its competitors for most of the populations considered and is equivalent to the Rank test in specific distributions.

Conclusions

Using simulation studies, we show that the proposed test will perform much better under different conditions of underlying population distribution such as normality or non-normality, skewed or symmetric, medium tailed or heavy tailed. The test is therefore recommended for practical applications because it is more powerful than any of the alternatives compared in this paper for almost all the shifts in location and in any direction.

Background

Few medical research studies involve comparing two groups on only a single response variable; comparisons on two or more response variables are usually desired. If a single variable is identified as of major research interest, it will be appropriate to apply a two independent samples t-test or Mann-Whitney test. In some studies, however, two response variables are of equal interest and importance. For example, in studies comparing two different treatments for hypertension, it is equally important to compare their effects on both systolic and diastolic blood pressure. For such studies, a bivariate analysis that compares the treatments on two response variables simultaneously may have advantages over two separate univariate tests, one for each variable. The great advantage of bivariate analysis is the possibility of increased power. If the response variables are not too highly correlated, the bivariate test has a chance of finding significant differences among the treatments even if none of the univariate tests is significant [1].

In most medical research, location analysis may be sufficient and testing the distributions is not necessary. For example, when it is decided to compare two characteristics of a population, such as the weight and height of infants, with those of another population, the researcher tries to compare the bivariate location in two populations. In terms of statistical theory, this problem may be restated as follows.

We consider two independent random bivariate samples

(x1i, y1i), i = 1, ..., m and (x2j, y2j), j = 1, ..., n from continuous bivariate populations e.g., weight and height of infants in control and treatment populations. [X1, Y1]' and [X2, Y2]' denote the joint distributions of (X1, Y1) and (X2, Y2) respectively. We intend to test

(1)

against

(2)

where δ= 1, δ2) ≠ (0, 0) and H0 means that the joint distribution of (X1, Y1) and (X2, Y2) are the same.

For the above-mentioned problem, we know that for a bivariate normal population, Hotelling's T2 is the best. In addition, under nonsingular linear transformations, T2 is invariant.

When the underlying population is unknown, many nonparametric tests have been proposed. In 1958, Blumen [2] described a sign test for the hypothesis that the medians of two or more variables had a particular value for the bivariate case. The slopes of the vector from the bivariate median to the n sample points were arranged in ascending order according to the respective angles made with the positive horizontal axis. Blumen's proposed statistic is proportional to the squared distance from the centre of gravity of the hypothesized centre. In 1962, Bennett [3] used certain properties of the multivariate normal integral to develop sign tests for the equality of means in two correlated multivariate populations. Chatterjee and Sen [4] extended the Wilcoxon-Mann-Whitney rank sum test to the case of two variables following a conditional approach. Mardia [5] proposed an unconditional non-parametric statistic using the median vector of the combined sample. Peters and Randles [6] introduced a sign rank affine invariant test for the difference in location between two elliptically symmetric populations. Hettmansperger and Oja [7] developed a multivariate invariant sign-test for the multi-sample location problem. Sen and Mathur [8] used the angles made by centerized data for two samples with the positive direction of the x-axis to construct a test statistic suggested as an affine-invariant test statistic for the bivariate two sample location problem. Sen and Mathur [9] proposed a consistent test similar to the Mann-Whitney test for difference in locations between two bivariate populations. LaRocque et al. [10] extended the univariate Wilcoxon sign rank test to the bivariate location problem. Baringhaus and Franz [11] proposed a test statistic using the difference between the sums of all the Euclidean interpoint distances. Mathur [12] suggested a nonparametric bivariate test for two sample location problem that did not require affine-invariance or elliptic-symmetry to be assumed.

The findings of most of these tests are not easy to apply and their powers depend on the direction of shifts and the covariance matrix of the alternative distribution. Some of the proposed tests are powerful only for particular forms of distributions and some of them require specific assumptions to verify the test statistics. Thus, it seems that the tests available in the literature are not wholly adequate and hence it is necessary to introduce a test statistic more powerful than the existing ones, which does not depend on the covariance structure of the underlying population and is also easy to apply with readily available software for those who are not experts in statistics.

In the following section, we present a simple bivariate test statistic for the two sample location problem. To investigate the power of the proposed test and to compare it with the alternatives in the literature, a simulation study was carried out. A summary of the power study is displayed in the results and discussion sections. In the conclusion section, an application of the proposed test statistic to a real set of data is given.

Methods

Test Statistic

Let (X1i, Y1i) i = 1, ..., m and (X2j, Y2j) j = 1, ..., n be two independent random samples from bivariate populations. [X1Y1]' and [X2Y2]' denote the joint distributions of X1, Y1 and X2, Y2 respectively. We intend to test the null hypothesis given in (1) against the alternative (2). According to the structure of this testing problem, it is presumed that the two distributions [X1Y1]' and [X2Y2]' have the same structural form, but there may be a location shift in [X2Y2]' with respect to [X1Y1]'. We therefore aim to test the existence of a location shift.

It is obvious that many tests are available to test the difference in locations between two univaraite populations. It is therefore desirable to find a convenient transformation for changing the bivariate data to the univariate case. We implement our test for three possible combinations of shift direction as follows:

(i) When the shift directions for two variables are the same i.e. δ1 δ2 > 0, random variables are defined as S 1i= X 1i+ Y 1ifor i = 1, ..., m and S 2j= X 2j+ Y 2jfor j = 1, ..., n. Now to test the null hypothesis H 0 in (1) against H A in (2), it is sufficient to test

against

where δ = δ1 + δ2 is a location difference parameter. In fact, this is a location problem in the univariate case and an available test such as the Mann-Whitney test can be used to solve it.

(ii) When the shift directions for two variables are not the same i.e., δ1 δ2 < 0, the random variables are defined as for i = 1, ..., m and for j = 1, ..., n. Therefore, it is sufficient to test

against

Where δ = δ1 - δ2 is a location parameter. For this location problem in the univariate case, the Mann-Whitney test is again used.

(ii) When (δ1 = 0, δ2 ≠ 0) or (δ1 ≠ 0, δ2 = 0), it is enough to apply a rank test to the second variable or the first variable, respectively.

Remark 1: To decide which of the above three methods must be used in practice, first the values and are computed, where , and , . Then if > 0, method (i) is used and if < 0, it is appropriate to use method (ii); and method (iii) is used for the testing problem when () or ().

Remark 2: (a) Note that, when the two variables are on significantly different scales, the data have to be transferred by the following relations before solving the testing problem:

and

where , and and are the standard deviations of the random variables X1 (or X2) and Y1 (or Y2), respectively.

(b) In application, when the two variables are on significantly different scales, the data are transformed by the following relations before using a test statistic and testing hypotheses:

and

where , and , are the samples pooled variances of the first variables and the second variables in (X1, Y1) and (X2, Y2), respectively.

Power

This section indicates the results of a Monte Carlo study to assess the power of the new test. For comparison purposes, the performances of the following tests were simulated:

  1. (1)

    Hotelling's T 2 test with test statistic:

    where S-1 is the inverse of the sample variance-covariance matrix S [13].

  2. (2)

    The Rank test, which is based on marginal ranks, is given by

    where N = m + n, i = 1, ..., N, j = 1,2, are the set of scores for each j = 1,2 and X ij are independent identically-distributed random variables with a continuous bivariate distribution [14].

  3. (3)

    The Cramer test with test statistic:

    where the function ϕ is the kernel function. is recommended for location alternatives [11].

  4. (4)

    The Mathur's test based on the test statistic:

where , and for i = 1, ..., m j = 1, ..., n[12].

The new proposed test (P) was compared with the above four tests using samples from bivariate normal and non-normal distributions. Simulations were run for bivariate normal with ρ = -0.5,0,0.5. Also, simulations were run for some non-normal distributions generated using the g-and-h distribution [15], i.e. generating Z ij from a bivariate normal distribution and setting .

For g = 0 this expression is taken to be .

As the g-and-h distribution provides a convenient method for considering a very wide range of situations corresponding to both symmetric and highly asymmetric distributions, its use is highly recommended. The case g = h = 0 corresponds to a normal distribution, the case g = 0 corresponds to a symmetric distribution, and, as g increases, the skewness increases as well. For example, with g = 0.5 and h = 0, the skewness is 1.75, which is great [16].

In this study, simulations were run with g = 0.25 and g = 0.5 to span the range of skewness values that seems to occur in practice.

The parameter h determines the heaviness of the tail. As h increase, the heaviness increases as well. With h = 0.2 and g = 0, the kurtosis equals 36. This might seem extreme, but even higher values were found by Wilcox, so our simulations were run for h = 0.2 [16].

Results and discussion

The results in Table 1, Table 2, Table 3, Table 4, Table 5 and Table 6 were based on 10,000 samples of sizes 15, 18 from a bivariate population with location parameters (δ1, δ2). A nominal significance level of 0.05 was used. STAT, MASS, CRAMER and ICSNP libraries in R program version 2.10.0 were used.

Table 1 Monte Carlo rejection proportion for the bivariate normal population (ρ = 0), m = 15, n = 18
Table 2 Monte Carlo rejection proportion for the bivariate normal population (ρ = 0.5), m = 15, n = 18
Table 3 Monte Carlo rejection proportion for the bivariate normal population (ρ = -0.5), m = 15, n = 18
Table 4 Monte Carlo rejection proportion for the bivariate skewed population, m = 15, n = 18
Table 5 Monte Carlo rejection proportion for the bivariate highly skewed population, m = 15, n = 18
Table 6 Monte Carlo rejection proportion for the bivariate heavy tailed population, m = 15, n = 18

Under the bivariate normal distribution with different correlations, the simulation results showed that the proposed test statistic performed better than any of the test statistics compared here for almost all shifts in location.

The findings of this study show that the proposed test had greater power than Hotelling's T2 and Mathur's test for skewed populations. Also, had greater power than Cramer's test for a small shift in location but reached a power level equivalent to that of the Rank test for a skewed population.

When the population was highly skewed, the proposed test statistic dominated Hotelling's T2 and Mathur's test for almost all shifts in location. It also dominated Cramer's test for small and moderate shifts in location.

The power of the proposed test was greater than any of its competitors for almost all shifts in location except the Rank test for a large shift in location under a heavy tailed bivariate distribution.

The simulation results revealed that the proposed test statistics would perform much better when the underlying population was bivariate normal, skewed, highly skewed or heavy tailed.

The simulations were done for sample sizes m = 10 and n = 10, and the results were closely similar. In general, simulations performed for different sample sizes showed similar power trends.

Conclusions

In the medical field, where two measurements such as changes in closing volume and white blood cell count [18], cholesterol level and blood pressure, potassium and sodium [19] are considered for important diagnoses, the bivariate values may be related in an unknown way, so bivariate analysis is considered an important problem. The population bivariate distributions may be unknown in many cases so parametric tests cannot be applied. Some nonparametric tests require assumptions that are hard to validate. The proposed test does not require the stringent assumption of affine-invariance or elliptic-symmetry, and it is very easy to understand and apply using only regular statistical programs. In fact, we have solved the bivariate problem by reducing it to the univariate problem of sum or difference of measurements.

The results of the simulation studies showed that the proposed test performed better than most of it competitors for almost all the shifts in location. This very important property of the proposed test statistic established that it would perform much better whether the underlying population was normal or non-normal, skewed or symmetric, medium tailed or heavy tailed. Therefore, its application is recommended, since it is more powerful than any of the alternatives compared here for almost all shifts in location and in any direction.

Most of the test statistics available in the literature were difficult to compute even with the help of the computer. The proposed test statistic could easily be calculated manually for small and moderate sized data sets, which is another important property.

Here for illustration, the application of the proposed test statistic to a real data set is given. Ayatollahi [17] studied growth velocity standards from longitudinally measured infants aged 0-2 years born in Shiraz. A cohort of 317 healthy neonates were selected and followed for two years. They were visited at home at different target ages and several variables were measured. Here the researchers focused on 12 months old children, and we interested in two dependent variables, height and weight, and a grouping variable, mother's education level. Ages were recorded exactly on the basis of the difference between the date of visit and date of birth in days, and then converted to months. The weight velocity over the first year of life was defined as the difference between weight at 12 months old and weight at birth divided by the difference between date of visit at 12 months old and date of birth [17].

Simultaneously, comparison of weight and height velocities between two groups of infants, with primary and secondary educated mothers, was the main interest. The bivariate observations were the 87 measurements on weight velocity (X1) and height velocity (Y1) over the first year of life for infants with primary educated mothers and 54 measurements on weight velocity (X2) and height velocity (Y2) over the first year of life for infants with secondary educated mothers.

Table 7 shows kg/mo, kg/mo, cm/mo and cm/mo. Computing and , we found that and , hence > 0. According to the sign of , method (i) should be used. So S i = X i + Y i were computed for infants with primary and secondary educated mothers (i = 1,2). The Mann-Whitney test was used to test H0: [X1 + Y1] ~ [X2 + Y2] against H A : [X1 + Y1] ~ [X2 + Y2 + δ]; the p-value = 0.006 led to rejection of the null hypothesis at the 5% level of significance. This was consistent with the conclusion reached using Hotelling's T2 test for the same data set with p-value = 0.027.

Table 7 Mean and standard deviation of weight and height velocity of infants over the first year of life with primary and secondary educated mothers (m = 87, n = 54)

In order to illustrate the performance of the proposed test versus Hotelling's T2 test especially for small size samples, a random sample of 22 infants was selected. Weight and height velocities for this random sample, a part of data from Ayatollahi (2005) [17], are presented in Table 8. The bivariate observations were the 13 measurements on weight velocity (X1) and height velocity (Y1) over the first year of life for infants with primary educated mothers and 9 measurements on X2, Y2 for infants with secondary educated mothers. In Table 9, mean and standard deviation of weight and height velocity over the first year of life for infants with primary and secondary educated mothers are presented. Using the proposed test, the p-value was 0.030, which led to rejection of the null hypothesis at the 5% level of significance. However, this was not consistent with the conclusion reached using Hotelling's T2 test (p-value = 0.072). In this small data set, Hotelling's T2 could not detect the difference, but the proposed test could detect it as well as in the large data set.

Table 8 Data from the weight and height velocity of infants over first year of life with primary and secondary educated mothers
Table 9 Mean and standard deviation of weight and height velocity of infants over first year of life with primary and secondary educated mothers (m = 13, n = 9)

Authors' information

Corresponding author: SMT Ayatollahi, Ph.D., FSS, C.Stat. Professor of Biostatistics, The Medical School, Shiraz University of Medical Sciences, Shiraz, Islamic Republic of Iran. P.O.Box 71345-1874

References

  1. Fleiss JL: The Design and Analysis of Clinical Experiments. 1986, New york: John Wiley & sons

    Google Scholar 

  2. Blumen I: A new bivariate sign test. Journal of American statistical Association. 1958, 53: 448-456. 10.2307/2281867.

    Article  Google Scholar 

  3. Bennett B: On multivariate sign tests. Journal of the. 1962, 24: 159-161.

    Google Scholar 

  4. Chatterjee SK, Sen K: Nonparametric tests for the bivariate two sample location problem. Bull Calcutta Statist Ass. 1964, 18-58. 13

  5. Mardia K: A nonparametric test for the bivariate location problem. Journal of the Royal statistical Society, series B. 1967, 29: 320-342.

    Google Scholar 

  6. Peters D, Randles R: A bivariate signed rank test for two sample location problem. Journal of American statistical Association. 1991, 85: 552-557. 10.2307/2289797.

    Article  Google Scholar 

  7. Hettmansperger T, Oja H: Affine invariant multivariate multisample sign tests. Journal of Royal Statistical Society. 1994, Series B (56): 235-249.

    Google Scholar 

  8. Sen K, Mathur S: A bivariate signed rank test for two sample location problem. Commun Statist - Theory Meth. 1997, 26 (12): 3031-3050. 10.1080/03610929708832092.

    Article  Google Scholar 

  9. Sen K, Mathur S: A test for bivariate two sample location problem. Commun Statist - theory Meth. 2000, 29 (2): 417-436. 10.1080/03610920008832492.

    Article  Google Scholar 

  10. Larocque D, Tardif S, Eeden Cv: An affine-invariant generalization of the wilcoxon signed-rank test for the bivariate location problem. Aust N Z J Stat. 2003, 45 (2): 153-165. 10.1111/1467-842X.00271.

    Article  Google Scholar 

  11. Baringhaus L, Franz C: On a new multivariate two-sample test. Journal of Multivariate Analysis. 2004, 88: 190-206. 10.1016/S0047-259X(03)00079-4.

    Article  Google Scholar 

  12. Mathur SK: A new nonparametric bivariate test for two sample location problem. Stat Meth & Appl. 2008, 18 (3): 375-388.

    Article  Google Scholar 

  13. Rencher A: Methods of Multivariate Analysis. 2002, New York: John Wiley & sons

    Chapter  Google Scholar 

  14. Hajek J, Sidak Z, Sen KP: Theory of Rank Tests. 1999, ACADEMIC PRESS, second

    Google Scholar 

  15. Hoaglin DC: Summarizing shape numerically: the g-and-h distributions. Exploring Data Tables, Trends and Shapes. Edited by: Hoaglin D, Mosteller F, Tukey J. 1985, New York: Wiley

    Google Scholar 

  16. Wilcox RR: Simlation results on solutions to the multivariate Behrens-Fisher problem via trimmed means. The Statistician. 1995, 44 (2): 213-225. 10.2307/2348445.

    Article  Google Scholar 

  17. Ayatollahi SMT: Growth velocity standards from longitudinally measured infants of age 0-2 years born in Shiraz, Southern Iran. American Journal of Human Biology. 2005, 17 (3): 302-309. 10.1002/ajhb.20126.

    Article  CAS  PubMed  Google Scholar 

  18. Merchant JA, Halprin GM, Hudson AR, Kilburn KH, McKenzie WN, Hurst DJ, Bermazohn P: Responses to Cotton Dust. Archives of Environmental Health. 1975, 30: 222-229.

    Article  CAS  PubMed  Google Scholar 

  19. Rawlings JO: Applied Regression Analysis:A Research Tool. 1988, Wadsworth, Inc.

    Google Scholar 

Download references

Acknowledgements

This work was supported by grant number 88-4820 from Shiraz University of Medical Sciences.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to S MT Ayatollahi.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

HT proposed the test, most of the redaction, simulation study, application to weight and height velocity. SMTA conceptualized and supervised the study. MT proposed the test and redaction. All authors read and approved the final manuscript.

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Tabesh, H., Ayatollahi, S.M. & Towhidi, M. A simple powerful bivariate test for two sample location problems in experimental and observational studies. Theor Biol Med Model 7, 13 (2010). https://doi.org/10.1186/1742-4682-7-13

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1742-4682-7-13

Keywords