Skip to main content

A parametric method for cumulative incidence modeling with a new four-parameter log-logistic distribution

Abstract

Background

Competing risks, which are particularly encountered in medical studies, are an important topic of concern, and appropriate analyses must be used for these data. One feature of competing risks is the cumulative incidence function, which is modeled in most studies using non- or semi-parametric methods. However, parametric models are required in some cases to ensure maximum efficiency, and to fit various shapes of hazard function.

Methods

We have used the stable distributions family of Hougaard to propose a new four-parameter distribution by extending a two-parameter log-logistic distribution, and carried out a simulation study to compare the cumulative incidence estimated with this distribution with the estimates obtained using a non-parametric method. To test our approach in a practical application, the model was applied to a set of real data on fertility history.

Conclusions

The results of simulation studies showed that the estimated cumulative incidence function was more accurate than non-parametric estimates in some settings. Analyses of real data indicated that the proposed distribution showed a much better fit to the data than the other distributions tested. Therefore, the new distribution is recommended for practical applications to parameterize the cumulative incidence function in competing risk settings.

Background

In medical research with time-to-event data, there may be more than one final outcome of interest, and this circumstance can complicate the statistical analysis. In such cases, events other than the desired one(s) are considered as competing risks when their occurrence prevents the event of interest [1, 2]. An important quantity in competing risk settings is the cumulative incidence function (CIF), which makes it possible to calculate the probability of a particular event. In contrast, the cause-specific hazard function (CSHF) calculates the instantaneous rate of the event. For example, in fertility studies in women, researchers are interested in calculating the cumulative live birth rate in the presence of competing risks over time. Competing events, such as the probability of stillborn fetuses or abortions, can be calculated.

Most competing risk analyses of CIF are estimated non- or semi-parametrically [3, 4]. However, the parametric model is another available approach for modeling CIF. The advantage of parametric methods compared to non- and semi-parametric ones is that if a parametric model is selected correctly, it can predict the probability of the occurrence of events in the long term and provide additional insights about the time to failure and hazard functions [5]. Also, when the survival pattern follows a particular parametric model, the estimates from true model fit are usually more accurate than the non-parametric estimates.

The best known distributions for modeling CIF are the Weibull and Gompertz distributions. However, these are suitable only for hazard functions that increase or decrease monotonically; they are inadequate when the hazard function shape is unimodal. In such cases, simple distributions such as the two-parameter log-logistic or log-normal distributions are likely to be better choices. One approach to the construction of flexible parametric models is to add a shape parameter to provide a wide range of hazard shapes and improve the models in survival data. In 1996, Mudholkar et al. proposed a generalized Weibull family with a range of hazard shapes [6] and Foucher et al. in 2005 applied this distribution in semi-Markov models [7]. In 2006, Sparling et al. presented a three-parameter family of survival distributions that included the Weibull, negative binomial, and log-logistic distributions as special cases [8]. These distributions can fit U-shapes or unimodal shapes for the hazard function, and therefore can be appropriate for survival data.

In light of the issues summarized above, a more efficient parametric distribution with various shapes of hazard patterns would appear to be useful for estimating CIF in competing risk situations. In recent years, various parametric distributions have been developed specifically for analyzing competing risk data that offer more flexibility. For example, in 2006 Jeong introduced a new parametric distribution for modeling CIF [5]. In 2009, Wahed et al. developed Weibull's distribution, resulting in a beta-Weibull four-parameter distribution for use in competing risks [9]. Here, we propose a new four-parameter log-logistic distribution by extension of a two-parameter log-logistic distribution that contains different kinds of hazard shapes in survival data and increases the efficiency of the CIF over the non-parametric approaches. Also, this is an improper distribution which enjoys more flexibility for modeling of CIF. Therefore, it would be suitable for competing risk models. We have performed a simulation study to compare CIF estimates obtained with the four-parameter distribution and a non-parametric method. After using simulated data to assess the method, we analyzed a real data set to examine the efficiency of our proposed distribution.

Methods

Introduction of the new distribution

The survival function according to a two-parameter log-logistic distribution is as follows:

(1)

where λ > 0 and τ > 0 are the scale and shape parameters, respectively. If τ ≤ 1, the hazard function decreases monotonically, whereas if τ > 1, the hazard function is unimodal [10].

Survival function of the four-parameter log-logistic distribution

The two-parameter log-logistic distribution is expanded on the basis of the family of Hougaard stable distributions, whose survival function is as follows:

(2)

where H is the cumulative hazard function [11]. If a two-parameter log-logistic cumulative hazard function is used instead of H, we obtain a new distribution that is improper. In addition, to reduce the number of parameters, the substitution υ = θ2-α is used [12]. The survival function of the new distribution is constructed as:

(3)

where the parameter space is θ > 0, λ > 0, τ > 0, -∞ < α < ∞. The survival function must be between zero and one, as shown in the Appendix. If α < 0, the survival function is improper. This is an important characteristic of CIF modeling that differs from the two-parameter log-logistic distribution and other distributions.

Hazard function

The hazard function can be directly obtained from equation (3), as:

(4)

Because of the complexity of this hazard function formula, there is no simple mathematical expression for different types of hazard function. The flexibility of the hazard function is shown in Figure 1. Compared to the two-parameter model, the four-parameter log-logistic distribution has a flexible hazard function that can be monotonically decreasing or increasing, unimodal, or U-shaped.

Figure 1
figure 1

Hazard function of the four-parameter log-logistic distribution.

Cumulative incidence function

Competing risks data are represented as a pair (T, δ) where δ is the indicator variable, defined as δ = 0 if the observation is censored, and as δ = 1,2,...,K where K is the number of competing events. T is the time to first event or censoring. The two major quantities in the analysis of competing risks data are CSHF and CIF. The CSHF rate for event k is the instantaneous event rate for an individual who experiences event k at time t given that the subject experiences no other type of event up to t. The CIF for event k, F k (t) = P(T ≤ t, δ = k), is the cumulative probability of observing event k by time t. The CIF for event k is defined as follows:

(5)

where S(u) = P(T > u) and h k (u) is the hazard function for the k th cause-specific event. In the literature, parametric methods are proposed to estimate CIF with the CSHF method [5, 9, 13]. Here we have also used the CSHF method to model CIF.

To estimate the CIF non-parametrically, the overall survival function should be replaced with the Kaplan-Meier estimate and the cause-specific cumulative hazard function with the Nelson-Aalen estimate [3].

Estimation method

For convenience, we have assumed throughout this paper that there were two events: the desired event k = 1 and a competing event k = 2; and that n is the sample size. Because the two event are mutually exclusive, the overall survival function factored into a product of two cause-specific survival functions, i.e. S(t, ψ) = S 1 (t,ψ 1 ) S 2 (t, ψ 2 ). Therefore, the likelihood function of the parametric inference is constructed as:

(6)

where ψ k = (λ k , τ k , θ k , α k ) is the parameter vector for event k, S k (t, ψ k ) is the survival function for event k, and f k (t, ψ k ) is the density function of event k based on a four-parameter log-logistic distribution.

If event k occurs, δ ki = 1; otherwise δ ki = 0 (k = 1,2, i = 1,2,...,n). The covariance matrix, I - 1 ( ψ ^ 1 , ψ ^ 2 ) , is estimated by the inverse of the Fisher information matrix [14]. According to the invariant property of the maximum likelihood estimate (MLE), the CIF is estimated by substituting ψ ^ in expression (5), which yields F ^ k ( t ) = ∫ 0 t Ŝ ( u ) ĥ k ( u ) d u .

Simulation study

A simulation study was used to compare the cumulative incidence estimate of the proposed distribution with a three-parameter distribution proposed by Sparling [8] and the non-parametric method at different times. As described by Beyersmann in 2009, we first simulated survival times T with all-cause hazards h 1 (t) + h 2 (t) on the basis of a two-parameter log-logistic distribution, with λ 1 = 0.3, τ 1 = 2.97 for the event of interest and λ 2 = 0.03, τ 2 = 1.1 for the competing event (based on fertility data). The event type was then determined by a binomial experiment with probability h 1 (t)/(h 1 (t) + h 2 (t)) on event type 1 [15, 16]. Additionally, we generated censoring times with a binomial experiment. The data sets were simulated with sizes n = 1000, and a 7% censoring level. Using the data thus produced, we applied the four-parameter log-logistic, Sparling distributions, and non-parametric method to these data. Accordingly, 1000 samples were generated and the bias and empirical mean square error (MSE) of the CIF at time t were calculated as follows:

where F 1 (t) is the true value of CIF at time t[17].

To test the efficiency of the parametric distribution proposed here, we used another simulation study. Failure times were generated on the basis of a two-parameter Weibull distribution with k 1 = 1.4, p 1 = 0.45 for the event of interest and k 2 = 1.04, p 2 = 0.03 for the competing event. We used the same method to fit the new distribution to these data.

The maximum likelihood estimates of the parameter vectors were calculated by PROC NLMIXED in SAS v. 9.1, and the non-parametric estimate of CIF was obtained with the "cuminc" R function from the "cmprsk" library. Because the determination of a suitable initial value to fit the models is an important problem in numerical studies, many initial values were examined to find a suitable convergence.

Results

Table 1 summarizes the results of the first simulation in which the four-parameter log-logistic, Sparling distribution and non-parametric methods were fit for different times with n = 1000. The results showed that the bias and MSE of the CIF estimates obtained with the four-parameter method for the event of interest at t = 1.25 to t = 2 were smaller than with the Sparling distribution and the non-parametric method. For the competing event, the bias and MSE of the CIF estimates were lower than with the non-parametric method.

Table 1 The results of parametric and non-parametric estimates of CIF based on a four-parameter log-logistic and Sparling simulation for different times.

The results of the second simulation are summarized in Table 2. Up to t = 1.5, the bias and the MSE of the CIF estimates obtained with the non-parametric method for the event of interest were lower than with the four-parameter method, but after t = 2, the bias and MSE of the CIF estimates for the competing event with the new distribution were equivalent or slightly lower than with the non-parametric method. For the competing event, the bias and MSE of the CIF estimates were lower than with the non-parametric method at all times.

Table 2 The results of parametric and non-parametric estimates of CIF based on a four-parameter log-logistic simulation for different times.

In summary, these two simulations indicate that the four-parameter modeling of CIF was as efficient as the non-parametric method and the Sparling distribution and sometimes led to better estimates of CIF. Moreover, the four-parameter log-logistic model performed well under a Weibull distribution.

Example: women's fertility history

We tested the proposed distribution on a set of real data. In a cross-sectional study, the fertility history of 858 women aged 15-49 years in rural areas of the Shiraz district (southwestern Iran) was reviewed (unpublished data). The women were selected by multistage random sampling from a list of villages in 2008. Only the first pregnancy of each woman was included in this study. A self-administered questionnaire regarding fertility history was used. After women with an undesired first pregnancy were excluded, the final sample consisted of 652 women. Live birth as a result of the first delivery was our desired event, and a stillborn fetus or abortion was the competing event. The event time was defined as the interval between marriage and a live birth, a competing event or censoring. Also, women who had not given birth on the date of interview (7% in this data set) were censored.

The estimated cumulative incidence of live births and abortions or stillborn fetuses based on the two- and four-parameter log-logistic, Weibull, Gompertz and Sparling distributions and the non-parametric estimates are shown in Figure 2. Up to time t = 3, the cumulative incidence of live births increased rapidly; thereafter, cumulative incidence tended to plateau. This means that the probability of live births during the first four years after marriage increased rapidly, and remained approximately constant thereafter. The curves also show that the four-parameter log-logistic distribution was closer to the non-parametric estimate than the other distributions at all times. For shorter intervals since marriage, the two-parameter log-logistic and Sparling distributions were closer to the non-parametric estimates than to the Weibull and Gompertz distributions. After t = 5, all distributions were close to the observed data.

Figure 2
figure 2

Cumulative incidence function estimates of live births (a) and abortions (b) with the non-parametric and two- and four-parameter log-logistic, Weibull, Gompertz and Sparling distributions in a fertility history study.

Table 3 shows the Akaike information criterion (AIC), Bayesian information criterion (BIC) and estimated cumulative incidence for two events in different times. Based on AIC and BIC criteria, the four-parameter log-logistic model with the lowest AIC and BIC showed a better fit to the data than the two-parameter log-logistic, Sparling, Weibull or Gompertz distributions. Because the two-parameter log-logistic distribution is nested within the Sparling and the four-parameter log-logistic distributions, we can compute likelihood-ratio chi-square statistics to test the fit of the nested models. The likelihood-ratio chi-square statistics and their corresponding p-values are:

Table 3 The Akaike information criterion (AIC), Bayesian information criterion (BIC) and the estimates of the cumulative incidence function under competing risks based on different distributions with the non-parametric method.

χ2 = 69.2, df = 1, p < 0.001 for two-parameter log-logistic versus Sparling and χ2 = 217.1, df = 2, p < 0.001 for two-parameter log-logistic versus four-parameter log-logistic. Likelihood-ratio test, AIC and BIC show the four-parameter log-logistic distribution fits the data better than two-parameter log-logistic and Sparling distributions. These results confirm the findings in Figure 2, and again indicate that the proposed distribution shows a closer fit to the observed data than the other distributions to which it is compared.

Discussion

Although non-parametric methods such as the Kaplan-Meier approach are widely used in survival analysis and may show a very close fit to the data, they do not provide additional information about the nature of the data. Therefore, in this study our ultimate aim was to develop a new parametric distribution by extension of the two-parameter log-logistic distribution. The addition of third and fourth parameters allows the model to capture U-shaped hazards.

Our simulation study showed that the parametric estimate of CIF with the new distribution was slightly less biased and had a smaller MSE than the estimate obtained using non-parametric methods. Simulations with the two-parameter log-logistic and Weibull distributions showed that our proposed four-parameter distribution had appropriate efficiency. Also, analyses of real data indicated that the proposed distribution showed a much better fit to the data than the other distributions tested. Our results are consistent with other studies in finding that an appropriate parametric model yields more precise estimates of cumulative incidence than non-parametric methods, and is thus a potentially suitable way to describe quantities of competing risks [9, 18]. In contrast, if a parametric model is mis-specified, the quantities will be estimated incorrectly, which will clearly bias the inferences [12]. However, our proposed distribution captures various hazard shapes well, which extends its applicability to a variety of survival data.

In addition to this advantage, the proposed distribution is improper for α < 0. This property makes our proposed distribution superior to other distributions such as the Weibull, two-parameter log-logistic, three-parameter Sparling and generalized Weibull models [6, 8]. This characteristic of our distribution also makes it possible to evaluate the direct effect of covariates on CIF, which is not possible in the CSHF model [19, 20]. The potential applications of direct modeling of CIF and parametric regression models with the four-parameter log-logistic distribution will be examined in forthcoming papers.

Conclusions

Despite the complexity of this distribution for modeling CIF (which is one of its limitations), the results of our simulation study and real-data application show that the new distribution achieves a much better fit to the data than other distributions that use fewer parameters. Whereas the two-parameter log-logistic is a proper distribution, the four-parameter log-logistic is an improper distribution in the subset of parameter space. Therefore, this distribution is suitable for parameterizing CIF directly in competing risk models. Moreover, it is can be added to a family of distributions and also potentially useful for parameterizing survival data in general.

Appendix

The survival function of the new distribution is as follows:

The parameter space is θ > 0, τ > 0, λ > 0, -∞ < α <∞. The survival function must be between zero and one for all values in the parameter space. If (θ2[(log(1+λtτ )/θ+1] α /α-1) > 0, then the condition holds. First, if α > 0, log(1+λtτ )/θ + 1 must be positive, which implies that log(1+λtτ )/θ > 0 since λ > 0, τ > 0 and θ > 0, log(1+λtτ )/θ is always positive. Thus, the condition holds for α > 0. The same result follows for the case α < 0.

Authors' information

Corresponding author: SMT Ayatollahi, Ph.D., FSS, C.Stat. Professor of Biostatistics, The Medical School, Shiraz University of Medical Sciences, Shiraz, Islamic Republic of Iran. P.O.Box 71345-1874.

Abbreviations

CIF:

cumulative incidence function

CSHF:

cause-specific hazard function MSE: mean square error

MLE:

maximum likelihood estimate

AIC:

Akaike information criterion

BIC:

Bayesian information criterion.

References

  1. Pintilie M: Competing Risks, A Practical Perspective. 2006, Chichester: John Wiley & Sons

    Chapter  Google Scholar 

  2. Putter H, Fiocco M, Geskus RB: Tutorial in biostatistics, Competing risks and multi-state models. Statistics in Medicine. 2007, 26: 2389-2430. 10.1002/sim.2712.

    Article  CAS  PubMed  Google Scholar 

  3. Gray RJ: A class of K-sample tests for comparing the cumulative incidence of a competing risk. Annals of Statistics. 1988, 16: 1141-54. 10.1214/aos/1176350951.

    Article  Google Scholar 

  4. Fine JP, Gray RJ: A proportional hazards model for the subdistribution of a competing risk. Journal of the American Statistical Association. 1999, 94: 496-509. 10.2307/2670170.

    Article  Google Scholar 

  5. Jeong JH: A new parametric family for modelling cumulative incidence functions: application to breast cancer data. Journal of the Royal Statistical Society, Series A. 2006, 169 (2): 289-303. 10.1111/j.1467-985X.2006.00409.x.

    Article  Google Scholar 

  6. Mudholkar GS, Srivastava DK, Kollia GD: A Generalization of the Weibull Distribution with Application to the Analysis of Survival Data. Journal of the American Statistical Association. 1996, 91 (436): 1575-1583. 10.2307/2291583.

    Article  Google Scholar 

  7. Foucher Y, Mathieu E, Philippe Saint-Pierre P, Durand JF, Daures JP: A Semi-Markov Model Based on Generalized Weibull Distribution with an Illustration for HIV Disease. Biometrical. 2005, 47 (6): 1-9.

    Google Scholar 

  8. Sparling YH, Younes N, Lachin JM: Parametric survival models for interval-censored data with time-dependent covariates. Biostatistics. 2006, 7 (4): 599-614. 10.1093/biostatistics/kxj028.

    Article  PubMed  Google Scholar 

  9. Wahed AS, Loung M, Jeong JH: A new generalization of Weibull distribution with application to a breast cancer data set. Statistics in Medicine. 2009, 28: 2077-2094. 10.1002/sim.3598.

    Article  PubMed Central  PubMed  Google Scholar 

  10. Klein JP, Moeschberger ML: Survival Analysis Techniques for Censored and Truncated Data. 2003, New York: Springer

    Google Scholar 

  11. Hougaard P: Survival models for heterogeneous populations derived from stable distributions. Biometrika. 1986, 73: 387-396. 10.1093/biomet/73.2.387.

    Article  Google Scholar 

  12. Haile SR: Inference on competing risks in breast cancer data. PhD Thesis, University of Pittsburgh, Biostatistics Department. 2008

    Google Scholar 

  13. Benichou J, Gail MH: Estimates of absolute cause-specific risk in cohort studies. Biometrics. 1990, 46: 813-826. 10.2307/2532098.

    Article  CAS  PubMed  Google Scholar 

  14. Jeong JH, Fine JP: Direct parametric inference for the cumulative incidence function. Applied Statistics. 2006, 55: 187-200. 10.1111/j.1467-9876.2006.00532.x.

    Google Scholar 

  15. Beyersmann J, Latouche A, Buchholz A, Schumacher M: Simulating competing risks data in survival analysis. Statistics in Medicine. 2009, 28: 956-971. 10.1002/sim.3516.

    Article  PubMed  Google Scholar 

  16. Bender R, Augustin T, Blettner M: Generating survival times to simulate Cox proportional hazards models. Statistics in Medicine. 2005, 24: 1713-1723. 10.1002/sim.2059.

    Article  PubMed  Google Scholar 

  17. Burton A, Altman DG, Royston P, Holder RL: The design of simulation studies in medical statistics. Statistics in Medicine. 2006, 25: 4279-4292. 10.1002/sim.2673.

    Article  PubMed  Google Scholar 

  18. Cheng Y: Modeling cumulative incidences of dementia and dementia-free death using a novel three-parameter logistic function. International Journal of Biostatistics. 2009, 5 (1): Art (29)

    Google Scholar 

  19. Fine JP: Regression modeling of competing crude failure probabilities. Biostatistics. 2001, 2 (1): 85-97. 10.1093/biostatistics/2.1.85.

    Article  PubMed  Google Scholar 

  20. Jeong JH, Fine JP: Parametric regression on cumulative incidence function. Biostatistics. 2007, 8: 184-196.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

This work was supported by grant number 90-5604 from Shiraz University of Medical Sciences, Shiraz, Islamic Republic of Iran. The authors would like to thank K. Shashok (Author AID in the Eastern Mediterranean), N. Shokrpour at Emam Reza Polyclinic and the Center for Development of Clinical Research of Nemazee Hospital and Dr J. Millward-Sadler for their editing services.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to SeyyedMohammadTaghi Ayatollahi.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

ZS and NZ were responsible for the design, simulation, analysis and interpretation. SMTA supervised the study and interpreted the results. All authors read and approved the final manuscript.

Zahra Shayan and Najaf Zare contributed equally to this work.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Shayan, Z., Ayatollahi, S. & Zare, N. A parametric method for cumulative incidence modeling with a new four-parameter log-logistic distribution. Theor Biol Med Model 8, 43 (2011). https://doi.org/10.1186/1742-4682-8-43

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1742-4682-8-43

Keywords