The exponential distribution is considered in situtations where intervals between events are considered as well as where a skewed distribution is appropriate. The exponential distribution also plays key role in survival analysis. Goodness-of-fit for exponentiality is crucial as, in the natural sciences, some of the commonly used distributions such as gamma and Weibull distributions are just translated versions of the exponential distributions. Several well known exponentiality tests are reviewed. A power comparison is performed using simulation.
Assessing whether a data set is in compliance with a postulated distribution is termed as goodness-of-fit of a distribution. Tests for exponentiality is the general term for goodness-of-fit tests for exponential distributions. An exhaustive list of references for goodness-of-fit tests for exponential distributions are given in N. Balakrishnan and Asit P. Basu 1, K. Yu. Volkova 2, A. P. Rogozhnikov and B. Yu. Lemeshko 3, and the references there in.
In this paper, we implement several exponentiality tests, such as, Test for exponentiality based on Ahsanullah characterization 4, 5, Atkinson test for exponentiality 6, Cox and Oakes test for exponentiality 7, Cramervon Mises test for exponentiality 7, Deshpande test for exponentiality 8, Test for exponentiality of Epps and Pulley ( 7 section 2.8.1), Epstein test for exponentiality 9, Frozini test for exponentiality 10, test for exponentiality based on the Gini statistic 11, Gnedenko F-test of exponentiality 9, Harris modification of Gnedenko F-test 9, Hegazy-Green test for exponentiality 12, Hollander-Proshan test for exponentiality 13, Kimber-Michael test 14 and 15, Kochar test for exponentiality 16, Kolmogorov-Smirnov test ( 7 section 2.1) forexponentiality, Lorenz test for exponentiality 17, Moran test for exponentiality 18, 19, Pietra statistic 9, exponentiality based on Rossberg characterization 2, Shapiro-Wilk test for exponentiality 20, WE test for exponentiality 9, Wong and Wong test for exponentiality 9, and Anderson-Darling test for exponentiality 21.
The test is based on the following statistic by Alexey Novikov and Ruslan Pusev,
![]() |
where
is the empirical distribution function,
![]() |
![]() |
Under exponentiality, one has
![]() |
4, 5. This test can be implemented either using the asymptotic normal distribution or using the simulated distribution under the exponentiality assumption. Here we represent them as AHTT and AHTS, respectively.
2.2. Atkinson Test for ExponentialityThe Atkinson test for exponentiality is based on the following statistic 6,
![]() |
The statistic is asymptotically (absolute) normal,
![]() |
where,
![]() |
This test can be implemented either using the asymptotic normal distribution or using the simulated distribution under the exponentiality assumption. Here we represent them as AKTT and AKTS, respectively.
2.3. Test for Exponentiality of Cox and OakesThe Cox and Oakes test is a test for the composite hypothesis of exponentiality 7. The test statistic is,
![]() |
where
is asymptotically standard normal 7. This test can be implemented either using the asymptotic normal distribution or using the simulated distribution under the exponentiality assumption. Here we represent them as COTT and COTS, respectively.
The Cramer-von Mises test for exponentiality (Henze and Meintanis 7 is based on the following statistic,
![]() |
where
is the empirical distribution function of the scaled data
The p-value is computed by Monte Carlo simulation. Here we represent the test as CMTS.
Deshpande test for the composite hypothesis of exponentiality 8, is based on the following statistic,
![]() |
Under exponentiality, one has
![]() |
where
![]() |
This test can be implemented either using the asymptotic normal distribution or using the simulated distribution under the exponentiality assumption. Here we represent them as DPTT and DPTS, respectively.
2.6. Test for Exponentiality of Epps and PulleyThe test statistic is
![]() |
where
is asymptotically standard normal ( 7 section 2.8.1). This test can be implemented either using the asymptotic normal distribution or using the simulated distribution under the exponentiality assumption. Here we represent them as EPTT and EPTS, respectively.
The test 9 is based on the following statistic:
![]() |
where
![]() |
are order statistics. Under exponentiality, EPSn is approximately distributed as a chi-square with
degrees of freedom. This test can be implemented either using the asymptotic normal distribution or using the simulated distribution under the exponentiality assumption. Here we represent them as ESTT and ESTS, respectively.
The Frozini test for exponentiality is based on the following statistic 10,
![]() |
The p-value is computed by Monte Carlo simulation. Here we represent the test as FRTS.
2.9. Test for Exponentiality Based on the Gini StatisticThe test is based on the Gini statistic,
![]() |
Under exponentiality, the normalized statistic
is asymptotically standard normal 11. This test can be implemented either using the asymptotic normal distribution or using the simulated distribution under the exponentiality assumption. Here we represent them as GSTT and GSTS, respectively.
The test 9 is based on the following statistic,
![]() |
where
![]() |
are order statistics. Under exponentiality,
follows an F distribution with
and
degrees of freedom. Here we represent the test as GNTT.
The test 9 is based on the following statistic,
![]() |
where
![]() |
are order statistics. Under exponentiality,
follows an F distribution with
and
degrees of freedom. Here we represent the test as HGTT.
The Hegazy-Green test for exponentiality 12 is based on the following statistic,
![]() |
The p-value is computed by Monte Carlo simulation. Here we represent the test as HFTS.
2.13. Hegazy-Green Test for ExponentialityThe Hegazy-Green test for exponentiality 12 is based on the following statistic,
![]() |
The p-value is computed by Monte Carlo simulation. Here we represent the test as HRTS.
2.14. Hollander-Proshan Test for ExponentialityThe test 13 is based on the following statistic,
![]() |
Under exponentiality, one has
![]() |
This test can be implemented either using the asymptotic normal distribution or using the simulated distribution under the exponentiality assumption. Here we represent them as HPTT and HPTS, respectively.
2.15. Kimber-Michael Test for ExponentialityThe Kimber-Michael test 14, 15 for exponentiality is based on the following statistic,
![]() |
where
![]() |
The p-value is computed by Monte Carlo simulation. Here we represent the test as KMTS.
2.16. Kochar Test for ExponentialityThe Kochar test for exponentiality 16 is based on the following statistic,
![]() |
where
![]() |
The statistic T is asymptotically standard normal. This test can be implemented either using the asymptotic normal distribution or using the simulated distribution under the exponentiality assumption. Here we represent them as KCTT and KCTS, respectively.
2.17. Kolmogorov-Smirnov Test for ExponentialityThe Kolmogorov-Smirnov test ( 7 section 2.1) for exponentiality is based on the following statistic,
![]() |
where,
is the empirical distribution function of the scaled data
The p-value is computed by Monte Carlo simulation. Here we represent the test as KSTS.
The Lorenz test for exponentiality 17 for exponentiality is based on the following statistic,
![]() |
The statistic
is asymptotically standard normal. This test can be implemented either using the asymptotic normal distribution or using the simulated distribution under the exponentiality assumption. Here we represent them as LZTT and LZTS, respectively.
The Moran test for exponentiality 18, 19 is based on the following statistic,
![]() |
where, where
is Euler-Mascheroni constant. The statistic is asymptotically normal,
![]() |
This test can be implemented either using the asymptotic normal distribution or using the simulated distribution under the exponentiality assumption. Here we represent them as MRTT and MRTS, respectively.
2.20. Test for Exponentiality Based on the Pietra statisticThe test is based on the following Pietra statistic 9,
![]() |
The p-value is computed by Monte Carlo simulation. Here we represent the test as PSTS.
2.21. Test for Exponentiality Based on Rossberg CharacterizationThe test is based on the following statistic 2,
![]() |
where
is the empirical distribution function,
![]() |
![]() |
Here
denotes the
order statistic of
The p-value is computed from the limit null distribution. Under exponentiality, one has
![]() |
This test can be implemented either using the asymptotic normal distribution or using the simulated distribution under the exponentiality assumption. Here we represent them as RCTT and RCTS, respectively.
2.22. Shapiro-Wilk Test for ExponentialityThe Shapiro-Wilk test for exponentiality 20 is based on the following statistic,
![]() |
The p-value is computed by Monte Carlo simulation. Here we represent the test as SWTS.
2.24. Wong and Wong Test for ExponentialityThe Wong and Wong test for the composite hypothesis of exponentiality 9 is based on the following statistic,
![]() |
where
and
are the smallest and the largest order statistics respectively. The p-value is computed by Monte Carlo simulation. Here we represent the test as WWTS.
Anderson-Darling upper tail test is based on the statistic 21
![]() |
where
and
is the
ordered measurement in the sample. The p-value is computed by Monte Carlo simulation. Here we represent the test as ADTS.
Samples are generated from standard exponential distribution to check whether the proportions of rejections match with the respective levels of siginificances. And samples are generated from some selected alternative distributions, such as, standard Uniform (0, 1), standard half-normal, Weibull (1.0, 1.4), Gamma (2.0, 1.0), Beta (2.0, 1.0), Gamma (0.5, 1.0), and Log Normal (0.0, 0.8), distributions to investigate how powerful the tests are. We have considered sample sizes, 12, 20, and 28. Levels of significances considered are 1%, 5%, and 10%. In each cases, 10,000 samples are considered.
In Table 3, when samples are taken from the standard exponential distribution (null distribution), the levels of significances are closely estimated for the tests AKTS, COTS, CMTS, DPTS, EPTT, EPTS, ESTT, ESTS, FRTS, GSTT, GSTS, GNTT, HGTT, HFTS, HRTS, HPTS, KMTS, KCTS, KSTS, LZTS, MRTS, SWTS, WETS, WWTS, and ADTS. The tests PSTS and RCTS are also closely estimating the levels of significances with exceptions for smaller samples. Tests AHTT, AKTT, DPTT, KCTT, and MRTT are not estimating the levels of significances closely. Tests AHTS, HPTT, LZTT, and RCTT are wrongly estimating the levels of significances always as zeros or very close to zeros.
In Table 4, when samples are taken from standard uniform distribution, the worst performing tests are, AHTS, HFTS, HRTS, HPTT, LZTT, RCTT, and SWTS, their rejection proportions are zeros or close to zeros. Tests AKTT, AKTS, COTT, COTS, DPTT, DPTS, EPTT, EPTS, FRTS, GSTT, GSTS, GNTT, HPTS, KMTS, PSTS, and WETS, have some decent powers at least for higher samples. Tests AHTT, KCTT, and ADTS have high powers, among them KCTT has highest powers for all sample sizes and for all levels considered.
In Table 5, when samples are taken from standard half normal distribution, the worst performing tests are, AHTS, HFTS, HRTS, LZTT, RCTT, and SWTS, their rejection proportions are zeros. Tests AHTT, and KCTT have high powers, between them KCTT has highest powers for higher sample sizes and for higher levels of significances.
In Table 6, when samples are taken from Weibull (1.0,1.4) distribution, the worst performing tests are, AHTS, HFTS, HRTS, HPTT, LZTT, RCTT, SWTS, and WWTS, their rejection proportions are zeros or close to zeros. Tests AKTT, COTT, COTS, DPTT, DPTS, EPTT, EPTS, FRTS, GSTT, GSTS, GNTT, HPTS, KCTS, LZTS, MRTT, MRTS, PSTS, WETS, and ADTS have some decent powers at least for higher samples and higher levels of significances. Tests AHTT, and KCTT have high powers, between them KCTT has highest powers for higher sample sizes and for higher levels of significances.
In Table 7, when samples are taken from Gamma (2.0,1.0) distribution, the worst performing tests are, AHTS, ESTT, ESTS, HPTT, LZTT, RCTT, SWTS, and WWTS, their rejection proportions are zeros or close to zeros. Tests AKTT, AKTS, COTT, COTS, DPTS, EPTT, EPTS, FRTS, GSTT, GSTS, GNTT, HPTS, KCTS, LZTS, MRTT, MRTS, RCTS, and WETS have some decent powers at least for higher samples and higher levels of significances. Tests DPTT, KCTT, PSTS, and ADTS have some good powers at least for higher samples and higher levels of significances. Tests AHTT, HFTS, and HRTS have high powers, among them HFTS has highest powers for higher sample sizes and for higher levels of significances.
In Table 8, when samples are taken from Beta(2.0,1.0) distribution, the worst performing tests are, AHTS, HFTS, HRTS, LZTT, RCTT, SWTS, and WWTS, their rejection proportions are zeros or close to zeros. Tests HGTT and HPTT have some decent powers at least for higher samples and higher levels of significances. Tests AKTT, AKTS, COTT, CMTS, ESTT, ESTS, KMTS, and KSTS, have high powers at least for higher samples and higher levels of significances. Tests AHTT, COTS, DPTT, DPTS, EPTT, EPTS, FRTS, GSTT, GSTS, GNTT, HPTS, KCTT, KCTS, LZTS, MRTS, PSTS, RCTS, WETS, and ADTS have very high powers, among them AHTT, DPTT, EPTS, FRTS, GSTT, GSTS, HPTS, KCTT, PSTS, WETS, and ADTS have highest powers irrespective of sample sizes and levels of significances.
In Table 9, when samples are taken from Gamma (0.5,1.0) distribution, the worst performing tests are, AHTS, GNTT, HGTT, HFTS, HRTS, HPTT, LZTT, PSTS, RCTT, and ADTS, their rejection proportions are zeros or close to zeros. Tests AKTT, AKTS, DPTT, DPTS, EPTT, EPTS, FRTS, GSTT, GSTS, HPTS, KCTS, KSTS, RCTS, SWTS, and WETS have some good powers at least for higher samples and higher levels of significances. Tests CMTS, KMTS, LZTS, and WWTS have good powers at least for higher samples and higher levels of significances. Tests COTT, COTS, MRTT, and MRTS, have high powers, among them MRTT and MRTS have highest powers irrespective of sample sizes and levels of significances.
In Table 10, when samples are taken from Log Normal(0,0.8) distribution, the worst performing tests are, AHTS, ESTT, ESTS, HPTT, KMTS, LZTT, RCTT, SWTS, and WWTS, their rejection proportions are zeros or close to zeros. Tests DPTS, FRTS, HFTS, MRTS, and RCTS have some decent powers at least for higher samples and higher levels of significances. Tests DPTT and KCTT have good powers at least for higher samples and higher levels of significances. Only AHTT have some high powers irrespective of sample sizes and levels of significances.
Overall worst performing tests are Ahsanullah characterization test using simulation (AHTS), Hegazy-Green test using simulation (HFTS), Hegazy-Green alternative test using simulation (HRTS), Lorenz test using normal approximation (LZTT), Rossberg characterization test using normal approximation (RCTT), Shapiro-Wilk test using simulation (SWTS), and Wong and Wong test using simulation (WWTS). These tests do not estimate the levels of significances correctly and have very low powers against the alternatives considered here.
Ahsanullah characterization test using normal approximation (AHTT) and Kochar test using normal approximation (KCTT) have high powers except for Gamma distribution with parameters 0.5 and 1.0. A few other tests also show higher powers but for some selected alternatives.
| [1] | Balakrishnan, N. and Basu, Asit P. The Exponential Distribution: Theory, Methods and Applications. Gordon and Breach Publishers, The Netherlands, 1995. | ||
| In article | View Article | ||
| [2] | Volkova, K.Yu. “On Asymptotic Efficiency of Exponentiality Tests Based on Rossberg's Characterization”. Journal of Mathematical Sciences, 167(4), 486-494, 2010. | ||
| In article | View Article | ||
| [3] | Rogozhnikov, A. P. and Lemeshko, B. Yu. “A Review of Tests for Exponentiality”. 11th International Conference on Actual Problems of Electronics Instrument Engineering, 159-166, 2012. | ||
| In article | View Article | ||
| [4] | Volkova, K.Yu. and Nikitin, Ya. Yu. “Exponentiality tests based on Ahsanullahs characterization and their efficiency”. Zap. Nauchn. Sem. POMI, 412, 69-87, 2013. | ||
| In article | |||
| [5] | Volkova, K.Yu. and Nikitin, Ya. Yu. “Exponentiality tests based on Ahsanullahs characterization and their efficiency”. Journal of Mathematical Sciences, 204(1), 42-54, 2015. | ||
| In article | View Article | ||
| [6] | Mimoto, N. and Zitikis, R. “The Atkinson index, the Moran statistic, and testing exponentiality”. J. Japan Statist. Soc., 38, 187-205, 2008. | ||
| In article | View Article | ||
| [7] | Henze, N. and Meintanis, S.G. “Recent and classical tests for exponentiality: a partial review with comparisons”. Metrika, 61, 29-45, 2005. | ||
| In article | View Article | ||
| [8] | Deshpande, J.V. “A class of tests for exponentiality against increasing failure rate average alternatives”. Biometrika, 70, 514-518, 1983. | ||
| In article | View Article | ||
| [9] | Ascher, S. “A survey of tests for exponentiality”. Communications in Statistics Theory and Methods, 19, 1811-1825, 1990. | ||
| In article | View Article | ||
| [10] | Frozini, B.V. “On the distribution and power of a goodness-of-fit statistic with parametric and nonparametric applications”. Goodness-of-fit, (Ed. by Revesz P., Sarkadi K., Sen P.K.) Amsterdam-Oxford-New York: North-Holland, 133-154, 1987. | ||
| In article | |||
| [11] | Gail, M.H. and Gastwirth, J.L. “A scale-free goodness-of-fit test for the exponential distribution based on the Gini statistic”. CJ. R. Stat. Soc. Ser. B, 40(3), 350-357, 1978. | ||
| In article | View Article | ||
| [12] | Hegazy, Y. A. S. and Green, J. R. “Some new goodness-of-fit tests using order statistics”. Journal of the Royal Statistical Society. Series C (Applied Statistics), 24, 99-308, 1975. | ||
| In article | View Article | ||
| [13] | Hollander M., Proshan F. “Testing whether new is better than used”. Ann. Math. Stat., 43, 1136-1146, 1972. | ||
| In article | View Article | ||
| [14] | Kimber, A.C. “Tests for the exponential, Weibull and Gumbel distributions based on the stabilized probability plot”. Biometrika, 72, 661-663, 1985. | ||
| In article | View Article | ||
| [15] | Michael, J.R. “The stabilized probability plot”. Biometrika, 70, 11-17, 1983. | ||
| In article | View Article | ||
| [16] | Kochar, S.C. “Testing exponentiality against monotone failure rate average”. Communications in Statistics Theory and Methods, 14, 381-392, 1985. | ||
| In article | View Article | ||
| [17] | Gail, M.H. and Gastwirth, J.L. “A scale-free goodness-of-fit test for the exponential distribution based on the Lorenz curve”. Journal of the American Statistical Association, 73, 787-793, 1978. | ||
| In article | View Article | ||
| [18] | Moran, P.A.P. “The random division of an interval Part II”. Journal of the Royal Statistical Society. Series B (Methodological), 13, 147-150, 1951. | ||
| In article | |||
| [19] | Tchirina, A.V. “Bahadur efficiency and local optimality of a test for exponentiality based on the Moran statistics”. Journal of Mathematical Sciences, 127(1), 1812-1819, 2005. | ||
| In article | View Article | ||
| [20] | Shapiro, S.S. and Wilk, M.B. “An analysis of variance test for the exponential distribution (complete samples)”. Technometrics, 14, 355-370, 1972. | ||
| In article | View Article | ||
| [21] | Anderson, T. W. and Darling, D. A. “Asymptotic theory of certain goodness of fit criteria based on stochastic processes”. Annals of Mathematical Statistics, 23, 193-212, 1952. | ||
| In article | View Article | ||
Published with license by Science and Education Publishing, Copyright © 2017 Mezbahur Rahman and Han Wu
This work is licensed under a Creative Commons Attribution 4.0 International License. To view a copy of this license, visit
http://creativecommons.org/licenses/by/4.0/
| [1] | Balakrishnan, N. and Basu, Asit P. The Exponential Distribution: Theory, Methods and Applications. Gordon and Breach Publishers, The Netherlands, 1995. | ||
| In article | View Article | ||
| [2] | Volkova, K.Yu. “On Asymptotic Efficiency of Exponentiality Tests Based on Rossberg's Characterization”. Journal of Mathematical Sciences, 167(4), 486-494, 2010. | ||
| In article | View Article | ||
| [3] | Rogozhnikov, A. P. and Lemeshko, B. Yu. “A Review of Tests for Exponentiality”. 11th International Conference on Actual Problems of Electronics Instrument Engineering, 159-166, 2012. | ||
| In article | View Article | ||
| [4] | Volkova, K.Yu. and Nikitin, Ya. Yu. “Exponentiality tests based on Ahsanullahs characterization and their efficiency”. Zap. Nauchn. Sem. POMI, 412, 69-87, 2013. | ||
| In article | |||
| [5] | Volkova, K.Yu. and Nikitin, Ya. Yu. “Exponentiality tests based on Ahsanullahs characterization and their efficiency”. Journal of Mathematical Sciences, 204(1), 42-54, 2015. | ||
| In article | View Article | ||
| [6] | Mimoto, N. and Zitikis, R. “The Atkinson index, the Moran statistic, and testing exponentiality”. J. Japan Statist. Soc., 38, 187-205, 2008. | ||
| In article | View Article | ||
| [7] | Henze, N. and Meintanis, S.G. “Recent and classical tests for exponentiality: a partial review with comparisons”. Metrika, 61, 29-45, 2005. | ||
| In article | View Article | ||
| [8] | Deshpande, J.V. “A class of tests for exponentiality against increasing failure rate average alternatives”. Biometrika, 70, 514-518, 1983. | ||
| In article | View Article | ||
| [9] | Ascher, S. “A survey of tests for exponentiality”. Communications in Statistics Theory and Methods, 19, 1811-1825, 1990. | ||
| In article | View Article | ||
| [10] | Frozini, B.V. “On the distribution and power of a goodness-of-fit statistic with parametric and nonparametric applications”. Goodness-of-fit, (Ed. by Revesz P., Sarkadi K., Sen P.K.) Amsterdam-Oxford-New York: North-Holland, 133-154, 1987. | ||
| In article | |||
| [11] | Gail, M.H. and Gastwirth, J.L. “A scale-free goodness-of-fit test for the exponential distribution based on the Gini statistic”. CJ. R. Stat. Soc. Ser. B, 40(3), 350-357, 1978. | ||
| In article | View Article | ||
| [12] | Hegazy, Y. A. S. and Green, J. R. “Some new goodness-of-fit tests using order statistics”. Journal of the Royal Statistical Society. Series C (Applied Statistics), 24, 99-308, 1975. | ||
| In article | View Article | ||
| [13] | Hollander M., Proshan F. “Testing whether new is better than used”. Ann. Math. Stat., 43, 1136-1146, 1972. | ||
| In article | View Article | ||
| [14] | Kimber, A.C. “Tests for the exponential, Weibull and Gumbel distributions based on the stabilized probability plot”. Biometrika, 72, 661-663, 1985. | ||
| In article | View Article | ||
| [15] | Michael, J.R. “The stabilized probability plot”. Biometrika, 70, 11-17, 1983. | ||
| In article | View Article | ||
| [16] | Kochar, S.C. “Testing exponentiality against monotone failure rate average”. Communications in Statistics Theory and Methods, 14, 381-392, 1985. | ||
| In article | View Article | ||
| [17] | Gail, M.H. and Gastwirth, J.L. “A scale-free goodness-of-fit test for the exponential distribution based on the Lorenz curve”. Journal of the American Statistical Association, 73, 787-793, 1978. | ||
| In article | View Article | ||
| [18] | Moran, P.A.P. “The random division of an interval Part II”. Journal of the Royal Statistical Society. Series B (Methodological), 13, 147-150, 1951. | ||
| In article | |||
| [19] | Tchirina, A.V. “Bahadur efficiency and local optimality of a test for exponentiality based on the Moran statistics”. Journal of Mathematical Sciences, 127(1), 1812-1819, 2005. | ||
| In article | View Article | ||
| [20] | Shapiro, S.S. and Wilk, M.B. “An analysis of variance test for the exponential distribution (complete samples)”. Technometrics, 14, 355-370, 1972. | ||
| In article | View Article | ||
| [21] | Anderson, T. W. and Darling, D. A. “Asymptotic theory of certain goodness of fit criteria based on stochastic processes”. Annals of Mathematical Statistics, 23, 193-212, 1952. | ||
| In article | View Article | ||