G12BAF (PDF version)
G12 Chapter Contents
G12 Chapter Introduction
NAG Library Manual

NAG Library Routine Document

G12BAF

Note:  before using this routine, please read the Users' Note for your implementation to check the interpretation of bold italicised terms and other implementation-dependent details.

+ Contents

    1  Purpose
    7  Accuracy

1  Purpose

G12BAF returns parameter estimates and other statistics that are associated with the Cox proportional hazards model for fixed covariates.

2  Specification

SUBROUTINE G12BAF ( OFFSET, N, M, NS, Z, LDZ, ISZ, IP, T, IC, OMEGA, ISI, DEV, B, SE, SC, COV, RES, ND, TP, SUR, NDMAX, TOL, MAXIT, IPRINT, WK, IWK, IFAIL)
INTEGER  N, M, NS, LDZ, ISZ(M), IP, IC(N), ISI(*), ND, NDMAX, MAXIT, IPRINT, IWK(2*N), IFAIL
REAL (KIND=nag_wp)  Z(LDZ,M), T(N), OMEGA(*), DEV, B(IP), SE(IP), SC(IP), COV(IP*(IP+1)/2), RES(N), TP(NDMAX), SUR(NDMAX,*), TOL, WK(IP*(IP+9)/2+N)
CHARACTER(1)  OFFSET

3  Description

The proportional hazard model relates the time to an event, usually death or failure, to a number of explanatory variables known as covariates. Some of the observations may be right-censored, that is the exact time to failure is not known, only that it is greater than a known time.
Let ti, for i=1,2,,n, be the failure time or censored time for the ith observation with the vector of p covariates zi. It is assumed that censoring and failure mechanisms are independent. The hazard function, λt,z, is the probability that an individual with covariates z fails at time t given that the individual survived up to time t. In the Cox proportional hazards model (see Cox (1972)) λt,z is of the form:
λt,z=λ0texpzTβ+ω
where λ0 is the base-line hazard function, an unspecified function of time, β is a vector of unknown parameters and ω is a known offset.
Assuming there are ties in the failure times giving nd<n distinct failure times, t1<<tnd such that di individuals fail at ti, it follows that the marginal likelihood for β is well approximated (see Kalbfleisch and Prentice (1980)) by:
L=i=1ndexpsiTβ+ωi lRtiexpzlTβ+ωldi (1)
where si is the sum of the covariates of individuals observed to fail at ti and Rti is the set of individuals at risk just prior to ti, that is, it is all individuals that fail or are censored at time ti along with all individuals that survive beyond time ti. The maximum likelihood estimates (MLEs) of β, given by β^, are obtained by maximizing (1) using a Newton–Raphson iteration technique that includes step halving and utilizes the first and second partial derivatives of (1) which are given by equations (2) and (3) below:
Ujβ= lnL βj =i=1ndsji-diαjiβ=0 (2)
for j=1,2,,p, where sji is the jth element in the vector si and
αjiβ=lRtizjlexpzlTβ+ωl lRtiexpzlTβ+ωl .
Similarly,
Ihjβ=- 2lnL βhβj =i=1nddiγhji (3)
where
γhji=lRti zhlzjlexpzlTβ+ωl lRtiexpzlTβ+ωl -αhiβαjiβ,   h,j= 1,,p.
Ujβ is the jth component of a score vector and Ihjβ is the h,j element of the observed information matrix Iβ whose inverse Iβ-1=Ihjβ -1 gives the variance-covariance matrix of β.
It should be noted that if a covariate or a linear combination of covariates is monotonically increasing or decreasing with time then one or more of the βj's will be infinite.
If λ0t varies across ν strata, where the number of individuals in the kth stratum is nk, for k=1,2,,ν with n=k=1νnk, then rather than maximizing (1) to obtain β^, the following marginal likelihood is maximized:
L=k=1νLk, (4)
where Lk is the contribution to likelihood for the nk observations in the kth stratum treated as a single sample in (1). When strata are included the covariate coefficients are constant across strata but there is a different base-line hazard function λ0.
The base-line survivor function associated with a failure time ti, is estimated as exp-H^ti, where
H^ti=tjti dilRtjexpzlTβ^+ωl , (5)
where di is the number of failures at time ti. The residual for the lth observation is computed as:
rtl= H^tlexpzlTβ^+ωl
where H^tl=H^ti,titl<ti+1. The deviance is defined as -2×(logarithm of marginal likelihood). There are two ways to test whether individual covariates are significant: the differences between the deviances of nested models can be compared with the appropriate χ2-distribution; or, the asymptotic normality of the parameter estimates can be used to form z tests by dividing the estimates by their standard errors or the score function for the model under the null hypothesis can be used to form z tests.

4  References

Cox D R (1972) Regression models in life tables (with discussion) J. Roy. Statist. Soc. Ser. B 34 187–220
Gross A J and Clark V A (1975) Survival Distributions: Reliability Applications in the Biomedical Sciences Wiley
Kalbfleisch J D and Prentice R L (1980) The Statistical Analysis of Failure Time Data Wiley

5  Parameters

1:     OFFSET – CHARACTER(1)Input
On entry: indicates if an offset is to be used.
OFFSET='Y'
An offset must be included in OMEGA.
OFFSET='N'
No offset is included in the model.
Constraint: OFFSET='Y' or 'N'.
2:     N – INTEGERInput
On entry: n, the number of data points.
Constraint: N2.
3:     M – INTEGERInput
On entry: the number of covariates in array Z.
Constraint: M1.
4:     NS – INTEGERInput
On entry: the number of strata. If NS>0 then the stratum for each observation must be supplied in ISI.
Constraint: NS0.
5:     Z(LDZ,M) – REAL (KIND=nag_wp) arrayInput
On entry: the ith row must contain the covariates which are associated with the ith failure time given in T.
6:     LDZ – INTEGERInput
On entry: the first dimension of the array Z as declared in the (sub)program from which G12BAF is called.
Constraint: LDZN.
7:     ISZ(M) – INTEGER arrayInput
On entry: indicates which subset of covariates is to be included in the model.
ISZj1
The jth covariate is included in the model.
ISZj=0
The jth covariate is excluded from the model and not referenced.
Constraint: ISZj0 and at least one and at most n0-1 elements of ISZ must be nonzero where n0 is the number of observations excluding any with zero value of ISI.
8:     IP – INTEGERInput
On entry: the number of covariates included in the model as indicated by ISZ.
Constraints:
  • IP1;
  • IP=​ number of nonzero values of ​ISZ.
9:     T(N) – REAL (KIND=nag_wp) arrayInput
On entry: the vector of n failure censoring times.
10:   IC(N) – INTEGER arrayInput
On entry: the status of the individual at time t given in T.
ICi=0
The ith individual has failed at time Ti.
ICi=1
The ith individual has been censored at time Ti.
Constraint: ICi=0 or 1, for i=1,2,,N.
11:   OMEGA(*) – REAL (KIND=nag_wp) arrayInput
Note: the dimension of the array OMEGA must be at least N if OFFSET='Y', and at least 1 otherwise.
On entry: if OFFSET='Y', the offset, ωi, for i=1,2,,N. Otherwise OMEGA is not referenced.
12:   ISI(*) – INTEGER arrayInput
Note: the dimension of the array ISI must be at least N if NS>0, and at least 1 otherwise.
On entry: if NS>0, the stratum indicators which also allow data points to be excluded from the analysis.
If NS=0, ISI is not referenced.
ISIi=k
The ith data point is in the kth stratum, where k=1,2,,NS.
ISIi=0
The ith data point is omitted from the analysis.
Constraint: if NS>0, 0ISIiNS and more than IP values of ISIi>0, for i=1,2,,N.
13:   DEV – REAL (KIND=nag_wp)Output
On exit: the deviance, that is -2×(maximized log marginal likelihood).
14:   B(IP) – REAL (KIND=nag_wp) arrayInput/Output
On entry: initial estimates of the covariate coefficient parameters β. Bj must contain the initial estimate of the coefficient of the covariate in Z corresponding to the jth nonzero value of ISZ.
Suggested value: in many cases an initial value of zero for Bj may be used. For other suggestions see Section 8.
On exit: Bj contains the estimate β^i, the coefficient of the covariate stored in the ith column of Z where i is the jth nonzero value in the array ISZ.
15:   SE(IP) – REAL (KIND=nag_wp) arrayOutput
On exit: SEj is the asymptotic standard error of the estimate contained in Bj and score function in SCj, for j=1,2,,IP.
16:   SC(IP) – REAL (KIND=nag_wp) arrayOutput
On exit: SCj is the value of the score function, Ujβ, for the estimate contained in Bj.
17:   COV(IP×IP+1/2) – REAL (KIND=nag_wp) arrayOutput
On exit: the variance-covariance matrix of the parameter estimates in B stored in packed form by column, i.e., the covariance between the parameter estimates given in Bi and Bj, ji, is stored in COVjj-1/2+i.
18:   RES(N) – REAL (KIND=nag_wp) arrayOutput
On exit: the residuals, rtl, for l=1,2,,N.
19:   ND – INTEGEROutput
On exit: the number of distinct failure times.
20:   TP(NDMAX) – REAL (KIND=nag_wp) arrayOutput
On exit: TPi contains the ith distinct failure time, for i=1,2,,ND.
21:   SUR(NDMAX,*) – REAL (KIND=nag_wp) arrayOutput
Note: the second dimension of the array SUR must be at least maxNS,1.
On exit: if NS=0, SURi1 contains the estimated survival function for the ith distinct failure time.
If NS>0, SURik contains the estimated survival function for the ith distinct failure time in the kth stratum.
22:   NDMAX – INTEGERInput
On entry: the dimension of the array TP and the first dimension of the array SUR as declared in the (sub)program from which G12BAF is called.
Constraint: NDMAXthe number of distinct failure times. This is returned in ​ND.
23:   TOL – REAL (KIND=nag_wp)Input
On entry: indicates the accuracy required for the estimation. Convergence is assumed when the decrease in deviance is less than TOL×1.0+CurrentDeviance. This corresponds approximately to an absolute precision if the deviance is small and a relative precision if the deviance is large.
Constraint: TOL10×machine precision.
24:   MAXIT – INTEGERInput
On entry: the maximum number of iterations to be used for computing the estimates. If MAXIT is set to 0 then the standard errors, score functions, variance-covariance matrix and the survival function are computed for the input value of β in B but β is not updated.
Constraint: MAXIT0.
25:   IPRINT – INTEGERInput
On entry: indicates if the printing of information on the iterations is required.
IPRINT0
No printing.
IPRINT1
The deviance and the current estimates are printed every IPRINT iterations. When printing occurs the output is directed to the current advisory message unit (see X04ABF).
26:   WK(IP×IP+9/2+N) – REAL (KIND=nag_wp) arrayWorkspace
27:   IWK(2×N) – INTEGER arrayWorkspace
28:   IFAIL – INTEGERInput/Output
On entry: IFAIL must be set to 0, -1​ or ​1. If you are unfamiliar with this parameter you should refer to Section 3.3 in the Essential Introduction for details.
For environments where it might be inappropriate to halt program execution when an error is detected, the value -1​ or ​1 is recommended. If the output of error messages is undesirable, then the value 1 is recommended. Otherwise, if you are not familiar with this parameter, the recommended value is 0. When the value -1​ or ​1 is used it is essential to test the value of IFAIL on exit.
On exit: IFAIL=0 unless the routine detects an error or a warning has been flagged (see Section 6).

6  Error Indicators and Warnings

If on entry IFAIL=0 or -1, explanatory error messages are output on the current error message unit (as defined by X04AAF).
Errors or warnings detected by the routine:
IFAIL=1
On entry,OFFSET'Y' or 'N',
orM<1,
orN<2,
orNS<0,
orIP<1,
orLDZ<N,
orTOL<10×machine precision,
orMAXIT<0.
IFAIL=2
On entry,ISZi<0 for some i,
orthe value of IP is incompatible with ISZ,
orICi1 or 0.
orISIi<0 or ISIi>NS,
ornumber of values of ISZi>0 is greater than or equal to n0, the number of observations excluding any with ISIi=0,
orall observations are censored, i.e., ICi=1 for all i,
orNDMAX is too small.
IFAIL=3
The matrix of second partial derivatives is singular. Try different starting values or include fewer covariates.
IFAIL=4
Overflow has been detected. Try using different starting values.
IFAIL=5
Convergence has not been achieved in MAXIT iterations. The progress toward convergence can be examined by using a nonzero value of IPRINT. Any non-convergence may be due to a linear combination of covariates being monotonic with time.
Full results are returned.
IFAIL=6
In the current iteration 10 step halvings have been performed without decreasing the deviance from the previous iteration. Convergence is assumed.

7  Accuracy

The accuracy is specified by TOL.

8  Further Comments

G12BAF uses mean centering which involves subtracting the means from the covariables prior to computation of any statistics. This helps to minimize the effect of outlying observations and accelerates convergence.
If the initial estimates are poor then there may be a problem with overflow in calculating expβTzi or there may be non-convergence. Reasonable estimates can often be obtained by fitting an exponential model using G02GCF.

9  Example

The data are the remission times for two groups of leukemia patients (see page 242 of Gross and Clark (1975)). A dummy variable indicates which group they come from. An initial estimate is computed using the exponential model and then the Cox proportional hazard model is fitted and parameter estimates and the survival function are printed.

9.1  Program Text

Program Text (g12bafe.f90)

9.2  Program Data

Program Data (g12bafe.d)

9.3  Program Results

Program Results (g12bafe.r)


G12BAF (PDF version)
G12 Chapter Contents
G12 Chapter Introduction
NAG Library Manual

© The Numerical Algorithms Group Ltd, Oxford, UK. 2012