Contiguity of probability measures

The concept of contiguity was formally introduced and developed by L. Le Cam in [a7]. It refers to sequences of probability measures, and is meant to be a measure of "closeness" or "nearness" of such sequences (cf. also Probability measure). It may also be viewed as a kind of uniform asymptotic mutual absolute continuity of probability measures. Actually, the need for the introduction of such a concept arose as early as 1955 or 1956, and it was at that time that Le Cam selected the name of "contiguity" , with the help of J.D. Esary (see [a9], p. 29).

There are several equivalent characterizations of contiguity, and the following may serve as its definition. Two sequences and are said to be contiguous if for any for which , it also happens that , and vice versa, where is a sequence of measurable spaces and and are measures on . Here and in the sequel, all limits are taken as . It is worth mentioning at this point that contiguity is transitive: If , are contiguous and , are contiguous, then so are , . Contiguity simplifies many arguments in passing to the limit, and it plays a major role in the asymptotic theory of statistical inference (cf. also Statistical hypotheses, verification of). Thus, contiguity is used in parts of [a8] as a tool of obtaining asymptotic results in an elegant manner; [a9] is a more accessible general reference on contiguity and its usages. In a Markovian framework, contiguity, some related results and selected statistical applications are discussed in [a11]. For illustrative purposes, [a11] can be used as standard reference.

The definition of contiguity calls for its comparison with more familiar modes of "closeness" , such as that based on the (or ) norm, defined by

and also the concept of mutual absolute continuity (cf. also Absolute continuity), . It is always true that convergence in the -norm implies contiguity, but the converse is not true (see, e.g., [a11], p. 12; the special case of Example 3.1(i)). So, contiguity is a weaker measure of "closeness" of two sequences of probability measures than that provided by sup-norm convergence. Also, by means of examples, it may be illustrated that it can happen that for all (i.e., if and only if for all , ) whereas and are not contiguous (see, e.g., [a11], pp. 9–10; Example 2.2). That contiguity need not imply absolute continuity for any is again demonstrated by examples (see, e.g., [a11], p. 9; Example 2.1 and Remark 2.3). This should not come as a surprise, since contiguity is interpreted as asymptotic absolute continuity rather than absolute continuity for any finite . It is to be noted, however, that a pair of contiguous sequences of probability measures can always be replaced by another pair of contiguous sequences whose respective members are mutually absolutely continuous and lie arbitrarily close to the given ones in the sup-norm sense (see, e.g., [a11], p. 25–26; Thm. 5.1).

The concept exactly opposite to contiguity is that of (asymptotic) entire separation. Thus, two sequences and are said to be (asymptotically) entirely separated if there exist and such that whereas as (see [a2], p. 24).

Alternative characterizations of contiguity are provided in [a11], Def. 2.1; Prop. 3.1; Prop. 6.1. In terms of sequences of random variables , two sequences and are contiguous if in -probability implies in -probability, and vice versa (cf. also Random variable). Thus, under contiguity, convergence in probability of sequences of random variables under and are equivalent and the limits are the same. Actually, contiguity of and is determined by the behaviour of the sequences of probability measures and , where , and . As explained above, there is no loss in generality by supposing that and are mutually absolutely continuous for all , and thus the log-likelihood function is well-defined with -probability for all . Then, e.g., and are contiguous if and only if and are relatively compact, or is relatively compact and for every subsequence converging weakly to a probability measure , one has , where is a dummy variable. It should be noted at this point that, under contiguity, the asymptotic distributions, under and , of the likelihood (or log-likelihood) ratios are non-degenerate and distinct. Therefore, the statistical problem of choosing between and is non-trivial for all sufficiently large .

An important consequence of contiguity is the following. With as above, let be a -dimensional random vector such that , a probability measure (where "" stands for weak convergence of probability measures). Then and is determined by . In particular, one may determine the asymptotic distribution of under (the alternative hypothesis) in terms of the asymptotic distribution of under (the null hypothesis) . Typically, and then for some . Also, if it so happens that and in -probability for every in (where denotes transpose and is a positive-definite covariance matrix), then, under contiguity again, .

In the context of parametric models in statistics, contiguity results avail themselves in expanding (in the probability sense) a certain log-likelihood function, in obtaining its asymptotic distribution, in approximating the given family of probability measures by exponential probability measures in the neighbourhood of a parameter point, and in obtaining a convolution representation of the limiting probability measure of the distributions of certain estimates. All these results may then be exploited in deriving asymptotically optimal tests for certain statistical hypotheses testing problems (cf. Statistical hypotheses, verification of), and in studying the asymptotic efficiency (cf. also Efficiency, asymptotic) of estimates. In such a framework, random variables are defined on , is a probability measure defined on and depending on the parameter , an open subset in , is the restriction of to , and the probability measures of interest are usually and , . Under certain regularity conditions, and are contiguous. The log-likelihood function expands in (and -probability); thus:

where is a -dimensional random vector defined in terms of the derivative of an underlying probability density function, and is a covariance function. Furthermore,

In addition, uniformly over bounded sets of , where is the normalized version of , being a suitably truncated version of . Finally, for estimates (of ) for which , a probability measure, one has , for a specified probability measure . This last result is due to J. Hájek [a3] (see also [a6]).

Contiguity of two sequences of probability measures and , as defined above, may be generalized as follows: Replace by , where converges to non-decreasingly, and replace by , where are real numbers tending to non-decreasingly. Then, under suitable regularity conditions, and are contiguous if and only if (see [a1], Thm. 2.1).

Some additional references to contiguity and its statistical applications are [a4], [a5], [a2], [a12], [a10].

References

[a1]	M.G. Akritas, M.L. Puri, G.G. Roussas, "Sample size, parameter rates and contiguity: the i.d.d. case" Commun. Statist. Theor. Meth. , A8 : 1 (1979) pp. 71–83
[a2]	P.E. Greenwood, A.M. Shiryayey, "Contiguity and the statistical invariance principle" , Gordon&Breach (1985)
[a3]	J. Hájek, "A characterization of limiting distributions of regular estimates" Z. Wahrscheinlichkeitsth. verw. Gebiete , 14 (1970) pp. 323–330
[a4]	J. Hájek, Z. Sidak, "Theory of rank tests" , Acad. Press (1967)
[a5]	I.A. Ibragimov, R.Z. Has'minskii, "Statistical estimation" , Springer (1981)
[a6]	N. Inagaki, "On the limiting distribution of a sequence of estimators with uniformity property" Ann. Inst. Statist. Math. , 22 (1970) pp. 1–13
[a7]	L. Le Cam, "Locally asymptotically normal families of distributions" Univ. Calif. Publ. in Statist. , 3 (1960) pp. 37–98
[a8]	L. Le Cam, "Asymptotic methods in statistical decision theory" , Springer (1986)
[a9]	L. Le Cam, G.L. Yang, "Asymptotics in statistics: some basic concepts" , Springer (1990)
[a10]	J. Pfanzagl, "Parametric statistical inference" , W. de Gruyter (1994)
[a11]	G.G. Roussas, "Contiguity of probability measures: some applications in statistics" , Cambridge Univ. Press (1972)
[a12]	H. Strasser, "Mathematical theory of statistics" , W. de Gruyter (1985)