Volume 9, Issue 4
Tricks of the Trade
In and Out
Download This Issue
Staff and Contributors
Neighbourhoods of Independence for Random Processes via Information Geometry
1. Differential Geometry of the Freund 4-Manifold F
In  we proved that every neighbourhood of an exponential distribution contains a neighbourhood of gamma distributions in the subspace topology of , using information geometry (see Amari et al. [2, 3]) and the affine immersion of Dodson and Matsuzoe . As part of a study of the information geometry of gamma and bivariate gamma stochastic processes [5, 6, 7], we have calculated the geometry of the family of Freund bivariate mixture exponential density functions. The importance of this family lies in the fact that exponential distributions represent intervals between events for Poisson processes on the real line, and the Freund family provides models for bivariate processes with positive and negative covariance.
The Freund family of distributions becomes a Riemannian 4-manifold with the Fisher information metric, and we derive the induced -geometry, that is, the -Ricci curvature, the -scalar curvature, and so forth. We also show that the Freund manifold has a positive constant 0-scalar curvature, so geometrically it constitutes part of a sphere.
1.1. Freund Bivariate Mixture Exponential Distributions
This model was one of the first bivariate distributions to be obtained from reliability considerations. Freund  introduced a bivariate exponential mixture distribution arising from the following situation. Suppose that an instrument has two components, and , with lifetimes and having density functions (when both components are in operation) ; , . Then and are dependent, in that a failure of either component changes the parameter of the life distribution of the other component. Thus, when fails, the parameter for becomes ; when fails, the parameter for becomes . There is no other dependence. The joint density function of and is
Define the functions and :
Provided that , the marginal density function of is, according to Freund,
and provided that , the marginal density function of is
We can see that the marginal density functions are, in general, not exponential but rather mixtures of exponential distributions if ; otherwise, they are weighted averages. For this reason, this system of distributions should be termed bivariate mixture exponential distributions rather than simply bivariate exponential distributions. The marginal functions and are exponential distributions only in the special case .
Freund discussed the statistics of the special case when and obtained the following joint density function
with marginal density functions:
The covariance and correlation coefficient of and were derived by Freund, as follows:
Note that in general . The correlation coefficient when , , and when and , . In many applications, , that is, lifetime tends to be shorter when the other component is out of action. In such cases the correlation is positive.
1.2. Fisher Information Metric
Proposition 1.1 Let be the set of Freund bivariate mixture exponential distributions, that is,
Then we have:
1. Identifying as a local coordinate system, can be regarded as a 4-manifold.
2. F is a Riemannian space and the Fisher information matrix , where
is given by
In this section we provide the -connection and various -curvature objects of the Freund 4-manifold F: the -curvature tensor, the -sectional curvatures, the -mean curvatures, the -Ricci tensor, and the -scalar curvature.
For each , the -connection is the torsion-free affine connection with components:
So we have an affine connection defined by
where is the Fisher information metric.
Note that the 0-connection is the Riemannian connection with respect to the Fisher metric.
Proposition 1.2 The functions , are given by
For example, the component is given by
Proposition 1.3 By solving the equations , , we obtain the components of :
So we obtain:
Proposition 1.4 The components of the -curvature tensor , are given by
Since the analytical expression for the curvature tensor is very large, we report the components :
while the other independent components are zero.
Proposition 1.5 The -sectional curvatures:
are given by
Proposition 1.6 The -mean curvatures:
are given by
Contracting with , we obtain the components of the Ricci tensor.
Proposition 1.7 The components of the -Ricci tensor are given by the symmetric matrix .
The -eigenvalues and the -eigenvectors of the -Ricci tensor are given by
Proposition 1.8 The manifold F has a constant -scalar curvature .
Note that the Freund manifold F has a positive constant scalar curvature when , so geometrically it constitutes part of a sphere (compare, for example, Kobayashi and Nomizu ).
About Mathematica | Download Mathematica Player
© Wolfram Media, Inc. All rights reserved.