next up previous contents
Next: Expectations and Products Up: Spaces of Random Variables Previous: Spaces of Random Variables

Random Variables

There seem to be two general approaches to the development of Random Variables, enforcing a choice between ``feast'' or ``famine'' of rigor. The first is to simply say a random variable is a variable which takes on values according to some probability distribution, and leave it at that. The second is to delve into a subtle realm of measure and probability theory, rich and involving fields unto themselves. We will attempt to steer a middle course between this Scilla and Charybdis, using what we need of the indubitably elegant foundation laid by Kolmogorov and others without sinking too far into chthonian abstraction.

Let us begin with a state space. This is a finite dimensioned Hilbert Space, generally tex2html_wrap_inline715 . We will assume the concept of a Random Variable, with finite variance, taking on values in this space (see Appendix). Consider further the infinitude of possible such Random Variables (RV's). It is the relationships between these that determine the stochastic behavior of our system, and it is on the set of all such RV's that we shall build our edifice. For this set may be shown to be a Hilbert Space itself. This will be of great interest to us, because it allows us to treat probabalistic relationships as geometric ones. This is of great mathematical, computational, and aesthetic import.

We may develop this vector space informally by merely noting that the operations of vector addition and scalar multiplication defined on the original state space naturally induce definitions for the space of Random Variables. Linear combinations of RV's may be evaluated in the obvious way, yielding still more elements of tex2html_wrap_inline782 , our space of Random variables. The closure of the original set under these operations ensures the closure of the space of random variables, and similarly with the rest of the Vector Space Axioms.

To proceed slightly more formally, we begin by developing the one dimensional case. Consider the set of all finite variance real-valued random variables. We may associate this with the set of all square-integrable real-valued functions, tex2html_wrap_inline790 . We will consider tex2html_wrap_inline782 to be simply the Cartesian Product of this infinite dimensional space of scalar random variables with itself d times.

It is the similarity between this construction and that of tex2html_wrap_inline715 which provides its utility and intuitive advantages, and it is the differences which make for a rich landscape of mathematical structures and challenges.


next up previous contents
Next: Expectations and Products Up: Spaces of Random Variables Previous: Spaces of Random Variables

Scot Free Kennedy
Sat Sep 13 00:27:51 PDT 1997