Let X1, X2, …be exponential random variables with parameter...

Let $X_{1}, X_{2}, \ldots$ be exponential random variables with parameter 1 . (a) Argue that $X_{1}+X_{2}$ is not an exponential random variable. (b) Let $N$ be a geometric random variable with parameter $p$. Prove that $\sum_{i=1}^{N} X_{i}$ is exponentially distributed with parameter $p$.

Let $X_{1}, X_{2}, \ldots$ be exponential random variables with parameter 1 .
(a) Argue that $X_{1}+X_{2}$ is not an exponential random variable.
(b) Let $N$ be a geometric random variable with parameter $p$. Prove that $\sum_{i=1}^{N} X_{i}$ is exponentially distributed with parameter $p$.

Key Concepts

Gamma Distribution

The gamma distribution generalizes the exponential distribution and arises naturally as the sum of independent exponential random variables with the same rate parameter. Its shape and scale parameters determine its form, and when the shape parameter is an integer, the distribution is specifically known as the Erlang distribution. Recognizing when a sum of exponential variables forms a gamma distribution—and when it does not—helps in understanding the behavior of convolutions of independent random variables.

Exponential Distribution

The exponential distribution is a continuous probability distribution commonly used to model waiting times between independent events that occur at a constant average rate. It is characterized by its parameter (often denoted by ?) and has the memoryless property, meaning that the probability of an event occurring in the future is independent of the past. Understanding its probability density function and properties is fundamental in probability theory and reliability analysis.

Geometric Distribution

The geometric distribution is a discrete probability distribution that models the number of independent Bernoulli trials needed to achieve the first success. It also features a memoryless property, much like the exponential distribution, though in the discrete setting. This distribution is crucial when the number of events or summands in a random process is itself random, such as when summing a random number of exponential variables.

Mixture Distributions and Random Sums

Mixture distributions arise when the overall distribution is a weighted combination of several component distributions, with weights determined by another random variable. In the context of random sums—where the number of terms being added is itself a random variable (for instance, one following a geometric distribution)—the resulting distribution is obtained by averaging over the possible numbers of terms. This concept is fundamental in deriving the overall distribution when combining a series of independent random variables with a random count.

Convolution of Independent Random Variables

Convolution is the mathematical operation used to obtain the probability distribution of the sum of independent random variables. For continuous random variables, this involves integrating the product of their probability density functions. Understanding convolution is essential in determining why the sum of certain random variables (such as two i.i.d. exponential variables) does not retain the original distribution, and instead, takes on a different form like the gamma distribution.

Please give Ace some feedback