Requests reach a server at an average rate of two per minute. One question asks how many requests arrive in the next three minutes, and its answer is a count. Another asks how long the server waits for the next request, and its answer is a time in minutes. Under a homogeneous Poisson model both questions describe the same arrivals, so an event about the time of the first or the kth arrival can be rewritten as an event about counts. This lesson uses that link to find the law of the first wait, of the gaps between arrivals and of the time of the kth arrival, and to show why an exponential wait has no memory.
Key terms
First arrival time
Definition Let , for , be a homogeneous Poisson process with rate . So , the counts in disjoint time intervals are independent, and the count in any interval of length is . Here is the number of arrivals up to and including time . The first arrival time is the time at which the count first reaches . For every ,
because the first arrival comes after time exactly when no arrival has happened by time . Taking complements gives .
In plain words “Still waiting at time ” and “no arrivals by time ” are two descriptions of the same outcomes. The first speaks about a time and the second about a count, and that is why waiting probabilities can be read off from Poisson counts.
Example In a constructed model, requests arrive as a homogeneous Poisson process with rate per minute. The count in the first half minute is , so
The chance of waiting more than thirty seconds is about percent. The chance that the first request comes within thirty seconds is , which is also the chance of at least one arrival in a half-minute window.
Exponential waiting time
Definition In a homogeneous Poisson process with rate , the first arrival time has the exponential distribution with rate , written . For its survival function, CDF and density are
and for . The survival function is from the previous card, and the density is the derivative of for . Since as , the first arrival happens at some finite time with probability . The mean is , the variance is and the standard deviation is . With in arrivals per unit of time and in the same unit, the product is a pure number, the density is measured per unit of time, and the mean is a time.
In plain words The rate gives the mean count of a window by multiplying by the window’s length, and it gives the mean wait by taking the reciprocal. The density is not a probability. A probability is the area under the density over a time interval, and for every single time , even though the arrival happens at some time with probability .
Example With per minute, a three-minute window has mean count , while the first wait has mean minute, or seconds. The variance of the wait is square minute and its standard deviation is minute, as large as the mean. So the waits are not concentrated near seconds. A wait under seconds has probability , and a wait over one minute has probability . The density at is per minute, a value above that is not a probability. For a wait longer than seconds, first convert seconds to minute, then
Working in seconds gives the same exponent, since the rate is per second and .
Memoryless waiting
Definition For all and , a waiting time satisfies
The conditioning event has probability , and the event lies inside , so the conditional probability is the ratio of the two survival probabilities. Given that no arrival has happened by time , the remaining wait is again . In a Poisson process the same holds from any fixed time . The count is and is independent of the arrivals up to time , so the wait from time until the next arrival is whatever happened before .
In plain words Time already spent waiting does not make an arrival overdue. After an empty stretch, the wait still to come has the same law as a fresh wait. This is a statement about conditional probabilities, and the time already spent still counts toward the total wait. It comes from the model’s constant rate and its independent counts in disjoint intervals, not from the mere fact that a question is about waiting. Many real waits are not memoryless, for example a bus that runs on a timetable or a part that wears out with age.
Example With per minute, suppose seconds pass with no arrival. The probability of waiting more than another seconds is , the same as for a fresh wait of seconds. The unconditional probability of a total wait above seconds is smaller,
because it also requires the first seconds to be empty, which has probability , and .
Interarrival time
Definition Let be the time of the th arrival for , and set . The th interarrival time is the gap
so is the first wait. In a homogeneous Poisson process with rate , the gaps are independent and each has the distribution. Conversely, if independent gaps are added up to give arrival times, counting the arrivals up to each time produces a homogeneous Poisson process with rate .
In plain words After each arrival, the wait for the next one has the same exponential law as the very first wait and does not depend on the earlier gaps. Generating the gaps one at a time is a second, equivalent way to describe the process.
Example With per minute, every gap has mean seconds. The probability that one particular gap, for instance the one after the fourth arrival, lasts more than a minute is . By independence, the probability that each of the first three gaps lasts more than a minute is
The kth arrival time
Definition For , the th arrival time is the sum of the first gaps,
By linearity of expectation and the independence of the gaps,
For this is the exponential first wait. For the arrival time is not exponential, because an exponential variable with mean has variance , which is larger than .
In plain words A gap is the time between two neighboring arrivals, or from time to the first arrival, while an arrival time is measured from time and adds up all the gaps before it. Each gap is exponential, but the sum of several gaps is not. Its standard deviation is only times its mean.
Example With per minute, the third arrival time has mean minutes and variance square minute, so its standard deviation is minute. An exponential wait with the same mean of minutes would have standard deviation minutes, so does not have an exponential distribution. Its probabilities come from counts, as the next card shows.
Count and waiting time connection
Definition For every and ,
since the th arrival has happened by time exactly when at least arrivals have happened by then. Taking complements and using ,
For the sum has the single term , the exponential survival function again.
In plain words A question about when the th arrival happens becomes a question about how many arrivals a window holds. The window runs from time to the time in the question, and its count is compared with . The th arrival comes after time exactly when fewer than arrivals have happened by time .
Example With per minute, the count in the first minute is . The second arrival comes within one minute exactly when that count is at least , so
The subtracted terms are and . An exponential wait with the same mean of one minute would give , a different number.
Check yourself
- A constructed model treats arrivals at a help desk as a homogeneous Poisson process with rate per hour. Find the mean of the first wait in minutes, the probability that the first wait is longer than minutes, and the probability of no arrivals in the first minutes.
Show the answer
Work in hours, the unit of the rate. The mean wait is hour, which is minutes. Twenty minutes is hour, so the first wait is longer than that with probability . Forty minutes is hour, so the count in that window is and it is zero with probability .
- In the same model, the first minutes pass with no arrival. Find the probability that the next minutes also have no arrival. A classmate argues that after a quiet stretch an arrival is overdue, so the answer should be below . What is wrong with this, and why is your answer larger than the probability found in question 1?
Show the answer
The event is that the first wait is longer than hour, given that it is longer than hour. By memorylessness
The same answer follows from independent increments, since the count in the second stretch of minutes is and independent of the empty first stretch. Under this model the quiet stretch says nothing about the future, so no arrival is overdue. The probability from question 1 is unconditional. It also requires the first minutes to be empty, which has probability , and .
- In the same model, a classmate notes that the third arrival time has mean hour, treats it as exponential with mean hour, and reports as the probability that the third arrival comes within the first hour. Find the correct probability.
Show the answer
The mean is right, since hour, but is the sum of three independent exponential gaps and is not exponential. Use counts instead. The count in the first hour is , and the third arrival comes within the hour exactly when . So
The classmate’s value is too large.