A table of measurements tells you what happened at a few moments. A formula that fits the table lets you ask about every moment in between and beyond. Before you trust its answers, you need to know what the formula assumes, how far it misses the data, and where the data run out.
Key terms
Variables and parameters
Definition A function model describes how one quantity depends on another. The input (the independent variable) and the output (the dependent variable) are the quantities that change within one situation. A parameter is a constant in the formula that stays fixed within one situation but may take a different value in another, so one formula with parameters describes a whole family of functions. In the linear model the parameters are and , and in the exponential model they are and . Parameters are found from given facts or from data, and each one usually has a meaning in the situation.
In plain words Variables are what you plug in and read off. Parameters are the settings that make the general formula fit one particular case.
Example One shop rents bikes for dollars for hours. Here is the input and the output. The parameter is a fixed fee and is the charge per hour. A second shop with uses the same linear form with different parameters, and for a ride of hours the costs are and dollars.
Units
Definition Every variable in a model is measured in a unit, and every parameter carries the unit that makes the formula consistent. Quantities that are added or subtracted must have the same unit, and both sides of an equation must have the same unit. In the parameter has the unit of and the slope has the unit of per unit of , which is also the unit of any average rate of change of the model. An exponent must be a pure number, so in the input counts units of time, for example the number of years. Then has the unit of , and has no unit and is the growth factor per unit of time, per year in that example. Changing the unit of the input changes every parameter that refers to it, such as the slope of a line or the growth factor of an exponential model.
In plain words Units tell you what each number in the formula means. Checking them catches many mistakes before any arithmetic does.
Example A tank holds liters of water minutes after a drain opens. The is in liters, the starting volume. The is in liters per minute, the rate of change. If time is measured in hours instead, then and
so the same rate now reads liters per hour.
Model assumptions
Definition The assumptions of a model are the statements about the situation that the model takes as true. They decide the form of the function, its domain and the inputs where its answers can be trusted. A linear model assumes the output changes by the same amount over every input interval of the same length. An exponential model assumes it changes by the same factor, that is the same percent, over every input interval of the same length. Every model also assumes that the conditions behind the data stay the same.
In plain words A model is a bet about how the world behaves. Write the bet down, because the answers are only as good as the bet.
Example A phone battery at percent drops percentage points per hour of video, so . This assumes steady use and a battery that drains evenly. Setting gives hours. For larger the formula gives negative charge, which is impossible, so the model only makes sense on the domain .
Linear versus exponential growth
Definition Take equally spaced inputs with . A linear function, written here as because is needed for the base below, has constant differences,
An exponential function with , and has constant ratios,
So for data with equally spaced inputs, nearly constant differences suggest a linear model and nearly constant ratios suggest an exponential one. If and , exponential growth eventually overtakes every linear function. For any and there is a number with for all .
In plain words Linear growth adds the same amount each step. Exponential growth multiplies by the same factor each step, and when that factor is greater than it always pulls ahead in the end.
Example Start two savings plans at dollars. One adds dollars a year, the other grows by percent a year.
| Year | ||
|---|---|---|
The linear plan leads for five years. The exponential plan passes it between year and year and stays ahead from then on.
Residual
Definition Let a model be fitted to data points . The residual at the th point is the observed value minus the predicted value,
It is positive when the point lies above the graph of , negative when it lies below, and zero when it lies on the graph. A model fits well when its residuals are small compared with the data and show no systematic pattern. A long run of residuals with the same sign, or residuals that rise and fall in a curve, means the form of the model misses a trend in the data.
In plain words A residual is how far a data point sits above or below the model’s curve. Small and random is good. Lined up in a pattern means the curve has the wrong shape.
Example A town counted its residents, in thousands, every two years. The ratios of successive counts are all close to , and , which suggests the exponential model . For comparison take the line through the first and last points, .
| Count | Residual for | Residual for | |||
|---|---|---|---|---|---|
The line sits above every middle point, and its residuals dip and come back up. The data bend upward and the line cannot. The exponential residuals are all smaller than in size, under one percent of each count, and their signs are mixed with no long run of one sign and no curve, so is the better choice.
Interpolation
Definition Let the data inputs run from to , the smallest and largest. Interpolation is using a model to estimate the output at an input with that is not one of the data inputs. Data on both sides hold the model in place, so a model with small residuals and no pattern usually gives reliable estimates inside this range.
In plain words Interpolation fills a gap between measurements you already have.
Example The town was not counted at . The exponential model gives
which lies between the counts at and at . The line gives , about thousand more, which matches its habit of running too high in the middle of the data.
Extrapolation
Definition Extrapolation is using a model to estimate the output at an input or , outside the range of the data. No measurements lie there, so the estimate rests entirely on the assumption that the same pattern continues. The farther lies from the data, the more two models that fit the same data can disagree.
In plain words Extrapolation predicts where no one has measured. It is often necessary, but treat the answer as a guess that gets weaker with distance.
Example Here is the town years after the first count, according to each model.
Two years past the data the models differ by about thousand. At the exponential model, the one that fit best, predicts more than thousand residents. Very few towns keep growing percent a year for forty years, because housing, jobs and land run out. The fit inside the data cannot warn you about that.
Exact and approximate values
Definition An exact value is a number written without rounding, such as , or . An approximate value is a rounded decimal, written with . Keep exact expressions, or the full precision of your calculator, through every step and round only the final answer. Report that answer to a precision the data can support, since a model built from measurements is itself an approximation.
In plain words Round once, at the end, and not more finely than your data were measured.
Example The town model doubles when , so and
Rounding too early with and gives years instead, off by more than four months. The counts have three significant digits and the factor is itself an estimate from them, so report about years. More digits would claim an accuracy the data do not have.
Data limitations
Definition A data set is a finite list of measurements taken over a limited range of inputs, under particular conditions and with limited precision. Infinitely many functions pass through any finite set of points with different inputs, so data can support a model but never prove it. A good fit says nothing about inputs outside the range of the data, and differences smaller than the precision of the measurements carry no information.
In plain words Numbers that fit a pattern are evidence, not proof. Another curve can match every point you have and still go somewhere else.
Example The points , and lie exactly on both
At the first gives and the second gives . Three points cannot decide between them. More data or a reason from the situation can, for example knowing that a quantity doubles every step because each cell splits in two.
Check yourself
- A sample has mass , , and grams at hours. Is a linear or an exponential model the better fit? Give the model and use it to estimate the mass at .
Show the answer
The differences are , and , which are not constant. The ratios are all , so the model is exponential,
Then grams. Since lies outside the data, this is an extrapolation and assumes the same rate of decay continues.
- The model was fitted to the points , and . Find the three residuals and say which points lie above the line.
Show the answer
The predictions are , and , so the residuals are , then , then . Only the point has a positive residual, so it is the only one above the line.
- The height of a young tree is modeled by meters, years after planting, fitted to measurements taken at and . Give the units and meaning of and . Then decide whether estimating the height at and at is interpolation or extrapolation, and which estimate deserves more trust.
Show the answer
The number is in meters and is the height at planting. The number is in meters per year and is the growth per year. The estimate meters is an interpolation, between the measurements at and . The estimate meters is an extrapolation far beyond the data and assumes the tree keeps growing at the same rate for sixty years, which trees do not do. Trust the first and treat the second with suspicion.