Regression analysis

profiledani_dj511
RegressionAnalysisMemoExampleV1.docx

Date: December 1, 2015

To: Greg Hart, COO

From: Richard Peterson, Research Analyst

Subject: Predicting Flight Arrival Delay from Departure Delay

At our meeting on October 1st while we were discussing the preliminary analysis of the arrival and departure data you asked if we might be able to use that data to predict arrival times based on departure times. We reanalyzed the data for this purpose and want to share the results.

In this data set a change in departure delay has a high positive correlation to a change in arrival delay, 0.90 on a scale of -1.0 to +1.0. While the two are closely related, this alone does not prove causality or provide a measurement of predictability. For this, we conducted a statistical test called a regression analysis of the departure and arrival delays of the 444 random flights -- 169 United and 275 American -- from LAX to JFK over a one year period. The analysis creates a formula from the data that best expresses the dependence of any arrival time based on that airplane’s departure time. We can use this formula to predict arrival times. The formula has two parts: 1) the arrival time minutes saved (or lost) when the airplane departs on time and, 2) the weight or impact that each minute of departure delay has on arrival delay.

The analysis of this limited data set reveals that: 1) when airplanes depart on time they are likely to arrive about four minutes (4:07 minutes) earlier than scheduled and, 2) for every minute of departure delay there is approximately one minute (0:57 seconds) of arrival delay. For any given departure delay, say, 20 minutes, we can predict the arrival delay as: 4:07 minutes of early arrival + the weight of 0.96 times the 20 minute departure delay or approximately 15 minutes of arrival delay. The departure-arrival relationship of each of the 444 flights is depicted in the chart on the next page. It might be helpful to illustrate this relationship in a chart. The scatterplot chart (Figure 1) below shows the linear relationship by drawing an ideal line through the data with the least amount of distance from all of the data points. The line through the dots representing individual airplane data is called the regression line and it is drawn by applying a formula to all of the data that mathematically minimizes the distance or variation.

The regression statistics also provide an estimate of the accuracy of the formula using two measures. The first measure is an indication of how much of the arrival delay is explained by the departure delay. In this data that measure is 82%, which means that 18% of arrival delays are due to factors other than departure delays. The other measure of accuracy is the range, and we can expect to see a range of 33 minutes (plus or minus 17 minutes of arrival delay around the regression line) for any given departure delay. This variation due to “other” factors is considerably less than if we were to make an arrival time estimate without using regression analysis.

y = 0.9558x - 4.1144

Multiple R = 0.9

R² = 0.8164

Std Error = 16.7

P value = 0.002288

American and United: Predicting Arrival Delay

Finally, the regression statistics include a measure of reliability. Our data approaches 100% reliability; meaning, if we were to collect the sample data again, we would have the same regression statistics.

While we need data on more flight delays to and from more airports, the early indication is that we will be able to predict arrival delays based on departure delays with considerable accuracy and reliability. We look forward to receiving a more comprehensive data set on which we could repeat this analysis.

If you have any questions or comments please contact us.

Figure 1

Scatter Plot of 444 Flights LAX to JFK

ArrDelay 34 -3 -6 -3 -5 -8 -6 -5 -6 3 -6 -2 -11 -3 -10 -9 -3 -5 7 7 -9 30 -5 -2 -6 -6 -8 2 282 -1 -7 -5 -6 -4 -7 9 -6 -5 -3 1 -6 -3 1 1 3 -3 0 2 -1 2 113 -5 8 32 -1 -7 -2 -3 0 -6 -7 -4 -6 -7 -3 -7 -8 -3 15 25 -4 29 -7 -4 -7 -4 -3 6 14 -4 -8 -8 1 -4 -4 -2 3 -7 10 5 -3 -7 61 13 -5 -6 72 -7 -4 75 -5 0 -4 -8 -5 13 -4 -3 -1 -1 1 23 6 -1 0 -1 -8 4 1 33 -2 -5 -6 -7 -6 1 -4 -10 -5 -5 -4 -3 -7 -3 59 75 -5 -5 -2 18 7 -9 -7 -2 14 13 17 -6 26 23 100 1 256 -6 0 36 -7 23 -5 29 -5 -6 -6 -6 -9 1 55 -5 -7 -9 -5 -5 2 -2 18 -5 -7 -4 -3 -1 -3 -6 -1 -5 -5 -4 -5 -5 0 0 -9 -6 -6 38 -3 15 -5 -6 -6 30 1 1 -3 -1 -7 -3 -4 124 131 -6 -3 290 12 11 3 -4 -2 3 -5 -3 -6 -3 41 -7 -5 -4 -5 -7 -3 -4 -3 37 -7 -3 -7 -4 -3 -3 -5 -4 -7 -5 -7 -1 -6 47 -7 -9 15 -5 -3 66 -6 -6 -5 7 8 1 -4 -4 -3 6 -1 0 -4 1 -6 -5 -1 75 -5 -4 -5 207 -3 207 -4 3 -12 165 28 -3 -5 -3 -4 2 -3 7 3 185 99 -1 -2 3 -1 -5 -2 8 1 1 -1 88 11 3 3 -3 -3 -5 6 21 -5 5 0 -5 -3 -1 16 -4 10 9 -1 -6 -4 -4 -3 -3 81 16 139 -3 2 42 108 186 -4 -2 1 1 -4 -3 -3 1 -7 -3 -3 0 -1 8 -10 -5 -1 -6 -5 1 13 3 -2 14 15 3 2 -2 -2 3 -1 -3 -3 40 2 0 6 -6 -1 -1 -7 -6 61 -5 26 -4 4 -2 146 -2 2 -5 -1 4 58 -4 -3 8 -2 -1 27 -1 0 -7 9 -8 -7 -11 -3 -4 -9 3 -6 4 -11 -5 -2 1 -5 -6 -5 -6 -8 -1 -5 -7 -7 3 -4 13 0 -3 0 -4 -2 0 30 -2 0 0 40 16 18 -4 -1 31 2 42 -8 6 32 -6 -17 -12 -18 -15 14 -2 -5 1 -29 -11 -14 3 -14 -2 21 -2 -3 2 -11 106 -36 -4 -2 -27 -32 -5 261 -8 -11 4 -18 -16 -18 14 -1 -7 -11 -16 -21 2 19 -4 -5 26 -19 -17 -17 -16 121 -32 13 16 -15 -30 -26 -28 -18 -1 -9 5 -14 -22 11 -14 -24 -38 7 12 -19 24 7 3 -13 5 9 -23 -3 -13 -13 -2 -19 -22 11 -22 -3 -11 16 4 -17 -24 32 -4 -24 -27 55 -14 0 68 -5 1 -15 -19 -10 15 -5 -21 -13 -8 -1 54 12 -1 -6 0 -12 42 -12 2 -19 9 -18 -27 -23 -16 -27 -24 -2 -22 3 -10 -18 16 44 54 -25 -9 -22 12 -11 -13 19 -7 23 -6 4 0 15 -3 74 -2 227 -1 -14 10 -9 -11 -20 26 0 -5 -18 -14 -11 -7 46 -11 -32 -21 -10 25 8 -10 43 6 50 7 -15 -15 -8 15 5 -25 -28 -7 -33 -13 -7 29 -9 -14 -15 61 -3 8 -2 -27 -11 16 12 -20 -20 19 -16 -20 -15 107 122 -52 4 292 -4 -9 -27 -30 -25 3 -26 -13 7 -18 31 -15 -12 -9 -18 -32 -14 11 4 49 -12 6 -13 14 -20 -20 -11 -8 -3 -7 -6 -5 -28 25 -9 -12 24 -7 16 61 -10 -10 -7 -4 -3 -1 39 3 7 8 -13 -2 -5 -14 -15 -13 -9 61 -19 -15 -22 175 -21 224 9 27 -19 178 63 15 -14 21 -13 0 -22 10 0 176 87 -8 -8 2 -4 -15 -7 25 -6 33 26 49 5 -11 6 -7 -3 68 8 15 -6 20 -8 -10 -2 -18 27 -36 5 8 0 -32 -31 -33 3 -7 64 -10 115 92 58 19 110 167 -3 -6 21 30 -8 -1 -24 -24 -21 -25 -24 -14 -23 17 -11 -27 -1 -13 -25 3 17 5 3 7 6 6 39 -15 -23 12 15 44 -21 34 -1 55 -9 -3 -8 -9 -8 -11 52 19 40 -16 21 -10 139 -15 -20 -17 -14 -30 43 -11 -14 6 -23 -6 13 10 18 -25 -19 -24 -5 -41 3 -1 4 8 -13 -20 -19 -14 -3 -17 -16 -13 16 -37 -9 -6 8 -28 -28 18 11 30 0 -1 -9 -9 -16 -2 28 -3 -13 -27 41 3 12 -13 15 17 -7 26 30 -26

Departure Delays (in Minutes)

Arrival Delays (in Minutes)