Guest Post: Beat the Instructor–A Great Classroom Forecasting Exercise

brent sniderOur Guest Post today comes from Brent Snider, who is an award winning instructor of Operations Management at the University of Calgary’s Haskayne School of Business.

Forecasting is covered late in the term in our required undergrad course, which may contribute to student apathy towards the topic.  Beat the Instructor was developed after recognizing that there were no spreadsheet-based experiential introductory exercises that have been shown to build significant student interest in learning forecasting techniques.

Most forecasting exercises tend to be highly technical and or intended to be used after forecasting techniques have already been introduced in lectures.  Beat the Instructor is an in-class game that enables student groups to compete against their instructor in an introductory time-series forecasting exercise, even before any lecture content has been covered.  In addition to starting the forecasting topic positively via a 30 minute hands-on experiential learning exercise, the game has proven to build strong student interest in learning the forecasting techniques that are covered later in the lecture.

beat the instructor graphStudent groups are provided a spreadsheet with historical demand for 12 previous periods for 4 separate items.  Each of the 4 items represents one of the classical demand patterns of trend, cycles, seasonality, and random variations.  The students are then asked to predict demand for the next 6 periods for each item, and submit their forecast to the instructor.  In addition to competing amongst themselves, student groups are challenged to outperform the instructor’s forecast (who also predicts demand using the techniques that will be subsequently covered).  Each group’s forecast is graphed, in addition to the instructor’s, creating anticipation for the actual demand pattern.  After actual demand is randomly generated (and revealed on the graph), each group’s forecast error is calculated and ranked.  Typically the instructor outperforms most if not all groups, generating student interest in learning the techniques that can answer their often posed question: “How did you forecast so well?”

Guest Post: A Great Classroom Forecasting Exercise

steve harrodDr. Steven Harrod is Assistant Professor of Operations Management at the University of Dayton and can be reached at steven.harrod@udayton.edu. This is his 3rd guest post for our OM blog.

This large data set, Excel based, forecasting exercise is suitable for an hour lecture, after students have learned basic time series forecast methods in Chapter 4 of the Heizer/Render text. It gives a “real world” experience, and provides an excellent opportunity to visual the significance of error statistics in more detail. Here are instructions:

  1. Distribute the data (here is the link), but do not reveal its source.
  2. Ask the students to experiment (in Excel or Excel OM) by implementing a variety of time series forecast methods (moving average, exponential, etc.). Provide guidance, as you prefer. Give the students time to work independently (or at least in groups without you lecturing).
  3. Intermittently reveal your own progress in completing the steps on a projection screen. In a typical lecture period, you should be able to progress through two or three forecast models, and then pick one of those for error statistics.
  4. Discuss picking a “best” model according to error statistics (MAD, MSE, etc.).
  5. Pick one model, and demonstrate the calculation of the tracking signal. Chart this signal.

For discussion, ask: What are the data? Why is the tracking signal spiking? Reveal that the data are the recorded miles per gallon of a minivan at each fuel tank filling for a period of about two years. The tracking signal is spiking because the family takes vacations, and the mileage shifts from city driving to highway driving. When the tracking signal spikes, it is an indication that some fundamental change has occurred in the underlying process. The tracking signal measures whether the underlying process of the series data is stable. Since a forecast is simply the generation of a trend from a series of data points, the methodology is dependent on the underlying process being stable. If the underlying process is not stable, or experiencing a fundamental change in behavior, the forecast can not accurately predict the trend.

Good OM Reading: Analytics at Disney World

Here in the tourist mecca of Orlando, Disney World reigns as king. With 60,000 employees (called “cast members”), Disney is a driving force not just in our economy, but in the use of operations management tools. Analytics (Sept.-Oct. 2012) has a great piece on the careful planning guests don’t see taking place “behind the scenes” to run the operation smoothly. The article examines the role analytics plays in ensuring the guest experience is maximized. It makes a nice supplement to our text coverage of Disney in both the forecasting (Ch.4) and waiting line (Module D) chapters.

The authors write: “Forecasting serves as the analytical foundation for operations planning at the Resort. It all starts with the park attendance forecast, which lays out the expected attendance at each park. These predictions are strongly considered when setting park hours and performing other strategic planning. More granular forecasts are required for each individual area, such as guest arrivals at the hotel front desks. The company recently launched a new labor demand planning system, which generates forecasts for every 15-minute period at many locations throughout the property, including park entry turnstiles, quick-service restaurants and merchandise locations. These forecasts help the resort plan labor effectively to ensure guest service standards are met”.

Another innovative way the resort uses forecasting is for attraction wait times. The most popular attractions use Disney’s FASTPASS system – a unique virtual queueing system that allows guests to receive a ticket with a designated 1-hour window of time when they can return and skip the regular line. From a central command center underneath the Magic Kingdom, forecasting models are executed every 5-10 minutes to project the return patterns of FASTPASS guests based on entertainment schedules and the number of FASTPASS tickets that have been distributed. The forecasts are posted at the front of the attractions to help guests choose whether to enter the line, take a FASTPASS ticket or return to the attraction later in the day. These wait times are also available on Disney’s Mobile Magic smart phone app, which shares real-time information about the parks throughout the day.

I think your students may also enjoy reading this down-to-earth article.

Guest Post: How I Teach Forecasting at Temple U.

Professor Howard Weiss at Temple University’s Fox School of Business writes about how he uses software to teach forecasting. Howard, the developer of both Excel OM and POM for Windows,  is also Academic Director of  Temple’s EMBA program.

For several years, I have been assigning my students a forecasting project using data from their company.  Since I want students to learn about seasonality, I require the data  must be four complete cycles of the measurement. That is, I ask for 48 months, 16 quarters, 20 or 28 days, or 8 or 24 hours over 4 days. Most students are able to obtain data from their company and for those who cannot I ask them to find acceptable data on the web or ask a classmate for data.

I have the students  first present three graphs: a graph of the data over 48 months, a graph of the annual data over the 4 years, and a stacked graph of the data over 12 months for each of the 4 years. For the first two graphs, I have them apply Excel’s easy-to-use option to identify the trend line. I also ask the students to identify the ratio of the trends. They expect annual to monthly trend to be near 12, and are surprised when it is closer to 144. I have the  students use the stacked graph to identify seasonality.

I then require the students to run their data through most of the models in the Heizer-Render textbook. Using POM for Windows (which comes free with the book), it is very easy to change from model to model, to determine the best n for moving averages and the best alpha for exponential smoothing. It also is straightforward to run the decomposition methods that are in POM, which will determine seasonal factors as in the textbook.  For each model, students are to identify the bias, MAD, MSE, standard error, and MAPE –and select the best forecasting method based on the error measures. Finally, using the method they have selected, I ask them to identify forecasts for the next 12 months and the seasonal factors for each month.

The students very much like applying forecasting to data from their own company. They  also appreciate the value of the graphs, the ease in changing from one method to another in POM, and that the different methods will yield different results.

Video Tip: Forecasting at Hard Rock Cafe

It’s hard to motivate students about how important forecasting is in OM with common examples like IBM’s stock price, Dell sales, or housing starts. So in Ch.4 we have two tools to help set the stage. The first is the Global Company Profile featuring Disney World.  Disney does detailed daily, weekly, monthly, annual, and 5-year forecasts of park attendance, with a staff of 35 analyzing a whole flock of interesting variables. The second tool is the 8-min. video case study we created on how Hard Rock Cafe uses forecasting.

Students like the Hard Rock video not only because the company is “cool”, but because the applications of moving averages and regression are clever and thoughtful. For example,  multiple regression is used to estimate the price elasticity of each menu item. Hard Rock is able to estimate the impact of a $1 price increase of cheeseburgers on sales of chicken sandwiches and margaritas.

The weighted moving average technique is used to set sales and bonus targets for store managers. The company also uses exponential smoothing and other models to forecast daily sales/food needs, purchasing needs, and borrowing needs. A good lead-in to the video is to ask students what they think Hard Rock needs to forecast with mathematical models.

OM in the News: The Challenge of Forecasting Electric Car Demand

If only we had a nice time series of data to use in forecasting demand for the relatively new product like electric cars!  We could take several of the quantitative  models in Chapter 4, Forecasting, and present a report complete with error measures such as MAD.

But when the product is heavily promoted battery-powered vehicles about to appear on roads around the world, such math models do not apply. We talk about 4 qualitative methods in the chapter, and these become our toolbox. Most forecasting firms, as we see in The Wall Street Journal (Oct.28,2010), turn to consumer market surveys to predict sales through 2020.

J.D.Power, for example, thinks sales will remain low and be only a small slice of the global market even a decade down the road. That firm puts the combined forecast of hybrids (such as the Toyota Prius) and all-electric models (like the Nissan Leaf) at 5.2 million cars in 2020. This is just 7.3% of all 70.9 million passenger vehicles to be sold by then.

Boston Consulting Group, in its separate study, forecasts hybrid and electric autos making up 26% of the 2020 global market. PRTM, yet another forecasting group, estimates the total at 30% of the market. PRTM thinks battery prices will fall enough to make prices the same as standard models.

Why the huge spread? “Based on our research of consumer market attitudes towards these technologies, we don’t anticipate a mass migration to green vehicles in the coming decade”‘ says one J.D. Powers VP. “Everybody feels that everybody else should be driving environmentally friendly vehicles”, says another Powers VP. But the  CEO  of a different firm states, “I think we might be underestimating the enthusiasm of the customers”.

Discussion questions:

1. Discuss the dangers of using consumer market surveys to forecast.

2. How have firms forecast the demand for other new products, like color TVs or HDTVs?

3. What could have a major impact on buyers’  behavior?