stocks.jpgIt amazes me what people will believe.

Stock market data going back 200 years?

I remember shaking my head in 1994 when Jeremy Siegel came out with “Stocks for the Long Run.” Using data collated by others, “Stocks for the Long Run” purported to show that since 1802, “stocks have generated a remarkably constant” average return of 7% a year after adjusting for inflation. (Add 3% inflation and you get the all too common concept of a virtually guaranteed 10% annual return on stocks over the long run.)

How valid can data be going back 200 years? Not very! (See The Wall Street Journal “Intelligent Investor” column below for excellent debunking of said data.) You’d think a professor from The Wharton School of Business would know better. And yet the contents of his book became articles of faith for many investors who basked in a belief that the long arm of history was inevitably on their side if they just could wait long enough.

The further you go back for data, the more imprecise information becomes. At some point conditions change so much that attempting to compare data can become useless. Going back more than 75 years for U.S. economic data becomes problematic. Are you truly comparing apples to apples? Even back just 60 years, staying in the post-World War II era, has its challenges. Technology and globalization are just two macro trends that have had incredible impact.

The past is at best an imperfect guide to the future; there is no certainty. Fancy titles from far off places are no guarantees of genius and even genius is no guarantee of correctness.

Always ask: What if “they” are just as human as I am? What if “they” are wrong? What will I do then? What is my back-up plan? How will I and those I’m responsible for survive. How will “me and mine” prosper?

So often people are accepted as virtually infallible experts based too much upon the power of their personalities. Intelligent people with a strong internal sense of certainty can be extremely persuasive. Basking in the radiance of someone’s powerful confidence definitely makes us feel warm, safe, and secure. But when we surrender our sense of skepticism, when we mute our personal independent inquires, we run the grave risk of committing serious errors of judgement.

Beware the Pied Piper. Beware the Emperor in his new finery. Beware the acclaim of the crowds. Think for yourself.

_____________

Does Stock-Market Data Really Go Back 200 Years?
By JASON ZWEIG
The Wall Street Journal
July 11, 2009

As of June 30, U.S. stocks have underperformed long-term Treasury bonds for the past five, 10, 15, 20 and 25 years.

Still, brokers and financial planners keep reminding us, there’s almost never been a 30-year period since 1802 when stocks have underperformed bonds.

These true believers rely on the gospel of “Stocks for the Long Run,” the book by finance professor Jeremy Siegel of the Wharton School at the University of Pennsylvania that was first published in 1994.

Using data assembled by other scholars, Prof. Siegel extended the history of U.S. stock returns all the way back to 1802. He came to two conclusions that became articles of faith to millions of investors: Ever since Thomas Jefferson was in the White House, stocks have generated a “remarkably constant” average return of nearly 7% a year after inflation. (Adding inflation at 3% yields the commonly cited 10% annual stock return.) And, declared Prof. Siegel, “the risks of holding stocks decrease over time.”

There is just one problem with tracing stock performance all the way back to 1802: It isn’t really valid.

Prof. Siegel based his early numbers on data first gathered decades ago by two economists, Walter Buckingham Smith and Arthur Harrison Cole.

For the years 1802 through 1820, Profs. Smith and Cole collected prices on three dozen banking, insurance, transportation and other stocks — but ended up including only seven, all banks, in their stock-market index. Through 1845, they tracked 19 insurance stocks, but rejected 95% of them, adding only one to their index. For 1834 onward, they added a maximum of 27 railroad stocks.

To be a good measure of stock returns, an index should be comprehensive (by including many stocks) and representative (by including the stocks commonly held by investors). The Smith and Cole indexes are neither, as the professors signaled in their 1935 book, “Fluctuations in American Business.” They cherry-picked their indexes by throwing out any stock that didn’t survive for the whole period, whose share prices were too hard to find or whose returns seemed “inflexible,” “erratic,” or “non-typical.”

The database of early U.S. securities at EH.net has so far identified more than 1,000 stocks that were listed on 10 different exchanges — including Charleston, S.C., New Orleans, and Norfolk, Va. — between 1790 and 1860. Thus the indexes relied on by Prof. Siegel exclude 97% of all the stocks that existed in the earliest years of the U.S. market, and include only the bluest of the blue-chip survivors. Never mind all of the canals, wooden turnpikes, rubber-hat companies and the other doomed stocks that investors lost millions on — and whose returns may never be reconstructed.

There is a second problem with Prof. Siegel’s data.

In an article published in 1992, he estimated the average annual dividend yield from 1802-1870 at 5.0%. Two years later in his book, it had grown to 6.4% — raising the average annual return in the early years from 5.7% to 7.0% after inflation.

Why does that matter? By using the higher number for the earlier period, Prof. Siegel appears to have raised his estimate of the rate of return for the entire period by about half a percentage point annually.

Prof. Siegel calculated in his 1992 article that $1 invested in stocks in 1802 would have grown, after inflation, to $86,100 by 1990. In his book just two years later, however, he estimated that $1 in 1802 would have mushroomed into $260,000 by 1992. But in 1991 and 1992, stocks gained 30.5% and 7.6%, respectively, which should have taken the cumulative return up to only about $121,000. Nearly all of that huge difference seems to have come from Prof. Siegel’s revised number for early dividends.

“I made an estimate of the dividend yield,” Prof. Siegel told me, “through looking at a smaller set of securities and projecting it out.” Money manager Robert Arnott of Research Affiliates LLC has recently estimated the early dividend yield at 5.2%. “Arnott has a much lower estimate, and that’s a big difference,” said Prof. Siegel. “I mean, I don’t know what more to say.”

I later called Prof. Siegel to ask him again about the difference between his original research and his book, but he didn’t get back to me by press time.

What, then, are the odds that stocks will continue to lag behind bonds for the long run? The sad truth is that history can’t tell us the answer. The 1802-to-1870 stock indexes are rotten with methodological flaws. So we have only the period since then, or four distinct and complete 30-year stretches of stock returns, to base our long-term investment decisions on.

Another emperor of the late bull market, it seems, has turned out to have no clothes.