Warning: "continue" targeting switch is equivalent to "break". Did you mean to use "continue 2"? in /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php on line 580

Warning: "continue" targeting switch is equivalent to "break". Did you mean to use "continue 2"? in /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php on line 583

Warning: "continue" targeting switch is equivalent to "break". Did you mean to use "continue 2"? in /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php on line 586

Warning: "continue" targeting switch is equivalent to "break". Did you mean to use "continue 2"? in /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php on line 589

Warning: "continue" targeting switch is equivalent to "break". Did you mean to use "continue 2"? in /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php on line 592

Warning: Cannot modify header information - headers already sent by (output started at /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php:580) in /home/calcul9/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1673

Warning: Cannot modify header information - headers already sent by (output started at /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php:580) in /home/calcul9/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1673

Warning: Cannot modify header information - headers already sent by (output started at /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php:580) in /home/calcul9/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1673

Warning: Cannot modify header information - headers already sent by (output started at /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php:580) in /home/calcul9/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1673

Warning: Cannot modify header information - headers already sent by (output started at /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php:580) in /home/calcul9/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1673

Warning: Cannot modify header information - headers already sent by (output started at /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php:580) in /home/calcul9/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1673

Warning: Cannot modify header information - headers already sent by (output started at /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php:580) in /home/calcul9/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1673

Warning: Cannot modify header information - headers already sent by (output started at /home/calcul9/public_html/wp-content/themes/suffusion/functions/media.php:580) in /home/calcul9/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1673
{"id":1634,"date":"2011-03-04T15:45:29","date_gmt":"2011-03-04T21:45:29","guid":{"rendered":"http:\/\/www.calculatinginvestor.com\/?p=1634"},"modified":"2011-03-04T15:45:29","modified_gmt":"2011-03-04T21:45:29","slug":"performance-evaluation","status":"publish","type":"post","link":"https:\/\/www.calculatinginvestor.com\/2011\/03\/04\/performance-evaluation\/","title":{"rendered":"Passive vs. Active Management: The Importance of Performance Evaluation"},"content":{"rendered":"

<\/a>Can investors reliably pick mutual funds which beat the market?<\/strong><\/p>\n

I am a very big fan of index funds. However, I often hear the argument from my friends and relatives that index investors are content to be \u201caverage\u201d and that smart investors who are well informed and willing to put in a little extra work should be able to \u201cbeat the market\u201d.<\/p>\n

If only it were that easy! There are numerous academic studies showing that, after fees, the average active mutual fund underperforms low cost index funds. These studies also show that there is very little \u201cpersistence\u201d among the mutual funds that have managed to beat the indexes in the past. In other words, we can\u2019t accurately predict which funds which will beat the market in the future by looking at past performance.<\/p>\n

Despite all the evidence in favor of index funds, I find that it is very difficult to change the mind of a diehard believer in active management. Instead, I\u00a0choose to stress the importance of carefully measuring investment performance. I strongly believe that any investor who does not carefully measure and evaluate investment performance is not a serious investor!\u00a0 I have found that most investors who carefully and honestly monitor the performance of their investments and compare this performance to a relevant benchmark will eventually convince themselves that indexing is the way to go.<\/p>\n

Evaluating the Performance of Some Carefully Chosen Mutual Funds<\/strong><\/p>\n

In this post, I\u2019m going to demonstrate two methods for evaluating investment performance. First, I\u2019ll compare the returns of some carefully chosen mutual funds to a broad index benchmark. Next, I\u2019ll do a risk-adjusted evaluation of these same funds using the Fama-French Three Factor model.<\/p>\n

How the Sample Funds were Selected<\/strong><\/p>\n

One very well known and long established list of carefully selected mutual funds is the Forbes Honor Roll<\/a>. This list of 10 mutual funds is published annually, and, according to Forbes, the funds are chosen based on \u201cconsistency and great long-term returns\u201d.<\/p>\n

To keep this analysis simple, I\u2019m going to use only the Top 5 funds from the 2005 Honor Roll list<\/a>. I\u2019ve chosen a 5-year interval as a minimum amount of time to begin to evaluate the performance and risk of the chosen funds.<\/p>\n

5-year Performance of Selected Funds\u00a0vs. Total Stock Market<\/strong><\/p>\n

So, how have the Honor Roll funds from 5-years ago performed? A plot of the total returns (including dividends) of the Top 5 Honor Roll Funds from 2005 is shown here:<\/p>\n

\"\"<\/a><\/p>\n

The bold red line is an index based on the total stock market (VTI). We can see that 3 of 5 funds outperformed the total stock market. Not bad for the Honor Roll!\u00a0 However, a closer look shows that two funds beat the index by a very small margin, and one fund underperformed by a large amount. In fact, an investor who invested an equal amount in each of these Top 5 Honor Roll funds would have underperformed the VTI index by more than 4% over the 5-year period.<\/p>\n

What about risk?<\/strong><\/p>\n

One potential problem with comparing these funds to VTI is that VTI may not be an appropriate benchmark. Some of the funds may take on\u00a0more risk than others, and the returns of the funds should be judged on a risk-adjusted basis.<\/p>\n

For example, most investors believe that stocks are likely to outperform bonds over the long run, but investors still buy bonds in spite of their lower expected returns. Why? Of course, the reason is that stocks are more risky than bonds. Stocks are likely to outperform bonds, but they also have a risk of doing very poorly\u2026even over relatively long horizons. Investors who are not willing to bear this risk will choose bonds over stocks in spite of the fact that returns are likely to be lower.<\/p>\n

Similarly, not all stocks have the same risk\/return characteristics. Some stocks have higher risk and higher expected return. A mutual fund which overweights these risky stocks will tend to have higher returns than the broader market when times are good, but it may also have a higher chance of disaster when the markets are under stress.<\/p>\n

The best way to account for differences in risk is to evaluate funds using an asset pricing model such as the Capital Asset Pricing Model (CAPM) or Fama-French Three Factor (FF3F) model. I prefer the Fama-French model since it does a better job of explaining returns across a wide variety of investment strategies.<\/p>\n

Fama-French Regression Results<\/strong><\/p>\n

The Fama-French Three Factor model regression results are shown here:<\/p>\n

\n\n\n\t\n\t\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t
Fund Name<\/th>Ticker<\/th>Monthly Alpha<\/th>FF-Beta<\/th>FF-s (size)<\/th>FF-h (value)<\/th>R-squared<\/th>\n\t<\/tr>\n<\/thead>\n
Calamos Growth Fund A<\/td>CVGRX<\/td>-0.129%<\/td>1.24<\/td>0.17<\/td>-0.57<\/td>0.93<\/td>\n\t<\/tr>\n\t
Bruce Fund<\/td>BRUFX<\/td>0.168%<\/td>0.61<\/td>0.15<\/td>0.09<\/td>0.66<\/td>\n\t<\/tr>\n\t
Muhlencamp Fund<\/td>MUHLX<\/td>-0.725%*<\/td>0.90<\/td>0.10<\/td>0.11<\/td>0.90<\/td>\n\t<\/tr>\n\t
Mairs&Powers Growth Fund<\/td>MPGFX<\/td>-0.032%<\/td>0.78<\/td>0.18<\/td>0.33<\/td>0.91<\/td>\n\t<\/tr>\n\t
Keeley Small Cap Value Fund<\/td>KSCVX<\/td>-0.148%<\/td>1.18<\/td>0.63<\/td>0.06<\/td>0.91<\/td>\n\t<\/tr>\n<\/tbody>\n<\/table>\n<\/p>\n

Only the Bruce fund has a positive alpha over the 5-year evaluation period.\u00a0 In other words, only\u00a0the Bruce Fund has outperformed after adjusting for\u00a0risk.\u00a0\u00a0Further, the only statistically significant alpha is the negative alpha for the Muhlencamp fund.<\/p>\n

Conclusion<\/strong><\/p>\n

In this post, I’ve demonstrated two basic methods for evaluating the performance of a mutual fund.\u00a0 We can compare the performance to a broad market benchmark, or we can use an asset pricing model to evaluate whether the funds deliver excess returns after accounting for risk.\u00a0 If your investment strategy is underperforming by a meaningful margin when evaluated by either of these two methods, then you might consider switching to a simpler index based portfolio.<\/p>\n

Additional Information:<\/strong><\/p>\n

Data:<\/strong> The data for this analysis was taken from Yahoo! Finance and the Fama-French website.<\/p>\n

Code:<\/strong> The R-code used to run the regressions and generate the plots is shown below.<\/p>\n

\r\n# Goal: Using data from Yahoo finance, estimate the Fama-French Factors for Forbes Honor Roll\r\n# using monthly returns\r\n\r\nlibrary(tseries)\r\n\r\n# Load FF factor returns\r\nstartyear <- 2006\r\nstartmonth <- 1\r\nendyear <- 2010\r\nendmonth <- 12\r\n\r\nstart <- (startyear-1926.5)*12+startmonth\r\nstop <- (endyear - 1926.5)*12+endmonth\r\n\r\nff_returns <- read.table("F-F_Factors_monthly.txt")\r\nrmrf <- ff_returns[start:stop,2]\/100\r\nsmb <- ff_returns[start:stop,3]\/100\r\nhml <- ff_returns[start:stop,4]\/100\r\nrf <- ff_returns[start:stop,5]\/100\r\n\r\n# Load Fund Data\r\nprices1 <- get.hist.quote("CVGRX", quote="Adj", start="2005-12-25", retclass="zoo")\r\nprices2 <- get.hist.quote("BRUFX", quote="Adj", start="2005-12-25", retclass="zoo")\r\nprices3 <- get.hist.quote("MUHLX", quote="Adj", start="2005-12-25", retclass="zoo")\r\nprices4 <- get.hist.quote("MPGFX", quote="Adj", start="2005-12-25", retclass="zoo")\r\nprices5 <- get.hist.quote("KSCVX", quote="Adj", start="2005-12-25", retclass="zoo")\r\n\r\n# Benchmark\r\nprices.vti <- get.hist.quote("VTI", quote="Adj", start="2005-12-25", retclass="zoo")\r\n\r\nprices1 <- na.locf(prices1)               # Copy last traded price when NA\r\nprices2 <- na.locf(prices2)\r\nprices3 <- na.locf(prices3)\r\nprices4 <- na.locf(prices4)\r\nprices5 <- na.locf(prices5)\r\n\r\n# To make monthly returns, you must have this incantation:\r\nmonthly.prices <- aggregate(prices1, as.yearmon, tail, 1)\r\nmonthly.prices2 <- aggregate(prices2, as.yearmon, tail, 1)\r\nmonthly.prices3 <- aggregate(prices3, as.yearmon, tail, 1)\r\nmonthly.prices4 <- aggregate(prices4, as.yearmon, tail, 1)\r\nmonthly.prices5 <- aggregate(prices5, as.yearmon, tail, 1)\r\n\r\n# Benchmark\r\nmonthly.vti <- aggregate(prices.vti, as.yearmon, tail, 1)\r\n\r\n# Convert selected monthly prices into monthly returns to run regression\r\nr <- diff(log(monthly.prices))  # Need to chnage this line to estimate factors for desired fund\r\nr1 <- exp(r)-1\r\n\r\n# Now shift out of zoo into ordinary matrix\r\nrj <- coredata(r1)\r\nrj <- rj[1:60]\r\nrjrf <- rj - rf\r\n\r\nd <- lm(rjrf ~ rmrf + smb + hml)               # FF model estimation.\r\nprint(summary(d))\r\n\r\nseries1 <- 100*(monthly.prices\/coredata(monthly.prices[1])-1)\r\nseries2 <- 100*(monthly.prices2\/coredata(monthly.prices2[1])-1)\r\nseries3 <- 100*(monthly.prices3\/coredata(monthly.prices3[1])-1)\r\nseries4 <- 100*(monthly.prices4\/coredata(monthly.prices4[1])-1)\r\nseries5 <- 100*(monthly.prices5\/coredata(monthly.prices5[1])-1)\r\n\r\nseries.vti <- 100*(monthly.vti\/coredata(monthly.vti[1])-1)\r\n\r\ndates <- 2005+10\/12 + (1:64)\/12\r\nseries <- cbind(series1,series2,series3,series4,series5,series.vti)\r\ndates <- cbind(dates,dates,dates,dates,dates,dates)\r\nmatplot(dates,series,type='l',lty = c(3,4,5,6,2,1),col=c(3,4,5,6,9,2),lwd=c(2,2,2,2,2,5),ylab="",xlab="")\r\nlegend(2006,45,c("CVGRX","BRUFX","MUHLX","MPGFX","KSCVX","VTI"),lty = c(3,4,5,6,2,1),col=c(3,4,5,6,9,2),lwd=c(2,2,2,2,2,5))\r\ntitle("Total Returns of Forbes Honor Roll Funds vs. VTI",xlab="Date",ylab="Percent Gain",cex.main="2.25",cex.lab="1.75")\r\n\r\n<\/pre>\n","protected":false},"excerpt":{"rendered":"

Can investors reliably pick mutual funds which beat the market? I am a very big fan of index funds. However, I often hear the argument from my friends and relatives that index investors are content to be \u201caverage\u201d and that smart investors who are well informed and willing to put in a little extra work […]<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.calculatinginvestor.com\/wp-json\/wp\/v2\/posts\/1634"}],"collection":[{"href":"https:\/\/www.calculatinginvestor.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.calculatinginvestor.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.calculatinginvestor.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.calculatinginvestor.com\/wp-json\/wp\/v2\/comments?post=1634"}],"version-history":[{"count":89,"href":"https:\/\/www.calculatinginvestor.com\/wp-json\/wp\/v2\/posts\/1634\/revisions"}],"predecessor-version":[{"id":1728,"href":"https:\/\/www.calculatinginvestor.com\/wp-json\/wp\/v2\/posts\/1634\/revisions\/1728"}],"wp:attachment":[{"href":"https:\/\/www.calculatinginvestor.com\/wp-json\/wp\/v2\/media?parent=1634"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.calculatinginvestor.com\/wp-json\/wp\/v2\/categories?post=1634"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.calculatinginvestor.com\/wp-json\/wp\/v2\/tags?post=1634"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}