Skip to main content
Top
Published in: Financial Markets and Portfolio Management 1/2022

26-04-2021

State-dependent stock selection in index tracking: a machine learning approach

Authors: Reza Bradrania, Davood Pirayesh Neghab, Mojtaba Shafizadeh

Published in: Financial Markets and Portfolio Management | Issue 1/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We focus on the stock selection step of the index tracking problem in passive investment management and incorporate constant changes in the dynamics of markets into the decision. We propose an approach, using machine learning techniques, which analyses the performance of the selection methods used in previous market states and identifies the one that gives the optimal tracking portfolio in each period. We apply the proposed procedure using the popular cointegration technique in index tracking and show that it tracks the S&P 500 with a very high level of accuracy. The empirical evidence shows that our proposed approach outperforms cointegration techniques that use a single criterion (e.g., stocks with the maximum market capitalization) in the asset selection.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
For example, at the end of August 2019, passive US stock funds managed $4.27 trillion—slightly more than the $4.25 trillion in actively managed US stock funds (www.​reuters.​com). This means index funds now control half the US stock mutual fund market.
 
2
For example, see Malkiel (1995), Moskowitz (2000), Kosowski (2011) and Kacperczyk et al. (2014), among others.
 
3
For example, Alexander and Dimitriu (2004) propose a model to compose an optimal tracking portfolio using principal component analysis in the stock returns. Focardi and Fabozzi (2004) choose a clustering-based methodology to compose an optimal tracking portfolio, in which Euclidean distances among stock price series are employed for clustering. Corielli and Marcellino (2006) use several factors by employing a heuristic selection to compose a tracking portfolio that discards long-term factors that could result in tracking error. Wu et al. (2007) use a goal programming approach by defining appropriate values for both the tracking error and its volatility. Canakgoz and Beasley (2009) and Li et al. (2011) use multi-objective optimization to maximize return and minimize tracking error. One of the most common approaches is the cointegration technique, in which the index is developed based on historical data on the long-term relationships between the subsets of stocks constituting the portfolio (e.g., Alexander and Dimitriu (2002, 2005a).
 
4
Other studies that use market capitalization include Meade and Salkin (1990), Bamberg and Wagner (2000), among others.
 
5
Some of the economic variables for mean predictability include term spread (Campbell 1987; Fama and French 1988, 1989; Ferson and Harvey (1991)), default spread (Fama and French 1988, 1989; Keim and Stambaugh 1986) and Treasury bill yield (Fama and Schwert 1977; Ferson and Harvey 1991). The variables for predicting variances include lagged squared return and/or lagged variance (Bollerslev 1986; Engle 1982; French et al. 1987; Harvey 2001; Schwert 1989; Whitelaw 1994), default spread (Harvey 2001; Whitelaw 1994), dividend yield (Harvey 2001) and debt-to-equity ratio (Schwert 1989). Finally, the predictability of covariances is attributed to variables such as lagged covariances, lagged cross-products of returns (Bollerslev et al. 1988), term spread (Campbell 1987; Harvey 2001), default spread and dividend yield (Harvey 2001).
 
6
Correlation can be very sensitive to the presence of outliers and is only a short-term statistic and lacks stability. However, since both cointegration and correlation approaches stand out for the index tracking problem, Alexander and Dimitriu (2005a) present a study focused on comparing the two methods, and the results are similar for both. Sant’Anna et al. (2016) attempt to compare correlation and cointegration using IT strategy. This comparison is similar to that carried out by Alexander and Dimitriu (2005a) for IT and long-short strategies.
 
7
A sigmoid function that generates output values between 0 and 1.
 
8
Some of these state variables include Term Spread (Campbell 1987; Fama and French 1988, 1989; Ferson and Harvey 1991), Default Spread (Fama and French 1988, 1989; Keim and Stambaugh 1986) and Treasury Bill Yield (Fama and Schwert 1977; Ferson and Harvey 1991). Default Spread (Harvey 2001; Whitelaw 1994), Dividend Yield (Harvey 2001) and Debt-to-Equity ratio (Schwert 1989).
 
9
We de-seasonalize Unemployment Rate, Industrial Production Index and Consumer Price Index by applying the first difference method.
 
10
The DAX, as the Germany's primary stock index, includes the 30 largest companies that trade on the Frankfurt Stock Exchange.
 
11
Our findings are not sensitive to the length of in- or out-of-sample periods. Results based on various choices are available upon request.
 
12
We follow previous studies and use different numbers of stocks in TPs to show how our proposed approach works in different size scenarios. The exact number of stocks used in tracking portfolios varies in these studies, even for the same index. For example, Alexander and Dimitriu (2005a) use 20, 25 and 30 stocks to track DJIA index which includes 30 stocks. Filbeck and Visscher (1997) select ten stocks to track FTSE 100, whereas Rafaely and Bennell (2006) use between five to 30 stocks to track the same index. Meade and Salkin (1990) use 25 stocks to track FT500 index, and Zheng et al. (2020) use 30, 40 and 50 stocks to construct their tracking portfolios to track S&P 500 index.
 
Literature
go back to reference Acosta-González, E., Armas-Herrera, R., Fernández-Rodríguez, F.: On the index tracking and the statistical arbitrage choosing the stocks by means of cointegration: the role of stock picking. Quant. Finance 15(6), 1075–1091 (2015)CrossRef Acosta-González, E., Armas-Herrera, R., Fernández-Rodríguez, F.: On the index tracking and the statistical arbitrage choosing the stocks by means of cointegration: the role of stock picking. Quant. Finance 15(6), 1075–1091 (2015)CrossRef
go back to reference Ait-Sahali, Y., Brandt, M.W.: Variable selection for portfolio choice. J. Financ. 56(4), 1297–1351 (2001)CrossRef Ait-Sahali, Y., Brandt, M.W.: Variable selection for portfolio choice. J. Financ. 56(4), 1297–1351 (2001)CrossRef
go back to reference Alexander, C.: Optimal hedging using cointegration. Philos. Trans. R. Soc. Ser. A 357(1758), 2039–2058 (1999)CrossRef Alexander, C.: Optimal hedging using cointegration. Philos. Trans. R. Soc. Ser. A 357(1758), 2039–2058 (1999)CrossRef
go back to reference Alexander, C., Dimitriu, A.: The cointegration alpha: enhanced index tracking and long-short equity market neutral strategies. In: ISMA Discussion Papers in Finance, vol. 8 (2002) Alexander, C., Dimitriu, A.: The cointegration alpha: enhanced index tracking and long-short equity market neutral strategies. In: ISMA Discussion Papers in Finance, vol. 8 (2002)
go back to reference Alexander, C., Dimitriu, A.: Sources of over-performance in equity markets. J. Portf. Manag. 30(4), 170–185 (2004)CrossRef Alexander, C., Dimitriu, A.: Sources of over-performance in equity markets. J. Portf. Manag. 30(4), 170–185 (2004)CrossRef
go back to reference Alexander, C., Dimitriu, A.: Indexing and statistical arbitrage: tracking error or cointegration? J. Portf. Manag. 31(2), 50–63 (2005a)CrossRef Alexander, C., Dimitriu, A.: Indexing and statistical arbitrage: tracking error or cointegration? J. Portf. Manag. 31(2), 50–63 (2005a)CrossRef
go back to reference Alexander, C., Dimitriu, A.: Indexing, cointegration and equity market regimes. Int. J. Financ. Econ. 10(3), 213–231 (2005b)CrossRef Alexander, C., Dimitriu, A.: Indexing, cointegration and equity market regimes. Int. J. Financ. Econ. 10(3), 213–231 (2005b)CrossRef
go back to reference Alpaydin, E.: Introduction to Machine Learning (Adaptive Computation and Machine Learning). The MIT Press, London (2004) Alpaydin, E.: Introduction to Machine Learning (Adaptive Computation and Machine Learning). The MIT Press, London (2004)
go back to reference Bamberg, G., Wagner, N.: Equity index replication with standard and robust regression estimators. OR Spectr. 22(4), 525–543 (2000)CrossRef Bamberg, G., Wagner, N.: Equity index replication with standard and robust regression estimators. OR Spectr. 22(4), 525–543 (2000)CrossRef
go back to reference Bollerslev, T.: Generalized autoregressive conditional heteroskedasticity. J. Economet. 31(3), 307–327 (1986)CrossRef Bollerslev, T.: Generalized autoregressive conditional heteroskedasticity. J. Economet. 31(3), 307–327 (1986)CrossRef
go back to reference Bollerslev, T., Engle, R.F., Wooldridge, J.M.: A capital asset pricing model with time-varying covariances. J. Polit. Econ. 96(1), 116–131 (1988)CrossRef Bollerslev, T., Engle, R.F., Wooldridge, J.M.: A capital asset pricing model with time-varying covariances. J. Polit. Econ. 96(1), 116–131 (1988)CrossRef
go back to reference Campbell, J.Y.: Stock returns and the term structure. J. Financ. Econ. 18(2), 373–399 (1987)CrossRef Campbell, J.Y.: Stock returns and the term structure. J. Financ. Econ. 18(2), 373–399 (1987)CrossRef
go back to reference Canakgoz, N.A., Beasley, J.E.: Mixed-integer programming approaches for index tracking and enhanced indexation. Eur. J. Oper. Res. 196, 384–399 (2009)CrossRef Canakgoz, N.A., Beasley, J.E.: Mixed-integer programming approaches for index tracking and enhanced indexation. Eur. J. Oper. Res. 196, 384–399 (2009)CrossRef
go back to reference Chen, J.-H., Huang, C.-Y.: An analysis of the spillover effects of exchange-traded funds. Appl. Econ. 42(9), 1155–1168 (2010)CrossRef Chen, J.-H., Huang, C.-Y.: An analysis of the spillover effects of exchange-traded funds. Appl. Econ. 42(9), 1155–1168 (2010)CrossRef
go back to reference Chiang, W.: Optimizing performance. In: Neubert, A. (ed.) Indexing for Maximum Investment Results. GPCo Publishers, Chicago (1998) Chiang, W.: Optimizing performance. In: Neubert, A. (ed.) Indexing for Maximum Investment Results. GPCo Publishers, Chicago (1998)
go back to reference Corielli, F., Marcellino, M.: Factor based index tracking. J. Bank. Finance 30(8), 2215–2233 (2006)CrossRef Corielli, F., Marcellino, M.: Factor based index tracking. J. Bank. Finance 30(8), 2215–2233 (2006)CrossRef
go back to reference Dose, C., Cincotti, S.: Clustering of financial time series with application to index and enhanced index tracking portfolio. Physica A Stat. Mech. Appl. 1(355), 145–151 (2005)CrossRef Dose, C., Cincotti, S.: Clustering of financial time series with application to index and enhanced index tracking portfolio. Physica A Stat. Mech. Appl. 1(355), 145–151 (2005)CrossRef
go back to reference Dunis, C.L., Ho, R.: Cointegration portfolios of European equities for index tracking and market neutral strategies. J. Asset Manag. 6(1), 33–52 (2005)CrossRef Dunis, C.L., Ho, R.: Cointegration portfolios of European equities for index tracking and market neutral strategies. J. Asset Manag. 6(1), 33–52 (2005)CrossRef
go back to reference Engle, R.F.: Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation. Economet: J. Economet. Soc. 50(4), 987–1007 (1982) Engle, R.F.: Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation. Economet: J. Economet. Soc. 50(4), 987–1007 (1982)
go back to reference Engle, R.F., Granger, C.: Cointegration and error correction: Representation estimation and testing. Econometrica 55, 251–276 (1987)CrossRef Engle, R.F., Granger, C.: Cointegration and error correction: Representation estimation and testing. Econometrica 55, 251–276 (1987)CrossRef
go back to reference Fama, E.F., French, K.R.: Dividend yields and expected stock returns. J. Financ. Econ. 22(1), 3–25 (1988)CrossRef Fama, E.F., French, K.R.: Dividend yields and expected stock returns. J. Financ. Econ. 22(1), 3–25 (1988)CrossRef
go back to reference Fama, E.F., French, K.R.: Business conditions and expected returns on stocks and bonds. J. Financ. Econ. 25(1), 23–49 (1989)CrossRef Fama, E.F., French, K.R.: Business conditions and expected returns on stocks and bonds. J. Financ. Econ. 25(1), 23–49 (1989)CrossRef
go back to reference Fama, E.F., Schwert, G.W.: Asset returns and inflation. J. Financ. Econ. 5(2), 115–146 (1977)CrossRef Fama, E.F., Schwert, G.W.: Asset returns and inflation. J. Financ. Econ. 5(2), 115–146 (1977)CrossRef
go back to reference Ferson, W.E., Harvey, C.R.: The variation of economic risk premiums. J. Polit. Econ. 99(2), 385–415 (1991)CrossRef Ferson, W.E., Harvey, C.R.: The variation of economic risk premiums. J. Polit. Econ. 99(2), 385–415 (1991)CrossRef
go back to reference Filbeck, G., Visscher, S.: Dividend yield strategies in the British stock market. Eur. J. Financ. 3(4), 277–289 (1997)CrossRef Filbeck, G., Visscher, S.: Dividend yield strategies in the British stock market. Eur. J. Financ. 3(4), 277–289 (1997)CrossRef
go back to reference Focardi, S., Fabozzi, F.: A methodology for index tracking based on time-series clustering. Quant. Finance 4(4), 417–425 (2004)CrossRef Focardi, S., Fabozzi, F.: A methodology for index tracking based on time-series clustering. Quant. Finance 4(4), 417–425 (2004)CrossRef
go back to reference French, K.R., Schwert, G.W., Stambaugh, R.F.: Expected stock returns and volatility. J. Financ. Econ. 19(1), 3–29 (1987)CrossRef French, K.R., Schwert, G.W., Stambaugh, R.F.: Expected stock returns and volatility. J. Financ. Econ. 19(1), 3–29 (1987)CrossRef
go back to reference Frino, A., Gallagher, D.R.: Tracking S&P500 index funds. J. Portf. Manag. 28(1), 44–55 (2001)CrossRef Frino, A., Gallagher, D.R.: Tracking S&P500 index funds. J. Portf. Manag. 28(1), 44–55 (2001)CrossRef
go back to reference Fu, X.Y., Du, J.H., Guo, Y.F., Liu, M.W., Dong, T., Duan, X.W.: A machine learning framework for stock selection. Working paper, Sun Yat-sen University. Unpublished (2018) Fu, X.Y., Du, J.H., Guo, Y.F., Liu, M.W., Dong, T., Duan, X.W.: A machine learning framework for stock selection. Working paper, Sun Yat-sen University. Unpublished (2018)
go back to reference Harvey, C.R.: The specification of conditional expectations. J. Empir. Financ. 8(5), 573–637 (2001)CrossRef Harvey, C.R.: The specification of conditional expectations. J. Empir. Financ. 8(5), 573–637 (2001)CrossRef
go back to reference Heaton, J.B., Polson, R.F., Witte, J.H.: Deep learning in finance. arXiv: 1602.06561 (2016) Heaton, J.B., Polson, R.F., Witte, J.H.: Deep learning in finance. arXiv: 1602.06561 (2016)
go back to reference Jareno, F., Tolentino, M., Negrut, L.: A Straightforward Analysis of Sector Portfolios in the US Stock Market. Appl. Economet. Int. Dev. Euro Am. Assoc. Econ. Dev. 16(1), 105–114 (2016) Jareno, F., Tolentino, M., Negrut, L.: A Straightforward Analysis of Sector Portfolios in the US Stock Market. Appl. Economet. Int. Dev. Euro Am. Assoc. Econ. Dev. 16(1), 105–114 (2016)
go back to reference Kacperczyk, M., Van Nieuwerburgh, S., Veldkamp, L.: Time-varying fund manager skill. J. Finance 69, 1455–1484 (2014)CrossRef Kacperczyk, M., Van Nieuwerburgh, S., Veldkamp, L.: Time-varying fund manager skill. J. Finance 69, 1455–1484 (2014)CrossRef
go back to reference Keim, D.B., Stambaugh, R.F.: Predicting returns in the stock and bond markets. J. Financ. Econ. 17(2), 357–390 (1986)CrossRef Keim, D.B., Stambaugh, R.F.: Predicting returns in the stock and bond markets. J. Financ. Econ. 17(2), 357–390 (1986)CrossRef
go back to reference Kosowski, R.: Do mutual funds perform when it matters most to investors? Us mutual fund performance and risk in recessions and expansions. Q. J. Financ. 1, 607–664 (2011)CrossRef Kosowski, R.: Do mutual funds perform when it matters most to investors? Us mutual fund performance and risk in recessions and expansions. Q. J. Financ. 1, 607–664 (2011)CrossRef
go back to reference Larsen, G.A., Renick, B.: Empirical insights on indexing. J. Portf. Manag. 25(1), 51–60 (1998)CrossRef Larsen, G.A., Renick, B.: Empirical insights on indexing. J. Portf. Manag. 25(1), 51–60 (1998)CrossRef
go back to reference Li, B., Pi, D.: Learning deep neural networks for node classification. Expert Syst. Appl. 137, 324–334 (2019)CrossRef Li, B., Pi, D.: Learning deep neural networks for node classification. Expert Syst. Appl. 137, 324–334 (2019)CrossRef
go back to reference Li, Q., Sun, L., Bao, L.: Enhanced index tracking based on multi-objective immune algorithm. Expert Syst. Appl. 38(5), 6101–6106 (2011)CrossRef Li, Q., Sun, L., Bao, L.: Enhanced index tracking based on multi-objective immune algorithm. Expert Syst. Appl. 38(5), 6101–6106 (2011)CrossRef
go back to reference Malkiel, B.G.: Returns from investing in equity mutual funds 1971 to1991. J. Finance 50(2), 549–572 (1995)CrossRef Malkiel, B.G.: Returns from investing in equity mutual funds 1971 to1991. J. Finance 50(2), 549–572 (1995)CrossRef
go back to reference Meade, N., Salkin, G.R.: Developing and maintaining an equity index fund. J. Oper. Res. Soc.. 41(7), 599–607 (1990)CrossRef Meade, N., Salkin, G.R.: Developing and maintaining an equity index fund. J. Oper. Res. Soc.. 41(7), 599–607 (1990)CrossRef
go back to reference Montfort, K., Visser, E., Van Draat, L.F.: Index tracking by means of optimized sampling. J. Portf. Manag. 34(2), 143–152 (2008)CrossRef Montfort, K., Visser, E., Van Draat, L.F.: Index tracking by means of optimized sampling. J. Portf. Manag. 34(2), 143–152 (2008)CrossRef
go back to reference Moskowitz, T.J.: Mutual fund performance: an empircal decomposition into stock-picking talent, style, transaction costs, and expenses: discussion. J. Finance 55, 1695–1703 (2000)CrossRef Moskowitz, T.J.: Mutual fund performance: an empircal decomposition into stock-picking talent, style, transaction costs, and expenses: discussion. J. Finance 55, 1695–1703 (2000)CrossRef
go back to reference Oh, K.J., Kim, T.Y., Min, S.: Using genetic algorithm to support portfolio optimization for index fund management. Expert Syst. Appl. 28, 371–379 (2005)CrossRef Oh, K.J., Kim, T.Y., Min, S.: Using genetic algorithm to support portfolio optimization for index fund management. Expert Syst. Appl. 28, 371–379 (2005)CrossRef
go back to reference Ouyang, H., Zhang, X., Yan, H.: Index tracking based on deep neural network. Cogn. Syst. Res. 57, 107–114 (2019)CrossRef Ouyang, H., Zhang, X., Yan, H.: Index tracking based on deep neural network. Cogn. Syst. Res. 57, 107–114 (2019)CrossRef
go back to reference Rafaely, B., Bennell, J.A.: Optimisation of FTSE 100 tracker funds: a comparison of genetic algorithms and quadratic programming. Manag. Financ. 32(6), 477–492 (2006) Rafaely, B., Bennell, J.A.: Optimisation of FTSE 100 tracker funds: a comparison of genetic algorithms and quadratic programming. Manag. Financ. 32(6), 477–492 (2006)
go back to reference Rojas, R.: Neural networks: a systematic introduction. Springer Science& Business Media (2013) Rojas, R.: Neural networks: a systematic introduction. Springer Science& Business Media (2013)
go back to reference Roll, R.: A mean/variance analysis of tracking error. J. Portf. Manag. 18(4), 13–22 (1992)CrossRef Roll, R.: A mean/variance analysis of tracking error. J. Portf. Manag. 18(4), 13–22 (1992)CrossRef
go back to reference Sant’Anna, L. R., Filomena, T. P., and Caldeira, J. F. : Index tracking and enhanced indexing using cointegration and correlation with endogenous portfolio selection. Q. Rev. Econ. Finance 65, 146–157 (2016)CrossRef Sant’Anna, L. R., Filomena, T. P., and Caldeira, J. F. : Index tracking and enhanced indexing using cointegration and correlation with endogenous portfolio selection. Q. Rev. Econ. Finance 65, 146–157 (2016)CrossRef
go back to reference Schwert, G.W.: Why does stock market volatility change over time? J. Financ. 44(5), 1115–1153 (1989)CrossRef Schwert, G.W.: Why does stock market volatility change over time? J. Financ. 44(5), 1115–1153 (1989)CrossRef
go back to reference Tsang, K.H., Wong, H.Y.: Deep-learning solution to portfolio selection with serially-dependent returns. Working paper, The Chinese University of Hong Kong (CUHK). Unpublished (2019) Tsang, K.H., Wong, H.Y.: Deep-learning solution to portfolio selection with serially-dependent returns. Working paper, The Chinese University of Hong Kong (CUHK). Unpublished (2019)
go back to reference Whitelaw, R.F.: Time variations and covariations in the expectation and volatility of stock market returns. J. Financ. 49(2), 515–541 (1994)CrossRef Whitelaw, R.F.: Time variations and covariations in the expectation and volatility of stock market returns. J. Financ. 49(2), 515–541 (1994)CrossRef
go back to reference Wu, L.-C., Chou, S.-C., Yang, C.-C., Ong, C.-S.: Enhanced index investing based on goal programming. J. Portf. Manag. 33(3), 49–56 (2007)CrossRef Wu, L.-C., Chou, S.-C., Yang, C.-C., Ong, C.-S.: Enhanced index investing based on goal programming. J. Portf. Manag. 33(3), 49–56 (2007)CrossRef
go back to reference Zheng, Y., Chen, B., Hospedales, T.M., Yang, Y.: Index tracking with cardinality constraints: a stochastic neural networks approach. Proc. AAAI Conf. Artif. Intell. 34(01), 1242–1249 (2020) Zheng, Y., Chen, B., Hospedales, T.M., Yang, Y.: Index tracking with cardinality constraints: a stochastic neural networks approach. Proc. AAAI Conf. Artif. Intell. 34(01), 1242–1249 (2020)
Metadata
Title
State-dependent stock selection in index tracking: a machine learning approach
Authors
Reza Bradrania
Davood Pirayesh Neghab
Mojtaba Shafizadeh
Publication date
26-04-2021
Publisher
Springer US
Published in
Financial Markets and Portfolio Management / Issue 1/2022
Print ISSN: 1934-4554
Electronic ISSN: 2373-8529
DOI
https://doi.org/10.1007/s11408-021-00391-7

Other articles of this Issue 1/2022

Financial Markets and Portfolio Management 1/2022 Go to the issue