Skip to main content
Top
Published in: Neural Computing and Applications 4/2018

20-10-2017 | Original Article

Smooth statistical modeling of bivariate non-monotonic data by a three-stage LUT neural system

Authors: Simone Fiori, Nicola Fioranelli

Published in: Neural Computing and Applications | Issue 4/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The present paper introduces a new statistical data modeling algorithm based on artificial neural systems. This procedure allows abstracting from datasets by working on their probability density functions. The proposed method strives to capture the overall structure of the analyzed data, exhibits competitive computational runtimes and may be applied to non-monotonic real-world data (building on a previously developed isotonic neural modeling algorithm). An outstanding feature of the proposed method is the ability to return a smoother model compared to other modeling algorithms. Smooth models could have applications in the fields of engineering and computer science. In fact, the present research was motivated by an image contour resampling problem that arises in shape analysis. The features of the proposed algorithm are illustrated and compared to the features of existing algorithms by means of numerical tests on shape resampling.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
It is tacitly assumed that, while the points in the dataset \({{\mathbb {D}}}\) generally are not evenly spaced, the resampled coordinate \(\hat{x}\) is evenly spaced in \({{\mathbb {M}}}\), although such an assumption is not strictly necessary for the discussed modeling algorithm to work.
 
2
The shape contour datasets used within the present paper were drawn from the Surrey fish database described in http://​www.​ee.​surrey.​ac.​uk/​CVSSP/​demos/​css/​demo.​html. Unfortunately, these datasets are no longer available from the server. We can make them available to interested readers upon request.
 
3
The idea behind the RMSR index is as follows. Let us denote by z(x) the profile ordinate of a line parameterized by x. A completely flat (i.e., minimally rough) profile will be characterized by \({\mathrm{d}}z/{\mathrm{d}}x=0\), hence the cumulative quantity \(\int ({\mathrm{d}}z/{\mathrm{d}}x)^2{\mathrm{d}}x=0\). Conversely, the more a profile is uneven/rough, the larger \(({\mathrm{d}}z/{\mathrm{d}}x)^2\) is, the larger \(\int ({\mathrm{d}}z/{\mathrm{d}}x)^2{\mathrm{d}}x\) will result. We took a numerical approximation of this integral as a measure of roughness of a shape, approximated numerically by the sum of terms \((\hat{\xi }_i-\hat{\xi }_{i-1})^2\) and \((\hat{\eta }_i-\hat{\eta }_{i-1})^2\).
 
4
We used the MATLAB function interp1 with the syntax yh = interp1 (x,y,xh,method), where (x,y) is a dataset, yh is the result of interpolation at ‘query points’ xh, and method is either ‘linear’ or ‘spline.’
 
5
The derivative \(\kappa (s)=\theta '(s)\) represents the local curvature of the planar shape described by the orientation function \(\theta (s)\).
 
6
The above procedure takes the same syntax of the \({\hbox {MATLAB}}^{\copyright }\)’s function ‘interp1’.
 
Literature
1.
go back to reference Abdolahzare Z, Mehdizadeh SA (2016) Nonlinear mathematical modeling of seed spacing uniformity of a pneumatic planter using genetic programming and image processing. Neural Comput Appl. doi:10.1007/s00521-016-2450-1 Abdolahzare Z, Mehdizadeh SA (2016) Nonlinear mathematical modeling of seed spacing uniformity of a pneumatic planter using genetic programming and image processing. Neural Comput Appl. doi:10.​1007/​s00521-016-2450-1
3.
go back to reference Conolly RB, Lutz WK (2003) Nonmonotonic dose-response relationships: mechanistic basis, kinetic modeling, and implications for risk assessment. Toxicol Sci 77:151–157CrossRef Conolly RB, Lutz WK (2003) Nonmonotonic dose-response relationships: mechanistic basis, kinetic modeling, and implications for risk assessment. Toxicol Sci 77:151–157CrossRef
4.
go back to reference Domínguez-Menchero JS, González-Rodríguez G (2007) Analyzing an extension of the isotonic regression problem. Metrika 66:19–30MathSciNetCrossRefMATH Domínguez-Menchero JS, González-Rodríguez G (2007) Analyzing an extension of the isotonic regression problem. Metrika 66:19–30MathSciNetCrossRefMATH
5.
go back to reference Duren RW, Marks RJ II, Reynolds PD, Trumbo ML (2007) Real-time neural network inversion on the SRC-6e reconfigurable computer. IEEE Trans Neural Netw 18(3):889–901CrossRef Duren RW, Marks RJ II, Reynolds PD, Trumbo ML (2007) Real-time neural network inversion on the SRC-6e reconfigurable computer. IEEE Trans Neural Netw 18(3):889–901CrossRef
6.
go back to reference El-Shafie A, Abdelazim T, Noureldin A (2010) Neural network modeling of time-dependent creep deformations in masonry structures. Neural Comput Appl 19(4):583–594CrossRef El-Shafie A, Abdelazim T, Noureldin A (2010) Neural network modeling of time-dependent creep deformations in masonry structures. Neural Comput Appl 19(4):583–594CrossRef
7.
go back to reference Esaki L, Arakawa Y, Kitamura M (2010) Esaki diode is still a radio star, half a century on. Nature 464:31CrossRef Esaki L, Arakawa Y, Kitamura M (2010) Esaki diode is still a radio star, half a century on. Nature 464:31CrossRef
8.
go back to reference Evrendilek F (2014) Assessing neural networks with wavelet denoising and regression models in predicting diel dynamics of eddy covariance-measured latent and sensible heat fluxes and evapotranspiration. Neural Comput Appl 24(2):327–337CrossRef Evrendilek F (2014) Assessing neural networks with wavelet denoising and regression models in predicting diel dynamics of eddy covariance-measured latent and sensible heat fluxes and evapotranspiration. Neural Comput Appl 24(2):327–337CrossRef
9.
go back to reference Feng Y-J, Lin Z-X, Zhang R-Z (2011) The influence of root mean square phase gradient of continuous phase plate on smoothing focal spot. Acta Phys Sin 60(10):104202 (in Chinese) Feng Y-J, Lin Z-X, Zhang R-Z (2011) The influence of root mean square phase gradient of continuous phase plate on smoothing focal spot. Acta Phys Sin 60(10):104202 (in Chinese)
10.
go back to reference Fiori S (2002) Hybrid independent component analysis by adaptive LUT activation function neurons. Neural Netw 15(1):85–94CrossRef Fiori S (2002) Hybrid independent component analysis by adaptive LUT activation function neurons. Neural Netw 15(1):85–94CrossRef
11.
go back to reference Fiori S (2013) Fast statistical regression in presence of a dominant independent variable. Neural Comput Appl 22:1367–1378CrossRef Fiori S (2013) Fast statistical regression in presence of a dominant independent variable. Neural Comput Appl 22:1367–1378CrossRef
13.
go back to reference Fiori S (2014) Fast closed-form trivariate statistical isotonic modeling. Electron Lett 50:708–710CrossRef Fiori S (2014) Fast closed-form trivariate statistical isotonic modeling. Electron Lett 50:708–710CrossRef
14.
go back to reference Fiori S, Gong T, Lee HK (2015) Bivariate non-isotonic statistical regression by a look-up table neural system. Cognit Comput 7(6):715–730CrossRef Fiori S, Gong T, Lee HK (2015) Bivariate non-isotonic statistical regression by a look-up table neural system. Cognit Comput 7(6):715–730CrossRef
15.
go back to reference Goetghebeur E, Lapp K (1997) The effect of treatment compliance in a placebo-controlled trial: regression with unpaired data. J R Stat Soc Ser C (Appl Stat) 46(3):351–364CrossRefMATH Goetghebeur E, Lapp K (1997) The effect of treatment compliance in a placebo-controlled trial: regression with unpaired data. J R Stat Soc Ser C (Appl Stat) 46(3):351–364CrossRefMATH
16.
go back to reference Gujarati DN, Porter DC (2009) Basic econometrics, 5th edn. McGraw-Hill, New York, pp 73 – 78. ISBN: 978-0-07-337577-9 Gujarati DN, Porter DC (2009) Basic econometrics, 5th edn. McGraw-Hill, New York, pp 73 – 78. ISBN: 978-0-07-337577-9
17.
go back to reference Guo WW, Xue H (2012) An incorporative statistic and neural approach for crop yield modelling and forecasting. Neural Comput Appl 21(1):109–117MathSciNetCrossRef Guo WW, Xue H (2012) An incorporative statistic and neural approach for crop yield modelling and forecasting. Neural Comput Appl 21(1):109–117MathSciNetCrossRef
18.
go back to reference Hájek P, Olej V (2011) Credit rating modelling by kernel-based approaches with supervised and semi-supervised learning. Neural Comput Appl 20(6):761–773CrossRefMATH Hájek P, Olej V (2011) Credit rating modelling by kernel-based approaches with supervised and semi-supervised learning. Neural Comput Appl 20(6):761–773CrossRefMATH
19.
go back to reference Isermann R, Münchhof M (2011) Neural networks and Lookup Tables for identification. In: Identification of dynamic systems—an introduction with applications. Springer, Berlin, pp 501–537. ISBN: 978-3-540-78878-2 Isermann R, Münchhof M (2011) Neural networks and Lookup Tables for identification. In: Identification of dynamic systems—an introduction with applications. Springer, Berlin, pp 501–537. ISBN: 978-3-540-78878-2
20.
go back to reference Klassen E, Srivastava A, Mio W (2004) Analysis of planar shapes using geodesic paths on shape spaces. IEEE Trans Pattern Anal Mach Intell 26:372–383CrossRef Klassen E, Srivastava A, Mio W (2004) Analysis of planar shapes using geodesic paths on shape spaces. IEEE Trans Pattern Anal Mach Intell 26:372–383CrossRef
21.
go back to reference Kotłowski W, Słowiński R (2009) Rule learning with monotonicity constraints. In: Proceedings of the 26th international conference on machine learning (Montreal, Canada), pp 537–544 Kotłowski W, Słowiński R (2009) Rule learning with monotonicity constraints. In: Proceedings of the 26th international conference on machine learning (Montreal, Canada), pp 537–544
22.
go back to reference Laudani A, Lozito GM, Riganti Fulginei F, Salvini A (2015) On training efficiency and computational costs of a feed forward neural network: a review. Comput Intell Neurosci. Article ID 818243. doi:10.1155/2015/818243 Laudani A, Lozito GM, Riganti Fulginei F, Salvini A (2015) On training efficiency and computational costs of a feed forward neural network: a review. Comput Intell Neurosci. Article ID 818243. doi:10.​1155/​2015/​818243
24.
go back to reference Motulsky HJ, Ransnas LA (1987) Fitting curves to data using nonlinear regression: a practical and nonmathematical review. Fed Am Soc Exp Biol (FASEB) J 1(5):365–374 Motulsky HJ, Ransnas LA (1987) Fitting curves to data using nonlinear regression: a practical and nonmathematical review. Fed Am Soc Exp Biol (FASEB) J 1(5):365–374
25.
go back to reference Najah A, El-Shafie A, Karim OA, El-Shafie AH (2013) Application of artificial neural networks for water quality prediction. Neural Comput Appl 22(1):187–201CrossRef Najah A, El-Shafie A, Karim OA, El-Shafie AH (2013) Application of artificial neural networks for water quality prediction. Neural Comput Appl 22(1):187–201CrossRef
26.
go back to reference Niu K, Zhao F, Qiao X (2013) A missing data imputation algorithm in wireless sensor network based on minimized similarity distortion. In: Proceedings of the sixth international symposium on computational intelligence and design (Hangzhou, People’s Republic of China, October 28–29, 2013), vol 2, pp 235–238 Niu K, Zhao F, Qiao X (2013) A missing data imputation algorithm in wireless sensor network based on minimized similarity distortion. In: Proceedings of the sixth international symposium on computational intelligence and design (Hangzhou, People’s Republic of China, October 28–29, 2013), vol 2, pp 235–238
27.
go back to reference Owolabi TO, Zakariya YF, Olatunji SO, Akande KO (2016) Estimation of melting points of fatty acids using homogeneously hybridized support vector regression. Neural Comput Appl. doi:10.1007/s00521-016-2344-2 Owolabi TO, Zakariya YF, Olatunji SO, Akande KO (2016) Estimation of melting points of fatty acids using homogeneously hybridized support vector regression. Neural Comput Appl. doi:10.​1007/​s00521-016-2344-2
28.
go back to reference Prabhu S, Uma M, Vinayagam BK (2015) Surface roughness prediction using Taguchi-fuzzy logic-neural network analysis for CNT nanofluids based grinding process. Neural Comp Appl 26(1):41–55CrossRef Prabhu S, Uma M, Vinayagam BK (2015) Surface roughness prediction using Taguchi-fuzzy logic-neural network analysis for CNT nanofluids based grinding process. Neural Comp Appl 26(1):41–55CrossRef
29.
go back to reference Saâdaoui F (2017) A seasonal feedforward neural network to forecast electricity prices. Neural Comput Appl 28(4):835–847CrossRef Saâdaoui F (2017) A seasonal feedforward neural network to forecast electricity prices. Neural Comput Appl 28(4):835–847CrossRef
30.
go back to reference Simsion G, Witt G (2005) Data Model Essent, 3rd edn. Morgan Kauffman Publishers, Los AltosMATH Simsion G, Witt G (2005) Data Model Essent, 3rd edn. Morgan Kauffman Publishers, Los AltosMATH
31.
go back to reference Smith M (1996) Neural networks for statistical modeling. International Thomson Computer Press, London Smith M (1996) Neural networks for statistical modeling. International Thomson Computer Press, London
32.
go back to reference Specht DE (1991) A general regression neural network. IEEE Trans Neural Netw 2(6):568–576CrossRef Specht DE (1991) A general regression neural network. IEEE Trans Neural Netw 2(6):568–576CrossRef
33.
go back to reference Tamminen S, Laurinen P, Röning J (1999) Comparing regression trees with neural networks in aerobic fitness approximation. In: Proceedings of the international computing sciences conference symposium on advances in intelligent data analysis (Rochester, 1999), pp 414–419 Tamminen S, Laurinen P, Röning J (1999) Comparing regression trees with neural networks in aerobic fitness approximation. In: Proceedings of the international computing sciences conference symposium on advances in intelligent data analysis (Rochester, 1999), pp 414–419
35.
go back to reference Vansteenkiste E (2015) Lookup-table based neurons for an efficient FPGA implementation of neural networks. Master Thesis of the computing systems lab (CSL), Electronics and information systems (ELIS) department, Ghent University (Belgium) Vansteenkiste E (2015) Lookup-table based neurons for an efficient FPGA implementation of neural networks. Master Thesis of the computing systems lab (CSL), Electronics and information systems (ELIS) department, Ghent University (Belgium)
37.
go back to reference Yu R, Leung PS, Bienfang P (2006) Predicting shrimp growth: artificial neural network versus nonlinear regression models. Aquac Eng 34(1):26–32CrossRef Yu R, Leung PS, Bienfang P (2006) Predicting shrimp growth: artificial neural network versus nonlinear regression models. Aquac Eng 34(1):26–32CrossRef
Metadata
Title
Smooth statistical modeling of bivariate non-monotonic data by a three-stage LUT neural system
Authors
Simone Fiori
Nicola Fioranelli
Publication date
20-10-2017
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 4/2018
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-017-3215-1

Other articles of this Issue 4/2018

Neural Computing and Applications 4/2018 Go to the issue

Premium Partner