Skip to main content
Top

SwitchPath: Enhancing Exploration in Neural Networks Learning Dynamics

  • 2025
  • OriginalPaper
  • Chapter
Published in:

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The chapter 'SwitchPath: Enhancing Exploration in Neural Networks Learning Dynamics' introduces SwitchPath, a novel stochastic activation function that toggles between standard ReLU and its negative counterpart. This function enhances neural network exploration and robustness without the computational inefficiencies of methods like Dropout. Inspired by decision trees and epsilon-greedy algorithms, SwitchPath balances exploration and exploitation, improving generalization and reducing overfitting. The manuscript presents a comprehensive methodology, including training and inference phases, and demonstrates SwitchPath’s superior performance through experiments on computer vision networks and Vision Transformers. Additionally, it explores SwitchPath’s impact on generative models and GANs, showcasing its ability to mitigate mode collapse. The chapter concludes with future research directions, highlighting the potential of SwitchPath in various advanced neural network applications.
A. Di Cecco—PhD student, National PhD in AI, XXXVIII cycle, health and life sciences, UCBM.
C. Metta—EU Horizon 2020: G.A. 871042 SoBig-Data++, NextGenEU - PNRR-PEAI (M4C2, investment 1.3) FAIR and “SoBigData.it”.
F. Morandin and M. Parton—Funded by INdAM groups GNAMPA and GNSAGA.
Computational resources provided by CLAI laboratory, Chieti-Pescara, Italy.
Authors can be contacted at curiosailab@gmail.com.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Business + Economics & Engineering + Technology"

Online-Abonnement

Springer Professional "Business + Economics & Engineering + Technology" gives you access to:

  • more than 130.000 books
  • more than 540 journals

from the following subject areas:

  • Automotive
  • Construction + Real Estate
  • Business IT + Informatics
  • Electrical Engineering + Electronics
  • Energy + Sustainability
  • Finance + Banking
  • Management + Leadership
  • Marketing + Sales
  • Mechanical Engineering + Materials
  • Surfaces + Materials Technology
  • Insurance + Risk


Secure your knowledge advantage now!

Springer Professional "Engineering + Technology"

Online-Abonnement

Springer Professional "Engineering + Technology" gives you access to:

  • more than 75.000 books
  • more than 390 journals

from the following specialised fileds:

  • Automotive
  • Business IT + Informatics
  • Construction + Real Estate
  • Electrical Engineering + Electronics
  • Energy + Sustainability
  • Mechanical Engineering + Materials
  • Surfaces + Materials Technology





 

Secure your knowledge advantage now!

Springer Professional "Business + Economics"

Online-Abonnement

Springer Professional "Business + Economics" gives you access to:

  • more than 100.000 books
  • more than 340 journals

from the following specialised fileds:

  • Construction + Real Estate
  • Business IT + Informatics
  • Finance + Banking
  • Management + Leadership
  • Marketing + Sales
  • Insurance + Risk



Secure your knowledge advantage now!

Title
SwitchPath: Enhancing Exploration in Neural Networks Learning Dynamics
Authors
Antonio Di Cecco
Andrea Papini
Carlo Metta
Marco Fantozzi
Silvia Giulia Galfré
Francesco Morandin
Maurizio Parton
Copyright Year
2025
DOI
https://doi.org/10.1007/978-3-031-78977-9_18
This content is only visible if you are logged in and have the appropriate permissions.
This content is only visible if you are logged in and have the appropriate permissions.

Premium Partner

    Image Credits
    Neuer Inhalt/© ITandMEDIA, Nagarro GmbH/© Nagarro GmbH, AvePoint Deutschland GmbH/© AvePoint Deutschland GmbH, AFB Gemeinnützige GmbH/© AFB Gemeinnützige GmbH, USU GmbH/© USU GmbH, Ferrari electronic AG/© Ferrari electronic AG