The maximum points-based supervised learning rule for spiking neural networks

As the third generation of neural networks, Spiking Neural Networks (SNNs) have made great success in pattern recognition fields. However, the existing training methods for SNNs are not efficient enough because of the temporal encoding mechanism. To improve the training efficiency of the supervised SNNs and keep the useful temporal information, the Maximum Points-based Supervised Learning Rule (MPSLR) is proposed in this paper. Three training strategies are adopted in MPSLR to improve the learning performance. Firstly, only the target points and maximum voltage points are trained. By theoretical analyses, we find that the maximum points are effective for the voltage controlling of the non-target points, and the analytic solutions for all maximum voltage points are parallelly obtainable. This improves the training efficiency significantly by avoiding the successive voltage detecting. Secondly, the weight modification for each presynaptic neuron is normalized by a rate function to resizing the output scale. Thirdly, the spiking rates accumulated in a time window are utilized to involve more useful knowledge. Extensive experiments on both synthetic data and four real-world UCI datasets demonstrate that our algorithm achieves significantly better performance and higher efficiency than traditional methods in various situations, including different multi-spike rates and time lengths. Besides, it is more stable to hyper-parameter variations.