Biological batch normalisation: How intrinsic plasticity improves learning in deep neural networks.
In this work, we present a local intrinsic rule that we developed, dubbed IP, inspired by the Infomax rule. Like Infomax, this rule works by controlling the gain and bias of a neuron to regulate its rate of fire. We discuss the biological plausibility of the IP rule and compare it to batch normalisa...
Main Authors: | Nolan Peter Shaw, Tyler Jackson, Jeff Orchard |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2020-01-01
|
Series: | PLoS ONE |
Online Access: | https://doi.org/10.1371/journal.pone.0238454 |
Similar Items
-
Dynamic Neural Fields with Intrinsic Plasticity
by: Claudius Strub, et al.
Published: (2017-08-01) -
Neural plasticity and adult neurogenesis: the deep biology perspective
by: Anna Maria Colangelo, et al.
Published: (2019-01-01) -
Regularization of Deep Neural Network With Batch Contrastive Loss
by: Muhammad Tanveer, et al.
Published: (2021-01-01) -
The Effect of Batch Normalization on Deep Convolutional Neural Networks
by: Schilling, Fabian
Published: (2016) -
How has gambling become normalised in New Zealand?
by: Mack, Hugh Jonathan Devereux
Published: (2015)