Neural net lexicon

layer
a subgroup of processing elements
input layer
usually the first layer
output layer
usually the last layer
hidden layers
layers in between the input and the output layer
cells, neuromimes, artificial neurons
processing elements
threshold function
used to determine the output of a neuron in the output layer
connections
synapses between cells
autoassociation
pattern matching (A => A)
heteroassociation
pattern matching (A => B)
learning
process of changing the weights
training
the act in which a network participates when learning is employed
self-organizing
unsupervised learning
supervised learning
external criteria are used to be matched by the network output
LSTM
long/short term memory -- preservation of intended training on the original set
structure
how many layers, what functions they have (input or output), interconnections & their functions
encoding
paradigm used for the determination of and changing of weights on the connections between neurons
recall
getting an expected output for a given input
correlation matrix
aka weight matrix
hidden layer
aka Kohonen or Grossberg layer
cooperation
the attempt between neurons in one neuron aiding the prospect of another neuron's firing -- vehicle for these phenomena is the connection weight
negative connection value could mean either inhibition or competition
competition
the attempt between neurons to individually excel with higher output
orthogonal
dot product results in zero
Hamming distance
easier method than Euclidean distance to measure proximity between patterns