Below, you will see an interactive demonstration of a two-layer network with recurrent inhibition.
Activations: Each unit's activation (shown numerically as well as by colour) is computed by adding up the incoming activation on each input line (including inputs from the same layer via recurrent connections) multiplied by the corresponding weight.
Weights: the weights or connection strengths are displayed as red circles for excitatory connections and blue circles for inhibitory connections. The size of the circle is proportional to the magnitude of the weight. Inhibitory weights are represented by negative values. The threshold value is not currently used in these simulations. Each unit's activity must be updated repeatedly before it will stabilize.
Architecture: There are nine units in each layer. The first layer is the input layer. The second layer units have excitatory connections from the corresponding units in the layer below, and inhibitory connections from the adjacent units in the same layer.
Editing the input values: Below each input unit there is an interactive white box. The activity of each input unit can be edited by clicking on the white box beneath it, using the delete and arrow keys, and typing in numeric values. You need to press reset and then cycle several times after you have changed the input states. Note: this demo runs in java and requires the latest version of netscape; unfortunately this version for the macintosh has a bug which causes the values in the input boxes to disappear once they have been edited. However, the demo still works, and you can still see the values appear as the input layer states change.
Adjusting the weights: The inhibitory and excitatory weights can be edited by clicking on the corresponding white boxes, using the delete and arrow keys, and entering numeric values.
Testing the network: Clicking on cycle at the bottom of the display causes the activations to be propagated from the input layer to the output layer for one cycle. You need to press cycle many times before the network activities stabilize. For some parameter values, the states will oscillate indefinitely.
Resetting the states: Clicking the reset button at the bottom of the display resets the states of all the non-input units to zero.