Connectionism, neural nets

From Helpful
Jump to: navigation, search
This is more for overview of my own than for teaching or exercise.

Overview of the areas

Arithmetic · 'elementary mathematics' and similar concepts
Set theory, Category theory
Geometry and its relatives · Topology
Elementary algebra - Linear algebra - Abstract algebra
Calculus and analysis
 : Information theory · Number theory · Decision theory, game theory · Recreational mathematics · Dynamical systems · Unsorted or hard to sort

Math on data:

  • Statistics as a field
some introduction · areas of statistics
types of data · on random variables, distributions
Virtues and shortcomings of...
on sampling · probability
glossary · references, unsorted
Footnotes on various analyses

Other data analysis, data summarization, learning

Data massage
Data clustering · Dimensionality reduction · Fuzzy coding, decisions, learning · Optimization theory, control theory
Connectionism, neural nets · Evolutionary computing

Connectionism is the idea that interesting things are emergent effects from interconnected networks of simple units.

The term is used in cognitive psychology, cognitive science, neuroscience, and philosophy of mind, to model mental and behavioral phenomena -- but most recognizably in artificial intelligence in the form of neural networks.

Another angle is computationalism, which works more on higher-level expression, and tends to think connectionism is no more than lower-level association. The two are not necessarily incompatible, but certainly distinct approaches.

Neural networks

This article/section is a stub — probably a pile of half-sorted notes, is not well-checked so may have incorrect bits. (Feel free to ignore, fix, or tell me)

Terminology old and new

ANN history


Sigmoid neuron

Multilayer Perceptron (MLP)

A little fancier than perceptrons