Sparse coding

• Forms a good middle ground between fully distributed and extremely localized coding

• Is biologically plausible

• Is computationally sound in that it allows very large numbers of representations with a small number of units