Average Log-Loss (ALL) for Chromatic and Achromatic Images.

The first row shows the average log-loss (ALL, in bits/component) of the density model determined by the linear transformation RND. The value was obtained by averaging over 10 separately sampled training and test sets of size 40.000 and 50.000, respectively. The following rows show the difference of the ALL of the models SYM, PCA, ICA and of the spherically symmetric density (SSD) to the ALL of the RND model. The smaller average log-loss of the SSD model compared to the ICA model fundamentally contradicts the assumptions underlying the ICA model.