The combination of statistical learning technologies with large databases of psychophysiological data has appropriately generated enthusiastic interest in future clinical applicability. It is argued here that this enthusiasm should be tempered with the understanding that significant obstacles must be overcome before the systematic introduction of psychophysiological measures into neuropsychiatric practice becomes possible. The nonspecificity of psychophysiological measures complicates their use in diagnosis. Low test-retest reliability complicates use in longitudinal assessment, and quantitative psychophysiological measures can normalize in response to placebo intervention. Ten cautionary observations are introduced and, in some instances, possible directions for remediation are suggested.

Multichannel EEGs were obtained from healthy participants in the eyes-closed no-task condition (where the alpha component is typically abolished). EEG dynamics in the two conditions were quantified with two related binary Lempel-Ziv measures of the first principal component and with three measures of integrated information including the more recently proposed integrated synergy. Both integrated information and integrated synergy with model order p=1 had greater values in the eyes closed condition. If the model order of integrated synergy was determined with the Bayesian Information Criterion, this pattern was reversed, and in common with other measures, integrated synergy was greater in the eyes open condition. Eyes open versus eyes closed separation was quantified by calculation of the between-condition effect size. Lempel-Ziv complexity of the first principal component showed greater separation than the measures of integrated information. The performance of the integrated information measures investigated here when distinguishing between indisputably different physiological states encourages caution when advocating for their use as measures of consciousness.