Developers and purchasers of controlled health terminologies require valid mechanisms for comparing terminological systems. By Controlled Health Vocabularies, we refer to terminologies and terminological systems designed to represent clinical data at a granularity consistent with the practice of today's healthcare delivery. Comprehensive criterion for the evaluation of such systems historically have been lacking and the known criteria are inconsistently applied. Although there are many papers which describe specific desirable features of a controlled health vocabulary, to date there is not a consistent guide for evaluators of terminologies to reference, which will help them compare implementations of terminological systems on an equal footing [Methods Inf. Med. 37 (1998) 394, J. Am. Med. Inform. Assoc. 5 (1998) 503]. This guideline serves to fill the gap between academic enumeration of desirable terminological characteristics and the practical implementation or rigorous evaluations which will yield comparable data regarding the quality of one or more controlled health vocabularies.