Assessment of collective intelligence: methodological problems and perspectives

Abstract

Purpose of this paper is to investigate how can be measured the potential of collective intelligence formed by social technologies and what is missing for so far created collective intelligence measuring systems that can lead to public concerns to success. We founded that the evaluation indicators system of collective intelligence although quite detailly describes its development and is generally interpreted, has considerable drawbacks. On the other hand, the guidelines that could develop evaluation system of collective intelligence are defined. Despite the fact that the indices correspond to the major potential of collective intelligence assessment components certain parameters that need to be evaluated remain. In addition, the data on which the calculations are made, and that defines the index value has a significant impact on the development of the evaluation system of collective intelligence. Analysis of the measues of collective intelligence presented in this article can be seen only as a synoptic requiring more study. In order to determine the circumstances that led up to now create assessment system of the structures and properties of the individual indicators of collective intelligence, more research is needed. But the analysis of main properties, necessary for theoretical basis for these investigations, is presented in this article. On the other hand, due to the lack of the objective data - empirical results it is difficult to justify some of the assumptions made by analyzing the performance of collective intelligence potential indicators. In such cases our research is based on analogous reasoning applied to other areas of measurement systems. This article may be useful for further development of evaluation systems of collective intelligence. It sets out the basic guidelines which could be basis for development of of evaluation indicators system of collective intelligence in the future.