About Me
Information is the state of a system of interest (curiosity). Message is the information materialized.
Information is a quality of a message that is sent from a sender to one or more receivers. Information is always about something (size of a parameter, occurrence of an event, ...). Viewed in this manner, information does not have to be accurate. It may be a truth or a lie, or just the sound of a kiss. Even a disruptive noise used to inhibit the flow of communication and create misunderstanding would in this view be a form of information. However, generally speaking, the amount of information in the received message increases the more accurate the message is.
This model assumes there is a definite sender and at least one receiver. Many refinements of the model assume the existence of a common language understood by the sender and at least one of the receivers. An important variation identifies information as that which would be communicated by a message if it were sent from a sender to a receiver capable of understanding the message. However, in requiring the existence of a definite sender, the "information as a message" model does not attach any significance to the idea that information is something that can be extracted from an environment, e.g., through observation, reading or measurement.
Information is a term with many meanings depending on context, but is as a rule closely related to such concepts as meaning, knowledge, instruction, communication, representation, and mental stimulus. Simply stated, Information is a message received and understood. In terms of data, it can be defined as a collection of facts from which conclusions may be drawn. There are many other aspects of information since it is the knowledge acquired through study or experience or instruction. But overall, information is the result of processing, manipulating and organizing data in a way that adds to the knowledge of the person receiving it.
Communication theory is a numerical measure of the uncertainty of an outcome, for example, we can say that "the signal contained thousands of bits of information". Communication theory tends to use the concept of information entropy, generally attributed to C.E. Shannon (see below).
Another form of information is the Fisher information, a concept of R.A. Fisher. This is used in application of statistics to estimation theory and to science in general. Fisher information is thought of as the amount of information that a message carries about an unobservable parameter. It can be computed from knowledge of the likelihood function defining the system. For example, with a normal likelihood function, the Fisher information is the reciprocal of the variance of the law. In the absence of knowledge of the likelihood law, the Fisher information may be computed from normally distributed score data as the reciprocal of their second moment.
Even though information and data are often used interchangeably, they are actually very different. Data is a set of unrelated information, and as such is of no use until it is properly evaluated. Upon evaluation, once there is some significant relation between data, and they show some relevance, then it is converted into information. Now this same data can be used for different purposes. Thus, till the data convey some information, they are not useful.
[edit]
Measuring information entropy
The view of information as a message came into prominence with the publication in 1948 of an influential paper by Claude Shannon, "A Mathematical Theory of Communication." This paper provides the foundations of information theory and endows the word information not only with a technical meaning but also a measure. If the sending device is equally likely to send any one of a set of N messages, then the preferred measure of "the information produced when one message is chosen from the set" is the base two logarithm of N (This measure is called self-information). In this paper, Shannon continues:
The choice of a logarithmic base corresponds to the choice of a unit for measuring information. If the base 2 is used the resulting units may be called binary digits, or more briefly bits, a word suggested by J. W. Tukey. A device with two stable positions, such as a relay or a flip-flop circuit, can store one bit of information. N such devices can store N bits... [The Bell System Technical Journal, Vol. 27, p. 379, (July 1948).]
A complementary way of measuring information is provided by Algorithmic information theory. In brief, this measures the information content of a list of symbols based on how predictable they are, or more specifically how easy it is to generate the list. The sequence below would have a very low algorithmic information measurement since it is a very predictable pattern, and as the pattern continues the measurement would not change. Shannon information would give the same information measurement for each symbol, since they are statistically random, and each new symbol would increase the measurement.
123456789101112131415161718192021
It is important to recognise the limitations of Shannon's work from the perspective of human meaning. When referring to the meaning content of a message Shannon noted Frequently the messages have meaning these semantic aspects of communication are irrelevant to the engineering problem. The significant aspect is that the actual message is one selected from a set of possible messages (emphasis in original).
In Information Theory signals are part of a process, not a substance, they do something, they do not contain any specific meaning. Combining Algorithmic information theory and Information Theory we can conclude that the most random signal contains the most information as it can be interpreted in any way and cannot be compressed.
Micheal Reddy noted that signals of the mathematical theory are patterns that can be exchanged. There is no message contained in the signal, the signals covey the ability to select from a set of possible messages. In information theory the system must be designed to operate for each possible selection, not just the one which will actually be chosen since this is unknown at the time of design.
See also lexicographic information cost.
CHECK OUT OUR FRIEND SLECHTERIK AT MYSPACE.COM/SLECHTERIK YES? HE IS GOOD YES? HELLO SLECHTERIK THIS ONE GOES OUT TO YOU REPSECT HOMIE!!
(§§§§§§§§§§§§§§§§§§§§)±!)0000000000 CODE@))@)@)@)@)02@@@@@@)&@&&&&&&
&&&&&&&&&&&&
&&&&&&&&&&&&
&&&&& &&&&&&&&&&& &&&&&&&&&&&&
&&&&&&&&&&&&
&& &&& &&&& &&&&&&&&&&&&
&&&&&&&&&&&&
&&&&&&&&&&&&
&&&&&&& &&&& &&&&&&&&&&&&
&&&& &&&&&& &&&&&§§§§§§§)±!)0000000000 CODE@))@)@)@)@)02@@@@@@)&@&&&&&&
&&&&&&&&&&&&
&&&&&&&&&&&&
&&&&& &&&&&&&&&&& &&&&&&&&&&&&
&&&&&&&&&&&&
&& &&& &&&& &&&&&&&&&&&&
&&&&&&&&&&&&
&&&&&&&&&&&&
&&&&&&& &&&& &&&&&&&&&&&&
&&&& &&&&&& &&&&&
(§§§§§§§§§§§§§§§§§§§§)±!)0000000000 CODE@))@)@)@)@)02@@@@@@)&@&&&&&&
&&&&&&&&&&&&
&&&&&&&&&&&&
&&&&& &&&&&&&&&&& &&&&&&&&&&&&
&&&&&&&&&&&&
&& &&& &&&& &&&&&&&&&&&&
&&&&&&&&&&&&
&&&&&&&&&&&&
&&&&&&& &&&& &&&&&&&&&&&&
&&&& &&&&&& &&&&&§§§§§§§)±!)0000000000 CODE@))@)@)@)@)02@@@@@@)&@&&&&&&
&&&&&&&&&&&&
&&&&&&&&&&&&
&&&&& &&&&&&&&&&& &&&&&&&&&&&&
&&&&&&&&&&&&
&& &&& &&&& &&&&&&&&&&&&
&&&&&&&&&&&&
&&&&&&&&&&&&
&&&&&&& &&&& &&&&&&&&&&&&
&&&& &&&&&& &&&&&