Incomplete knowledge of the future, and also of the past of the transmitter from which the future might be constructed, is at the very basis of the concept of information. On the other hand, complete ignorance also precludes communication; a common language is required, that is to say an agreement between the transmitter and the receiver regarding the elements used in the communication process...
[The information of a message can] be defined as the 'minimum number of binary decisions which enable the receiver to construct the message, on the basis of the data already available to him.' These data comprise both the convention regarding the symbols and the language used, and the knowledge available at the moment when the message started. (Dennis Gabor)

Incomplete knowledge of the future, and also of the past of the transmitter from which the future might be constructed, is at the very basis of the concept of information. On the other hand, complete ignorance also precludes communication; a common language is required, that is to say an agreement between the transmitter and the receiver regarding the elements used in the communication process... [The information of a message can] be defined as the 'minimum number of binary decisions which enable the receiver to construct the message, on the basis of the data already available to him.' These data comprise both the convention regarding the symbols and the language used, and the knowledge available at the moment when the message started.

Dennis Gabor

Related topics

agreement binary common communication concept construct convention datum future ignorance knowledge language might moment number past transmitter

Related quotes

In a certain sense all knowledge is inductive. We can only learn the laws and relations of things in nature by observing those things. But the knowledge gained from the senses is knowledge only of particular facts, and we require some process of reasoning by which we may collect out of the facts the laws obeyed by them. Experience gives us the materials of knowledge: induction digests those materials, and yields us general knowledge. When we possess such knowledge, in the form of general propositions and natural laws, we can usefully apply the reverse process of deduction to ascertain the exact information required at any moment. In its ultimate foundation, then, all knowledge is inductive-in the sense that it is derived by a certain inductive reasoning from the facts of experience.

William Stanley Jevons

Classical science was based upon the belief that it is possible to formulate both the position and velocity at one time of any given particle. It followed that knowledge of the position and velocity of a given number of particles would enable the future behavior of the whole collection to be accurately predicted. The principle of Heisenberg is that given the determination of position, its velocity can be stated only as of a certain order of probability, while if its velocity is determined the correlative factor of position can be stated only as of a certain order of probability. Both cannot be determined at once, from which it follows necessarily that the future of the whole collection cannot possibly be foretold except in terms of some order of probability.

John Dewey

There is a school of Philosophy still in existence of which modern culture has lost sight. Glimpses of it are discernible in the ancient philosophies with which all educated men are familiar, but these are hardly more intelligible than fragments of forgotten sculpture,-less so, for we comprehend the human form, and can give imaginary limbs to a torso; but we can give no imaginary meaning to the truth coming down to us from Plato or Pythagoras, pointing, for those who hold the clue to their significance, to the secret knowledge of the ancient world. Side lights, nevertheless, may enable us to decipher such language, and a very rich intellectual reward offers itself to persons who are willing to attempt the investigation.

Alfred Percy Sinnett

A pure Democracy, by which I mean a Society consisting of a small number of citizens, who assemble and administer the Government in person, can admit of no cure for the mischiefs of faction. A common passion or interest will, in almost every case, be felt by a majority of the whole; a communication and concert result from the form of Government itself; and there is nothing to check the inducements to sacrifice the weaker party, or an obnoxious individual. Hence it is, that such Democracies have ever been spectacles of turbulence and contention; have ever been found incompatible with personal security, or the rights of property; and have in general been as short in their lives, as they have been violent in their deaths.

James Madison

I encourage investment in technologies that increase communication with the Iranian people. America in particular needs to increase the available mediums of dialogue with the Iranian people by strengthening the ability of the Iranian people to access news and information and to overcome the electronic censorship and monitoring efforts of the Iranian regime... This renewed dialogue would allow the world to demonstrate its solidarity with the democracy-seeking Iranian people. It would also improve the accuracy of the information received from Iran. But perhaps most importantly, improving these technologies would allow the Green Movement within Iran to communicate, organize and mobilize much more efficiently.

Reza Pahlavi