> So there is no real contradiction between the two fields of application.

Fair enough, I guess what I'm trying to get at is the fact that informational entropy seems to jar with logic, although it doesn't!:-) You know, you think of - messy = little order = little (chance of) information, and of neatness = density = lots of order = lots of information - but, of course, the more dense things are the less possible places any certain object could be and the more predictable things are.

A.N. Whitehead's notions of novelty highlight what I'm getting at:

"The art of progress is to preserve order amid change and to preserve change amid order."

"Order is not sufficient. What is required, is something much more complex. It is order entering upon novelty; so that the massiveness of order does not degenerate into mere repetition; and so that the novelty is always reflected upon a background of system."