An algorithmic refinement of maxent induces a thermodynamic-like behaviour in the reprogrammability of generative mechanisms

by H. Zenil, N.A. Kiani, J. Tegnér
Year:2018

Bibliography

An algorithmic refinement of maxent induces a thermodynamic-like behaviour in the reprogrammability of generative mechanisms
H. Zenil, N.A. Kiani, J. Tegnér
arXiv preprint arXiv:1805.07166, 2018

Abstract

Reprogramming a generative mechanism to produce a different object is associated with a cost. Here we use the notion of algorithmic randomness to quantify such a cost when reprogramming networks. We identify an asymmetry in a measure of reprogrammability, suggesting an analogy with a thermodynamic asymmetry. The principle of maximum entropy (Maxent) quantifies the evolution of entropy or the uncertainty during state transitions in systems confined to an equilibrium condition. Here we define a generalisation based on algorithmic randomness not restricted to equilibrium physics, based on both distance to algorithmic randomness and reprogrammability. We advance a constructive preferential attachment algorithm approximating a maximally algorithmic random network.
Hence, as a refinement on classical Maxent, networks can be quantified with respect to their distance to a maximally algorithmic random network. Our analysis suggests that the reprogrammability asymmetry originates from its non-monotonic relationship to algorithmic randomness. Our analysis motivates further work on the degree of algorithmic asymmetries in systems depending on their reprogrammability capabilities.

An algorithmic refinement of maxent induces a thermodynamic-like behaviour in the reprogrammability of generative mechanisms.pdf

Keywords

Second law of thermodynamics Reprogrammability Algorith- mic complexity Generative mechanisms
KAUST

"KAUST shall be a beacon for peace, hope and reconciliation, and shall serve the people of the Kingdom and the world."

King Abdullah bin Abdulaziz Al Saud, 1924 – 2015

Contact Us

  • 4700 King Abdullah University of Science and Technology

    Thuwal 23955-6900, Kingdom of Saudi Arabia

     

Quick links

© King Abdullah University of Science and Technology. All rights reserved