Submitted:
11 February 2026
Posted:
13 February 2026
Read the latest preprint version here
Abstract

Keywords:
Constraint, Asymmetry, and Meaning: A Cybernetic Reinterpretation of Probabilistic Emergence Across Complex Systems
- Deconstructing the “Borelean” limits of current ergodic assumptions in AI architectures.
- Mapping the transition from symmetry (uniform probability) to asymmetry (directed information) via Bateson’s negative explanation.
- Correlating these concepts with real-world mechanisms such as regularization, pruning, attention masks, and other constraint-inducing techniques.
The Long-Standing Debate
Theoretical Framework
Methods
- Bateson (1967, 2000a, pp. 407–418, Cybernetic Explanation) introduces negative explanation as the principle that structure arises through the recursive elimination of non-viable alternatives within bounded systems. This establishes the abstract, conceptual foundation of constraint-driven emergence.
- Bateson (2000b, pp. 315–344, The Cybernetics of ‘Self’) provides a concrete application: the behavior of the “alcoholic self” illustrates how systemic constraints and feedback loops produce viable outcomes without reliance on direct linear causation. This demonstrates negative explanation in a bounded, real-world context.
- Bateson (2000c, pp. 455–471, Form, Substance, and Difference) grounds the epistemology of structured emergence: meaningful outcomes arise from distinctions (“differences that make a difference”) rather than from stochastic or material forces, highlighting the ontological dimension of constraint.
- Borel (1909, 1913, 1914), by contrast, treats structure as an artifact of ergodic probability: uniform distribution over infinite sequences theoretically guarantees the emergence of order, independent of systemic boundaries or feedback.
- Information theory: Shannon’s entropy reduction via constraint aligns Bateson’s elimination
- Decision theory: Simon’s satisficing operationalizes cybernetic selection
- Computation theory: Turing’s algorithmic limits formalize constraint-driven convergence
- Comparative Operational Table (Table 1). Summarizes core differences between Borel’s ergodic model and Bateson’s constraint-driven logic, highlighting how bounded latent spaces and recursive elimination shape viable system outcomes.
- Comparative Epistemological Table (Table 2). Synthesizes cybernetic constraints versus probabilistic randomness in a matrix-like format, linking these distinctions to Information Theory (Shannon), Bounded Rationality (Simon), and Computability Theory (Turing). This table demonstrates how constraints generate meaningful structure and reveal the limits of infinite-trial assumptions.
- Formal Set-Theoretic Derivation. Operationalizes the recursive application of constraint functions in latent spaces, illustrating how ergodic symmetry is broken and structured emergence is preserved.
Analysis
Analytic Outputs
Discussion
- Reframes the Infinite Monkey Theorem. This study challenges the classical interpretation of Borel’s probabilistic ergodicity, arguing that meaningful structure does not emerge from unbounded random sampling, but from the recursive elimination of improbable alternatives. While Feller (1957) emphasizes the mathematical inevitability of structure through indefinite trials, this perspective overlooks how meaningful outcomes are actively constrained in real-world systems. Bateson’s negative explanation redirects attention from the probability of random success to the systemic boundaries that prevent failure. Popper’s (1959) emphasis on falsifiability and Spencer-Brown’s (1969) logic of distinction reinforce the view that meaningful emergence arises from what is excluded, not from what is permitted.
- Advances Cybernetic Epistemology. Building on Bateson’s (1967) critique of causality, this study advances cybernetic epistemology by formalizing negative explanation as a foundation for understanding how structure and meaning arise. Rather than framing causality as a chain of productive events, it centers on recursive feedback and systemic restraint. This argument aligns with von Foerster’s (1979) second-order cybernetics, which emphasizes the observer’s embeddedness within self-organizing systems, and Varela’s (1980) theory of autopoiesis, which shows that systems maintain coherence through self-regulation. This reconceptualization of causality shifts the discourse from generative randomness to epistemic boundaries.
- Demonstrates the Limits of Probabilistic Models. Traditional probabilistic models rely on asymptotic reasoning, suggesting that probabilities converge with infinite trials. Cantelli (1917) formalized this convergence, and de Finetti (1974) emphasized the subjective foundation of probability as a limiting frequency. However, these views often abstract away from how systems actually generate meaningful outcomes in bounded conditions. This study argues that such models obscure the role of feedback, thresholds, and selection constraints in shaping complex behavior. Morin’s (1992) critique of linear models in complexity science further supports the claim that probabilistic infinity is insufficient for explaining structure. Instead, cybernetic frameworks foreground constraint as the organizing principle of emergence.
- Bridges Philosophy, Cybernetics, and Probability. This study offers an integrative framework that connects philosophical epistemology, cybernetic systems theory, and classical probability. Bateson’s cybernetic logic is shown to intersect with Shannon’s information theory and Simon’s bounded rationality, while also resonating with Wiener’s (1948) theory of feedback and control. Foucault’s (1970) analysis of discourse as constrained by regimes of knowledge complements this cybernetic view, highlighting that epistemic systems are shaped by what they exclude rather than what they contain. Together, these thinkers converge on the idea that structure and intelligibility emerge from the filtration of possibilities—not their proliferation.
- Contributes to Contemporary Debates. By revisiting a canonical paradox in probability theory, this study contributes fresh insight into active debates within epistemology, complexity science, AI, and systems design. Rescher (1977) emphasizes the role of methodological pragmatism, advocating for knowledge systems that reflect real-world constraints. Kauffman’s (1993) notion of the adjacent possible illustrates how novelty arises from bounded combinations, not infinite random recombination. This study’s cybernetic synthesis supports those models that prioritize feedback, boundary conditions, and recursive structuring as mechanisms for emergence, thereby challenging the continued reliance on stochastic excess in contemporary theories of cognition and computation.
- Introduces a Constraint-Driven Model of Emergence. The cumulative insights from this study establish a formal model of constraint-driven emergence. This model reorients traditional assumptions about structure and meaning, placing the emphasis on what systems exclude through negative selection rather than on the statistically inevitable emergence of order. It highlights the explanatory power of cybernetic feedback, algorithmic restriction, and epistemic thresholds in producing intelligible outcomes within complex systems.
- Establishes a Foundation for Interdisciplinary Research. Finally, by integrating foundational insights from cybernetics, epistemology, and probability theory, this study lays the groundwork for interdisciplinary applications. It offers a theoretical architecture that can inform models in AI, cognitive science, ecology, organizational systems, and beyond. This foundation encourages a shift toward constraint-centric frameworks, aligning theoretical insight with practical design principles across disciplines.
Conclusion
Epistemological Addendum
References
- Achille, A., & Soatto, S. (2018). Emergence of invariance and disentanglement in deep representations. Journal of Machine Learning Research, 19(1), Article 1947. https://jmlr.org/papers/v19/17-646.html.
- Alemohammad, S., Casco-Rodriguez, J., Luzi, L., Humayun, A. I., Babaei, H., LeJeune, D., Siahkoohi, A., & Baraniuk, R. G. (2024, January 16–20). Self-consuming generative models go MAD [Poster presentation]. International Conference on Learning Representations (ICLR 2024), Vienna, Austria. https://openreview.net/forum?id=ShjMHfmPs0.
- Aristotle. (350 B.C.E./1929). Physics (R. P. Hardie & R. K. Gaye, Trans.). In The works of Aristotle (Vol. 2). Oxford University Press. (Original work published ca. 350 B.C.E.).
- Ascham, R. (1923). The scholemaster (E. Arber, Ed.). Constable & Company. (Original work published posthumously 1545).
- Bateson, G. (1967). Cybernetic explanation. American Behavioral Scientist, 10(8), 29–32. [CrossRef]
- Bateson, G. (1972). Steps to an ecology of mind: Collected essays in anthropology, psychiatry, evolution, and epistemology. Chandler Publishing Company.
- Bateson, G. (2000a). Cybernetic explanation. In G. Bateson, Steps to an ecology of mind: Collected essays in anthropology, psychiatry, evolution, and epistemology (pp. 407–418). University of Chicago Press. (Original work published 1972).
- Bateson, G. (2000b). The cybernetics of “self”: A theory of alcoholism. In G. Bateson, Steps to an ecology of mind: Collected essays in anthropology, psychiatry, evolution, and epistemology (pp. 315–344). University of Chicago Press. (Original work published 1972).
- Bateson, G. (2000c). Form, substance, and difference. In G. Bateson, Steps to an ecology of mind: Collected essays in anthropology, psychiatry, evolution, and epistemology (pp. 455–471). University of Chicago Press. (Original work published 1972).
- Bateson, G. (2000d). Redundancy and coding. In G. Bateson, Steps to an ecology of mind: Collected essays in anthropology, psychiatry, evolution, and epistemology (pp. 419–440). University of Chicago Press. (Original work published 1972).
- Bateson, G. (2000e). Pathologies of epistemology. In G. Bateson, Steps to an ecology of mind: Collected essays in anthropology, psychiatry, evolution, and epistemology (pp. 484–493). University of Chicago Press. (Original work published 1972).
- Boolos, G., & Jeffrey, R. (2002). Computability and logic (4th ed.). Cambridge University Press.
- Borel, É. (1909). Les probabilités dénombrables et leurs applications arithmétiques. Rendiconti del Circolo Matematico di Palermo, 27, 247–271.
- Borel, É. (1913). Mécanique statistique et irréversibilité. Journal de Physique Théorique et Appliquée, 5(1), 189–196.
- Borel, É. (1914). Le hasard. Librairie Félix Alcan.
- Brunswic, L. M., Clémente, M., Yang, R. H., Sigal, A., Rasouli, A., & Li, Y. (2025). Ergodic generative flows. In Proceedings of the 42nd International Conference on Machine Learning (pp. 5649–5668). Proceedings of Machine Learning Research.
- Cantelli, F. P. (1917). Sulla probabilità come limite della frequenza. Atti della Accademia Nazionale dei Lincei, 26(1), 39–45.
- Cervantes, M. de. (1605). Don Quixote (Vol. 1; J. Jarvis, Trans.; G. Doré, Illus.; D. W. Clark, Ed.). Project Gutenberg.
- Cilliers, P. (1998). Complexity and postmodernism: Understanding complex systems. Routledge.
- de Finetti, B. (1974). Theory of probability (Vol. 1). Wiley.
- Eagle, A. (2021). Chance versus randomness. In E. N. Zalta (Ed.), The Stanford encyclopedia of philosophy (Spring 2021 ed.). Metaphysics Research Lab, Stanford University.
- Feller, W. (1957). An introduction to probability theory and its applications (Vol. 1). Wiley.
- Ferbach, D., Bertrand, Q., Bose, A. J., & Gidel, G. (2024). Self-consuming generative models with curated data provably optimize human preferences. arXiv. https://arxiv.org/abs/2407.09499.
- Foucault, M. (1970). The order of things: An archaeology of the human sciences. Pantheon.
- Gödel, K. (1992). On formally undecidable propositions of Principia Mathematica and related systems (B. Meltzer & R. B. Braithwaite, Trans.). Dover. (Original work published 1931).
- Guba, E. G., & Lincoln, Y. S. (1982). Epistemological and methodological bases of naturalistic inquiry. Educational Technology Research and Development, 30(4), 233–252.
- Horman, W. (1519). Vulgaria. Wynkyn de Worde.
- Jowett, B. (1888). The republic of Plato. Clarendon Press.
- Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020). Scaling laws for neural language models. arXiv. https://arxiv.org/abs/2001.08361.
- Kauffman, S. (1993). The origins of order: Self-organization and selection in evolution. Oxford University Press.
- Knorr, K. (1999). Epistemic cultures: How the sciences make knowledge. Harvard University Press.
- Ladyman, J., & Wiesner, K. (2020). What is a complex system? Yale University Press.
- Lin, H. W., Rolnick, D., & Tegmark, M. (2017). Why does deep and cheap learning work so well? Journal of Statistical Physics, 168(6), 1223–1247. [CrossRef]
- Lockhart, E. N. S. (2024). Creativity in the age of AI: The human condition and the limits of machine generation. Journal of Cultural Cognitive Science, 9(1), 83–88. [CrossRef]
- Lockhart, E. N. S. (2025a). Bounded knowledge bases and the limits of epistemic production. ResearchGate. [CrossRef]
- Lockhart, E. N. S. (2025b, November 20–22). Experientia Humana contra Simulacra et Technē Artificialis: Re-envisioning humanoid robots as trans-synthetic species beyond corporate technosimulacra [Conference presentation]. Roboi 2025: The 1st International Symposium on Embodied Intelligence and Humanoid Robots, Osaka, Japan.
- Nagel, E., & Newman, J. R. (2001). Gödel’s proof (rev. ed.). New York University Press. (Original work published 1958).
- Machamer, P., Darden, L., & Craver, C. F. (2000). Thinking about mechanisms. Philosophy of Science, 67(1), 1–25.
- Majumdar, A. (2026). The relativity of AGI: Distributional axioms, fragility, and undecidability. arXiv. https://arxiv.org/abs/2601.17335.
- Morgan, M. S. (2001). Models, stories, and the economic world. Journal of Economic Methodology, 14(3), 361–385.
- Morin, E. (1992). From the concept of system to the paradigm of complexity. Journal of Social and Evolutionary Systems, 15(4), 371–385. [CrossRef]
- Peters, O. (2019). The ergodicity problem in economics. Nature Physics, 15(12), 1216–1221. [CrossRef]
- Popper, K. (1959). The logic of scientific discovery. Routledge.
- Rescher, N. (1977). Methodological pragmatism: A systems-theoretic approach to the theory of knowledge. New York University Press.
- Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27(3), 379–423.
- Shumailov, I., Shumaylov, Z., Zhao, Y., Papernot, N., Anderson, R., & Gal, Y. (2024). AI models collapse when trained on recursively generated data. Nature, 631(8022), 755–759. [CrossRef]
- Simon, H. A. (1955). A behavioral model of rational choice. Quarterly Journal of Economics, 69(1), 99–118. [CrossRef]
- Smith, K., Kirby, S., Guo, S., & Griffiths, T. L. (2024). AI model collapse might be prevented by studying human language transmission. Nature, 633(8030), 525. [CrossRef]
- Spencer-Brown, G. (1969). Laws of form. Allen & Unwin.
- Swedberg, R. (2016). Before theory comes theorizing or how to make social science more interesting. The British Journal of Sociology, 67(1), 5–22. [CrossRef]
- Tomczak, J. M. (2025). Deep generative modeling: From probabilistic framework to generative AI. Entropy, 27(3), Article 238. [CrossRef]
- Turing, A. M. (1950). Computing machinery and intelligence. Mind, 59(236), 433–460.
- Varela, F. J. (1980). Autopoiesis and society. In M. Zeleny (Ed.), Autopoiesis, Dissipative Structures, and Spontaneous Social Orders (pp. 85–100). Pergamon.
- Vassilev, A. (2025). Robust AI security and alignment: A Sisyphean endeavor? arXiv. https://arxiv.org/abs/2512.10100.
- von Bertalanffy, L. (1973). General system theory (Rev. ed.). George Braziller.
- von Foerster, H. (1979). Cybernetics of cybernetics. In K. Krippendorff (Ed.), Communication and Control in Society (pp. 5–8). Gordon and Breach.
- von Mises, R. (1957). Probability, statistics and truth (J. Neyman, Trans.). George Allen & Unwin. (Original work published 1936).
- Walker, L. O., & Avant, K. C. (2019). Strategies for theory construction in nursing (6th ed.). Pearson.
- Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., ... & Fedus, W. (2022). Emergent abilities of large language models. arXiv. [CrossRef]
- Wiener, N. (1948). Cybernetics: Or control and communication in the animal and the machine. MIT Press.
- Wolpert, D. H. (2019). The stochastic thermodynamics of computation. Journal of Physics A: Mathematical and Theoretical, 52(19), Article 193001. [CrossRef]
- Zhang, J.-J., Cheng, N., Li, F.-P., Wang, X.-C., Chen, J.-N., Pang, L.-G., & Meng, D. (2025). Symmetry breaking in neural network optimization: Insights from input dimension expansion. npj Artificial Intelligence, 1, Article 12. [CrossRef]
| Dimension | Borel (Ergodic) | Bateson (Constraint-Driven) |
|---|---|---|
| Space | Infinite trials | Bounded latent space |
| Dynamics | Uniform probability | Recursive elimination |
| Outcome | Theoretical convergence | Guaranteed viable subspace |
| Stability | Recursive collapse | Diversity preserved |
| Concept | Borel Infinite Monkey Theorem | Bateson Cybernetic Explanation | Supporting Theories |
|---|---|---|---|
| Core Principle | Random keystrokes + uniform probability → infinite trials → structured sequences | Constraints → recursive elimination → viable sequences → emergent meaning |
IT: uncertainty → selective filtering → structured information BR: limited search + satisficing → tractable, structured decisions CT: algorithmic limits → constrained exploration → reproducible structure |
| Causal Explanation | Probabilistic causality: any sequence is possible + independent selection mechanisms → theoretical convergence | Negative explanation: constraints → eliminate improbable sequences → reinforce viable pathways → observed outcomes |
IT: constraints → signal amplification → meaningful patterns BR: limited evaluation + satisficing → directed selection CT: algorithmic rules + halting limits → feasible outputs only |
| Role of Constraints | Operates independently of eliminative constraints; stochastic processes + infinite trials → passive structure | Constraints → remove implausible alternatives + iterative refinement → structured emergence |
IT: signal filtering + probability shaping → information clarity BR: search-space limitation + satisficing → structured decisions CT: algorithmic bounds + stepwise rules → constrained system behavior |
| Logical Structure | Reductio ad absurdum → infinite trials resolve disorder → theoretical structure | Recursive refinement → feedback constraints → structured meaning, non-random outcomes |
IT: filtering → measurable reduction of uncertainty → preserved structure BR: bounded exploration + satisficing → consistent outcome logic CT: computation constraints → enforce reproducible structure |
| Implications | Infinite stochastic possibility + no systemic restraints → passive emergence | Bounded selection + recursive constraint enforcement → viable sequences, preserved diversity |
IT: constraint application → high signal-to-noise ratio → informative sequences BR: bounded rationality + iterative selection → structured emergence within cognitive limits CT: algorithmic control → predictable, non-random outputs |
| Category | Example | Context | Application |
|---|---|---|---|
| Artificial Intelligence | Machine Learning Algorithms | In computational models, algorithms are used to predict outcomes based on data input. | Regularization and loss functions guide algorithms to exclude poor models and converge on optimal solutions. |
| Art and Music | Composition of a Fugue | In music composition, the creation of a fugue follows strict counterpoint and harmony rules. | Excludes dissonant or structurally flawed note combinations, producing a harmonious and coherent musical piece. |
| Biology | Cellular Apoptosis (Programmed Cell Death) | In living organisms, cells undergo apoptosis to maintain health and function. | Cells that are damaged or malfunctioning are eliminated, preventing the spread of harm. |
| Communication Systems | Error-Correcting Communication Systems | In digital communication, systems ensure reliable message transmission despite noise or interference. | Error-correcting codes eliminate invalid messages, ensuring only correct sequences are transmitted. |
| Cybersecurity | Intrusion Detection Systems | In information security, systems monitor network traffic to detect unauthorized access. | Identifies and blocks anomalous behavior, preventing security breaches and maintaining system integrity. |
| Economics | Central Banks (Monetary Policy) | Central banks regulate the economy through monetary policy to maintain economic stability. | Constraints such as interest rates eliminate extreme market behaviors, preventing inflation or deflation. |
| Education | Adaptive Learning Platforms | In educational technology, platforms adjust to students’ learning needs. | Excludes mastered topics and focuses on areas needing improvement to optimize the learning experience. |
| Environmental Systems | Ecosystem Management (Predator-Prey Balance) | In ecological systems, maintaining balance among species ensures ecosystem health. | Prevents ecological collapse by managing populations and excluding unsustainable population levels. |
| Healthcare | Insulin Pumps (Diabetes Management) | In medical technology, insulin pumps regulate blood sugar levels for diabetic patients. | Excludes non-optimal insulin dosing patterns to maintain homeostasis and prevent glucose instability. |
| Law | Legal Systems (Judicial Decision-Making) | In legal frameworks, courts make decisions based on established statutes and precedents. | Eliminates unlawful or inconsistent outcomes by ensuring decisions align with legal standards. |
| Linguistics | Grammar Checkers (Word Processors) | In word processing, software tools check for grammatical accuracy. | Excludes ungrammatical sentences by using syntactic rules, helping users create correct language structures. |
| Manufacturing | Assembly Line Quality Control | In industrial settings, production lines ensure that products meet certain standards. | Detects and removes defective products from the production line, ensuring high-quality output. |
| Psychology | Cognitive Behavioral Therapy (CBT) | In mental health, CBT helps individuals reframe their thought patterns. | Identifies and excludes irrational thoughts, guiding individuals toward healthier cognitive patterns. |
| Robotics | Adaptive Robots | In robotics, autonomous systems adjust based on sensor feedback to optimize actions. | Excludes unsafe or ineffective movements, ensuring that robots perform tasks safely and efficiently. |
| Social Systems | Organizational Management (Performance Reviews) | In business environments, performance reviews are used to evaluate employee effectiveness. | Excludes unproductive behaviors through feedback and guides the organization toward its goals. |
| Transportation | Air Traffic Control Systems | In aviation, air traffic control ensures safe management of aircraft movements in busy airspace. | Excludes unsafe flight paths by preventing collisions and ensuring safe air traffic management. |
| Urban Planning | Zoning Laws and Building Codes | In urban planning, laws regulate how buildings and structures are designed and placed in cities. | Excludes non-compliant or unsafe building designs, ensuring safe and functional city planning. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).