- R. M. Abdur Rahman Bin Md Faizullah LimGen: probing the llms for generating suggestive limitations of research papers. arXiv preprint arXiv:2403.15529. Note: Shows summarization-specific models fail to generate limitations due to their training objectives External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- M. Abrahamsen, L. Kleist, and T. Miltzow Training neural networks is $\exists\mathbb{R}$-complete. In Proceedings of NeurIPS 2021, Note: arXiv:2102.09798 External Links: Link Cited by: §2.3.3.
- N. Abreu, P. B. Edwards, and F. Motta Topological machine learning with unreduced persistence diagrams. External Links: 2507.07156, Link Cited by: §2.3.2.
- U. Alon and E. Yahav On the bottleneck of graph neural networks and its practical implications. External Links: 2006.05205, Link Cited by: §2.3.3.
- P. Alquier PAC-bayesian bounds for randomized empirical risk minimizers. Mathematical Methods of Statistics 17 (4), pp. 279–304. Note: Bounds for randomized predictors; extended PAC-Bayesian theory External Links: Document Cited by: §2.3.2.
- A. Amini, W. Schwarting, A. P. Soleimany, and D. Rus Quantifying epistemic uncertainty in deep learning. arXiv preprint arXiv:2110.12122. Cited by: §2.3.
- D. Angluin Queries and concept learning. Machine Learning 2 (4), pp. 319–342. External Links: Document, Link Cited by: §2.3.2.
- D. Angluin Computational limitations on learning from examples. Journal of the ACM 36 (4), pp. 955–981. External Links: Document, Link Cited by: §2.3.2.
- R. Anil et al. PaLM 2 technical report. Note: arXiv preprint arXiv:2305.10403 External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- Anthropic Research Tracing the thoughts of a large language model. Note: https://www.anthropic.com/research/tracing-thoughts-language-modelResearch blog/papers on interpretability and internal features. Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- Anthropic The claude 3 model family: opus, sonnet, haiku (model card). Note: https://www-cdn.anthropic.com/.../Model_Card_Claude_3.pdfOfficial Claude 3 model card (PDF) from Anthropic. Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- D. Arpit, S. Jastrzebski, N. Ballas, D. Krueger, E. Bengio, I. Serban, et al. A closer look at memorization in deep networks. In International Conference on Machine Learning (ICML), Note: arXiv:1706.05394 External Links: Link Cited by: §2.3.3.
- J. Baan The slodderwetenschap (sloppy science) of stochastic parrots – a plea for science to not take the route advocated by gebru and bender. arXiv preprint arXiv:2101.10098. Note: Counter-argument to the Stochastic Parrots paper, criticizing its methodology and ethics External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- D. Bahdanau, K. Cho, and Y. Bengio Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473. Cited by: §1.4.
- H. Bahng, H. J. Kim, and J. Yoo Learning representations that support extrapolation. In International Conference on Machine Learning (ICML), pp. 1433–1448. Cited by: §2.3.
- Y. Bahri, E. Dyer, J. Kaplan, J. Lee, and U. Sharma Explaining neural scaling laws. Proceedings of the National Academy of Sciences 121 (27), pp. e2311878121. External Links: Document, Link, https://www.pnas.org/doi/pdf/10.1073/pnas.2311878121 Cited by: footnote 5.
- Y. Bai, S. Kadavath, S. Kundu, A. Askell, J. Kernion, A. Jones, A. Chen, A. Goldie, A. Mirhoseini, C. McKinnon, et al. Constitutional ai: harmlessness from ai feedback. arXiv preprint arXiv:2212.08073. Note: Anthropic’s approach to AI alignment using AI-generated feedback External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- B. Barak, S. B. Hopkins, J. Kelner, P. Kothari, A. Moitra, and A. Potechin A nearly tight sum-of-squares lower bound for the planted clique problem. In Proceedings of the 57th Annual IEEE Symposium on Foundations of Computer Science (FOCS), pp. 428–437. External Links: Document Cited by: §2.3.3.
- E. Barbierato and A. Gatti The challenges of machine learning: a critical review. Electronics 13 (2). External Links: Link, ISSN 2079-9292, Document Cited by: item 1.
- J. Barrat Our final invention: artificial intelligence and the end of the human era. Thomas Dunne Books. External Links: ISBN 978-0-312-62237-4 Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- M. Belkin, D. Hsu, S. Ma, and S. Mandal Reconciling modern machine learning practice and the bias-variance trade-off. Proc. Natl. Acad. Sci. U.S.A. 116 (32), pp. 15849–15854. Note: arXiv:1812.11118 [cs, stat] External Links: ISSN 0027-8424, 1091-6490, Link, Document Cited by: §2.3.3.
- E. M. Bender, T. Gebru, A. McMillan-Major, and S. Shmitchell On the dangers of stochastic parrots: can language models be too big?. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, pp. 610–623. Note: Foundational critique arguing LLMs statistically mimic text without real understanding, introducing the ”stochastic parrot” metaphor External Links: Document, Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- A. Bianchini On the notion of artificial in the age of synthetic biology and ai. Foundations of Science. External Links: Document Cited by: §1.1.
- D. Bickerton Language and species. University of Chicago Press, Chicago. External Links: Link Cited by: §1.4.
- J. Birch The edge of sentience: risk and precaution in humans, other animals, and ai. Oxford University Press. External Links: ISBN 978-0-19-287042-1 Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- L. Bloomfield Language. Henry Holt and Company, New York. External Links: Link Cited by: §1.4.
- A. Blum, A. T. Kalai, and H. Wasserman Noise-tolerant learning, the parity problem, and the statistical query model. Journal of the ACM 50 (4), pp. 506–519. External Links: Document Cited by: §2.3.3.
- A. L. Blum and R. L. Rivest Training a 3-node neural network is np-complete. Neural Networks 5 (1), pp. 117–127. Cited by: §2.3.3.
- R. Board and L. Pitt On the necessity of occam algorithms. Theoretical Computer Science 100 (1), pp. 157–184. External Links: Document, Link Cited by: §2.3.2.
- M. A. Boden and E. A. Edmonds From fingers to digits: an artificial aesthetic. MIT Press, Cambridge, MA. Cited by: §1.1.
- M. A. Boden Artificial intelligence and natural man. 2, expanded edition, MIT Press / Basic Books, Cambridge, MA / New York. Cited by: §1.1.
- M. A. Boden (Ed.) The philosophy of artificial intelligence. Oxford University Press, New York / Oxford. Cited by: §1.1.
- M. A. Boden (Ed.) The philosophy of artificial life. Oxford Readings in Philosophy, Oxford University Press, New York / Oxford. Cited by: §1.1.
- N. Bostrom Superintelligence: paths, dangers, strategies. Oxford University Press. External Links: ISBN 978-0199678112 Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- G. Briggs Machine ethics , the frame problem , and theory of mind. External Links: Link Cited by: §2.3.
- S. Bringsjord A refutation of penrose’s godelian case against artificial intelligence. External Links: Link Cited by: footnote 17.
- R. A. Brooks Intelligence without representation. Artificial Intelligence 47, pp. 139–159. External Links: Document, Link Cited by: item 1.
- T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, et al. Language models are few-shot learners. In Advances in Neural Information Processing Systems, Vol. 33, pp. 1877–1901. Note: NeurIPS 2020. Introduced GPT-3 with 175B parameters demonstrating few-shot learning External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- Cambridge Dictionary Artificial. Note: Accessed: 2025-10-01 External Links: Link Cited by: §1.1.
- N. Carlini and D. Wagner Towards evaluating the robustness of neural networks. External Links: 1608.04644, Link Cited by: §2.3.3.
- R. Cartuyvels, G. Spinks, and M. Moens Discrete and continuous representations and processing in deep learning: looking forward. AI Open 2, pp. 143–159. External Links: ISSN 2666-6510, Link, Document Cited by: footnote 9.
- R. T. Q. Chen, Y. Rubanova, J. Bettencourt, and D. Duvenaud Neural ordinary differential equations. External Links: 1806.07366, Link Cited by: §2.3.3.
- J. Cheng, L. Dong, and M. Lapata Long short-term memory-networks for machine reading. arXiv preprint arXiv:1601.06733. Cited by: §1.4.
- K. Cho, B. Van Merriënboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, and Y. Bengio Learning phrase representations using rnn encoder-decoder for statistical machine translation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1724–1734. Cited by: §1.4.
- N. Chomsky Syntactic structures. Mouton & Co., The Hague. External Links: Link Cited by: §1.4.
- N. Chomsky Aspects of the theory of syntax. MIT Press, Cambridge, MA. External Links: Link Cited by: §1.4.
- K. R. Chowdhary Fundamentals of artificial intelligence. Springer. External Links: ISBN 978-81-322-3970-3 Cited by: §2.3.1.
- A. Chowdhery, S. Narang, J. Devlin, M. Bosma, G. Mishra, A. Roberts, P. Barham, H. W. Chung, C. Sutton, S. Gehrmann, et al. PaLM: scaling language modeling with pathways. arXiv preprint arXiv:2204.02311. Note: Google’s 540B parameter model demonstrating breakthrough capabilities External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- A. Chowdhery et al. PaLM: scaling language modeling with pathways. Note: arXiv preprint arXiv:2204.02311 External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- M. H. Christiansen and N. Chater Language as shaped by the brain. Behavioral and Brain Sciences 31 (5), pp. 489–558. External Links: Document, Link Cited by: §1.4.
- M. H. Christiansen and S. Kirby (Eds.) Language evolution. Oxford Studies in the Evolution of Language, Oxford University Press, Oxford. External Links: ISBN 0199244839, Link Cited by: §1.4.
- J. Chung, C. Gulcehre, K. Cho, and Y. Bengio Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555. Cited by: §1.4.
- P. S. Churchland Neurophilosophy: toward a unified science of the mind-brain. MIT Press, Cambridge, MA. External Links: ISBN 978-0262031165 Cited by: §1.1.
- W. F. Clocksin and C. S. Mellish Programming in prolog: using the iso standard. 5th edition, Springer. External Links: ISBN 978-3-540-00678-7 Cited by: Figure 1, §2.3.1.
- A. M. Collins and M. R. Quillian Retrieval time from semantic memory. Journal of Verbal Learning and Verbal Behavior 8 (2), pp. 240–247. Cited by: §2.3.1.
- A. Colmerauer, H. Kanoui, R. Pasero, and P. Roussel Un système de communication homme-machine en français. Rapport préliminaire de fin de contrat IRIA Groupe Intelligence Artificielle, Faculté des Sciences de Luminy, Université Aix-Marseille II, France. Cited by: §2.3.1.
- A. Colmerauer and P. Roussel The birth of prolog. In History of programming languages—II, pp. 331–367. Note: Originally written November 1992 Cited by: §2.3.1.
- J. Copeland and D. Proudfoot From computer metaphor to computational modeling: the evolution of computationalism. Minds and Machines 28 (4), pp. 515–542. External Links: Document Cited by: §1.1.
- T. M. Cover Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition. IEEE Transactions on Electronic Computers EC-14 (3), pp. 326–334. External Links: Document, Link Cited by: §2.3.2.
- T. Cui, Y. Wang, C. Fu, Y. Xiao, S. Li, X. Deng, Y. Liu, Q. Zhang, Z. Qiu, P. Li, Z. Tan, J. Xiong, X. Kong, Z. Wen, K. Xu, and Q. Li Risk taxonomy, mitigation, and assessment benchmarks of large language model systems. arXiv preprint. Note: arXiv:2401.05778 External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- G. Cybenko Approximation by superpositions of a sigmoidal function. Mathematics of Control, Signals and Systems 2 (4), pp. 303–314. External Links: Document Cited by: §2.3.3.
- C. Darwin The descent of man, and selection in relation to sex. John Murray, London. External Links: Link Cited by: §1.4.
- G. E. G. David Ilić Evidence of interrelated cognitive-like capabilities in large language models: indications of artificial general intelligence or achievement?. Intelligence 106, pp. 101858. External Links: Document, Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- X. Davies, L. Langosco, and D. Krueger Unifying Grokking and Double Descent. arXiv (en). Note: arXiv:2303.06173 [cs]Comment: ML Safety Workshop, 36th Conference on Neural Information Processing Systems (NeurIPS 2022) External Links: Link Cited by: §2.3.3.
- R. Davis, B. Buchanan, and E. Shortliffe Production rules as a representation for a knowledge-based consultation program. Artificial Intelligence 8 (1), pp. 15–45. Cited by: §2.3.1.
- T. W. Deacon The symbolic species: the co-evolution of language and the brain. W. W. Norton & Company, New York. External Links: Link Cited by: §1.4.
- DeepSeek AI / Hugging Face Deepseek-ai/deepseek-r1 (model card). Note: https://huggingface.co/deepseek-ai/DeepSeek-R1Model page and downloads (weights / details). Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- H. B. Demuth, M. H. Beale, O. De Jess, and M. T. Hagan Neural network design. 2nd edition, Martin Hagan, Stillwater, OK, USA. External Links: ISBN 0971732116 Cited by: §2.3.2.
- D. C. Dennett Brainstorms: philosophical essays on mind and psychology. MIT Press, Cambridge, MA. External Links: ISBN 978-0262540377 Cited by: §1.1.
- D. C. Dennett Consciousness explained. Little, Brown and Company, Boston. External Links: ISBN 978-0316180665 Cited by: §1.1.
- H. Derouiche, Z. Brahmi, and H. Mazeni Agentic ai frameworks: architectures, protocols, and design challenges. arXiv preprint arXiv:2508.10146. External Links: Link Cited by: §2.
- R. Descartes Discourse on method. Harmondsworth, Penguin, Harmondsworth,. Cited by: §2.2.
- J. Devlin, M. Chang, K. Lee, and K. Toutanova BERT: pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 4171–4186. Note: NAACL 2019. Introduced bidirectional pre-training for language representations External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- Dictionary.com Artificial. Note: Accessed: 2025-10-01 External Links: Link Cited by: §1.1.
- G. Dodig-Crnkovic Info-computationalism and morphological computing of informational structures. Information 3 (2), pp. 204–218. External Links: Document Cited by: §1.1.
- F. Doshi-Velez and B. Kim Towards a rigorous science of interpretable machine learning. In arXiv preprint arXiv:1702.08608, Cited by: item 1.
- H. L. Dreyfus and S. E. Dreyfus Mind over machine: the power of human intuition and expertise in the era of the computer. Free Press. External Links: ISBN 0029080606 Cited by: item 1.
- H. L. Dreyfus Alchemy and artificial intelligence. Technical report Technical Report P-3244, RAND Corporation. External Links: Link Cited by: item 1.
- H. L. Dreyfus What computers can’t do: a critique of artificial reason. Harper & Row. External Links: ISBN 0060110821 Cited by: item 1.
- H. L. Dreyfus Being-in-the-world: a commentary on heidegger’s being and time, division i. MIT Press, Cambridge, MA. Cited by: §2.4.
- S. d’ Ascoli, L. Sagun, and G. Biroli Triple descent and the two kinds of overfitting: where & why do they appear?. In Advances in Neural Information Processing Systems, Vol. 33, pp. 3058–3069. External Links: Link Cited by: §2.3.3.
- R. Eldan and O. Shamir The power of depth for feedforward neural networks. In Proceedings of the 29th Annual Conference on Learning Theory (COLT), Proceedings of Machine Learning Research, Vol. 49, pp. 907–940. External Links: Link Cited by: §2.3.3.
- J. L. Elman Finding structure in time. Cognitive Science 14 (2), pp. 179–211. Cited by: §1.4.
- C. S. et al. The history of artificial intelligence. Note: Technical review Cited by: §1.4.
- N. Evans and S. C. Levinson The myth of language universals: language diversity and its importance for cognitive science. Behavioral and Brain Sciences 32 (5), pp. 429–492. External Links: Document, Link Cited by: §1.4.
- T. Feng, C. Jin, J. Liu, K. Zhu, H. Tu, Z. Cheng, G. Lin, and J. You How far are we from agi: are llms all we need?. arXiv preprint arXiv:2405.10313. External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- C. J. Fillmore The mechanisms of “construction grammar”. In Proceedings of the Fourteenth Annual Meeting of the Berkeley Linguistics Society, pp. 35–55. External Links: Document, Link Cited by: §1.4.
- L. Floridi From the philosophy of information to an information ethics. Philosophy & Technology. Note: Places AI debates within a broader ‘information’ philosophical framework. Cited by: §1.
- J. A. Fodor The language of thought. Harvard University Press, Cambridge, MA. External Links: ISBN 978-0674510302 Cited by: §1.1.
- A. A. Forum Beware general claims about ”generalizable reasoning capabilities” (of modern ai systems). Note: AI Alignment ForumDiscusses historical arguments from Gary Marcus and statistical learning theorists about limitations of neural network architectures External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- D. Friedman Understanding inference and the ”stochastic parrot” in large language models. Note: Personal blog (Substack)Argues LLMs are sophisticated pattern-matchers devoid of understanding, reasoning, or intentionality External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- J. Friedman, T. Hastie, H. Höfling, and R. Tibshirani Pathwise coordinate optimization. The Annals of Applied Statistics 1 (2), pp. 302–332. External Links: Document Cited by: §2.3.3.
- L. Galke, Y. Ram, and L. Raviv Emergent communication for understanding human language evolution: what’s missing?. External Links: 2204.10590, Link Cited by: §1.4.
- H. Gardner Frames of mind: the theory of multiple intelligences. Basic Books, New York. Cited by: §2.
- S. Garg, P. K. Kothari, P. Liu, and R. Raz Memory-sample lower bounds for learning parity with noise. arXiv preprint arXiv:2107.02320. External Links: Link Cited by: §2.3.3.
- N. Gauvrit, H. Zenil, and P. Tegnér The information-theoretic and algorithmic approach to human, animal and artificial cognition. arXiv preprint. External Links: 1501.04242 Cited by: §1.1.
- F. A. Gers, J. Schmidhuber, and F. Cummins Learning to forget: continual prediction with lstm. Neural Computation 12 (10), pp. 2451–2471. Cited by: §1.4.
- B. Goertzel and C. Pennachin (Eds.) Artificial general intelligence. Springer Science & Business Media. External Links: ISBN 9783540686774 Cited by: §2.3.1.
- B. Goertzel Artificial general intelligence: concept, state of the art, and future prospects. In Artificial General Intelligence, pp. 1–48. Cited by: §1.1.
- B. Goertzel Generative ai vs. agi: the cognitive strengths and weaknesses of modern llms. arXiv preprint. Note: arXiv:2309.10371 External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- E. M. Gold Language identification in the limit. Information and Control 10 (5), pp. 447–474. External Links: Document, Link Cited by: §2.3.2.
- A. E. Goldberg Constructions: a construction grammar approach to argument structure. University of Chicago Press, Chicago. External Links: Link Cited by: §1.4.
- I. Goodfellow, Y. Bengio, A. Courville, and Y. Bengio Deep learning. Vol. 1, MIT Press. Cited by: §2.3.2.
- I. J. Goodfellow, J. Shlens, and C. Szegedy Explaining and harnessing adversarial examples. arXiv preprint. External Links: 1412.6572, Link Cited by: §2.3.3.
- A. Graves Supervised sequence labelling with recurrent neural networks. Studies in Computational Intelligence 385. Cited by: §1.4.
- J. Grimm Deutsche grammatik. Bei Dieterich, Göttingen. Note: Vol. 1 (other vols. published 1822–1837) External Links: Link Cited by: §1.4.
- J. Gryz The frame problem in artificial intelligence and philosophy. Filozofia Nauki 21, pp. 15–30. Cited by: §2.3.
- D. Guo et al. DeepSeek-r1: incentivizing reasoning capability in llms. Note: arXiv preprint arXiv:2501.12948Introduces DeepSeek-R1 and DeepSeek-R1-Zero; RL-based reasoning training. External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- B. Hajek and M. Raginsky Statistical learning theory. Vol. 1. External Links: Link Cited by: §2.3.2.
- W. L. Hamilton Graph representation learning. Synthesis Lectures on Artificial Intelligence and Machine Learning 14 (3), pp. 1–159. Cited by: §2.3.3.
- K. Hao Empire of ai: dreams and nightmares in sam altman’s openai. Penguin Press. External Links: ISBN 978-0593657508 Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- S. Harnad The symbol grounding problem. Physica D: Nonlinear Phenomena 42, pp. 335–346. External Links: Document Cited by: item 1.
- S. Harnad The symbol grounding problem. Physica D: Nonlinear Phenomena 42 (1-3), pp. 335–346. Note: How symbols in AI can acquire meaning beyond arbitrary manipulation. External Links: Document Cited by: §2.3.
- J. Haugeland Artificial intelligence: the very idea. MIT Press, Cambridge, MA. External Links: ISBN 978-0262580953 Cited by: §1.1.
- M. D. Hauser, N. Chomsky, and W. T. Fitch The faculty of language: what is it, who has it, and how did it evolve?. Science 298 (5598), pp. 1569–1579. External Links: Document, Link Cited by: §1.4.
- D. Haussler, M. J. Kearns, H. S. Seung, N. Tishby, et al. Rigorous learning curve bounds from statistical mechanics. Machine Learning 25 (2–3), pp. 195–236. Note: Connects VC dimension, statistical mechanics, learning curves External Links: Document Cited by: §2.3.2.
- M. Heidegger Being and time. Harper & Row, New York. Note: Originally published in German as Sein und Zeit (1927) Cited by: §2.4.
- S. Hochreiter and J. Schmidhuber Long short-term memory. Neural Computation 9 (8), pp. 1735–1780. Cited by: §1.4.
- C. F. Hockett The origin of speech. Scientific American 203 (3), pp. 88–111. External Links: Document, Link Cited by: §1.4.
- J. Hoffmann, S. Borgeaud, A. Mensch, E. Buchatskaya, T. Cai, E. Rutherford, D. d. L. Casas, L. A. Hendricks, J. Welbl, A. Clark, et al. Training compute-optimal large language models. arXiv preprint arXiv:2203.15556. Note: Introduced Chinchilla and revised scaling laws for compute-optimal training External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- K. Hornik, M. Stinchcombe, and H. White Multilayer feedforward networks are universal approximators. Neural Networks 2 (5), pp. 359–366. External Links: Document Cited by: §2.3.3.
- K. Hornik Approximation capabilities of multilayer feedforward networks. Neural Networks 4 (2), pp. 251–257. External Links: Document Cited by: §2.3.3.
- W. Hsieh, Z. Bi, C. Jiang, J. Liu, B. Peng, S. Zhang, X. Pan, J. Xu, J. Wang, K. Chen, P. Feng, Y. Wen, X. Song, T. Wang, M. Liu, J. Yang, M. Li, B. Jing, J. Ren, J. Song, H. Tseng, Y. Zhang, L. K. Q. Y. def:SMLPand Qian Niu, S. Chen, Y. Wang, and C. X. Liang A comprehensive guide to explainable ai: from classical models to llms. External Links: 2412.00800, Link Cited by: §2.3.3.
- E. Hüllermeier and W. Waegeman Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods. Machine Learning 110 (3), pp. 457–506. External Links: Document Cited by: §2.3.
- W. v. Humboldt On language: the diversity of human language-structure and its influence on the mental development of mankind. Originally published 1836; modern English ed. Cambridge Univ. Press (1988). Note: Originally published in German as “Über die Verschiedenheit des menschlichen Sprachbaues”; English translations published later (e.g., Cambridge Univ. Press ed.) External Links: Link Cited by: §1.4.
- IBM Artificial intelligence. Note: Accessed: 2025-10-01 External Links: Link Cited by: §1.1.
- M. Ivgi, Y. Carmon, and J. Berant Scaling laws under the microscope: predicting transformer performance from small scale experiments. In Findings of the Association for Computational Linguistics: EMNLP 2022, Y. Goldberg, Z. Kozareva, and Y. Zhang (Eds.), Abu Dhabi, United Arab Emirates, pp. 7354–7371. External Links: Link, Document Cited by: footnote 5.
- P. C. Jackson Introduction to artificial intelligence. 3 edition, Dover Publications. External Links: ISBN 0486843076 Cited by: §2.3.1.
- H. Jelodar, Y. Wang, C. Yuan, X. Feng, X. Jiang, Y. Li, and L. Zhao Latent dirichlet allocation (lda) and topic modeling: models, applications, a survey. External Links: 1711.04305, Link Cited by: §1.4.
- H. J. Jeon and B. V. Roy Information-theoretic foundations for machine learning. External Links: 2407.12288, Link Cited by: §2.3.2.
- A. Q. Jiang et al. Mistral 7b. Note: arXiv preprint arXiv:2310.06825Mistral AI release (7B model) and technical description. External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- M. I. Jordan Serial order: a parallel distributed processing approach. Advances in Psychology 121, pp. 471–495. Cited by: §1.4.
- T. Jose, N. Cesa-Bianchi, and Y. Seldin Information-theoretic analysis of epistemic uncertainty in bayesian meta-learning. In Proceedings of the 39th International Conference on Machine Learning (ICML), pp. 11025–11047. Cited by: §2.3.
- Justia Legal Dictionary Artificial. Note: Accessed: 2025-10-01 External Links: Link Cited by: §1.1.
- J. Kaplan, S. McCandlish, T. Henighan, T. B. Brown, B. Chess, R. Child, S. Gray, A. Radford, J. Wu, and D. Amodei Scaling laws for neural language models. arXiv preprint arXiv:2001.08361. Note: Established empirical scaling laws for language model performance External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- J. Kaplan, S. McCandlish, T. Henighan, T. B. Brown, B. Chess, R. Child, S. Gray, A. Radford, J. Wu, and D. Amodei Scaling laws for neural language models. External Links: 2001.08361, Link Cited by: §2.3.3, Abstract.
- S. Kapoor and A. Narayanan Leakage and the reproducibility crisis in ml-based science. arXiv preprint arXiv:2207.07048. Cited by: item 3.
- S. Khamesian and H. Malek Hybrid self-attention neat: a novel evolutionary approach to improve the neat algorithm. arXiv preprint. Note: arXiv:2112.03670 External Links: Link Cited by: §3.2.
- S. Kirby Spontaneous evolution of linguistic structure: an iterated learning model of the emergence of regularity and irregularity. IEEE Transactions on Evolutionary Computation 5 (2), pp. 102–110. External Links: Document, Link Cited by: §1.4.
- J. Kirkpatrick, R. Pascanu, N. Rabinowitz, J. Veness, G. Desjardins, A. A. Rusu, K. Milan, et al. Overcoming catastrophic forgetting in neural networks. Proceedings of the National Academy of Sciences (PNAS) 114 (13), pp. 3521–3526. External Links: Document, Link Cited by: §2.3.3.
- G. Kutyniok The mathematics of artificial intelligence. arXiv preprint arXiv:2203.08890. External Links: Link Cited by: §2.2.
- G. LaForte Why gödel’s theorem cannot refute computationalism. Minds and Machines 8 (4), pp. 577–593. External Links: Document Cited by: §1.1.
- S. Lee and A. B. Dieng Are neural scaling laws leading quantum chemistry astray?. External Links: 2509.26397, Link Cited by: footnote 5.
- S. Legg and M. Hutter A collection of definitions of intelligence. External Links: 0706.3639, Link Cited by: §1.2.
- S. Legg and M. Hutter Universal intelligence: a definition of machine intelligence. Minds and Machines 17, pp. 391–444. External Links: Document Cited by: §1.1.
- M. Leshno, V. Y. Lin, A. Pinkus, and S. Schocken Multilayer feedforward networks with a nonpolynomial activation function can approximate any function. Neural Networks 6 (6), pp. 861–867. External Links: Document Cited by: §2.3.3.
- B. Liang, Y. Wang, and C. Tong AI reasoning in deep learning era: from symbolic ai to neural–symbolic ai. Mathematics 13 (11). External Links: Link, ISSN 2227-7390, Document Cited by: §2.3.1.
- J. Lighthill Artificial intelligence: a general survey. In Artificial Intelligence: A Paper Symposium, J. Lighthill, N. S. Sutherland, R. M. Needham, H. C. Longuet-Higgins, and D. Michie (Eds.), pp. 1–21. External Links: Link Cited by: §1.4.
- R. K. Lindsay, B. G. Buchanan, E. A. Feigenbaum, and J. Lederberg DENDRAL: a case study of the first expert system for scientific hypothesis formation. Artif. Intell. 61, pp. 209–261. External Links: Link Cited by: §2.3.1.
- Z. C. Lipton, J. Berkowitz, and C. Elkan A critical review of recurrent neural networks for sequence learning. arXiv preprint arXiv:1506.00019. Cited by: §1.4.
- Z. C. Lipton and J. Steinhardt Troubling trends in machine learning scholarship. External Links: 1807.03341, Link Cited by: item 2.
- Z. C. Lipton The mythos of model interpretability. Queue 16 (3), pp. 31–57. Cited by: item 1.
- Z. Luo and P. Tseng On the convergence of the coordinate descent method for convex differentiable minimization. Journal of Optimization Theory and Applications 72 (1), pp. 7–35. External Links: Document Cited by: §2.3.3.
- M. Luong, H. Pham, and C. D. Manning Effective approaches to attention-based neural machine translation. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 1412–1421. Cited by: §1.4.
- G. Marcus Deep learning: a critical appraisal. Note: arXiv preprint arXiv:1801.00631 External Links: Link Cited by: item 1, §2.3.2.
- G. Marcus Elegant and powerful new result that seriously undermines large language models. Note: Marcus on AI (Substack)Critique of LLM capabilities with proposed disclaimer: ”All facts presented by Generative AI—even those that are true—are fictitious” External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- G. Marcus A knockout blow for llms?. Communications of the ACM. Note: Discusses devastating Apple research paper on LLM reasoning limitations, noting advocates are ”partly conceding the blow” External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- H. Maron, H. Ben-Hamu, H. Serviansky, and Y. Lipman Provably powerful graph networks. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Eds.), Vol. 32, pp. . External Links: Link Cited by: §2.3.3.
- (2024) Mathematical Modeling and Simulation: Introduction for Scientists and Engineers, 2nd Edition | Wiley. (en). External Links: Link Cited by: §2.3.1.
- D. A. McAllester Some pac-bayesian theorems. Machine Learning 37 (3), pp. 355–363. Note: Early PAC-Bayesian bounds that combine Bayesian ideas with PAC guarantees External Links: Document Cited by: §2.3.2.
- J. McCarthy and P. J. Hayes Some philosophical problems from the standpoint of artificial intelligence. In Machine Intelligence 4, B. Meltzer and D. Michie (Eds.), pp. 463–502. Cited by: item 1.
- J. McCarthy, M. Minsky, N. Rochester, and C. E. Shannon A proposal for the dartmouth summer research project on artificial intelligence. Note: Technical proposal (Aug 31, 1955); reprinted/retrospective in AI Magazine 2006Founding proposal that coined the term “artificial intelligence”. Cited by: §1.
- J. McCarthy Generality in artificial intelligence. Communications of the ACM. Note: A key voice emphasizing the distinction between domain-limited AI (’weak’) and the aspiration toward general AI (’strong’). Cited by: §1.
- W. S. McCulloch and W. Pitts A logical calculus of the ideas immanent in nervous activity. The bulletin of mathematical biophysics 5 (4), pp. 115–133. External Links: ISSN 1522-9602, Link, Document Cited by: §2.3.3, §3.1.
- Merriam-Webster Etymology Artificial (etymology). Note: Accessed: 2025-10-01 External Links: Link Cited by: §1.1.
- Merriam-Webster Artificial. Note: Accessed: 2025-10-01 External Links: Link Cited by: §1.1.
- R. S. Michalski On the quasi-inductive learning: the aq approach to rule extraction. In Machine Intelligence and Pattern Recognition, Vol. 4, pp. 171–197. Note: Early work leading to AQ family of inductive rule-learning algorithms (symbolic rule induction). Cited by: §2.3.2.
- M. L. Minsky and S. A. Papert Perceptrons: expanded edition. MIT Press, Cambridge, MA, USA. External Links: ISBN 0262631113 Cited by: §3.1, §3.1.
- M. L. Minsky Steps toward artificial intelligence. Proceedings of the IRE 49, pp. 8–30. Note: Survey/position paper by Minsky summarizing early AI directions; foundational for symbolic AI External Links: Document, Link Cited by: §2.3.2.
- M. L. Minsky (Ed.) Semantic information processing. MIT Press, Cambridge, MA. Note: Edited volume containing many classic symbolic AI papers (e.g., McCarthy, Minsky chapters) External Links: Link Cited by: §2.3.2.
- I. Mirzadeh, K. Alizadeh, H. Shahrokhi, O. Tuzel, S. Bengio, and M. Farajtabar GSM-symbolic: understanding the limitations of mathematical reasoning in large language models. arXiv preprint arXiv:2410.05229. Note: Demonstrates fundamental barriers to generalizable reasoning, with complete performance collapse on complex problems External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- Mistral AI Announcing mistral 7b. Note: https://mistral.ai/news/announcing-mistral-7bOfficial release blog and model card. Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- M. Mohri, A. Rostamizadeh, and A. Talwalkar Foundations of machine learning. The MIT Press. External Links: ISBN 026201825X Cited by: §2.3.2.
- C. Molnar, G. König, J. Herbinger, T. Freiesleben, S. Dandl, C. A. Scholbeck, G. Casalicchio, M. Grosse-Wentrup, and B. Bischl General pitfalls of model-agnostic interpretation methods for machine learning models. arXiv preprint arXiv:2007.04131. Cited by: item 1.
- T. Müller, A. Evans, C. Schied, and A. Keller Instant neural graphics primitives with a multiresolution hash encoding. ACM Transactions on Graphics 41 (4), pp. 1–15. External Links: ISSN 1557-7368, Link, Document Cited by: footnote 9.
- V. C. Müller Symbol grounding in computational systems: a paradox of intentions. arXiv preprint. External Links: 2505.00002 Cited by: §1.1.
- A. Mumuni and F. Mumuni Large language models for artificial general intelligence: a survey of foundational principles and approaches. arXiv preprint. Note: arXiv:2501.03151 External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- T. Nagel Mind and cosmos: why the materialist neo-darwinian conception of nature is almost certainly false. Oxford University Press, New York. External Links: ISBN 978-0199919758 Cited by: §1.1.
- P. Nakkiran, G. Kaplun, Y. Bansal, T. Yang, B. Barak, and I. Sutskever Deep Double Descent: Where Bigger Models and More Data Hurt. arXiv. Note: arXiv:1912.02292 [cs, stat]Comment: G.K. and Y.B. contributed equally External Links: Link, Document Cited by: §2.3.3.
- NASA What is artificial intelligence?. Note: Accessed: 2025-10-01 External Links: Link Cited by: §1.1.
- A. Newell and H. Simon The logic theory machine–a complex information processing system. IRE Transactions on Information Theory 2 (3), pp. 61–79. External Links: Document Cited by: §2.3.2.
- A. Newell, J. C. Shaw, and H. A. Simon Report on a general problem-solving program. In Proceedings of the International Conference on Information Processing, pp. 256–264. Note: Description of GPS (General Problem Solver) — means-ends analysis External Links: Link Cited by: §2.3.2.
- A. Newell, J.C. Shaw, and H. A. Simon Elements of a theory of human problem solving. Psychological Review 65 (3), pp. 151–166. External Links: Document, Link Cited by: §2.3.2.
- A. Newell and H. A. Simon Computer science as empirical inquiry: symbols and search. Communications of the ACM 19 (3), pp. 113–126. Cited by: §2.3.1.
- M. A. Nowak, N. L. Komarova, and P. Niyogi Evolution of universal grammar. Science 291 (5501), pp. 114–118. External Links: Document, Link Cited by: §1.4.
- J. N. Onyeukaziri Artificial intelligence and the notions of the “natural” and the “artificial”. In Journal of Data Analysis, Vol. 17, pp. 101–116. Cited by: §1.1.
- K. Oono and T. Suzuki Graph neural networks exponentially lose expressive power for node classification. In International Conference on Learning Representations, External Links: Link Cited by: §2.3.3.
- OpenAI Inside gpt-5 for work. Note: https://cdn.openai.com/pdf/inside-gpt-5-for-work.pdfTechnical overview / PDF from OpenAI. Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- OpenAI Introducing gpt-5. Note: https://openai.com/gpt-5/OpenAI product/technical announcement (Aug 7, 2025). Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray, et al. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems 35, pp. 27730–27744. Note: Introduced RLHF for aligning language models with human preferences External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- Oxford Learner’s Dictionaries Artificial. Note: Accessed: 2025-10-01 External Links: Link Cited by: §1.1.
- M. O’Neill and C. Ryan Grammatical evolution. IEEE Transactions on Evolutionary Computation 5 (4), pp. 349–358. External Links: Document Cited by: §3.2.
- J. Pearl Causality: models, reasoning, and inference. 2nd edition, Cambridge University Press. External Links: ISBN 9780521895606, Document Cited by: item 1.
- R. Penrose and E. Severino Artificial intelligence versus natural intelligence. Springer, Dordrecht, Netherlands. External Links: Link Cited by: §2.2.
- R. Penrose The emperor’s new mind: concerning computers, minds, and the laws of physics. Oxford University Press, Oxford. External Links: ISBN 978-0198519737 Cited by: §1.1.
- R. Penrose The emperor’s new mind: concerning computers, minds, and the laws of physics. Oxford University Press. Note: Philosophical argument against the possibility of full computational emulation of human consciousness. Cited by: §1.
- R. Penrose Shadows of the mind: a search for the missing science of consciousness. Oxford University Press, Oxford. External Links: ISBN 978-0198539780 Cited by: §1.1.
- G. Peyré The mathematics of artificial intelligence. arXiv preprint arXiv:2501.10465. External Links: Link Cited by: §2.2.
- S. Pinker and P. Bloom Natural language and natural selection. Behavioral and Brain Sciences 13 (4), pp. 707–727. Note: Target article with commentaries; preprint available External Links: Link Cited by: §1.4.
- A. Power, Y. Burda, H. Edwards, I. Babuschkin, and V. Misra Grokking: generalization beyond overfitting on small algorithmic datasets. External Links: 2201.02177, Link Cited by: §2.3.3.
- H. Putnam Representation and reality. MIT Press, Cambridge, MA. External Links: ISBN 978-0262660594 Cited by: §1.1.
- P. P. Quentin FEUILLADE–MONTIXI The stochastic parrot hypothesis is debatable for the last generation of llms. Note: LessWrongProvides examples where LLMs fail basic inference with novel information, supporting the stochastic parrot critique External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- J. R. Quinlan Induction of decision trees. Morgan Kaufmann. Note: ID3 / decision-tree induction — classic symbolic learning algorithm widely used in expert systems and symbolic concept learning External Links: Link Cited by: §2.3.2.
- A. Radford, K. Narasimhan, T. Salimans, and I. Sutskever Improving language understanding by generative pre-training. OpenAI blog. Note: The original GPT paper introducing generative pre-training External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, and I. Sutskever Language models are unsupervised multitask learners. OpenAI blog 1 (8), pp. 9. Note: Introduced GPT-2, demonstrating zero-shot task transfer External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, and P. J. Liu Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research 21 (140), pp. 1–67. Note: Introduced T5, treating every NLP task as a text-to-text problem External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- S. Raza, R. Sapkota, M. Karkee, and C. Emmanouilidis TRiSM for agentic ai: a review of trust, risk, and security management in llm-based agentic multi-agent systems. arXiv preprint arXiv:2506.04133. External Links: Link Cited by: §2.
- P. M. Romer Mathiness in the theory of economic growth. American Economic Review 105 (5), pp. 89–93. Cited by: item 2.
- F. Rosenblatt The perceptron: a probabilistic model for information storage and organization in the brain.. Psychological review 65 6, pp. 386–408. External Links: Link Cited by: §2.3.3, §3.1.
- D. E. Rumelhart, G. E. Hinton, and R. J. Williams Learning representations by back-propagating errors. Nature 323 (6088), pp. 533–536. Cited by: §1.4, §2.3.3.
- S. Russell and P. Norvig Artificial intelligence: a modern approach. 3rd edition, Prentice Hall Press, USA. External Links: ISBN 0136042597 Cited by: §2.3.1, §2.3.
- S. Russell and P. Norvig Artificial intelligence: a modern approach. 3 edition, Prentice Hall. Note: Standard textbook that frames AI via agents and a taxonomy of definitions/goals. Cited by: §1.
- C. Ryan, J. J. Collins, and M. O’Neill Grammatical evolution: evolving programs for an arbitrary language. In Proceedings of the First European Workshop on Genetic Programming (EuroGP’98), LNCS, Vol. 1391, pp. 83–96. External Links: Document Cited by: §3.2.
- M. S. Ryunosuke Ishizaki Large language models: assessment for singularity. AI & Society. Note: Open access External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- D. H. Sandra Johnson A primer on large language models and their limitations. arXiv preprint arXiv:2412.04503. Note: Argues LLMs lack self-monitoring (phenomenal consciousness) and internal updatable models of their environment External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- R. Sapkota, K. I. Rosenthal, and M. Karkee AI agents vs. agentic ai: a conceptual taxonomy, applications, and challenges. arXiv preprint arXiv:2505.10468. External Links: Link Cited by: §2.
- F. d. SaussureC. Bally and A. Séchéhaye (Eds.) Course in general linguistics. Philosophical Library / Duckworth (English translations). Note: Compiled from lecture notes; classic edition/English translations include Wade Baskin (1959) and Roy Harris (1983). External Links: Link Cited by: §1.4.
- F. Scarselli, M. Gori, A. C. Tsoi, M. Hagenbuchner, and G. Monfardini The graph neural network model. IEEE Transactions on Neural Networks 20 (1), pp. 61–80. External Links: Document Cited by: §2.3.3.
- M. Scheutz (Ed.) Computationalism: new directions. MIT Press, Cambridge, MA. External Links: ISBN 978-0262692843 Cited by: §1.1.
- A. Schleicher A compendium of the comparative grammar of the indo-european, sanskrit, greek and latin languages. Trübner & Co., London. External Links: Link Cited by: §1.4.
- J. Schneider Generative to agentic ai: survey, conceptualization, and future directions. arXiv preprint arXiv:2504.18875. External Links: Link Cited by: §2.
- M. Schuster and K. K. Paliwal Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing 45 (11), pp. 2673–2681. Cited by: §1.4.
- W. Seager Frame problems, emotions and axiological projectionism. Philosophical report (). Cited by: §2.3.
- J. R. Searle Minds, brains, and programs. Behavioral and Brain Sciences 3 (3), pp. 417–457. External Links: Document Cited by: §1.1, §2.2.
- J. R. Searle Minds, brains, and programs. Behavioral and Brain Sciences 3 (3), pp. 417–457. Cited by: §1, item 1.
- J. R. Searle The rediscovery of the mind. MIT Press, Cambridge, MA. External Links: ISBN 978-0262691549 Cited by: §1.1.
- M. Sensoy, A. Kendall, and F. Esposito Is epistemic uncertainty faithfully represented by evidential deep learning methods?. arXiv preprint arXiv:2402.09056. Cited by: §2.3.
- S. Shalev-Shwartz and S. Ben-David Understanding machine learning: from theory to algorithms. Cambridge University Press, USA. External Links: ISBN 1107057132 Cited by: §2.3.2.
- S. Shalev-Shwartz, O. Shamir, N. Srebro, and K. Sridharan Learnability, stability and uniform convergence. Journal of Machine Learning Research 11, pp. 2635–2670. External Links: Link Cited by: §2.3.2.
- M. Shanahan The Frame Problem. In The Stanford Encyclopedia of Philosophy, E. N. Zalta (Ed.), Note: https://plato.stanford.edu/archives/spr2016/entries/frame-problem/ Cited by: §2.3.
- J. Shang, Z. Zheng, J. Wei, X. Ying, F. Tao, and M. Team AI-native memory: a pathway from llms towards agi. arXiv preprint. Note: arXiv:2406.18312 External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- G. I. Sher Handbook of neuroevolution through erlang. Springer. External Links: ISBN 978-1-4614-4462-6 Cited by: §3.2.
- E. H. Shortliffe Computer-based medical consultations: mycin. Elsevier, New York. Note: American Elsevier Publishing Company Cited by: §2.3.1.
- H. T. Siegelmann and E. D. Sontag Turing computability with neural nets. Applied Mathematics Letters 4 (6), pp. 77–80. External Links: Document, Link Cited by: §2.3.3.
- H. A. Simon The sciences of the artificial. 1 edition, MIT Press, Cambridge, MA. External Links: ISBN 978-0262190510 Cited by: §1.1, §1.1.
- R. J. Solomonoff A formal theory of inductive inference. part i. Information and Control 7 (1), pp. 1–22. External Links: Document, Link Cited by: §2.3.2.
- R. J. Solomonoff A formal theory of inductive inference. part ii. Information and Control 7 (2), pp. 224–254. External Links: Document, Link Cited by: §2.3.2.
- S. Song, J. Hu, and K. Mahowald Language models fail to introspect about their knowledge of language. External Links: 2503.07513, Link Cited by: §2.3.1.
- B. Sorscher, R. Geirhos, S. Shekhar, S. Ganguli, and A. S. Morcos Beyond neural scaling laws: beating power law scaling via data pruning. External Links: 2206.14486, Link Cited by: footnote 5.
- Stanford Encyclopedia of Philosophy Artificial intelligence. Note: https://plato.stanford.edu/entries/artificial-intelligence/A well-rounded survey of history, proposed definitions, and philosophy-of-AI debates. Cited by: §1.3, §1, Figure 2, §2.4, §3.2.
- K. O. Stanley and R. Miikkulainen Efficient reinforcement learning through evolving neural network topologies. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2002), Note: Winner of Best Paper Award at GECCO 2002 External Links: Link Cited by: §3.2.
- K. O. Stanley and R. Miikkulainen Evolving neural networks through augmenting topologies. Evolutionary Computation 10 (2), pp. 99–127. External Links: Document Cited by: §3.2.
- K. O. Stanley and R. Miikkulainen Competitive coevolution through evolutionary complexification. Journal of Artificial Intelligence Research 21, pp. 63–100. External Links: Link Cited by: §3.2.
- H. Su, Z. Tian, X. Shen, and X. Cai Unraveling the mystery of scaling laws: part i. External Links: 2403.06563, Link Cited by: footnote 5.
- L. A. Suchman Plans and situated actions: the problem of human–machine communication. Cambridge University Press. External Links: ISBN 0521388473 Cited by: item 1.
- I. Sutskever, O. Vinyals, and Q. V. Le Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems, Vol. 27, pp. 3104–3112. Cited by: §1.4.
- R. S. Sutton The bitter lesson. Note: Web essay / blog post External Links: Link Cited by: item 1.
- L. P. Syll Post-real economics — a severe case of mathiness. Note: Blog post, Heterodox Economic Blogs Cited by: item 2.
- C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. Goodfellow, and R. Fergus Intriguing properties of neural networks. In International Conference on Learning Representations (ICLR) Workshop, Note: preprint arXiv:1312.6199 External Links: Link Cited by: §2.3.3.
- M. Telgarsky Benefits of depth in neural networks. In Proceedings of COLT 2016, External Links: Link Cited by: §2.3.3.
- H. Touvron, T. Lavril, G. Izacard, X. Martinet, M. Lachaux, T. Lacroix, B. Rozière, N. Goyal, E. Hambro, F. Azhar, et al. LLaMA: open and efficient foundation language models. arXiv preprint arXiv:2302.13971. Note: Meta’s open foundation models ranging from 7B to 65B parameters External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- H. Touvron, T. Lavril, G. Izacard, X. Martinet, M. Lachaux, T. Lacroix, B. Rozière, N. Goyal, E. Hambro, F. Azhar, A. Rodriguez, A. Joulin, É. Grave, and G. Lample LLaMA: open and efficient foundation language models. arXiv preprint arXiv:2302.13971. External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- H. Touvron, L. Martin, K. Stone, P. Albert, A. Almahairi, Y. Babaei, N. Bashlykov, S. Batra, P. Bhargava, S. Bhosale, et al. Llama 2: open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288. Note: Updated and improved LLaMA models with better performance External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- T. Traber, A. Zech, N. Gessert, and A. Schlaefer ReLEx: regularisation for linear extrapolation in neural networks with rectified linear units. In Artificial Neural Networks and Machine Learning – ICANN 2020, pp. 170–182. External Links: Document Cited by: §2.3.
- P. Tseng and S. Yun A coordinate gradient descent method for nonsmooth separable minimization. Mathematical Programming 117 (1), pp. 387–423. External Links: Document Cited by: §2.3.3.
- P. Tseng Convergence of a block coordinate descent method for nondifferentiable minimization. Journal of Optimization Theory and Applications 109 (3), pp. 475–494. External Links: Document Cited by: §2.3.3.
- A. M. Turing Computing machinery and intelligence. Mind 59 (236), pp. 433–460. Note: Classic proposal of the “Imitation Game” (Turing Test). Cited by: §1, §2.
- M. S. Uddin Stochastic parrots: a novel look at large language models and their limitations. Towards AI. Note: Models are not capable of true reasoning or understanding, prone to errors and biases, and perpetuate stereotypes External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- L. G. Valiant A theory of the learnable. Commun. ACM 27 (11), pp. 1134–1142. External Links: ISSN 0001-0782, Link, Document Cited by: §2.3.2.
- L. G. Valiant A theory of the learnable. Communications of the ACM 27 (11), pp. 1134–1142. External Links: Document, Link Cited by: §2.3.2.
- V. N. Vapnik and A. Ya. Chervonenkis The uniform convergence of the frequencies of events to their probabilities. Doklady Akademii Nauk SSSR 181 (4), pp. 781–783. Note: Translated & extended in Theory of Probability & Its Applications 1971 External Links: Link Cited by: §2.3.2.
- V. N. Vapnik and A. Ya. Chervonenkis On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability & Its Applications 16 (2), pp. 264–280. External Links: Document, Link Cited by: §2.3.2.
- V. Vapnik The nature of statistical learning theory. Springer: New York. Cited by: §2.3.2.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin Attention is all you need. In Advances in Neural Information Processing Systems, Vol. 30, pp. 5998–6008. Note: NeurIPS 2017. The foundational paper introducing the Transformer architecture External Links: Link Cited by: §1.4, Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI, Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- T. Villani How close is agi actually? why llms alone will not get us to agi. New Jersey Innovation Institute. Note: Argues recent NLP advancements, while remarkable, do not constitute a path to AGI External Links: Link Cited by: Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI.
- E. Volná Evolutionary
Foundations of Artificial Intelligence Frameworks: Notion and Limits of AGI
Within the limited scope of this paper, we argue that artificial general intelligence cannot emerge from current neural network paradigms regardless of scale, nor is such an approach healthy for the field at present. Drawing on various notions, discussions, present-day developments and observations, current debates and critiques, experiments, and so on in between philosophy, including the Chinese Room Argument and G…
- Licence
- OPEN CC-BY-4.0
- Authors
- Khanh Gia Bui
- Published
- 2025-11-23 · arXiv
- Language
- en
- Length
- 36705 words
- Type
- narrative text
Cites 147 works
inferredOne description, two standard projections
Built from what the sources declared and what the gates observed. Nothing absent has been filled in here. 1 value read out of the text by the enrichment rules and 147 links to or from other resources — a lab's files, the pages it links, the works it cites stand under their elements, marked inferred, and are kept apart in the exports.
- Profile
aimpro-oer-profile/1built 2026-10-09- Content language
- en declared English
Identity 3/3
Responsibility 1/3
Content 3/5
Rights 3/4
Form and dates 3/10
Relations and custody 1/9
1 General 5/8
2 Life cycle 2/3
3 Meta-metadata 4/4
4 Technical 3/7
5 Educational 1/11
6 Rights 3/3
7 Relation 0/2
8 Annotation 0/3
9 Classification 0/4
What could not be established3
| Status | Field | Why |
|---|---|---|
| Not available | rights_holder |
no rights holder is named at source; the licence is recorded without one rather than attributed to the platform that served it |
| Not available | publisher |
the source named no publisher of the work; where it was collected from is recorded as collection provenance instead, which is a different claim |
| Not available | educational |
the source declared no educational metadata — no resource type, audience, context, difficulty or learning time. Nothing here estimates them |