doi: 10.3389/fncom.2024.1395901.
eCollection 2024.
Affiliations
Item in Clipboard
Front Comput Neurosci.
.
Abstract
There have been impressive advancements in the field of natural language processing (NLP) in recent years, largely driven by innovations in the development of transformer-based large language models (LLM) that utilize “attention.” This approach employs masked self-attention to establish (via similarly) different positions of tokens (words) within an inputted sequence of tokens to compute the most appropriate response based on its training corpus. However, there is speculation as to whether this approach alone can be scaled up to develop emergent artificial general intelligence (AGI), and whether it can address the alignment of AGI values with human values (called the alignment problem). Some researchers exploring the alignment problem highlight three aspects that AGI (or AI) requires to help resolve this problem: (1) an interpretable values specification; (2) a utility function; and (3) a dynamic contextual account of behavior. Here, a neurosymbolic model is proposed to help resolve these issues of human value alignment in AI, which expands on the transformer-based model for NLP to incorporate symbolic reasoning that may allow AGI to incorporate perspective-taking reasoning (i.e., resolving the need for a dynamic contextual account of behavior through deictics) as defined by a multilevel evolutionary and neurobiological framework into a functional contextual post-Skinnerian model of human language called “Neurobiological and Natural Selection Relational Frame Theory” (N-Frame). It is argued that this approach may also help establish a comprehensible value scheme, a utility function by expanding the expected utility equation of behavioral economics to consider functional contextualism, and even an observer (or witness) centric model for consciousness. Evolution theory, subjective quantum mechanics, and neuroscience are further aimed to help explain consciousness, and possible implementation within an LLM through correspondence to an interface as suggested by N-Frame. This argument is supported by the computational level of hypergraphs, relational density clusters, a conscious quantum level defined by QBism, and real-world applied level (human user feedback). It is argued that this approach could enable AI to achieve consciousness and develop deictic perspective-taking abilities, thereby attaining human-level self-awareness, empathy, and compassion toward others. Importantly, this consciousness hypothesis can be directly tested with a significance of approximately 5-sigma significance (with a 1 in 3.5 million probability that any identified AI-conscious observations in the form of a collapsed wave form are due to chance factors) through double-slit intent-type experimentation and visualization procedures for derived perspective-taking relational frames. Ultimately, this could provide a solution to the alignment problem and contribute to the emergence of a theory of mind (ToM) within AI.
Keywords:
QBism; consciousness; double slit experiment; functional contextualism; hypergraph; large language model; predictive coding.
Copyright © 2024 Edwards.
Conflict of interest statement
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Figures
Figure 1
(A) An illustration of word embeddings; and (B) a simplified representation of panel (A) used in Figures 3–5.
Figure 2
(A) An illustration of unique to LLMs positional encoding for the inputted word “is” using sine and cosine waves. Panel (B) illustrates that the word embedding values plus the position values give a unique positional encoding for input words such as “is.” Note, this process would be repeated for each input word giving a unique positional encoding for each input word.
Figure 3
An illustration of how LLM’s use masked self-attention via dot product to calculate the similarity of Query, Value, and Key vectors within the multihead attention layer.
Figure 4
A simplified illustration of a transformer-based (decoder only) LLM model, highlighting the residual connection between the input layer directly to the masked self-attention values, which are connected to a feed forward neural network to create values for the final verbal text output via a SoftMax function.
Figure 5
A simplified summarized illustration of a transformer-based (decoder only) LLM model, highlighting the stages of word embeddings, positional encodings, masked self-attention, residual connections, and feedforward output network.
Figure 6
(A) Sample Python code for a derived relation “greater than.” (B) A simple visualization of this Python code for a derived relation “greater than” using matplotlib.
Figure 7
A RFT (or N-Frame) and ACT values modified version of the decoder only transformer LLM, which now includes a policy network (agent), an ACT-based values estimation, a utility estimation based form the ACT-based values, and a perspective-taking unit within a neurosymbolic layer to guide token selection toward contextually relevant prosocial human values that should encourage compassionate deictic perspective-taking responding.
Figure 8
A simple schematic illustration of how perspective-taking ToM (“I see”) involves the combination of several relational frames to build a hierarchical perspective-taking event of another person.
Figure 9
Illustrative process-based hypergraph of perspective-taking relational frames for the theory of mind “I see you” function. Red coordination, green hierarchy, purple temporal, orange spatial, dash purple spatial–temporal connection, dashed red transformation of function, and brown dashed new perspective-taking relations.
Figure 10
Clustered graph with perspective-taking relational frames (DBSCAN clustering) hypergraph; two clusters, blue and orange.
Figure 11
(A) Clustered hypergraph with perspective relational frames (DBSCAN, mass represented by node size). Cluster 0 (Person A): Density = 0.60, Volume = 52, Mass = 31.20: (Person B) Density = 1.33, Volume = 5, Mass = 6.67; Cluster 1; (B) Replicator equation simulation of N-Frame, whereby more densely populated clusters (higher density) become evolutionary dominant over time (i.e., person A and B perspective-taking in blue clustering and not person C who has minimal perspective-taking as clustered in orange.
Figure 12
An illustration that the brain generates a “map” as defined by predictive coding and evolutionary theory. This represents the reality that we see for our internal observer perspective
Figure 13
(A1–E) Impossible structures (or objects) based on continuous self-referential loop paradoxes (internal only observer), whereby the internal observer can get caught in paradoxes that have no beginning or end.
Figure 14
An updated illustration of Penrose’s theory of the three worlds (like three sides of a three sided coin), the interface comprises of a triaspect monism, which highlights the circular relation of the platonic world
Figure 15
(A) Plato’s cave, whereby the external observer projects a showdown onto a wall so that the internal observer can only observe the projection (the map) and not the source information (the territory). (B) Metaphorically how two separate people can interface (through evolution theory) with the world in different ways, on the left the woman observes a world that is bleak and without a clear path forward, while the woman on the right observes a world that is full of beauty and purpose. Adobe stock images from users (A, top) matiasdelcarmine, (B, left) Aksana, and (B, right) terra.incognita, with permission.
Figure 16
(A) A simple schematic representation of a Markov blanket containing sensory, internal, and active. (B) The Markov blanket of a cell whereby states can be thought of as a series of sets with a clear Markov boundary between internal (inner) states and external (outer) states. (C) The Markov blanket ensemble dynamics of internal, sensory, active, and external states of the brain and its environment.
Figure 17
(A) Special relativity light cone represented from the perspective of the conscious subjective observer
Figure 18
(A) An interference pattern observed in the classic Young double slit experiment whereby the photon evolving through the double slits behaves like a wave rather than a particle, leading to an interference pattern. (B) A modified version of the classic Young Double slit experiment whereby a photoelectric detector is placed at the entry point of the double slits, and this placement of detectors leads to the photon behaving more particle-like, leading to a two-band diffraction pattern. (C) A modified version of the classic Young Double slit experiment whereby a photoelectric detector is placed at the exit point of the double slits (usually with an interferometer set up), and this placement of detectors also leads to the photon behaving more particle-like leading to a two-band diffraction pattern despite not detecting which slit the photon traveled through, this effect changes to an interference pattern when the information is “erased.” Adobe stock images (A,B, and left part C) from user LuckySoul with permission.
References
-
-
Aaronson S. (2013). The ghost in the quantum turing machine. Mind. Mach. 23, 411–442. doi: 10.48550/arXiv.1306.0159
–
DOI
-
-
-
Allday J. (2009). Quantum Reality. Theory and Philosophy. Boca Raton Fla./London/New York.
-
-
-
Allday J. (2022). Quantum Reality: Theory and Philosophy. New York: CRC Press.
-
-
-
Armstrong D. M. (2018). The Mind-Body Problem: An Opinionated Introduction. Oxfordshire, UK: Routledge.
-
Grants and funding
The author declares that no financial support was received for the research, authorship, and/or publication of this article.
