1. Introduction
Qualitative topological spatial and temporal reasoning is one of the core pieces of the research agenda of spatial information science (
Figure 1) [
1]. For four decades, research has been conducted to provide the theoretical tools to software developers to enhance the infrastructure of powerful spatial information systems, including formal models [
2,
3,
4,
5,
6,
7,
8], relation sets [
9,
10,
11,
12,
13,
14], data structures [
15,
16,
17,
18], analysis techniques [
19,
20,
21,
22,
23,
24], artificial intelligence applications [
25,
26], and many other aspects. While the ecosystem for qualitative topological reasoning is diverse and prolific, not all of the important theoretical innovations over the past few decades have made their way into modern software. At the dawn of an age of geographic artificial intelligence [
25], it is essential to integrate all available spatial and temporal reasoning insights into AI systems with the hope that that will result in interpretable, verifiable conclusions in terms that humans naturally understand. One fundamental aspect of that is of course natural language, foundational to human-computer interaction in these applications [
26,
27,
28,
29].
Geographic concepts are traditionally analyzed in static terms in typical geographic information systems, but this approach overlooks the temporal dimension that is fundamental to understanding spatial phenomena [
30]. Fundamentally, geographic information science is a direct application of a broader concept: spatial information science [
1,
31,
32,
33]. Time represents an added dimension to our physical world, mathematically applied symbolically as a cross-product of an existing space and a temporal dimension [
14,
34] (
Figure 2). On a technical level, such a concept motivates the spatio-temporal stack data structure [
18], also theoretically referred to as the space-time cube. Time is fundamentally a language of change, and to fully comprehend a spatial event, in many cases temporal relations prove pivotal, yet GIS solutions minimally implement qualitative temporal reasoning directly.
To realize a spatial-temporal decision support system, it is imperative to understand the concepts behind how humans understand their environments cognitively [
38]. One crucial aspect of this is found in topology [
27,
28,
29]. Topology serves as the backbone for a large set of decisions, manifest in our spoken and written languages through prepositions [
39]. Prepositions apply to both space (such as
inside) and time (such as
during). These terms differ only in their semantics:
inside implies a physical container object, while
during implies a containing temporal interval. When we consider intervals as objects, these two concepts become intuitively one and the same. These prepositions are what we might consider
topological primitives, namely that they represent a mathematically explicit concept endowed in an image schemata [
40]. Other prepositions behave differently, for example the spatial term
along [
26,
28]. This term takes certain members from various topological relations (in this case
disjoint,
meet,
overlap,
coveredBy, and
inside) and combines them into a specific term. Such a term is difficult for an information system to derive because of the humanistic nature of the categorization itself. Other terms such as
within [
41] are direct aggregates of topological primitives and are far easier to construct computationally. Terms of the latter two types benefit from aggregating similar relations, and to do that effectively, it is important to define similarity of concepts, in essence, constructing an ontology of spatial relations [
42].
The conceptual neighborhood graph is a tool that has been developed to construct models of similarity among qualitative relation sets [
19]. Conceptual neighborhood graphs organize the members of a qualitative relation set into a network where the nodes of the network represent relations and the edges represent a topological change under minimal units of modification called deformations. Conceptual neighborhood graphs have received a lot of attention over the last 30 years, with conceptual neighborhood graphs appearing in either the same article as the relation set (e.g., [
43]) or as separate articles (e.g., [
10,
24]). On top of this, researchers have considered new structures of conceptual neighborhood graphs, including matrix difference neighborhoods [
44], aggregates of multi-granular neighborhoods [
45], intersection and union neighborhoods [
46], and non-homeomorphic deformation neighborhoods [
47]. While conceptual neighborhood graph research may seem archaic to some, the topic has seen a revolution with respect to the big data world and the growth of spatio-temporal artificial intelligence [
25,
26]. This research specifically acknowledges the variety inherent in big data, and that variety leads to a definitive need for data integration, which may need to invoke discretization neighborhoods [
24,
26,
48] and may also need to translate topological primitives into other terms and vice versa [
26,
28].
The spatio-temporal stack (such as in
Figure 2(a) and 2(c)) specifically creates an environment in which time is discretized [
18]. To work with this reality, a set of discretized temporal relations were constructed [
14]. This relation set consists of a sizable collection of 74 relations. While this may be larger than practically needed or even cognitively plausible to invoke in human thought, this result was a purely theoretical exercise: can this circumstance exist in that embedding space? To further refine that theory, conceptual neighborhood graphs provide the mechanism for determining neighboring concepts, and thus pertinent aggregations [
28]. As such, it is imperative to engage in the work of determining the conceptual neighborhood graphs for this relation space. Prior work regarding spatio-temporal stack architectures did not embark on providing a query processing strategy against the structure itself that would leverage the temporal dimension [
35], thus this work starts to fill a missing link. While the tools exist to ask a question such as “find all objects that
overlap one another,” [
41] it is a different question altogether to pose “find all objects that
overlap one another which
start an event where a specific object
contains another specific object.” To answer this question, knowledge of both spatial [
4,
12] and temporal relations [
9,
14] are needed, and given that a human is asking the question, precisely what is meant by
start [
26] is also fundamental to that pursuit as well insofar as
start may mean something different to different individuals without one being in error. This means that information systems to be fully human-forward need mechanisms to help users customize their query outcomes, and the most logical aggregation structures in the research are conceptual neighborhood graphs [
28,
29].
It is this last piece of the query (what is meant by start) where this paper provides its merit. In this paper, the conceptual neighborhood graphs for translation, anisotropic scaling, and isotropic scaling are derived from simulation data upon a pair of discretized lines embedded within . Using SQL queries upon the output data, neighboring concepts are identified based on the appropriate criteria, inducing the query through the criteria necessary to identify the appropriate change in the dataset. The outcome of such a process provides both the logic for querying a spatio-temporal data structure, but also the options a user can customize over.
The remainder of the paper is structured as follows.
Section 2 introduces the basic mathematical definitions necessary for understanding the 9-intersection [
4] and the 9+-intersection [
49], adapted from the paper that defines the set of relations in the set [
14].
Section 3 introduces the set of 74 discretized temporal relations [
14].
Section 4 introduces the literature pertaining to conceptual neighborhood graphs [
19].
Section 5 describes the simulation protocol and query procedure leveraged to construct the dataset (adapted from [
24,
48]).
Section 6 presents the three conceptual neighborhood graphs for the discretized temporal relations.
Section 7 analyzes the output conceptual neighborhood graphs with specific attention paid to their relationship to the neighborhood graphs of the Allen interval algebra [
9,
19].
Section 8 provides discussion, conclusion, and calls for future work.
2. Foundational Mathematics for the Paper
Conceptual neighborhood graphs cannot exist without the relations that serve as nodes within them. In this paper, we will be working with the set of digital interval relations in
and their corresponding temporal analogs. This section will loosely follow the foundational mathematics necessary for understanding the relations from the literature [
14]. The subsequent section will focus on the relations themselves, built upon the principles in this section.
The mathematics underlying qualitative topological relations in the 9-intersection family adapts concepts from point-set and algebraic topology to achieve practical usability [
4,
50] while maintaining mathematical rigor. This section presents the point-set topology foundations [
51] that we adapt for digital lines in ℤ¹ [
14]. We begin with Definitions 1-4 because they align with intuitive spatial concepts—inside, outside, and edge—making them the most accessible starting point [
27].
Definition 1 (Interior): Let A be a set of points within a topological space X.
The interior of A, denoted, is the largest open set from the topological space X contained within A.
Definition 2 (Exterior): Let A be a set of points within a topological space X.
The complement of the set A, denoted by, represents the exterior of the set.
Definition 3 (Closure): Let A be a set of points within a topological space X.
The closure of the set A, denoted, is the smallest closed set from the topological space X, that contains A.
Definition 4 (Boundary): Let A be a set of points within a topological space X.
The boundary of the set A, denoted, is the set.
The interior, boundary, and exterior of an object form the vocabulary for the 9-intersection matrix, the foundational framework for spatial query systems in modern software [
4]. As shown in Equation (1), the 9-intersection matrix systematically compares each of the three topological components of object
A (rows) against each of the three components of object
B (columns), yielding nine pairwise intersection tests.
The structure and definition of the topological components in the 9-intersection family of models depends upon the topology of the embedding space and how one defines interior, boundary, and exterior, making this family of formalisms extremely flexible for practical application in information systems. For example, in continuous space (ℝ²), a circular region’s boundary is its perimeter (a continuous curve), while in raster space (ℤ²), the boundary could have several different definitions, one of which consisting of discrete edge pixels [
10,
12,
13,
14]; despite these different interpretations, both use the same 9-intersection framework.
This flexibility supports two approaches. First, practitioners can apply formal topological methods when objects and embedding spaces have matching dimensionality (co-dimension 0), such as two-dimensional regions in two-dimensional space or one-dimensional line segments in one-dimensional space. Second, they can engineer simplified frameworks for objects in higher-dimensional spaces by treating them as their lower-dimensional equivalents. For instance, a road network (one-dimensional lines) on a two-dimensional map can be analyzed using one-dimensional interval topology, avoiding the complexity (and also limitations) of full two-dimensional spatial relations.
A common example of this phenomenon is the cartographic generalization technique for roads or rivers (converting them to linear features) on a two-dimensional map. This transformation to make intuitive topological sense applies topological understanding from the one-dimensional interval approach by ignoring one spatial dimension. This “dimensional reduction” lets analysts apply well-understood one-dimensional interval algebra instead of resorting to the role of a linear or point feature in a two-dimensional space topologically as a component of a boundary. This approach is shown in
Figure 3.
The 9-intersection formalism was designed for simple objects and provides binary information (yes or no) about each intersection. Simple objects, in the most straightforward sense, have connected interiors, connected boundaries, and connected exteriors. Linear objects inherently violate this definition because their endpoints are separated from one another—you cannot travel from one endpoint to the other by staying on the boundary alone. Similarly, the line segment itself divides the exterior into two disconnected regions (before and after), as illustrated in
Figure 4.
Certain objects have topological components that are inherently disconnected—where portions of the interior, boundary, or exterior are separated from one another. Linear features demonstrate this property universally: a line segment always has two separated boundary points (start and end), whether embedded in one-dimensional, two-dimensional, or higher-dimensional space. The 9⁺-intersection matrix [
49] was developed to address precisely these cases where standard 9-intersection assumptions of connected components break down.
The 9⁺-intersection formalism describes diverse object types by decomposing their topological components into regular prototypical pieces. Equation (2) shows an example for two objects, each having disconnected boundaries and disconnected exteriors—a configuration that precisely characterizes intervals in one-dimensional embedding space. Although the 9⁺-intersection can express far more complex objects, this particular 5×5 structure is essential for
Section 3 because digital line segments possess exactly these features: disconnected exterior regions with temporal meaning ((−<) representing “before” and (−>) representing “after”)), plus two separated boundary points (∂^< for start and ∂^> for end), each with distinct semantic significance.
Figure 5 illustrates this configuration.
For the remainder of this paper, the partitions of the boundary and exterior of an object (where applicable) will follow these naming conventions.
Table 1.
Symbology lookup for Equation (2).
Table 1.
Symbology lookup for Equation (2).
| Symbol |
Meaning |
Component Type |
|
before A |
left exterior of A |
|
start of A |
left boundary of A |
|
during A |
interior of A |
|
end of A |
right boundary of A |
|
after A |
right exterior of A |
|
before B |
left exterior of B |
|
start of B |
left boundary of B |
|
during B |
interior of B |
|
end of B |
right boundary of B |
|
after B |
right exterior of B |
Equations (1) and (2) set the stage to develop the specific set of realizable discretized temporal relations (i.e., 9+-intersection symbols) between two discretized temporal intervals (i.e., connected elements of
) [
14] described in
Section 3.
3. Discretized Temporal Relations
Temporal relations represent some of the earliest (and also most recent) work within the geographic information science community. As with the history of most formalisms for object relation sets, the vectorized sets came first, then followed by discretized versions (e.g., [
9] and [
14], [
10,
12,
50], and [
13,
43]).
The Allen interval algebra serves as the foundation for studies of temporal relations in an abstract sense [
9]. Allen’s work specified intervals by their starting and ending points in
. Allen explored the 25 possible sequences of boundary points and determined that 13 of those relations were realizable given basic constraints about boundary points simultaneously occupying either the starting or ending point of the other boundary (eliminating two candidates) and that the ending point of an interval must naturally come after its starting point (eliminating a further ten candidates). The resulting relations are shown in
Table 2.
The relations in
Table 2 have a definitive relationship to one another. Relations such as
before and
after are temporally inverted relations. These relations consider the mirror image of the relation. In continuous spaces, this is related to converse relations: if
a is
before b, then it is directly implied that
b is
after a. This set of relations is comprised of five temporally inverted pairs and an additional three relations that are self-inverted (or temporally symmetric) (
equal, inside, contains), as shown in
Table 3 [
9].
The Allen interval algebra became the springboard by which to consider minimum bounding rectangle relations [
6], direction relations [
7,
8,
53], but also (more importantly for this paper) discretized temporal intervals [
14]. To maintain starting and ending points that are part of the accessible space, the digital Jordan curve [
3] was chosen to represent these intervals in
. Given this definition, it is possible for an object to consist of only boundary, a similar result to discretized region-region relations in
[
12]. With the assertion that an interval object must have distinct starting and ending points, a series of constraints were applied in a constraint sieve to isolate verifiable relations between intervals in
based on their 9-intersection and 9+-intersection symbols [
14]. The constraint sieve identified 34 relations (with an additional eight relations present if considering touching relations) in the 9-intersection are shown in
Table 4 [
10,
14].
As seen in
Table 3, the relations in
Table 4 have temporal analogs, just as their continuous counterparts do. They can be constructed by considering a mirror image of the space. Symbolically, this means that the 9+-intersection is transformed in the following manner:
This will not change the 9-intersection relation, and it furthermore constructs distinct relations for 32 of the 42 non-ordered line-line relations, creating a total of 74 9+-intersection relations [
14]. Theorem 1 describes why the 9-intersection relation is equivalent for temporally ordered relations. Theorem 2 addresses that there are exactly two configurations for outcomes of Equation (3).
Definition 5.
A relation is called temporally symmetric if the relation is unchanged by exchanging its before and after components in the 9+-intersection for objects A and B as expressed in Equation (3), namely . Otherwise, the relation is called temporally invertible.
Theorem 1. Consider the matrix transformation t in Equation (3). The matrix transformation does not influence the 9-intersection matrix.
Proof. The 9-intersection matrix (Equation (1)) can be derived from the 9+-intersection matrix (Equation (2)) by identifying if there is a non-empty intersection in any cell of the 9+-intersecfion that would map back to the cells in the 9-intersection. Based on the configuration in Equation (2), the corresponding cell mapping between Equation (2) and Equation (1) is shown in Equation (4):
The transformation in Equation (3) represents a horizontal and then vertical flip of the 9+-intersection in Equation (2), effectively rotating the matrix 180 degrees. When this is accomplished, the cell holds a very similar structural position to what it held before, just in a mirrored position within the matrix. Since Equation (4) is both vertically and horizontally symmetric, any transformation that flips the original matrix horizontally or vertically will be maintained under this transformation, and this is precisely what Equation (3) does twice in succession. Exchanging the before components of A within the relation for the after components of A results in a vertical flip; exchanging the before components of B with the after components of B results in a horizontal flip.
Theorem 2.
Consider the matrix transformation from Equation (3).is its own inverse.
Proof. Temporally symmetric relations have the function t as an identity function. If we consider what the function itself represents as an action, it is intuitive that Equation (3) is its own inverse. As discussed in Theorem 1, Equation (3) represents a horizontal flip followed by a vertical flip of the input matrix m, with each flip representing the exchange of the before and after components of objects A and B. For a function to be its own inverse, reapplying the function must result in the original input. Flipping the values back again reverts both objects to their original configuration. Since the 9+-intersection is unique for a drawn scenario, .
Theorem 2 dictates that a relation either is temporally symmetric, or it is directly paired with another relation in the set as a temporal inverse. Because
m exists,
t(
m) must also fit the same criteria from the constraint sieve. Since
t(
m) is its own inverse, Theorem 2 dictates that the chain stops there. The resulting relations from the temporal folding are shown in
Table 5.
Table 5 shows each pair of relations as suggested by Theorem 2. It is clear that there is an organizing principle connecting the relations together. If a relation is converse, red relations become yellow, while blue and green remain blue and green. If a relation is temporally inverted, its color remains the same. This set of relational images, identified by 9+-intersection matrices [
49], forms the vocabulary for the remainder of this paper. Relations in subsequent sections of the paper will be identified based on their names from
Table 4 and
Table 5 as appropriate.
4. Conceptual Neighborhood Graphs
Relation sets (such as in
Section 3) form the vocabulary of qualitative topological reasoning. These features become critical features of human-centric query systems [
43,
54]. The vocabulary of a relation set, however, is not enough. There is an implicit set of relationships between the relations themselves insofar as when an object is deformed in a certain way, there are predictable behaviors exhibited in the configurations of those relations that describe the next configuration(s). The research outcome that describes this deformational pathway is called the
conceptual neighborhood graph [
19].
Freksa [
19] first utilized the conceptual neighborhood graph principle to explain the relationships between the Allen interval algebra relations under three specific conditions (
Figure 6):
anisotropic scaling, namely one of the objects has a boundary point moved, while the other three boundary points in the scene remain fixed (called the A neighborhood),
translation, namely one of the objects moves without changing its duration while the other is unaltered (called the B neighborhood), and
isotropic scaling, namely one of the objects grows (or shrinks) the same amount at each boundary point while the other remains unaltered (called the C neighborhood).
In essence, whenever a change in relation is encountered between the prior state and the modified state as a function of a particular deformation to an object, an edge is constructed in the conceptual neighborhood graph. The three conceptual neighborhood graphs are shown in
Figure 7.
It is important to recognize that these three distinct conceptual neighborhood graphs are necessarily different from one another. The differences in the conceptual neighborhood graphs are the direct result of the type of allowable deformation. To highlight what is occurring, consider the relation
equal. If two objects that start as
equal have one of the four boundary points move (without loss of generality, one of
A’s boundary points), the direction of movement will change the relation in each case to something different. One pair of boundary points will however remain fused together. This particular deformation changes
equal to either
starts,
started by,
finishes, or
finished by depending upon which boundary point is moved. This is shown in
Figure 7(a). If that same
equal configuration undergoes translation, if object
A moves left, it now
overlaps object
B. Similarly, if it moves right, it now is
overlapped by object
B. This is shown in
Figure 7(b). Finally, if an equal object grows in both directions, it will now
contain object
B. Similarly, if it shrinks, it will now be
during object
B. This is shown in
Figure 7(c). As such, the structure of the specific conceptual neighborhood graph is fully dependent upon the type of deformation(s) allowed. An edge exists if and only if under that particular deformation (or deformations in a multi-option scenario [
46]), the specific relation can be converted to the connected relation without going through an intermediary step first.
Several other ways of envisioning conceptual neighborhood graphs have been found in the literature over the last 30 years. Examples of these innovations include accounting for changes to the topological structure of an object by adding holes or separations [
47], least matrix difference [
44], intersections and unions of conceptual neighborhood graphs to reflect various purposes [
46], mixed granularity neighborhoods [
45], discretization neighborhoods [
24,
48], and association rules mining neighborhood graphs [
24,
48]. Independent of the type of conceptual neighborhood graph, rules exist to define what constitutes an edge in the graph.
As this paper progresses, the relations from
Table 4 and
Table 5 will be placed into conceptual neighborhood graphs, with the hypothesis that these graphs will mirror the results from
Figure 7.
5. Simulation Protocol
Recent advances in conceptual neighborhood graphs involve discretized relations. Hall and colleagues [
24,
48] constructed conceptual neighborhood graphs in
using a simulation protocol that involved fixing a discretized object in
of a fixed size and systematically moving another object of fixed size pixel by pixel throughout an embedding grid. After the configuration was finished, the embedding was reset, with one of the objects changing its dimensions, and the process continued. This process continued until all possible configurations were completed between discretized rectangles. This simulation protocol is summarized in
Figure 8 as applied to a subspace of
large enough to bound a particular object on either side of another ground object
A.
. The only difference in the approaches is that the second dimension from the original protocol is not considered.
The simulation protocol requires several parameters to ensure complete relational coverage while limiting computational overhead. Based on prior research [
24,
48], we set the maximum interval size to
s = 10 pixels, as no new relations emerge between two-dimensional raster objects beyond this size. This finding transfers to one-dimensional intervals, allowing us to constrain the search space.
The embedding array size (
a = 32) follows from the formula:
This ensures sufficient space for: (1) a maximum-size interval for object
A, (2) a maximum-size interval for object
B, and (3) enough exterior space on both sides to represent the
before and
after relations without boundary contact (e.g., B1 and A1 from
Table 5).
The fixed object position (p = 12) is determined by:
This placement allows a moving interval to occupy any position from fully before the fixed interval (including a gap) to fully after it, covering all spatial configurations including the relational extremes of before and after.
To uniquely identify each intersection component, we encode object
A as integer values (0 for exterior, 1 for boundary, 2 for interior) and object
B as decimal values (0.0 for exterior, 0.1 for boundary, 0.2 for interior). Their sum produces a unique signature for each of the nine 9-intersection components, following the encoding method demonstrated in [
24,
48].
All other implementation details—such as the iteration order over positions and interval lengths—are arbitrary provided the simulation achieves complete coverage of the four-dimensional parameter space ⟨length₁, length₂, position₁, position₂⟩.
This dataset records the duration of each object, the position of the moving object, and the topological relation between the two interval objects. With this data, an SQLite database was queried to extract relations symbolic of each relevant homeomorphic deformation based on information in the rows of the dataset, consistent with Hall and colleagues [
24].
Similar to the prior protocol, when defining each conceptual neighborhood graph, two possible types of neighbors could exist:
persistent neighbors and
coincidental neighbors. Persistent neighbors are neighbors such that when both relations can exist at a particular pair of durations of their constituent objects, they are always neighbors. A good example of this would be relations such as
before and
meets from the Allen interval algebra. Coincidental neighbors are just that: they happen by chance, but they are not always neighbors under all configurations where those relations are available. An example of that phenomenon would be
overlapMeet and
overlapCovers from the region-region relations in
[
24,
48]. These are only neighbors where the size of at least one of the objects is insufficient to support
overlap, the appropriate intermediary relation that would be expected from continuous space [
43,
55]. We are interested predominantly in persistent neighbors in this paper.
Each homeomorphic deformation type (
Section 4) produces a distinct signature in the simulation data based on how position and length change between consecutive states. These signatures enable systematic extraction of conceptual neighbors through SQL queries. These signatures are as follows:
- ○
-
Translation- moves an interval without changing its size:
- ▪
Position changes by ±1
- ▪
Length remains constant
- ○
-
Isotropic scaling -expands or contracts the interval symmetrically from its center:
- ▪
Growth: length increases by 2 (one pixel each side), position decreases by 1 (center shifts left)
- ▪
Shrinkage: length decreases by 2 (one pixel each side), position increases by (center shifts right)
- ○
-
Anisotropic scaling - extends or contracts the interval from one endpoint:
- ▪
Left extension: length +1, position -1 (start point moves left)
- ▪
Right extension: length +1, position unchanged (end point moves right)
- ▪
Left contraction: length -1, position +1 (start point moves right)
- ▪
Right contraction: length -1, position unchanged (end point moves left)
Each of these deformation patterns translate directly into SQL join conditions. Equations (7)–(9) show queries that identify conceptual neighbors by matching these signatures in the simulation data. Translation is shown in Equation (7); isotropic scaling is shown in Equation 8; anisotropic scaling is shown in Equation (9).
SELECT S1.Relation, S2.Relation
FROM Simulation AS S1 INNER JOIN Simulation AS S2
ON ((S1.X=S2.X+1 OR S1.X = S2.X-1) AND S1.L1=S2.L1 AND S1.L2=S2.L2)
WHERE S1.Relation != S2.Relation (7)
SELECT S1.Relation, S2.Relation
FROM Simulation AS S1 INNER JOIN Simulation AS S2
ON ((S1.X=S2.X+1 AND S1.L1=S2.L1-2 AND S1.L2=S2.L2) OR (S1.X=S2.X-1 AND S2.L1+2 AND S1.L2=S2.L2) OR (S1.L2=S2.L2-2 AND S1.X=S2.X-1) OR (S1.L2=S2.L2+2 AND S1.X=S2.X+1))
WHERE S1.Relation != S2.Relation (8)
SELECT S1.Relation, S2.Relation
FROM Simulation AS S1 INNER JOIN Simulation AS S2
ON ((S1.X=S2.X AND S1.L1=S2.L1+1 AND S1.L2=S2.L2) OR (S1.X=S2.X AND S1.L1=S2.L1-1 AND S1.L2=S2.L2) OR (S1.X=S2.X-1 AND S1.L1=S2.L1+1 and S1.L2=S2.L2) OR (S1.X=S2.X+1 AND S1.L1=S2.L1-1 AND S1.L2=S2.L2) OR (S1.L2=S2.L2-1 AND S1.L1=S2.L1 AND S1.X=S2.X) OR (S1.L1=S2.L1+1 AND S1.L1=S2.L1 AND S1.X=S2.X) OR (S1.L2=S2.L2+1 AND S1.L1=S2.L1 AND S1.X=S2.X+1) OR (S1.L2=S2.L2-1 AND S1.L1=S2.L1 AND S1.X=S2.X-1)
WHERE S1.Relation != S2.Relation (9)
Although generated through simulation, this dataset is theoretically complete and fully representative due to the finite nature of discrete spaces. In discrete embeddings, the set of possible relations reaches closure—no new relations emerge beyond a certain object size, and consequently, no new conceptual neighbor pairs emerge either. This closure property eliminates the need for formal algebraic proofs, though such proofs remain theoretically feasible. The structural constraints of intervals in one-dimensional discrete space severely limit configurational possibilities, making exhaustive enumeration through simulation both practical and sufficient.
6. Results
The SQL queries from
Section 5 create a set of records that can be visualized as graphical outputs.
Section 6 shows the outcomes of these graphs for both the 9-intersection relations from
Table 4 and the 9+-intersection relations from
Table 5 [
14]. Each graphic will be broken into types of relations by symbology approaches that have an impact on the analysis (e.g., 9-intersection relation families as color; presence of an interior as shape). The results for translation, isotropic scaling, and anisotropic scaling are shown in
Figure 9,
Figure 10 and
Figure 11 and
Table 6,
Table 7 and
Table 8. Interactive 3-D representations of the figures in this section can be accessed here.
The translation conceptual neighborhood graph specifically is influenced by the size of the intervals that take part in the relation, creating a disconnected graph, a unique feature amongst existing conceptual neighborhood graphs in the literature. This is clearly visible in
Figure 9. Because translation does not alter the interval objects as a result of the deformation, any relations that are size dependent or have no interior retain that feature and thus are exclusionary to connection to other relations that do not fit those same parameters by default. The two graphs on the top and bottom of
Figure 6 are mirror images of each other as they are composed of converse scenarios (the triangular symbology relations have an
A without an interior, while the diamond symbology relations have a
B without an interior). This represents an effective test of the simulation protocol because the size dependent relations remain disconnected from one another. Similarly, the relations with no interior for either
A or
B (left-center, square symbology) form their own specialized group. Additionally, there are
touch relations that are not distinguishable by the 9-intersection, but hold a specialized transitional meaning that has been recognized in numerous other studies [
10,
12,
13,
14]. These relations sit between relations
disjoint/
inside/
contains and their corresponding boundary sharing relations
meet/
coveredBy/
covers. The main part of the graph (relations where both digital intervals have interiors) is completely symmetric with one size restricted relation branching from
meet. Unique to the conceptual neighborhood graphs in this study, it is the only one which is planar.
Table 6 shows the fundamental symmetry of the graph through the basic rule that the converse relation must relate to the converses of those relations that the original relation relates to. The most connected relation is M1 with a degree of 5.
The isotropic scaling conceptual neighborhood graph is exactly symmetric, as shown directly in
Table 7. It also exhibits the converse behavior expected. In terms of representing the graph in
Figure 10, only one relation is displaced and that is to make sure that connections remain visible. The graph is clearly not planar. Unlike
Figure 9, the relations that come from particular symbology groups in the image are not interconnected (other than the circular symbology relations and some triangular symbology and diamond symbology relations, but not all). This is an important assertion that mirrors how discretized relations have long been seen: spend time developing infrastructure around the relations comprised of larger objects because they are more commonly found, a reality that constructed multiple pieces in the literature about discretized region-region relations [
10,
12,
13]. The circular symbology relations form the bedrock of this graph. Once these relations get sufficiently small, they connect to triangular symbology and diamond symbology relations, and then those connect to square symbology relations. As such, the square symbology relations are isolated from one another. Square symbology relations transition into triangular relations as
B grows and to diamond symbology relations as
A grows. Triangular symbology relations transition to circular symbology relations as
B grows and connect to triangular symbology relations as
A grows. Diamond symbology relations transition to circular symbology relations as
A grows and connect to diamond symbology relations as
B grows. The predictability of the transition between symbology shape families in this graph provides further evidence of the accuracy of the simulations. The most connected relations in this graph are M1 and O8, both with degree 6.
The anisotropic scaling conceptual neighborhood graph shows a similar symbology shape transfer pattern to isotropic scaling. Anisotropic scaling is a much more convoluted pattern due to there being four pulling directions (as opposed to two), but also maintains symmetry, consistent with isotropic scaling. Similar to isotropic scaling, this graph is also non-planar. Similar to the other graphs, it is plainly converse fulfilling and symmetric. The most connected relation in this graph is M1 with a degree of 8.
To get to temporal relations, we can simply append the graphs together across temporally symmetric relations. Temporally symmetric relations (as discussed in Definition 5) do not differ when the before components of the relation are exchanged with the after components of the relation. The temporally symmetric relations are E1, E2, C1, C2, C4, C5, I1, I2, I4, and I5. In each case, the relation itself does not change if one considers a mirror image of that relation. In the other cases, a relation from the 9-intersection has two forms in the 9+-intersection: one corresponding to the lefthand side (the
before/starts group) and one corresponding to the righthand side (the
after/finishes group). All further analyses regarding properties of the graphs themselves mirror those from
Figure 9,
Figure 10 and
Figure 11. These graphs are shown in
Figure 12,
Figure 13 and
Figure 14.
7. Comparison of Discretized Temporal Conceptual Neighborhood Graphs to Continuous Temporal Conceptual Neighborhood Graphs
Dube [
14] demonstrated that the discretized temporal interval relations fit into categories that reflect a corresponding Allen interval relation [
9]. This assertion motivated the structure of
Table 5. As such, it is hypothesized that the conceptual neighbors of each relation within a specified conceptual neighborhood graph are either of the same Allen family (such as in
Table 5), or neighbor a relation in an Allen family that is a conceptual neighbor in the corresponding conceptual neighborhood graphs of the Allen interval relations (such as in
Figure 7). Such a result would be further evidence of the simulation method working. Hall and Dube [
24] demonstrated the discretized region-region relation conceptual neighborhood graphs followed this exact behavior. Given that these objects are of co-dimension 0 to their embedding space (just as in the region-region case), the same behavior is expected. The outcomes are shown in
Table 9,
Table 10 and
Table 11.
The translation conceptual neighborhood graph behaves exactly as expected. Each type of relation attaches appropriately to the corresponding relations in the
B neighborhood. This is most easily observed around
equal: equal attaches only to the
overlap group and not to the
coveredBy,
covers,
inside, or
contains groups. Similarly,
contains, inside, and
disjoint do not directly connect to
overlap, thus forming the explicit structure in
Figure 7(b). The relations without an interior for one or more of the objects induce connections that bypass relations that cannot exist in those groups, for example
equal, coveredBy, and
covers connecting to
meet because
overlap is not available.
Table 10 shows a behavior that at first does not seem to fit the predicted behavior: two relations from the
coveredBy family (CB2, CB4) connect to a relations from the
covers family (CV2, CV4), which violates the structure of Freksa’s
C-neighborhood (
Figure 7(c)). This additional connection, however, is an important one to really get a feel for what is happening with discretized relations as compared to continuous relations. Unlike the dense intervals in continuous space, objects have to grow in chunks. This is made most plain when we consider the relations that have an object with no interior that then exhausts the interior of another object with one of its boundaries (e.g., CB4 and CV4). As the object without an interior grows, it will encounter relations CV2 and CB2 respectively. This is specifically because of the relative size. CB2 and CV2 also connect to one another for the exact same reason. While this violates Freksa’s
C-neighborhood, this is not the first time such a result has been seen in discretized relations. In fact, the region-region relations exhibit this same exact behavior [
24,
48] as a function of relative size, a concept that is irrelevant in continuous embedding spaces. The reason that the result does not appear functionally within the group is the presence of an intermediary relation
overlapFully. This new feature in the conceptual neighborhood graph, however, follows the lateral pattern exhibited in the C-neighborhood between
inside,
equal, and
contains.
Anisotropic scaling is far more predictable and exhibits the behaviors expected from Freksa’s
A-neighborhood (
Figure 7(a)). This is more predictable than isotropic behavior because only one pixel changes its classification in each change, whereas isotropic scaling must examine the changes to two pixels. This result is suggestive of the matrix-difference neighborhoods suggested in prior research [
44].
When we aggregate the neighborhoods across the blue relations in
Table 9,
Table 10 and
Table 11, the aggregated conceptual neighborhood graphs are shown in
Figure 15. Other than the connection between
coveredBy and
covers in
Figure 15(c), there are no differences in these conceptual neighborhood graphs from their continuous counterparts.
Because the temporal versions of these relations are inverse copies, the graphs can be glued together over the symmetric relations inside, equal, and contains.
8. Discussion, Conclusions, and Future Work
In this paper, the set of discretized temporal relations [
14] were placed into three distinct conceptual neighborhood graphs, each representing a different homeomorphic deformation of a single discretized temporal interval. It was shown that the discretized temporal interval relations organized into these neighborhood graphs in a predictable manner from the corresponding continuous temporal interval relations [
9,
19], a behavior similar to the discretized region-region relations [
10,
24].
On its surface, this work appears as a “replication of a classic” study (in this case, the work of Freksa [
19]). By working with discretized intervals (temporal or otherwise), though a classical method is recreated, there are numerous advantages that access to conceptual neighborhood graphs provide within this setting [
26]. While these types of constructions have long been available for continuous objects, they have only more recently been studied for their discretized cousins [
24], and the deformations do not necessarily behave as subtly in all cases as they do in the continuous embedding spaces. On a relational level, discretized intervals (and thus relations between them) [
14] are necessarily approximations of their real-world counterparts, resulting in an increase in the volume of relations available in these relational dictionaries. This increase in volume allows for more surgical precision in choosing datapoints of interest in applications. A simple example of this can be seen by using the size constraints of objects. Not all relations are available between objects of particular sizes, as seen easily in
Figure 9 and
Figure 12 discussing translation. Knowing that restriction provides much more nuance in their applications than Freksa’s work suggests in the continuous domain where such concerns are largely irrelevant due to the denseness of continuous embedding spaces. As shown in prior research, choosing a configuration of object sizes influences the structure of the conceptual neighborhood graph, resulting in relations that are always neighbors and relations that are neighbors only within a particular context and would not be neighbors otherwise [
24,
48]. Different applications of the same idea create filtration and aggregation opportunities that are customizable to their context [
26], be it through mathematical means or via user selection, presumably motivated by the conceptual neighborhood graphs in this work as concepts in human thought have been shown to have connected signatures in these graphs [
28,
29,
57].
The results of this work provide a critical piece of infrastructure for spatio-temporal knowledge discovery. Knowledge discovery predominantly requires the detection of events. This work relates to the detection of spatio-temporal events. To determine events, it is imperative to be able to map human language onto computational data sources as ultimately humans will ask the questions or an artificially intelligent agent will need to translate the results of its operations back into human language itself [
25,
26,
27,
28,
29,
40,
43,
56]. While the relations themselves represent the primitive space for that mapping, they do not represent fully the construction of human language which might abstract away less critical details that are unnecessary for the circumstance (such as the
within operator in a modern GIS). Conceptual neighborhood graphs provide the easiest possible way to model that behavior because humans naturally group relations that share fundamental similarity. An easy example of this is shown in
Figure 16. Dube and Egenhofer [
28] demonstrated that this concept is not only manifest in reasonably topological spatial terms, but also showed that those terms held specific mathematical properties within the conceptual neighborhood graphs themselves, specifically convexity. Convex subgraphs maintain all possible shortest paths between their vertices from within the graph overall. Most qualitative spatial reasoning work has focused on conquering the layers of the spatio-temporal stack; this work focuses on conquering the stacking dimension. As such, one direct contribution of this paper is the skeleton for the construction of human-centric queries that are either a specific symbol or an aggregate of connected symbols. The conceptual neighborhood graphs (or their unions and/or intersections) represent that skeleton. Human-subjects testing would be required to create specific aggregates within software that are most commonly used. Without human-subjects testing, software interfaces could be developed that give the user flexibility in choosing the appropriate relation terms to be aggregated, be it through consistent information in their 9-intersection or 9+-intersection signatures (e.g., [
41]), or via specific user choice. The added benefit of a choice-based approach is that users can specifically choose a more nuanced view of a phenomenon. While this approach seemingly violates the premise of Occam’s razor, the computational tool is not bound by this human construct implicitly. One challenge in current GIS tools is specifically that the “select by location” infrastructure does not provide avenues for custom queries in its user interface, relegating this to more advanced programming language applications such as the
st_relates function in the
sf library [
58] or in GeoPandas [
59]. None of the available spatial libraries in available programming languages possess infrastructure for digital topological relations of any kind (be they spatial or temporal), let alone aggregates of them motivated by conceptual neighborhood graphs. Work is currently ongoing to integrate these types of relations into spatio-temporal libraries such as
SpaceTime [
60], the first step to having practical tools operable in software that leverage corresponding conceptual neighborhood graph insights directly.
Not only is this concept fundamental to defining terms; it is also a matter of pragmatism in our data forward world with respect to data filtration [
26]. Decision support systems function differently than do information systems. Information systems determine what fits sufficient criteria only; decision support systems are interested in ranking solutions. The conceptual neighborhood graph provides the framework by which a decision support system can support “next best” results. Furthermore, a conceptual neighborhood graph architecture (if endowed in the decision support system’s query logic or within the programming of an artificially intelligent geospatial agent) allows for a user to specify the exact nature of the specificity of their query. Because discretized representations of data are fundamentally uncertain with respect to a continuous space that they in effect model, it is possible that particular edges of the conceptual neighborhood graph may lead to relevant neighbors in a contextual application, while others would not. Without conceptual neighborhood graphs as a guiding paradigm, this problem is not cognitively simple, requiring humans to recognize the variability within the conceptual neighborhood graph by their own devices; with a conceptual neighborhood graph, this process has simple guideposts to direct the refinement of the query itself that can be coached by an artificially intelligent agent or by basic cascading logic within software. For example, if a user deems
inside to be their prerogative in a query, the system can ask in return about the conceptual neighbors of
inside and give the user the opportunity to include or exclude them. This process can continue until the user adds no additional search terms. These innovations lead to smarter data systems overall.
While there are many families of conceptual neighborhood graphs that have been developed (almost as numerous as relation sets themselves), there is still much work to be done. While most conceptual neighborhood graphs focus on homeomorphic deformations, there are other very crucial transformations that fundamentally alter objects structurally. Most notably for temporal intervals is the concept of the conversion between discretization and vectorization. This paper demonstrates the linkage between these dimensions in
Section 7. The future work that this leads to is a conceptual neighborhood graph that fundamentally links these concepts, effectively a layered conceptual neighborhood graph. An example of this concept applied to direction reasoning is shown in
Figure 17, where the only difference between the layers is whether or not the point itself (the circle in the center of each symbol) is part of the direction field or not [
53]. This work has been suggested both here and in its region-region counterpart [
24].
To fully realize this line of research, two fundamental concepts remain. The first is an appropriate definition of lines in
and their corresponding relation sets and conceptual neighborhood graphs. The second is to consider yet another type of conceptual neighborhood graph: a
generalization neighborhood. Cartographic generalization is a critical component of geographic information science [
61,
62,
63,
64]. In our big data world, we must cope with the large variety of data representations. To appropriately do that, we must come to a fundamental understanding and synergy of continuous and discretized spaces. By considering both a discretization/vectorization and cartographic generalization neighborhood, we will be able to leverage more data resources toward our worthy tasks, whatever they are [
26]. For example, consider the term
outside. There are corresponding versions of
separated in all relational sets, which is not surprising because it is one of the core parts of the Natural Semantic Metalanguage [
65]. Though objects may not structurally be the same, the same root image schemata [
40] is involved in this characterization. More importantly, because we generalize objects on the fly [
66,
67], two representations may actually be discussing the same object with that object existing in different cartographic forms, and thus on their own existing in one conceptual neighborhood graph that is perhaps different than the one in the other representation. Both of these scenarios demonstrate the necessity to understand this particular concept of relational similarity across different types of deformations that have not been fully explored. The basic infrastructure to consider a generalization neighborhood exists within continuous spaces as all of the types of relations between simple objects have conceptual neighborhood graphs established [
56,
57,
68], but it does not exist within discretized spaces yet due to the definition of lines in
being missing.
Of course, the overall goal for all of this research agenda is the creation of a fully endowed qualitative spatio-temporal decision support system [
69] and eventually geospatial AI with similar capacity [
25,
26]. To fully realize this, it is more than just a technical exercise of data structures and theoretical reasoning formalisms; this process involves the intrinsic knowledge of how humans interact with a system and making that usable on those terms, most notably their cognitive structures and their ability to strategically problem solve [
29]. The qualitative spatial reasoning and spatial cognition community need to come together to figure out the structure appropriate for a query language designed with these principles in mind and work in concert with the software engineering and user experience design communities to construct software and programming languages that can embed those insights. Theoretical formalisms and data structures guide this process, but there is much work with human subjects to be done to get the linguistic concepts correct, a basic concept that made a language like SQL successful [
70].