Graph Algebras and Derived Graph Operations

1. Introduction

The paper is a relatively independent part of a broader long-term project to develop a proper foundation of diagrammatic specification formalisms and diagrammatic logics. The project is centered around and extends the concept of generalized sketches. We use the term “diagrammatic” as a synonym for “graph-based” in a very broad sense including arbitrary presheaf topoi.

One of the objectives of our project is to lift up traditional first-order logic to a wide range of arbitrary categories. In [2] we only addressed predicates and showed how to define corresponding first-order logics of statements in context without operations in arbitrary categories. The present paper is also meant to be a first step towards an abstract notion of operation allowing us to define fully fledged first-order logics of statements in context, at least, in arbitrary topoi.

Generalized sketches have been developed in the 90s independently by Michael Makkai, motivated by his work on an abstract formulation of Completeness Theorems in Logic [3], and a group in Latvia around Zinovy Diskin, motivated by their work on data bases and data modeling [4,5,6]. Our concept of graph operation has its seeds in the concept of sketch operation. Sketch operations do not appear in the work of Makkai, while they have been an integral part of Diskin’s pioneering work from the very beginning.

Graph operations (and their prospective generalizations) are vital in software engineering. Moreover, they provide a conceptual tool with many potential and useful applications in mathematics, logics, and computer science.

Software models are often diagrammatic structures. To keep software models comprehensible for humans, we should, however, avoid to overload them with auxiliary items and redundant information. Nonetheless, to formulate and integrate relevant constraints in software models, it is necessary to refer to items that are not present in a model but that can be derived, like the composition of references, for example. Graph operations are an appropriate tool to refer to and reason about those derivable items in diagrammatic artifacts.

Graph operations are also vital for the definition of query languages for diagrammatic data models, for example. The crucial idea is to formalize queries as derived graph operations built up from basic operations like the operations of Codd’s relational algebra, for example. The potential to formalize query languages for diagrammatic data models was one of Diskin’s main motivations to introduce sketch operations [5].

An example par excellence for the conceptual potential of graph operations in mathematics are categories. Categories can be described as graphs plus an identity and a composition operation. It is not common yet, but quite natural, to consider these operations as graph operations. The identity operation introduces for each vertex in a graph a loop while the composition operation generates for any two successive edges in a graph a corresponding composite edge. Even statements like “we assume a category with chosen pullbacks”, for example, can be adequately made precise by means of corresponding graph operations. [7] seems to be the first paper outlining the potential of graph operations in category theory. Since categories are nowadays widely used in computer science, logic, mathematics, and physics, we will use them as our running example.

In traditional string-based formalisms and logics, terms are the standard tool to represent and reason about “derivable data”. At the same time, terms give us an adequate tool at hand to represent derived operations, i.e., operations that can be built up from the basic operations in an algebra. Therefore, we generalized in [1] the construction of terms from traditional algebras to graph algebras. The construction of graph term algebras and their characterization as a free construction is the main result in [1]. Unfortunately, our expectation that graph terms will give us a universal and appropriate concept of derived graph operations and substitutions at hand, vanished. We realized that the strong interconnection between “representation of data” and “representation of derived operations” breaks down in the case of graph operations.

After Section 2 where we list some basic notations, concepts, conventions, and results, the paper presents a further development of the theory of graph operations and graph algebras in two directions - model theory (including term algebras) and derived graph operations.

Model theory: 

In [1] we coined the concept of graph algebra, introduced graph terms and showed that graph term algebras are free graph algebras. There was, however, no model theory in the sense of traditional Universal Algebra. As a kind of “proof of concept”, we generalize therefore some basic model-theoretic concepts and results from traditional algebras to graph algebras. We concentrate on the concept “generated subalgebra” and the related problem of characterizing monomorphic and epimorphic homomorphisms, respectively.

To tackle this task, we make some substantial effort in Section 3 to revise and reformulate traditional set-theoretic definitions, constructions and proofs in Universal Algebra by means of more category-theoretic concepts and constructions. Relying on this reformulation, we can in Section 4 smoothly transfer concepts, definitions and results from traditional algebras to graph algebras. Especially, we prove that all monomorphic homomorphisms between graph algebras are regular.

In [1] we adapted the original idea of sketch operations [5] and defined the arity of a graph operation as a single graph inclusion. This definition does not allow us, however, to consider projections as legal graph operations. To be closer to the traditional concept of operation in Universal Algebra, and to be able to define an appropriate concept of derived graph operation, we declare therefore in this paper the arity of a graph operation as a span of graph inclusions. In Section 4.2 we clarify the relation between both versions and discuss to what extent they are equivalent.

To prove that all monomorphic homomorphisms between graph algebras are regular, we also introduce in Section 4.4 partial graph algebras. We define a so-called term completion procedure transforming partial graph algebras into total graph algebras. This procedure provides for each signature a free functor from the corresponding category of partial graph algebras to the corresponding category of graph algebras. The construction of graph term algebras turns out to be just a special case of this new procedure.

Derived graph operations: 

To understand why the strong interconnection between “representation of data” and “representation of derived operations” breaks down in the case of graph operations and to find out how to define derived graph operations in an appropriate way, we include in the paper a more in-depth analysis of the concept term and discuss in Section 3.4 substitution calculi in general.

In Section 3.7 we recall the construction of syntactic Lawvere theories as it is described in [8], for example. In Section 5.1 we discuss finite product categories and elucidate that terms can be characterized as normal forms for finite product expressions, thus Lawvere’s original slogan “composition is substitution” can be turned into the slogan “substitution is symbolic composition plus normalization”.

Reviewing the relationship between finite products and tensor products, we identify in Section 5.2 copying as the cause of the problem. We argue that, in case of graph operations, “copying of data”, as a computation of its own, has to be replaced by “soldering” of input and (!) output ports of computations.

In such a way, we end up in Section 5.3 with three mechanisms to construct new graph operations out of given ones: parallel composition, instantiation (“soldering” of input and output ports), and sequential composition.

Finally, we introduce in Section 5.4 graph operation expressions with a structure as close as possible to the structure of terms. We define their semantics, i.e., the derived graph operations we have been looking for, by means of the three mechanisms parallel composition, instantiation and sequential composition.

We complete the paper with some remarks concerning Operations in Topoi in Section 6, a discussion of Related Work in Section 7, and concluding remarks in Section 8.

2. Notations and Preliminaries

${\mathsf{C}}_{Obj}$ denotes the collection of objects of a category $\mathsf{C}$ and ${\mathsf{C}}_{Mor}$ the collection of morphisms of $\mathsf{C}$, respectively. $\mathsf{C}(A,B)$ is the collection of all morphisms from object A to object B in $\mathsf{C}$. If the category $\mathsf{C}$ is clear from the context, we will often use the more compact notation $B^A$ instead of $\mathsf{C}(A,B)$. We use the diagrammatic notation $f;g:A\to C$ for the composition of morphisms $f:A\to B$ and $g:B\to C$ in $\mathsf{C}$. $\mathsf{C}⊑\mathsf{D}$ states that category $\mathsf{C}$ is a subcategory of category $\mathsf{D}$. A category $\mathsf{C}$ is small if the collection ${\mathsf{C}}_{Mor}$, and thus also the collection ${\mathsf{C}}_{Obj}$, is a set. $\mathsf{Cat}$ is the category of all small categories. A category $\mathsf{C}$ is locally small if $\mathsf{C}(A,B)$ is a set for all objects A and B in $\mathsf{C}$. $\mathsf{Set}$ denotes the category of all sets and all (total) maps. $\mathsf{Cat}$ and $\mathsf{Set}$ are not small but locally small.

A (directed multi) graph $\mathtt{G}=({\mathtt{G}}_V,{\mathtt{G}}_E,s{c}^{\mathtt{G}},t{g}^{\mathtt{G}})$ is given by a collection ${\mathtt{G}}_V$ of vertices, a collection ${\mathtt{G}}_E$ of edges and maps $s{c}^{\mathtt{G}}:{\mathtt{G}}_E\to {\mathtt{G}}_V$, $t{g}^{\mathtt{G}}:{\mathtt{G}}_E\to {\mathtt{G}}_V$ assigning to each edge its source and target vertex, respectively [9]. $\mathbf{0}=(\varnothing ,\varnothing ,i{d}_{\varnothing },i{d}_{\varnothing })$ is the empty graph. A graph $\mathtt{G}$ is small if ${\mathtt{G}}_V$ and ${\mathtt{G}}_E$ are sets. A graph homomorphism $\phi :\mathtt{G}\to \mathtt{H}$ between two graphs $\mathtt{G}=({\mathtt{G}}_V,{\mathtt{G}}_E,s{c}^{\mathtt{G}},t{g}^{\mathtt{G}})$ and $\mathtt{H}=({\mathtt{H}}_V,{\mathtt{H}}_E,s{c}^{\mathtt{H}},t{g}^{\mathtt{H}})$ is a pair $({\phi }_V,{\phi }_E)$ of maps ${\phi }_V:{\mathtt{G}}_V\to {\mathtt{H}}_V$, ${\phi }_E:{\mathtt{G}}_E\to {\mathtt{H}}_E$ such that the following diagrams commute.

The identity graph homomorphism $i{d}_{\mathtt{G}}$ on a graph $\mathtt{G}$ is the pair $(i{d}_{{\mathtt{G}}_V},i{d}_{{\mathtt{G}}_E})$ of identity maps and composition of graph homomorphisms $\phi :\mathtt{G}\to \mathtt{H}$ and $\psi :\mathtt{H}\to \mathtt{K}$ is done componentwise, i.e $\phi ;\psi :=({\phi }_V;{\psi }_V,{\phi }_E;{\psi }_E)$. $\mathsf{Graph}$ is the category of all small graphs and all graph homomorphims between them. The empty graph is the initial object in $\mathsf{Graph}$. For convenience and uniformity reasons, we will often consider a set A as a graph without edges.

The category comprising as well finite and small graphs as the underlying graphs of categories like $\mathsf{Cat}$, $\mathsf{Set}$, and $\mathsf{Graph}$, for example, is denoted by $\mathsf{GRAPH}$, while $\mathsf{SET}$ is the category containing all the corresponding collections of vertices and edges, respectively. Correspondingly, we denote the category with all small categories and categories like $\mathsf{Cat}$, $\mathsf{Set}$, and $\mathsf{Graph}$ as objects by $\mathsf{CAT}$.

$gr\left(\mathsf{C}\right)$ denotes the underlying graph of a category $\mathsf{C}$, i.e., we have $\mathtt{gr}{\left(\mathsf{C}\right)}_V:={\mathsf{C}}_{Obj}$ and $\mathtt{gr}{\left(\mathsf{C}\right)}_E:={\mathsf{C}}_{Mor}$. Note, that a functor $\mathbf{F}:\mathsf{C}\to \mathsf{D}$ is just a graph homomorphism $\mathbf{F}:gr\left(\mathsf{C}\right)\to gr\left(\mathsf{D}\right)$ preserving also identities and composition. In other words: The assignments $\mathsf{C}\mapsto gr\left(\mathsf{C}\right)$, $(\mathbf{F}:\mathsf{C}\to \mathsf{D})\mapsto (\mathbf{F}:gr(\mathsf{C})\to gr(\mathsf{D}\left)\right)$ define a faithful forgetful functor $\mathbf{Gr}:\mathsf{Cat}\to \mathsf{Graph}$. It is well-known that there is a functor $\mathbf{Pth}:\mathsf{Graph}\to \mathsf{Cat}$ left-adjoint to $\mathbf{Gr}$ assigning to any graph $\mathtt{G}$ the corresponging path category $\mathsf{P}\left(\mathtt{G}\right)$.

In practical applications, it is often more convenient to work with interpretation categories instead of functor categories. An interpretation of a graph $\mathtt{G}$ in a category $\mathsf{C}$, denoted by $\phi :\mathtt{G}\to \mathsf{C}$, is a graph homomorphism $\phi$ from $\mathtt{G}$ to $gr\left(\mathsf{C}\right)$. A natural transformation $\mu :\phi \Rightarrow \psi$ between two interpretations $\phi :\mathtt{G}\to \mathsf{C}$ and $\psi :\mathtt{G}\to \mathsf{C}$ is a family ${\mu }_v:{\phi }_V\left(v\right)\to {\psi }_V\left(v\right)$, $v\in {\mathtt{G}}_V$ of morphism in $\mathsf{C}$ such that ${\phi }_E\left(f\right);{\mu }_u={\mu }_v;{\psi }_E\left(f\right)$ for all edges $f:v\to u$ in $\mathtt{G}$. All interpretations of $\mathtt{G}$ in $\mathsf{C}$ and all natural transformations between them constitute the interpretation category $[\mathtt{G}\to \mathsf{C}]$ with composition the vertical composition of natural transformations. (In [10] interpretations $\phi :\mathtt{G}\to \mathsf{C}$ are called “models of $\mathtt{G}$ in $\mathsf{C}$” and the notation $\mathbf{Mod}(\mathtt{G},\mathsf{C})$ is used instead of $[\mathtt{G}\to \mathsf{C}]$. For our purposes the more neutral and general term “interpretation” is more convenient.) For any categories $\mathsf{C}$, $\mathsf{D}$ the assignments $(\mathbf{F}:\mathsf{C}\to \mathsf{D})\mapsto (\mathbf{F}:gr(\mathsf{C})\to gr(\mathsf{D}\left)\right)$ define a full embedding of the traditional functor category $[\mathsf{C}\to \mathsf{D}]$ into the interpretation category $\left[gr\right(\mathsf{C})\to \mathsf{D}]$.

Obviously, the category $\mathsf{Graph}$ is, by definition, isomorphic to the interpretation category $[\mathtt{MG}\to \mathsf{Set}]$ with $\mathtt{MG}$ the graph . On the other side, the adjunction $\mathbf{Pth}⊣\mathbf{Gr}$ ensures that for any small graph $\mathtt{G}$ the interpretation category $[\mathtt{G}\to \mathsf{C}]$ is isomorphic to the functor category $\left[\mathsf{P}\right(\mathtt{G})\to \mathsf{C}]$ and thus a presheaf topos.

For any set I and any set A the set $A^I=\{\mathbf{a}:I\to A\}$ of all maps from I into A is a categorical product in $\mathsf{Set}$ with the family $({\pi }_i:A^I\to A\mid i\in I)$ of projections defined by ${\pi }_i\left(\mathbf{a}\right):=\mathbf{a}\left(i\right)$ for all $\mathbf{a}\in A^I$. If I is finite with n elements (indices), $A^I$ is therefore isomorphic to the n-ary Cartesian product $A^n$ of A. In case, we equip a finite set $I_n=\{i_1,i_2,\dots ,i_n\}$ with a fixed total order $i_1<i_2<\dots <i_n$, we can reuse the traditional tuple notation for elements in the Cartesian product $A^n$ to represent also the elements in $A^{I_n}$: A map $\mathbf{a}:I_n\to A$ is represented by the tuple $(\mathbf{a}\left(i_1\right),\mathbf{a}\left(i_2\right),\dots ,\mathbf{a}\left(i_n\right))$. In the paper, we will often describe a map $\mathbf{a}:I_n\to A$ by simply declaring $\mathbf{a}=(a_1,a_2,\dots ,a_n)$, i.e., $\mathbf{a}\left(i_j\right)=a_j$ for all $1\le j\le n$. In case $n=0$, i.e., $I_0=\varnothing$, we will consequently represent the only map $\mathbf{a}:I_0\to A$ by the empty tuple $\left(\right)$. For any finite set A we denote its cardinality by $\left|A\right|$.

For any inclusion $A\subseteq B$ of sets we denote by ${\iota }_{A,B}:A\hookrightarrow B$ the corresponding inclusion map with ${\iota }_{A,B}\left(a\right)=a$ for all $a\in A$. A graph $\mathtt{G}$ is a subgraph of a graph $\mathtt{H}$, $\mathtt{G}⊑\mathtt{H}$ in symbols, if ${\mathtt{G}}_V\subseteq {\mathtt{H}}_V$, ${\mathtt{G}}_E\subseteq {\mathtt{H}}_E$ and the inclusion maps ${\iota }_{{\mathtt{G}}_V,{\mathtt{H}}_V}:{\mathtt{G}}_V\to {\mathtt{H}}_V$ and ${\iota }_{{\mathtt{G}}_E,{\mathtt{H}}_E}:{\mathtt{G}}_E\to {\mathtt{H}}_E$ establish a graph homomorphism ${\iota }_{\mathtt{G},\mathtt{H}}=({\iota }_{{\mathtt{G}}_V,{\mathtt{H}}_V},{\iota }_{{\mathtt{G}}_E,{\mathtt{H}}_E}):\mathtt{G}\to \mathtt{H}$. ${\iota }_{\mathtt{G},\mathtt{H}}$ is also called an inclusion graph homomorphism or graph inclusion, shortly.

A partial map $f:A\circ ⟶B$ is given by a domain of definition $dom\left(f\right)\subseteq A$ and a total map from $dom\left(f\right)$ into B. The composition $f;g:A\circ ⟶C$ of two partial maps $f:A\circ ⟶B$ and $g:B\circ ⟶C$ is defined by

• $dom(f;g):=\{x\in A\mid x\in dom(f),f(x)\in dom(g\left)\right\}$ and
• $f;g\left(a\right):=g\left(f\right(a\left)\right)$ for all $a\in dom(f;g)$.

We consider any (total) map $f:A\to B$ as a partial map $f:A\circ ⟶B$ with $dom\left(f\right)=A$

3. Algebras and Term Algebras

Traditional expositions of Universal Algebra are based on finite Cartesian products. As a first step of a smooth transition from traditional algebras to graph algebras, we reformulate in this section some very basic concepts and results of Universal Algebra utilizing sets of maps $A^I$ instead of finite Cartesian products $A^n$.

In parallel, we try to lift the traditional set-theoretic definitions, constructions and proofs in Universal Algebra to a more general and abstract level utilizing category-theoretic concepts and constructions. The objective is to pave the way from traditional operations and algebras via graph operations and graph algebras to operations and algebras in topoi.

3.1. Signatures, Algebras and Homomorphisms

To declare the arities of operation symbols we use canonical finite indexing sets

$$I_0=\varnothing ,I_n:=\{i_1,i_2,\dots ,i_n\}\mathrm{for}\mathrm{all}n\ge 1\mathrm{and}O=\left\{o\right\}.$$

(1)

For all $n\ge 2$ we assume $I_n$ to be equipped with a fixed total order $i_1<i_2<\dots <i_n$ thus we can reuse the tuple notation to represent maps $\mathbf{a}:I_n\to A$ as discussed in Section 2.

Definition 1

(Signature). A signature $\mathsf{\Sigma }=(OP,ar)$ is given by

• a set $OP$ ofoperation symbols,
• a map $ar$ assigning to each operation symbol $\mathtt{op}$ as its arity a pair $ar\left(\mathtt{op}\right)=(I_{\mathtt{op}},O_{\mathtt{op}})$ of finite sets with $I_{\mathtt{op}}=I_n$ for some $n\in \mathbb{N}$, and $O_{\mathtt{op}}=O=\left\{o\right\}$.

We say that $\mathtt{op}\in OP$ is ann-ary operation symbol if $I_{\mathtt{op}}=I_n$. If $I_{\mathtt{c}}=I_0$ for $\mathtt{c}\in OP$, we say also that $\mathtt{c}$ is aconstant symbol.

Remark 1

(Sets as Arities). There can be arbitrary many finite separeted inputs for an algebraic operation. We decide to work with explicit sets of names for the “input positions”. In contrast to possibly multiple inputs, it is usually assumed that an algebraic operation has exactly one single output. For conformity reasons we introduce also a name for the single output position. This brings us closer to graph algebras where the single-output paradigm will be given up. As well the input as the output arity of a graph operation can be an arbitrary finite graph (see Definition 15).

Definition 2

(Algebra). Let Σ be a signature. A Σ-algebra $\mathcal{A}=(A,O{P}^{\mathcal{A}})$ given by

• a set A, called the carrier of $\mathcal{A}$, and
• a family $O{P}^{\mathcal{A}}=({\mathtt{op}}^{\mathcal{A}}:A^{I_{\mathtt{op}}}\to A^{O_{\mathtt{op}}}\mid \mathtt{op}\in OP)$ of maps called $operations$.

We say that ${\mathtt{op}}^{\mathcal{A}}$ is ann-ary operation if $I_{\mathtt{op}}=I_n$. If $I_{\mathtt{c}}=I_0$, we say also that ${\mathtt{c}}^{\mathcal{A}}$ is a constant operation, or simply aconstant.

In the case where the signature $\mathsf{\Sigma }$ has no constant symbols, the empty set constitutes a $\mathsf{\Sigma }$-algebra, called the empty Σ-algebra.

Now we reformulate the traditional concept of homomorphism.

Definition 3

(Homomorphism). Let Σ be a signature. A $\mathsf{\Sigma }$-homomorphism $h:\mathcal{A}\to \mathcal{B}$ between two Σ-algebras $\mathcal{A}$ and $\mathcal{B}$ is a map $h:A\to B$ satisfying the following homomorphism condition

$$\left(\mathbf{HC}\right){\mathtt{op}}^{\mathcal{A}}\left(\mathit{a}\right);h={\mathtt{op}}^{\mathcal{B}}(\mathit{a};h)\mathrm{for}\mathrm{all}\mathtt{op}\in OP\mathrm{and}\mathrm{all}\mathit{a}\in A^{I_{\mathtt{op}}}$$

For any sets A, B, I each map $h:A\to B$ induces a map $\_;h:A^I\to B^I$ thus we can, more abstractly but equivalently, express the homomorphism condition (HC) by the requirement that the above right square of maps commutes. Note, that in case of constant symbols $\mathtt{c}\in OP$, $I_{\mathtt{c}}=I_0$ the homomorphism condition turns into the equation ${\mathtt{op}}^{\mathcal{A}}\left(\right);h={\mathtt{op}}^{\mathcal{B}}\left(\right)$ if we apply our conventions in Section 2 concerning the tuple notation.

Given any $\mathsf{\Sigma }$-algebra $\mathcal{A}$, the identity map on the carrier set $i{d}_A:A\to A$ induces an identity $\mathsf{\Sigma }$-homomorphism $i{d}_{\mathcal{A}}:\mathcal{A}\to \mathcal{A}$. Similarly, given any $\mathsf{\Sigma }$-homomorphisms $f:\mathcal{A}\to \mathcal{B}$, $g:\mathcal{B}\to \mathcal{C}$, the composition $f;g:A\to C$ of the underlying maps induces a $\mathsf{\Sigma }$-homomorphism $f;g:\mathcal{A}\to \mathcal{C}$. This defines the category $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$ with all $\mathsf{\Sigma }$-algebras as objects and all $\mathsf{\Sigma }$-homomorphisms as morphisms.

Proposition 1

(Forgetful Functor). The assignments $\mathcal{A}\mapsto A$ and $(f:\mathcal{A}\to \mathcal{B})\mapsto (f:A\to B)$ define a faithful forgetful functor

$${\mathbf{U}}_{\mathsf{\Sigma }}:\mathsf{Alg}\left(\mathsf{\Sigma }\right)\to \mathsf{Set}.$$

(2)

Characteristic for any incarnation of the concept algebra is that the corresponding categories of algebras inherit all limits from the respective underlying category. For the abstract concept of $\mathbf{F}$-algebra for an arbitrary functor $\mathbf{F}:\mathsf{C}\to \mathsf{C}$, for example, the category of all $\mathbf{F}$-algebras inherits all limits from the category $\mathsf{C}$ [11].

It is well-known that the category $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$ inherits all limits from the category $\mathsf{Set}$. Following our methodological intention to lift things up to a more categorical element-free level, we demonstrate that the decision to work with sets of maps $A^I$ instead of Cartesian products $A^n$ enables us to give a pure categorical concise proof of this classical result. Since we want to do all later constructions and argumentations within $\mathsf{Set}$, we restrict ourselves to small limits.

Theorem 1

(Limits). $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$ inherits any small limit from the category $\mathsf{Set}$, i.e., the functor ${\mathbf{U}}_{\mathsf{\Sigma }}:\mathsf{Alg}\left(\mathsf{\Sigma }\right)\to \mathsf{Set}$ reflects small limits. $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$ has therefore all small limits since $\mathsf{Set}$ does.

Proof. 

Let $\mathtt{J}$ be a small graph and $\delta :\mathtt{J}\to \mathsf{Alg}\left(\mathsf{\Sigma }\right)$ be a diagram in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$ where ${\delta }_v={\mathcal{A}}_v=(A_v,O{P}^{{\mathcal{A}}_v})$ for all vertices v in ${\mathtt{J}}_V$. We have to show that any limit cone $\pi :L\Rightarrow \delta ;{\mathbf{U}}_{\mathsf{\Sigma }}$ over the translated diagram $\delta ;{\mathbf{U}}_{\mathsf{\Sigma }}:\mathtt{J}\to \mathsf{Set}$ induces a limit cone $\pi :\mathcal{L}\Rightarrow \delta$ over $\delta$ in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$ such that $\mathcal{L}$ is a $\mathsf{\Sigma }$-algebra with L as its carrier.

To define the operations in $\mathcal{L}$, we note that for any operation symbol $\mathtt{op}$ in $OP$ and any map $\mathbf{l}:I_{\mathtt{op}}\to L$ we get a commutative cone $\mathbf{l};\pi :I_{\mathtt{op}}\Rightarrow \delta ;{\mathbf{U}}_{\mathsf{\Sigma }}$ in $\mathsf{Set}$ with ${(\mathbf{l};\pi )}_v:=\mathbf{l};{\pi }_v:I_{\mathtt{op}}\to A_v$ for all v in ${\mathtt{J}}_V$. Applying the respective operations ${\mathtt{op}}^{{\mathcal{A}}_v}$ to the maps $\mathbf{l};{\pi }_v$ gives us a new cone ${\mathtt{op}}^{\delta }(\mathbf{l};\pi ):O_{\mathtt{op}}\Rightarrow \delta ;{\mathbf{U}}_{\mathsf{\Sigma }}$ in $\mathsf{Set}$ with ${\mathtt{op}}^{\delta }{(\mathbf{l};\pi )}_v:={\mathtt{op}}^{{\mathcal{A}}_v}(\mathbf{l};{\pi }_v):O_{\mathtt{op}}\to A_v$ for all vertices v in ${\mathtt{J}}_V$. Now, for any edge $e:v\to w$ in ${\mathtt{J}}_E$, we have that ${\delta }_e:{\delta }_v\to {\delta }_w$ is a $\mathsf{\Sigma }$-homomorphism from ${\mathcal{A}}_v$ to ${\mathcal{A}}_w$ and thus, by the homomorphism condition and commutativity of $\pi :L\Rightarrow \delta ;{\mathbf{U}}_{\mathsf{\Sigma }}$ we have

$${\mathtt{op}}^{{\mathcal{A}}_v}(\mathbf{l};{\pi }_v);{\delta }_e={\mathtt{op}}^{{\mathcal{A}}_w}(\mathbf{l};{\pi }_v;{\delta }_e)={\mathtt{op}}^{{\mathcal{A}}_w}(\mathbf{l};{\pi }_w)$$

(3)

which encapsulates that the cone ${\mathtt{op}}^{\delta }(\mathbf{l};\pi ):O_{\mathtt{op}}\Rightarrow \delta ;{\mathbf{U}}_{\mathsf{\Sigma }}$ is commutative. By the universal property of $\pi$, there is a unique map $k:O_{\mathtt{op}}\to L$ which satisfies

$$k;{\pi }_v={\mathtt{op}}^{{\mathcal{A}}_v}(\mathbf{l};{\pi }_v)$$

(4)

for all v in ${\mathtt{J}}_V$. By defining ${\mathtt{op}}^{\mathcal{L}}\left(\mathbf{l}\right):=k$, we ensure that each map ${\pi }_v:L\to A_v$ induces a $\mathsf{\Sigma }$-homomorphism ${\pi }_v:\mathcal{L}\to {\mathcal{A}}_v$ for all v in ${\mathtt{J}}_v$. Thus, we get indeed a commutative cone $\pi :\mathcal{L}\Rightarrow \delta$ in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$.

It remains to show that $\pi :\mathcal{L}\Rightarrow \delta$ is a limit cone, i.e. for any other commutative cone $p:\mathcal{X}\Rightarrow \delta$ in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$, we have to show that there is a $\mathsf{\Sigma }$-homomorphism $\kappa :\mathcal{X}\to \mathcal{L}$ such that $\kappa ;{\pi }_v=p_v$ for all v in ${\mathtt{J}}_V$. Note that p induces a commutative cone $p;{\mathbf{U}}_{\mathsf{\Sigma }}:X\Rightarrow \delta ;{\mathbf{U}}_{\mathsf{\Sigma }}$ in $\mathsf{Set}$ with ${(p;{\mathbf{U}}_{\mathsf{\Sigma }})}_v:=p_v:X\to A_v$ for all v in ${\mathtt{J}}_V$. As $\pi$ is a limit cone over $\delta ;{\mathbf{U}}_{\mathsf{\Sigma }}$, there exists a unique map $\kappa :X\to L$ such that $\kappa ;{\pi }_v=p_v$ for all v in ${\mathtt{J}}_V$. We claim that $\kappa$ extends to the desired $\mathsf{\Sigma }$-homomorphism, by showing that

$${\mathtt{op}}^{\mathcal{X}}\left(\mathbf{x}\right);\kappa ={\mathtt{op}}^{\mathcal{L}}(\mathbf{x};\kappa )$$

(5)

for any $\mathtt{op}$ in $OP$ and $\mathbf{x}:I_{\mathtt{op}}\to X$. By definition, ${\mathtt{op}}^{\mathcal{L}}(\mathbf{x};\kappa )$ is the unique map such that ${\mathtt{op}}^{\mathcal{L}}(\mathbf{x};\kappa );{\pi }_v={\mathtt{op}}^{{\mathcal{A}}_v}(\mathbf{x};\kappa ;{\pi }_v)$ holds for all v in ${\mathtt{J}}_V$. Indeed, the map ${\mathtt{op}}^{\mathcal{X}}\left(\mathbf{x}\right);\kappa :O_{\mathtt{op}}\to X$ also satisfies this equality for all v in ${\mathtt{J}}_V$ as

$${\mathtt{op}}^{\mathcal{X}}\left(\mathbf{x}\right);\kappa ;{\pi }_v={\mathtt{op}}^{\mathcal{X}}\left(\mathbf{x}\right);p_v={\mathtt{op}}^{{\mathcal{A}}_v}(\mathbf{x};p_v)={\mathtt{op}}^{{\mathcal{A}}_v}(\mathbf{x};\kappa ;{\pi }_v).$$

By uniqueness of mediating morphisms we get (5), which shows that $\kappa :X\to L$ is indeed a $\mathsf{\Sigma }$-homomorphism from $\kappa :\mathcal{X}\to \mathcal{L}$. Moreover, it is the unique homomorphism such that $\kappa ;{\pi }_v=p_v$ and thus, $\pi :\mathcal{L}\Rightarrow \delta$ is a limit cone. □

Remark 2

(Hom-sets). The proof of Theorem 1 is based on the convention in Section 2 that we consider $A^I$ as a shorthand notation for the collection (hom-set) $\mathsf{Set}(I,A)$ of all morphisms in $\mathsf{Set}$ from I to A. $\mathsf{Set}(I,A)$ is a set since $\mathsf{Set}$ is locally small. $\mathsf{Set}(I,A)$ is isomorphic to a corresponding exponential object in $\mathsf{Set}$, but this isomorphism does not play any role in the paper.

3.2. Subalgebras

As in the traditional approach, we can define subalgebras by means of set inclusions.

Definition 4

(Subalgebras). Let $\mathsf{\Sigma }=(OP,ar)$ be a signature. A Σ-algebra $\mathcal{A}=(A,O{P}^{\mathcal{A}})$ is a $\mathsf{\Sigma }$-subalgebra of a Σ-algebra $\mathcal{B}=(B,O{P}^{\mathcal{B}})$, $\mathcal{A}⊑\mathcal{B}$ in symbols, if $A\subseteq B$ and for all $\mathtt{op}\in OP$ and $\mathbf{a}:I_{\mathtt{op}}\to A$ the following diagram commutes:

Here ${\iota }_{A,B}:A\hookrightarrow B$ is the corresponding inclusion map from A into B.

A comparison of Definition 3 and Definition 4 makes, however, obvious that we can also simply describe $\mathsf{\Sigma }$-subalgebras as special kinds of $\mathsf{\Sigma }$-homomorphisms.

Corollary 1

(Subalgebras as Inclusion Homomorphisms). For Σ-algebras $\mathcal{A}$ and $\mathcal{B}$ such that $A\subseteq B$ we have that $\mathcal{A}$ is a Σ-subalgebra of $\mathcal{B}$ if, and only if, the inclusion map ${\iota }_{A,B}:A\hookrightarrow B$ establishes a Σ-homomorphism ${\iota }_{A,B}:\mathcal{A}\hookrightarrow \mathcal{B}$.

Since one of our objectives is to lift the traditional set-theoretic exposition of Universal Algebra to a more category-theoretic one, we will use, from now on, the concepts “$\mathsf{\Sigma }$-subalgebra” and “inclusion $\mathsf{\Sigma }$-homomorphism” interchangeably.

We know that the monomorphisms (epimorphisms) in $\mathsf{Set}$ are exactly the injective (surjective) maps, respectively. Any faithful functor reflects monomorphisms and epimorphisms. The forgetful functor ${\mathbf{U}}_{\mathsf{\Sigma }}:\mathsf{Alg}\left(\mathsf{\Sigma }\right)\to \mathsf{Set}$ is faithful thus we obtain

Corollary 2

(Injective and surjective Homomorphisms). If the underlying map $f:A\to B$ of a Σ-homomorphism $f:\mathcal{A}\to \mathcal{B}$ is injective (surjective) then $f:\mathcal{A}\to \mathcal{B}$ is a monomorphism (epimorphism) in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$.

In the traditional set-theoretic approach to Universal Algebra, a preferred tool to describe, construct and reason about subalgebras are subsets of the carrier which are closed w.r.t. to applications of the operations in the algebra.

Definition 5

(Closedness). Let $\mathcal{B}=(B,O{P}^{\mathcal{B}})$ be a Σ-algebra. We say a subset $A\subseteq B$ isclosed in $\mathcal{B}$if for all $\mathtt{op}\in OP$ and $\mathbf{a}:I_{\mathtt{op}}\to A$ the result ${\mathtt{op}}^{\mathcal{B}}(\mathbf{a};{\iota }_{A,B}):O_{\mathtt{op}}\to B$ of applying the operation ${\mathtt{op}}^{\mathcal{B}}$ in $\mathcal{B}$ to the input $\mathbf{a};{\iota }_{A,B}:I_{\mathtt{op}}\to B$ factors through the inclusion map ${\iota }_{A,B}:A\hookrightarrow B$, i.e., there exists a map $r_{\mathbf{a}}:O_{\mathtt{op}}\to B$ such that the following diagram commutes:

If $\mathcal{A}$ is a $\mathsf{\Sigma }$-subalgebra of $\mathcal{B}$ then the carrier A of $\mathcal{A}$ is obviously closed w.r.t. all the operations in $\mathcal{B}$. On the other side, the inclusion map ${\iota }_{A,B}:A\hookrightarrow B$ is a monomorphism in $\mathsf{Set}$. Therefore the map $r_{\mathbf{a}}:O_{\mathtt{op}}\to B$ in Definition 5 is unique if it exists. In such a way, the assignments $\mathbf{a}\mapsto r_{\mathbf{a}}$ define a total operation from $A^{I_{\mathtt{op}}}$ to $A^{O_{\mathtt{op}}}$ if A is closed, and we obtain the following result.

Proposition 2

(Subalgebra ≅ Closed Subset). There is a one-to-one correspondence between Σ-subalgebras of $\mathcal{B}$ and closed subsets of $\mathcal{B}$.

Proposition 2 suggests that there may be actually no need for the auxiliary concept closed subset in a more category-theoretic approach. This conjecture is supported by the observation that we can reconstruct the standard result that closed subsets are closed w.r.t. intersection, reformulated in terms of inclusion homomorphisms, as a special case of Theorem 1. To see this, we have to realize that the intersection of subsets can be described as a special limit construction, namely multiple pullbacks, in $\mathsf{Set}$.

Remark 3

(Multiple Pullbacks). Let I be a set and M be an I-indexed family $(A_i\subseteq B\mid i\in I)$ of subsets of a set B. We can describe this situation by a diagram $\delta :\mathtt{MP}\left(I\right)\to \mathsf{Set}$ with $\mathtt{MP}\left(I\right)$ a small graph given by $\mathtt{MP}{\left(\mathtt{I}\right)}_V:=I\cup \{*\}$, $\mathtt{MP}{\left(\mathtt{I}\right)}_E:=\{e_i:i\to *\mid i\in I\}$, and δ defined by ${\delta }_i:=A_i$ for all $i\in I$, ${\delta }_{*}:=B$ and inclusion maps ${\delta }_{e_i}:={\iota }_{A_i,B}:A_i\hookrightarrow B$ for all $i\in I$.

It is well-known and straightforward to prove that the intersection $\cap M:={\bigcap }_{i\in I}{A}_i$ together with the inclusion maps ${\iota }_{\cap M,A_i}:\cap M\hookrightarrow A_i$, $i\in I$ and ${\iota }_{\cap M,B}={\iota }_{\cap M,A_i};{\iota }_{A_i,B}:\cap M\hookrightarrow B$ is a limit cone of the diagram $\delta :\mathtt{MP}\left(I\right)\to \mathsf{Set}$ in $\mathsf{Set}$.

Limits of this shape are also calledmultiple pullbacks and they reflect monomorphisms: For any category $\mathsf{C}$, any diagram $\delta :\mathtt{MP}\left(I\right)\to \mathsf{C}$ and any limit cone $p:L\Rightarrow \delta$ all the morphisms $p_i:L\to {\delta }_i$, $i\in I$ are monomorphisms in $\mathsf{C}$ as as long as all the morphisms ${\delta }_{e_i}:{\delta }_i\to {\delta }_{*}$, $i\in I$ are.

Due to Remark 3 we can now replace and enhance the traditional statement

“If M is a family of closed subsets in $\mathcal{B}$, then its intersection $\cap M$ is closed as well”

by the following corollary of Theorem 1.

Corollary 3

(Intersection of Subalgebras). For any set I, any Σ-algebra $\mathcal{B}$, and any diagram $\delta :\mathtt{MP}\left(I\right)\to \mathsf{Alg}\left(\mathsf{\Sigma }\right)$ of Σ-subalgebras ${\delta }_{e_i}={\iota }_{A_i,B}:{\mathcal{A}}_i\hookrightarrow \mathcal{B}$, $i\in I$ of $\mathcal{B}$ there is a unique Σ-subalgebra $\mathcal{L}=(L,O{P}^{\mathcal{L}})$ of $\mathcal{B}$ with $L={\bigcap }_{i\in I}{A}_i$ that is a Σ-subalgebra of ${\mathcal{A}}_i$ for all $i\in I$.

Moreover, the inclusion Σ-homomorphisms ${\iota }_{L,A_i}:\mathcal{L}\hookrightarrow {\mathcal{A}}_i$, $i\in I$ and ${\iota }_{L,B}:\mathcal{L}\hookrightarrow \mathcal{B}$ constitute a multiple pullback, i.e., a limit cone of the diagram $\delta :\mathtt{MP}\left(I\right)\to \mathsf{Alg}\left(\mathsf{\Sigma }\right)$ in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$.

We call $\mathcal{L}=(L,O{P}^{\mathcal{L}})$ also the intersection of the I-indexed family $\mathcal{M}=({\mathcal{A}}_i\mid i\in I)$ of Σ-subalgebras of $\mathcal{B}$ and may use the notations $\bigcap \mathcal{M}$, ${\bigcap }_{i\in I}{\mathcal{A}}_i$ or, simply, $\bigcap {\mathcal{A}}_i$ to denote $\mathcal{L}$.

Traditionally, the $\mathsf{\Sigma }$-subalgebra $\mathcal{R}(A,\mathcal{B})$ of a $\mathsf{\Sigma }$-algebra $\mathcal{B}$generated by a subset $A\subseteq B$ can be defined as the $\mathsf{\Sigma }$-subalgebra with the carrier $R(A,\mathcal{B})$ constructed as the intersection of the following family of closed sets in $\mathcal{B}$:

$$R(A,\mathcal{B}):=\cap \{X\subseteq B\mid X\mathrm{closed}\mathrm{in}\mathcal{B}\mathrm{and}A\subseteq X\}.$$

(6)

Since, the collection of all subsets of a set B is a set as well, this definition matches the pattern of Corollary 3. We only have to choose for I the set $\{X\subseteq B\mid X\mathrm{closed}\mathrm{in}\mathcal{B}\mathrm{and}A\subseteq X\}$ itself or any isomorphic set.

Using this sleight of hand, we can take full advantage of the universal property of the intersection of subalgebras in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$, as stated in Corollary 3, and lift up the concept “generated by a subset” to the concept “accessible via a map”.

Definition 6

(Subalgebra accessible via a Map). For any Σ-algebra $\mathcal{B}$ and any map $f:A\to B$ let $\mathcal{M}$ be the set of all Σ-subalgebras $\mathcal{X}$ of $\mathcal{B}$ such that f factors through the inclusion map ${\iota }_{X,B}:X\hookrightarrow B$, i.e., there exists a map $f_{\mathcal{X}}:A\to X$ such that $f_{\mathcal{X}};{\iota }_{X,B}=f$.

We denote by $\mathcal{R}(f,\mathcal{B})$ the intersection of $\mathcal{M}$, according to Corollary 3. Especially, the carrier of $\mathcal{R}(f,\mathcal{B})$ is the intersection $R(f,\mathcal{B}):=\bigcap \{X\mid \mathcal{X}\in \mathcal{M}\}$ of sets. We call $\mathcal{R}(f,\mathcal{B})$ the$\mathsf{\Sigma }$-subalgebra of $\mathcal{B}$ accessible (reachable) via for thehomomorphic image of A w.r.t. f.

In case of inclusion maps $f={\iota }_{A,B}:A\hookrightarrow B$ we also use the traditional notation $\mathcal{R}(A,\mathcal{B})$ instead of $\mathcal{R}({\iota }_{A,B},\mathcal{B})$ and also call $\mathcal{R}(A,\mathcal{B})$ the$\mathsf{\Sigma }$-subalgebra of $\mathcal{B}$ generated by A.

Note, that the map $f_{\mathcal{X}}:A\to X$ in Definition 6 is unique, if it exists, since the inclusion map ${\iota }_{X,B}:X\hookrightarrow B$ is a monomorphism in $\mathsf{Set}$.

Corollary 4

(Homomorphic image includes Image). For any Σ-algebra $\mathcal{B}$ and any map $f:A\to B$ we have $f\left(A\right)\subseteq R(f,\mathcal{B})$ for the(set-theoretic) image $f\left(A\right):=\left\{f\right(a)\mid a\in A\}$ of A w.r.t. the map f.

Proof. 

Follows immediately from the observation that $f\left(A\right)=\bigcap \{Y\mid Y\in \mathcal{N}\}$ for the set $\mathcal{N}$ of all subsets Y of B such that f factors through the inclusion map ${\iota }_{Y,B}:Y\hookrightarrow B$ and that $\{X\mid \mathcal{X}\in \mathcal{M}\}\subseteq \mathcal{N}$ due to the definition of $\mathcal{M}$ and $\mathcal{R}(f,\mathcal{B})$ in Definition 6 and the definition of $\mathcal{N}$. □

Remark 4

(Well-powered). In category theory the adjective well-powered is used for categories $\mathsf{C}$ where for all objects A in $\mathsf{C}$ the collection of all subobjects of A is a set.

Of course, we do have the traditional concept of generated algebra and corresponding results available.

Definition 7

(Accessible and Generated Algebras). Let $\mathcal{B}$ be a Σ-algebra.

• $\mathcal{B}$ isaccessible via a map $f:A\to B$if$\mathcal{R}(f,\mathcal{B})=\mathcal{B}$.
• If $\mathcal{B}$ is accessible via an inclusion map ${\iota }_{A,B}:A\to B$, i.e., if$\mathcal{R}(A,\mathcal{B})=\mathcal{R}({\iota }_{A,B},\mathcal{B})=\mathcal{B}$, we say also that $\mathcal{B}$ isgenerated by A.
• $\mathcal{B}$ is said to be generated if it is generated by the empty set, i.e., accessible via the unique map ${\iota }_{\varnothing ,B}:\varnothing \hookrightarrow B$ from the initial object ∅ in $\mathsf{Set}$ to B.

Corollary 5.

A Σ-algebra $\mathcal{B}$ is generated if, and only if, there are no proper Σ-subalgebras of $\mathcal{B}$.

Corollary 6.

If a signature Σ has no constant symbols, then the empty Σ-algebra is the only generated Σ-algebra.

The concept accessible via a map can be utilized to find a characterization of epimorphisms in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$. First, we observe that “accessible via a map” implies “epic”.

Lemma 1

(Accessible implies Epic). A Σ-homomorphism $f:\mathcal{A}\to \mathcal{B}$ is an epimorphism in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$ if $\mathcal{B}$ is accessible via the underlying map $f:A\to B$, i.e., if $\mathcal{B}=\mathcal{R}(f,\mathcal{B})$.

Proof. 

We consider arbitrary Σ-homomorphisms $g,h:\mathcal{B}\to \mathcal{C}$ such that $f;g=f;h$.

We know that the set $X=\{b\in B\mid g(b)=h(b\left)\right\}\subseteq B$ together with the inclusion map ${\iota }_{X,B}:X\hookrightarrow B$ is an equalizer of the maps $g,h:B\to C$ in $\mathsf{Set}$. According to 1, there is a unique Σ-algebra $\mathcal{X}=(X,O{P}^{\mathcal{X}})$ such that ${\iota }_{X,B}:X\hookrightarrow B$ becomes an inclusion Σ-homomorphism ${\iota }_{X,B}:\mathcal{X}\hookrightarrow \mathcal{B}$ which is, moreover, the equalizer of the Σ-homomorphisms $g,h:\mathcal{B}\to \mathcal{C}$. Assumption $f;g=f;h$ ensures that there exists a unique map $f_{\mathcal{X}}:A\to X$ with $f_{\mathcal{X}};{\iota }_{X,B}=f$. Due to the construction of $\mathcal{R}(f,\mathcal{B})$ in Definition 6, we have an inclusion Σ-homomorphism ${\iota }_{R(f,\mathcal{B}),X}:\mathcal{R}(f,\mathcal{B})\hookrightarrow \mathcal{X}$. Accessibility of $\mathcal{B}$ means $\mathcal{B}=\mathcal{R}(f,\mathcal{B})$ thus we get, finally, $\mathcal{X}=\mathcal{B}$. This means, however, that the equalizer of g and h is the identity on B thus we have $g=h$ as required. □

To show that, on the other side, epic implies accessible we can take advantage of the following result.

Proposition 3

(Subalgebras are Regular Monos). For any Σ-subalgebra ${\iota }_{\mathcal{A},\mathcal{B}}:\mathcal{A}\hookrightarrow \mathcal{B}$ of a Σ-algebra $\mathcal{B}$ there exists a Σ-algebra $\mathcal{C}$ and parallel Σ-homomorphisms $g,h:\mathcal{B}\to \mathcal{C}$ such that ${\iota }_{\mathcal{A},\mathcal{B}}:\mathcal{A}\hookrightarrow \mathcal{B}$ is the equalizer of g and h.

Proof. 

We construct the pushout of the span of inclusion maps (see the left diagram below). We set $C:=B{+}_{A}B$, $g:={\kappa }_1$, and $h:={\kappa }_2$. Since ${\iota }_{A,B}$ is injective both maps ${\kappa }_1,{\kappa }_2:B\to B{+}_{A}B$ are injective too and, moreover, the pushout square is as well a pullback square. This ensures, especially, that ${\iota }_{A,B}:A\hookrightarrow B$ is the equalizer of the maps ${\kappa }_1,{\kappa }_2:B\to B{+}_{A}B$ in $\mathsf{Set}$. The pushout property of the square provides a unique map $k:B{+}_{A}B\to B$ such that

$${\kappa }_1;k={\kappa }_2;k=i{d}_B$$

(7)

Operations on C: We extend now C to a Σ-algebra $\mathcal{C}=(C,O{P}^{\mathcal{C}})$ by defining for each $\mathtt{op}$ in $OP$ a corresponding operation ${\mathtt{op}}^{\mathcal{C}}:{\left(B{+}_{A}B\right)}^{I_{\mathtt{op}}}\to {\left(B{+}_{A}B\right)}^{O_{\mathtt{op}}}$. For any $\mathbf{c}:I_{\mathtt{op}}\to B{+}_{A}B$ in ${\left(B{+}_{A}B\right)}^{I_{\mathtt{op}}}$ we do have four possible cases.

Case 1 

$\mathbf{c}$ factors through ${\kappa }_1$: There exists a map ${\mathit{b}}_1:I_{\mathtt{op}}\to B$ such that ${\mathit{b}}_1;{\kappa }_1=\mathbf{c}$ (see the right diagram above). ${\mathit{b}}_1$ is unique since ${\kappa }_1$ is a monomorphism. We simply set

$${\mathtt{op}}^{\mathcal{C}}\left(\mathbf{c}\right)={\mathtt{op}}^{\mathcal{C}}({\mathit{b}}_1;{\kappa }_1):={\mathtt{op}}^{\mathcal{B}}\left({\mathit{b}}_1\right);{\kappa }_1$$

(8)

Case 2 

$\mathbf{c}$ factors through ${\kappa }_2$: Analogously to Case 1.

Case 3 

Overlapping of Case 1 and 2: There exist maps ${\mathit{b}}_1,{\mathit{b}}_2:I_{\mathtt{op}}\to B$ such that ${\mathit{b}}_1;{\kappa }_1=\mathbf{c}={\mathit{b}}_2;{\kappa }_1$. Due to the pullback property of the square there exists a unique $\mathbf{a}:I_{\mathtt{op}}\to A$ such that ${\mathit{b}}_1=\mathbf{a};{\iota }_{A,B}={\mathit{b}}_2$. The homomorphism property of ${\iota }_{\mathcal{A},\mathcal{B}}$ ensures ${\mathtt{op}}^{\mathcal{B}}\left({\mathit{b}}_1\right)={\mathtt{op}}^{\mathcal{B}}(\mathbf{a};{\iota }_{A,B})={\mathtt{op}}^{\mathcal{B}}\left({\mathit{b}}_2\right)={\mathtt{op}}^{\mathcal{A}}\left(\mathbf{a}\right);{\iota }_{A,B}$ thus we get, finally, ${\mathtt{op}}^{\mathcal{B}}\left({\mathit{b}}_1\right);{\kappa }_1={\mathtt{op}}^{\mathcal{A}}\left(\mathbf{a}\right);{\iota }_{A,B};{\kappa }_1={\mathtt{op}}^{\mathcal{A}}\left(\mathbf{a}\right);{\iota }_{A,B};{\kappa }_2={\mathtt{op}}^{\mathcal{B}}\left({\mathit{b}}_2\right);{\kappa }_2$. That is, in the event of an overlapping, Case 1 and Case 2 define the same output ${\mathtt{op}}^{\mathcal{C}}\left(\mathbf{c}\right)={\mathtt{op}}^{\mathcal{B}}\left({\mathit{b}}_1\right);{\kappa }_1={\mathtt{op}}^{\mathcal{B}}\left({\mathit{b}}_2\right);{\kappa }_2$. Note, that there will always be an overlapping for constant symbols!

Case 4 

$\mathbf{c}$ factors neither through ${\kappa }_1$ nor through ${\kappa }_2$: This can only happen if $I_{\mathtt{op}}=I_n$ with $n\ge 2$. Utilizing the operations in $\mathcal{B}$ to a maximal extent, Cases 1 and 2 define a partial map from ${\left(B{+}_{A}B\right)}^{I_{\mathtt{op}}}$ to ${\left(B{+}_{A}B\right)}^{O_{\mathtt{op}}}$. However, since we restrict ourselves to total operations, we have to find an ad hoc totalization trick to turn ${\mathtt{op}}^{\mathcal{C}}$ into a total operation. Employing (7), we may decide to utilize the operations in $\mathcal{B}$ to produce outputs in the left copy of B in $B{+}_{A}B$. We set

$${\mathtt{op}}^{\mathcal{C}}\left(\mathbf{c}\right):={\mathtt{op}}^{\mathcal{B}}(\mathbf{c};k);{\kappa }_1$$

(9)

The operations in $\mathcal{C}$ are defined by (8) exactly in a way that the maps ${\kappa }_1$ and ${\kappa }_2$ become Σ-homomorphisms ${\kappa }_1,{\kappa }_2:\mathcal{B}\to \mathcal{C}$. Note, that Case 4 has no relevance for the homomorphism property of ${\kappa }_1$ and ${\kappa }_2$! Theorem 1 ensures, finally, that the inclusion Σ-homomorphism ${\iota }_{\mathcal{A},\mathcal{B}}:\mathcal{A}\to \mathcal{B}$ is the equalizer of the Σ-homomorphisms ${\kappa }_1,{\kappa }_2:\mathcal{B}\to \mathcal{C}$. □

Regularity of $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$ entails that the concepts accessible and epic are equivalent.

Proposition 4

(Accessible ≅ Epic). For any Σ-homomorphism $f:\mathcal{A}\to \mathcal{B}$ it holds that $\mathcal{B}$ is accessible via the underlying map $f:A\to B$, i.e., in other words $\mathcal{B}$ is equal to the homomorphic image $\mathcal{R}(f,\mathcal{B})$ of $\mathcal{A}$ w.r.t. f, if, and only if, $f:\mathcal{A}\to \mathcal{B}$ is an epimorphism in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$.

Proof. 

“Accessible implies epic” has been shown in Lemma 1. We show now “epic implies accessible”: We consider an arbitrary Σ-subalgebra $\mathcal{X}$ of $\mathcal{B}$ such that there exists a map $f_{\mathcal{X}}:A\to X$ with $f_{\mathcal{X}};{\iota }_{X,B}=f$. Due to Proposition 3 there exist Σ-homomorphisms $g,h:\mathcal{B}\to \mathcal{C}$ such that ${\iota }_{\mathcal{X},\mathcal{B}}:\mathcal{X}\to \mathcal{B}$ is the equalizer of g and h. Due to the assumption $f_{\mathcal{X}};{\iota }_{X,B}=f$, we get $f;g=f;h$ and thus $g=h$ since f is epic. This means, however, $\mathcal{X}=\mathcal{B}$ and, finally, $\mathcal{R}(f,\mathcal{B})=\mathcal{B}$ due to the construction of $\mathcal{R}(f,\mathcal{B})$ in Definition 6. □

The axiom of choice is equivalent to the statement that all epimorphisms $f:A\to B$ in the category $\mathsf{Set}$ are split, i.e., there exists a map $g:B\to A$ such that $g;f=i{d}_B$. As a consequence each homomorphism between $\mathsf{\Sigma }$-algebras maps closed subsets to closed subsets. Especially, we have

Lemma 2

(Closed Images). For any Σ-homomorphism $f:\mathcal{A}\to \mathcal{B}$ the (set-theoretic) image $f\left(A\right)\subseteq B$ of the carrier A of $\mathcal{A}$ is closed in $\mathcal{B}$. We denote by $f\left(\mathcal{A}\right)$ the unique Σ-subalgebra of $\mathcal{B}$ with carrier $f\left(A\right)$ and call it the(set-theoretic) image of $\mathcal{A}$ w.r.t. the $\mathsf{\Sigma }$-homomorphism f.

Lemma 2 is the last brick we need to conclude that the epic $\mathsf{\Sigma }$-homomorphisms are exactly the surjective one.

Corollary 7

(Epic ≅ Surjective). For any Σ-homomorphism $f:\mathcal{A}\to \mathcal{B}$ we have $f\left(\mathcal{A}\right)=\mathcal{R}(f,\mathcal{B})$ thus $f:\mathcal{A}\to \mathcal{B}$ is an epimorphism in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$ if, and only if, the map $f:A\to B$ is surjective.

Proof. 

By Corollary 4 we have $f\left(A\right)\subseteq R(f,\mathcal{B})$. Lemma 2 gives us the Σ-subalgebra $f\left(\mathcal{A}\right)$ of $\mathcal{B}$ at hand and ensures $f\left(A\right)\supseteq R(f,\mathcal{B})$ due to the construction of $R(f,\mathcal{B})$ in Definition 6. This gives us $f\left(\mathcal{A}\right)=\mathcal{R}(f,\mathcal{B})$ since two Σ-subalgebras of a Σ-algebra $\mathcal{B}$ are equal if, and only if, they do have the same carrier. By Proposition 4 we get $f:\mathcal{A}\to \mathcal{B}$ epic if, and only if, $\mathcal{B}=f\left(\mathcal{A}\right)=\mathcal{R}(f,\mathcal{B})$. $\mathcal{B}=f\left(\mathcal{A}\right)$, however, means that f is surjective. □

Remark 5

(Stepwise Generation of Closed Subsets). There is another, more constructive, way to construct the closed sets $R(A,\mathcal{B})$. We start with A and add all the elements from B that we can reach by applying successively the operations in $\mathcal{B}$ to elements that have already been reached. A categorical analysis, formalization, and generalization of this stepwise iterative construction can be found in [12], for example.

3.3. Terms and Term Algebras

We define terms as strings of symbols. To distinguish terms from metalevel expressions, such as $o{p}^{\mathcal{A}}(a_1,\dots ,a_n)$, we will use angle bracket symbols $"\langle ","\rangle "$, instead of parenthesis $"(",")"$, to build terms. Moreover, we will use delimiter signs ⌜…⌝ to indicate that the expression between the delimiters is a string. So, the delimiter signs $⌜\dots ⌝$ are not constituents of terms and we may just drop them if convenient. The following is a traditional inductive definition of terms similar to [13,14]:

Definition 8

(Terms). The set $T_{\mathsf{\Sigma }}\left(X\right)$ of all $\mathsf{\Sigma }$-terms over a set X of variables is the smallest set of strings of symbols such that

Variables: 

$⌜x⌝\in T_{\mathsf{\Sigma }}\left(X\right)$, for all $x\in X$;

Constants: 

$⌜\mathtt{c}\langle \rangle ⌝\in T_{\mathsf{\Sigma }}\left(X\right)$, for all $\mathtt{c}\in OP$ with $I_{\mathtt{c}}=I_0$;

Operations: 

$⌜\mathtt{op}\langle t_1,\dots ,t_n\rangle ⌝\in T_{\mathsf{\Sigma }}\left(X\right)$, for all $\mathtt{op}\in OP$ with $I_{\mathtt{op}}=I_n$, $n\ge 1$ and all maps $\mathit{t}=(⌜t_1⌝,\dots ,⌜t_n⌝)$ in $T_{\mathsf{\Sigma }}{\left(X\right)}^{I_n}$.

Note that the assignments $x\mapsto ⌜x⌝$, assigning to each variable the string consisting only of a single symbol denoting this variable, define an injective map ${\eta }_X$: $X\to T_{\mathsf{\Sigma }}\left(X\right)$. Note, moreover, that in case $X=I_n=\{i_1,i_2,\dots ,i_n\}$ each operation symbol $\mathtt{op}\in OP$ is reborn as the $\mathsf{\Sigma }$-term $⌜\mathtt{op}\langle i_1,\dots ,i_n\rangle ⌝\in T_{\mathsf{\Sigma }}\left(I_n\right)$.

A term can be seen as a “tree-like computation scheme” and if we assign to variables certain values in an algebra we can compute a value in this algebra following this computation scheme. Terms are constructed inductively thus we can define this kind of evaluation of terms also inductively.

Definition 9

(Evaluation of terms). For any set X of variables, any Σ-algebra $\mathcal{A}=(A,O{P}^{\mathcal{A}})$ and any map $\alpha :X\to A$ (called a variable assignment ) we can define inductively a map ${\alpha }^{*}:T_{\mathsf{\Sigma }}\left(X\right)\to A$:

Variables: 

${\alpha }^{*}\left(x\right):=\alpha \left(x\right)$, for all $⌜x⌝\in T_{\mathsf{\Sigma }}\left(X\right)$;

Constants: 

${\alpha }^{*}\left(\mathtt{c}\langle \rangle \right):={\mathtt{c}}^{\mathcal{A}}\left(\right)\left(o\right)$, for all $⌜\mathtt{c}\langle \rangle ⌝\in T_{\mathsf{\Sigma }}\left(X\right)$;

Operations: 

${\alpha }^{*}\left(\mathtt{op}\langle t_1,\dots ,t_n\rangle \right):={\mathtt{op}}^{\mathcal{A}}({\alpha }^{*}\left(t_1\right),\dots ,{\alpha }^{*}\left(t_n\right))\left(o\right)$, for all $⌜\mathtt{op}\langle t_1,\dots ,t_n\rangle ⌝\in T_{\mathsf{\Sigma }}\left(X\right)$.

All three cases in Definition 9 are disjoint and terms are only equal if, and only if, they are equal as strings thus ${\alpha }^{*}$ is uniquely defined.

There is no indication in Definition 8 and Definition 9, respectively, where the sets $T_{\mathsf{\Sigma }}\left(X\right)$ of $\mathsf{\Sigma }$-terms live and where the evaluation of $\mathsf{\Sigma }$-terms takes place. A very common and powerful practice in Universal Algebra is to internalize $\mathsf{\Sigma }$-terms as elements of carriers of $\mathsf{\Sigma }$-algebras and to encode term evaluation by $\mathsf{\Sigma }$-homomorphisms: First, we observe that the stepwise construction of terms in Definition 8 can be reflected by defining for each operation symbol in $OP$ a corresponding (constructor) operation on $T_{\mathsf{\Sigma }}\left(X\right)$:

Definition 10

(Term algebra). For a set X of variables we define the term $\mathsf{\Sigma }$-algebra over X${\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)=(T_{\mathsf{\Sigma }}\left(X\right),O{P}^{{\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)})$ by

Constants: 

${\mathtt{c}}^{{\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)}\left(\right)\left(o\right):=⌜\mathtt{c}\langle \rangle ⌝$, for all $\mathtt{c}\in OP$ with $I_{\mathtt{c}}=I_0$, and

Operations: 

${\mathtt{op}}^{{\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)}\left(\mathit{t}\right)\left(o\right):=⌜\mathtt{op}\langle t_1,\dots ,t_n\rangle ⌝$, for all $\mathtt{op}\in OP$ with $I_{\mathtt{op}}=I_n$, $n\ge 1$ and all maps $\mathit{t}=(⌜t_1⌝,\dots ,⌜t_n⌝)$ in $T_{\mathsf{\Sigma }}{\left(X\right)}^{I_n}$.

Note that the term $\mathsf{\Sigma }$-algebra ${\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)$ is generated by ${\eta }_X\left(X\right)\subseteq T_{\mathsf{\Sigma }}\left(X\right)$. This is implicitly ensured by the statement of $T_{\mathsf{\Sigma }}\left(X\right)$ being the smallest set satisfying the conditions in Definition 8. We say that the elements in ${\eta }_X\left(X\right)$ are the generators of ${\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)$.

Second, we observe that the introduction of term $\mathsf{\Sigma }$-algebras ${\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)$ allows us to encode the defining equations for the cases Constants and Operations in Definition 9 by the requirement that the map ${\alpha }^{*}:T_{\mathsf{\Sigma }}\left(X\right)\to A$ should establish a $\mathsf{\Sigma }$-homomorphism ${\alpha }^{*}:{\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)\to \mathcal{A}$:

Constants: 

${\alpha }^{*}\left(\mathtt{c}\langle \rangle \right)={\alpha }^{*}\left({\mathtt{c}}^{{\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)}\left(\right)\left(o\right)\right)=({\mathtt{c}}^{{\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)}\left(\right);{\alpha }^{*})\left(o\right)={\mathtt{c}}^{\mathcal{A}}\left(\right)\left(o\right)$, for all $⌜\mathtt{c}\langle \rangle ⌝\in T_{\mathsf{\Sigma }}\left(X\right)$;

Operations: 

${\alpha }^{*}\left(\mathtt{op}\langle t_1,\dots ,t_n\rangle \right)={\alpha }^{*}\left({\mathtt{op}}^{{\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)}\left(\mathit{t}\right)\left(o\right)\right)=({\mathtt{op}}^{{\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)}\left(\mathit{t}\right);{\alpha }^{*})\left(o\right)={\mathtt{op}}^{\mathcal{A}}(\mathit{t};{\alpha }^{*})\left(o\right)$$={\mathtt{op}}^{\mathcal{A}}({\alpha }^{*}\left(t_1\right),\dots ,{\alpha }^{*}\left(t_n\right))\left(o\right)$, for all $⌜\mathtt{op}\langle t_1,\dots ,t_n\rangle ⌝\in T_{\mathsf{\Sigma }}\left(X\right)$ where $\mathit{t}$ is the map in $T_{\mathsf{\Sigma }}{\left(X\right)}^{I_n}$ defined by $\mathit{t}=(⌜t_1⌝,\dots ,⌜t_n⌝)$.

The third case Variables in Definition 9 simply requires that the map ${\alpha }^{*}:T_{\mathsf{\Sigma }}\left(X\right)\to A$ is an extension of the map $\alpha :X\to A$ thus the statement “Definition 9 defines ${\alpha }^{*}:T_{\mathsf{\Sigma }}\left(X\right)\to A$ uniquely” is transformed into the statement that the term $\mathsf{\Sigma }$-algebra ${\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)$ is a $\mathsf{\Sigma }$-algebra freely generated by X.

Proposition 5

(Term Algebras as Free Construction). Given a set X of variables, the Σ-term algebra ${\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)$ has the following universal property: For any Σ-algebra $\mathcal{A}=(A,O{P}^{\mathcal{A}})$ and any map $\alpha :X\to A$ there exists a unique Σ-homomorphism ${\alpha }^{*}:{\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)\to \mathcal{A}$ such that ${\eta }_X;{\alpha }^{*}=\alpha$.

The universal property in Proposition 5 characterizes ${\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)$ uniquely up to isomorphism and the case $X=\varnothing$ gives us initial $\mathsf{\Sigma }$-algebras at hand.

Corollary 8.

${\mathcal{T}}_{\mathsf{\Sigma }}(\varnothing )$ is initial in the category $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$.

It is a standard result for free constructions that the assignments $X\mapsto {\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)$ and $(f:X\to Y)\mapsto ({(f;{\eta }_Y)}^{*}:{\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)\to {\mathcal{T}}_{\mathsf{\Sigma }}\left(Y\right))$ define a (free) functor ${\mathbf{F}}_{\mathsf{\Sigma }}:\mathsf{Set}\to \mathsf{Alg}\left(\mathsf{\Sigma }\right)$ that is left-adjoint to the forgetful functor ${\mathbf{U}}_{\mathsf{\Sigma }}$ (see [15]).

3.4. Substitutions

The very appealing advantage of internalizing terms as elements of carriers of algebras, encoding term evaluations as homomorphisms and thus having the adjunction ${\mathbf{F}}_{\mathsf{\Sigma }}⊣{\mathbf{U}}_{\mathsf{\Sigma }}$ at hand, is that we get a fully fledged, well-defined and well-behaved substitution calculus for free relying on general results in Category Theory. We insert an informal exposition what we mean by a substitution calculus and what the expected features of such a calculus could be. The advantages of the “internal view of terms” will be discussed afterwards.

3.4.1. Substitution Calculi

The concept substitution is a kind of conceptual descendant of the concept variable. A variable in an expression is a “free location” where we can put in expressions of a certain kind. The basic constituent of a substitution calculus is its specific way to describe a

(1)

substitution (declaration), i.e., an assignment of expressions to variables.

In Universal Algebra, we can formalize substitutions as maps $\sigma :X\to T_{\mathsf{\Sigma }}\left(Y\right)$. For finite sets $X=\{x_1,\dots ,x_n\}$ we may simply declare a substitution by listing the corresponding assignments $\{x_1\mapsto t_1,\dots ,x_n\mapsto t_n\}$.

The second constituent of a substitution calculus is the specific mechanism for

(2)

substitution application, i.e., the replacement of occurrences of variables in a given expression by the expressions assigned to the variables by a substitution.

A common practice in Universal Algebra [14] is to denote the resulting term in $T_{\mathsf{\Sigma }}\left(Y\right)$ of applying a finite substitution $\{x_1\mapsto t_1,\dots ,x_n\mapsto t_n\}$ to a term t in $T_{\mathsf{\Sigma }}\left(X\right)$ by

$$t[x_1/t_1,\dots ,x_n/t_n].$$

(10)

An obvious, but not always trivial, requirement for substitution application is

(3)

preservation of well-formedness, i.e., replacing variables in a well-formed expression by well-formed expressions should result in a well-formed expression.

In case of terms, “well-formedness” simply means that we consider only those strings of symbols as terms which can be generated inductively by the three rules in Definition 8.

Lets assume we have three collections of expressions and two linkable substitutions. The first substitution replaces variables in expressions from the first collection by expressions from the second collection thus its application produces expressions in the second collection. Analogously, the second substitution replaces variables in expressions from the second collection by expressions from the third collection and its application results in expressions from the third collection. In this situation, we do have two possibilities to transform expressions from the first collection into expressions from the third collection. First, we can apply both substitutions successively. Second, we can compose both “small step” substitutions into a single “big step” substitution. That is, we apply the second substitution to all the expressions appearing in the definition of the first substitution and obtain a new substitution replacing variables in expressions from the first collection by expressions from the third collection. This puts another feature of substitution calculi on the agenda:

(4)

composition of linkable substitutions.

The composition of the two linkable finite substitutions $\{x_1\mapsto t_1,\dots ,x_n\mapsto t_n\}$ from $X=\{x_1,\dots ,x_n\}$ to $T_{\mathsf{\Sigma }}\left(Y\right)$ and $\{y_1\mapsto r_1,\dots ,y_m\mapsto r_m\}$ from $Y=\{y_1,\dots ,y_m\}$ to $T_{\mathsf{\Sigma }}\left(Z\right)$ results, for example, in the finite substitution

$$\{x_1\mapsto t_1[y_1/r_1,\dots ,y_m/r_m],\dots ,x_n\mapsto t_n[y_1/r_1,\dots ,y_m/r_m]\}$$

(11)

from X to $T_{\mathsf{\Sigma }}\left(Z\right)$.

Obviously, we would like that the application of the “big step” substitution produces always the same result as the successive application of the two linkable “small step” substitutions, i.e., for a substitution calculus we require that

(5)

composition of substitutions is compatible with substitution application.

For the two linkable finite substitutions above this requirement can be expressed by the equation

$$\begin{array}{cc}\hfill & t[x_1/t_1[y_1/r_1,\dots ,y_m/r_m],\dots ,x_n/t_n[y_1/r_1,\dots ,y_m/r_m]]\hfill \\ \hfill =& \left(t[x_1/t_1,\dots ,x_n/t_n]\right)[y_1/r_1,\dots ,y_m/r_m]\hfill \end{array}$$

(12)

Compatibility of composition of substitutions with substitution application ensures usually another useful property:

(6)

composition of substitutions is associative.

These are the six syntactic features we would claim to be the essential characteristics of a substitution calculus as such. If a substitution calculus is, however, part of a bigger logic formalism where also semantic structures are considered, we will have some additional features concerning the interplay of syntax and semantics.

In analogy to substitutions, we have first to choose a way to describe

(7)

variable assignments, i.e., assignments of semantic items to variables.

In Universal Algebra, we work exclusively with variables ranging over elements in sets thus variable assignments can be defined as maps $\alpha :X\to A$ from a set of variables into the carrier set of a $\mathsf{\Sigma }$-algebra $\mathcal{A}$, as we have done in Definition 9.

In analogy to the step from substitution (declaration) to substitution application, each variable assignment should induce a corresponding

(8)

evaluation of expressions, computing for each expression a unique semantic item or truth value, respectively.

Definition 9 presents, for example, an inductive definition of the evaluation ${\alpha }^{*}:T_{\mathsf{\Sigma }}\left(X\right)\to A$ of $\mathsf{\Sigma }$-terms into elements in the carrier A of a $\mathsf{\Sigma }$-algebra $\mathcal{A}$ induced by a variable assignment $\alpha :X\to A$.

Since variable assignments establish a bridge from syntax to semantics, there is no composition of variable assignments in a substitution calculus. We should, however, have

(9)

composition of substitutions with variable assignments as well as composition of variable assignments with homomorphisms.

For both new kinds of composition it is desirable to have

(10)

compatibility w.r.t. substitution application and/or evaluation, respectively.

Finally, it would be reasonable to require

(11)

associativity for the three new possible combinations of the four kinds of composition, i.e., substitution-substitution-assignment, substitution-assignment-homomorphism, and assignment-homomorphism-homomorphism, respectively.

3.4.2. Substitutions by Algebraic Extensions

We discuss now the specialties of the “internalization approach” in view of the informal concept of a substitution calculus outlined in the last subsection.

Features (7) & (8): Variable assignments are formalized as maps $\alpha :X\to A$ from a set of variables into the carrier set A of a $\mathsf{\Sigma }$-algebra $\mathcal{A}$ and the corresponding unique term evaluations are inductively defined maps ${\alpha }^{*}:T_{\mathsf{\Sigma }}\left(X\right)\to A$ according to Definition 9.

Introducing term $\mathsf{\Sigma }$-algebras and realizing that the inductive definition of unique term evaluations can be described as unique algebraic extensions ${\alpha }^{*}:{\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)\to \mathcal{A}$ of variable assignments $\alpha :X\to A$, as stated in Proposition 5, has three immediate consequences.

Feature (1):

Substitutions$\sigma :X\to T_{\mathsf{\Sigma }}\left(Y\right)$ become simply a special case of variable assignments and

Feature (2):

Substitution applications appear as a special case of term evaluations namely as algebraic extensions ${\sigma }^{*}:{\mathcal{T}}_{\mathsf{\Sigma }}\left(X\right)\to {\mathcal{T}}_{\mathsf{\Sigma }}\left(Y\right)$. Applying a substitution $\sigma :X\to T_{\mathsf{\Sigma }}\left(Y\right)$ to a $\mathsf{\Sigma }$-term $t\in T_{\mathsf{\Sigma }}\left(X\right)$ means nothing but to compute the $\mathsf{\Sigma }$-term ${\sigma }^{*}\left(t\right)\in T_{\mathsf{\Sigma }}\left(Y\right)$. As mentioned before, it is common to use instead of ${\sigma }^{*}\left(t\right)$ also the more informative notation in (10) in case of finite sets of variables.

Feature (3):

Preservation of well-formedness is implicitly ensured by the fact that the structures, we define in Definition 10 (Term algebra), are indeed $\mathsf{\Sigma }$-algebras.

Feature (9): The composition of a substitution $\sigma :X\to T_{\mathsf{\Sigma }}\left(Y\right)$ with a variable assignment $\alpha :Y\to A$, is the variable assignment $\sigma ;{\alpha }^{*}:X\to A$ while Feature (10), i.e., the compatibility of substitution application and evaluation, is ensured by the uniqueness of algebraic extensions: ${\sigma }^{*};{\alpha }^{*}={(\sigma ;{\alpha }^{*})}^{*}$ (see the left diagram below).

Feature (4) composition of linkable substitutions becomes a special case of feature (9): The composition of a substitution $\sigma :X\to T_{\mathsf{\Sigma }}\left(Y\right)$ and a substitution $\delta :Y\to T_{\mathsf{\Sigma }}\left(Z\right)$ is the substitution $\sigma ;{\delta }^{*}:X\to T_{\mathsf{\Sigma }}\left(Z\right)$. In such a way, Feature (5) composition of substitutions is compatible with substitution application becomes a special case of feature (10): ${\sigma }^{*};{\delta }^{*}={(\sigma ;{\delta }^{*})}^{*}$ (see the right diagram above). Equation 12 is spelling out this equation for the finite case.

Also the remaining part of feature (9) and (10), respectively, is ensured by Proposition 5: The composition of a variable assignment $\alpha :X\to A$ with a $\mathsf{\Sigma }$-homomorphism $h:\mathcal{A}\to \mathcal{B}$, for example, is the variable assignment $\alpha ;h:X\to B$ and the uniqueness of algebraic extensions ensures compatibility: ${\alpha }^{*};h={(\alpha ;h)}^{*}$.

Finally, all the compatibilities together with the associativity of composition of maps gives us also the three kinds of associativity required by feature (11). The proof of the associativity

substitution; (substitution; assignment) = (substitution; substitution); assignment,

for example, is simply given by compatibility of substitution application and evaluation as well as associativity of map composition: $\sigma ;{(\delta ;{\beta }^{*})}^{*}=\sigma ;({\delta }^{*};{\beta }^{*})=(\sigma ;{\delta }^{*});{\beta }^{*}$ for arbitrary substitutions $\sigma :X\to T_{\mathsf{\Sigma }}\left(Y\right)$, $\delta :Y\to T_{\mathsf{\Sigma }}\left(Z\right)$ and assigments $\beta :Z\to A$.

Remark 6

(No Internalization). Of course there is no need to utilize internalization of terms and uniqueness of algebraic extensions to establish a fully-fledged substitution calculus for Universal Algebra! Instead, we could just work out separately each of the necessary definitions and proofs based on the inductive definition of terms analogously to Definition 9 (Evaluation of Terms). Internalization simply saves us a lot of work if it comes to substitutions!

On the other side, internalization is obviously not helpful in establishing substitution calculi for pure syntactic logic frameworks and/or for logic frameworks without operations. Also in logic frameworks, where some variables may range over logic formulas, internalization of terms will be of restricted help.

As an example of a definition that is independent of Proposition 5, we give an explicit inductive definition of substitution application.

Definition 11

(Substitution Application). For any sets X, Y of variables and any substitution $\delta :X\to T_{\mathsf{\Sigma }}\left(Y\right)$ we can define inductively a corresponding substitution application ${\delta }^{*}:T_{\mathsf{\Sigma }}\left(X\right)\to T_{\mathsf{\Sigma }}\left(Y\right)$ such that ${\eta }_X;{\delta }^{*}=\delta$:

Variables: 

${\delta }^{*}\left(x\right):=\delta \left(x\right)$, for all $⌜x⌝\in T_{\mathsf{\Sigma }}\left(X\right)$;

Constants: 

${\delta }^{*}\left(\mathtt{c}\langle \rangle \right):=\mathtt{c}\langle \rangle$, for all $⌜\mathtt{c}\langle \rangle ⌝\in T_{\mathsf{\Sigma }}\left(X\right)$;

Operations: 

${\delta }^{*}\left(\mathtt{op}\langle t_1,\dots ,t_n\rangle \right):=\mathtt{op}\langle {\delta }^{*}\left(t_1\right),\dots ,{\delta }^{*}\left(t_n\right)\rangle$, for all $⌜\mathtt{op}\langle t_1,\dots ,t_n\rangle ⌝\in T_{\mathsf{\Sigma }}\left(X\right)$.

Remark 7

(Kleisli Category). The composition of substitutions defined above, together with ${\eta }_X$ as the identity substitution for every set X gives us a category of substitutions. In more abstract categorical terms, this is exactly the Kleisli category of the adjunction ${\mathbf{F}}_{\mathsf{\Sigma }}⊣{\mathbf{U}}_{\mathsf{\Sigma }}$, which is equivalent to the full subcategory of $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$ of all term Σ-algebras (see, for example, [15]).

3.5. Two Model-Theoretic Implications of the Existence of a Free Functor

Before we turn to our actual topic “derived operations”, it is maybe worth to round up our discussion of monomorphisms and epimorphisms in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$. We mentioned already in Corollary 2 that injective $\mathsf{\Sigma }$-homomorphisms are monomorphisms in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$ since the functor ${\mathbf{U}}_{\mathsf{\Sigma }}:\mathsf{Alg}\left(\mathsf{\Sigma }\right)\to \mathsf{Set}$ is faithful and reflects therefore monomorphisms. The first observation is that the existence of the free functor ${\mathbf{F}}_{\mathsf{\Sigma }}:\mathsf{Set}\to \mathsf{Alg}\left(\mathsf{\Sigma }\right)$ now provides the implication in the other direction.

Lemma 3

(Monic implies Injective). For every monic Σ-homomorphism $f:\mathcal{A}\to \mathcal{B}$ the underlying map $f:A\to B$ is a monomorphism in $\mathsf{Set}$, i.e., injective.

Proof. 

We consider an arbitrary set X and arbitrary maps $g,h:X\to A$ such that $g;f=h;f$.

By uniqueness of algebraic extensions we have $g^{*};f={(g;f)}^{*}$ and $h^{*};f={(h;f)}^{*}$ (feature (10) compatibility of substitution application and evaluation) thus the assumption entails $g^{*};f={(g;f)}^{*}={(h;f)}^{*}=h^{*};f$. $f:\mathcal{A}\to \mathcal{B}$ monic implies $g^{*}=h^{*}$ and by pre-composition with ${\eta }_X$ we obtain $g={\eta }_X;g^{*}={\eta }_X;h^{*}=h$ as required. □

Second, the free functor helps to elucidate the intuition behind the choice of the adjectives “accessible”/“reachable” in Definition 6, namely that each element in $R(f,\mathcal{B})$ can be accessed/reached by first applying the map f and then applying successively the operations in $\mathcal{B}$.

Lemma 4

(Accessible via Map ≅ Accessible via Extension). For any Σ-algebra $\mathcal{B}$ and any map $f:A\to B$ we have $\mathcal{R}(f,\mathcal{B})=\mathcal{R}(f^{*},\mathcal{B})$ for the algebraic extension $f^{*}:T_{\mathsf{\Sigma }}\left(A\right)\to B$. In such a way, $\mathcal{B}$ is accessible via $f:A\to B$ if, and only if, $\mathcal{B}$ is accessible via $f^{*}:T_{\mathsf{\Sigma }}\left(A\right)\to B$.

Proof. 

Feature (10) compatibility of substitution application and evaluation ensures for any Σ-subalgebras $\mathcal{X}$ of $\mathcal{B}$ that f factors through ${\iota }_{X,B}:X\hookrightarrow B$ if, and only if, $f^{*}$ factors through ${\iota }_{X,B}:X\hookrightarrow B$. □

By Lemma 4, Proposition 4, and Corollary 7 we obtain the following equivalences.

Corollary 9.

For any Σ-algebra $\mathcal{B}$ and any map $f:A\to B$ the following statements are equivalent

• $\mathcal{B}$ is accessible via $f:A\to B$.
• $\mathcal{B}$ is accessible via $f^{*}:T_{\mathsf{\Sigma }}\left(A\right)\to B$.
• $f^{*}:{\mathcal{T}}_{\mathsf{\Sigma }}\left(A\right)\to \mathcal{B}$ is an epimorphisms in $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$.
• $f^{*}:T_{\mathsf{\Sigma }}\left(A\right)\to B$ is an epimorphism in $\mathsf{Set}$, i.e., surjective.

3.6. Terms and Derived Operations

For any set X and any $\mathsf{\Sigma }$-algebra $\mathcal{A}$ the evaluation of $\mathsf{\Sigma }$-terms over X in $\mathcal{A}$ is actually a map from $T_{\mathsf{\Sigma }}\left(X\right)\times A^X$ into A. In Definition 9 we fix an arbitrary element $\alpha \in A^X$ and define a corresponding map ${\alpha }^{*}:T_{\mathsf{\Sigma }}\left(X\right)\to A$ by varying inductively over $T_{\mathsf{\Sigma }}\left(X\right)$. That is, we describe the map from $T_{\mathsf{\Sigma }}\left(X\right)\times A^X$ into A by an $A^X$-indexed family of maps ${\alpha }^{*}:T_{\mathsf{\Sigma }}\left(X\right)\to A$. This kind of splitting is the basis for the internalization trick.

We can, however, also proceed the other way around. We can represent the map from $T_{\mathsf{\Sigma }}\left(X\right)\times A^X$ into A by a $T_{\mathsf{\Sigma }}\left(X\right)$-indexed family of maps from $A^X$ into A or $A^O$. $O=\left\{o\right\}$ is the singleton used in Definition 1 to declare the output arity of operation symbols.

Definition 12

(Derived Operations). For any set X of variables, any Σ-algebra $\mathcal{A}$ and any Σ-term $t\in T_{\mathsf{\Sigma }}\left(X\right)$ we define a corresponding derived operation , i.e., the map

$$t^{\mathcal{A}}:A^X\to A^{O}with{t}^{\mathcal{A}}\left(\alpha \right)\left(o\right):={\alpha }^{*}\left(t\right)forall\alpha \in A^X.$$

We call the maps $t^{\mathcal{A}}$derived operations since they are built up from the basic operations in $O{P}^{\mathcal{A}}$ (compare Definition 14 below). Derived operations live on the same “external level” as the basic operations, i.e., outside of carrier sets of algebras. Terms represent those derived operations, thus it is opportune to also have a complementary external view on terms and consider them as syntactic entities living together with operation symbols on the same external level. Especially, we can consider terms as entities existing independent of and prior to algebras.

To support and validate the external view on terms, we should avoid the sleight of hand in Definition 12 and define derived operations, independent of Definition 9, simply by constructing new maps from given maps.

The only two constructions we need for this purpose are available in any category with finite products: Composition of maps (morphisms) and tupling of maps (morphisms). Since we use non-traditional finite products $A^I$, instead of traditional Cartesian products $A^n$, to define domains and codomains of operations, it is probably worth to spell out the corresponding version of tupling we will rely on.

Definition 13

(Tupling of Maps). For any family of maps $f_j:A^X\to A^O$ with $1\le n,1\le j\le n$ we can construct a map $\langle \langle f_1,\dots ,f_n\rangle \rangle :A^X\to A^{I_n}$, $I_n:=\{i_1,i_2,\dots ,i_n\}$ defined by

$$\langle \langle f_1,\dots ,f_n\rangle \rangle \left(\alpha \right)\left(i_j\right):=f_j\left(\alpha \right)\left(o\right)forall\alpha \in A^{X}andall1\le j\le n.$$

For an empty family of maps, $\langle \langle \rangle \rangle :A^X\to A^{I_0}$ denotes the constant map assigning to all $\alpha \in A^X$ the only element in $A^{I_0}$ represented by the empty tuple $\left(\right)$.

Now we are prepared to give an inductive definition of derived operations. The base cases are projection maps, represented by variables, and constant maps. The induction step is implicitly divided into two steps: first tupling and then composition with a basic operation.

Definition 14

(Construction of Derived Operations). For any set X and any Σ-algebra $\mathcal{A}$ we define inductively for all Σ-terms $t\in T_{\mathsf{\Sigma }}\left(X\right)$ a corresponding derived operation $t^{\mathcal{A}}:A^X\to A^O$ as follows

Variables: 

for all $⌜x⌝\in T_{\mathsf{\Sigma }}\left(X\right)$ the (projection) map $x^{\mathcal{A}}:A^X\to A^O$ is defined by $x^{\mathcal{A}}\left(\alpha \right)\left(o\right):={\pi }_x\left(\alpha \right)=\alpha \left(x\right)$ for all $\alpha \in A^X$;

Constants: 

$\mathtt{c}{\langle \rangle }^{\mathcal{A}}:=\langle \langle \rangle \rangle ;{\mathtt{c}}^{\mathcal{A}}$, for all $⌜\mathtt{c}\langle \rangle ⌝\in T_{\mathsf{\Sigma }}\left(X\right)$;

Operations: 

$\mathtt{op}{\langle t_1,\dots ,t_n\rangle }^{\mathcal{A}}:=\langle \langle t_1^{\mathcal{A}},\dots ,t_n^{\mathcal{A}}\rangle \rangle ;{\mathtt{op}}^{\mathcal{A}}$, for all $⌜\mathtt{op}\langle t_1,\dots ,t_n\rangle ⌝\in T_{\mathsf{\Sigma }}\left(X\right)$, $n\ge 1$.

3.7. Syntactic Lawvere Theories

As long as we restrict to finite sets of variables, syntactic Lawvere theories are the ultimate implementation of the external view on terms while also incorporating the internal view as we will see soon. We will not give a fully detailed exposition but just enough to be prepared for the discussion and definition of derived graph operations in Section 5 (the interested reader may consult [8] for more details).

3.7.1. Construction of Lawvere Theories

Relying on the concept of $\mathsf{\Sigma }$-term and a substitution calculus, as discussed in the last section, we can define for any signature $\mathsf{\Sigma }=(OP,ar)$ a syntactic category $\mathsf{L}\left(\mathsf{\Sigma }\right)$ as follows:

Objects: 

As objects we chose canonical finite sets of variables

$$X_0=\varnothing \mathrm{and}{X}_n:=\{x_1^n,x_2^n,\dots ,x_n^n\}\mathrm{for}\mathrm{all}n\in \mathbb{N}\mathrm{with}n\ge 1.$$

(13)

For all $n\ge 2$ we assume $X_n$ to be equipped with a fixed total order $x_1^n<x_2^n<\dots <x_n^n$ thus we can reuse the tuple notation to represent maps as discussed in Section 2.

Morphisms: 

Morphisms are all tuples $(t_1,\dots ,t_n):X_m\to X_n$ representing a substitution (declaration) $\mathit{t}:X_n\to T_{\mathsf{\Sigma }}\left(X_m\right)$.

Identities: 

The identity on $X_n$ is the tuple $(x_1^n,\dots ,x_n^n):X_n\to X_n$ representing the substitution ${\eta }_{X_n}:X_n\to T_{\mathsf{\Sigma }}\left(X_n\right)$.

Composition: 

The composition of two tuples $(r_1,\dots ,r_m):X_k\to X_m$ and $(t_1,\dots ,t_n):X_m\to X_n$ is the tuple $({\mathit{r}}^{*}\left(t_1\right),\dots ,{\mathit{r}}^{*}\left(t_n\right)):X_k\to X_n$ representing the substitution $\mathit{t};{\mathit{r}}^{*}:X_n\to T_{\mathsf{\Sigma }}\left(X_k\right)$ where ${\mathit{r}}^{*}:T_{\mathsf{\Sigma }}\left(X_m\right)\to T_{\mathsf{\Sigma }}\left(X_k\right)$ is the application of the substitution $\mathit{r}:X_m\to T_{\mathsf{\Sigma }}\left(X_k\right)$ according to Definition 11 (compare also (11)).

Laws: 

Identity and associativity law are ensured by feature (5) composition of substitutions is compatible with substitution application (compare also (12))

3.7.2. Properties of Lawvere Theories

The category $\mathsf{L}\left(\mathsf{\Sigma }\right)$ has all finite products. We describe binary products:

• The product of two objects $X_n$ and $X_m$ is defined by $X_n\times X_m:=X_{n+m}$ with projections ${\pi }_1:=(x_1^{n+m},\dots ,x_n^{n+m}):X_{n+m}\to X_n$ and ${\pi }_2:=(x_{n+1}^{n+m},\dots ,x_{n+m}^{n+m}):X_{n+m}\to X_m$.
• The tuple of two morphisms $(t_1,\dots ,t_n):X_k\to X_n$ and $(r_1,\dots ,r_m):X_k\to X_m$ in $\mathsf{L}\left(\mathsf{\Sigma }\right)$ is given by

$$\langle \langle (t_1,\dots ,t_n),(r_1,\dots ,r_m)\rangle \rangle :=(t_1,\dots ,t_n,r_1,\dots ,r_m):X_k\to X_{n+m}$$

.

Remark 8

(Product versus Sum). The tentative reader has surely realized that $X_{n+m}$ is not the product but the sum of $X_n$ and $X_m$ in the category $\mathsf{Set}$ and that $(t_1,\dots ,t_n,r_1,\dots ,r_m)$ represents the cotuple $[\mathit{t},\mathit{r}]:X_{n+m}\to T_{\mathsf{\Sigma }}\left(X_k\right)$ of the two maps $\mathit{t}:X_n\to T_{\mathsf{\Sigma }}\left(X_k\right)$ and $\mathit{r}:X_m\to T_{\mathsf{\Sigma }}\left(X_k\right)$ in $\mathsf{Set}$. However, by choosing the direction of the morphisms in $\mathsf{L}\left(\mathsf{\Sigma }\right)$ in accordance with the direction of there semantics $\langle \langle t_1^{\mathcal{A}},\dots ,t_n^{\mathcal{A}}\rangle \rangle :A^{X_k}\to A^{X_n}$, $X_{n+m}$ becomes indeed the categorical product of $X_n$ and $X_m$ in $\mathsf{L}\left(\mathsf{\Sigma }\right)$. In other words, for us it is much more convenient to describe $\mathsf{L}\left(\mathsf{\Sigma }\right)$ as a category with finite products instead of a category with finite sums. In this way, we avoid, especially, the needless use of opposite categories.

Nevertheless, the reader should keep in mind that syntactic entities are usually and most conveniently constructed by colimits in $\mathsf{Set}$ while the semantics as interpretation paradigm turns those colimits on the syntactic level into corresponding limits on the semantic level. We do have, for example, the exponential law $A^{X_{n+m}}\cong A^{X_n}\times A^{X_m}$ with “$\_\times \_$” denoting this time the Cartesian product of sets.

The construction of syntactic Lawvere theories $\mathsf{L}\left(\mathsf{\Sigma }\right)$ for signatures $\mathsf{\Sigma }$ is a free construction on the “external meta-level”. More specific, there is for any signature $\mathsf{\Sigma }$ an equivalence between the category $\mathsf{Alg}\left(\mathsf{\Sigma }\right)$ and the category of all finite product preserving functors from $\mathsf{L}\left(\mathsf{\Sigma }\right)$ into $\mathsf{Set}$: For every finite product preserving functor $\mathbf{H}:\mathsf{L}\left(\mathsf{\Sigma }\right)\to \mathsf{Set}$ there is a corresponding $\mathsf{\Sigma }$-algebra $\mathcal{U}\left(\mathbf{H}\right)$ with carrier $\mathbf{H}\left(X_1\right)$ and operations defined for each n-ary operation symbol in $OP$ by ${\mathtt{op}}^{\mathcal{U}\left(\mathbf{H}\right)}:=b_n;\mathbf{H}\left(\left(\mathtt{op}\langle x_1^n,\dots ,x_n^n\rangle \right)\right);b$ with the isomorphisms $b_n:\mathbf{H}{\left(X_1\right)}^{I_n}\to \mathbf{H}\left(X_n\right)$, provided by the assumption that $\mathbf{H}$ preserves finite products, and the obvious isomorphism $b:\mathbf{H}\left(X_1\right)\to \mathbf{H}{\left(X_1\right)}^O$.

Conversely, for every $\mathsf{\Sigma }$-algebra $\mathcal{A}$ the assignments $X_1\mapsto A$, $X_n\mapsto A^{I_n}$ for all $n\ge 2$, and $(t_1,\dots ,t_n)\mapsto \langle \langle t_1^{\mathcal{A}},\dots ,t_n^{\mathcal{A}}\rangle \rangle$ give rise to a unique finite limit preserving functor $\mathbf{FP}\left(\mathcal{A}\right):\mathsf{L}\left(\mathsf{\Sigma }\right)\to \mathsf{Set}$ such that $\mathcal{U}\left(\mathbf{FP}\right(\mathcal{A}\left)\right)=\mathcal{A}$. This is ensured by Definition 13 and Definition 14.

Finally, $\mathsf{L}\left(\mathsf{\Sigma }\right)$ comprises all finite term $\mathsf{\Sigma }$-algebras, in the following sense: It is well-known that hom-functors preserve limits and thus, especially, finite products. In such a way, for all $n\in \mathbb{N}$ the hom-functor $\mathsf{L}\left(\mathsf{\Sigma }\right)(X_n,\_):\mathsf{L}\left(\mathsf{\Sigma }\right)\to \mathsf{Set}$ preserves finite limits. According to the above equivalence of categories and the Yoneda Lemma, the corresponding $\mathsf{\Sigma }$-algebra $\mathcal{U}\left(\mathsf{L}\left(\mathsf{\Sigma }\right)(X_n,\_)\right)$ satisfies the universal property stated in Proposition 5. This means, however, nothing but the $\mathsf{\Sigma }$-algebras $\mathcal{U}\left(\mathsf{L}\left(\mathsf{\Sigma }\right)(X_n,\_)\right)$ and ${\mathcal{T}}_{\mathsf{\Sigma }}\left(X_n\right)$ being isomorphic.

4. Graph Algebras and Graph Term Algebras

Relying on the categorical reconstruction of concepts, constructions and results of traditional Universal Algebra in Section 3, we present in this section a generalization of those concepts, constructions and results to graph algebras.

4.1. Graph Signatures, Graph Algebras and Homomorphisms

We consider the composition of two morphisms in a category as a graph operation. The arity of a corresponding operation symbol $\mathtt{comp}$ could be declared in the following way.

(14)

Compared to traditional algebraic operations we can presently infer some essential differences [1]:

Two different kinds of input items. 

This is evident due to working with graphs which consists of both vertices and edges. Instead of a single set, we declare therefore a graph as the input arity.

Arbitrary many output items. 

A single output is assumed for algebraic operations, but graph operations can produce arbitrarily large finite graphs as output. Similar to the input, the output arity is chosen to be a graph.

Output is often related to the input. 

In the case of the composition operation $\mathtt{comp}$ above, the relation between the two arity graphs ${\mathtt{I}}_{\mathtt{comp}}$ and ${\mathtt{O}}_{\mathtt{comp}}$ is clear from the labelling: the output edge ’$o{e}_1$’ has the same source and target as the input edges ’$i{e}_1$’ and ’$i{e}_2$’, respectively. Instead of always requiring coherent labelling, we introduce a third arity graph ${\mathtt{B}}_{\mathtt{comp}}$, called the boundary of $\mathtt{comp}$, to encompass the connection between input and output in a fitting way.

We summarise the previous discussion as the following definition.

Definition 15

(Graph signature). A graph signature $\mathsf{\Gamma }=(OP,ar)$ is given by

• a set $OP$ of operation symbols,
• a map $ar$ assigning to each operation symbol $\mathtt{op}$ in $OP$ its arity span, i.e., a span $ar\left(\mathtt{op}\right)={\mathtt{I}}_{\mathtt{op}}\stackrel{l_{\mathtt{op}}}{\hookleftarrow }{\mathtt{B}}_{\mathtt{op}}\stackrel{{\mathtt{r}}_{\mathtt{op}}}{\hookrightarrow }{\mathtt{O}}_{\mathtt{op}}$ of inclusion graph homomorphisms between finite graphs such that the sets ${\left({\mathtt{O}}_{\mathtt{op}}\right)}_V\setminus {\left({\mathtt{B}}_{\mathtt{op}}\right)}_V$ and ${\left({\mathtt{I}}_{\mathtt{op}}\right)}_V$ as well as the sets ${\left({\mathtt{O}}_{\mathtt{op}}\right)}_E\setminus {\left({\mathtt{B}}_{\mathtt{op}}\right)}_E$ and ${\left({\mathtt{I}}_{\mathtt{op}}\right)}_E$ are disjoint. The graphs ${\mathtt{I}}_{\mathtt{op}}$, ${\mathtt{B}}_{\mathtt{op}}$, ${\mathtt{O}}_{\mathtt{op}}$ are referred to as theinput arity,boundary arity, and output arity of $\mathtt{op}$, respectively.

If ${\mathtt{I}}_{\mathtt{c}}$ is the empty graph $\mathbf{0}$ for $\mathtt{c}\in OP$, we also say that $\mathtt{c}$ is a constant symbol. Note, that also ${\mathtt{B}}_{\mathtt{c}}=\mathbf{0}$ in this case.

It is maybe worth to mention that the disjointedness condition is equivalent to the condition that ${\mathtt{B}}_{\mathtt{op}}$ is the componentwise set intersection of the graphs ${\mathtt{I}}_{\mathtt{op}}$ and ${\mathtt{O}}_{\mathtt{op}}$, i.e.

$${\left({\mathtt{B}}_{\mathtt{op}}\right)}_V={\left({\mathtt{I}}_{\mathtt{op}}\right)}_V\cap {\left({\mathtt{O}}_{\mathtt{op}}\right)}_V\mathrm{and}{\left({\mathtt{B}}_{\mathtt{op}}\right)}_E={\left({\mathtt{I}}_{\mathtt{op}}\right)}_E\cap {\left({\mathtt{O}}_{\mathtt{op}}\right)}_E.$$

(15)

Remark 9

(Arity Renamings). In contrast to traditional operations we use explicit names to identify the input and output “positions” of a graph operation. Names can, however, be chosen arbitrary and we should be prepared to rename, if necessary, the arities of a graph operation.

An arity renaming ϱ from an arity span $\mathtt{I}\stackrel{l}{\hookleftarrow }\mathtt{B}\stackrel{r}{\hookrightarrow }\mathtt{O}$ to another arity span ${\mathtt{I}}^{\prime }\stackrel{l^{\prime }}{\hookleftarrow }{\mathtt{B}}^{\prime }\stackrel{r^{\prime }}{\hookrightarrow }{\mathtt{O}}^{\prime }$ is simply a triple of graph isomorphisms ${\varrho }_I:\mathtt{I}\to {\mathtt{I}}^{\prime }$, ${\varrho }_B:{\mathtt{B}}_{\mathtt{op}}\to {\mathtt{B}}^{\prime }$, ${\varrho }_O:\mathtt{O}\to {\mathtt{O}}^{\prime }$ such that the following diagram commutes

Remark 10

(Notational Conventions). For all finite graphs $\mathtt{J}$, used in arity spans, we assume that the corresponding sets ${\mathtt{J}}_V$ and ${\mathtt{J}}_E$ are equipped with a fixed total order. Relying on our conventions in Section 2, this allows us to represent any graph homomorphism $\mathit{b}=({\mathit{b}}_V,{\mathit{b}}_E):\mathtt{J}\to \mathtt{G}$ as a pair of tuples ${\mathit{b}}_V=(b{v}_1,\dots ,b{v}_n)$, ${\mathit{b}}_E=(b{e}_1,\dots ,b{e}_m)$ where $n=\left|{\mathtt{J}}_V\right|$, $m=\left|{\mathtt{J}}_E\right|$ and $b{v}_i$ ($b{e}_j$) the image of the i-th (j-th) element in ${\mathtt{J}}_V$ (${\mathtt{J}}_E$), $1\le i\le n$, $1\le j\le m$. For any arity span ${\mathtt{I}}_{}\stackrel{l_{}}{\hookleftarrow }{\mathtt{B}}_{}\stackrel{r_{}}{\hookrightarrow }{\mathtt{O}}_{}$ we assume that $\mathtt{B}$ inherits the order from $\mathtt{I}$ and $\mathtt{O}$, respectively.

We impose the disjointness condition in Definition 15 to distinguish syntatctically between input items of a graph operation and the new output items produced by a graph operation. Another objective is to be able to infer later the arity of a “graph operation expression” only based on the expression itself and the arities of the operations symbols defined in the corresponding signature.

To achieve this goal we will use “canonical arity spans” to describe the arities of operation symbols and graph operation expressions, respectively. In a canonical arity span we use canonical sets ${\mathtt{I}}_V=\{i{v}_1,\dots ,i{v}_{n^{\mathtt{I}}}\}$ of input vertices and ${\mathtt{I}}_E=\{i{e}_1,\dots ,i{e}_{m^{\mathtt{I}}}\}$ of input edges, respectively, with $n^{\mathtt{I}}=\left|{\mathtt{I}}_V\right|$ and $m^{\mathtt{I}}=\left|{\mathtt{I}}_E\right|$. In the same way, we use canonical sets ${\mathtt{O}}_V\setminus {\mathtt{B}}_V=\{o{v}_1,\dots ,o{v}_{n^{\mathtt{O}}}\}$ of output vertices and ${\mathtt{O}}_E\setminus {\mathtt{B}}_E=\{o{e}_1,\dots ,o{e}_{m^{\mathtt{O}}}\}$ of output edges, respectively, with $n^{\mathtt{O}}=|{\mathtt{O}}_V\setminus {\mathtt{B}}_V|$ and $m^{\mathtt{O}}=|{\mathtt{O}}_E\setminus {\mathtt{B}}_E|$.

Example 1

(Signature for Categories). We define a signature ${\mathsf{\Gamma }}_{cat}$ with an operation symbol $\mathtt{comp}$ to denote operations composing two edges and an operation symbol $\mathtt{id}$ to denote operations assigning to vertices corresponding identity edges.

As per Definition 15, we extend the arity of $\mathtt{comp}$ proposed in (14) to the span of graph homomorphisms shown in Figure 1 with a boundary graph ${\mathtt{B}}_{\mathtt{comp}}$ consisting of only two vertices, $i{v}_1$ and $i{v}_3$. This encapsulates exactly the desired requirements for a composition operation with regards to sources and targets.

Analogously, the arity of $\mathtt{id}$, shown in Figure 2, encapsulates the requirements for an identity operation with regards to sources and targets.

$\mathsf{Graph}$ is a locally small category and we employ here the same exponential notation for hom-sets as we did for sets in Section 3. That is, for any graphs $\mathtt{G}$ and $\mathtt{H}$, ${\mathtt{G}}^{\mathtt{H}}$ denotes the set $\mathsf{Graph}(\mathtt{H},\mathtt{G})$ of all graph homomorphisms from $\mathtt{H}$ into $\mathtt{G}$.

Graph operations are maps, i.e., morphisms in $\mathsf{Set}$! Specifically, an operation ${\mathtt{op}}^{\mathtt{G}}$ on a graph $\mathtt{G}$ should take as input a graph homomorphism in ${\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$ and return as output a graph homomorphism in ${\mathtt{G}}^{{\mathtt{O}}_{\mathtt{op}}}$. This procedure needs to respect the boundary which is ensured by requiring the resulting square being commutative.

Definition 16

(Graph Algebra). Let $\mathsf{\Gamma }=(OP,ar)$ be a graph signature. A(graph) $\mathsf{\Gamma }$-algebra $\mathcal{G}=(\mathtt{G},O{P}^{\mathcal{G}})$ is given

• by a graph $\mathtt{G}$, called the carrier of $\mathcal{G}$, and
• a family $O{P}^{\mathcal{G}}=({\mathtt{op}}^{\mathcal{G}}:{\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}\to {\mathtt{G}}^{{\mathtt{O}}_{\mathtt{op}}}|\mathtt{op}\in OP)$ of maps such that the following diagram commutes for all $\mathtt{op}$ in $OP$ and all graph homomorphisms $\mathit{b}\in {\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$.

(16)

The maps in $O{P}^{\mathcal{G}}$ are referred to asgraph operations.

The specific case where ${\mathtt{I}}_{\mathtt{op}}$ is the empty graph $\mathbf{0}$, the set ${\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$ becomes a singleton as there is exactly one graph homomorphism ${\mathbf{0}}_{\mathtt{G}}:\mathbf{0}\to \mathtt{G}$, represented by a pair of empty tuples ${\mathbf{0}}_{\mathtt{G}}=(\left(\right),\left(\right))$. Thus, for any constant symbol $\mathtt{c}$ in $OP$, with ${\mathtt{I}}_{\mathtt{c}}=\mathbf{0}$, the corresponding graph operation ${\mathtt{c}}^{\mathcal{G}}$ returns a subgraph of $\mathtt{G}$, i.e., it returns the image of ${\mathtt{O}}_{\mathtt{c}}$ under ${\mathtt{c}}^{\mathcal{G}}\left({\mathbf{0}}_{\mathtt{G}}\right)$.

In the case where the signature $\mathsf{\Gamma }$ has no constant symbols, the empty graph constitutes a $\mathsf{\Gamma }$-algebra, called the empty Γ-algebra.

Example 2

(Categories as Graph Algebras). We consider the graph signature ${\mathsf{\Gamma }}_{cat}$ in 1.

Obviously, any small category $\mathsf{C}$ gives rise to a ${\mathsf{\Gamma }}_{cat}$-algebra $\mathcal{C}=(gr\left(\mathsf{C}\right),O{P}^{\mathcal{C}})$ with the underlying graph $gr\left(\mathsf{C}\right)$ of $\mathsf{C}$ as carrier: The graph operation ${\mathtt{comp}}^{\mathcal{C}}:gr{\left(\mathsf{C}\right)}^{{\mathtt{I}}_{\mathtt{comp}}}\to gr{\left(\mathsf{C}\right)}^{{\mathtt{O}}_{\mathtt{comp}}}$ is defined by the single equation ${\left({\mathtt{comp}}^{\mathcal{C}}\left(\mathit{b}\right)\right)}_E\left(o{e}_1\right):={\mathit{b}}_E\left(i{e}_1\right){;}^{\mathsf{C}}{\mathit{b}}_E\left(i{e}_2\right)$ for all $\mathit{b}\in gr{\left(\mathsf{C}\right)}^{{\mathtt{I}}_{\mathtt{comp}}}$ where “$\_{;}^{\mathsf{C}}\_$” denotes the composition in $\mathsf{C}$. For the two vertices in ${\mathtt{O}}_{\mathtt{comp}}$ the images w.r.t. ${\mathtt{comp}}^{\mathcal{C}}\left(\mathit{b}\right)$ are always fixed due to the commutativity condition in Definition 16: ${\left({\mathtt{comp}}^{\mathcal{C}}\left(\mathit{b}\right)\right)}_V\left(i{v}_1\right)={\mathit{b}}_V\left(i{v}_1\right)$ and ${\left({\mathtt{comp}}^{\mathcal{C}}\left(\mathit{b}\right)\right)}_V\left(i{v}_2\right)={\mathit{b}}_V\left(i{v}_2\right)$.

Not every ${\mathsf{\Gamma }}_{cat}$-algebra, however, can be seen as a category since it may fail to satisfy the identity and/or the associativity law. In [1] we presented some ideas concerning equations for graph algebras but the development of a full equational calculus is a topic of future research.

Example 3

(Chosen Pullbacks). Graph algebras can serve as a conceptual tool to give a precise meaning to statements like “let $\mathsf{C}$ be a category with chosen pullbacks”.

We define the arity of an operation symbol $\mathtt{pb}$ as the span of inclusion graph homomorphisms given in Figure 3. To choose pullbacks for a small category $\mathsf{C}$ means then nothing but to define a graph operation ${\mathtt{pb}}^{\mathcal{C}}:gr{\left(\mathsf{C}\right)}^{{\mathtt{I}}_{\mathtt{pb}}}\to gr{\left(\mathsf{C}\right)}^{{\mathtt{O}}_{\mathtt{pb}}}$ assigning to each cospan $\mathit{b}:{\mathtt{I}}_{\mathtt{pb}}\to gr\left(\mathsf{C}\right)$ in $\mathsf{C}$ a corresponding pullback span ${\mathtt{pb}}^{\mathcal{C}}:{\mathtt{O}}_{\mathtt{pb}}\to gr\left(\mathsf{C}\right)$.

Remark 11

(Built-in Projections). Given a “set of indices” I and a “carrier set” A, we do have a projection map ${\pi }_i:A^I\to A$ at hand for any index $i\in I$, as described in Section 2.

Analougously, we obtain for a “graph of indices” $\mathtt{H}$ and a “carrier graph” $\mathtt{G}$ a projection map ${\pi }_{\mathtt{K}}^{\mathtt{H}}$ for any subgraph $\mathtt{K}$ of $\mathtt{H}$ by simple pre-composition with the inclusion graph homomorphism ${\iota }_{\mathtt{K},\mathtt{H}}:\mathtt{K}\hookrightarrow \mathtt{H}$:

$${\pi }_{\mathtt{K}}^{\mathtt{H}}:{\mathtt{G}}^{\mathtt{H}}\to {\mathtt{G}}^{\mathtt{K}}isdefinedby{\pi }_{\mathtt{K}}^{\mathtt{H}}\left(\mathit{b}\right):={\iota }_{\mathtt{K},\mathtt{H}};\mathit{b}forall\mathit{b}\in {\mathtt{G}}^{\mathtt{H}}.$$

(17)

In such a way, we do have for any Γ-algebra $\mathcal{G}=(\mathtt{G},O{P}^{\mathcal{G}})$ and any arity span $\mathtt{I}\stackrel{l}{\hookleftarrow }$ $\mathtt{B}$ $\stackrel{r}{=}\mathtt{O}$ (as in Definition 15) with $\mathtt{B}=\mathtt{O}$ exactly one map from ${\mathtt{G}}^{\mathtt{I}}$ to ${\mathtt{G}}^{\mathtt{O}}$ satisfying the commutativity condition for graph operations in Definition 16, namely the projection ${\pi }_{\mathtt{O}}^{\mathtt{I}}:{\mathtt{G}}^{\mathtt{I}}\to {\mathtt{G}}^{\mathtt{O}}$. In case $\mathtt{I}=\mathtt{B}=\mathtt{O}$, ${\pi }_{\mathtt{I}}^{\mathtt{I}}:{\mathtt{G}}^{\mathtt{I}}\to {\mathtt{G}}^{\mathtt{I}}$ is simply the identity on ${\mathtt{G}}^{\mathtt{I}}$.

We call those projections built-in since their semantics is completely determined by their arity! After the choice of the carrier $\mathtt{G}$ of a graph algebra $\mathcal{G}$ we do have these projections available independent of and prior to the choice of the semantics ${\mathtt{op}}^{\mathcal{G}}$ of the operation symbols $\mathtt{op}\in OP$.

A crucial methodological point is that we can use these built-in projections without being forced to include corresponding auxiliary operational symbols in $OP$ and/or without any need to define their semantics when defining graph algebras. In the traditional approach we are forced to do this because there is no idea of boundaries at all or, in other words, all boundaries in our sense are per default empty in traditional Universal Algebra.

Our reformulation of the definition of homomorphisms for traditional algebras in Definition 3 applies analogously to graph algebras.

Definition 17

(Graph Algebra Homomorphism). Let Γ be a graph signature. A $\mathsf{\Gamma }$-homomorphism $\phi :\mathcal{G}\to \mathcal{H}$ between two Γ-algebras $\mathcal{G}=(\mathtt{G},O{P}^{\mathcal{G}})$ and $\mathcal{H}=(\mathtt{H},O{P}^{\mathcal{H}})$ is a graph homomorphism $\phi :\mathtt{G}\to \mathtt{H}$ satisfying the following homomorphism condition

$$\left(\mathrm{HC}\right){\mathtt{op}}^{\mathcal{G}}\left(\mathit{b}\right);\phi ={\mathtt{op}}^{\mathcal{H}}(\mathit{b};\phi )forall\mathtt{op}\in OPandall\mathit{b}\in {\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}.$$

For any graphs $\mathtt{G}$, $\mathtt{H}$, $\mathtt{J}$ each graph homomorphism $\phi :\mathtt{G}\to \mathtt{H}$ induces by post-composition a map $\_;\phi :{\mathtt{G}}^{\mathtt{J}}\to {\mathtt{H}}^{\mathtt{J}}$ thus we can, more abstractly but equivalently, express the homomorphism condition (HC) by the requirement that the above right square of maps commutes. Note, that in case of constant symbols $\mathtt{c}\in OP$, ${\mathtt{I}}_{\mathtt{c}}=\mathbf{0}$ the homomorphism condition turns into the equation ${\mathtt{op}}^{\mathtt{G}}(\left(\right),\left(\right));\phi ={\mathtt{op}}^{\mathtt{H}}(\left(\right),\left(\right))$ if we apply our conventions in Section 2 and and Remark 10 concerning the tuple notation.

Example 4

(Functors as Homomorphisms). In case of ${\mathsf{\Gamma }}_{cat}$-algebras as defined in Example 2, the homomorphism conditions for the operation symbols $\mathtt{comp}$ and $\mathtt{id}$, according to Definition 3, are nothing but the usual requirements for functors to be compatible with composition and identities, respectively.

Graph $\mathsf{\Gamma }$-algebras and $\mathsf{\Gamma }$-homomorphisms together constitute a category $\mathsf{Alg}\left(\mathsf{\Gamma }\right)$: Composition $\phi ;\psi :\mathcal{G}\to \mathcal{K}$ of two $\mathsf{\Gamma }$-homomorphisms $\phi :\mathcal{G}\to \mathcal{H}$ and $\psi :\mathcal{H}\to \mathcal{K}$ is given by the composition $\phi ;\psi$ of the underlying graph homomorphisms $\phi :\mathtt{G}\to \mathtt{H}$ and $\psi :\mathtt{H}\to \mathtt{K}$. Lastly, the identity $\mathsf{\Gamma }$-homomorphism $i{d}_{\mathcal{G}}:\mathcal{G}\to \mathcal{G}$ for any $\mathsf{\Gamma }$-algebra $\mathcal{G}$ is given by the identity graph homomorphism $i{d}_{\mathtt{G}}:\mathtt{G}\to \mathtt{G}$.

Proposition 6

(Forgetful Functor). The assignments $\mathcal{G}\to \mathtt{G}$ and $(\phi :\mathcal{G}\to \mathcal{H})\mapsto (\phi :\mathtt{G}\to \mathtt{H})$ define a faithful forgetful functor

$${\mathbf{U}}_{\mathsf{\Gamma }}:\mathsf{Alg}\left(\mathsf{\Gamma }\right)\to \mathsf{Graph}.$$

(18)

The homomorphism condition for $\mathsf{\Sigma }$-homorphisms between $\mathsf{\Sigma }$-algebras in Definition 3 has exactly the same structure as the homomorphism condition for $\mathsf{\Gamma }$-homomorphisms between graph $\mathsf{\Gamma }$-algebras in Definition 17. In such a way, the pure categorical proof of Theorem 1 can be directly transformed into a proof of the corresponding statement for graph algebras thus we get the following theorem “for free”.

Theorem 2

(Limits of Graph Algebras). $\mathsf{Alg}\left(\mathsf{\Gamma }\right)$ inherits any small limit from the category $\mathsf{Graph}$, i.e., the functor ${\mathbf{U}}_{\mathsf{\Gamma }}:\mathsf{Alg}\left(\mathsf{\Gamma }\right)\to \mathsf{Graph}$ reflects small limits. $\mathsf{Alg}\left(\mathsf{\Gamma }\right)$ has therefore all small limits since $\mathsf{Graph}$ does.

4.2. Comparison with the old definitions

Guided by the pioneering generalized sketch framework developed in the 90s by a group around Zinovy Diskin [4,5,6], we introduced in [1] a different definition of graph signatures and graph algebras, respectively. [1] considers a graph inclusion $i_{\mathtt{op}}:{\mathtt{I}}_{\mathtt{op}}\hookrightarrow {\mathtt{R}}_{\mathtt{op}}$ as the arity of an operation symbol $\mathtt{op}$ and defines an operation ${\mathtt{op}}^{\mathcal{G}}$ on a graph $\mathtt{G}$ as a map from ${\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$ to ${\mathtt{G}}^{{\mathtt{R}}_{\mathtt{op}}}$ making the following triangle commute for any $\mathit{b}:{\mathtt{I}}_{\mathtt{op}}\to \mathtt{G}$.

(19)

The need for projection operations, among other issues, advised us to introduce explicit output arities. At that point, we could have also chosen cospans ${\mathtt{I}}_{\mathtt{op}}\hookrightarrow {\mathtt{R}}_{\mathtt{op}}\hookleftarrow {\mathtt{O}}_{\mathtt{op}}$ to declare the arities of graph operations instead of the spans in Definition 15. The choice of spans has, however, many advantages that we will try to point at later in the paper.

In this subsection we discuss that the new variant and the old variant in [1] are semantically equivalent as either definition of arity, algebra, or homomorphism, respectively, can be obtained from the other.

4.2.1. Comparison of Arity Declarations

For any arity span ${\mathtt{I}}_{\mathtt{op}}\stackrel{l_{\mathtt{op}}}{\hookleftarrow }{\mathtt{B}}_{\mathtt{op}}\stackrel{r_{\mathtt{op}}}{\hookrightarrow }{\mathtt{O}}_{\mathtt{op}}$ in Definition 15 we can simply construct a pushout to obtain the result arity ${\mathtt{R}}_{\mathtt{op}}$

The pushout of the arities of the operation symbol $\mathtt{comp}$ is visualized in Figure 4.

Pushouts in $\mathsf{Graph}$ (as in any topos) preserve monomorphisms and, moreover, pushouts with a monomorphism involved are also pullbacks ([16], 13.3). Equation 15 ensures that we can choose the specific pushout ${\mathtt{R}}_{\mathtt{op}}={\mathtt{I}}_{\mathtt{op}}\cup {\mathtt{O}}_{\mathtt{op}}$, which makes the resulting $i_{\mathtt{op}}$ into a graph inclusion, matching the definition in [1]. Note, that ${\mathtt{B}}_{\mathtt{op}}={\mathtt{O}}_{\mathtt{op}}$ implies ${\mathtt{I}}_{\mathtt{op}}={\mathtt{R}}_{\mathtt{op}}$.

Conversely, given a cospan ${\mathtt{I}}_{\mathtt{op}}\stackrel{i_{\mathtt{op}}}{\hookleftarrow }{\mathtt{R}}_{\mathtt{op}}\stackrel{o_{\mathtt{op}}}{\hookrightarrow }{\mathtt{O}}_{\mathtt{op}}$ of graph inclusions, we can construct the intersection ${\mathtt{B}}_{\mathtt{op}}={\mathtt{I}}_{\mathtt{op}}\cap {\mathtt{O}}_{\mathtt{op}}$, i.e., the componentwise intersection of the vertex and edge sets. This is well-defined as both ${\mathtt{I}}_{\mathtt{op}}$ and ${\mathtt{O}}_{\mathtt{op}}$ are subgraphs of the same graph ${\mathtt{R}}_{\mathtt{op}}$. The resulting commutative square of inclusion graph homomorphisms is a pullback in $\mathsf{Graph}$ where the span ${\mathtt{I}}_{\mathtt{op}}\stackrel{l_{\mathtt{op}}}{\hookleftarrow }{\mathtt{B}}_{\mathtt{op}}\stackrel{r_{\mathtt{op}}}{\hookrightarrow }{\mathtt{O}}_{\mathtt{op}}$ satisfies the condition in Definition 15. In the case where ${\mathtt{R}}_{\mathtt{op}}={\mathtt{I}}_{\mathtt{op}}\cup {\mathtt{O}}_{\mathtt{op}}$, the square is also a pushout!

Arities of graph operations are, however, defined in [1] by a single graph inclusion $i_{\mathtt{op}}:{\mathtt{I}}_{\mathtt{op}}\hookrightarrow {\mathtt{R}}_{\mathtt{op}}$ only. In this situation, we can construct a cospan ${\mathtt{I}}_{\mathtt{op}}\stackrel{i_{\mathtt{op}}}{\hookleftarrow }{\mathtt{R}}_{\mathtt{op}}\stackrel{o_{\mathtt{op}}}{\hookrightarrow }{\mathtt{O}}_{\mathtt{op}}$ of graph inclusion with ${\mathtt{O}}_{\mathtt{op}}$ the smallest subgraph of ${\mathtt{R}}_{\mathtt{op}}$ containing all vertices in ${\left({\mathtt{R}}_{\mathtt{op}}\right)}_V\backslash {\left({\mathtt{I}}_{\mathtt{op}}\right)}_V$ and all edges in ${\left({\mathtt{R}}_{\mathtt{op}}\right)}_E\backslash {\left({\mathtt{I}}_{\mathtt{op}}\right)}_E$. By construction, we have ${\mathtt{R}}_{\mathtt{op}}={\mathtt{I}}_{\mathtt{op}}\cup {\mathtt{O}}_{\mathtt{op}}$. As for cospans, in general, ${\mathtt{B}}_{\mathtt{op}}$ is defined to be the graph ${\mathtt{I}}_{\mathtt{op}}\cap {\mathtt{O}}_{\mathtt{op}}$. However, the crucial observation is that ${\mathtt{B}}_{\mathtt{op}}$ will always be a discrete graph, i.e., a graph without edges! Note, that this construction is a special case of the construction of so-called initial pushouts in $\mathsf{Graph}$ ([9], 6.1).

Since for a pushout of arities ${\mathtt{B}}_{\mathtt{op}}={\mathtt{O}}_{\mathtt{op}}$ implies ${\mathtt{I}}_{\mathtt{op}}={\mathtt{R}}_{\mathtt{op}}$, this means, especially, that the original definition of arities of graph operations in [1] does not allow us to consider built-in projections (see Remark 11) as legal graph operations. This was one of the main reasons that we introduced spans of graph inclusions as arities in this paper.

In conclusion, the span and cospan version are inverse to each other (at least in $\mathsf{Graph}$) while the original version in [1] is a special case of the cospan version which is less expressive than the other two versions. All three variants give us, however, a pushout of arities and inclusion graph homomorphisms at hand.

4.2.2. Equivalence of graph operations

Given a pushout of arities we consider an arbitrary $\mathit{b}:{\mathtt{I}}_{\mathtt{op}}\to \mathtt{G}$.

For any $\mathit{o}:{\mathtt{O}}_{\mathtt{op}}\to \mathtt{G}$ with $r_{\mathtt{op}};\mathit{o}=l_{\mathtt{op}};\mathit{b}$ there exists, due to the pushout property, a unique ${\mathit{r}}_{\mathit{o}}:{\mathtt{R}}_{\mathtt{op}}\to \mathtt{G}$ with $i_{\mathtt{op}};{\mathit{r}}_{\mathit{o}}=\mathit{b}$ and $o_{\mathtt{op}};{\mathit{r}}_{\mathit{o}}=\mathit{o}$. Conversely, for any $\mathit{r}:{\mathtt{R}}_{\mathtt{op}}\to \mathtt{G}$ with $i_{\mathtt{op}};\mathit{r}=\mathit{b}$ we have trivially $l_{\mathtt{op}};\mathit{b}=r_{\mathtt{op}};(o_{\mathtt{op}};\mathit{r})$.

The uniqueness of mediating morphisms ensures that the assignments $\mathit{o}\mapsto {\mathit{r}}_{\mathit{o}}$ and $\mathit{r}\mapsto o_{\mathtt{op}};\mathit{r}$ are inverse to each other. This observation ensures that there is a one-to-one correspondence between maps from ${\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$ to ${\mathtt{G}}^{{\mathtt{R}}_{\mathtt{op}}}$ satisfying commutativity condition (19) and maps from ${\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$ to ${\mathtt{G}}^{{\mathtt{O}}_{\mathtt{op}}}$ satisfying the commutativity condition in Definition 16.

4.2.3. Equivalence of homomorphism conditions

Extending the equivalence of graph operations, also the equivalence of the respective homomorphism conditions can be shown straightforwardly utilizing the uniqueness of mediating morphisms for the pushout of arities, as the interest reader may check.

Remark 12

(Graph of a Graph Operation). For any map $f:A\to B$ its graph is usually defined as the binary relation $\left\{\right(a,f\left(a\right))\mid a\in A\}\subseteq A\times B$. Often the story is even turned and maps are introduced as those binary relations $f\subseteq A\times B$ which are left-total andright-unique.

Given a pushout of arities and a graph operation ${\mathtt{op}}^{\mathcal{G}}:{\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}\to {\mathtt{G}}^{{\mathtt{O}}_{\mathtt{op}}}$ we could, anologously, consider the set $\{{\mathit{r}}_{{\mathtt{op}}^{\mathcal{G}}\left(\mathit{b}\right)}\mid \mathit{b}\in {\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}\}\subseteq {\mathtt{G}}^{{\mathtt{R}}_{\mathtt{op}}}$ as the graph of the graph operation ${\mathtt{op}}^{\mathcal{G}}$. Utilizing the projections from ${\mathtt{G}}^{{\mathtt{R}}_{\mathtt{op}}}$ into ${\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$ and ${\mathtt{G}}^{{\mathtt{O}}_{\mathtt{op}}}$, respectively, we could even lift up properties likeleft-total and right-unique to characterize those subsets of ${\mathtt{G}}^{{\mathtt{R}}_{\mathtt{op}}}$ that correspond to graph operations.

This observation may be a basis to define Skolemization in Logics of Statements in Context [2] once we have integrated operations into those logics.

${\mathtt{R}}_{\mathtt{op}}$ has also another important role which was probably one of the reasons that the original definition of sketch operations in [4,5,6] relies on graph inclusions $i_{\mathtt{op}}:{\mathtt{I}}_{\mathtt{op}}\hookrightarrow {\mathtt{R}}_{\mathtt{op}}$. ${\mathtt{R}}_{\mathtt{op}}$ is the only place where the input items of a graph operation and the new items, created by the graph operation, can be related. In such a way, we have to use ${\mathtt{R}}_{\mathtt{op}}$ if we want to describe and specify properties of the output of a graph operation that depend on properties of the input.

Example 5

(Graph of Pullback Operation). Figure 5 shows the pushout of arity declarations for the operation symbol $\mathtt{pb}$. Constructing the graph of pullback operations, as described in Example 3, considers for any chosen pullback the whole pullback square, and not just the pullback span.

Example 6

(Chosen In general, any chosen (co)limits of diagrams of a fixed shape $\mathtt{I}$ in a category $\mathsf{C}$ give rise to a corresponding graph operation on $gr\left(\mathsf{C}\right)$ where arity $\mathtt{B}$ is simply given by all the vertices in $\mathtt{I}$ while arity $\mathtt{O}$ represents the shape of the corresponding (co)cones.

In such a way, the pushout $\mathtt{R}$ combines the fixed shape $\mathtt{I}$ of diagrams with the shape of corresponding (co)cones thus the elements in the graph of the corresponding graph operation on $gr\left(\mathsf{C}\right)$ represent, at the same time, a diagram and a (co)cone for this diagram.

Remark 13

(Advantages of Spans of Arities). Starting with a span of arities as in Definition 15 we get a corresponding commutative square of arities by a simple pushout construction. That this square becomes, moreover, in any topos a pullback is a necessary side effect.

If we start, in contrast, with a cospan we could construct a pullback to get a commutative square of arities. In the case of graphs (and probably in arbitrary pre-sheaf topoi) it is sufficient to require that the cospan of inclusion morphisms is jointly epic to make the pullback square simultaneously a pushout square. We are, however, not sure that this condition is sufficient for arbitrary topoi.

The tricky construction of initial pushouts for a single arity inclusion (and not a cospan!) may also generalize to arbitrary pre-sheaf topoi but probably not to arbitrary topoi.

The original definition of arities and graph operations in [1] turned out to be not appropriate to define derived graph operations. On one side, projections are necessary to define an appropriate notion of derived graph operations. The original definition excludes, however, projections. On the other side, our later construction of derived operations, by means of epi-mono factorizations and pushouts, can not be equivalently mimicked by means of the original definition. Even the universal property of initial pushouts is not of help in establishing an equivalence.

4.3. Graph Subalgebras

The definitions and results for graph algebras, presented in this subsection, are new and can not be found in [1].

The effort, we spent in Section 3, to lift up the traditional exposition of algebras to a more categorical one, pays now off. We can directly transfer most of the definitions and results from algebras to graph algebras. The only difference is that the "ad hoc totalization trick" in the proof of 3 does not work in case of graph algebras and that there is no axiom of choice in $\mathsf{Graph}$.

In contrast to Section 3, we do not distinguish between “subalgebras” and “inclusion homomorphisms”. We define “subalgebras” simply as “inclusions”.

Definition 18

(Graph Subalgebra). Let $\mathsf{\Gamma }=(OP,ar)$ be a graph signature. A Γ-algebra $\mathcal{G}=(\mathtt{G},O{P}^{\mathcal{G}})$ is a $\mathsf{\Gamma }$-subalgebra of a Γ-algebra $\mathcal{H}=(\mathtt{H},O{P}^{\mathcal{H}})$ if $\mathtt{G}⊑\mathtt{H}$ and and the inclusion graph homomorphism ${\iota }_{\mathtt{G},\mathtt{H}}=({\iota }_{{\mathtt{G}}_V,{\mathtt{H}}_V},{\iota }_{{\mathtt{G}}_E,{\mathtt{H}}_E}):\mathtt{G}\to \mathtt{H}$ establishes a Γ-homomorphism ${\iota }_{\mathtt{G},\mathtt{H}}:\mathcal{G}\to \mathcal{H}$.

We know that the monomorphisms (epimorphisms) in $\mathsf{Graph}$ are exactly the injective (surjective) graph homomorphisms, respectively. Faithful functors reflect monomorphisms and epimorphisms. The forgetful functor ${\mathbf{U}}_{\mathsf{\Gamma }}:\mathsf{Alg}\left(\mathsf{\Gamma }\right)\to \mathsf{Graph}$ is faithful thus we obtain

Corollary 10

(Injective and surjective Homomorphisms). If the underlying graph homomorphism $\phi :\mathtt{G}\to \mathtt{H}$ of a Γ-homomorphism $\phi :\mathcal{G}\to \mathcal{H}$ is injective (surjective) then $\phi :\mathcal{G}\to \mathcal{H}$ is a monomorphism (epimorphism) in $\mathsf{Alg}\left(\mathsf{\Gamma }\right)$.

The category $\mathsf{Graph}$ has all small limits and colimits and those are obtained by componentwise limits and colimits, respectively, in $\mathsf{Set}$. This means, especially, that $\mathsf{Graph}$ has all small multiple pullbacks (see Remark 3). Due to Theorem 2 we can define, in such a way, the intersection of graph subalgebras analogously to the intersection of subalgebras in Corollary 3.

Corollary 11

(Intersection of Graph Subalgebras). For any set I, any Γ-algebra $\mathcal{H}$, and any diagram $\delta :\mathtt{MP}\left(I\right)\to \mathsf{Alg}\left(\mathsf{\Gamma }\right)$ of Γ-subalgebras ${\delta }_{e_i}={\iota }_{{\mathtt{G}}_i,\mathtt{H}}:{\mathcal{G}}_i\hookrightarrow \mathcal{H}$, $i\in I$ of $\mathcal{H}$ there is a unique Γ-subalgebra $\mathcal{L}=(\mathtt{L},O{P}^{\mathcal{L}})$ of $\mathcal{H}$ with $\mathtt{L}={\bigcap }_{i\in I}{\mathtt{G}}_i$, i.e., ${\mathtt{L}}_V={\bigcap }_{i\in I}{\left({\mathtt{G}}_i\right)}_V$ and ${\mathtt{L}}_E={\bigcap }_{i\in I}{\left({\mathtt{G}}_i\right)}_E$, that is a Γ-subalgebra of ${\mathcal{G}}_i$ for all $i\in I$.

Moreover, the inclusion Γ-homomorphisms ${\iota }_{\mathtt{L},{\mathtt{G}}_i}:\mathcal{L}\hookrightarrow {\mathcal{G}}_i$, $i\in I$ and ${\iota }_{\mathtt{L},\mathtt{H}}:\mathcal{L}\hookrightarrow \mathcal{H}$ constitute a multiple pullback, i.e., a limit cone of the diagram $\delta :\mathtt{MP}\left(I\right)\to \mathsf{Alg}\left(\mathsf{\Gamma }\right)$.

We call $\mathcal{L}=(\mathtt{L},O{P}^{\mathcal{L}})$ also the intersection of the I-indexed family $\mathcal{M}=({\mathcal{G}}_i\mid i\in I)$ of Γ-subalgebras of $\mathcal{H}$ and may use the notations $\bigcap \mathcal{M}$, ${\bigcap }_{i\in I}{\mathcal{G}}_i$ or, simply, $\bigcap {\mathcal{G}}_i$ to denote $\mathcal{L}$.

The category $\mathsf{Graph}$ is well-powered, i.e., the collection of all graph subalgebras of a graph algebra is a set, thus we can define a concept “accessible via a graph homomorphism”.

Definition 19

(Graph Subalgebra accessible via a Graph Homomorphism). For any Γ-algebra $\mathcal{H}$ and any graph homomorphism $\phi :\mathtt{G}\to \mathtt{H}$ let $\mathcal{M}$ be the set of all Γ-subalgebras $\mathcal{X}$ of $\mathcal{H}$ such that φ factors through the inclusion graph homomorphism ${\iota }_{\mathtt{X},\mathtt{H}}:\mathtt{X}\hookrightarrow \mathtt{H}$, i.e., there exists a graph homomorphism ${\phi }_{\mathtt{X}}:\mathtt{G}\to X$ such that ${\phi }_{\mathcal{X}};{\iota }_{\mathtt{X},\mathtt{H}}=\phi$.

We denote by $\mathcal{R}(\phi ,\mathcal{H})$ the intersection of $\mathcal{M}$, according to Corollary 11. Especially, the carrier of $\mathcal{R}(\phi ,\mathcal{H})$ is the intersection $\mathtt{R}(\phi ,\mathcal{H}):=\bigcap \{\mathtt{X}\mid \mathcal{X}\in \mathcal{M}\}$ of graphs. We call $\mathcal{R}(\phi ,\mathcal{H})$ the$\mathsf{\Gamma }$-subalgebra of $\mathcal{H}$ accessible (reachable) via $\phi$or thehomomorphic image of $\mathtt{G}$ w.r.t. $\phi$.

In case of inclusion graph homomorphisms $\phi ={\iota }_{\mathtt{G},\mathtt{H}}:\mathtt{G}\hookrightarrow \mathtt{H}$ we use also the notation $\mathcal{R}(\mathtt{G},\mathcal{H})$ instead of $\mathcal{R}({\iota }_{\mathtt{G},\mathtt{H}},\mathcal{H})$ and call $\mathcal{R}(\mathtt{G},\mathcal{H})$ also the$\mathsf{\Gamma }$-subalgebra of $\mathcal{H}$ generated by $\mathtt{G}$.

Note, that the graph homomorphism ${\phi }_{\mathtt{X}}:\mathtt{G}\to X$ in Definition 19 is unique, if it exists, since the inclusion graph homomorphism ${\iota }_{X,B}:\mathtt{X}\hookrightarrow \mathtt{H}$ is a monomorphism in $\mathsf{Graph}$.

We can also transfer Corollary 4 to graph algebras since for any graph homomorphism $\phi :\mathtt{G}\to \mathtt{H}$ the set-theoretic image $\phi \left(\mathtt{G}\right)$ of $\mathtt{G}$ w.r.t. $\phi$ constitutes a subgraph of $\mathtt{H}$. Moreover, we have $\phi \left(\mathtt{G}\right)=\bigcap \{\mathtt{Y}\mid \mathtt{Y}\in \mathcal{N}\}$ for the set $\mathcal{N}$ of all subgraphs $\mathtt{Y}$ of $\mathtt{H}$.

Corollary 12

(Homomorphic image includes Image). For any Γ-algebra $\mathcal{H}$ and any graph homomorphism $\phi :\mathtt{G}\to \mathtt{H}$ we have $\phi \left(\mathtt{G}\right)⊑\mathtt{R}(\phi ,\mathcal{H})$ for the set-theoretic image $\phi \left(\mathtt{G}\right)$ of $\mathtt{G}$ w.r.t. φ.

Definition 20

(Accessible and Generated Graph Algebras). Let $\mathcal{H}$ be a Γ-algebra.

• $\mathcal{H}$ isaccessible via a graph homomorphism $\phi :\mathtt{G}\to \mathtt{H}$if $\mathcal{R}(\phi ,\mathcal{H})=\mathcal{H}$.
• If $\mathcal{H}$ is accessible via an inclusion graph homomorphism ${\iota }_{\mathtt{G},\mathtt{H}}:\mathtt{G}\to \mathtt{H}$, i.e., if $\mathcal{R}(\mathtt{G},\mathcal{H})=\mathcal{R}({\iota }_{\mathtt{G},\mathtt{H}},\mathcal{H})=\mathcal{H}$, we say also that $\mathcal{H}$ isgenerated by $\mathtt{G}$.
• $\mathcal{H}$ is said to be generated if it is generated by the empty graph, i.e., accessible via the unique graph homomorphism ${\iota }_{\mathbf{0},\mathtt{H}}:\mathbf{0}\hookrightarrow \mathtt{H}$ from the initial object $\mathbf{0}$ in $\mathsf{Graph}$ to $\mathtt{H}$.

Corollary 13.

A Γ-algebra $\mathcal{H}$ is generated if, and only if, there are no proper Γ-subalgebras of $\mathcal{H}$.

Corollary 14.

If a signature Γ has no constant symbols, then the empty Γ-algebra is the only generated Γ-algebra.

The concept accessible via a graph homomorphism can be utilized to find a characterization of epimorphisms in $\mathsf{Alg}\left(\mathsf{\Gamma }\right)$. First, we observe that “accessible” implies “epic”.

Lemma 5

(Accessible implies Epic). A Γ-homomorphism $\phi :\mathcal{G}\to \mathcal{H}$ is an epimorphism in $\mathsf{Alg}\left(\mathsf{\Gamma }\right)$ if $\mathcal{H}$ is accessible via the underlying graph homomorphism $\phi :\mathtt{G}\to \mathtt{H}$, i.e., if $\mathcal{H}=\mathcal{R}(\phi ,\mathcal{H})$.

Proof. 

We consider arbitrary Γ-homomorphsms $\psi ,\varphi :\mathcal{H}\to \mathcal{K}$ such that $\phi ;\psi =\phi ;\varphi$.

We know that the subgraph $\mathtt{X}$ of $\mathtt{H}$ with ${\mathtt{X}}_V=\{v\in {\mathtt{H}}_V\mid {\psi }_V\left(v\right)={\varphi }_V\left(v\right)\}\subseteq {\mathtt{H}}_V$, ${\mathtt{X}}_E=\{e\in {\mathtt{H}}_E\mid {\psi }_E\left(e\right)={\varphi }_E\left(e\right)\}\subseteq {\mathtt{H}}_E$ together with the inclusion graph homomorphism ${\iota }_{\mathtt{X},\mathtt{H}}:\mathtt{X}\hookrightarrow \mathtt{H}$ is an equalizer of the graph homomorphisms $\psi ,\varphi :\mathtt{H}\to \mathtt{K}$ in $\mathsf{Graph}$. According to Theorem 2, there is a unique Γ-algebra $\mathcal{X}=(\mathtt{X},O{P}^{\mathcal{X}})$ such that ${\iota }_{\mathtt{X},\mathtt{H}}:\mathtt{X}\hookrightarrow \mathtt{H}$ becomes an inclusion Γ-homomorphism ${\iota }_{\mathtt{X},\mathtt{H}}:\mathcal{X}\hookrightarrow \mathcal{H}$ which is, moreover, the equalizer of the Γ-homomorphisms $\psi ,\varphi :\mathcal{H}\to \mathcal{K}$.

Assumption $\phi ;\psi =\phi ;\varphi$ ensures that there exists a unique graph homomorphism ${\phi }_{\mathcal{X}}:\mathtt{G}\to \mathtt{X}$ with ${\phi }_{\mathcal{X}};{\iota }_{\mathtt{X},\mathtt{H}}=\phi$. Due to the construction of $\mathcal{R}(\phi ,\mathcal{H})$ in Definition 19, we have an inclusion Γ-homomorphism ${\iota }_{R(\phi ,\mathcal{H}),\mathtt{X}}:\mathcal{R}(\phi ,\mathcal{H})\hookrightarrow \mathcal{X}$. Accessibility of $\mathcal{H}$ means $\mathcal{H}=\mathcal{R}(\phi ,\mathcal{H})$ thus we get, finally, $\mathcal{X}=\mathcal{H}$. This means, however, that the equalizer of ψ and ϕ in $\mathsf{Graph}$ is the identity on $\mathtt{H}$ thus we have $\psi =\varphi$ as required. □

We can also show that graph subalgebras are regular monomorphisms. Unfortunately, the “ad hoc totalization trick”, used in the proof of Proposition 3, does not work for arbitrary graph operations since we may have, in contrast to traditional operations, non-empty boundaries and a corresponding commutativity requirement for graph operations. The simplest example, where this trick fails, is an operation that simply outputs a chosen edge between two distinct nodes.

What we need is a more well-behaved procedure of transforming partial graph algebras into total graph algebras. We develop therefore in Section 4.4 a corresponding free construction called term completion.

Proposition 7

(Graph Subalgebras are Regular Monos). For any Γ-subalgebra ${\iota }_{\mathtt{G},\mathtt{H}}:\mathcal{G}\to \mathcal{H}$ of a Γ-algebra $\mathcal{H}$ there exists a Γ-algebra $\mathcal{K}$ and parallel Γ-homomorphisms $\psi ,\varphi :\mathcal{H}\to \mathcal{K}$ such that ${\iota }_{\mathtt{G},\mathtt{H}}:\mathcal{G}\to \mathcal{H}$ is the equalizer of ψ and ϕ in $\mathsf{Alg}\left(\mathsf{\Gamma }\right)$.

Proof. 

Utilizing th term completion construction and its characterization as a free construction, as presented in Section 4.4, we will sketch a proof varying the proof of Proposition 3.

We construct the pushout of the span $\mathtt{H}$ $\stackrel{{\iota }_{\mathtt{G},\mathtt{H}}}{\leftarrow }$ $\mathtt{G}$ $\stackrel{{\iota }_{\mathtt{G},\mathtt{H}}}{\to }$ $\mathtt{H}$ of inclusion graph homomorphisms (see the left diagram below). We set $\mathtt{K}:=\mathtt{H}{+}_{\mathtt{G}}\mathtt{H}$. Since ${\iota }_{\mathtt{G},\mathtt{H}}$ is monic in $\mathsf{Graph}$ both graph homomorphisms ${\kappa }_1,{\kappa }_2:\mathtt{H}\to \mathtt{K}$ are monic too and, moreover, the pushout square is as well a pullback square. This ensures, especially, that ${\iota }_{\mathtt{G},\mathtt{H}}:\mathtt{G}\to \mathtt{H}$ is the equalizer of the graph homomorphisms ${\kappa }_1,{\kappa }_2:\mathtt{H}\to \mathtt{K}$ in $\mathsf{Graph}$.

Graph Operations on $\mathtt{K}$: We extend $\mathtt{K}$ to a partial Γ-algebra $\mathcal{K}=(\mathtt{K},O{P}^{\mathcal{K}})$ (see Definition 21) by defining for each $\mathtt{op}$ in $OP$ a corresponding partial graph operation ${\mathtt{op}}^{\mathcal{K}}:{\mathtt{K}}^{I_{\mathtt{op}}}\circ ⟶{\mathtt{K}}^{O_{\mathtt{op}}}$ according to Case 1, Case 2 and Case 3.

The operations in $\mathcal{K}$ are defined exactly in a way that the graph homomorphisms ${\kappa }_1$ and ${\kappa }_2$ become Γ-homomorphisms ${\kappa }_1,{\kappa }_2:\mathcal{H}\to \mathcal{K}$, in the sense of Definition 22, thus we obtain a commutative square in $\mathsf{PAlg}$ (see the middle diagram above).

Applying the functor ${\mathbf{TC}}_{\mathsf{\Gamma }}:\mathsf{PAlg}\left(\mathsf{\Gamma }\right)\to \mathsf{Alg}\left(\mathsf{\Gamma }\right)$ we transform this commutative square in $\mathsf{PAlg}\left(\mathsf{\Gamma }\right)$ into a commutative square in $\mathsf{Alg}\left(\mathsf{\Gamma }\right)$. Taking into account Corollary 15 and (23) we get the commutative diagram on the right above.

The underlying square of graph homomorphisms is again a pullback in $\mathsf{Graph}$ since the inclusion graph homomorphism ${\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}:\mathtt{K}\to {\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$ is monic in $\mathsf{Graph}$.

Theorem 2 ensures, finally, that the Γ-homomorphism ${\iota }_{\mathtt{G},\mathtt{H}}:\mathcal{G}\to \mathcal{H}$ is the equalizer of the Γ-homomorphisms ${\kappa }_1;{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)},{\kappa }_2;{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}:\mathcal{H}\to {\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$. □

Regularity of $\mathsf{Alg}\left(\mathsf{\Gamma }\right)$ entails that the concepts accessible and epic are equivalent.

Proposition 8

(Accessible ≅ Epic). For any Γ-homomorphism $\phi :\mathcal{G}\to \mathcal{H}$ it holds that $\mathcal{H}$ is accessible via the underlying graph homomorphism $\phi :\mathtt{G}\to \mathtt{H}$, i.e., in other words $\mathcal{H}$ is equal to the homomorphic image $\mathcal{R}(\phi ,\mathcal{H})$ of $\mathcal{G}$ w.r.t. φ, if, and only if, $\phi :\mathcal{G}\to \mathcal{H}$ is an epimorphism in $\mathsf{Alg}\left(\mathsf{\Gamma }\right)$.

Proof. 

“Accessible implies epic” has been shown in 5. We show now “epic implies accessible”: We consider an arbitrary Γ-subalgebra $\mathcal{X}$ of $\mathcal{H}$ such that there exists a graph homomorphism ${\phi }_{\mathcal{X}}:\mathtt{G}\to \mathtt{X}$ with ${\phi }_{\mathcal{X}};{\iota }_{\mathtt{X},\mathtt{B}}=\phi$. Due to Proposition 7 there exist Γ-homomorphisms $\psi ,\varphi :\mathcal{H}\to \mathcal{C}$ such that ${\iota }_{\mathtt{X},\mathtt{H}}:\mathcal{X}\to \mathcal{H}$ is the equalizer of ψ and ϕ. Due to the assumption ${\phi }_{\mathcal{X}};{\iota }_{\mathtt{X},\mathtt{H}}=\phi$, we get $\phi ;\psi =\phi ;\varphi$ and thus $\psi =\varphi$ since φ is epic. This means, however, $\mathcal{X}=\mathcal{H}$ and, finally, $\mathcal{R}(\phi ,\mathcal{H})=\mathcal{H}$ due to the construction of $\mathcal{R}(\phi ,\mathcal{H})$ in Definition 19. □

The axiom of choice is not valid in $\mathsf{Graph}$. Therefore, the set-theoretic image $\phi \left(\mathtt{G}\right)$ of the carrier $\mathtt{G}$ of a $\mathsf{\Gamma }$-algebra $\mathcal{G}$ w.r.t. a $\mathsf{\Gamma }$- homomorphism $\phi :\mathcal{G}\to \mathcal{H}$ is, in general, not closed w.r.t. operations in $\mathcal{H}$. As a consequence, not every epic $\mathsf{\Gamma }$-homomorphism needs to be surjective. We adapt the standard example of the composition of morphisms in categories.

Example 7

(Epic ≇ Surjective). We consider a ${\mathsf{\Gamma }}_{cat}$-homomorphism $\phi :\mathcal{G}\to \mathcal{H}$ between two finite ${\mathsf{\Gamma }}_{cat}$-algebras $\mathcal{G}$ and $\mathcal{H}$, as depicted below.

${\mathtt{G}}^{{\mathtt{I}}_{\mathtt{comp}}}$ is empty while ${\mathtt{H}}^{{\mathtt{I}}_{\mathtt{comp}}}$ has exactly one element $\mathit{b}$ given by the assignments $f\mapsto \alpha$, $g\mapsto \beta$. α and β are in the set-theoretic image $\phi \left(\mathtt{G}\right)$ while the result of applying ${\mathtt{comp}}^{\mathcal{G}}$ to $\mathit{b}$, namely $\gamma ={\mathtt{comp}}^{\mathcal{G}}\left(\mathit{b}\right)\left(o{e}_1\right)$, is not. $\phi :\mathcal{G}\to \mathcal{H}$ is not surjective but epic since $\mathcal{H}=\mathcal{R}(\phi ,\mathcal{H})$.

4.4. Partial Graph Algebras and their Term Completion

In practice, graph operations are often partial graph operations. The sketch operations introduced in [5,6], for example, can be seen as partial graph operations where the domain of definition is specified by diagrammatic predicates. Therefore we decided to present in this paper also the very basic definitions for partial graph algebras.

This decision was also triggered by the observation that we could prove Proposition 7 for arbitrary graph signatures based on a well-behaved completion procedure transforming partial (graph) algebras into total (graph) algebras. To our little surprise the construction of (graph) term algebras turns out to be just a special case of this new procedure.

Definition 21

(Partial Graph algebra). Apartial (graph) $\mathsf{\Gamma }$-algebra $\mathcal{G}$ is a pair $(\mathtt{G},O{P}^{\mathcal{G}})$ given

• by a graph $\mathtt{G}$, called the carrier of $\mathcal{G}$, and
• a family $O{P}^{\mathcal{G}}=({\mathtt{op}}^{\mathcal{G}}:{\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}\circ ⟶{\mathtt{G}}^{{\mathtt{O}}_{\mathtt{op}}}|\mathtt{op}\in OP)$ of partial maps such that the following diagram commutes for all $\mathtt{op}$ in $OP$ and all graph homomorphisms $\mathit{b}\in dom\left({\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}\right)$.

(20)

The partial maps in $O{P}^{\mathcal{G}}$ are referred to aspartial graph operations.

Be aware that also constants can be partial! For any constant symbol $\mathtt{c}$ in $OP$, with ${\mathtt{I}}_{\mathtt{c}}=\mathbf{0}$, we do have exactly two possibilities since ${\mathtt{G}}^{{\mathtt{I}}_{\mathtt{c}}}$ is a singleton: Either, $dom\left({\mathtt{c}}^{\mathcal{G}}\right)={\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$, i.e., the constant is defined, or $dom\left({\mathtt{c}}^{\mathcal{G}}\right)=\varnothing$, i.e., the constant is not defined.

Definition 22

(Partial Graph Algebra Homomorphism). A $\mathsf{\Gamma }$-homomorphism $\phi :\mathcal{G}\to \mathcal{H}$ between two partial Γ-algebras $\mathcal{G}=(\mathtt{G},O{P}^{\mathcal{G}})$ and $\mathcal{H}=(\mathtt{H},O{P}^{\mathcal{H}})$ is a graph homomorphism $\phi :\mathtt{G}\to \mathtt{H}$ satisfying the following homomorphism condition

$$\left(\mathrm{HCP}\right)\mathit{b};\phi \in dom\left({\mathtt{H}}^{{\mathtt{I}}_{\mathtt{op}}}\right)and{\mathtt{op}}^{\mathcal{G}}\left(\mathit{b}\right);\phi ={\mathtt{op}}^{\mathcal{H}}(\mathit{b};\phi )forall\mathtt{op}\in OPandall\mathit{b}\in dom\left({\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}\right).$$

In other words, definedness of partial operations has to be preserved by a homomorphism but does not need to be reflected!

Partial graph $\mathsf{\Gamma }$-algebras and $\mathsf{\Gamma }$-homomorphisms between them constitute a category $\mathsf{PAlg}\left(\mathsf{\Gamma }\right)$: Composition $\phi ;\psi :\mathcal{G}\to \mathcal{K}$ of two $\mathsf{\Gamma }$-homomorphisms $\phi :\mathcal{G}\to \mathcal{H}$ and $\psi :\mathcal{H}\to \mathcal{K}$ is given by the composition $\phi ;\psi$ of the underlying graph homomorphisms $\phi :\mathtt{G}\to \mathtt{H}$ and $\psi :\mathtt{H}\to \mathtt{K}$. The identity $\mathsf{\Gamma }$-homomorphism $i{d}_{\mathcal{G}}:\mathcal{G}\to \mathcal{G}$ for any partial $\mathsf{\Gamma }$-algebra $\mathcal{G}$ is given by the identity graph homomorphism $i{d}_{\mathtt{G}}:\mathtt{G}\to \mathtt{G}$. We consider graph $\mathsf{\Gamma }$-algebras as special partial $\mathsf{\Gamma }$-algebras thus $\mathsf{Alg}\left(\mathsf{\Gamma }\right)$ is a full subcategory of $\mathsf{PAlg}\left(\mathsf{\Gamma }\right)$.

Proposition 9

(Forgetful Functor). The assignments $\mathcal{G}\to \mathtt{G}$ and $(\phi :\mathcal{G}\to \mathcal{H})\mapsto (\phi :\mathtt{G}\to \mathtt{H})$ define a faithful forgetful functor

$${\mathbf{U}}_{\mathsf{\Gamma }}^P:\mathsf{PAlg}\left(\mathsf{\Gamma }\right)\to \mathsf{Graph}.$$

By introducing a fresh new element whenever an operation is not defined for a certain input, we can transform any partial (graph) algebra into a total (graph) algebra.

Remark 14

(Syntactic Representaion of Inputs). In addition to our notational conventions in Section 2 and Remark 10 we will rely on the following syntactic representation of inputs of graph operations: For any graph $\mathtt{G}$ and any $\mathtt{op}$ in $OP$ an input $\mathit{b}=({\mathit{b}}_V,{\mathit{b}}_E)\in {\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$ is represented by two strings, representing the vertices and the edges in $\mathtt{G}$, respectively, separated by the symbol “|”

$$syn\left(\mathit{b}\right):=⌜b{v}_1,\dots ,b{v}_{n_{\mathtt{op}}}b{e}_1,\dots ,b{e}_{m_{\mathtt{op}}}⌝$$

where $n_{\mathtt{op}}=\left|{\left({\mathtt{I}}_{\mathtt{op}}\right)}_V\right|$ and $m_{\mathtt{op}}=\left|{\left({\mathtt{I}}_{\mathtt{op}}\right)}_E\right|$. In case ${\mathtt{I}}_{\mathtt{op}}=\mathbf{0}$, the only input ${\mathbf{0}}_{\mathtt{G}}=(\left(\right),\left(\right)):\mathbf{0}\to \mathtt{G}$ is represented, in such a way, by two separated empty sequences: $syn\left({\mathbf{0}}_{\mathtt{G}}\right)=⌜|⌝$.

Of course, we could work with any other syntactic representation as long as the following two important properties are satisfied: (1) Uniqueness, i.e., for all ${\mathit{b}}_1,{\mathit{b}}_2\in {\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$ we have $syn\left({\mathit{b}}_1\right)=syn\left({\mathit{b}}_2\right)$ if, and only if, ${\mathit{b}}_1={\mathit{b}}_2$. (2) $syn\left(\mathit{b}\right)$ is indeed a representation, i.e. we are able to reconstruct from $syn\left(\mathit{b}\right)$ the corresponding graph homomorphism $\mathit{b}=({\mathit{b}}_V,{\mathit{b}}_E)\in {\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$ with help of the information about ${\mathtt{I}}_{\mathtt{op}}$ in the signature Γ. In case ${\mathtt{I}}_{\mathtt{op}}$ has no isolated vertices, for example, we can represent uniquely any $\mathit{b}\in {\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$ by the string $⌜b{e}_1,\dots ,b{e}_{m_{\mathtt{op}}}⌝$ only!

Definition 23

(Term Completion). Let $\mathsf{\Gamma }=(OP,ar)$ be a graph signature and $\mathcal{K}=(\mathtt{K},O{P}^{\mathcal{K}})$ be a partial Γ-algebra. We define the $\mathsf{\Gamma }$-term completion ${\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$ of the graph $\mathtt{K}$ w.r.t. the partial Γ-algebra $\mathcal{K}$ as the smallest graph satisfying the following three conditions:

Generators: 

$\mathtt{K}⊑{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$

Constants: 

For all constants $\mathtt{c}$ in $OP$, such that $dom\left({\mathtt{c}}^{\mathcal{K}}\right)=\varnothing$ the graph ${\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$ contains

• $⌜{\mathtt{c}}_{ov}\langle |\rangle ⌝$ as a vertex, for each vertex $ov$ in ${\mathtt{O}}_{\mathtt{c}}$;
• $⌜{\mathtt{c}}_{oe}\langle |\rangle ⌝$ as an edge, for each edge $oe$ in ${\mathtt{O}}_{\mathtt{c}}$,
  where $s{c}^{{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left({\mathtt{c}}_{oe}\langle |\rangle \right):={\mathtt{c}}_{s{c}^{{\mathtt{O}}_{\mathtt{c}}}\left(oe\right)}\langle |\rangle$ and $t{g}^{{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left({\mathtt{c}}_{oe}\langle |\rangle \right):={\mathtt{c}}_{t{g}^{{\mathtt{O}}_{\mathtt{c}}}\left(oe\right)}\langle |\rangle$

Operations: 

For all $\mathtt{op}$ in $OP$ with ${\mathtt{I}}_{\mathtt{op}}\ne \mathbf{0}$ and any $\mathit{t}\in {\mathtt{T}}_{\mathsf{\Gamma }}{\left(\mathcal{K}\right)}^{{\mathtt{I}}_{\mathtt{op}}}$ such that there is no $\mathit{b}\in dom\left({\mathtt{op}}^{\mathcal{K}}\right)\subseteq {\mathtt{K}}^{{\mathtt{I}}_{\mathtt{op}}}$ with $\mathit{t}=\mathit{b};{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}$, ${\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$ contains

• $⌜{\mathtt{op}}_{ov}\langle syn\left(\mathit{t}\right)\rangle ⌝$ as a vertex, for each vertex $ov$ in ${\left({\mathtt{O}}_{\mathtt{op}}\right)}_V\setminus {\left({\mathtt{B}}_{\mathtt{op}}\right)}_V$;
• $⌜{\mathtt{op}}_{oe}\langle syn\left(\mathit{t}\right)\rangle ⌝$ as an edge, for each edge $oe$ in ${\left({\mathtt{O}}_{\mathtt{op}}\right)}_E\setminus {\left({\mathtt{B}}_{\mathtt{op}}\right)}_E$, where

  $$s{c}^{{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left({\mathtt{op}}_{oe}\langle syn\left(\mathit{t}\right)\rangle \right):=\left\{\begin{array}{cc}\hfill {\mathit{t}}_V\left(s{c}^{{\mathtt{O}}_{\mathtt{op}}}\left(oe\right)\right)& \hfill ifs{c}^{{\mathtt{O}}_{\mathtt{op}}}\left(oe\right)\in {\left({\mathtt{B}}_{\mathtt{op}}\right)}_V\\ \hfill {\mathtt{op}}_{s{c}^{{\mathtt{O}}_{\mathtt{op}}}\left(oe\right)}\langle syn\left(\mathit{t}\right)\rangle & \hfill ifs{c}^{{\mathtt{O}}_{\mathtt{op}}}\left(oe\right)\in {\left({\mathtt{O}}_{\mathtt{op}}\right)}_V\setminus {\left({\mathtt{B}}_{\mathtt{op}}\right)}_V\end{array}\right.$$

  $$t{g}^{{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left({\mathtt{op}}_{oe}\langle syn\left(\mathit{t}\right)\rangle \right):=\left\{\begin{array}{cc}\hfill {\mathit{t}}_V\left(t{g}^{{\mathtt{O}}_{\mathtt{op}}}\left(oe\right)\right)& \hfill ift{g}^{{\mathtt{O}}_{\mathtt{op}}}\left(oe\right)\in {\left({\mathtt{B}}_{\mathtt{op}}\right)}_V\\ \hfill {\mathtt{op}}_{t{g}^{{\mathtt{O}}_{\mathtt{op}}}\left(oe\right)}\langle syn\left(\mathit{t}\right)\rangle & \hfill ift{g}^{{\mathtt{O}}_{\mathtt{op}}}\left(oe\right)\in {\left({\mathtt{O}}_{\mathtt{op}}\right)}_V\setminus {\left({\mathtt{B}}_{\mathtt{op}}\right)}_V\end{array}\right.$$

Obviously, we have

$${\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)=\mathtt{K}\mathrm{for}\mathrm{all}\mathrm{total}\mathsf{\Gamma }-\mathrm{algebras}\mathcal{K}=(\mathtt{K},O{P}^{\mathcal{K}}).$$

(21)

Remark 15

(Term Construction by Pushouts). The construction of Γ-terms in Definition 23 can be organized as a successive application of term construction steps: A term construction step in the case Constants means that we construct, in parallel, for a constant symbol $\mathtt{c}$ the terms for all vertices and edges in ${\mathtt{O}}_{\mathtt{c}}$. Analogously, a term construction step in the case Operations means that we construct for an operation symbol $\mathtt{op}$ and an input $\mathit{t}$, in parallel, the terms for all vertices and edges in ${\mathtt{O}}_{\mathtt{op}}\setminus {\mathtt{B}}_{\mathtt{op}}$. We start with the graph $\mathtt{K}$ and each term construction step extends a given graph $\mathtt{T}$ to a graph ${\mathtt{T}}^{\prime }$. This extension is, however, nothing but the construction of the following pushout

where the definition of ${\mathtt{op}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left(\mathit{t}\right)$ is spelled out, explicitly, in Definition 24. In the light of this observation, one can look at the term notation as a means to solve two problems:

• The term notation provides a uniform mechanism to create unique identifiers for the new graph items introduced by applying a non-deleting injective graph transformation rule.
• At the same time, the term notation encodes all the information necessary to identify uniquely the pushout that has been creating the new items.

The following term completion construction is new and has even never been defined even for traditional partial algebras. Utilizing the operations in $\mathcal{K}$ to the greatest possible extend, we can straightforwardly extend $\mathcal{K}$ to a total $\mathsf{\Gamma }$-algebra with carrier ${\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$.

Definition 24

(Term Completion Algebra). We can extend any partial Γ-algebra $\mathcal{K}=(\mathtt{K},O{P}^{\mathcal{K}})$ to a total Γ-algebra ${\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)=({\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right),O{P}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)})$ as follows:

Constants: 

For all constants $\mathtt{c}$ in $OP$:

Utilizing$\mathcal{K}$:

If ${\mathtt{c}}^{\mathcal{K}}$ is defined, we simply reuse it:

$${\mathtt{c}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left({\mathbf{0}}_{{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\right)={\mathtt{c}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}({\mathbf{0}}_{\mathtt{K}};{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}):={\mathtt{c}}^{\mathcal{K}}\left({\mathbf{0}}_{\mathtt{K}}\right);{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}$$

Completion: 

If ${\mathtt{c}}^{\mathcal{K}}$ is not defined, i.e., $dom\left({\mathtt{c}}^{\mathcal{K}}\right)=\varnothing$ we set

• ${\left({\mathtt{c}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left({\mathbf{0}}_{{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\right)\right)}_V\left(ov\right):=⌜{\mathtt{c}}_{ov}\langle |\rangle ⌝$ for each vertex $ov$ in ${\mathtt{O}}_{\mathtt{c}}$ and
• ${\left({\mathtt{c}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left({\mathbf{0}}_{{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\right)\right)}_E\left(oe\right):=⌜{\mathtt{c}}_{oe}\langle |\rangle ⌝$ for each edge $oe$ in ${\mathtt{O}}_{\mathtt{c}}$.

Operations: 

For all $\mathtt{op}$ in $OP$ with ${\mathtt{I}}_{\mathtt{op}}\ne \mathbf{0}$ and any $\mathit{t}\in {\mathtt{T}}_{\mathsf{\Gamma }}{\left(\mathcal{K}\right)}^{{\mathtt{I}}_{\mathtt{op}}}$:

Utilizing$\mathcal{K}$:

If there is a $\mathit{b}\in dom\left({\mathtt{op}}^{\mathcal{K}}\right)\subseteq {\mathtt{K}}^{{\mathtt{I}}_{\mathtt{op}}}$ with $\mathit{t}=\mathit{b};{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}$, we reuse ${\mathtt{op}}^{\mathcal{K}}$:

$${\mathtt{op}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left(\mathit{t}\right)={\mathtt{op}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}(\mathit{b};{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}):={\mathtt{op}}^{\mathcal{K}}\left(\mathit{b}\right);{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}$$

Completion: 

If there is no $\mathit{b}\in dom\left({\mathtt{op}}^{\mathcal{K}}\right)\subseteq {\mathtt{K}}^{{\mathtt{I}}_{\mathtt{op}}}$ with $\mathit{t}=\mathit{b};{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}$, we set

$${\left({\mathtt{op}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left(\mathit{t}\right)\right)}_V\left(ov\right):=\left\{\begin{array}{cc}\hfill {\mathit{t}}_V\left(ov\right)& ifov\in {\left({\mathtt{B}}_{\mathtt{op}}\right)}_V\hfill \\ \hfill ⌜{\mathtt{op}}_{ov}\langle syn\left(\mathit{t}\right)\rangle ⌝& ifov\in {\left({\mathtt{O}}_{\mathtt{op}}\right)}_V\setminus {\left({\mathtt{B}}_{\mathtt{op}}\right)}_V\hfill \end{array}\right.$$

$${\left({\mathtt{op}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left(\mathit{t}\right)\right)}_E\left(oe\right):=\left\{\begin{array}{cc}\hfill {\mathit{t}}_E\left(oe\right)& ifoe\in {\left({\mathtt{B}}_{\mathtt{op}}\right)}_E\hfill \\ \hfill ⌜{\mathtt{op}}_{oe}\langle syn\left(\mathit{t}\right)\rangle ⌝& ifoe\in {\left({\mathtt{O}}_{\mathtt{op}}\right)}_E\setminus {\left({\mathtt{B}}_{\mathtt{op}}\right)}_E.\hfill \end{array}\right.$$

The definitions ensure that the constructed pairs ${\mathtt{op}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left(\mathit{t}\right)$ of maps are indeed graph homomorphisms and that the operations in ${\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$ satisfy the commutativity condition in Definition 16. Moreover, the cases “Utilizing $\mathcal{K}$” are defined in such a way that we get

Corollary 15

(Embedding). For any partial Γ-algebra $\mathcal{K}=(\mathtt{K},O{P}^{\mathcal{K}})$ the inclusion graph homomorphism ${\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}:\mathtt{K}\to {\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$ constitutes a Γ-homomorphism ${\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}:\mathcal{K}\to {\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$ in $\mathsf{PAlg}\left(\mathsf{\Gamma }\right)$ thus, due to (21), ${\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)=\mathcal{K}$ if$\mathcal{K}$ is a total Γ-algebra.

We can adapt and generalize the proof of Proposition 2 (Free graph algebras) in [1] to a proof that term completion is a free construction.

Proposition 10

(Term Completion as Free Construction). For any partial Γ-algebra $\mathcal{K}=(\mathtt{K},O{P}^{\mathcal{K}})$, the total Γ-algebra ${\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)=({\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right),O{P}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)})$ has the following universal property: For any total Γ-algebra $\mathcal{G}=(\mathtt{G},O{P}^{\mathcal{G}})$ and any Γ-homomorphism $\phi :\mathcal{K}\to \mathcal{G}$ there exists a unique Γ-homomorphism ${\phi }^{*}:{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)\to \mathcal{G}$ such that the defining condition ${\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)};{\phi }^{*}=\phi$ is satisfied.

Proof. 

We prove by structural induction according to Definition 23 and Remark 15.

Generators: 

In this basic case the defining condition forces ${\phi }_V^{*}\left(kv\right)={\phi }_V\left(kv\right)$ for all $kv\in {\mathtt{K}}_V$ and ${\phi }_E^{*}\left(kv\right)={\phi }_E\left(ke\right)$ for all $ke\in {\mathtt{K}}_E$.

Constants: 

In the second basic case we have for all constants $\mathtt{c}$ in $OP$:

Utilizing$\mathcal{K}$:

If ${\mathtt{c}}^{\mathcal{K}}$ is defined, the definition of operations in ${\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$, the defining condition and the assumption that φ is a Γ-homomorphism ensure that ${\phi }^{*}$ satisfies the homorphism condition for the constant $\mathtt{c}$:

$$\begin{array}{cc}\hfill {\mathtt{c}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left({\mathbf{0}}_{{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\right);{\phi }^{*}& ={\mathtt{c}}^{\mathcal{K}}\left({\mathbf{0}}_{\mathtt{K}}\right);{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)};{\phi }^{*}={\mathtt{c}}^{\mathcal{K}}\left({\mathbf{0}}_{\mathtt{K}}\right);\phi ={\mathtt{c}}^{\mathcal{G}}({\mathbf{0}}_{\mathtt{K}};\phi )\hfill \\ \hfill & ={\mathtt{c}}^{\mathcal{G}}({\mathbf{0}}_{\mathtt{K}};{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)};{\phi }^{*})={\mathtt{c}}^{\mathcal{G}}({\mathbf{0}}_{{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)};{\phi }^{*})\hfill \end{array}$$

Completion: 

If ${\mathtt{c}}^{\mathcal{K}}$ is not defined, the definition of operations in ${\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$ and the required homomorphism condition for ${\phi }^{*}$ forces for each vertex $ov$ in ${\mathtt{O}}_{\mathtt{c}}$

$$\begin{array}{cc}\hfill {\phi }_V^{*}\left({\mathtt{c}}_{ov}\langle |\rangle \right)& ={\phi }_V^{*}\left({\left({\mathtt{c}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left({\mathbf{0}}_{{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\right)\right)}_V\left(ov\right)\right)={\left({\mathtt{c}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left({\mathbf{0}}_{{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\right);{\phi }^{*}\right)}_V\left(ov\right)\hfill \\ \hfill & ={\left({\mathtt{c}}^{\mathcal{G}}({\mathbf{0}}_{{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)};{\phi }^{*})\right)}_V\left(ov\right)={\left({\mathtt{c}}^{\mathcal{G}}\left({\mathbf{0}}_{\mathtt{G}}\right)\right)}_V\left(ov\right).\hfill \end{array}$$

For each edge $oe$ in ${\mathtt{O}}_{\mathtt{c}}$ we get, analogously, ${\phi }_E^{*}\left({\mathtt{c}}_{oe}\langle \rangle \right)={\left({\mathtt{c}}^{\mathcal{G}}\left({\mathbf{0}}_{\mathtt{G}}\right)\right)}_E\left(oe\right)$.

Operations: 

We have for all $\mathtt{op}$ in $OP$ with ${\mathtt{I}}_{\mathtt{op}}\ne \mathbf{0}$ and any $\mathit{t}\in {\mathtt{T}}_{\mathsf{\Gamma }}{\left(\mathcal{K}\right)}^{{\mathtt{I}}_{\mathtt{op}}}$:

Utilizing$\mathcal{K}$:

If there is a $\mathit{b}\in dom\left({\mathtt{op}}^{\mathcal{K}}\right)\subseteq {\mathtt{K}}^{{\mathtt{I}}_{\mathtt{op}}}$ with $\mathit{t}=\mathit{b};{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}$, the definition of operations in ${\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$, the defining condition and the assumption that φ is a Γ-homomorphism ensure that ${\phi }^{*}$ satisfies the homomorphism condition for $\mathit{t}$:

$$\begin{array}{cc}\hfill {\mathtt{op}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left(\mathit{t}\right);{\phi }^{*}& ={\mathtt{op}}^{\mathcal{K}}\left(\mathit{b}\right);{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)};{\phi }^{*}={\mathtt{op}}^{\mathcal{K}}\left(\mathit{b}\right);\phi ={\mathtt{op}}^{\mathcal{G}}(\mathit{b};\phi )\hfill \\ \hfill & ={\mathtt{op}}^{\mathcal{G}}(\mathit{b};{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)};{\phi }^{*})={\mathtt{op}}^{\mathcal{G}}(\mathit{t};{\phi }^{*})\hfill \end{array}$$

Completion: 

If there is no $\mathit{b}\in dom\left({\mathtt{op}}^{\mathcal{K}}\right)\subseteq {\mathtt{K}}^{{\mathtt{I}}_{\mathtt{op}}}$ with $\mathit{t}=\mathit{b};{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}$, the induction hypothesis is that ${\phi }^{*}$ is already defined on a subgraph $\mathtt{T}⊑{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$ and that $\mathit{t}\left({\mathtt{I}}_{\mathtt{op}}\right)⊑\mathtt{T}$. This ensures $\mathit{t};{\phi }^{*}\in {\mathtt{G}}^{{\mathtt{I}}_{\mathtt{op}}}$. In the induction step we extend ${\phi }^{*}$ to the graph ${\mathtt{T}}^{\prime }⊑{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$. The definition of operations in ${\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$ and the required homomorphism condition for ${\phi }^{*}$ forces for each vertex $ov$ in ${\left({\mathtt{O}}_{\mathtt{op}}\right)}_V\setminus {\left({\mathtt{B}}_{\mathtt{op}}\right)}_V$

$$\begin{array}{cc}\hfill {\phi }_V^{*}\left({\mathtt{op}}_{ov}\langle syn\left(\mathit{t}\right)\rangle \right)& ={\phi }_V^{*}\left({\left({\mathtt{op}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left(\mathit{t}\right)\right)}_V\left(ov\right)\right)={\left({\mathtt{op}}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\left(\mathit{t}\right);{\phi }^{*}\right)}_V\left(ov\right)\hfill \\ \hfill & ={\left({\mathtt{op}}^{\mathcal{G}}(\mathit{t};{\phi }^{*})\right)}_V\left(ov\right).\hfill \end{array}$$

For each edge $oe$ in ${\left({\mathtt{O}}_{\mathtt{op}}\right)}_E\setminus {\left({\mathtt{B}}_{\mathtt{op}}\right)}_E$ we get, analogously, ${\phi }_E^{*}\left({\mathtt{op}}_{oe}\langle syn\left(\mathit{t}\right)\rangle \right)={\left({\mathtt{op}}^{\mathcal{G}}(\mathit{t};{\phi }^{*})\right)}_E\left(oe\right)$.

□

The assignments $\mathcal{K}\mapsto {\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$ and $(\psi :\mathcal{L}\to \mathcal{K})\mapsto ({(\psi ;{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)})}^{*}:{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{L}\right)\to {\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right))$ define, as usual for free constructions, a functor ${\mathbf{TC}}_{\mathsf{\Gamma }}:\mathsf{PAlg}\left(\mathsf{\Gamma }\right)\to \mathsf{Alg}\left(\mathsf{\Gamma }\right)$, and this functor is left-adjoint to the inclusion functor $\mathbf{I}:\mathsf{Alg}\left(\mathsf{\Gamma }\right)\hookrightarrow \mathsf{PAlg}\left(\mathsf{\Gamma }\right)$.

(22)

Due to Corollary 15 we even have $\mathbf{I};{\mathbf{TC}}_{\mathsf{\Gamma }}=i{d}_{\mathsf{Alg}\left(\mathsf{\Gamma }\right)}$, i.e., $\mathsf{Alg}\left(\mathsf{\Gamma }\right)$ is a full reflective subcategory of $\mathsf{PAlg}\left(\mathsf{\Gamma }\right)$. Especially, we have for any $\mathsf{\Gamma }$-homomorphism $\psi :\mathcal{L}\to \mathcal{K}$ in $\mathsf{PAlg}\left(\mathsf{\Gamma }\right)$

$${\mathbf{TC}}_{\mathsf{\Gamma }}\left(\psi \right)={(\psi ;{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)})}^{*}=\psi ;{\iota }_{\mathtt{K},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)}\mathrm{if}\mathcal{L}\mathrm{is}\mathrm{a}\mathrm{total}\mathsf{\Gamma }-\mathrm{algebra}.$$

(23)

4.5. Graph Terms and Graph Term Algebras

Graph term algebras are just the special case of term completion algebras ${\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{K}\right)$ where all the graph operations in $\mathcal{K}$ are completely undefined, i.e., where everything is determined by the carrier only.

Definition 25

(Graph Term Algebras). Let $\mathtt{X}$ be a graph and $\mathcal{X}=(\mathtt{X},O{P}^{\mathcal{X}})$ be the corresponding unique partial Γ-algebra where all graph operations are completely undefined.

Graph terms 

We denote the graph ${\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathcal{X}\right)$, according to Definition 23, also by ${\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathtt{X}\right)$ and call it thegraph of all (graph) $\mathsf{\Gamma }$-terms on $\mathtt{X}$.

Graph term algebra 

We denote the term completion Γ-algebra ${\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathcal{X}\right)$, according to Definition 24, also by ${\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathtt{X}\right)=({\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathtt{X}\right),O{P}^{{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathtt{X}\right)})$ and call it the$\mathsf{\Gamma }$-term graph algebra on $\mathtt{X}$.

Assigning to any graph $\mathtt{X}$ the corresponding unique partial $\mathsf{\Gamma }$-algebra $\mathcal{X}=(\mathtt{X},O{P}^{\mathcal{X}})$ where all graph operations are completely undefined, defines a functor from $\mathsf{Graph}$ to $\mathsf{PAlg}\left(\mathsf{\Gamma }\right)$ that is left-adjoint to the forgetful functor ${\mathbf{U}}_{\mathsf{\Gamma }}^P:\mathsf{PAlg}\left(\mathsf{\Gamma }\right)\to \mathsf{Graph}$ in Proposition 9. Combining this adjunction with the adjunction in (22) gives us the desired universal property of graph term algebras at hand.

Proposition 11

(Graph Term Algebra as Free Construction). Given a graph $\mathtt{X}$ the Γ-term graph algebra ${\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathtt{X}\right)$ has the following universal property: For any total Γ-algebra $\mathcal{G}=(\mathtt{G},O{P}^{\mathcal{G}})$ and any graph homomorphism $\phi :\mathtt{X}\to \mathtt{G}$ there exists a unique Γ-homomorphism ${\phi }^{*}:{\mathcal{T}}_{\mathsf{\Gamma }}\left(\mathtt{X}\right)\to \mathcal{G}$ such that the defining condition ${\iota }_{\mathtt{X},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathtt{X}\right)};{\phi }^{*}=\phi$ is satisfied.

It might be worth to mention that Proposition 11 enables us to also transfer Lemma 3 and Lemma 4 in Section 3.5 straightforwardly to the graph algebra setting.

The definition of graph term algebras and their characterization as a free construction is the main result in [1]. We claimed: “The Kleisli category of the new adjunction provides an appropriate substitution calculus.” However, time passed and we realized that this claim is only true with some reservations.

Substition Calculus: 

Graph term algebras manifest the “internalization approach” in the case of graph algebras. Relying on Proposition 11, we can indeed obtain a fully fledge substitution calculus, meeting the requirements formulated in Section 3.4.1. Based on the idea that a substitution (declaration) is now given by a graph homomorphism $\sigma :\mathtt{X}\to {\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathtt{Y}\right)$ and that a variable assignment is a graph homomorphism $\alpha :\mathtt{X}\to \mathtt{G}$ for a $\mathsf{\Gamma }$-algebra $\mathcal{G}=(\mathtt{G},O{P}^{\mathcal{G}})$, we can simply transfer all the discussion, definitions and results from Section 3.4.2 to graph algebras. We will spare the reader this copy-paste exercise.

No appropriate concept of Derived Operation: 

In traditional Universal Algebra we do have a one-to-one correspondence between the “internal view” of terms as elements of free algebras and the “external view” of terms as an appropriate representation of derived operations (compare Definition 12 and Definition 14). It took us a while to understand that and why this one-to-one correspondence breaks down if it comes to graph algebras. We discuss and address this problem in the next section.

5. Derived Graph Operations

We now discuss the reasons why graph terms are, in our opinion, not providing a fully adequate and appropriate concept of derived graph operation. First, each graph term, interpreted as an operation in a given graph algebra, will only produce isolated single vertices or single edges (without source and target), respectively. What we do need, however, are graphs as outputs of derived graph operations! This flaw could be repaired by considering not single graph terms but subgraphs of graphs of graph terms.

Lemma 6

(Operations by Subgraphs). For a given graph $\mathtt{X}$, any subgraph $\mathtt{O}⊑{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathtt{X}\right)$ defines a span $\mathtt{X}{l}_{\mathtt{O}}{\mathtt{B}}_{\mathtt{O}}{o}_{\mathtt{O}}\mathtt{O}$ of graph inclusions with ${\mathtt{B}}_{\mathtt{O}}:=\mathtt{X}\cap \mathtt{O}$. Moreover, we obtain for all graphs $\mathtt{G}$ a map ${\delta }_{\mathtt{O}}^{\mathtt{G}}:{\mathtt{G}}^{\mathtt{X}}\to {\mathtt{G}}^{\mathtt{O}}$ defined by${\delta }_{\mathtt{O}}^{\mathtt{G}}\left(\mathit{b}\right):={\iota }_{\mathtt{O},{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathtt{X}\right)};{\mathit{b}}^{*}$ for all $\mathit{b}\in {\mathtt{G}}^{\mathtt{X}}$ and satisfying the commutativity requirement for graph operations in 16.

However, this solution is also not quite satisfactory. Each item in $\mathtt{O}$ is given by a separate term expression and the different term expressions may represent, in general, different “computation schemes”. What we want and need, especially in practical applications, is a single graph operation expression built up from variables and the symbols in $OP$ such that the corresponding derived operation for a $\mathsf{\Gamma }$-algebra produces, in parallel, for any input all (!) output items simultaneously by the same computation. Moreover, we would like to be able to define the semantics of those graph operation expressions, i.e., the corresponding derived graph operations in $\mathsf{\Gamma }$-algebras, independent of graph term algebras and in a comparably easy, well-structured inductive way as we did it for terms in Definition 14.

Unfortunately, traditional terms are not providing a fully appropriate blueprint to define such graph operation expressions. In Definition 8 terms are constructed by the following steps: The two basic steps Variables and Constants, and the induction step Operations which is implicitly split into two steps - (1) Tupling and (2) Symbolic Sequential Composition of a tuple with an operation symbol. This splitting becomes apparent in Definition 14 (Construction of Derived Operations).

In the case of graph operations the step Variables turns into a step (Built-in) Projections. Besides this, there is nothing wrong with any of the steps except the step Tupling.

Example 8

(Composition of four Edges). To illustrate the problems with tupling we consider the composition of four edges. We are interested in a “graph operation expression” built up of three copies of the operation symbol $\mathtt{comp}$, as defined in Example 1. The input arity of the expression should be the graph $iv1$ $\stackrel{{ie}_1}{\to }$ $iv$2 $\stackrel{{ie}_2}{\to }$ $iv$3 $\stackrel{{ie}_3}{\to }$ $iv$4 $\stackrel{{ie}_4}{\to }$ $iv$5 and the output arity should be the graph $iv$1 $\stackrel{oe}{\to }$ $iv$5 with $oe$ representing the composition of the four edges in the input arity.

An obvious idea is that in a first step two parallel applications of $\mathtt{comp}$ produce the graph $iv$1 $\stackrel{{oe}_1}{\to }$ $iv$3 $\stackrel{{oe}_2}{\to }$ $iv$5 with $o{e}_1$ representing the composition of the edges $i{e}_1$, $i{e}_2$ and $o{e}_2$ representing the composition of the edges $i{e}_3$, $i{e}_4$, respectively. In a second final step, the third application of $\mathtt{comp}$ should produce then the edge $iv$1 $\stackrel{oe}{\to }$ $iv$5.

If we describe the first step by a tuple we will not get $iv$1 $\stackrel{{oe}_1}{\to }$ $iv$3 $\stackrel{{oe}_2}{\to }$ $iv$5 as output arity but only a pair $\left(\begin{array}{cc}\hfill i{v}_1\stackrel{{oe}_1}{\to }& i{v}_3\end{array},\begin{array}{cc}\hfill i{v}_3\stackrel{{oe}_2}{\to }& i{v}_5\end{array}\right)$ of separated edges. This pair of edges, however, does not match the input arity of $\mathtt{comp}$ thus the second step can not be performed.

One could argue that we can repair this flaw a posteriori by “gluing” the two separated graphs on the overlapping part, i.e., on the vertex $i{v}_3$ in the example. This construction, however, would be rather complicated and pathological as it would consist of a mixture of colimit and limit constructions. In the next subsections we will propose a more systematic well-behaved mechanism based on a priori “soldering”.

5.1. Reconstruction of syntactic Lawvere Theories

In this section we analyze the construction of syntactic Lawvere theories in more detail to better understand the “nature of tupling” and to find a way to solve the problems with tupling pointed at in Example 8.

In Section 3.7 we defined syntactic Lawvere categories relying on a given concept of term and a corresponding substitution calculus. Moreover, we have seen that syntactic Lawvere categories can be characterized as finite product categories freely generated by a signature. Following this observation, we will now turn the story and reconstruct the concept of term by means of the language of finite products and a corresponding axiomatization of finite products.

5.1.1. Categories with Finite Products

We start with a standard definition of finite products. A category $\mathsf{C}$ has finite products if, and only if, the following ingredients are present:

• $\mathsf{C}$ has an empty product (terminal object) $\mathbf{1}$, i.e., for any object A in $\mathsf{C}$ there is a morphism $\langle \langle \rangle \rangle :A\to \mathbf{1}$ such that

  $$g;\langle \langle \rangle \rangle =\langle \langle \rangle \rangle :B\to \mathbf{1}\mathrm{for}\mathrm{all}\mathrm{morphisms}g:B\to A.$$

  (24)
• For any family $A_1,\dots ,A_n$, $n\ge 1$ of objects there is an object $A_1\times \dots \times A_n$ together with projections ${\pi }_i:A_1\times \dots \times A_n\to A_i$, $1\le i\le n$ such that
• for any object B and any family $f_i:B\to A_i$, $1\le i\le n$ of morphisms there is a morphism $\langle \langle f_1,\dots ,f_n\rangle \rangle :B\to A_1\times \dots \times A_n$ with

  $$\langle \langle f_1,\dots ,f_n\rangle \rangle ;{\pi }_i=f_i\mathrm{for}\mathrm{all}1\le i\le n.$$

  (25)
  Moreover, we have $i{d}_{\mathbf{1}}=\langle \langle \rangle \rangle$ and $i{d}_{A_1\times \dots \times A_n}=\langle \langle {\pi }_1,\dots ,{\pi }_n\rangle \rangle$.
• Finally, for all morphisms $g:C\to B$ the following equation holds

  $$g;\langle \langle f_1,\dots ,f_n\rangle \rangle =\langle \langle g;f_1,\dots ,g;f_n\rangle \rangle .$$

  (26)

5.1.2. Categories based on Finite Product Expressions

To reconstruct syntactic Lawvere categories, we define, in a first step, reflexive graphs with finite product expressions as edges and an associative composition. A finite product expression (or fp-expression for short) is a string of symbols built up of variable symbols, operation symbols, angle bracket symbols $"\langle ","\rangle "$ to denote tupling, the semicolon symbol “$;$” to denote symbolic composition and the auxiliary comma symbol “$,$” to separate substrings.

In a second step, we generate out of fp-expression graphs finite product categories with equivalence classes of fp-expressions as morphisms.

We will only outline the definitions, constructions and results. One possibility to do it completely formal and precise is to reuse, for example, the well-developed theory of specifications of partial algebras with conditional existence equations [17,18] and to construct the finite product categories as “partial quotient term algebras” freely generated by signatures (compare [19]).

First, we define for any signature $\mathsf{\Sigma }=(OP,ar)$ a reflexive graph $\mathtt{FP}\left(\mathsf{\Sigma }\right)$ with an associative composition as follows:

Objects: 

As objects we choose the same canonical finite sets of variables as for $\mathsf{L}\left(\mathsf{\Sigma }\right)$

$$X_0=\varnothing \mathrm{and}{X}_n:=\{x_1^n,x_2^n,\dots ,x_n^n\}\mathrm{for}\mathrm{all}n\in \mathbb{N}\mathrm{with}n\ge 1.$$

Morphisms: 

Morphisms are all finite product expressions defined inductively as follows

Symbolic Projections: 

$⌜x_i^n⌝:X_n\to X_1$ is an fp-expression for all $n\ge 1$, $1\le i\le n$.

Constant and Operation Symbols: 

$⌜op⌝:X_n\to X_1$ with $n\in \mathbb{N}$ is an fp-expression if $\mathtt{op}$ is an n-ary operation symbol in $OP$.

Empty Symbolic Tuples: 

$⌜\langle \rangle ⌝:X_n\to X_0$ is an fp-expression for all $n\in \mathbb{N}$.

Non-empty Symbolic Tuples: 

$⌜\langle e{x}_1,\dots ,e{x}_n\rangle ⌝:X_m\to X_n$ is an fp-expression for all $m\ge 0$, $n\ge 1$ and all families $⌜e{x}_i⌝:X_m\to X_1$, $1\le i\le n$ of fp-expressions.

Symbolic Sequential Composition: 

$⌜e{x}_1⌝;⌜e{x}_2⌝:X_n\to X_m$ is an fp-expression for all $n,k,m\in \mathbb{N}$ and all fp-expressions $⌜e{x}_1⌝:X_n\to X_k$, $⌜e{x}_2⌝:X_k\to X_m$.

Symbolic Identities: 

$⌜\langle x_1^n,\dots ,x_n^n\rangle ⌝:X_n\to X_n$ is the identity on $X_n$ for all $n\ge 1$ and $⌜\langle \rangle ⌝:X_0\to X_0$ is the identity on $X_0$.

Remark 16

(Computation Diagrams). Inspired by logic circuit diagrams, term graphs [20], andstring diagrams [21], we will use informal computation diagrams to visualize the computations represented by fp-expressions. A computation diagram consists of “computation units”, “(data-flow) edges”, and input and output “ports”.

Each n-ary operation symbol is seen as a “computation unit” with n input ports and a single output port. Variable symbols appear, however, in two different roles: As “ports”, i.e., as elements of the objects $X_n$, and as “computation units”, i.e., as identifiers for projections. To distinguish these two roles we simply denote ports by i instead of $x_i^n$. As a “computation unit”, a variable simply copies values from a single input port to an arbitrary finite number of output ports.

Example 9

(Finite Product Expressions). Let Σ be a signature with two binary operation symbols “+” and “*”. Both fp-expressions $⌜+⌝:X_2\to X_1$ and $⌜\langle x_1^2,x_2^2\rangle ;+⌝:X_2\to X_1$ are equivalent, according to the equations (24) – (26), and represent simple “tree-like” computation diagrams as depicted below. The picture below visualizes also the effect of symbolic composition.

The equations (24) – (26) do not enforce that the unary symbolic tuple $⌜\langle \langle x_1^2,x_2^2\rangle ;+\rangle ⌝:X_2\to X_1$ is equivalent to the fp-expression $⌜\langle x_1^2,x_2^2\rangle ;+⌝:X_2\to X_1$ even if both fp-expressions represent “essentially” the same computation and are therefore depicted by the same computation diagram!

The first fp-expressions represent the addition of two numbers. We can, of course, derive expressions, representing the doubling of a number, as the expression $⌜\langle x_1^1,x_1^1\rangle ;+⌝:X_1\to X_1$, for example. The picture below shows how the corresponding dag-like computation diagram is obtained by composing a “copying unit” with a computation unit.

More generally, fp-expressions allow us to represent arbitrary “sharing of sub-computations”. The fp-expression $⌜\langle \langle x_1^2,x_2^2\rangle ;+\rangle ;\langle x_1^1,x_1^1\rangle ;*⌝:X_2\to X_1$, for example, represents the square of the sum of two numbers. The corresponding dag-like computation diagram is depicted below

Relying on the identity and associativity law as well as the axioms of finite products, according to the equations (24) – (26), we generate a family of equivalence relations in $\mathtt{FP}\left(\mathsf{\Sigma }\right)(X_n,X_m)$ for all $n,m\in \mathbb{N}$ that is compatible with symbolic composition and symbolic tupling. We construct the corresponding equivalence classes of fp-expressions and define composition, identity and tupling operations on these equivalence classes in the usual way by representatives. What we obtain, finally, is a finite product category $\mathsf{FP}\left(\mathsf{\Sigma }\right)$ with equivalence classes of symbolic tuples as morphisms.

Adapting the recipe from Definition 14, we can obviously translate every $\mathsf{\Sigma }$-term $t\in T_{\mathsf{\Sigma }}\left(X_n\right)$ into an fp-expression $pe\left(t\right)$.

Definition 26

(Translation of Terms into Finite Product Expressions). For any set $X_n$, $n\in \mathbb{N}$ we define inductively for all Σ-terms $t\in T_{\mathsf{\Sigma }}\left(X_n\right)$ a corresponding finite product expression $pe\left(t\right):X_n\to X_1$ as follows

Variables: 

$pe(⌜x_i^n⌝):=⌜x_i^n⌝$, for all $n\ge 1$, $1\le i\le n$.

Constants: 

$pe(⌜\mathtt{c}\langle \rangle ⌝):=⌜\langle \rangle ;\mathtt{c}⌝$, for all $⌜\mathtt{c}\langle \rangle ⌝\in T_{\mathsf{\Sigma }}\left(X_n\right)$;

Operations: 

$pe(⌜\mathtt{op}\langle t_1,\dots ,t_n\rangle ⌝):=⌜\langle pe\left(t_1\right),\dots ,pe\left(t_n\right)\rangle ;\mathtt{op}⌝$, for all $⌜\mathtt{op}\langle t_1,\dots ,t_n\rangle ⌝\in T_{\mathsf{\Sigma }}\left(X_n\right)$, $n\ge 1$.

We call all the fp-expressions $pe\left(t\right)$, obtained by Definition 26, fp-expressions in normal form. Correspondingly, all the fp-expressions $⌜\langle pe\left(t_1\right),\dots ,pe\left(t_n\right)\rangle ⌝$ are called symbolic tuples in normal form. We use the term “normal form” since they are in normal form w.r.t. a rewrite system consisting of the rewriting rules given by the equations (24) – (26) read from the left to the right [14].

Example 10

(Finite Product Expressions - Normal Forms). From the five fp-expressions in 9 the two expressions $⌜\langle x_1^2,x_2^2\rangle ;+⌝$ and $⌜\langle x_1^1,x_1^1\rangle ;+$ are fp-expressions in normal form while $⌜\langle \langle x_1^2,x_2^2\rangle ;+\rangle ⌝$ is a symbolic tuple in normal form.

None of the rules (24) – (26) can be applied to +! However, applying these rules we can transfer the fp-expression $⌜\langle \langle x_1^2,x_2^2\rangle ;+\rangle ;\langle x_1^1,x_1^1\rangle ;*⌝:X_2\to X_1$, that is the symbolic composition of a symbolic tuple in normal form with an fp-expression in normal form, into normal form:

$$\begin{array}{cccc}\hfill \langle \langle x_1^2,x_2^2\rangle ;+\rangle ;\langle x_1^1,x_1^1\rangle ;*& \Rightarrow & 〈\langle \langle x_1^2,x_2^2\rangle ;+\rangle ;x_1^1,\langle \langle x_1^2,x_2^2\rangle ;+\rangle ;x_1^1〉;*\hfill & \left(\right)\hfill \\ & \Rightarrow & 〈\langle x_1^2,x_2^2\rangle ;+,\langle x_1^2,x_2^2\rangle ;+〉;*\hfill & \left(\right)\hfill \end{array}$$

The picture below shows the result of this transformation into normal form for the relevant sub-expression $\langle \langle x_1^2,x_2^2\rangle ;+\rangle ;\langle x_1^1,x_1^1\rangle$.

The general effect of normalization is that all “value copying” is moved to the beginning while we have to “clone computations units” to get rid of “value copying” happening elsewhere.

The crucial observation is that every equivalence class of symbolic tuples, constituting a morphism in $\mathsf{FP}\left(\mathsf{\Sigma }\right)$, contains exactly one symbolic tuple in normal form! Based on this observation it can be shown that the category $\mathsf{FP}\left(\mathsf{\Sigma }\right)$ is isomorphic to the syntactic Lawvere category $\mathsf{L}\left(\mathsf{\Sigma }\right)$.

5.1.3. Substitutions Revisited

Since every equivalence class of symbolic tuples in $\mathsf{FP}\left(\mathsf{\Sigma }\right)$ contains exactly one symbolic tuple in normal form, we can define a corresponding representation category ${\mathsf{FP}}_{\mathsf{nf}}\left(\mathsf{\Sigma }\right)$ with morphisms all symbolic tuples in normal form.

However, symbolic composition of a symbolic tuple in normal form with an fp-expression in normal formal or a symbolic tuple in normal form does not result, in general, in an fp-expression in normal form or a symbolic tuple in normal form, respectively. We have to normalize this composite fp-expression to define composition in ${\mathsf{FP}}_{\mathsf{nf}}\left(\mathsf{\Sigma }\right)$.

The rules, given by the equations (24) – (26), are not sufficient to transform any fp-expression in its normal form. They are, however, sufficient to compute the normal form of all symbolic compositions of a symbolic tuple in normal form with an fp-expression in normal formal and thus, due to equation (26), of all symbolic compositions of symbolic tuples in normal form! We described an example of a normalization of a symbolic composition of a symbolic tuple in normal form with an fp-expression in normal formal in Example 10.

We do have now a chain of isomorphisms between categories $\mathsf{L}\left(\mathsf{\Sigma }\right)\cong \mathsf{FP}\left(\mathsf{\Sigma }\right)\cong {\mathsf{FP}}_{\mathsf{nf}}\left(\mathsf{\Sigma }\right)$. The morphisms in $\mathsf{L}\left(\mathsf{\Sigma }\right)$ are tuples of terms representing substitution declarations while composition is nothing but substitution application. The tuples of terms in $\mathsf{L}\left(\mathsf{\Sigma }\right)$ are transformed into symbolic tuples in normal form in ${\mathsf{FP}}_{\mathsf{nf}}\left(\mathsf{\Sigma }\right)$ while composition in ${\mathsf{FP}}_{\mathsf{nf}}\left(\mathsf{\Sigma }\right)$ is given by symbolic composition plus normalization. So, in the light of substitution calculi, as discussed in Section 3.4.1, we get the following correspondence of concepts: “substitution declaration” ≅ “symbolic tuple in normal form”. Moreover, Lawvere’s original slogan “composition is substitution” turns into the slogan

substitution application ≅ symbolic composition plus normalization.

This perception may open a path to develop, once in the future, an appropriate substitution calculus for derived graph operations!?

5.2. Analysis of Finite Product Expressions

After we transformed the syntactic Lawvere category $\mathsf{L}\left(\mathsf{\Sigma }\right)$ into the isomorphic categories $\mathsf{FP}\left(\mathsf{\Sigma }\right)$ and ${\mathsf{FP}}_{\mathsf{nf}}\left(\mathsf{\Sigma }\right)$, we can now attack the problems, pointed at in Example 8, by analyzing in more detail finite product expressions.

5.2.1. Finite Products vs. Tensor Products

It is well-known that finite products give us also tensor products at hand [21]. We will use the term parallel composition of morphisms instead of tensor product of morphisms and we will use the bar symbol “|” instead of “⊗” to denote parallel composition of morphisms. The picture below visualizes the parallel composition of the fp-expression $⌜+⌝:X_2\to X_1$ with itself.

The other way around, tensor products together with copying allow us to define finite products [21]. In our present setting copying is represented by symbolic tuples of symbolic projections thus each non-empty symbolic tuple $⌜\langle e{x}_1,\dots ,e{x}_n\rangle ⌝$ can be equivalently described by a symbolic composition $⌜\langle copy\rangle ;\left(e{x}_1^{\prime }\right|\dots \left|e{x}_n^{\prime }\right)⌝$ of a symbolic tuple $⌜\langle copy\rangle ⌝$ of symbolic projections with a parallel composition $⌜\left(e{x}_1^{\prime }\right|\dots \left|e{x}_n^{\prime }\right)⌝$ of expressions. The picture below shows the result of this transformation for the fp-expression $\langle \langle x_1^2,x_2^2\rangle ;+,\langle x_1^2,x_2^2\rangle ;+\rangle$, discussed in Example 10. To exemplify that we do not have always $e{x}_i^{\prime }=e{x}_i$, we show also the result for the variant $\langle \langle x_1^3,x_2^3\rangle ;+,\langle x_2^3,x_3^3\rangle ;+\rangle$.

In conclusion, in case of traditional operations tupling can be equivalently replaced by parallel composition plus copying. There are no problems concerning parallel composition of graph operations thus the problem with tupling can be, finally, encircled to be a problem with copying. We have to replace, eventually, copying by another mechanism that does not cause problems!

5.2.2. Copying vs. Soldering

How can we explain, in terms of computation diagrams, the effect of pre-composing an expression $ex:X_n\to X_m$ with a symbolic tuple $⌜\langle copy\rangle ⌝:X_k\to X_n$ of symbolic projections? We construct out of a computation diagram with n input ports and m output ports a new computation diagram with with k input ports and the same m output ports.

To explain this construction, we have to leave the pure world of expressions and remember that a symbolic tuple $⌜\langle copy\rangle ⌝:X_k\to X_n$ of symbolic projections encodes a map $\mathbf{c}:X_n\to X_k$ between ports (!). If $\mathbf{c}$ is not surjective, the construction adds each element in $X_k\setminus \mathbf{c}\left(X_n\right)$ as a “dummy input port”. In addition, each original input port $x\in X_n$ is soldered with all other input ports $x^{\prime }\in X_n$ with $\mathbf{c}\left(x^{\prime }\right)=\mathbf{c}\left(x\right)$ to a single input port in $X_k$. Relying on our conventions in Section 2 concerning the notation of maps, we will use a new type of expression $\left[\mathbf{c}\right]\left(ex\right)$ to denote the new operation from $X_k$ to $X_m$ defined by the newly constructed computation diagram and call it the instance of $ex$ w.r.t. $\mathbf{c}$. The left picture in Figure 6 visualizes the construction of $[1,2,1,2](+|+)$.

In the case of computation units and non-injective, surjective maps $\mathbf{c}:X_n\to X_k$, we could even interpret the construction of $\left[\mathbf{c}\right]\left(ex\right)$ as the construction of a new computation unit computing, for example, the square of a number (see the right picture in Figure 6).

In case of traditional operations, soldering of input ports has no effect on output ports since the boundaries are empty! In case of graph operations, however, soldering of input ports may cause soldering of items in the boundary and thus, potentially, also of output ports. This is exactly the mechanism, we have been looking for to solve the problems with tupling exemplified in Example 8 as we will demonstrate in the next Section 5.3.

5.3. Three Mechanisms to construct new Graph Operations

Our analysis in the last subsection suggests that we should try to define “derived graph operations” by means of three basic constructions on graph operations - parallel composition, instantiation, and sequential composition, respectively.

5.3.1. Parallel Composition

Given a graph $\mathtt{G}$ and a family ${\omega }_i:{\mathtt{G}}^{{\mathtt{I}}_i}\to {\mathtt{G}}^{{\mathtt{O}}_i}$, $1\le i\le k$, $k\ge 2$ of graph operations with arity spans $a{r}_i=\begin{array}{ccc}\hfill {\mathtt{I}}_i\stackrel{l_i}{\hookleftarrow }& {\mathtt{B}}_i\stackrel{r_i}{\hookrightarrow }& {\mathtt{O}}_i\hfill \end{array}$ we can construct a new graph operation

$$\omega :={\omega }_1+\dots +{\omega }_k:{\mathtt{G}}^{\mathtt{I}}\to {\mathtt{G}}^{\mathtt{O}}\mathrm{with}\mathrm{arity}ar=a{r}_1+\dots +a{r}_k=\begin{array}{cc}\mathtt{I}\stackrel{l}{\hookleftarrow }\mathtt{B}\stackrel{r}{\hookrightarrow }& \mathtt{O}\hfill \end{array},$$

(27)

called the parallel composition of ${\omega }_1,\dots ,{\omega }_k$, where the arity graphs are given by sums of graphs $\mathtt{I}={\mathtt{I}}_1+\dots +{\mathtt{I}}_k$, $\mathtt{B}={\mathtt{B}}_1+\dots +{\mathtt{B}}_k$, $\mathtt{O}={\mathtt{O}}_1+\dots +{\mathtt{O}}_k$ and the inclusion graph homomorphims are sums of graph homomorphisms $l=l_1+\dots +l_k$, $r=r_1+\dots +r_k$.

The sum $\mathtt{I}={\mathtt{I}}_1+\dots +{\mathtt{I}}_k$ comes along with a family ${\kappa }_i^{\mathtt{I}}:{\mathtt{I}}_i\to \mathtt{I}$, $1\le i\le k$ of injections and for any $\mathit{b}\in {\mathtt{G}}^{\mathtt{I}}$ the uniqueness of mediating morphisms entails the equation

$$\mathit{b}=[{\kappa }_1^{\mathtt{I}};\mathit{b},\dots ,{\kappa }_k^{\mathtt{I}};\mathit{b}]:\mathtt{I}\to \mathtt{G}.$$

(28)

Applying the given operations ${\omega }_i:{\mathtt{G}}^{{\mathtt{I}}_i}\to {\mathtt{G}}^{{\mathtt{O}}_i}$, $1\le i\le k$ we obtain a family ${\omega }_i({\kappa }_i^{\mathtt{I}};\mathit{b}):{\mathtt{O}}_i\to \mathtt{G}$ of graph homomorphisms satisfying the commutativity requirement for graph operations in Definition 16:

$$l_i;{\kappa }_i^{\mathtt{I}};\mathit{b}=r_i;{\omega }_i({\kappa }_i^{\mathtt{I}};\mathit{b})\mathrm{for}\mathrm{all}1\le i\le k.$$

(29)

We define the result of applying $\omega ={\omega }_1+\dots +{\omega }_k$ to an input $\mathit{b}\in {\mathtt{G}}^{\mathtt{I}}$ as the unique cotuple of the single results

$$\omega \left(\mathit{b}\right)=({\omega }_1+\dots +{\omega }_k)\left(\mathit{b}\right):=[{\omega }_1({\kappa }_1^{\mathtt{I}};\mathit{b}),\dots ,{\omega }_k({\kappa }_k^{\mathtt{I}};\mathit{b})]:\mathtt{O}\to \mathtt{G}.$$

(30)

The algebraic laws of cotuples and sums ensure that the commutativity requirement for graph operations is satisfied:

$$\begin{array}{cccc}\hfill r;\omega \left(\mathit{b}\right)& =& (r_1+\dots +r_k);[{\omega }_1({\kappa }_1^{\mathtt{I}};\mathit{b}),\dots ,{\omega }_k({\kappa }_k^{\mathtt{I}};\mathit{b})]\hfill & \left(\mathrm{def}.\mathrm{of}r\mathrm{and}\right(30\left)\right)\hfill \\ & =& [r_1;{\omega }_1({\kappa }_1^{\mathtt{I}};\mathit{b}),\dots ,r_k;{\omega }_k({\kappa }_k^{\mathtt{I}};\mathit{b})]\hfill & \\ & =& [l_1;{\kappa }_1^{\mathtt{I}};\mathit{b},\dots ,l_k;{\kappa }_k^{\mathtt{I}};\mathit{b}]\hfill & \left(29\right)\hfill \\ & =& (l_1+\dots +l_k);[{\kappa }_1^{\mathtt{I}};\mathit{b},\dots ,{\kappa }_k^{\mathtt{I}};\mathit{b}]\hfill & \\ & =& l;\mathit{b}\hfill & \left(\mathrm{def}.\mathrm{of}l\mathrm{and}\right(28\left)\right)\hfill \end{array}$$

Remark 17

(Parallel Composition - Index Shifting). In case that all the arity spans $a{r}_i=\begin{array}{ccc}\hfill {\mathtt{I}}_i\stackrel{l_i}{\hookleftarrow }& {\mathtt{B}}_i\stackrel{r_i}{\hookrightarrow }& {\mathtt{O}}_i\hfill \end{array}$ are canonical arity spans, in the sense of Remark 10, we can construct the arity $ar=a{r}_1+\dots +a{r}_k=\begin{array}{ccc}\hfill \mathtt{I}\stackrel{l}{\hookleftarrow }& \mathtt{B}\stackrel{r}{\hookrightarrow }& \mathtt{O}\hfill \end{array}$ also as a canonical arity span.

We construct the sums of sets ${\mathtt{I}}_V={\left({\mathtt{I}}_{\mathtt{1}}\right)}_V+\dots +{\left({\mathtt{I}}_{\mathtt{k}}\right)}_V$ and ${\mathtt{I}}_E={\left({\mathtt{I}}_{\mathtt{1}}\right)}_E+\dots +{\left({\mathtt{I}}_{\mathtt{k}}\right)}_E$, respectively, utilizing the technique of “index shifting” we used in SubSection 3.7.2 to define finite products in Lawvere theories. The sum $\mathtt{B}={\mathtt{B}}_1+\dots +{\mathtt{B}}_k$ of boundary graphs can be chosen to be a corresponding subgraph of $\mathtt{I}={\mathtt{I}}_1+\dots +{\mathtt{I}}_k$. Finally, we can construct a sum $\mathtt{O}={\mathtt{O}}_1+\dots +{\mathtt{O}}_k$ with ${\mathtt{O}}_V={\mathtt{B}}_V\cup ({\mathtt{O}}_V\setminus {\mathtt{B}}_V)$ and ${\mathtt{O}}_E={\mathtt{B}}_E\cup ({\mathtt{O}}_E\setminus {\mathtt{B}}_E)$, respectively, where both sums of sets ${\mathtt{O}}_V\setminus {\mathtt{B}}_V:={\left({\mathtt{O}}_{\mathtt{1}}\right)}_V\setminus {\left({\mathtt{B}}_{\mathtt{1}}\right)}_V+\dots +{\left({\mathtt{O}}_{\mathtt{k}}\right)}_V\setminus {\left({\mathtt{B}}_{\mathtt{k}}\right)}_V$ and ${\mathtt{O}}_E\setminus {\mathtt{B}}_E:={\left({\mathtt{O}}_{\mathtt{1}}\right)}_E\setminus {\left({\mathtt{B}}_{\mathtt{1}}\right)}_E+\dots +{\left({\mathtt{O}}_{\mathtt{k}}\right)}_E\setminus {\left({\mathtt{B}}_{\mathtt{k}}\right)}_E$ are again constructed by means of “index shifting”.

The technique of “index shifting” allows us to define sums of canonical arities in such a way that the formation of these sums becomes associative. This means, especially, that there is no need to work with “nested parallel compositions”.

Example 11

(Parallel Composition). We consider a ${\mathsf{\Gamma }}_{cat}$-algebra $\mathcal{C}=(gr\left(\mathsf{C}\right),O{P}^{\mathcal{C}})$ given by a category $\mathsf{C}$ as described in Example 2. The upper part of Figure 7 is the same as the upper part of Figure 14 and shows the arity $ar\left(comp\right)+ar\left(comp\right)$ of the parallel composition ${\mathtt{comp}}^{\mathcal{C}}+{\mathtt{comp}}^{\mathcal{C}}$ of the composition operation in $\mathcal{C}$ with itself.

Analogously, the upper part of Figure 8 shows the arity of the parallel composition ${\mathtt{comp}}^{\mathcal{C}}+{\pi }_{\mathtt{I}}^{\mathtt{I}}$ of the composition operation in $\mathcal{C}$ with the built-in projection (identity map) ${\pi }_{\mathtt{I}}^{\mathtt{I}}:{\mathtt{G}}^{\mathtt{I}}\to {\mathtt{G}}^{\mathtt{I}}$, as defined in Remark 11, where $\mathtt{I}$ is the canonical input arity graph $iv$1 $\stackrel{{ie}_1}{\to }$ $iv$2. (The notations for “graph operation expressions”, like $\left(\mathtt{comp}\right|\mathtt{comp})$ and $\left(\mathtt{comp}\right|(\mathtt{I},\mathtt{I}))$, will be defined in Section 5.4.)

5.3.2. Instantiation

Given a graph $\mathtt{G}$ and a graph operation $\omega :{\mathtt{G}}^{\mathtt{I}}\to {\mathtt{G}}^{\mathtt{O}}$ with arity $\begin{array}{ccc}\hfill \mathtt{I}\stackrel{l}{\hookleftarrow }& \mathtt{B}\stackrel{r}{\hookrightarrow }& \mathtt{O}\hfill \end{array}$, we can construct for any finite graph ${\mathtt{I}}^{\prime }$ and any graph homomorphism $\phi :\mathtt{I}\to {\mathtt{I}}^{\prime }$ a new graph operation

$$\omega /\phi :=:{\mathtt{G}}^{{\mathtt{I}}^{\prime }}\to {\mathtt{G}}^{{\mathtt{O}}^{\prime }}\mathrm{with}\mathrm{arity}ar/\phi =\begin{array}{ccc}\hfill {\mathtt{I}}^{\prime }\stackrel{l^{\prime }}{\hookleftarrow }& {\mathtt{B}}^{\prime }\stackrel{r^{\prime }}{\hookrightarrow }& {\mathtt{O}}^{\prime }\hfill \end{array},$$

(31)

called the instance of ω w.r.t. φ, where ${\mathtt{B}}^{\prime }:=\phi \left(\mathtt{B}\right)⊑{\mathtt{I}}^{\prime }$ and ${\mathtt{O}}^{\prime }$ is constructed as a pushout of the span $\begin{array}{ccc}\hfill {\mathtt{B}}^{\prime }\stackrel{\phi \mathtt{B}}{\leftarrow }& \mathtt{B}\stackrel{r}{\hookrightarrow }& \mathtt{O}\hfill \end{array}$ with ${\mathtt{B}}^{\prime }⊑{\mathtt{O}}^{\prime }$ such that ${\mathtt{I}}^{\prime }$ and ${\mathtt{O}}^{\prime }\setminus {\mathtt{B}}^{\prime }$ are disjoint as depicted in the picture below. For any input $\mathit{b}\in {\mathtt{G}}^{{\mathtt{I}}^{\prime }}$ we can apply the given graph operation $\omega :{\mathtt{G}}^{\mathtt{I}}\to {\mathtt{G}}^{\mathtt{O}}$ to $\phi ;\mathit{b}\in {\mathtt{G}}^{\mathtt{I}}$ and obtain a result $\omega (\phi ;\mathit{b})\in {\mathtt{G}}^{\mathtt{O}}$ such that $l;\phi ;\mathit{b}=r;\omega (\phi ;\mathit{b})$. Since $l;\phi ={\phi }_{\mathtt{B}};l^{\prime }$ by construction, we obtain ${\phi }_{\mathtt{B}};l^{\prime };\mathit{b}=r;\omega (\phi ;\mathit{b})$ thus the pushout property of the right square entails the existence of a unique $k_{\mathit{b}}:{\mathtt{O}}^{\prime }\to \mathtt{G}$ such that $l^{\prime };\mathit{b}=r^{\prime };k_{\mathit{b}}$ and ${\phi }_{\mathtt{O}};k_{\mathit{b}}=\omega (\phi ;\mathit{b})$.

It is probably worth to mention that it is sufficient to require that ${\phi }_{\mathtt{O}};k_{\mathit{b}}=\omega (\phi ;\mathit{b})$. ${\phi }_{\mathtt{B}}:\mathtt{B}\to {\mathtt{B}}^{\prime }$ is an epimorphism by construction such that ${\phi }_{\mathtt{O}}:\mathtt{O}\to {\mathtt{O}}^{\prime }$ also becomes an epimorphism since pushouts preserve epimorphisms. Therefore, $k_{\mathit{b}}:{\mathtt{O}}^{\prime }\to \mathtt{G}$ is uniquely determined by the requirement ${\phi }_{\mathtt{O}};k_{\mathit{b}}=\omega (\phi ;\mathit{b})$. Moreover, this requirement also implies $l^{\prime };\mathit{b}=r^{\prime };k_{\mathit{b}}$ since ${\phi }_{\mathtt{B}}:\mathtt{B}\to {\mathtt{B}}^{\prime }$ is an epimorphism. In other words: $\omega (\phi ;\mathit{b})$ factors uniquely through ${\phi }_{\mathtt{O}}:\mathtt{O}\to {\mathtt{O}}^{\prime }$ thus the term “instance” is indeed appropriate.

For any input $\mathit{b}\in {\mathtt{G}}^{{\mathtt{I}}^{\prime }}$ we define $(\omega /\phi )\left(\mathit{b}\right):=k_{\mathit{b}}$. This ensures, especially, the required commutativity$l^{\prime };\mathit{b}=r^{\prime };(\omega /\phi )\left(\mathit{b}\right)$.

Remark 18

(Instantiation - Canonical Arities). For a canonical arity span $\begin{array}{ccc}\hfill \mathtt{I}\stackrel{l}{\hookleftarrow }& \mathtt{B}\stackrel{r}{\hookrightarrow }& \mathtt{O}\hfill \end{array}$ and a canonical input arity graph ${\mathtt{I}}^{\prime }$ we do have that ${\mathtt{I}}^{\prime }$ and $\mathtt{O}\setminus \mathtt{B}$ are disjoint. In such a way, we can simply define ${\mathtt{O}}_V^{\prime }={\mathtt{B}}_V^{\prime }\cup ({\mathtt{O}}_V\setminus {\mathtt{B}}_V)$ and ${\mathtt{O}}_E^{\prime }={\mathtt{B}}_E^{\prime }\cup ({\mathtt{O}}_E\setminus {\mathtt{B}}_E)$ such that ${\mathtt{I}}^{\prime }\stackrel{l^{\prime }}{\hookleftarrow }$ $\mathtt{B}$’ $\stackrel{r^{\prime }}{\hookrightarrow }\mathtt{O}$’ becomes a canonical arity span as well.

Example 12

(Instances of the Composition Operation). There are four different instances of the composition operation ${\mathtt{comp}}^{\mathcal{C}}$ in a ${\mathsf{\Gamma }}_{cat}$-algebra $\mathcal{C}=(gr\left(\mathsf{C}\right),O{P}^{\mathcal{C}})$ as described in Example 2.

The lower part of Figure 9 visualizes the arity $ar\left(comp\right)/\beta$ of the instance ${\mathtt{comp}}^{\mathcal{C}}/\beta$ of ${\mathtt{comp}}^{\mathcal{C}}$ giving us the composition of two loops at hand. The arity $ar\left(comp\right)/\gamma$ of the most specialized instance ${\mathtt{comp}}^{\mathcal{C}}/\gamma$ of ${\mathtt{comp}}^{\mathcal{C}}$, namely the composition of a loop with itself, is shown in the lower part of Figure 10.

Example 13

(Tupling versus Soldering). The lower part of Figure 7 visualizes the arity of the instance $({\mathtt{comp}}^{\mathcal{C}}+{\mathtt{comp}}^{\mathcal{C}})/\phi$ of the parallel composition ${\mathtt{comp}}^{\mathcal{C}}+{\mathtt{comp}}^{\mathcal{C}}$ in Example 11. It shows that instantiation provides indeed the “soldering effect” we need to solve the problems with “tupling” as exemplified in 8! The output arity of the graph operation $({\mathtt{comp}}^{\mathcal{C}}+{\mathtt{comp}}^{\mathcal{C}})/\phi$ consists of two successive arrows thus we can indeed compose it with ${\mathtt{comp}}^{\mathcal{C}}$ (see Example 14).

Analogously, the lower part of Figure 8 visualizes the arity of the instance $({\mathtt{comp}}^{\mathcal{C}}+{\pi }_{\mathtt{I}}^{\mathtt{I}})/\psi$ of the parallel composition ${\mathtt{comp}}^{\mathcal{C}}+{\pi }_{\mathtt{I}}^{\mathtt{I}}$ in Example 11. This example shows that we need also “soldering” to describe the composition of three arrows by means of “derived graph operations”.

Remark 19

(Transfer of Items). Note, that φ is not required to be surjective! The items in ${\mathtt{I}}^{\prime }\setminus \phi \left(\mathtt{I}\right)$ have no influence on the output produced by $\omega /\phi$ and are ignored. Specifically, they do not appear in ${\mathtt{B}}^{\prime }=\phi \left(\mathtt{B}\right)$ and thus not in ${\mathtt{O}}^{\prime }$ either.

Any transfer of items from the input to the output has to be done explicitly! If we need to transfer, in addition, also items from ${\mathtt{I}}^{\prime }\setminus \phi \left(\mathtt{B}\right)$ to the output, we have to construct first a parallel composition of ω with appropriate built-in projections before we define a corresponding extended ${\phi }^{\prime }$ that also comprises the items in ${\mathtt{I}}^{\prime }\setminus \phi \left(\mathtt{B}\right)$ we wish to transfer. An example for such a “need of transfer” is the successive composition of three arrows (compare Figure 8).

Corollary 16

(Instantiation). Let be given a graph $\mathtt{G}$ and a graph operation $\omega :{\mathtt{G}}^{\mathtt{I}}\to {\mathtt{G}}^{\mathtt{O}}$ with a canonical arity span $\begin{array}{ccc}\hfill \mathtt{I}\stackrel{l}{\hookleftarrow }& \mathtt{B}\stackrel{r}{\hookrightarrow }& \mathtt{O}\hfill \end{array}$. For any canonical input arity graphs ${\mathtt{I}}^{\prime }$, ${\mathtt{I}}^{\prime \prime }$ and any graph homomorphisms $\phi :\mathtt{I}\to {\mathtt{I}}^{\prime }$, $\psi :{\mathtt{I}}^{\prime }\to {\mathtt{I}}^{\prime \prime }$ we have

$$(\omega /\phi )/\psi =\omega /(\phi ;\psi ).$$

Proof. 

Follows immediately from the fact $(\phi ;\psi )\left(\mathtt{I}\right)=\psi \left(\phi \right(\mathtt{I}\left)\right)$ and the fact that the composition of two pushouts is a pushout again. The choice of canonical arities insures, especially, ${\mathtt{O}}_V\setminus {\mathtt{B}}_V={\mathtt{O}}_V^{\prime }\setminus {\mathtt{B}}_V^{\prime }={\mathtt{O}}_V^{\prime \prime }\setminus {\mathtt{B}}_V^{\prime \prime }$ and ${\mathtt{O}}_E\setminus {\mathtt{B}}_E={\mathtt{O}}_E^{\prime }\setminus {\mathtt{B}}_E^{\prime }={\mathtt{O}}_E^{\prime \prime }\setminus {\mathtt{B}}_E^{\prime \prime }$ by construction. □

Conjecture 1

(Parallel Composition and Instantiation). It should not be a problem to prove a more general result about the interplay of parallel composition and instantiation.

Let be given a graph $\mathtt{G}$ and a family ${\omega }_i:{\mathtt{G}}^{{\mathtt{I}}_i}\to {\mathtt{G}}^{{\mathtt{O}}_i}$, $1\le i\le k$, $k\ge 2$ of graph operations with canonical arity spans $\begin{array}{ccc}\hfill {\mathtt{I}}_i\stackrel{l_i}{\hookleftarrow }& {\mathtt{B}}_i\stackrel{r_i}{\hookrightarrow }& {\mathtt{O}}_i\hfill \end{array}$ together with a family ${\phi }_i:{\mathtt{I}}_i\to {\mathtt{I}}_i^{\prime }$, $1\le i\le k$ of homomorphisms where all the ${\mathtt{I}}_i^{\prime }$ are canonical input arity graphs. For any graph homomorphism $\phi :{\mathtt{I}}_1^{\prime }+\dots +{\mathtt{I}}_k^{\prime }\to {\mathtt{I}}^{\prime \prime }$ with ${\mathtt{I}}^{\prime \prime }$ a canonical input arity graph we have

$$({\omega }_1/{\phi }_1+\dots +{\omega }_k/{\phi }_k)/\phi =({\omega }_1+\dots +{\omega }_k)/({\phi }_1+\dots +{\phi }_k);\phi .$$

5.3.3. Sequential Composition

At first glance, it should not be a problem to sequentially compose two graph operations ${\omega }_1:{\mathtt{G}}^{{\mathtt{I}}_1}\to {\mathtt{G}}^{{\mathtt{O}}_1}$ with arity $a{r}_1=\begin{array}{ccc}\hfill {\mathtt{I}}_1\stackrel{l_1}{\hookleftarrow }& {\mathtt{B}}_1\stackrel{r_1}{\hookrightarrow }& {\mathtt{O}}_1\hfill \end{array}$ and ${\omega }_2:{\mathtt{G}}^{{\mathtt{I}}_2}\to {\mathtt{G}}^{{\mathtt{O}}_1}$ with arity $a{r}_2=\begin{array}{ccc}\hfill {\mathtt{I}}_2\stackrel{l_2}{\hookleftarrow }& {\mathtt{B}}_2\stackrel{r_2}{\hookrightarrow }& {\mathtt{O}}_2\hfill \end{array}$. We simply require ${\mathtt{O}}_1={\mathtt{I}}_2$ and define, as usual, composition by successive application: $({\omega }_1;{\omega }_2)\left(\mathit{b}\right):={\omega }_2\left({\omega }_1\left(\mathit{b}\right)\right)$ for all $\mathit{b}\in {\mathtt{G}}_{{\mathtt{I}}_1}$ while the arity of the sequential composition is given by a standard pullback based composition of spans (see the picture below).

There are, however, at least two problems with this obvious proposal:

• For canonical arity spans $a{r}_1$ and $a{r}_2$, we can have an equality ${\mathtt{O}}_1={\mathtt{I}}_2$ only if ${\omega }_1$ is a built-in projection.
• There are two kinds of output items produced by the sequential composition of two graph operations. First, the output items produced by ${\omega }_2$. Second, the output items produced by ${\omega }_1$ and implicitly transferred by ${\omega }_2$, i.e., the items in ${\mathtt{B}}_2\setminus ({\mathtt{B}}_1\cap {\mathtt{B}}_2)={\mathtt{B}}_2\setminus {\mathtt{B}}_1$. In other words, the resulting arity will not satisfy the disjointness condition in 15 if ${\mathtt{B}}_2\setminus {\mathtt{B}}_1$ is non-empty!

Since we intend to later define graph operation expressions with canonical arity spans only, we consider canonical arity spans $a{r}_1$ and $a{r}_2$. To solve the first problem, we introduce sequential composition via arity renaming, i.e., instead of ${\mathtt{O}}_1={\mathtt{I}}_2$ we assume a graph isomorphism $\varrho :{\mathtt{I}}_2\to {\mathtt{O}}_1$ and define a graph operation ${\omega }_1{;}^{\varrho }{\omega }_2:{\mathtt{G}}^{{\mathtt{I}}_1}\to {\mathtt{G}}^{{\mathtt{O}}_2^{\varrho }}$ with arity $ar=\begin{array}{ccc}\hfill {\mathtt{I}}_1\stackrel{l}{\hookleftarrow }& \mathtt{B}\stackrel{r}{\hookrightarrow }& {\mathtt{O}}_2^{\varrho }\hfill \end{array}$ where ${\mathtt{O}}_2^{\varrho }$ is isomorphic to ${\mathtt{O}}_2$ and constructed by means of $\varrho$ in such a way that $ar$ becomes a canonical arity span. This also solves the second problem.

We now describe the rather involved step-wise construction of the canonical arity of the graph operation ${\omega }_1{;}^{\varrho }{\omega }_2:{\mathtt{G}}^{{\mathtt{I}}_1}\to {\mathtt{G}}^{{\mathtt{O}}_2^{\varrho }}$ obtained by sequential composition of two given graph operations ${\omega }_1:{\mathtt{G}}^{{\mathtt{I}}_1}\to {\mathtt{G}}^{{\mathtt{O}}_1}$ and ${\omega }_2:{\mathtt{G}}^{{\mathtt{I}}_2}\to {\mathtt{G}}^{{\mathtt{O}}_1}$ via a graph isomorphism $\varrho :{\mathtt{I}}_2\to {\mathtt{O}}_1$. The reader can follow the construction in Figure 11.

• We obtain an epi-mono factorization of $l_2;\varrho :{\mathtt{B}}_2\to {\mathtt{I}}_2$ by constructing the image of ${\mathtt{B}}_2$ w.r.t. $\varrho :{\mathtt{I}}_2\to {\mathtt{O}}_1$. The resulting restriction ${\varrho }_{\mathtt{B}}:{\mathtt{B}}_2\to \varrho \left({\mathtt{B}}_2\right)$ of $\varrho$ becomes an isomorphism since $\varrho$ is an isomorphism.
• The boundary arity of ${\omega }_1{;}^{\varrho }{\omega }_2$ can now be constructed by simple intersection (pullback): $\mathtt{B}:={\mathtt{B}}_1\cap \varrho \left({\mathtt{B}}_2\right)$ and $l:=l_2^{\varrho };l_1$.
• To be able to define ${\mathtt{O}}_2^{\varrho }$ as an extension of $\mathtt{B}$ such that ${\mathtt{O}}_2^{\varrho }\setminus \mathtt{B}$ consists of canonical sets of output vertices and output edges, according to Remark 10, we first have to reindex the output vertices/edges in $\varrho \left({\mathtt{B}}_2\right)\setminus \mathtt{B}=\varrho \left({\mathtt{B}}_2\right)\setminus {\mathtt{B}}_1\subseteq {\mathtt{O}}_1\setminus {\mathtt{B}}_1$. We construct a graph ${\mathtt{B}}_2^{\varrho }$, isomorphic to $\varrho \left({\mathtt{B}}_2\right)$ with ${\left({\mathtt{B}}_2^{\varrho }\right)}_V={\mathtt{B}}_V\cup {\mathtt{P}}_V$ and ${\left({\mathtt{B}}_2^{\varrho }\right)}_E={\mathtt{B}}_E\cup {\mathtt{P}}_E$ where ${\mathtt{P}}_V=\{o{v}_1,\dots ,o{v}_{n^{\mathtt{P}}}\}$ and ${\mathtt{P}}_E=\{o{e}_1,\dots ,o{e}_{m^{\mathtt{P}}}\}$ for $n^{\mathtt{P}}=|{\left(\varrho \left({\mathtt{B}}_2\right)\right)}_V\setminus {\mathtt{B}}_V|$ and $m^{\mathtt{P}}=|{\left(\varrho \left({\mathtt{B}}_2\right)\right)}_E\setminus {\mathtt{B}}_E|$.
• We can define an isomorphism $\iota :\varrho \left({\mathtt{B}}_2\right)\to {\mathtt{B}}_2^{\varrho }$ that is the identity on $\mathtt{B}$ and, in addition, ${\iota }_V$ restricted to ${\left(\varrho \left({\mathtt{B}}_2\right)\right)}_V\setminus {\mathtt{B}}_V$ is an order-preserving map from ${\left(\varrho \left({\mathtt{B}}_2\right)\right)}_V\setminus {\mathtt{B}}_V$ to ${\mathtt{P}}_V$ while ${\iota }_E$ restricted to ${\left(\varrho \left({\mathtt{B}}_2\right)\right)}_E\setminus {\mathtt{B}}_E$ is an order-preserving map from ${\left(\varrho \left({\mathtt{B}}_2\right)\right)}_E\setminus {\mathtt{B}}_E$ to ${\mathtt{P}}_E$. The construction ensures that $r_1^{*};\iota$ becomes an inclusion graph homomorphism $r_1^{*};\iota :\mathtt{B}\to {\mathtt{B}}_2^{\varrho }$.
• We construct ${\mathtt{O}}_2^{\varrho }$ by a pushout of the span with ${\left({\mathtt{O}}_2^{\varrho }\right)}_V:={\mathtt{B}}_V\cup \left({\mathtt{P}}_V+{\left({\mathtt{O}}_2\right)}_V\setminus {\left({\mathtt{B}}_2\right)}_V\right)$ where $\left({\mathtt{P}}_V+{\left({\mathtt{O}}_2\right)}_V\setminus {\left({\mathtt{B}}_2\right)}_V\right)$ is constructed by “index shifting” and ${\left({\mathtt{O}}_2^{\varrho }\right)}_E:={\mathtt{B}}_E\cup \left({\mathtt{P}}_E+{\left({\mathtt{O}}_2\right)}_E\setminus {\left({\mathtt{B}}_2\right)}_E\right)$ where $\left({\mathtt{P}}_E+{\left({\mathtt{O}}_2\right)}_E\setminus {\left({\mathtt{B}}_2\right)}_E\right)$ is also constructed by “index shifting”.
• The construction ensures ${\mathtt{B}}_2^{\varrho }⊑{\mathtt{O}}_2^{\varrho }$ and that ${\varrho }_{\mathtt{O}}:{\mathtt{O}}_2\to {\mathtt{O}}_2^{\varrho }$ becomes an isomorphism. We set $r:=r_1^{*};\iota ;r_2^{\varrho }$ and obtain a canonical arity span $\begin{array}{ccc}\hfill {\mathtt{I}}_1\stackrel{l}{\hookleftarrow }& \mathtt{B}\stackrel{r}{\hookrightarrow }& {\mathtt{O}}_2^{\varrho }\hfill \end{array}$ as required.

After the arity of the graph operation ${\omega }_1{;}^{\varrho }{\omega }_2:{\mathtt{G}}^{{\mathtt{I}}_1}\to {\mathtt{G}}^{{\mathtt{O}}_2^{\varrho }}$ has been constructed, we can straightforwardly define ${\omega }_1{;}^{\varrho }{\omega }_2:{\mathtt{G}}^{{\mathtt{I}}_1}\to {\mathtt{G}}^{{\mathtt{O}}_2^{\varrho }}$ by successive application of the given graph operations plus two intermediate arity-based isomorphic transformations:

$$\left({\omega }_1{;}^{\varrho }{\omega }_2\right)\left(\mathit{b}\right):={\varrho }_{\mathtt{O}}^{-1};{\omega }_2(\varrho ;{\omega }_1\left(\mathit{b}\right)):{\mathtt{O}}_2^{\varrho }\to \mathtt{G}\mathrm{for}\mathrm{all}\mathit{b}\in {\mathtt{G}}^{{\mathtt{I}}_1}.$$

(32)

The commutativity condition in Definition 16 is trivially satisfied since the diagram in Figure 11 is commutative by construction and definition.

Example 14

(Composition of four and three Arrows). The output arity of the graph operation $({\mathtt{comp}}^{\mathcal{C}}+{\mathtt{comp}}^{\mathcal{C}})/\phi$ in Example 13 is the graph ${\mathtt{O}}_1:=\begin{array}{ccc}\hfill i{v}_1\stackrel{o{e}_1}{\to }& i{v}_3\stackrel{o{e}_2}{\to }& i{v}_5\hfill \end{array}$ (see Figure 7) while the input arity of the graph operation ${\mathtt{comp}}^{\mathcal{C}}$ is the graph ${\mathtt{I}}_2:=\begin{array}{ccc}\hfill i{v}_1\stackrel{o{e}_1}{\to }& i{v}_2\stackrel{o{e}_2}{\to }& i{v}_3\hfill \end{array}$. In such a way, both graph operations can be composed via the arity renaming $\varrho :{\mathtt{I}}_2\to {\mathtt{O}}_1$ defined by the assignments $\{i{v}_1\mapsto i{v}_1,i{v}_2\mapsto i{v}_3,i{v}_3\mapsto i{v}_5,o{e}_1\mapsto o{e}_1,o{e}_2\mapsto o{e}_2\}$. The resulting graph operation $(({\mathtt{comp}}^{\mathcal{C}}+{\mathtt{comp}}^{\mathcal{C}})/\phi ){;}^{\varrho }{\mathtt{comp}}^{\mathcal{C}}$ with the canonical arity span shown in Figure 12 describes then the way of composing four successive arrows we discussed in Example 8.

Analogously, the output arity of the graph operation $({\mathtt{comp}}^{\mathcal{C}}+{\pi }_{\mathtt{I}}^{\mathtt{I}})/\psi$ in Example 13 is the graph ${\mathtt{O}}_1:=\begin{array}{ccc}\hfill i{v}_1\stackrel{o{e}_1}{\to }& i{v}_3\stackrel{i{e}_3}{\to }& i{v}_4\hfill \end{array}$ (see Figure 8) while the input arity of the graph operation ${\mathtt{comp}}^{\mathcal{C}}$ is the graph ${\mathtt{I}}_2:=\begin{array}{ccc}\hfill i{v}_1\stackrel{o{e}_1}{\to }& i{v}_2\stackrel{o{e}_2}{\to }& i{v}_3\hfill \end{array}$. In such a way, both graph operations can be composed via the arity renaming $\rho :{\mathtt{I}}_2\to {\mathtt{O}}_1$ defined by the assignments $\{i{v}_1\mapsto i{v}_1,i{v}_2\mapsto i{v}_3,i{v}_3\mapsto i{v}_4,o{e}_1\mapsto o{e}_1,o{e}_2\mapsto i{e}_3\}$. The resulting graph operation $((({\mathtt{comp}}^{\mathcal{C}}+{\pi }_{\mathtt{I}}^{\mathtt{I}})/\psi ){;}^{\rho }{\mathtt{comp}}^{\mathcal{C}}$ with the canonical arity span shown in Figure 13 describes then the way of composing three successive arrows in a ${\mathsf{\Gamma }}_{cat}$-algebra $\mathcal{C}=(gr\left(\mathsf{C}\right),O{P}^{\mathcal{C}})$ that corresponds to the left-hand side of the associativity law for the composition of morphisms in categories

$$(f;g);h=f;(g;h)\mathrm{for}\mathrm{all}A\stackrel{f}{\to }B\stackrel{g}{\to }C\stackrel{h}{\to }D\mathrm{in}\mathsf{C}.$$

(33)

With the obvious changes we can also construct a graph operation $((({\pi }_{\mathtt{I}}^{\mathtt{I}}+{\mathtt{comp}}^{\mathcal{C}})/{\psi }^{\prime }){;}^{{\rho }^{\prime }}{\mathtt{comp}}^{\mathcal{C}}$ with the same canonical arity span but representing the right-hand side of the associativity law.

Conjecture 2

(Associativity of Sequential Composition). We consider three graph operations with two arity renamings as depicted below

What kind of associativity we can gain? Constructing, first, the composition ${\omega }_2{;}^{\epsilon }{\omega }_3$ we transfer the diagram of arities above into the diagram

This means, that we can sequentially compose ${\omega }_1$ and ${\omega }_2{;}^{\epsilon }{\omega }_3$ via $\varrho :{\mathtt{I}}_2\to {\mathtt{O}}_1$. We obtain a graph operation ${\omega }_1{;}^{\varrho }\left({\omega }_2{;}^{\epsilon }{\omega }_3\right)$ with input arity ${\mathtt{I}}_1$ and output arity ${\left({\mathtt{O}}_3^{\epsilon }\right)}^{\varrho }$.

In contrast, we can not compose ${\omega }_1{;}^{\varrho }{\omega }_2$ and ${\omega }_3$ via $\epsilon :{\mathtt{I}}_3\to {\mathtt{O}}_2$ since the output arity of ${\omega }_1{;}^{\varrho }{\omega }_2$ is ${\mathtt{O}}_2^{\varrho }$ and not ${\mathtt{O}}_2$ as required. Fortunately, we can bridge the gap using ${\varrho }_{\mathtt{O}}^{-1}:{\mathtt{O}}_2\to {\mathtt{O}}_2^{\varrho }$ (see Figure 11 and the diagram below) and construct the sequential composition $\left({\omega }_1{;}^{\varrho }{\omega }_2\right){;}^{\epsilon ;{\varrho }_{\mathtt{O}}^{-1}}{\omega }_3$ with input arity ${\mathtt{I}}_1$ and output arity ${\mathtt{O}}_3^{\epsilon ;{\varrho }_{\mathtt{O}}^{-1}}$.

We are convinced that one can prove ${\left({\mathtt{O}}_3^{\epsilon }\right)}^{\varrho }={\mathtt{O}}_3^{\epsilon ;{\varrho }_{\mathtt{O}}^{-1}}$ and an associativity law like ${\omega }_1{;}^{\varrho }\left({\omega }_2{;}^{\epsilon }{\omega }_3\right)=\left({\omega }_1{;}^{\varrho }{\omega }_2\right){;}^{\epsilon ;{\varrho }_{\mathtt{O}}^{-1}}{\omega }_3$, but leave this as a topic for future research.

Remark 20

(Constructions and Built-in Projections). For any graph $\mathtt{G}$ the collection of all built-in projections ${\pi }_{\mathtt{K}}^{\mathtt{H}}:{\mathtt{G}}^{\mathtt{H}}\to {\mathtt{G}}^{\mathtt{K}}$, as described in Remark 11, is closed w.r.t. any of the three constructions – parallel composition, instantiation, or sequential composition, respectively. That is, applying any of these constructions only to built-in projections will result in a built-in projection.

We made some effort to define the arity spans of resulting graph operations in such a way that the result of applying any of the three constructions to graph operations with canonical arity spans, has a canonical arity span as well.

In such a way, the sub-collection of all built-in projections ${\pi }_{\mathtt{O}}^{\mathtt{I}}:{\mathtt{G}}^{\mathtt{I}}\to {\mathtt{G}}^{\mathtt{O}}$ with $\mathtt{I}$ a finite canonical input arity becomes also closed w.r.t. any of the three constructions. This fact may cause some redundancy when defining “graph operation expressions” and corresponding “derived graph operations”. We will, however, try to avoid unnecessary redundancy.

5.4. Graph Operation Expressions and Derived Graph Operations

Now, we finally have everything at hand to define graph operation expressions and their semantics, i.e., the derived graph operations we have been looking for. We define graph operation expressions with canonical arities and with a structure as close as possible to the structure of terms. Instead of “terms” we have “single expressions” while “multi expressions” correspond to “tuples of terms”.

Definition 27

(Graph Operation Expressions). For any graph signature $\mathsf{\Gamma }=(OP,ar)$ we define inductively the set $GE\left(\mathsf{\Gamma }\right)$ of all(graph operation) $\mathsf{\Gamma }$-expressions with canonical arity spans.

Projections: 

$⌜(\mathtt{I},\mathtt{O})⌝\in GE\left(\mathsf{\Gamma }\right)$ with arity span $ar\left(⌜(\mathtt{I},\mathtt{O})⌝\right)=\begin{array}{ccc}\hfill \mathtt{I}\stackrel{l}{\hookleftarrow }& \mathtt{O}& \mathtt{O}\stackrel{r}{\hookrightarrow }\mathtt{O}\hfill \end{array}$ for any finite canonical input arity graph $\mathtt{I}$ and any subgraph $\mathtt{O}⊑\mathtt{I}$.

$(\mathtt{I},\mathtt{O})$ is called aprojection expression.

Constants: 

$⌜\left[\right]\mathtt{c}⌝\in GE\left(\mathsf{\Gamma }\right)$ with arity $ar(⌜\left[\right]\mathtt{c}⌝)=\begin{array}{ccc}\hfill \mathtt{I}\stackrel{l}{\hookleftarrow }& \mathbf{0}\stackrel{r}{\hookrightarrow }& {\mathtt{O}}_{\mathtt{c}}\hfill \end{array}$ for any constant symbol $\mathtt{c}\in OP$ and any finite canonical input arity graph $\mathtt{I}$.

Moreover, $⌜\left(\right[]\mathtt{c}\downarrow \mathtt{O})⌝\in GE\left(\mathsf{\Gamma }\right)$ with arity $ar(⌜(\left[\right]\mathtt{c}\downarrow \mathtt{O})⌝)=\begin{array}{ccc}\hfill \mathtt{I}\stackrel{l}{\hookleftarrow }& \mathbf{0}\stackrel{r}{\hookrightarrow }& \mathtt{O}\hfill \end{array}$ for any non-empty subgraph $\mathtt{O}⊑{\mathtt{O}}_{\mathtt{c}}$.

Both expressions $⌜\left[\right]\mathtt{c}⌝$ and $⌜\left(\right[]\mathtt{c}\downarrow \mathtt{O})⌝$ are declared assingle $\mathsf{\Gamma }$-expressions.

Operations: 

$⌜\left[syn\right(\phi \left)\right]\mathtt{op}⌝\in GE\left(\mathsf{\Gamma }\right)$ for any operation symbol $\mathtt{op}\in OP$, any finite canonical input arity graph ${\mathtt{I}}^{\prime }$, and any graph homomorphism $\phi :{\mathtt{I}}_{\mathtt{op}}\to {\mathtt{I}}^{\prime }$ where the arity$ar(⌜\left[syn\left(\phi \right)\right]\mathtt{op}⌝)=\begin{array}{ccc}\hfill \mathtt{I}\prime \stackrel{l^{\prime }}{\hookleftarrow }& {\mathtt{B}}^{\prime }\stackrel{r^{\prime }}{\hookrightarrow }& {\mathtt{O}}^{\prime }\hfill \end{array}$ is constructed as an instance of the arity $ar\left(\mathtt{op}\right)={\mathtt{I}}_{\mathtt{op}}\stackrel{l_{\mathrm{op}}}{\hookleftarrow }{\mathtt{B}}_{\mathtt{op}}\stackrel{r_{\mathrm{op}}}{\hookrightarrow }{\mathtt{O}}_{\mathtt{op}}$ by means of ${\mathtt{B}}^{\prime }:=\phi \left({\mathtt{B}}_{\mathtt{op}}\right)$ and a pushout as done in (31).

Moreover, $⌜\left(\right[syn\left(\phi \right)]\mathtt{op}\downarrow \mathtt{O})⌝\in GE\left(\mathsf{\Gamma }\right)$ for any non-empty subgraph $\mathtt{O}⊑{\mathtt{O}}^{\prime }$ such that $\mathtt{O}\setminus {\mathtt{B}}^{\prime }$ non-empty with arity $ar\left(⌜(\left[syn\left(\phi \right)\right]\mathtt{op}\downarrow \mathtt{O})⌝\right)=\begin{array}{ccc}\hfill {\mathtt{I}}^{\prime }\stackrel{l_0^{\prime }}{\hookleftarrow }& {\mathtt{B}}^{\prime }\cap \mathtt{O}\stackrel{r_0^{\prime }}{\hookrightarrow }& \mathtt{O}\hfill \end{array}$.

Both expressions $⌜\left[syn\right(\phi \left)\right]\mathtt{op}⌝$ and $⌜\left(\right[syn\left(\phi \right)]\mathtt{op}\downarrow \mathtt{O})⌝$ are calledbasic $\mathsf{\Gamma }$-expressions and are declared as single $\mathsf{\Gamma }$-expressions.

Multi expressions: 

$⌜\left(g{e}_1\right|\dots \left|g{e}_k\right)⌝\in GE\left(\mathsf{\Gamma }\right)$ for any family $g{e}_i$, $1\le i\le k$, $k\ge 2$ of single Γ-expressions or projection expressions with, at least, one single Γ-expression. The arity $ar(⌜(g{e}_1|\dots |g{e}_k)⌝):=ar\left(g{e}_1\right)+\dots +ar\left(g{e}_k\right)=\begin{array}{ccc}\hfill \mathtt{I}\stackrel{l}{\hookleftarrow }& \mathtt{B}\stackrel{r}{\hookrightarrow }& \mathtt{O}\hfill \end{array}$ is constructed as described in Remark 17.

Moreover, $⌜\left[syn\left(\phi \right)\right]\left(g{e}_1\right|\dots \left|g{e}_k\right)⌝\in GE\left(\mathsf{\Gamma }\right)$ for any finite canonical input arity graph ${\mathtt{I}}^{\prime }\ne \mathtt{I}$, and any graph homomorphism $\phi :\mathtt{I}\to {\mathtt{I}}^{\prime }$ with arity$ar\left(⌜\left[syn\left(\phi \right)\right]\right(g{e}_1|\dots |g{e}_k)⌝)$ $=\begin{array}{ccc}\hfill {\mathtt{I}}^{\prime }\stackrel{l^{\prime }}{\hookleftarrow }& {\mathtt{B}}^{\prime }\stackrel{r^{\prime }}{\hookrightarrow }& {\mathtt{O}}^{\prime }\hfill \end{array}$ constructed as an instance of the arity $ar(⌜(g{e}_1|\dots |g{e}_k)⌝)=$ $\mathtt{I}\stackrel{l}{\hookleftarrow }$ $\mathtt{B}\stackrel{r}{\hookrightarrow }$ $\mathtt{O}$ by means of ${\mathtt{B}}^{\prime }:=\phi \left(\mathtt{B}\right)$ and a pushout as done in (31).

Both expressions $⌜\left(g{e}_1\right|\dots \left|g{e}_k\right)⌝$ and $⌜\left[syn\left(\phi \right)\right]\left(g{e}_1\right|\dots \left|g{e}_k\right)⌝$ are declared asmulti $\mathsf{\Gamma }$-expressions.

Symbolic composition: 

$⌜(g{e}_1;syn\left(\varrho \right);g{e}_2)⌝\in GE\left(\mathsf{\Gamma }\right)$ for any single or multi Γ-expression $g{e}_1$ with arity $ar\left(g{e}_1\right)=\begin{array}{ccc}\hfill {\mathtt{I}}_1\stackrel{l_1}{\hookleftarrow }& {\mathtt{B}}_1\stackrel{r_1}{\hookrightarrow }& {\mathtt{O}}_1\hfill \end{array}$, any basic Γ-expression $g{e}_2$ with arity $ar\left(g{e}_2\right)=\begin{array}{ccc}\hfill {\mathtt{I}}_2\stackrel{l_2}{\hookleftarrow }& {\mathtt{B}}_2\stackrel{r_2}{\hookrightarrow }& {\mathtt{O}}_2\hfill \end{array}$, and any graph isomorphism $\varrho :{\mathtt{I}}_2\to {\mathtt{O}}_1$.

The arity $ar(⌜(g{e}_1;syn\left(\varrho \right);g{e}_2)⌝)=\begin{array}{ccc}\hfill {\mathtt{I}}_1\stackrel{l}{\hookleftarrow }& \mathtt{B}\stackrel{r}{\hookrightarrow }& {\mathtt{O}}_2^{\varrho }\hfill \end{array}$ with ${\mathtt{O}}_2^{\varrho }$ isomorphic to ${\mathtt{O}}_2$ is constructed as described in Section 5.3.3.

$⌜(g{e}_1;syn\left(\varrho \right);g{e}_2)⌝$ is declared as asingle $\mathsf{\Gamma }$-expressions.

Remark 21

(Notational Convention: Trivial Instances). In case of trivial instances, we will just drop the corresponding substring “$[\dots ]$”:

Constants: 

In the case $\mathtt{I}=\mathbf{0}$, we will just write $⌜\mathtt{c}⌝$ instead of $⌜\left[\right]\mathtt{c}⌝$ and $⌜(\mathtt{c}\downarrow \mathtt{O})⌝$ instead of $⌜\left(\right[]\mathtt{c}\downarrow \mathtt{O})⌝$.

Operations: 

In the case $\phi =i{d}_{{\mathtt{I}}_{\mathtt{op}}}$, we will just write $⌜\mathtt{op}⌝$ instead of $⌜\left[syn\right(\phi \left)\right]\mathtt{op}⌝$ and $⌜(\mathtt{op}\downarrow \mathtt{O})⌝$ instead of $⌜\left(\right[syn\left(\phi \right)]\mathtt{op}\downarrow \mathtt{O})⌝$.

Since we utilize sequential composition via arity renaming, we could even require φ to be a non-isomorphism in the cases Operations and Multi expressions.

Example 15

(Graph Operation Expressions). The graph operation $({\mathtt{comp}}^{\mathcal{C}}+{\mathtt{comp}}^{\mathcal{C}})/\phi$ in 13 is represented by the ${\mathsf{\Gamma }}_{cat}$-expression $⌜\left[syn\right(\phi \left)\right]\left(\mathtt{comp}\right|\mathtt{comp})⌝$. By Symbolic compositionwe obtain then the ${\mathsf{\Gamma }}_{cat}$-expression $⌜\left(\right[syn\left(\phi \right)\left]\right(\mathtt{comp}\left|\mathtt{comp}\right);syn\left(\varrho \right);\mathtt{comp})⌝$ representing the graph operation $(({\mathtt{comp}}^{\mathcal{C}}+{\mathtt{comp}}^{\mathcal{C}})/\phi ){;}^{\varrho }{\mathtt{comp}}^{\mathcal{C}}$ in Example 14.

The graph operation $((({\mathtt{comp}}^{\mathcal{C}}+{\pi }_{\mathtt{I}}^{\mathtt{I}})/\psi ){;}^{\rho }{\mathtt{comp}}^{\mathcal{C}}$ in Example 14 is represented by the ${\mathsf{\Gamma }}_{cat}$-expression $⌜\left(\right[syn\left(\psi \right)\left]\right(\mathtt{comp}\left|\right(\mathtt{I},\mathtt{I}\left)\right);syn\left(\rho \right);\mathtt{comp})⌝$ while $((({\pi }_{\mathtt{I}}^{\mathtt{I}}+{\mathtt{comp}}^{\mathcal{C}})/{\psi }^{\prime }){;}^{{\rho }^{\prime }}{\mathtt{comp}}^{\mathcal{C}}$ corresponds to the ${\mathsf{\Gamma }}_{cat}$-expression $⌜(\left[syn\left({\psi }^{\prime }\right)\right]\left((\mathtt{I},\mathtt{I})\right|\mathtt{comp});syn\left({\rho }^{\prime }\right);\mathtt{comp})⌝$. Both ${\mathsf{\Gamma }}_{cat}$-expressions share the same canonical arity span shown in Figure 13 and thus, we can express the associativity law (33) for the composition of morphisms in categories by an equation between ${\mathsf{\Gamma }}_{cat}$-expressions:

$$(\left[syn\left(\psi \right)\right]\left(\mathtt{comp}\right|(\mathtt{I},\mathtt{I}));syn\left(\rho \right);\mathtt{comp})=(\left[syn\left({\psi }^{\prime }\right)\right]\left((\mathtt{I},\mathtt{I})\right|\mathtt{comp});syn\left({\rho }^{\prime }\right);\mathtt{comp}).$$

(34)

In (34) we do have a twofold - syntactic and semantic - equality between graph operation expressions: equal arity and equal semantics. A future equational calculus for graph operation expressions should, however, also reflect arity renamings, as defined in Remark 9, and deal with semantic equality of graph operation expressions “up to arity renamings”.

Generalizing the examples of the correspondence between graph operation expressions and graph operations in Example 15 and relying on the inductive definition of graph operation expressions in Definition 27, we define now “derived graph operations” as those graph operations that can be represented by graph operation expressions.

Definition 28

(Derived Graph Operations). Let $\mathsf{\Gamma }=(OP,ar)$ be a graph signature and $\mathcal{G}=(\mathtt{G},O{P}^{\mathcal{G}})$ a Γ-algebra. For all Γ-expressions $⌜ge⌝\in GE\left(\mathsf{\Gamma }\right)$ with $ar\left(ge\right)=\begin{array}{ccc}\hfill {\mathtt{I}}_{ge}\stackrel{l_{ge}}{\hookleftarrow }& {\mathtt{B}}_{ge}\stackrel{r_{ge}}{\hookrightarrow }& {\mathtt{O}}_{ge}\hfill \end{array}$ we can inductively define a map $g{e}^{\mathcal{G}}:{\mathtt{G}}^{{\mathtt{I}}_{ge}}\to {\mathtt{G}}^{{\mathtt{O}}_{ge}}$ satisfying the commutativity condition in (16). $g{e}^{\mathcal{G}}$ is called thederived graph operation in $\mathcal{G}$ represented by $ge$.

Projections: 

${(\mathtt{I},\mathtt{O})}^{\mathcal{G}}:={\pi }_{\mathtt{O}}^{\mathtt{I}}:{\mathtt{G}}^{{\mathtt{I}}_{}}\to {\mathtt{G}}^{{\mathtt{O}}_{}}$, according to (17), for all $⌜(\mathtt{I},\mathtt{O})⌝\in GE\left(\mathsf{\Gamma }\right)$.

Constants: 

$\left[\right]{\mathtt{c}}^{\mathcal{G}}:={\pi }_{\mathbf{0}}^{\mathtt{I}};{\mathtt{c}}^{\mathcal{G}}:{\mathtt{G}}^{{\mathtt{I}}_{}}\to {\mathtt{G}}^{{\mathtt{O}}_{\mathtt{c}}}$ for all $⌜\left[\right]\mathtt{c}⌝\in GE\left(\mathsf{\Gamma }\right)$.

${(\left[\right]\mathtt{c}\downarrow \mathtt{O})}^{\mathcal{G}}:={\pi }_{\mathbf{0}}^{\mathtt{I}};{\mathtt{c}}^{\mathcal{G}};{\pi }_{\mathtt{O}}^{{\mathtt{O}}_{\mathtt{c}}}:{\mathtt{G}}^{{\mathtt{I}}_{}}\to {\mathtt{G}}^{{\mathtt{O}}_{}}$ for all $⌜\left(\right[]\mathtt{c}\downarrow \mathtt{O})⌝\in GE\left(\mathsf{\Gamma }\right)$.

Operations: 

${\left(\left[syn\left(\phi \right)\right]\mathtt{op}\right)}^{\mathcal{G}}:={\mathtt{op}}^{\mathcal{G}}/\phi :{\mathtt{G}}^{{\mathtt{I}}^{\prime }}\to {\mathtt{G}}^{{\mathtt{O}}^{\prime }}$, according to Section 5.3.2, for all $⌜\left[syn\right(\phi \left)\right]\mathtt{op}⌝\in GE\left(\mathsf{\Gamma }\right)$.

${(\left[syn\left(\phi \right)\right]\mathtt{op}\downarrow \mathtt{O})}^{\mathcal{G}}:=({\mathtt{op}}^{\mathcal{G}}/\phi );{\pi }_{\mathtt{O}}^{{\mathtt{O}}^{\prime }}:{\mathtt{G}}^{{\mathtt{I}}^{\prime }}\to {\mathtt{G}}^{\mathtt{O}}$ for all $⌜\left(\right[syn\left(\phi \right)]\mathtt{op}\downarrow \mathtt{O})⌝\in GE\left(\mathsf{\Gamma }\right)$.

Multi expressions: 

$(g{e}_1|\dots |g{e}_k{)}^{\mathcal{G}}:=(g{e}_1^{\mathcal{G}}+\dots +g{e}_k^{\mathcal{G}})$, according to Section 5.3.1, for all $⌜\left(g{e}_1\right|\dots \left|g{e}_k\right)⌝\in GE\left(\mathsf{\Gamma }\right)$.

$\left(\left[syn\left(\phi \right)\right]\right(g{e}_1|\dots |g{e}_k{\left)\right)}^{\mathcal{G}}:=(g{e}_1^{\mathcal{G}}+\dots +g{e}_k^{\mathcal{G}})/\phi$, according to Section 5.3.1 and Section 5.3.2, for all $⌜\left[syn\left(\phi \right)\right]\left(g{e}_1\right|\dots \left|g{e}_k\right)\in ⌝GE\left(\mathsf{\Gamma }\right)$.

Symbolic composition: 

${(g{e}_1;syn\left(\varrho \right);g{e}_2)}^{\mathcal{G}}:=g{e}_1^{\mathcal{G}}{;}^{\varrho }g{e}_2^{\mathcal{G}}:{\mathtt{G}}^{{\mathtt{I}}_1}\to {\mathtt{G}}^{{\mathtt{O}}_2^{\varrho }}$, according to Section 5.3.3, for all $⌜(g{e}_1;syn\left(\varrho \right);g{e}_2)⌝\in GE\left(\mathsf{\Gamma }\right)$.

Conjecture 3

(Substitutions Revisited). In light of the discussion in Section 5.1.3, it may be possible to develop in the future a substitution calculus for graph operation expressions along the following lines: A substitution is given by a single or multi Γ-expression $⌜sub⌝$ with arity $\begin{array}{ccc}\hfill {\mathtt{I}}_1\stackrel{l_1}{\hookleftarrow }& {\mathtt{B}}_1\stackrel{r_1}{\hookrightarrow }& {\mathtt{O}}_1\hfill \end{array}$. The substitution $⌜sub⌝$ can be applied to a Γ-expression $⌜ge⌝$ with arity $\begin{array}{ccc}\hfill {\mathtt{I}}_2\stackrel{l_2}{\hookleftarrow }& {\mathtt{B}}_2\stackrel{r_2}{\hookrightarrow }& {\mathtt{O}}_2\hfill \end{array}$ if there is a graph isomorphism $\varrho :{\mathtt{I}}_2\to {\mathtt{O}}_1$. Substitution application is then done in two steps: (1) We build the expression $⌜(sub;syn(\varrho );ge)⌝$ by symbolic composition. If $⌜ge⌝$ is not a basic Γ-expression, this expression will be not a Γ-expression in the sense of Definition 27! (2) We transform the expression $⌜(sub;syn(\varrho );ge)⌝$ into an equivalent Γ-expression $⌜\widehat{ge}⌝$ in the sense of Definition 27.

To illustrate this idea, we outline for the graph signature ${\mathsf{\Gamma }}_{cat}$ an example of an equivalence between a symbolic-composition expression $⌜(sub;syn(\varrho );ge)⌝$, that is not a ${\mathsf{\Gamma }}_{cat}$-expression in the sense of Definition 27, and a ${\mathsf{\Gamma }}_{cat}$-expression $⌜\widehat{ge}⌝$.

To begin with a feasible visualization, we consider the ${\mathsf{\Gamma }}_{cat}$-expression $⌜\left[syn\right(\varphi \left)\right]\left(\mathtt{comp}\right|\mathtt{comp})⌝$ where ϕ and the arity $\begin{array}{ccc}\hfill {\mathtt{I}}^{\prime }\stackrel{l^{\prime }}{\hookleftarrow }& {\mathtt{B}}^{\prime }\stackrel{r^{\prime }}{\hookrightarrow }& {\mathtt{O}}^{\prime }\hfill \end{array}$ are described in Figure 14.

Figure 14. Parallel application of two composition operations on overlapping pairs of arrows.

Figure 14. Parallel application of two composition operations on overlapping pairs of arrows.

The sample substitution is given by the extended ${\mathsf{\Gamma }}_{cat}$-expression

$$⌜sub⌝:=⌜\left[syn\left(\overline{\varphi }\right)\right]\left(\mathtt{comp}\right|\mathtt{comp}|(\mathtt{I},\mathtt{I})\left|(\mathtt{I},\mathtt{I})\right)⌝$$

with arity $ar\left(sub\right)=\begin{array}{ccc}\hfill {\mathtt{I}}_{sub}\stackrel{l_{sub}}{\hookleftarrow }& \mathtt{B}\stackrel{r_{sub}}{\hookrightarrow }& {\mathtt{O}}_{sub}\hfill \end{array}$ depicted in Figure 15. $\mathtt{I}$ is the canonical input arity graph $iv$1 $\stackrel{{ie}_1}{\to }$ $iv$2. The input arity of $⌜\left(\mathtt{comp}\right|\mathtt{comp}\left|\right(\mathtt{I},\mathtt{I}\left)\right|(\mathtt{I},\mathtt{I}))⌝$ extends the input arity of $⌜\left(\mathtt{comp}\right|\mathtt{comp})⌝$ by the arrows $iv$7 $\stackrel{{ie}_5}{\to }$ $iv$8 $iv$9 $\stackrel{{ie}_6}{\to }$ $iv$10 while $\overline{\varphi }$ extends ϕ by the assignments $\{i{v}_7\mapsto i{v}_1,i{e}_5\mapsto i{e}_1,i{v}_8\mapsto i{v}_2,i{v}_9\mapsto i{v}_3,i{e}_6\mapsto i{e}_3,i{v}_{10}\mapsto i{v}_4\}$.

As ${\mathsf{\Gamma }}_{cat}$-expression we consider $⌜ge⌝:=⌜\left[syn\right(\phi \left)\right]\left(\mathtt{comp}\right|\mathtt{comp})⌝$ with arity $ar\left(ge\right)=\begin{array}{ccc}\hfill {\mathtt{I}}_{ge}\stackrel{l_{ge}}{\hookleftarrow }& {\mathtt{B}}_{ge}\stackrel{r_{ge}}{\hookrightarrow }& {\mathtt{O}}_{ge}\hfill \end{array}$ shown in Figure 16. φ is given by the assignments $\{i{e}_1\mapsto i{e}_1,i{e}_2\mapsto i{e}_2,i{e}_3\mapsto i{e}_3,i{e}_4\mapsto i{e}_4\}$.

By means of the isomorphism $\varrho :{\mathtt{I}}_{ge}\to {\mathtt{I}}_{sub}$ that is the identity on nodes, we can build the following symbolic-composition expression that is not a ${\mathsf{\Gamma }}_{cat}$-expression

$$⌜(sub;syn\left(\varrho \right);ge)⌝=⌜\left[syn\left(\overline{\varphi }\right)\right]\left(\mathtt{comp}\right|\mathtt{comp}|(\mathtt{I},\mathtt{I})\left|(\mathtt{I},\mathtt{I})\right);syn\left(\varrho \right);\left[syn\left(\phi \right)\right]\left(\mathtt{comp}\right|\mathtt{comp})⌝$$

Using the two ${\mathsf{\Gamma }}_{cat}$-expressions in (34), we can, however, construct a ${\mathsf{\Gamma }}_{cat}$-expression $⌜\widehat{ge}⌝$ given by

$$⌜\left[syn\left(\theta \right)\right]\left((\left[syn\left(\psi \right)\right]\left(\mathtt{comp}\right|(\mathtt{I},\mathtt{I}));syn\left(\rho \right);\mathtt{comp})\right|(\left[syn\left({\psi }^{\prime }\right)\right]\left((\mathtt{I},\mathtt{I})\right|\mathtt{comp});syn\left({\rho }^{\prime }\right);\mathtt{comp}))⌝$$

All four expressions share the same canonical input arity graph ${\mathtt{I}}^{\prime }$ in Figure 14 and θ is defined as the cotuple $\theta :=[i{d}_{{\mathtt{I}}^{\prime }},i{d}_{{\mathtt{I}}^{\prime }}]:{\mathtt{I}}^{\prime }+{\mathtt{I}}^{\prime }\to {\mathtt{I}}^{\prime }$.

$⌜(sub;syn(\varrho );ge)⌝$ and $⌜\widehat{ge}⌝$ do have the same arity and are equivalent, that is, for all ${\mathsf{\Gamma }}_{cat}$-algebras $\mathcal{G}=(\mathtt{G},O{P}^{\mathcal{G}})$ we have ${(sub;syn\left(\varrho \right);ge)}^{\mathcal{G}}={\widehat{ge}}^{\mathcal{G}}$.

Conjecture 4

(Operations by Subgraphs). At the beginning of this section we discussed that any subgraph of a graph of graph terms defines a graph operation (see Lemma 6). A reasonable question is to what extent this method of defining graph operations can be simulated by means of “graph operation expressions” and “derived graph operations”. We claim that it is possible to prove inductively a statement like the following:

For any finite canonical input arity graph $\mathtt{I}$ and any finite subgraph $\mathtt{O}⊑{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathtt{I}\right)$ there exist a graph operation expression $ge\in GE\left(\mathsf{\Gamma }\right)$ with input arity $\mathtt{I}$ and an output arity ${\mathtt{O}}^{\prime }$ isomorphic to $\mathtt{O}$ such that for all Γ-algebras $\mathcal{G}=(\mathtt{G},O{P}^{\mathcal{G}})$ we have $g{e}^{\mathcal{G}}={\delta }_{\mathtt{O}}^{\mathtt{I}}\left(\mathit{b}\right)$ (up to arity renaming) for the graph operation ${\delta }_{\mathtt{O}}^{\mathtt{I}}:{\mathtt{G}}^{\mathtt{I}}\to {\mathtt{G}}^{\mathtt{O}}$ defined in Lemma 6.

There are two essential means that should allow us to prove such a statement:

• By means of the restriction expressions $⌜\left(\right[]\mathtt{c}\downarrow \mathtt{O})⌝$ and $⌜\left(\right[syn\left(\phi \right)]\mathtt{op}\downarrow \mathtt{O})⌝$ we can simulate the “pseudo operation symbols” ${\mathtt{c}}_{ov}$, ${\mathtt{c}}_{oe}$, ${\mathtt{op}}_{ov}$, ${\mathtt{op}}_{oe}$ and their semantics by chosing $\mathtt{O}$ to be the single output vertex $ov$ or the single output edge $oe$ (together with its source and target), respectively.
• Once, we have been able to represent all the single vertices and edges in a subgraph $\mathtt{O}⊑{\mathtt{T}}_{\mathsf{\Gamma }}\left(\mathtt{I}\right)$ by corresponding graph operation expressions, we can combine them into one graph operation expression by the trick used in Conjecture 3 to define the graph operation expression $⌜\widehat{ge}⌝$. All the single output arities will be soldered together resulting in a graph isomorphic to $\mathtt{O}$.

6. Operations in Topoi

When we started to write the paper, we intended to round it up with a longer section to summarize the results and findings, and to lift them up to a more abstract level.

On the way, we discovered, however, too many new things and results, that we simply had to investigate and include in the paper, thus it became a bit too long and overloaded. Therefore, we reserve a detailed categorical analysis of the results and findings of the paper and the development of a general theory of operations in topoi as a topic of future research. We already spent, however, some essential effort to revise traditional concepts and results, and to lift them up to a more categorical level thus we want to include, at least, some few remarks concerning this topic.

We are quite sure that all (!) the definitions, constructions and results, including term algebras and the result that subalgebras are regular monic, can be generalized to presheaf topoi ($\mathsf{C}$-sets) $[\mathsf{C}\to \mathsf{Set}]$ with $\mathsf{C}$ a simple category in the sense of [22]. Simple categories are a special class of “finite categories with no cycles of non-identity morphisms” and play a role in the foundation of Homotopy Type Theory.

There is no problem to define signatures and algebras in arbitrary topoi, analogously to graph signatures and graph algebras. However, terms and term algebras will be, in general, not available. A main outcome of the paper is, that there is no need for term algebras to define derived operations. It is sufficient to define “operation expressions” and their semantics, and this can be done in arbitrary topoi (as long as we drop the request that operation expressions should be represented “syntactically”)!

We hope that even a prospective substitution calculus for graph operation expressions (along the ideas in Conjecture 3) can be generalized to operation expressions in arbitrary topoi.

7. Related Work

The work presented in this paper has its seeds in the pioneering work on generalized sketches of a group around Zinovy Diskin in the 90’s [4,5,6]. The concept of sketch operation in [5] was the starting point for the joint paper [1] on graph operations and free graph algebras. As discussed in Section 4.2 it turned out, however, that the original definition of arities and graph operations in [1] is not appropriated to define graph operation expressions representing derived graph operations in analogy to the role of terms as representations of derived operations in traditional Universal Algebra.

Being about to finish the paper and by a chain of accidents, we have been notified of a paper about graph operations (only available in French!) [7] from Albert Burroni a former PhD-student of Charles Ehresmann. The ambition of [7] is very much in accordance with the intentions behind our paper. Graph operations are also defined as maps from ${\mathtt{G}}^{\mathtt{I}}$ to ${\mathtt{G}}^{\mathtt{O}}$. There are, however, essential conceptual and technical differences between both papers:

• Input and output arity graphs are not described with concrete syntactic identifiers, but are implicitly considered as being given by “equivalence up to arity renaming”.
• There are no boundaries and thus no systematic treatment of “preservation conditions” as we formalized them by means of the commutativity condition in (16).
• In the examples, preservation conditions are expressed by means of ad-hoc equations between vertices and/or edges, respectively.
• There is no explicit notion of “derived graph operation” and the issue of “graph operation expressions” is not addressed at all.
• Derived graph operations, in our sense, appear only implicit when properties of graph operations are described by means of equations between vertices and/or edges.
• Apart from that, [7] demonstrates the usefulness and appropriateness of graph operations in category theory and, especially, it seems to be worth to investigate once the relation between Chapter 2 and the first-order sketches introduced in [2].

Since we use parallel and sequential composition of maps to define derived graph operations, there is of course a certain overlap with monoidal categories, term graphs [20] and string diagrams [21]. However, our approach to derived graph operations deviates essentially from traditional monoidal categories and string diagrams:

• Traditional monoidal categories and string diagrams deal only with single isolated items as input and output of operations.
• This becomes manifested in the absence of boundaries.
• The essential difference is that the presence of boundaries forces us to replace “copying of items” internal in a diagram by “soldering of input and output ports”, i.e., by constructing an instance of a diagram as a whole.

It is an interesting and open question to what extend it might be useful and feasible to define categories with (equivalence classes of) graph operation expressions as morphisms. A more exotic question would be if those hypothetical categories can be characterized and axiomatized in analogy to the different kinds of monoidal categories and string diagrams.

8. Conclusions

One of the roles of terms in Universal Algebra is to represent derived operations, i.e., operations that can be build up from the basic operations in an algebra. Relying on a revised version of graph operations we defined graph operation expressions as a counterpart to terms. We identified three basic mechanisms to construct new graph operations out of given ones: parallel composition, instantiation and sequential composition. These mechanisms allowed us to construct for all graph operation expressions a corresponding derived graph operation in any graph algebra.

In another direction, we made a first step towards “Universal Graph Algebra”, i.e., we generalized some basic model-theoretic concepts and results from algebras to graph algebras. Especially, we generalized the concept generated subalgebra and proved that all monomorphic homomorphisms between graph algebras are regular.

We made an overall and essential effort to present definitions, concepts, constructions, results, and proofs in a more categorical a way that we can lift them up, once in the future, straightforwardly to the level of topoi.

Besides the missing proofs of the conjectures, there are many open ends and many things that can or should be done. Especially, an equational calculus for graph operations relying on the equality of graphs (and not of single vertices and/or edges) is very much demanded. Such a calculus is expected to provide also a basis to define an equivalence relation for graph operation expressions and, in turn, for a semantic preserving rewriting of graph operation expressions.