Submitted:
26 October 2023
Posted:
27 October 2023
You are already at the latest version
Abstract
In this paper, we explore a new norm on Lp-space called r-norm, and hence producing a new normed space called r-normed space. Measure theoretic and functional analytic properties are covered such as the relation between r-norm and the classical p-norm. An application of r-normed space in probability theory and statsitics is also presented, notably, its role as a rigorous framework in describing the coefficient of determination.
Keywords:
r-normed space
; r-norm
; Lp-space
; measure theory
; functional analysis
; coefficient of determination
1. Introduction
In functional analysis [1,2], a normed-space is a vector space [3] together with a map [4] from the vector space to the set of all nonnegative real numbers which satisfies a set of axioms [4] called normed space axioms [2]. A comprehensive and formal description about normed spaces will be presented later. Mathematicians have studied normed spaces from the late 19th and early 20th centuries as the history is concerned.
In this paper, we explore a new kind of normed space related to functions [1,2] which we refer to as the r-normed space. The formal definition of this normed space will be presented as well its rigorous construction. We also present an application of r-normed space in probability theory and statistics [5].
For the rest of the paper, symbolic first or second order notations [6] will frequently occur in every formal expression. The readers are referred to [4,6] for comprehensive explanations regarding the formal expressions. Foundations in abstract measure theory [7] are also required since we will not present basic concepts in measure theory unless we think necessary.
2. Basics of Lp Space and Normed Space
The underlying vector space [3] in the whole discussion is the space, a function space satisfying some Lebesgue integration property [7] which will be described further. The designation of space can be broad since many different vector spaces may be examples of space such as finite dimensional vector space, infinite dimensional vector space in forms of sequences and function space of certain type of Lebesgue integrable functions [2,7]. We will present the general measure theoretic definition of space as follows.
Definition 1
We will need to show that the family of equivalence classes in definition 1 is a vector space. First, let us observe the axiomatic definition of vector space in the following definition.
Definition 2
(Vector Space). A set V is a vector space [3] over a field together with operations and if the following axioms are satisfied:
- V1
- V2
- V3
- There exists a unique such that
- V4
- V5
- V6
- There exists a unique such that
- V7
- V8
The following theorem will show that the family of equivalence classes in definition 1 is in fact a vector space over which is referred to as an space.
Theorem 1.
Let be a measure space. The family of equivalent classes as described in definition 1 is a vector space over .
Proof.
To show that is a vector space over we need to show that all axioms in definition 2 hold.
Let . Since are real-valued functions, then
and
holds and show that axioms V1 and V2 are satisfied. Note that in the sense of , the symbol ‘=’ designates the equivalence relation ∼ as described in definition 1. The zero function also exists as it satisfies
Then we have
which shows that axiom V3 is satisfied. Then is certain since
With
axiom V4 is satisfied. Note that
since
Now, let . Then we obtain
which shows that axiom V5 is satisfied. Then, certainly and we have
which shows that axiom V6 is satisfied. Also
and
show that axioms V7 and V8 are satisfied. Thus, we conclude that is a vector space. □
Another functional analytic [2] notion to necessarily be presented is normed space [2], which is given in the following definition.
Definition 3
(Normed Space). Let V be a vector space over a field . A norm on V is a map satisfying the following axioms:
- N1
- N2
- N3
- N4
If is a norm on V, then we call a normed space [2].
For a given vector space and a possible norm, the common challenge is proving axiom N4, which is sometimes also referred to as the triangle inequality. An indispensable tools in mathematical analysis to help prove axiom N4 are the so-called “Hölder’s inequality" and “Minkowski inequality" which will be presented. In fact, Minkowski inequality is a consequence of Hölder’s inequality. However, we first need Young’s inequality in order to prove Hölder’s which is presented in the following lemma.
Proposition 1.
Let such that and . Note that the following expressions are equivalent:
- i
- ii
- iii
- iv
- v
Lemma 1.
Proof.
Suppose a function such that , and f is continuous [8] as well as bijective [4]. Note that we will have
In particular, f can be defined by
as it is continuous [2] and bijective. And we can show the bijectivity of f if we can show that f is strictly monotone, since strict monotonicity of such a function implies bijectivity. Now let such that . Certainly we have
which shows that f is strictly increasing. Hence f is bijective. It implies that exists, which is now our task in finding it. Follows from proposition 1, we obtain the inverse as given by
And we have
which proves the lemma. □
Now we present Hölder’s inequality in the following theorem.
Theorem 2.
Proof.
Suppose some functions defined by
and
respectively. Follows from lemma 1, i. e., Young’s inequality, we obtain
By taking Lebesgue integral [7] to the expression above, we obtain
which implies
which proves Hölder’s inequality. □
Theorem 3.
Proof.
Proving for is trivial, since obviously
then by the property of Lebesgue integral [7] we have
which proves the inequality for .
Now we prove the inequality for . Let such that and . Let such that
Note that since is a vector space, which means that it is closed under addition and scalar multiplication. That is,
where the map is defined by
From the expression above, additive closure shows that , and scalar multiplicative closure shows that , and hence . Follows from proposition 1, we obtain
from the fact that . Hence . Then follows from the triangle inequality and Hölder’s inequality we obtain
which implies
which proves Minkowski inequality for . Thus, we conclude the proof. □
Now let us observe the very fundamental norm defined on space, which is the p-norm [2]. This norm is a fundamental concept in functional analysis and is the interest of study in Banach spaces [1,2]. This norm will also be essentially related to our formulation of r-norm. We will present this norm on a theorem after we present the following lemma.
Lemma 2.
Let be a measure space [7]. Let such that . Follows from theorem 1, we have a vector space . The expression
holds.
Proof.
We prove the forward part first. Let and . Suppose . Then we have
which implies
And by the property of Lebesgue integral [7], we obtain
which proves the forward part.
Now for the backward part, suppose
Let such that . Note that g is measurable and nonnegative. By simple function [7] approximation theorem, for every there exists a simple function such that
and
holds. Note that there are only finitely many points in the image of since it is a simple function, for any . Now let
such that
The notation above refers to the image of a function [4]. Now suppose
And suppose
We can now express the simple function as
where
which is known as an indicator function. And the Lebesgue integral of g over X can be given in accordance with its definition [7] by
Recalling the assumption, we now have
Note that each term in the summation above is nonnegative. Then we must have
which implies
The only solution to this circumstance is
The statement above implies that
which means that , or μ-almost everywhere [7]. It also implies that , which proves the backward part. We conclude that
which proves the theorem as a whole. □
Theorem 4.
Let be a measure space [7]. Let such that . Follows from theorem 1, we have a vector space . A map defined by
is a norm on known as the p-norm, and hence is a normed space.
Proof.
To show that is a norm on , we need to show that axioms N1, N2, N3 and N4 in definition 3 are satisfied. For the whole discussion in this proof, let and .
By definition, involves the designation of within the Lebesgue integral, hence we will always have a nonnegative integrand. By the property of Lebesgue integral [7], since then
which shows that axiom N1 is satisfied.
Now we need to show that , which is equivalent to showing , as shown by
Follows from lemma 2, we obtain
Note that the equality symbol ‘=’ in terms of refers to ’∼’ in terms of . Thus, the statement above shows that which implies and hence axiom N2 is satisfied.
By the property of Lebesgue integral [7], we obtain
which shows that axiom N3 is satisfied.
Then by the property of Lebesgue integral as well as theorem 3 (Minkowski inequality), we obtain
which shows that axiom N4 is satisfied.
Thus, we conclude that is a norm on . Hence is a normed space. □
3. Definition and Properties of r-Normed Space
We formulate r-norm as a norm on space. The formal definition of r-norm and r-normed space follows from the following theorem.
Theorem 5.
Proof.
We need to show that axioms N1, N2, N3 and N4 are satisfied. For the whole disucssion in this proof, let and .
Note that , μ-almost everywhere [7] and , which imply μ-almost everywhere. Then
And note that , which means
Then by the property of Lebesgue integral [7], we obtain
which shows that axiom N1 is satisfied.
Note that
and
hold. Follows from lemma 2, we obtain
Note that the equality symbol ’=’ in terms of refers to the equivalence relation [4] symbol ’∼’ in terms of . Then by the transitive property of biconditional statements, we obtain
which shows that axiom N2 is satisfied.
By the property of Lebesgue integral [7], we obtain
which shows that axiom N3 is satisfied.
Follows from the property of Lebesgue integral [7] and theoerm 3 (Minkowski inequality), we obtain
which shows that axiom N4 is satisfied. We conclude that the map is a norm on . □
By theorem 5, we can present the formal definition of r-normed and r-normed space in the following definition.
Definition 4
As we have mentioned in the earlier section that p-norm and r-norm are closely related. The relationship is described in the following proposition.
Proposition 2.
Suppose an r-normed space with respect to a measure space [7]. Let . Note that from theorem 4, we have another norm defined by
And follows from definition 4, we obtain
4. An Application of r-Normed Space
A notable application of r-normed space is in a formal description of the coefficient of determination (CoD) in probability theory and statistics [5]. The CoD is used in statistical models for predictions or hypotheses testing. It provides a numeric representation on the performance of the model [9]. This section will discuss the formal construction of CoD based on the r-norm, begun from defining the underlying measure space [7] and random variables [5].
Suppose we have a real world observation. Note that we will only have finitely many data points in the observation. Let be the possible outcome of the observation, and hence . Let be a -algebra [7] representing the set of probable events from the observation. Then we have a measurable space . Then let be a probability measure, and hence we have a probability space [5]. Let us consider another measure defined as the counting measure [7] on , i. e.,
Since we only have finitely many data points in the observation, then
which means that is a finite measure.
Also suppose that the observation produces random variables [5] of which some of them are independent and one of them is dependent. We will focus on the dependent random variable . Suppose Y is almost surely [5] nonconstant, that is,
and almost surely [5] bounded, that is,
On the other hand, suppose . Theorem 5 and definition 4 allow us to define an r-norm on . Let such that
where denotes the expectation [5] of Y, that is,
The boundedness of the expectation is implied from the designation that Y is almost surely bounded. Also note that is just a constant, which means that it is also an function, since
Now let
Then the r-norm is defined by
Suppose we develop a predictive model to estimate Y, either using a statistical or machine learning (ML) model. Let be the predictive model. The CoD regarding the predictive model with respect to Y can be be given by
With that in mind, we can also present a new method of numeric performance evaluation of the model by making use of only the r-norm in exchange for the CoD. We propose the method in the following proposition.
Proposition 3.
Suppose an observation which produces a finite number of data points. Let a measurable space [5] be the underlying event space [5]. Note that
Then let be the corresponding probability space. And let be a counting measure [7] on , and hence we have another measure space . Let be a dependent random variable such that Y has a bounded expectation [5], is almost surely nonconstant [5] and . Let such that
And let
Follows from theorem 5 and definition 4, there exists a normed space such that
Let be a predictive model on Y such that . The model is ρ-reliable if there exists some with such that
Here is the main difference of the CoD with the performance evaluation presented in proposition 3. In CoD the model can be deemed showing a good performance if the corresponding CoD has a value close to 1. While in our proposed method, the model has a good performance if the corresponding squared r-norm has a value close to 0. On the other hand, an awful model will give a negative CoD, or equivalently a squared r-norm greater than 1.
5. Conclusion and Future Work
We have presented a new norm called r-norm on an space which produces a new normed space called r-normed space. Some property of r-normed space has also been presented regarding its relation with the classical p-norm on the same underlying function space. An application of r-normed space has also been presented in the formal description of coefficient of determination in probability theory and statistics [5]. The r-normed space of square integrable random variable with respect to a measure space space and probability space of a finite observation , with being a counting measure [7], serves as an alternative framework in describing the coefficient of determination. We have also proposed an alternative model performance evaluation using the squared r-norm as presented in proposition 3.
For the future works, we are interested in further exploring the measure theoretic and functional analytic properties of r-normed space. We are also interested in exploring other possible applications of r-normed space in probability theory, statistics, or other fields of science and engineering.
Conflicts of Interest
Conflicts of Interest: The authors declare no conflicts of interest.
References
- Bühler, T.; Salamon, D.A. Functional Analysis; American Mathematical Society: Zurich, 2018. [Google Scholar]
- Kreyszig, E. Introductory Functional Analysis with Applications; Wiley: New York, 1978. [Google Scholar]
- Roman, S. Advanced Linear Algebra (Second Edition); Springer: New York, 2005. [Google Scholar]
- Stoll, R.R. Set Theory and Logic; Dover: New York, 1963. [Google Scholar]
- Brémaud, P. Probability Theory and Stochastic Processes; Springer: Cham, 2020. [Google Scholar] [CrossRef]
- Bergmann, M.; Moor, J.; Nelson, J. The Logic Book (Sixth Edition); McGraw-Hill: New York, 2014. [Google Scholar]
- Salamon, D.A. Measure and Integration; European Mathematical Society: Zurich, 2016. [Google Scholar]
- Rudin, W. Principles of Mathematical Analysis; McGraw-Hill: New York, 1964. [Google Scholar]
- Draper, N.R.; Smith, H. Applied Regression Analysis; Wiley-Interscience, 1998. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Copyright: This open access article is published under a Creative Commons CC BY 4.0 license, which permit the free download, distribution, and reuse, provided that the author and preprint are cited in any reuse.