Solution of the Unconditional Extremal Problem for a Linear-Fractional Integral Functional Depending on the Parameter
Peter Shnurkov, Kseniia Adamova

TL;DR
This paper investigates an extremal problem for a fractional linear integral functional depending on a parameter, providing new theoretical results and potential applications in stochastic control.
Contribution
It extends previous work by analyzing a fractional linear integral functional with parameter-dependent integrands on probability distributions.
Findings
Proved three key extremum theorems for the functional.
Established that solutions are determined by the extremal properties of a test function.
Connected the results to applications in stochastic system control.
Abstract
The paper is devoted to the study of the unconditional extremal problem for a fractional linear integral functional defined on a set of probability distributions. In contrast to results proved earlier, the integrands of the integral expressions in the numerator and the denominator in the problem under consideration depend on a real optimization parameter vector. Thus, the optimization problem is studied on the Cartesian product of a set of probability distributions and a set of admissible values of a real parameter vector. Three statements on the extremum of a fractional linear integral functional are proved. It is established that, in all the variants, the solution of the original problem is completely determined by the extremal properties of the test function of the linear-fractional integral functional; this function is the ratio of the integrands of the numerator and the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsDifferential Equations and Boundary Problems · Fractional Differential Equations Solutions · Mathematical and Theoretical Analysis
Solution of the Unconditional Extremal Problem
for a Linear-Fractional Integral Functional
Depending on the Parameter
P. V. Shnurkov 111National Research University Higher School of Economics, Moscow, 101000 Russia, [email protected], K. A. Adamova 222National Research University Higher School of Economics, Moscow, 101000 Russia, [email protected]
Abstract
The paper is devoted to the study of the unconditional extremal problem for a fractional linear integral functional defined on a set of probability distributions. In contrast to results proved earlier, the integrands of the integral expressions in the numerator and the denominator in the problem under consideration depend on a real optimization parameter vector. Thus, the optimization problem is studied on the Cartesian product of a set of probability distributions and a set of admissible values of a real parameter vector. Three statements on the extremum of a fractional linear integral functional are proved. It is established that, in all the variants, the solution of the original problem is completely determined by the extremal properties of the test function of the linear-fractional integral functional; this function is the ratio of the integrands of the numerator and the denominator. Possible applications of the results obtained to problems of optimal control of stochastic systems are described.
Key words: linear-fractional integral functional, unconditional extremal problem for a fractional linear integral functional, test function, optimal control problems for Markov and semi-Markov random processes.
1 Introduction
The present paper is a continuation of the studies of the unconditional extremal problem for linear-fractional integral functionals carried out in the papers [1], [2]. Besides its theoretical value, this problem serves as a basis for solving optimal control problems for various classes of random processes (regenerating, Markov, semi-Markov). In turn, optimal control problems for these classes of processes arise in the analysis of numerous applied models in the mathematical theory of effectiveness and reliability, storage theory, and other areas of applied probability theory.
Let us make some remarks of bibliographic nature concerning the general unconditional extremal problem for linear-fractional integral functionals.
By linear-fractional programming we usually mean the area of optimization theory in which the objective functional of the extremal problem under consideration is the ratio of two linear functionals and the available constraints are linear. In this area of optimization theory, there exists an extensive literature mostly devoted to the study of such problems in finite-dimensional spaces.
A comprehensive theory dealing with this direction was described in the fundamental monograph [3]. This book not only presents theoretical results concerning the solutions of the corresponding extremal problems, but also describes numerical methods for finding such solutions. In addition, it contains a detailed bibliography in the field of fractional linear programming. Also note certain recent important papers, such as [4], [5], [6], in which theoretical and numerical problems related to research in this subject were studied.
A special area of linear-fractional programming comprises extremal problems in which the objective functional is the ratio of two integrals. The integrands in these integrals are assumed to be known and integration is carried out with respect to a probability measure belonging to a set of probability measures defined on a given measure space. The solution of the problem is the probability measure furnishing a global extremum to such a functional. Functionals of this form may be called integral linear-fractional functionals. Extremal problems for integral linear-fractional objective functionals defined on a set of probability distributions in a finite-dimensional space were considered by V. A. Kashtanov in [7], [8]. His results on the theory of unconditional extrema for such functionals were described in complete form in the monograph [8, Chap. 10]. The main significant feature of these results is that the unconditional extremum of functionals of such form is attained on degenerate probability distributions having one point of growth. However, this result was obtained in [8] under highly restrictive conditions, the chief of which was the assumption on the existence of an extremum of the objective functional, i.e., the existence of a solution of the original problem. In his papers [1], [2], P. V. Shnurkov constructed a new solution of the unconditional extremal problem for a linear-fractional integral functional, which significantly generalizes and strengthens the corresponding results from [8]. The fundamental difference of the results given in [1], [2] from the earlier ones is that the main statement indicates conditions under which the extremum of a fractional linear integral functional exists and is attained on a degenerate distribution concentrated at one point. Further, the point at which the whole probability measure is concentrated is the point of global extremum of a function for which an explicit analytic representation was obtained.
In the papers [1], [2], it was assumed that the integrands of the numerator and denominator of the fractional linear integral functional under consideration are independent of the probability measure characterizing the control. This assumption is justified by the fact that, in many applied problems, the objective exponent is a stationary cost functional with a prescribed structure. However, in many specific problems, the objective exponent is expressed as a linear-fractional integral functional the integrands of whose numerator and denominator depend on a collection of deterministic control parameters. In this case, the extremal problem is changed, and a special study is needed. Such a study is given in the present paper.
2 Statement of the Main Extremal Problem
Let denote a measure space, where is an arbitrary set and is the -algebra of subsets of the set including all simpletons.
In what follows, the space will serve as a set of admissible stochastic optimization or of control parameters in the extremal problem under consideration.
Let be a set of probability measures defined on the -algebra whose elements will be denoted by . In what follows, we shall formulate constraints on the set and its elements related to the main extremal problem.
Definition 1**.**
A probability measure defined on , is said to be degenerate if there exists a point such that , , where is the set consisting of one point and is an arbitrary set from the system not containing the point . The point is called the concentration point of the measure , and we will denote the measure with its concentration point by the symbol .
Let denote the set of all possible degenerate probability measures defined on the measure space . The set is in a one-to-one correspondence with with the set of points concentration of degenerate probability measures .
Let be a set of values of the vector parameter In what follows, the parameter will serve as a deterministic optimization (control) parameter in the optimization problem under consideration.
Let us define some measurable numerical functions:
[TABLE]
where , .
We introduce the following integral transformations defined by the functions , :
[TABLE]
The integral expressions in relations (1) are Lebesgue integrals with respect to the probability measure . According to the general probability model examined in great detail in [9, Chap. 2], these integrals have the meaning of expectations of some random variables , depending on an elementary outcome of a random experiment on the probability space . If the set is a finite-dimensional real space, then the probability measure can be given by the distribution function of a one-dimensional or multidimensional random variable. In that case, the integrals in relations (1) can be expressed as a Lebesgue-Stieltjes integral with respect to the probability distribution [9], [10]. The integral transformations (1) also define the following functionals given on the set of probability measures ,
[TABLE]
these functionals depend on the parameter .
Let us now introduce the notion of a fractional linear integral functional depending on a parameter.
Definition 2**.**
The mapping defined by the relation
[TABLE]
will be called a linear-fractional integral functional depending on a parameter .
We shall consider the extremal problem
[TABLE]
for a linear-fractional integral functional depending on a numerical parameter .
Definition 3**.**
The function
[TABLE]
is called the test function of the linear-fractional integral functional (2).
The unconditional extremal problem for a linear-fractional integral functional of the form (2) do independent of the parameter was studied in the author’s papers [1], [2]. However, problem (3) considered in the present paper cannot be reduced to the problem examined in those papers. Namely, the integrands of the numerator and denominator of the objective functional (2) depend on an additional nonrandom control parameter . In the papers [1], [2], it was assumed that the integrands of the numerator and denominator of the fractional linear integral functional are independent of the control.
We shall introduce preliminary conditions on the main objects appearing in the description of the extremal problem (3). These conditions ensure the well-posedness of the problem under consideration. They are as follows:
The integral expressions
[TABLE]
exist for all , . 2. 2.
, , . 3. 3.
.
Remark. If the function does not change sign, i.e., , or , then Condition 2 from the system of preliminary conditions holds automatically. At the same time, the strict positivity condition for the function is natural for many optimal control problems for regenerating and semi-Markov random processes (see the corresponding remarks [2]). In this connection, in the following main statement on the extremum of the fractional linear integral functional, it will be assumed that conditions 1, 3 and the strict sign-constancy condition for the function hold.
Theorem 1**.**
Suppose that the main objects in the extremal problem (3) satisfy the preliminary conditions 1, 3 and the function is strictly of constant sign (strictly positive or strictly negative) for all . We also assume that the test function attains its global extremum on the whole set at the point .
Then the solution of the extremal problem (3) exists and is attained on the pair , where is a degenerate probability measure concentrated at the point , and the following relations hold:**
[TABLE]
if is the point of global maximum of the function ;**
[TABLE]
if is the point of global minimum of the function .
As a preliminary, we shall prove the following lemma.
Lemma 1**.**
If the assumptions of the theorem are satisfied and the function
[TABLE]
is bounded above or below, i.e., at least one of the following inequalities holds:**
[TABLE]
then the corresponding estimate also holds for the whole linear-fractional functional:**
[TABLE]
Proof of Lemma 1.
Suppose that inequality (4) holds:
[TABLE]
First, consider the variant in which , . Then, from (8), we obtain
[TABLE]
By the property of the integral [10], it follows from (9) that
[TABLE]
At the same time, the strict positivity condition for the function implies the corresponding inequality for the integral [10]:
[TABLE]
But, in that case, from (10) and (11), we obtain
[TABLE]
Now we consider the variant in which , .
Then, using (8), we can write
[TABLE]
It follows from inequality (13) and the property of the integral that the following inequality holds:
[TABLE]
At the same time, the condition of strict negativity of the function implies the corresponding inequality for the integral:
[TABLE]
But, in that case, from the inequalities (14) and (15), we obtain
[TABLE]
Thus, in both cases in which the function does not change sign, using condition (8), we obtain inequality (6) expressed as (12) and (16).
The first assertion of Lemma 1 is proved.
The second assertion of the lemma (inequality (7)) is proved in a similar way, .
The proof of Lemma 1 is complete.
Let us pass to the proof of the main assertion of the theorem.
Proof of Theorem 1.
Suppose that the test function attains its global maximum at the point . This assumption implies the estimate
[TABLE]
Then the function satisfies the assumptions of Lemma 1. Applying this lemma, we obtain the inequality of the form (6):
[TABLE]
Consider the degenerate probability measure , concentrated at the point . By the property of the integral, for any fixed value of the parameter , the following equalities hold:
[TABLE]
whence
[TABLE]
By assumption, the pair is the point of global maximum of the function . Hence, in view of (19), it follows that, for any fixed value of ,
[TABLE]
It follows from inequality (18) that the set of values of the functional is bounded above for all , . But, in that case, this set has a finite upper bound [11] that satisfies the inequality
[TABLE]
Since , in view of the upper bound property [11], we can write
[TABLE]
for any fixed measure .
In particular, for , we have
[TABLE]
At the same time, . Then, by the above-mentioned upper bound property, we have
[TABLE]
Under the assumption of the theorem, . Then by the upper bound property [11], for any fixed , the following inequality holds:
[TABLE]
whence
[TABLE]
Note additionally that the relations , hold. Then, by the definition of the upper bound,
[TABLE]
Using relation (21), (22), (23), (24), (25) simultaneously, we obtain
[TABLE]
It follows from relations (26) that the upper bound for the functional on the set , is attained for , and the following equality holds:
[TABLE]
In this case, the upper bound is the maximum of the functional under study with respect to the set , .
Thus, we have
[TABLE]
The first assertion of the theorem is proved.
The second assertion is proved in a similar way.
The proof of Theorem 1 is complete.
Now we shall study the solution of the extremal problem (3) for the variants in which the test function of the linear-fractional integral functional (2) does not attain its global extremum.
Theorem 2**.**
Suppose that the main objects in the extremal problem (3) satisfy conditions 1, 3 and the function is strictly of constant sign (strictly positive or strictly negative) We also assume that the test function is bounded (above or below), but does not attain its global extremum (maximum or minimum) on the set .
Then the following assertions hold:**
If the test function is bounded above and does not attain its global maximum, then, for any given , there exists a pair such that the following inequality holds:**
[TABLE]
where is a degenerate probability measure concentrated at the point . 2. 2.
If the test function is bounded below and does not attain its global minimum, then, for any given , there exists a pair such that the following inequality holds:**
[TABLE]
where is a degenerate probability measure concentrated at the point .
Note that assertions 1 and 2 may hold either separately for the upper and lower bounds or simultaneously for both bounds.
Proof of Theorem 2..
The following auxiliary statement holds.
Lemma 2**.**
Suppose that the assumptions of Theorem 1 hold;* however, at the same time, the test function is bounded above or below, but does not attain its global extremum on the set of values of the arguments . Then the linear-fractional integral functional is also bounded above or below and the following relations hold*:**
[TABLE]
if the test function is bounded above or
[TABLE]
if the test function is bounded below.
Relations (29) and (30) given above may hold either separately for the upper and lower bounds of the values of the functional , or simultaneously for both bounds.
Proof of Lemma 2.
Suppose that the following condition holds:
[TABLE]
but, at the same time, the function does not attain its maximum value on the set . As is well known if the set is bounded above, then it has a finite upper bound [11] and the following relation holds:
[TABLE]
Using the assertion of Lemma 1, from (31) we obtain
[TABLE]
whence, by the upper bound property,
[TABLE]
At the same time, by the property of the integral
[TABLE]
where is a fixed point and is a degenerate probability measure concentrated at the point .
It follows from relation (33) that
[TABLE]
Since , by the upper bound property for any fixed , we have
[TABLE]
whence
[TABLE]
Using relations (32), (34), (35), we can write
[TABLE]
whence we directly obtain relation (29). The second assertion of Lemma 2, i.e., relation (30) is proved in a similar way.
Let us now pass to the direct proof of Theorem 2. We consider the variant in which the test function is bounded above, but does not attain its global maximum on the set . Then the first assertion of Lemma 2 holds, i.e., relation (29). Let us fix an arbitrary . Then, by the upper bound property, there exists an , such that the following inequality holds:
[TABLE]
Let denote a degenerate probability measure concentrated at the point . Then, by the property of the integral, we have
[TABLE]
From relations (29), (36), (37), we obtain (27), i.e., the first assertion of Theorem 2. The second assertion of this theorem (relation (28)) is proved in a similar way, using the second assertion of Lemma 2.
The proof of Theorem 2 is complete.
The theoretical value of Theorem 2 consists in the fact that if the test function of the linear-fractional integral functional is bounded, but does not attain its extremum, then, for any given , there exists an -optimal deterministic control strategy determined by the values of , for the maximum problem or by the values of for the of minimum problem.
Let us pass to the formulation and proof of another statement related to the extremal problem for a linear-fractional integral functional depending on a parameter.
Theorem 3**.**
We assume that the main objects in the extremal problem (3) satisfy the conditions 1, 3 and the function is of constant sign (strictly positive or strictly negative). We also assume that the test function is not bounded (above or below). Then the corresponding linear-fractional integral functional is also not bounded above or below and the following assertions hold:
There exists a sequence , , , , such that
[TABLE]
if the test function is not bounded above. 2. 2.
There exists a a sequence , , , , such that
[TABLE]
if the test function is not bounded below.
If the test function is bounded above and does not attain its global maximum, then, for any given , there exists a pair , such that the inequality holds.
Proof.
Suppose that the test function is not bounded above. Then there exists a sequence of pairs of points , , , , for which , . Consider the sequence of degenerate probability measures concentrated at the points . By the property of the integral with respect to a degenerate measure, we have
[TABLE]
and so relation (38) is proved.
Relation (39) can be established in a similar way.
The proof of Theorem 3 is complete.
By Theorem 3, if the test function of the linear-fractional integral functional is not bounded above or below, then the solution of the corresponding unconditional extremum (maximum or minimum) problem does not exist.
3 Conclusions
In this paper, we have proved three theorems whose assertions determine the solution of the unconditional extremal problem for a linear-fractional integral functional depending on a parameter. It is established that the solutions of the extremal problem are completely defined by the properties of the test function. The results obtained generalize statements from [1], [2] on the unconditional extremum of a fractional linear integral functional to the case where the test function is independent of the optimization parameter. The given results can be used to solve various applied stochastic control problems in which the analytic structure of the objective functional is described by a fractional linear integral functional.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] P. V. Shnurkov, “Solution of the unconditional extremum problem for a linear-fractional integral functional on a set of probability measures,” Dokl. Math. 94 (2) 550–554 (2016).
- 2[2] P. V. Shnurkov, A. K. Gorshenin, and V. V. Belousov, “Analytic solution of the problem of the optimal control of a semi-Markov process with finite set of states,” Informatika i Prilozh. 10 (4) 72–88 (2016).
- 3[3] E. B. Bajalinov, Linear-Fractional Programming. Theory, Methods, Applications, and Software (Kluwer Academic Publ., Boston–Dordrecht–London, 2003).
- 4[4] M. Borza, A. Rambely, and M. Saraj “Solving linear-fractional programming problems with interval coefficients in the objective function. A new approach,” Appl. Math. Sci. 6 (69), 3443–3452 (2012).
- 5[5] V. Joshi, E. Singh, and N. Gupta, “Primal-dual approach to solve linear fractional programming problem,” J. Appl. Math., Stat. Inform. (JAMSI) 4 (1), G 1–G 9 (2008).
- 6[6] M. Hasan and S. Acharjee, “Solving LFP by converting it into a single LP,” Int. J. Oper. Res. 8 (1), 1–14 (2011).
- 7[7] E. Yu. Barzilovich and V. A. Kashtanov, Mathematical Questions of the Maintenance Theory of Complicated Systems (Sov. Radio, Moscow, 1971).
- 8[8] Questions of Mathematical Reliability Theory , Ed. by B. V. Gnedenko (Radio i Svyaz’, Moscow, 1983).
