- Research
- Open access
- Published:
Characterization of quadratic growth of extended-real-valued functions
Journal of Inequalities and Applications volume 2016, Article number: 29 (2016)
Abstract
This paper shows that the sharpest possible bound in the second-order growth condition of a proper lower semicontinuous function can be attained under some assumptions. We also establish a relationship among strong metric subregularity, quadratic growth, the positive-definiteness property of the second-order subdifferential/generalized Hessian, the strong metric regularity, and tilt stability in a finite-dimensional setting.
1 Introduction
This work is devoted to studying the relationships among strong metric subregularity, the quadratic growth condition, strong metric regularity, and the positive-definiteness property of the second-order subdifferential/generalized Hessian in finite and infinite-dimensional settings.
It is well known in nonlinear optimization that the quadratic growth conditions of extended-valued functions play a central role (see, e.g., [1–3]). In a nonsmooth setting, various metric regularity properties of the subdifferential of a lower semicontinuous convex function acting in a Hilbert space were established by Aragón Artacho and Geoffroy [4] in terms of the quadratic growth condition. Later, motivated by some results in [5], Aragón Artacho and Geoffroy [6] extended their characterizations from [4] to convex functions defined on arbitrary Banach spaces and pointed out that if the subgradient mapping ∂f of a proper l.s.c. convex function f defined on a Banach space is strongly metrically subregular at \((\bar{x}, \bar{x}^{*})\) with modulus \(\kappa>0\), then the following quadratic growth condition holds:
where \(c\in(0,\frac{1}{2\kappa})\) and U is a neighborhood of x̄. They raised the question whether the bound of the constant in the quadratic growth condition (1) may be improved (see [6], Remark 3.2). Drusvyatskiy et al. [7] extended the characterizations from [6] to proper lower semicontinuous functions defined on Asplund spaces and gave an affirmative answer to the above question via showing that the constant c in (1) can be chosen arbitrarily in \((0,\frac{1}{\kappa})\).
In other lines of development, in [8], the second-order subdifferential/generalized Hessian is used to characterize the tilt-stable local minimizers introduced by Poliquin and Rockafellar [8] for prox-regular and subdifferentially continuous functions on \(\mathbb {R}^{n}\). Later, Mordukhovich and Nghia [5] extended this characterization to the settings of Hilbert spaces by using a new notion of the combined second-order subdifferential. Quite recently, Drusvyatskiy et al. [7] extended the known equivalences between metric regularity and the strong metric regularity properties of the gradient mappings for \(\mathcal{C}^{2}\)-smooth functions, characterized via the classical Hessian, to the general class of prox-regular and subdifferentially continuous functions on \(\mathbb {R}^{n}\) in terms of the second-order subdifferential/generalized Hessian.
The current work aims to achieve new results in the aforementioned directions by improving the known characterizations. After recording in Section 2 the necessary definitions and facts that will be needed throughout the manuscript, we devote Section 3 to characterizations of the second-order growth condition of a proper lower semicontinuous function. Theorem 3.1 provides a sufficient condition which allows strong metric subregularity with modulus κ to imply the second-order growth condition with the constant \(c=1/\kappa\). Theorem 3.2 gives a sufficient condition for metric subregularity in a nonconvex setting. In Section 4, in finite-dimensional setting, we establish an equivalence among strong metric subregularity, quadratic growth, the positive-definiteness property of the second-order subdifferential/generalized Hessian, the strong metric regularity and tilt stability, and we show that the constant c in the quadratic growth condition can attain \(1/\kappa\) (Theorem 4.2).
2 Preliminaries
In this section, we summarize some of the fundamental tools used in variational analysis and nonsmooth optimization. Readers can refer [9–12] for more details. Throughout this paper, unless otherwise stated, X and Y are Banach spaces. The symbol → always denotes the convergence relative to the norm while the symbol \(\stackrel{w^{*}}{\rightarrow}\) signifies the weak∗ convergence in the dual space \(X^{*}\). The closed ball centered at \(x\in X\) of radius r is denoted by \(\mathbb {B}_{r}(x)\). We denote by \(\mathbb {R}_{--}\) the set \(\{x\in \mathbb {R} \mid x<0\}\). The distance function associated with a nonempty set \(\Omega\in X\) is defined by
Let \(F : X \rightrightarrows Y\) be a set-valued mapping between Banach spaces X and Y. The domain and graph are defined by
and
respectively. For a mapping \(F : X \rightrightarrows X^{*}\) between a Banach space X and its dual \(X^{*}\) we define the sequential Painlevé-Kuratowski outer limit by
Our study is focused on two key notions: metric subregularity and strong metric subregularity. They plays an important role in stability analysis. For more details, one can refer to the references [13–17]. They are defined as follows.
Definition 2.1
A mapping \(F : X \rightrightarrows Y\) is said to be metrically subregular at x̄ for ȳ if \(\bar{y} \in F(\bar{x})\) and there is a positive constant κ along with a neighborhood U of x̄ such that
Definition 2.2
A mapping \(F : X \rightrightarrows Y\) is said to be strongly (metrically) subregular at x̄ for ȳ if \(\bar{y} \in F(\bar{x})\) and there is a positive constant κ along with a neighborhood U of x̄ such that
We notice that the strong metric subregularity of F at x̄ for ȳ is equivalent to the metric subregularity if x̄ is an isolated point of \(F^{-1}(\bar{y})\).
For an extended-real-valued function \(f : X \rightarrow\bar{\mathbb {R}}:= (-\infty;+\infty]\), we define the domain of f to be
In this paper, unless otherwise stated, we assume that all the extended-real-valued functions are proper, i.e., not identically equal to +∞, and lower semicontinuous (l.s.c.) on X.
The fundamental tools for studying general nonsmooth functions are subdifferentials. The following two subdifferential notions are used in this paper.
Definition 2.3
(Subdifferentials of functions)
Let \(f : X \rightarrow\bar{\mathbb {R}}\) and \(\bar{x} \in\operatorname {dom} f\).
-
The regular/Fréchet subdifferential of f at x̄ is
$$ \hat{\partial}f(\bar{x}):=\biggl\{ x^{*}\in X^{*} \Bigm| \liminf_{x\rightarrow\bar{x}} \frac{f(x)-f(\bar{x})-\langle x^{*},x-\bar {x}\rangle}{\|x-\bar{x}\|}\ge0\biggr\} . $$(5) -
The (basic, limiting, Mordukhovich) subdifferential of f at x̄ is defined via (2) by
$$ \partial f(\bar{x}):=\mathop{\operatorname{Lim}\sup}_{x\stackrel{f}{\rightarrow}\bar{x}}\hat {\partial}f(x), $$(6)where the symbol \(x\stackrel{f}{\rightarrow}\bar{x}\) means that \(x \rightarrow \bar{x}\) with \(f(x) \rightarrow f(\bar{x})\).
When f is convex, \(\partial f(x)\) is the usual subgradient set of convex analysis. When f is smooth, \(\partial f(x)\) is the singleton \({\nabla f(x)}\).
Definition 2.4
Given a subset \(K\subset X\) and a point \(x\in K\). The contingent cone of K at x is defined by
Definition 2.5
(Normal cone)
Let there be given a subset \(K\subset X\) and a point \(\bar{x}\in K\).
-
The regular/Fréchet normal cone of K at x̄ is defined by
$$ \hat{N}_{K}(\bar{x}):=\biggl\{ x^{*}\in X^{*} \Bigm| \limsup _{x\stackrel{K}{\rightarrow}\bar {x}}\frac{\langle x^{*},x-\bar{x}\rangle}{\|x-\bar{x}\|}\leq0\biggr\} , $$(7)where \(x\stackrel{K}{\rightarrow}\bar{x}\) signifies the convergence \(x \rightarrow\bar{x}\) with \(x \in K\).
-
The limiting normal cone of f at x̄ is defined via (2) by
$$ N_{K}(\bar{x}):=\mathop{\operatorname{Lim}\sup}_{x\stackrel{K}{\rightarrow}\bar{x}} \hat{N}_{K}(x). $$(8)
When K is convex, \(N_{K}(\bar{x})=\hat{N}_{K}(\bar{x})\). Let \(C\subset X\) be a cone, we denote by
its polar cone. Bonnans and Shapiro [1] pointed out that \(\hat{N}_{K}(\bar {x})=[T_{K}(\bar{x})]^{-}\) if X is a finite-dimensional space. Applying the last two notions to the subdifferential mapping \(\partial f : X \rightrightarrows X^{*}\) for an extended-real-valued function f yields the combined second-order subdifferential of f at \((\bar{x},\bar{x}^{*})\) introduced in [7] by
and the second-order subdifferential (or generalized Hessian) of f at \((\bar{x},\bar{x}^{*})\) introduced in [18] by
Note that
if \(f\in\mathcal{C}^{2}\), where \(\nabla^{2}f(\bar{x})^{*}=\nabla^{2}f(\bar {x})\) in the case of Hilbert spaces X.
In order to characterize the relationships between the quadratic growth conditions and metric subregularity of the subdifferentials in nonsmooth and nonconvex settings, we need the following two notions, which were introduced in [19] and were further studied in [20] and [21].
Definition 2.6
Let \(f : X \rightarrow\bar{\mathbb {R}}\) and \(\bar{x} \in\operatorname {dom} f\). We say that f is prox-regular at x̄ for \(\bar{v}\in\partial f(\bar{x})\) if there exist \(\varepsilon> 0\) and \(r \geq0\) such that
whenever \(x\in \mathbb {B}_{\varepsilon}(\bar{x})\), \(|f(x)-f(\bar {x})|<\varepsilon\), and \(v \in\partial f(x)\) with \(\|v-\bar{v}\| <\varepsilon\). If this holds for every \(\bar{v}\in\partial f(\bar {x})\), we say that f is prox-regular at x̄.
Definition 2.7
A function \(f : X \rightarrow\bar{\mathbb {R}}\) is subdifferentially continuous at \(\bar{x} \in\operatorname{dom} f\) for \(\bar{v}\in\partial f(\bar{x})\) if for every \(\varepsilon> 0\) there exists \(\delta> 0\) such that \(|f(x)-f(\bar{x})|<\varepsilon\) whenever \(x\in \mathbb {B}_{\delta}(\bar{x})\) and \(\|v-\bar{v}\| <\delta\) with \(v \in\partial f(x)\). If this occurs for all \(\bar {v}\in\partial f(\bar{x})\), we say that f is subdifferentially continuous at x̄.
3 Characterizing quadratic growth properties
The main focus of this section is relating the quadratic growth properties of a function f to the subregularity of the subdifferential ∂f.
In the convex case, Aragón Artacho and Geoffroy [6] gave a condition
where U is a neighborhood of point \(\bar{x}\in X\), \(c>0\), and \(\lambda\in(0,1)\), which allows the convex subdifferential to be strongly metrically subregular at any \((\bar{x},\bar{x}^{*})\in\operatorname {gph}\partial f\).
It will be showed in the next theorem that a condition similar to (13) guarantees that the upper bound \(\frac{1}{\kappa }\) in (1) can be attained.
Theorem 3.1
Let there be given \(f : X \rightarrow\bar{\mathbb {R}}\) and \((\bar {x}, \bar{x}^{*}) \in\operatorname{gph} \partial f\). If the subdifferential ∂f is strongly metrically subregular at \((\bar{x}, \bar {x}^{*})\) with modulus \(\kappa> 0\), then the following two assertions are equivalent:
-
(i)
there are real numbers \(r\in(0,\kappa^{-1})\) and \(\delta >0\) such that
$$ f(x)\geq f(\bar{x})+\bigl\langle \bar{x}^{*},x-\bar{x}\bigr\rangle - \frac {r}{2}\|x-\bar{x}\|^{2} \quad \textit{for all } x\in \mathbb {B}_{\delta}(\bar{x}), $$(14) -
(ii)
for any real number \(\alpha\in(0,\kappa^{-1})\), there is a real number \(\eta>0\) such that
$$ f(x)\geq f(\bar{x})+\bigl\langle \bar{x}^{*},x-\bar{x}\bigr\rangle + \frac {\alpha}{2}\|x-\bar{x}\|^{2}\quad \textit{for all } x\in \mathbb {B}_{\eta }(\bar{x}). $$(15)
Furthermore, if there is a neighborhood U of x̄ such that for all \(x \in U\), \(\lambda\in(0, 1)\),
then (i) or (ii) can imply the following:
-
(iii)
there is a real number \(\theta>0\) such that
$$ f(x)\geq f(\bar{x})+\bigl\langle \bar{x}^{*},x-\bar{x}\bigr\rangle + \frac {1}{2\kappa}\|x-\bar{x}\|^{2} \quad \textit{for all } x\in \mathbb {B}_{\theta }(\bar{x}). $$(17)
Proof
The proof of the equivalence (i) ⇔ (ii) appears implicitly in [7], Corollary 3.3. Now, we show the implication (ii) ⇒ (iii). Suppose that assertion (iii) is not true, then for any positive integer k such that \(\mathbb {B}_{\frac{1}{k}}(\bar{x})\subset U\), there is an \(x_{k}\in \mathbb {B}_{\frac{1}{k}}(\bar{x})\) such that
One can pick a positive number \(\varepsilon_{k}\) such that
Since (ii) holds, for some real number \(\kappa^{-1}-\varepsilon _{k}<\alpha_{k}<\kappa^{-1}\), there is a real number \(\eta_{k}>0\) such that
Next, we show that
for all \(x=\lambda x_{k}+(1-\lambda)\bar{x}\) with \(\lambda\in(0,1)\). Define
It follows from (16) and (19) that, for all \(\lambda\in(0,1)\),
hence, inequality (21) holds for all \(x=\lambda x_{k}+(1-\lambda)\bar{x}\) with \(\lambda\in(0,1)\), which contradicts the inequality (20) and thus completes the proof of the theorem. □
Remark 3.1
-
(i)
The condition (16) is a sufficient condition for (17). For example, for \(x=(x_{1},x_{2})\in \mathbb {R}^{2}\), consider the function
$$f(x):= \textstyle\begin{cases} +\infty,&x_{1}=x_{2}\neq0, \\ \frac{1}{2}\|x\|^{2},&\text{otherwise}. \end{cases} $$Obviously, f is not convex, and the subdifferential ∂f is strongly metrically subregular at \((\bar{x}, \bar{x}^{*})=(\mathbf{0}, \mathbf{0})\in\operatorname{gph} \partial f\) with modulus \(\kappa=1\). Furthermore, we observe that, for any neighborhood U of \(\bar{x}=(0,0)\) and \(\lambda\in(0, 1)\), the condition (16) holds. On the other hand, we see that (17) holds at \((\bar{x}, \bar {x}^{*})=(\mathbf{0}, \mathbf{0})\).
-
(ii)
The condition (16) is only a sufficient condition for (17). Consider the real function \(f(x)=|x|\). We observe that the subgradient mapping ∂f is a strongly metrically subregular at \(\bar{x}=0\) for \(\bar{x}^{*}=0\) with any \(\kappa>0\), and inequality (17) is satisfied at \((0,0)\). However, the inequality (16) does not hold.
-
(iii)
We observe that the bound \(\alpha= \kappa^{-1}\) in (15) is the sharpest possible bound. To illustrate this, consider the real function \(f(x)=\frac{1}{2}x^{2}\). We observe that the subgradient mapping ∂f is strongly metrically subregular at \(\bar{x}=0\) for \(\bar{x}^{*}=0\) with modulus \(\kappa=1\), and inequality (15) is satisfied at \((0,0)\) for \(\alpha= \kappa^{-1}\). However, inequality (15) is false at \((0,0)\) for any \(\alpha>\kappa^{-1}\).
-
(iv)
Notice that condition (16) is weaker than the strong convexity of f in U, because the strong convexity entails the condition that there exists a constant c such that, for all \(x_{1}, x_{2} \in U\) and \(\lambda\in(0, 1)\),
$$ f\bigl(\lambda x_{1}+ (1-\lambda)x_{2}\bigr) \leq\lambda f(x_{1})+(1-\lambda) f(x_{2})-c\lambda(1-\lambda) \|x_{1}-x_{2}\|^{2}. $$(23)
In a nonconvex setting, Drusvyatskiy et al. [7] showed that the quadratic growth property (15) holds if the subdifferential ∂f is metrically subregular at \((\bar {x},\bar{x}^{*})\) with \(\kappa^{-1}>0\) and the inequality (14) holds. Furthermore, we have an additional uniformity condition: there exists \(\beta\in[0,\alpha)\) such that
which together with (15) implies that the subdifferential ∂f is strongly metrically subregular. We notice that the quadratic growth property of a proper lower semicontinuous function f can also hold if we substitute the strong metric subregularity of ∂f with a condition similar to (13). More precisely, we have the following theorems.
Theorem 3.2
Let there be given \(f : X \rightarrow\bar{\mathbb {R}}\), \((\bar{x}, \bar{x}^{*}) \in\operatorname{gph} \partial f\), and \(\kappa> 0\). If there are real numbers \(r\in(0,\kappa^{-1})\) and \(\theta>0\) such that
and for any real number \(\alpha\in(0,\kappa^{-1})\), there is a positive real number μ such that, for all \(x \in \mathbb {B}_{\mu }(\bar{x})\) and \(\lambda\in(0, 1)\),
then there is a real number \(\eta>0\) such that
Furthermore, if there are a real number \(\beta\in(0,\alpha)\) and a positive real number δ such that
then the subdifferential ∂f is metrically subregular at \((\bar{x}, \bar{x}^{*})\).
Proof
Let \(\vartheta=\min\{\theta,\mu\}\). It follows from (26) that, for all \(x \in \mathbb {B}_{\vartheta}(\bar{x})\) and \(\lambda \in(0, 1)\),
i.e.,
Moreover, by (25),
which together with the inequality (29) gives
Letting \(\lambda\uparrow1\) in this inequality, we obtain (27). By applying Theorem 3.1 of [7], it follows from (27) and (28) that the subdifferential ∂f is metrically subregular at \((\bar{x}, \bar{x}^{*})\). □
Furthermore, it is easy to observe the following consequence of Theorem 3.2 concerning the strong metric subregularity of the subdifferential.
Corollary 3.1
Let there be given \(f : X \rightarrow\bar{\mathbb {R}}\), \((\bar{x}, \bar{x}^{*}) \in\operatorname{gph} \partial f\), and \(\kappa> 0\). If there are real numbers \(r\in(0,\kappa^{-1})\) and \(\theta>0\) such that
and for any real number \(\alpha\in(0,\kappa^{-1})\), there is a positive real number μ such that for all \(x \in \mathbb {B}_{\mu }(\bar{x})\) and \(\lambda\in(0, 1)\),
then there is a real number \(\eta>0\) such that
Furthermore, if there are a real number \(\beta\in(0,\alpha)\) and a positive real number δ such that
then we see that the subdifferential ∂f is strongly metrically subregular at \((\bar{x}, \bar{x}^{*})\).
The conditions (25) and (28) can be weakened, if we strengthen slightly the condition (26). More specifically, we have the following result.
Theorem 3.3
Let there be given \(f : X \rightarrow\bar{\mathbb {R}}\), \((\bar{x}, \bar{x}^{*}) \in\operatorname{gph} \partial f\), and \(\kappa> 0\). If there are real numbers \(r\in(0,\kappa^{-1})\) and \(\theta>0\) such that
and for any real number \(\alpha\in(0,\kappa^{-1})\), there is a positive real number μ such that for all \(x \in \mathbb {B}_{\mu }(\bar{x})\) and \(\lambda\in(0, 1)\),
then there is a real number \(\eta>0\) such that
Furthermore, if there are a real number \(\beta\in(0,\alpha)\) and a positive real number δ such that
then the subdifferential ∂f is metrically subregular at \((\bar{x}, \bar{x}^{*})\).
Proof
Let \(\vartheta=\min\{\theta,\mu\}\). For all \(x \in \mathbb {B}_{\vartheta}(\bar{x})\) and \(\lambda\in(0, 1)\), the inequality (36) gives
It follows from (37) that, for all \(x \in \mathbb {B}_{\vartheta}(\bar{x})\) and \(\lambda\in(0, 1)\),
which together with the inequality (40) gives
Letting \(\lambda\uparrow1\) in this inequality, we have
which implies (38).
Furthermore, letting \(\varepsilon=\min\{\vartheta,\delta\}\), it follows from (39) and (43) that, for all \((x,x^{*})\in\operatorname{gph} \partial f\cap \mathbb {B}_{\varepsilon}(\bar {x},\bar{x}^{*})\),
which implies
Thus the subdifferential ∂f is metrically subregular at \((\bar{x}, \bar{x}^{*})\). □
4 Second-order characterizations of quadratic growth properties
In this section, we characterize the quadratic growth properties by the second-order subdifferential (or generalized Hessian) defined in (10). To motivate the subsequent discussion, we first review the standard second-order optimality condition and restate it in terms of the gradient itself. The proof of the following proposition is similar to [22], Proposition 5.1.
Proposition 4.1
Consider a \(\mathcal{C}^{2}\)-smooth function f on \(\mathbb {R}^{n}\) and let x̄ be a local minimizer of f. Then the following conditions are equivalent:
-
(i)
the gradient mapping ∇f is strongly metrically subregular at \((\bar{x},0)\),
-
(ii)
the Hessian matrix \(\nabla^{2} f(\bar{x})\) is positive definite.
Proof
Since f is \(\mathcal{C}^{2}\)-smooth, we have
and hence
where the symbol I denote the identity mapping. If the Hessian matrix \(\nabla^{2} f(\bar{x})\) is positive definite, there are a real number \(\varepsilon>0\) and a positive real number λ which is slightly smaller than the minimal eigenvalue of \(\nabla^{2} f(\bar{x})\) such that
It follows from the last inequality that
which verifies the gradient mapping ∇f is strongly metrically subregular at \((\bar{x},0)\) with modulus \(\lambda^{-1}\). Hence the implication (ii) ⇒ (i) holds.
To show the implication (i) ⇒ (ii), suppose the gradient mapping ∇f is strongly metrically subregular at \((\bar{x},0)\) with \(\kappa>0\), then there is a real number \(\delta >0\) such that
which implies that one can pick a real number \(r\in[0,\frac {1}{2\kappa})\) such that
Hence there exists a positive real number μ such that
If the Hessian matrix \(\nabla^{2} f(\bar{x})\) is not positive definite, then there is an eigenvalue \(\bar{\lambda}=0\) and a corresponding eigenvector \(v\in \mathbb {R}^{n}\) with \(\|v\|=1\). Let \(x_{t}=\bar{x}+tv\), then \(x_{t}\in \mathbb {B}_{\delta}(\bar{x})\) when t is small enough. It follows from (44) that
which is a contradiction and thus completes the proof. □
In a nonsmooth setting, it is natural to use a second-order subdifferential construction. The next theorem establishes a relationship among the strong metric subregularity, the quadratic growth condition, and the positive-definiteness property of the combined second-order subdifferential for a prox-regular and subdifferentially continuous function. Its proof technique follows [6], Corollary 3.7.
Definition 4.1
Let there be given \(f: \mathbb {R}^{n} \rightarrow\bar{\mathbb {R}}\) and \((\bar{x}, \bar{x}^{*}) \in\operatorname{gph} \partial f\). We say that f is contingent-normal at x̄ for \(\bar{x}^{*}\) if the following property holds: for a vector \(u\in \mathbb {R}^{n}\), if there exists a vector \(w^{*}\) such that \((u,w^{*})\in T_{\operatorname{gph}\partial f}(\bar{x}, \bar{x}^{*})\), then there is a vector \(u^{*}\) such that \((u^{*},-u)\in\hat{N}_{\operatorname{gph}\partial f}(\bar{x}, \bar{x}^{*})\).
Definition 4.2
Let there be given \(f: \mathbb {R}^{n} \rightarrow\bar{\mathbb {R}}\) and \((\bar{x}, \bar{x}^{*}) \in\operatorname{gph} \partial f\). We say that f is normal-contingent at x̄ for \(\bar{x}^{*}\) if the following property holds: for a vector \(u\in \mathbb {R}^{n}\), if there exists a vector \(u^{*}\) such that \((u^{*},-u)\in\hat{N}_{\operatorname {gph}\partial f}(\bar{x}, \bar{x}^{*})\), then there is a vector \(w^{*}\) such that \((-u,-w^{*})\in T_{\operatorname{gph}\partial f}(\bar{x}, \bar{x}^{*})\).
Remark 4.1
We observe that the assumptions in Definition 4.1 and Definition 4.2 can be satisfied automatically by many functions. For instance, if \(\operatorname{gph}\partial f\) has the form of the following set:
then the function f is contingent-normal and normal-contingent at any point \((\bar{x}, \bar{x}^{*}) \in\operatorname{gph} \partial f\). For example, consider the real-valued function
Then \(\nabla f(x)=|x|\) and
which is a form of (45). Take \((\bar{x}, \bar {x}^{*})=(0,0)\), we have
It is easy to verify that this function f is contingent-normal and normal-contingent at \((0, 0)\).
Theorem 4.1
Let there be given \(f: \mathbb {R}^{n} \rightarrow\bar{\mathbb {R}}\) and \((\bar{x}, \bar{x}^{*}) \in\operatorname{gph} \partial f\). Assume f is prox-regular at x̄ for \(\bar{x}^{*}\) with \(r>0\) and subdifferentially continuous at x̄ for \(\bar{x}^{*}\). Consider the following three statements:
-
(i)
the subdifferential ∂f is strongly metrically subregular at \((\bar{x}, \bar{x}^{*})\) with modulus \(\kappa>0\),
-
(ii)
there exist a neighborhood U of x̄ and a positive constant \(\alpha>r\) such that
$$ f(x)\geq f(\bar{x})+\bigl\langle \bar{x}^{*},x-\bar{x}\bigr\rangle + \frac {\alpha}{2}\|x-\bar{x}\|^{2}\quad \textit{for all } x\in U, $$(46) -
(iii)
there is a constant \(c>0\) such that the combined second-order subdifferential \(\breve{\partial}^{2} f(\bar{x}, \bar {x}^{*})\) is positive-definite in the sense that
$$ \bigl\langle u^{*},u\bigr\rangle \geq c\|u\|^{2} \quad \textit{for all } u\in X \textit{ and } u^{*}\in\breve{\partial}^{2} f \bigl(\bar{x}, \bar{x}^{*}\bigr) (u). $$(47)
Then implication (i) ⇒ (ii) holds when \(\kappa ^{-1}>r\). Implication (ii) ⇒ (iii) holds with \(c=\frac{\alpha-r}{2}\) if f is normal-contingent at x̄ for \(\bar{x}^{*}\). Furthermore, (iii) ⇒ (i) holds with \(\kappa>\frac{1}{c}\) if f is contingent-normal at x̄ for \(\bar{x}^{*}\).
Proof
The implication (i) ⇒ (ii) has been established in [23], Theorem 12. Next, we show the implication (iii) ⇒ (i). Our immediate goal now is to show that for any \(\kappa> 1/c\), there are some neighborhoods U of x̄ and V of \(\bar{x}^{*}\) such that
If it is not the case, then for all \(n\in \mathbb {N}\) there is \((x_{n},x^{*}_{n})\in\operatorname{gph}\partial f\) with \(\|x_{n}-\bar{x}\|\leq\frac {1}{n}\), \(\|x^{*}_{n}-\bar{x}^{*}\|\leq\frac{1}{n}\) and such that \(\|x_{n}-\bar{x}\|> \kappa\|x^{*}_{n}-\bar{x}^{*}\|\). This implies \(x_{n} \neq \bar{x}\) for all n, hence the bounded sequence \((\frac{x_{n}-\bar {x}}{\|x_{n}-\bar{x}\|},\frac{x^{*}_{n}-\bar{x}^{*}}{\|x_{n}-\bar{x}\|})\) must have a convergent subsequence. Without loss of generality, we may assume that the sequence \((\frac {x_{n}-\bar{x}}{\|x_{n}-\bar{x}\|},\frac{x^{*}_{n}-\bar{x}^{*}}{\|x_{n}-\bar {x}\|})\) is convergent, hence there are some points u and \(w^{*}\) with
Since f is contingent-normal at x̄ for \(\bar{x}^{*}\), there is a vector \(u^{*}\) such that \((u^{*},-u)\in\hat{N}_{\operatorname {gph}\partial f}(\bar{x}, \bar{x}^{*})=[T_{\operatorname{gph}\partial f}(\bar {x}, \bar{x}^{*})]^{-}\), i.e., \(u^{*}\in\breve{\partial}^{2} f(\bar{x}, \bar{x}^{*})(u)\), thus we have
this together with (47) gives \(\langle w^{*},u\rangle\geq c\| u\|^{2}\), thus we have
This is a clear contradiction, which shows condition (48) holds. Thus, the subdifferential ∂f is strongly metrically subregular at \((\bar{x}, \bar{x}^{*})\) with any constant \(\kappa> 1/c\).
Finally, we prove the implication (ii) ⇒ (iii). Since (ii) holds, there exist a neighborhood U of x̄ and a positive constant α such that (46) holds. Let \(u\in \mathbb {R}^{n}\) and consider \(u^{*}\in\breve{\partial}^{2} f(\bar{x}, \bar{x}^{*})(u)\), i.e., \((u^{*},-u)\in\hat {N}_{\operatorname{gph}\partial f}(\bar{x}, \bar{x}^{*})\). Since f is normal-contingent at x̄ for \(\bar{x}^{*}\), there is a vector \(w^{*}\) such that \((-u,-w^{*})\in T_{\operatorname{gph}\partial f}(\bar{x}, \bar {x}^{*})\), thus we have
and there are \((x_{n},x^{*}_{n})\in\operatorname{gph}\partial f\) and \(\tau _{n}\downarrow0\) with \((x_{n},x^{*}_{n})\rightarrow(\bar{x},\bar{x}^{*})\) and
Let \(x\in U\) and consider \(x^{*}\in\partial f(x)\), we have
this together with (46) gives
Since \(x_{n}^{*}\in\partial f(x_{n})\) and \(x_{n} \in U\) when n is large enough, one has
when n is large enough. Hence,
Letting \(n \rightarrow+\infty\) we have \(\langle w^{*},u\rangle\geq \frac{\alpha-r}{2}\|u\|^{2}\), this together with (50) yields \(\langle u^{*},u\rangle\geq\frac{\alpha-r}{2}\|u\|^{2}\), which justifies that the combined second-order subdifferential \(\breve {\partial}^{2} f(\bar{x}, \bar{x}^{*})\) is positive-definite and thus completes the proof of the theorem. □
In the following theorem, we establish an equivalence among the strong metric subregularity, the quadratic growth condition, the positive-definiteness property of the second-order subdifferential/generalized Hessian, the strong metric regularity, and tilt stability for a proper l.s.c. function acting in \(\mathbb {R}^{n}\).
Theorem 4.2
Consider a proper l.s.c. function \(f: \mathbb {R}^{n} \rightarrow\bar {\mathbb {R}}\) and a point \((\bar{x}, 0) \in\operatorname{gph} \partial f\). If f is normal-contingent at x̄ for \(\bar{x}^{*}=0\) and \(\operatorname{gph} \partial f\) is convex, then the following statements are equivalent:
-
(i)
the subgradient mapping ∂f is strongly metrically subregular at \((\bar{x}, 0)\) with \(\kappa>0\),
-
(ii)
there is a constant \(c>0\) such that the second-order subdifferential \(\partial^{2} f(\bar{x}, 0)\) is positive-definite in the sense that
$$ \bigl\langle u^{*},u\bigr\rangle \geq c\|u\|^{2}\quad \textit{for all } u\in X \textit{ and } u^{*}\in\partial^{2} f(\bar{x}, 0) (u), $$(51) -
(iii)
there exist neighborhoods U of x̄ and V of 0 such that for any \(u^{*}\in V\) there is a point \(u \in(\partial f)^{-1}(u^{*}) \cap U\) satisfying the inequality
$$ f(x)\geq f(u)+\bigl\langle u^{*},x-u\bigr\rangle +\frac{1}{2\kappa} \|x-u\|^{2}\quad \textit{for all } x\in U, $$(52) -
(iv)
the subgradient mapping ∂f is strongly metrically regular around \((\bar{x}, 0)\) with \(\kappa>0\),
-
(v)
the second-order subdifferential \(\partial^{2} f(\bar{x}, 0)\) is positive-definite in the sense that
$$ \bigl\langle u^{*},u\bigr\rangle >0 \quad \textit{for all } u\in X \textit{ and } u^{*}\in \partial^{2} f(\bar{x}, 0) (u), u\ne0, $$(53) -
(vi)
the point x̄ is a tilt-stable local minimizer of the function f.
Proof
Since \(\operatorname{gph} \partial f\) is convex, we have \(\hat {N}_{\operatorname{gph}\partial f}(\bar{x}, \bar{x}^{*})=N_{\operatorname {gph}\partial f}(\bar{x}, \bar{x}^{*})\). Thereby, \(\breve{\partial}^{2} f(\bar{x}, \bar{x}^{*})(u)=\partial^{2} f(\bar{x}, \bar{x}^{*})(u)\), which together with Theorem 4.1 shows that the implications (i) ⇒ (ii) holds. The equivalence among (iii), (iv), (v), and (vi) has been established by Drusvyatskiy et al. [7]. The implications (ii) ⇒ (v) and (iv) ⇒ (i) hold trivially. □
Remark 4.2
-
(i)
Under the assumptions of Theorem 4.2, we see that the constant c in the quadratic growth condition (1) can attain to \(\frac{1}{\kappa}\), and the strong metric subregularity is equivalent to the strong metric regularity.
-
(ii)
The assumption that \(\operatorname{gph} \partial f\) is convex is essential in the conclusion of Theorem 4.2. If this assumption fails, the equivalence between the strong metric subregularity and the strong metric regularity may be a failure. To illustrate it, take the real-valued function \(f(x)=|x|\), we observe that ∂f is strongly metrically subregular at \((0, 0)\) with any \(\kappa>0\) and f is normal-contingent at \(\bar{x}=0\) for \(\bar{x}^{*}=0\) as well as \(\operatorname{gph} \partial f\) is not convex. On the other hand, ∂f is not strongly metrically regular at \((0, 0)\).
References
Bonnans, JF, Shapiro, A: Perturbation Analysis of Optimization Problems. Springer, New York (2000)
Nocedal, J, Wright, SJ: Numerical Optimization. Springer Series in Operations Research and Financial Engineering. Springer, New York (2006)
Ruszczyński, A: Nonlinear Optimization. Princeton University Press, Princeton (2006)
Aragón Artacho, FJ, Geoffroy, MH: Characterization of metric regularity of subdifferentials. J. Convex Anal. 15(2), 365-380 (2008)
Mordukhovich, BS, Nghia, TTA: Second-order variational analysis and characterizations of tilt-stable optimal solutions in finite and infinite dimensions. Nonlinear Anal. 86, 159-180 (2013)
Aragón Artacho, FJ, Geoffroy, MH: Metric subregularity of the convex subdifferential in Banach spaces. J. Nonlinear Convex Anal. 15(1), 35-47 (2014)
Drusvyatskiy, D, Mordukhovich, BS, Nghia, TTA: Second-order growth, tilt stability and metric regularity of the subdifferential. J. Convex Anal. 21(4), 301-324 (2014)
Poliquin, RA, Rockafellar, RT: Tilt stability of a local minimum. SIAM J. Optim. 8(2), 287-299 (1998)
Borwein, JM, Zhu, QJ: Techniques of Variational Analysis. Springer, New York (2005)
Clarke, FH, Ledyaev, Y, Stern, RI, Wolenski, PR: Nonsmooth Analysis and Control Theory. Springer, New York (1998)
Penot, JP: Calculus Without Derivatives. Graduate Texts in Mathematics. Springer, New York (2013)
Rockafella, RT, Wets, RJB: Variational Analysis. Grundlehren der Mathematischen Wissenschaften. Springer, Berlin (1998)
Dontchev, AL, Rockafellar, RT: Implicit Functions and Solution Mappings: A View from Variational Analysis. Springer Monographs in Mathematics. Springer, Dordrecht (2009)
Drusvyatskiy, D, Lewis, AS: Tilt stability, uniform quadratic growth, and strong metric regularity of the subdifferential. SIAM J. Optim. 23(1), 256-267 (2013)
Ioffe, AD: Metric regularity and subdifferential calculus. Russ. Math. Surv. 55, 501-558 (2000)
Mordukhovich, BS: Variational Analysis and Generalized Differentiation. Volume I: Basic Theory. Springer, Berlin (2006)
Mordukhovich, BS: Variational Analysis and Generalized Differentiation. Volume II: Applications. Springer, Berlin (2006)
Mordukhovich, BS: Sensitivity analysis in nonsmooth optimization. In: Field, DA Komkov, V (eds.) Theoretical Aspects of Industrial Design. SIAM Proc. Applied Math., vol. 58, pp. 32-46 (1992)
Poliquin, RA, Rockafellar, RT: Second-Order Nonsmooth Analysis in Nonlinear Programming. World Scientific, Singapore (1995)
Poliquin, RA, Rockafellar, RT: Generalized Hessian properties of regularized nonsmooth functions. SIAM J. Optim. 6, 1121-1137 (1996)
Poliquin, RA, Rockafellar, RT: Prox-regular functions in variational analysis. Trans. Am. Math. Soc. 348(5), 1805-1838 (1996)
Drusvyatskiy, D, Ioffe, AD: Quadratic growth and critical point stability of semi-algebraic functions. Math. Program. 153(2), 635-653 (2015)
Wang, JJ, Song, W: Characterization of the strong metric subregularity of the Mordukhovich subdifferential on Asplund spaces. Abstr. Appl. Anal. 2014, Article ID 596582 (2014)
Acknowledgements
This work was supported by the National Natural Sciences Grant (No. 11371116).
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors contributed equally to the writing of this paper. All authors read and approved the final manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Wang, J.j., Song, W. Characterization of quadratic growth of extended-real-valued functions. J Inequal Appl 2016, 29 (2016). https://doi.org/10.1186/s13660-016-0977-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13660-016-0977-4