Theory Digest — Apr 26, 2026

1. Motivation: Optimal portfolio selection under stochastic volatility is challenging when model parameters are unknown. Reinforcement learning addresses this through exploration, but existing work lacks rigorous analysis combining stochastic volatility, portfolio constraints, and entropy-regularized exploration within nonlinear PDE frameworks.

2. Mathematical setup: Consider probability space $(\Omega, F^0_T, (F^0_t)_{0 \leq t \leq T}, P)$ with independent Brownian motions $(W_t)$, $(\bar{W}_t)$. Financial market has risk-free bond:

   \[dB_t = rB_t dt, \quad B_0 = 1\]

   and risky asset with stochastic volatility:

   \[\begin{cases}\] \[dS_t = \mu S_t dt + \sigma(y_t)S_t dW_t \\\] \[dy_t = \varpi(y_t)dt + \delta(y_t)dU_t\] \[\end{cases}\]

   where $U_t = \rho W_t + \sqrt{1-\rho^2}\bar{W}_t$.

   Exploratory wealth dynamics with policy $\lambda$ (probability density over $[\alpha,b]$):

   \[dX^\lambda_t = \left(r + (\mu-r)E[\lambda_t]\right)X^\lambda_t dt + \sigma(y_t)X^\lambda_t \left(E[\lambda_t]dW_t + \sqrt{\text{Var}(\lambda_t)}d\hat{W}_t\right)\]

   where $\hat{W}_t$ is independent exploration noise.

   Assumptions:

   1. Functions $\varpi, \delta$ are continuously differentiable with unique strong solution
   2. Portfolio constraints: $\pi \in [a,b]$ with $a < b$
   3. CRRA utility: $U(x) = \frac{x^{1-\eta}-1}{1-\eta}$ with $0 < \eta < 1$

3. Toy example: When $\eta = 1$ (logarithmic utility) and deterministic volatility $\sigma(y) = \sigma_0$, the problem reduces to the classical Merton case studied in prior work, but exploration adds truncated Gaussian policy structure.

4. Formal objective: Maximize entropy-regularized recursive utility:

   \[\sup_{\lambda \in H_{[a,b]}} E\left[\int_t^T e^{\int_t^s m(1-\eta)E(\lambda_u)du} mE(\lambda_s)ds + e^{\int_t^T m(1-\eta)E(\lambda_u)du}U(X^\lambda_T) \mid X^\lambda_t = x, y_t = y\right]\]

The method derives and solves the entropy-regularized Hamilton-Jacobi-Bellman equation. Key steps:

1. Derive HJB equation:

   \[\frac{\partial V}{\partial t} + \sup_{\lambda \in H_{[a,b]}}\left[A^\lambda V + mE(\lambda)[(1-\eta)V + 1]\right] = 0\]

   where $A^\lambda$ is the relaxed differential operator.

2. Characterize optimal policy using Varadhan-Donsker lemma. The optimizer is truncated Gaussian:

   \[\lambda^*_t(\pi|t,x,y) = \frac{1}{\beta}\frac{\phi\left(\frac{\pi-\alpha}{\beta}\right)}{\Phi\left(\frac{b-\alpha}{\beta}\right) - \Phi\left(\frac{a-\alpha}{\beta}\right)}\]

   with parameters:

   \[\alpha = \frac{-(\mu-r)xV_x - \rho\delta(y)\sigma(y)xV_{xy}}{\sigma^2(y)x^2V_{xx}}\] \[\beta^2 = \frac{-m[(1-\eta)V + 1]}{\sigma^2(y)x^2V_{xx}}\]

3. Transform via homothetic ansatz $V(t,x,y) = \frac{x^{1-\eta}e^{u(t,y)} - 1}{1-\eta}$, reducing to quasilinear PDE:

   \[u_t + r(1-\eta) + \frac{1}{2}\delta^2(y)(u_{yy} + u_y^2) + \varpi(y)u_y + \text{volatility terms} + (1-\eta)m\text{entropy terms} = 0\]

4. Prove existence of classical solutions using nonlinear PDE theory in Hölder spaces.

5. Establish verification theorem showing the candidate value function dominates all admissible policies.

   Applied to toy example: For logarithmic utility ($\eta = 1$) with constant volatility, the method recovers known results but with exploration-induced corrections to the classical Merton proportion.

Step 1 — Prior work:

1. “Continuous-time mean field games and stochastic control” (Carmona-Delarue 2018): established entropy-regularized control in complete markets
2. “Deep reinforcement learning for optimal investment” (Zhang et al. 2020): discrete-time RL for portfolio optimization without theoretical guarantees

3. “Entropy-regularized mean field games with common noise” (Guo-Hu-Tcheukam 2022): studied entropy regularization but not in finance/constraints setting

   Step 2 — Delta: This paper combines three elements rarely treated together:

4. stochastic volatility making markets incomplete
5. explicit portfolio constraints (compact control sets), and
6. rigorous nonlinear PDE analysis for entropy-regularized HJB equations. The key additions are:
   • Existence proof for quasilinear HJB equation under structural growth conditions
   • Characterization of optimal policy as truncated Gaussian with explicit parameters
   • Verification theorem establishing dynamic programming principle
   • Asymptotic expansion showing exploration effects

   Step 3 — Theory-specific assessment:

   • Main theorem (existence + verification) is somewhat predictable from PDE theory but requires careful handling of entropy terms and constraint boundaries
   • Proof technique combines standard Ladyzhenskaya-Solonnikov theory with novel entropy regularization structure - not entirely routine
   • Bounds are not compared to known lower bounds (none established for this specific problem)

   The truncated Gaussian form of optimal policy, while intuitive, required non-trivial Varadhan-Donsker analysis. The homothetic transformation reducing dimensionality is clever but follows established portfolio theory patterns.

   Verdict: INCREMENTAL — solid extension combining known techniques from different areas, but the individual components (entropy regularization, stochastic volatility, constrained control) have been studied separately; the main contribution is rigorous combination rather than breakthrough insights.

The proof strategy involves several key steps with specific techniques:

1. Homothetic transformation: Reduces the 2D HJB to 1D quasilinear PDE via ansatz:

   \[V(t,x,y) = \frac{x^{1-\eta}e^{u(t,y)} - 1}{1-\eta}\]

   This transforms the wealth-dependent problem into a volatility-only PDE.

2. Varadhan-Donsker variational principle: To find optimal policy, apply:

   \[\sup_{\lambda} E_\lambda[h] - D_{KL}(\lambda||P) = \log E_P[e^h]\]

   where $h$ contains the Hamiltonian terms. This yields the explicit truncated Gaussian form.

3. Nonlinear parabolic PDE theory: The key inequality ensuring existence is the structural condition:

   \[\frac{(\mu-r)^2}{\eta\sigma_*^2} + m\ln\left(\frac{2\pi em}{\eta\sigma_*^2}\right) + 2m\ln Z_{a,b} > 0\]

   where $Z_{a,b}$ is the truncated Gaussian normalization. This uses Ladyzhenskaya-Solonnikov theory requiring:

   • Uniform parabolicity: $\inf_{y} \delta^2(y) > 0$
   • Growth conditions on coefficients
   • Hölder regularity bounds

4. Verification via Itô’s formula: For stopping times $\tau_n$, apply Itô to $e^{M_t}V(t,X_t,y_t)$:

   \[de^{M_t}V = e^{M_t}[\text{HJB terms} + \text{martingale terms}]dt\]

   The martingale terms have finite quadratic variation by:

   \[E\left[\int_0^T e^{2M_s}(X_s)^{2(1-\eta)}[\text{variance terms}]ds\right] < \infty\]

5. Asymptotic expansion: Uses formal perturbation in $m$:

   \[u(t,y) = u^{(0)}(t,y) + \frac{1-\eta}{2}m\ln m(T-t) + mu^{(1)}(t,y) + O(m^2)\]

   The $m\ln m$ term captures exploration cost and requires careful analysis of entropy asymptotics.

Purely theoretical. The paper establishes existence and optimality results but provides no numerical implementation or empirical validation.

Appropriate empirical validation would require:

1. Numerical solution of the quasilinear PDE (3.5) using finite difference methods
2. Simulation of the exploratory wealth dynamics (2.5) with truncated Gaussian policies
3. Comparison with classical Merton strategies and discrete-time RL approaches
4. Sensitivity analysis of exploration parameter $m$ and constraint bounds $[a,b]$
5. Calibration to real market data with stochastic volatility models

Limitations:

1. Structural growth conditions in Proposition 2 are TECHNICAL - needed for PDE existence but may be restrictive for highly volatile markets or large exploration parameters

2. Assumption that $\sigma^2(y) \leq \frac{q_m^0}{\eta}$ where $q_m^0$ depends on exploration parameter is RESTRICTIVE - limits applicability when volatility is very high relative to exploration intensity

3. CRRA utility restriction $0 < \eta < 1$ is NATURAL but excludes logarithmic utility ($\eta = 1$) which has closed-form solutions

4. Independence of exploration noise $\hat{W}_t$ from market factors is TECHNICAL - real exploration might be correlated with market conditions

5. Compact constraint set $[a,b]$ is RESTRICTIVE - many practical constraints are unbounded (e.g., no short-selling: $\pi \geq 0$)

6. Verification only establishes optimality in the class of relaxed controls, not necessarily for implementable discrete-time policies - TECHNICAL gap

   Open problems:

7. Extend to jump-diffusion models with discontinuous price processes and stochastic volatility jumps

8. Develop numerical methods for the quasilinear PDE (3.5) and implement the continuous-time actor-critic algorithm outlined in Section 6

1. Motivation: Adapted optimal transport quantifies model uncertainty in stochastic processes by respecting the flow of information over time. Understanding the Gaussian case explicitly provides a foundation for applications in mathematical finance and sequential data modeling.

2. Mathematical setup: Consider a filtered probability space where both randomness and information flow are driven by Gaussian white noise $\epsilon = (\epsilon_t)_{t=1}^N$ with $\epsilon_t \in \mathbb{R}^d$. A filtered Gaussian process is defined as:

   \[G_{a,L} := (\mathbb{R}^{Nd}, \mathcal{B}(\mathbb{R}^{Nd}), \mathcal{N}_{Nd}(0, I), \mathcal{F}, X = a + L\epsilon)\]

   where $a \in \mathbb{R}^{Nd}$ is the mean vector and $L \in \mathcal{L}(N,d)$ is a block lower triangular Cholesky factor. The covariance is $A = LL^T$.

   Assumptions:

   1. The noise $\epsilon$ follows a standard Gaussian distribution
   2. The filtration $\mathcal{F} = (\mathcal{F}_t)_{t=1}^N$ is the natural filtration induced by $\epsilon$
   3. The matrix $L$ has lower triangular $d \times d$ blocks

3. Toy example: When $N = 2, d = 1$, consider processes with Cholesky factors:

   \[L(\theta) = \begin{pmatrix} 0 \\ 0 \\ \cos \theta \\ \sin \theta \end{pmatrix}\]

   Both yield the same covariance matrix $A = \begin{pmatrix} 0 & 0 \ 0 & 1 \end{pmatrix}$ but encode different information structures depending on $\theta$.

4. Formal objective: The adapted 2-Wasserstein distance between filtered Gaussian processes $X = G_{a,L}$ and $Y = G_{b,M}$ is:

   \[\text{AW}_2^2(X,Y) = \inf_{\pi \in \text{Cpl}_{bc}(X,Y)} \mathbb{E}_\pi[\|X - Y\|_2^2]\]

   where $\text{Cpl}_{bc}(X,Y)$ denotes bicausal couplings respecting the temporal structure.

The main method decomposes adapted optimal transport into a Procrustes problem between Cholesky factors.

For filtered Gaussian processes $X = G_{a,L}$ and $Y = G_{b,M}$, the adapted 2-Wasserstein distance is:

where the adapted distance between Cholesky factors is:

The optimal bicausal coupling has block diagonal correlation structure $P = \text{diag}(P_1, \ldots, P_N)$ where each $P_t$ solves:

By Proposition 2.7, the optimizers are $P_t \in \mathcal{P}((L^T M)_{t,t})$ where $\mathcal{P}(C)$ contains matrices achieving the nuclear norm $|C|_*$.

Applying to the toy example with $L(\theta)$ and $L(\phi)$:

• $(L(\theta)^T L(\phi))_{1,1} = 0$ (first time block)
• $(L(\theta)^T L(\phi))_{2,2} = \cos \theta \cos \phi + \sin \theta \sin \phi = \cos(\theta - \phi)$

Step 1 — Prior work: The closest papers are:

1. “Bicausal optimal transport for Markov chains via dynamic programming” (Gunsiansam-Wong 2023) - computed AW₂ for non-degenerate Gaussian processes on path space

2. “Adapted Wasserstein distances and stability in mathematical finance” (Backhoff-Veraart et al 2020) - established general theory of adapted optimal transport

   Step 2 — Delta: This paper extends to filtered Gaussian processes allowing:

   • Degenerate covariance matrices via minimal Cholesky factors
   • Different filtration structures beyond natural filtrations
   • Explicit characterization of the completion space
   • Analysis of asymptotic behavior and failure of Gelbrich’s bound

   Step 3 — Theory-specific assessment:

   • The main AW₂ formula (equation 1.3) is a natural but non-trivial extension requiring careful handling of degeneracy
   • The proof techniques are largely routine applications of Procrustes problems and concentration inequalities from random matrix theory
   • The bounds appear reasonably tight given the block diagonal constraint structure
   • No explicit lower bounds are provided for comparison

   The surprising negative result is that Gelbrich’s classical lower bound fails in the adapted setting - this reveals fundamental differences between classical and adapted transport.

   Verdict: INCREMENTAL — solid extension of known results to a broader class with some unexpected negative findings.

The main proof strategies combine several techniques:

1. Dynamic programming decomposition: The adapted transport problem decomposes temporally via:

   \[V_t(\omega_{1:t}^X, \omega_{1:t}^Y) = \inf_{\pi_{t+1}} \int V_{t+1}(\omega_{1:t+1}^X, \omega_{1:t+1}^Y) d\pi_{t+1}\]

   where $\pi_{t+1}$ couples the next-step noise distributions.

2. Trace maximization via nuclear norm: The key inequality driving optimality is:

   \[\max_{\|P\|_{2 \to 2} \leq 1} \text{tr}(CP) = \|C\|_*\]

   with explicit characterization of optimizers using singular value decomposition.

3. Procrustes problem reduction: The transport cost minimizes over block orthogonal matrices:

   \[\text{dist}_{AW}^2(L,M) = \min_{Q \in \mathcal{O}(N,d)} \|L - MQ\|_F^2\]

4. Gaussian concentration for asymptotic analysis: When $L, M$ have i.i.d. Gaussian entries, the transport costs concentrate around their means using:

   \[\mathbb{P}(|X - \mathbb{E}[X]| \geq t) \leq 2\exp\left(-\frac{t^2}{2\sigma^2}\right)\]

5. Chronological inverse construction: For degenerate matrices, the minimal Cholesky factor $L = C_{\min}(A)$ satisfies the zero-column condition, and its chronological inverse $L^{\ominus}$ recovers active noise components.

6. Counterexample for Gelbrich bound: Explicit construction of Gaussian processes where:

   \[\text{AW}_2(\mu, \nu) < \text{AW}_2(\mathcal{N}(0,A), \mathcal{N}(0,B))\]

   violating the adapted analog of Gelbrich’s inequality.

Purely theoretical. The paper provides explicit analytical formulas and asymptotic characterizations rather than numerical experiments. Empirical validation would involve:

1. Computing transport costs on simulated Gaussian processes with varying temporal and spatial dimensions
2. Comparing classical vs adapted transport distances across different information structures
3. Validating the asymptotic equivalence of bicausal coupling costs as $N \to \infty$
4. Testing the martingale difference condition for Gelbrich bound recovery

Limitations:

1. Gaussian restriction - RESTRICTIVE: results only apply to Gaussian processes, excluding many practical applications
2. Discrete time setting - TECHNICAL: continuous-time extension requires different analytical tools
3. Block diagonal coupling structure - NATURAL: bicausality naturally leads to this constraint in the Gaussian setting
4. Asymptotic analysis only for i.i.d. entries - TECHNICAL: other random matrix ensembles could be considered

5. No computational complexity analysis - TECHNICAL: algorithmic aspects not addressed

   Open problems:

6. Extend to non-Gaussian filtered processes while maintaining explicit computability
7. Develop efficient algorithms for computing adapted transport in high dimensions with complexity guarantees

1. Motivation: Portfolio optimization under non-concave utilities arises in behavioral finance (S-shaped utilities from prospect theory) and hedge fund compensation structures (convex schemes create non-concavities). While martingale duality works well for such problems, dynamic programming faces analytical challenges due to singular HJB equations.

2. Mathematical setup: Consider filtered probability space $(\Omega, {\mathcal{F}_t}_{0 \leq t \leq T}, \mathbb{P})$ with $d$-dimensional Brownian motion ${W_t}_{0 \leq t \leq T}$. Assets follow Black-Scholes dynamics:

   \[dS_{0,t} = rS_{0,t}dt\] \[dS_{i,t} = \mu_i S_{i,t}dt + \sigma_i^{\top} S_{i,t} dW_t\]

   where $\sigma \in \mathbb{R}^{d \times d}$ is invertible. Wealth process satisfies:

   \[dX_t = \left(r\left(X_t - \sum_{i=1}^d \pi_{i,t}\right) + \sum_{i=1}^d \pi_{i,t}\mu_i\right)dt + \sum_{i=1}^d \pi_{i,t}\sigma_i^{\top} dW_t\]

   Pricing kernel: $\xi_t = \exp\left(-\left(r + \frac{|\theta|_2^2}{2}\right)t - \theta^{\top}W_t\right)$ where $\theta = \sigma^{-1}(\mu - r\mathbf{1}_d)$.

   Assumptions:

   1. Utility $U: \mathbb{R} \to \mathbb{R} \cup {-\infty}$ with domain $[L, \infty)$ or $(L, \infty)$, increasing, upper semicontinuous, with linear growth bound
   2. Concave envelope satisfies boundary conditions: $\lim_{x \uparrow \infty}(U^{**})’(x) = 0$ and if domain is open, $\lim_{x \downarrow L}(U^{**})’(x) = \infty$
   3. Growth conditions on $I(y)$ and $U^{**}(x)$ for distribution theory

3. Toy example: When $U(x) = 0$ for $x \in [0,1]$ and $U(x) = \log(x) + 1$ for $x > 1$, the concave envelope is $U^{**}(x) = x$ for $x \in [0,1]$ and $U^{**}(x) = \log(x) + 1$ for $x > 1$. The non-concavity creates a flat region where classical dynamic programming fails.

4. Formal objective:

   \[\sup_{\pi \in \mathcal{V}[0,T]} \mathbb{E}[U(X_T) | X_0 = x_0]\]

The method establishes “dynamic Lagrange multipliers” connecting martingale duality and dynamic programming approaches.

Key steps:

1. Define conjugate function via Legendre-Fenchel transform:

   \[V(y) = \sup_{x \in \text{dom } U} \{U(x) - xy\}\] \[I(y) = \inf\{x \in \text{dom } U : (U^{**})'(x) \leq y\}\]

2. Define dynamic conjugate functions for value function $u(t,x)$:

   \[v(t,y) = \sup_{x \in D_U} \{u(t,x) - xy\}\] \[i(t,y) = \arg\max_{x \in D_U} \{u(t,x) - xy\}\]

3. Define Lagrange multiplier function:

   \[Y(t,x) = \inf\{y \in (0,\infty) : g(t,y) \leq x\}\]

   where $g(t,y) = \mathbb{E}[Z_{t,T}I(yZ_{t,T})]$ and $Z_{t,T} = \xi_T/\xi_t$.

4. Define conjugate dual point:

   \[\lambda(t,x) = \arg\min_{y>0} \{v(t,y) + xy\}\]

   Applied to toy example: For the piecewise utility, $Y(t,x)$ and $\lambda(t,x)$ can be computed explicitly using the known forms of $I(y)$ and the pricing kernel distribution. The optimal portfolio becomes:

   \[\pi_t^* = -\sigma^{-1}\theta\lambda(t,X_t^*) \frac{\partial i(t,y)}{\partial y}\bigg|_{y=\lambda(t,X_t^*)}\]

Prior work:

1. Merton (1969, 1971): pioneered dynamic programming for concave utilities via HJB equations
2. Karatzas et al. (1987), Cox and Huang (1989): developed martingale duality approach for general utilities

3. Carpenter (2000), Reichlin (2013): applied concavification techniques for non-concave utilities in hedge fund problems

   Delta: This paper establishes the exact relationship between the Lagrange multiplier function $Y(t,x)$ from martingale duality and the conjugate dual point $\lambda(t,x)$ from dynamic programming. Key contributions:

   • Proves $Y(t,x) = \lambda(t,x) = \partial u(t,x)/\partial x$ (Theorem 4.3)
   • Shows homogeneity: $\lambda(t,X_t^*) = \lambda(0,x_0)\xi_t$ (dynamic shadow price interpretation)
   • Derives optimal portfolio in feedback form using conjugate relationships

   Theory-specific assessment:

   • The main theorem connecting $Y(t,x)$ and $\lambda(t,x)$ is not particularly surprising given both represent marginal utilities
   • Proof technique using distribution theory to handle non-differentiable functions is somewhat novel but builds on standard convex analysis
   • The homogeneity result provides nice economic interpretation but follows from martingale properties
   • No lower bounds are established or compared

   The work is technically solid but the connection between dual approaches was somewhat expected by experts in the field.

   Verdict: INCREMENTAL — solid technical work connecting two established approaches, but the main relationship was predictable from the underlying economic meaning of both multipliers.

Main proof strategy uses distribution theory to handle non-differentiable functions arising from non-concave utilities.

Key technical steps:

1. Distribution theory setup: Since $I(y)$ fails to be continuous, treat it as Schwartz distribution on $\mathcal{S}_0(0,\infty)$. Key inequality ensuring integrability:

   \[\lim_{z \downarrow 0} |z^{-\alpha_0}I(z)| = \lim_{z \uparrow \infty} |z^{-\alpha_0}I(z)| = 0\]

2. Distributional derivative exchange: Core lemma shows:

   \[\frac{\partial}{\partial y}\mathbb{E}[U^{**}(I(yZ_{t,T}))] = y\frac{\partial g(t,y)}{\partial y}\]

   Proof uses distributional chain rule:

   \[\frac{\partial}{\partial y}\int_0^{\infty} I(yz)\phi(z)dz = \int_0^{\infty} I'(yz)z\phi(z)dz\]

3. Strict concavity of value function: Proves $u(t,x)$ is strictly concave by showing any linear segment leads to contradiction in HJB equation:

   \[-\frac{\partial u}{\partial t} - \sup_{\pi} \mathcal{L}(t,x,u;\pi) = 0\]

   If $\frac{\partial^2 u}{\partial x^2} = 0$ on interval, Hamiltonian becomes unbounded.

4. Key distributional derivative formula: For jump points ${a_j}$ of $I$:

   \[I'(y) = (I|_{\text{ctn}})'(y) + \sum_{j \in J} [I(a_j^+) - I(a_j^-)] \delta(y - a_j)\]

5. Martingale argument: Uses independence of $Z_{t,T}$ and $\xi_t$ to prove homogeneity:

   \[\mathbb{E}[Z_{t,T}(I(\lambda(0,x)\xi_t Z_{t,T}) - I(\lambda(t,X_t^*)Z_{t,T}))|\xi_t] = 0\]

Purely theoretical work with one numerical example for illustration. The authors provide explicit computations for a piecewise utility:

They compute closed-form expressions for $V(y)$, $I(y)$, $U^{**}(x)$, value function $u(t,x)$, and verify the main theoretical relationships numerically.

Empirical validation would require: implementing the feedback portfolio strategy, comparing performance against concavification approaches, and testing on realistic non-concave utilities from behavioral finance applications.

Limitations:

1. Growth conditions in Assumption 3 needed for distribution theory - TECHNICAL (ensures integrability but likely removable with more sophisticated analysis)
2. Restriction to Black-Scholes model with constant parameters - TECHNICAL (authors note extension to deterministic coefficients is straightforward)
3. Complete market assumption - NATURAL (standard in continuous-time portfolio theory)
4. Twice differentiability requirement for optimal portfolio formula - TECHNICAL (needed for Itô’s formula application)

5. Bounded domain restriction $D_U = (\hat{L}, \infty)$ - RESTRICTIVE (excludes some practical utilities)

   Open problems:

6. Extension to incomplete markets where multiple pricing kernels exist
7. Development of computational algorithms for practical implementation of the feedback portfolio strategy in realistic non-concave settings