1. Motivation (2–3 sentences): Standard causal inference estimators like IPW, AIPW, and TMLE become unstable under practical positivity violations where treatment probabilities approach zero, leading to extreme inverse propensity weights. This instability is particularly problematic when estimating policy values (mean counterfactual outcomes under treatment rules) in observational studies.

2. Mathematical setup: Consider observations $O = (W, A, Y)$ where $W$ are covariates, $A \in {0,1}$ is treatment, and $Y$ is outcome. The target parameter is the mean counterfactual outcome under treatment rule $d(W)$:

   \[E[Y^d] = E_W[E[Y | A = d(W), W]]\]

   This can be decomposed as:

   \[E[E[Y | W] + (d(W) - \bar{g}(W))(E[Y | A = 1, W] - E[Y | A = 0, W])]\]

   where $\bar{g}(W) = P(A = 1

   W)$ is the propensity score and $B(W) = E[Y

   A = 1, W] - E[Y

   A = 0, W]$ is the CATE.

   Assumptions:

   1. Consistency: $Y = Y^A$

   2. No unmeasured confounding: $(Y^0, Y^1) \perp A

      W$

   3. Positivity: $0 < P(A = a

      W) < 1$ for $a \in {0,1}$ (may be violated in practice)

3. Toy example: When $d = 2$, $W = (W_1, W_2) \sim \text{Uniform}(-1,1)^2$, and $g(W) = \text{expit}(2(W_1 + W_2))$ with $\kappa = 2$, regions where $W_1 + W_2 \approx -1$ have $g(W) \approx 0$, creating practical positivity violations that destabilize standard estimators through extreme weights $1/g(A

   W)$.

4. Formal objective: The authors target a projected parameter induced by a CATE working model $\beta^T \phi(W)$:

   \[\Psi_n(P) = E_P[E_P(Y|W) + (d(W) - g(W))\beta(P)^T \phi_n(W)]\]

The method introduces two estimators based on data-adaptive CATE working models using HAL basis functions:

A-TMLE Algorithm:

1. Estimate nuisance functions $\hat{g}(W)$ and $\hat{Q}(A,W)$ using Super Learner
2. Construct pseudo-outcome $Z_i = (Y_i - \hat{m}(W_i))/(A_i - \hat{g}(W_i))$ with weights $(A_i - \hat{g}(W_i))^2$
3. Fit CATE using relaxed HAL: $\hat{\tau}(W) = \hat{\beta}^T \phi_n(W)$

4. Plug-in estimator:

   \[\hat{\Psi}_{\text{A-TMLE}} = P_n[Y + (d(W) - \hat{g}(W))\hat{\beta}^T \phi_n(W)]\]

   Regularized TMLE Algorithm: Uses a stabilized clever covariate obtained by projecting the standard TMLE covariate onto the CATE working model score space:

   \[H_{\text{Reg}}(A,W) = P_n[(d(W) - \hat{g}(W))\phi_n(W)]^T \hat{\Sigma}^{-1} (A - \hat{g}(W))\phi_n(W)\]

   where $\hat{\Sigma} = P_n[\phi_n(W)\phi_n(W)^T \hat{g}(W)(1-\hat{g}(W))]$.

   Application to toy example: With $d(W) = 1{W_2 > 0}$, $\phi_n(W) = (1, W_1, W_2, W_1W_2)^T$, the estimators avoid direct inverse weighting by $1/\hat{g}(W)$, instead using the projected coefficient $\hat{\beta}$ to capture treatment effect heterogeneity while maintaining stability when $\hat{g}(W) \approx 0$.

Step 1 — Prior work:

• van der Laan and Rose (2011, 2018): Standard TMLE framework using efficient influence functions with inverse propensity score clever covariates
• Gruber et al. (2022): Propensity score truncation methods to stabilize TMLE under positivity violations
• Benkeser and Van Der Laan (2016): Highly adaptive lasso for data-adaptive basis construction

Step 2 — Delta: This paper introduces:

1. A projected policy-value parameter based on CATE working models that avoids inverse propensity score weighting
2. Regularized TMLE that projects the standard clever covariate onto the CATE tangent space

3. Theoretical characterization of second-order remainders and first-order plug-in bias.

   Step 3 — Theory-specific assessment:

   • Surprising vs predictable: The result that targeting can be avoided under exact CATE models is somewhat surprising, as standard TMLE theory requires both outcome and propensity score targeting
   • Proof technique: The proofs are largely routine applications of influence function calculus and projection theory. The key insight is recognizing that $(A - \bar{g}(W))[\tau(W) - \beta^T\phi(W)]$ vanishes under exact CATE working models
   • Bound tightness: No lower bounds are provided. The remainder bounds are standard second-order expansions without matching lower bounds

   Verdict: INCREMENTAL — solid extension of TMLE that improves finite-sample stability but uses standard projection techniques without fundamental theoretical breakthroughs.

The main proof strategy relies on influence function calculus and L2-projection theory:

1. EIF derivation for $\beta(P)$: Starting from the estimating equation $U(\beta, P, B(P), \bar{g}) = 0$, differentiate to obtain:

   \[\Sigma(P) D_{\beta(\cdot),P} = \phi(W)(B(P) - \beta^T\phi(W))\bar{g}(W)(1-\bar{g}(W)) + \text{cross-terms}\]

2. Projected parameter EIF: The key decomposition shows that under exact CATE working models:

   \[Y - E_P Y = (Y - E_P[Y|A,W]) + (A - \bar{g}(W))\tau_P(W) + (E_P[Y|W] - E_P Y)\]

   The crucial insight is that when $\tau_P(W) = \beta(P)^T\phi(W)$, the term $(A - \bar{g}(W))[\tau_P(W) - \beta(P)^T\phi(W)]$ vanishes.

3. Second-order remainder bounds: Using von Mises expansion:

   \[R_2 \leq \|B_0 - \beta_0^T\phi\|\|\bar{g} - \bar{g}_0\|^2 + \|\beta - \beta_0\|\|\bar{g} - \bar{g}_0\| + \|\beta - \beta_0\|^2\]

4. Projection result: The regularized clever covariate is the L2-projection:

   \[\Pi_{A_n} H_{NP}(A,W) = 1 + (A - \bar{g}(W))\phi_n(W)^T \Sigma_n^{-1} E_P[\phi_n(W)(d(W) - \bar{g}(W))]\]

   where $A_n = {1 + (A - \bar{g}(W))u(W) : u \in \Phi_n}$ is the affine class induced by the working model.

Simulation study:

• Data generating process: $W \sim \text{Uniform}(-1,1)^4$, logistic propensity with parameter $\kappa \in {0.1, 2}$ (strong vs. weak overlap)
• Outcome model: $\mu_0(W) = \sin(4W_1) + \sin(4W_2) + \sin(4W_3) + \sin(4W_4) + \cos(4W_2)$

• CATE: $B_0(W) = 1 + W_1 +

  W_2

  + \cos(4W_3) + W_4$

• Sample sizes: $n \in {200, 500, 1000}$, 500 Monte Carlo replicates
• Baselines: IPW, AIPW, standard TMLE

Key results: Under practical positivity violations ($\kappa = 2$), A-TMLE and regularized TMLE achieve 15-30% lower MSE than AIPW and TMLE. Coverage improves from ~85% (AIPW/TMLE) to ~95% for adaptive methods.

Real data: Right Heart Catheterization study (n=5735) with policies based on APACHE score thresholds. A-TMLE and regularized TMLE produce confidence intervals 20-40% shorter than IPW/AIPW while maintaining stable point estimates.

Limitations:

1. RESTRICTIVE: Primary A-TMLE estimand is a projected parameter, not the original policy value $E[Y^d]$, unless CATE working model is exact
2. TECHNICAL: Regularized TMLE first-order bias analysis requires projected EIF to approximate nonparametric EIF at rate $o_P(n^{-1/4})$
3. TECHNICAL: Oracle analysis assumes fixed basis functions rather than data-adaptive HAL selection
4. RESTRICTIVE: Limited to point treatment settings; longitudinal extension unclear

5. TECHNICAL: Inference theory incomplete - simulations suggest standard TMLE influence function works better than projected versions

   Open problems:

6. Data-adaptive basis selection: Develop principled methods for choosing HAL penalty parameters and basis dimension to optimize the approximation-variance tradeoff
7. Sequential treatment extension: Extend the projection framework to longitudinal TMLE with time-varying treatments and dynamic regimes where positivity violations compound over time

1. Motivation: The Blahut-Arimoto algorithm is a fundamental iterative method for computing rate-distortion functions, yet its continuous-time dynamical structure and exact dissipation mechanisms remain poorly understood. Understanding the geometric principles underlying BA convergence could unlock accelerated algorithms and deeper connections to information geometry.

2. Mathematical setup: Let $X \sim p(x)$ be a discrete source with reconstruction alphabet $\hat{X}$ and distortion $d(x,\hat{x})$. The rate-distortion problem seeks

   \[\min_{p(\hat{x}|x)} I(X;\hat{X}) + \beta E[d(X,\hat{X})]\]

   The BA algorithm defines the operator $\tilde{q}_\betaq := \int p(x) \frac{q(\hat{x})e^{-\beta d(x,\hat{x})}}{\sum_{\hat{y}} q(\hat{y})e^{-\beta d(x,\hat{y})}} dx$ and iterates $q_{k+1} = \tilde{q}_\beta[q_k]$. The continuous-time embedding is

   \[\partial_\tau q_\tau = \tilde{q}_\beta[q_\tau] - q_\tau\]

   Assumptions:

   1. Densities $q_\tau(x)$ are strictly positive with finite second moments
   2. Distortion satisfies $d(x,y) \leq C(1 + |x|^2 + |y|^2)$
   3. The map $q \mapsto \tilde{q}_\beta[q]$ is Gâteaux differentiable in the weighted Hilbert space $H_q$ with Fisher-Rao inner product $\langle h,g \rangle_{H_q} = \int \frac{h(x)g(x)}{q(x)} dx$

3. Toy example: For Gaussian source $X \sim N(0,\sigma^2)$ with quadratic distortion $d(x,\hat{x}) = (x-\hat{x})^2$, the optimal reproduction is $q^* = N(0, \sigma^2 - 1/(2\beta))$ and the variance $s(\tau) = E_{q_\tau}[\hat{X}^2]$ evolves via the closed ODE $\dot{s} = \tilde{s}(s,\beta) - s$ where $\tilde{s}(s,\beta) = s/(1 + 2\beta s + (2\beta s)^2\sigma^2)(1 + 2\beta s)^{-2}$.

4. Formal objective: Establish the exact dissipation identity

   \[\frac{d}{d\tau} \Phi_\beta = -\chi^2(\tilde{q}_\beta \| q)\]

   where $\Phi_\beta(q)$ is the marginal free energy and $\chi^2(p|q) = \int \frac{(p-q)^2}{q}$ is the Pearson chi-squared divergence.

The method establishes the continuous-time BA flow and analyzes its dissipation structure through three main steps:

1. Jacobian operator analysis: Define the Jacobian $K_q := D\tilde{q}_\beta[q]$ and information-theoretic Hessian $A_q := I - K_q$. The chain rule gives $\partial_\tau \tilde{q}_\beta[q_\tau] = K_{q_\tau}[\delta q_\tau]$ where $\delta q_\tau = \tilde{q}_\beta[q_\tau] - q_\tau$ is the velocity field.

2. Unified dissipation identity: Both the chi-squared functional $V(q) := \chi^2(\tilde{q}_\beta[q]|q)$ and Jeffreys divergence $D_J(q) := D_{KL}(q|\tilde{q}_\beta[q]) + D_{KL}(\tilde{q}_\beta[q]|q)$ satisfy

   \[\frac{d}{d\tau} D(q_\tau) = -2D(q_\tau) + 2\langle \delta q_\tau, K_{q_\tau}[\delta q_\tau] \rangle_{H_{q_\tau}} + N(q_\tau)\]

   where $N(q) = -\int \frac{(\delta q)^3}{q^2}$ for $D = V$ and $N(q) = 0$ for $D = D_J$ (exact cubic cancellation).

3. Variational foundation: The marginal free energy $\Phi_\beta(q) = \inf_p F_\beta(p;q)$ where $F_\beta(p;q) = D_{KL}(p|q) + \beta E[d(X,\hat{X})]$ satisfies the exact identity

   \[\frac{d}{d\tau} \Phi_\beta(q_\tau) = -\chi^2(\tilde{q}_\beta[q_\tau] \| q_\tau)\]

   Application to toy example: For the Gaussian case, the variance satisfies $\dot{s}(\tau) = \tilde{s}(s(\tau),\beta) - s(\tau)$ with unique fixed point $s^* = \sigma^2 - 1/(2\beta)$. The Jacobian eigenvalues are $\lambda_n = \alpha^n$ where $\alpha = s^*/(s^* + (2\beta)^{-1})$, giving exponential convergence rate $1-\alpha = 1/(1+2\beta s^*)$.

Prior work:

1. Blahut (1972) and Arimoto (1972): Established discrete BA algorithm convergence via monotone free energy decrease
2. Csiszár (1975): Characterized BA steps as alternating I-projections in discrete setting

3. Nakagawa-Watanabe: Derived O(1/n) discrete convergence rates

   Delta: This paper provides the first complete continuous-time analysis revealing that chi-squared divergence (not KL divergence) is the fundamental dissipation mechanism. Key contributions:

   • Exact identity $\dot{\Phi}_\beta = -\chi^2(\tilde{q}_\beta | q)$ elevates chi-squared from local approximation to global driver
   • Proves exact cubic cancellation for Jeffreys divergence via Bregman symmetrization
   • Identifies operator $A_q = I - K_q$ as Fisher-Rao Hessian of free energy
   • Provides first rigorous proof that Gaussian distribution emerges as unique dynamical attractor

   Theory-specific assessment:

   • Main theorem is genuinely surprising: prior work focused on KL monotonicity, not chi-squared as exact dissipation measure
   • Proof technique combines envelope theorems, weighted Hilbert space analysis, and spectral theory in novel way
   • Bounds appear tight: the universal decay rate 2 matches known discrete analysis
   • Cubic cancellation result has no known prior precedent

   Verdict: SIGNIFICANT — The chi-squared dissipation identity and cubic cancellation theorem represent clear non-obvious advances that most information theorists should read, establishing new geometric foundations for BA analysis.

The proofs employ three main technical approaches:

1. Weighted Hilbert space calculus: Work in the moving bundle ${H_{q_\tau}}_{\tau \geq 0}$ with Fisher-Rao inner product. Apply dominated convergence theorem for differentiation under integral sign, justified by quadratic distortion growth. Key chain rule:

   \[\partial_\tau \tilde{q}_\beta[q_\tau] = K_{q_\tau}[\partial_\tau q_\tau] = K_{q_\tau}[\delta q_\tau]\]

2. Envelope theorem application: For marginal free energy $\Phi_\beta(q) = \inf_p F_\beta(p;q)$, the envelope theorem gives

   \[\frac{d}{d\tau} \Phi_\beta(q_\tau) = \left\langle \frac{\delta F_\beta}{\delta q}[\tilde{q}_\beta[q_\tau]; q_\tau], \partial_\tau q_\tau \right\rangle\]

   Computing $\frac{\delta F_\beta}{\delta q} = -\frac{\tilde{q}_\beta[q]}{q}$ and substituting $\partial_\tau q_\tau = \delta q_\tau$ yields the chi-squared identity.

3. Bregman divergence symmetrization: For the cubic cancellation, expand the Jeffreys divergence $D_J(q) = B_\psi(q,\tilde{q}) + B_\psi(\tilde{q},q)$ where $B_\psi$ is the Bregman divergence of negative entropy. The key insight is that symmetrization eliminates all odd-order terms:

   \[D_J(q) = \frac{1}{2}\langle \delta q, A_q[\delta q] \rangle_{H_q} + O(\|\delta q\|^4_{H_q})\]

4. Spectral analysis for Gaussian case: Exploit the fact that Gaussian BA map tensorizes. In the diagonalized coordinates, the Jacobian eigenvalues are

   \[\lambda_n = \prod_{i=1}^d \alpha_i^{n_i}, \quad \alpha_i = 1 - \frac{1}{2\beta\sigma^2_{P,i}}\]

   The spectral gap $\min_n(1-\lambda_n) = 1/(2\beta \max_i \sigma^2_{P,i})$ governs convergence rate.

Purely theoretical with analytical validation on the Gaussian benchmark case. The theory predicts:

• Exact variance ODE $\dot{s} = \tilde{s}(s,\beta) - s$ for any initial distribution
• Exponential convergence rate $2\lambda$ where $\lambda = 1/(1+2\beta s^*)$
• Universal decay rate 2 for both chi-squared and Jeffreys functionals

Empirical validation would involve:

1. Numerical integration of the variance ODE vs. discrete BA iterations for Gaussian sources
2. Verification of the chi-squared dissipation identity $\dot{\Phi}_\beta = -V(q_\tau)$ on finite alphabet problems
3. Measurement of cubic cancellation: $N_J(q) \equiv 0$ vs. $N_V(q) \neq 0$ along trajectories
4. Spectral stiffness experiments in high-dimensional anisotropic Gaussian sources

Limitations:

1. Regularity assumptions (TECHNICAL): Requires strict positivity, finite second moments, and Gâteaux differentiability in weighted Hilbert spaces. These conditions hold for standard examples but may exclude some pathological cases.

2. Continuous alphabet restriction (TECHNICAL): The weighted Hilbert space framework applies cleanly to continuous spaces. Discrete finite alphabets require matrix analysis adaptations.

3. Local spectral gap analysis (NATURAL): Convergence rates are characterized only near equilibrium. Global exponential bounds remain open.

4. Gaussian specialization (NATURAL): The complete finite-dimensional reduction only works for Gaussian sources with quadratic distortion. Extensions to other exponential families are non-trivial.

   Open problems:

5. Global exponential convergence: Extend local rate $2\lambda$ to global exponential bounds using the Jeffreys divergence cubic cancellation
6. Non-Gaussian solvable cases: Find other source-distortion pairs where the BA flow reduces to finite-dimensional ODEs beyond the Gaussian-quadratic case

1. Motivation: Stackelberg stochastic differential games model hierarchical decision-making where a leader commits to a strategy before a follower responds. However, these games suffer from time-inconsistency: optimal strategies derived at initial time may fail to remain optimal at later times. This makes commitment unrealistic and undermines the solution concept.

2. Mathematical setup: Consider two players controlling the SDE:

   \[dX(s) = [A(s)X(s) + B_1(s)u(s) + B_2(s)v(s)]ds + [C(s)X(s) + D_1(s)u(s) + D_2(s)v(s)]dW(s)\]

   Player 1 (leader) minimizes:

   \[J_1(t, ξ; u, v) = \frac{1}{2}E_t\left[\int_t^T [\langle Q_1(s)X(s), X(s)\rangle + \langle R_1(s)u(s), u(s)\rangle]ds + \langle G_1X(T), X(T)\rangle\right]\]

   Player 2 (follower) minimizes:

   \[J_2(t, ξ; u, v) = \frac{1}{2}E_t\left[\int_t^T [\langle Q_2(s)X(s), X(s)\rangle + \langle R_2(s)v(s), v(s)\rangle]ds + \langle G_2X(T), X(T)\rangle\right]\]

   Assumptions:

   1. $Q_1, Q_2, G_1, G_2 \geq 0$ (positive semidefinite)
   2. $R_1, R_2 \geq \delta I$ for some $\delta > 0$ (coercivity)
   3. All coefficient matrices are bounded and measurable

3. Toy example: When $n = m_1 = m_2 = 1$, $C = D_1 = D_2 = 0$, and all matrices are constants with $R_1, R_2, G_1, G_2, Q_1 > 0$, the closed-loop Stackelberg solution becomes time-inconsistent: if the strategy were time-consistent, auxiliary variable $y^*(t) = 0$ for all $t$, leading to $u^* \equiv 0$ and $x^* \equiv 0$, contradicting $x_0 \neq 0$.

4. Formal objective: Find a time-consistent closed-loop equilibrium strategy $\bar{\Theta}_1$ satisfying the variational inequality:

   \[\lim_{\varepsilon \to 0^+} \frac{J_1(t, ξ; \bar{\Theta}_1^{\varepsilon}X^{\varepsilon}, \Theta_2^*(\bar{\Theta}_1^{\varepsilon})X^{\varepsilon}) - J_1(t, ξ; \bar{\Theta}_1\bar{X}, \Theta_2^*(\bar{\Theta}_1)\bar{X})}{\varepsilon} \geq 0\]

The method reformulates the leader’s time-inconsistent problem via closed-loop equilibrium strategies.

Step 1: Assume leader uses linear feedback $u = \Theta_1 X$ with $\Theta_1 \in L^{\infty}(0,T; \mathbb{R}^{m_1 \times n})$. For any fixed $\Theta_1$, the follower faces a standard LQ problem with unique optimal response:

\[\Theta_2^*(\Theta_1) = -[R_2 + D_2^T P_2 D_2]^{-1}[B_2^T P_2 + D_2^T P_2(C + D_1\Theta_1)]\]

where $P_2$ solves the Riccati equation:

\[\dot{P}_2 + (A + B_1\Theta_1)^T P_2 + P_2(A + B_1\Theta_1) + (C + D_1\Theta_1)^T P_2(C + D_1\Theta_1) + Q_2 - [P_2 B_2 + (C + D_1\Theta_1)^T P_2 D_2][R_2 + D_2^T P_2 D_2]^{-1}[B_2^T P_2 + D_2^T P_2(C + D_1\Theta_1)] = 0\]

Step 2: The leader’s problem becomes a nonlinear forward-backward optimal control problem coupling a forward SDE with a backward Riccati equation.

Step 3: Using variational methods, characterize the equilibrium strategy through the equilibrium Riccati equation (ERE):

\[\bar{\Theta}_1 = -[R_1 + D(P_2)^T P_1 D(P_2)]^{-1}[B(P_2)^T P_1 + D(P_2)^T P_1(C - D_2(R_2 + D_2^T P_2 D_2)^{-1}(B_2^T P_2 + D_2^T P_2 C))]\]

Applied to toy example: With $n=1$, $D_2=0$, the method yields a unique time-consistent linear strategy $\bar{\Theta}_1(t) = -[R_1]^{-1}[B_1^T P_1(t)]$ where $(P_1, P_2)$ solve the coupled ERE system, eliminating the time-inconsistency paradox.

Step 1 — Prior work:

1. Bensoussan et al. [4] (2022): “Stackelberg Games with a Large Number of Followers” — derived coupled HJB equations via time discretization but left convergence as open problem
2. Başar and Olsder [2]: “Dynamic Noncooperative Game Theory” — established feedback Stackelberg equilibrium concept but required short time horizons

3. Huang and Shi [17]: finite-horizon LQ games with control-dependent diffusion — needed restrictive assumptions for solvability

   Step 2 — Delta: This paper provides:

4. New solution concept: Closed-loop equilibrium strategies where follower is globally optimal (vs. locally optimal in [4])
5. Rigorous foundation: Variational derivation of ERE eliminates need for unproven limiting arguments

6. Global well-posedness: Removes short-time restrictions from [2,17], allows control-dependent diffusion

   Step 3 — Theory-specific assessment:

   • Main theorem surprising? Moderately. The equivalence between closed-loop equilibrium and feedback Stackelberg equilibrium is non-obvious, and removing short-time constraints is significant
   • Proof technique routine? Partially novel. The variational approach for nonlinear forward-backward systems goes beyond standard LQ techniques, though it builds on authors’ previous work [19,20]
   • Bound tightness: No explicit lower bounds provided, so tightness cannot be assessed

   The key insight is reformulating the leader’s nonlinear control problem (due to controlled Riccati equations) as a time-consistent equilibrium, yielding the same ERE as the problematic HJB approach but with rigorous justification.

   Verdict: SIGNIFICANT — provides rigorous foundation for previously heuristic methods and achieves global well-posedness under broader conditions than existing theory.

The proof employs a sophisticated variational analysis for nonlinear forward-backward systems.

Main technique: Variational characterization of equilibrium strategies through perturbation analysis.

1. Perturbation setup: For equilibrium strategy $\bar{\Theta}_1$, consider perturbations $\bar{\Theta}_1^{\varepsilon}(s) = \bar{\Theta}_1(s) + \mathbf{1}_{[t,t+\varepsilon]}(s)V(s)$ and analyze the cost variation.

2. Key estimation lemma: For the perturbed system, establish:

   \[|X^{\varepsilon} - X|_{L^2} \leq C|ξ|^2\varepsilon\] \[|P_2^{\varepsilon} - P_2|_{C[t,T]} \leq C\varepsilon\]

3. Decoupling technique: Introduce auxiliary adjoint system to represent cost variation:

   \[dY_1 = -[A^T Y_1 + C^T Z_1 + (Q_1 + \Theta_1^T R_1\Theta_1)X_0^{\varepsilon}]ds + Z_1 dW(s)\]

   with ansatz $Y_1 = P_1 X_0^{\varepsilon} + P_3$ leading to the Lyapunov equation:

   \[\dot{P}_1 = -[A^T P_1 + P_1 A + C^T P_1 C + Q_1 + \Theta_1^T R_1\Theta_1]\]

4. Critical variational inequality: After extensive calculation, the first-order variation becomes:

   \[\lim_{\varepsilon \to 0^+} \frac{\Delta J_1}{\varepsilon} = \frac{1}{2}\langle[D(P_2)^T P_1 D(P_2) + R_1]V\xi, V\xi\rangle + \langle[R_1\Theta_1 + B(P_2)^T P_1 + D(P_2)^T P_1 C]\xi, V\xi\rangle\]

5. Equilibrium characterization: The variational inequality $\Delta J_1/\varepsilon \geq 0$ for all perturbations $V$ yields:

   \[R_1\bar{\Theta}_1 + B(P_2)^T P_1 + D(P_2)^T P_1 C = 0\]

   A priori estimates (for global existence): The technical core establishes bounds preventing finite-time blowup. For Case (i) with $

   D_2

   > \delta > 0$:

   \[\frac{d}{dt}[\text{vec}(P_1), \text{vec}(P_2)]^T \leq C(1 + |[\text{vec}(P_1), \text{vec}(P_2)]|)\]

   using the Kronecker product structure and spectral properties of the linearized system.

Purely theoretical with one application example.

Asset management problem: Two investors with asymmetric information managing wealth $X(t)$ targeting terminal value $z$. Model parameters: initial wealth $x_0 = 100$, target $z = 200$, risk-free rate $r = 0.03$, stock returns $\mu_1 = 0.08, \mu_2 = 0.10$, volatilities $\sigma_1 = 0.15, \sigma_2 = 0.19$, horizon $T = 10$.

Numerical results:

1. ERE solutions $(P_1(s), P_2(s))$ computed via backward Euler scheme
2. Three sample paths show wealth convergence to target $z = 200$

3. Control trajectories reveal leader invests less aggressively than follower ($u_1(s) < u_2(s)$), consistent with strategic hierarchy

   Empirical validation would require: Testing the equilibrium strategies against:

4. Pre-committed (time-inconsistent) strategies in realistic market scenarios
5. Robustness analysis under model misspecification
6. Computational efficiency comparisons with existing HJB-based methods

Limitations:

1. Linear strategy restriction (TECHNICAL) — Analysis limited to linear feedback $u = \Theta_1 X$; existence of nonlinear equilibria unknown

2. Restrictive structural conditions (RESTRICTIVE) — Global well-posedness requires either one-dimensional setting or control-independent diffusion with full-rank drift controllability

3. No explicit convergence rates (TECHNICAL) — Numerical scheme lacks rigorous error analysis and stability guarantees

4. Limited economic interpretation (NATURAL) — Asset management example is illustrative; broader applicability to realistic hierarchical systems unclear

   Open problems:

5. Multi-dimensional case with control-dependent diffusion: Extend Theorem 4.2 beyond the restrictive conditions, particularly for $D_2 \neq 0$ in high dimensions

6. Nonlinear equilibrium strategies: Characterize existence and uniqueness of equilibrium strategies beyond the linear class $u = \Theta_1 X$