Showing 1–45 of 45 results for author: Shi, B

A diffuse-interface Landau-de Gennes model for free-boundary nematic liquid crystals

Authors: Dawei Wu, Baoming Shi, Yucen Han, Pingwen Zhang, Apala Majumdar, Lei Zhang

Abstract: We introduce a diffuse-interface Landau-de Gennes free energy for free-boundary nematic liquid crystals (NLC) in three dimensions submerged in isotropic liquid, where a phase field is introduced to model the deformable interface. The energy we propose consists of the original Landau-de Gennes free energy, three penalty terms and a volume constraint. We prove the existence and regularity of minimiz… ▽ More We introduce a diffuse-interface Landau-de Gennes free energy for free-boundary nematic liquid crystals (NLC) in three dimensions submerged in isotropic liquid, where a phase field is introduced to model the deformable interface. The energy we propose consists of the original Landau-de Gennes free energy, three penalty terms and a volume constraint. We prove the existence and regularity of minimizers to the diffuse-interface energy functional. We also prove a uniform maximum principle of the minimizer under appropriate assumptions, together with a uniqueness result for small domains. Then, we establish a sharp-interface limit where minimizers of the diffuse-interface energy converge to a minimizer of a sharp-interface energy under the framework of $Γ$-convergence. Finally, we conduct numerical experiments with the diffuse-interface model, the findings of which are compared with existing works. △ Less

Submitted 19 August, 2024; v1 submitted 31 July, 2024; originally announced July 2024.

Comments: 31 pages, 3 figures

MSC Class: 76A15; 49J27; 49K20; 35B50; 49J45; 35F30

A Lyapunov Analysis of Accelerated PDHG Algorithms

Authors: Xueying Zeng, Bin Shi

Abstract: The generalized Lasso is a remarkably versatile and extensively utilized model across a broad spectrum of domains, including statistics, machine learning, and image science. Among the optimization techniques employed to address the challenges posed by this model, saddle-point methods stand out for their effectiveness. In particular, the primal-dual hybrid gradient (PDHG) algorithm has emerged as a… ▽ More The generalized Lasso is a remarkably versatile and extensively utilized model across a broad spectrum of domains, including statistics, machine learning, and image science. Among the optimization techniques employed to address the challenges posed by this model, saddle-point methods stand out for their effectiveness. In particular, the primal-dual hybrid gradient (PDHG) algorithm has emerged as a highly popular choice, celebrated for its robustness and efficiency in finding optimal solutions. Recently, the underlying mechanism of the PDHG algorithm has been elucidated through the high-resolution ordinary differential equation (ODE) and the implicit-Euler scheme as detailed in [Li and Shi, 2024a]. This insight has spurred the development of several accelerated variants of the PDHG algorithm, originally proposed by [Chambolle and Pock, 2011]. By employing discrete Lyapunov analysis, we establish that the PDHG algorithm with iteration-varying step sizes, converges at a rate near $O(1/k^2)$. Furthermore, for the specific setting where $τ_{k+1}σ_k = s^2$ and $θ_k = τ_{k+1}/τ_k \in (0, 1)$ as proposed in [Chambolle and Pock, 2011], an even faster convergence rate of $O(1/k^2)$ can be achieved. To substantiate these findings, we design a novel discrete Lyapunov function. This function is distinguished by its succinctness and straightforwardness, providing a clear and elegant proof of the enhanced convergence properties of the PDHG algorithm under the specified conditions. Finally, we utilize the discrete Lyapunov function to establish the optimal linear convergence rate when both the objective functions are strongly convex. △ Less

Submitted 26 July, 2024; originally announced July 2024.

Comments: 16 pages

Enhanced dissipation and blow-up suppression for an aggregation equation with fractional diffusion and shear flow

Authors: Niu Binqian, Binbin Shi, Weike Wang

Abstract: In this paper, we consider an aggregation equation with fractional diffusion and large shear flow, which arise from modelling chemotaxis in bacteria. Without the advection, the solution of aggregation equation may blow up in finite time. First, we study the enhanced dissipation of shear flow by resolvent estimate method, where the fractional Laplacian $(-Δ)^{α/2}$ is considered and $α\in (0,2)$. N… ▽ More In this paper, we consider an aggregation equation with fractional diffusion and large shear flow, which arise from modelling chemotaxis in bacteria. Without the advection, the solution of aggregation equation may blow up in finite time. First, we study the enhanced dissipation of shear flow by resolvent estimate method, where the fractional Laplacian $(-Δ)^{α/2}$ is considered and $α\in (0,2)$. Next, we show that the enhanced dissipation of shear flow can suppress blow-up of solution to aggregation equation with fractional diffusion and establish global classical solution in the case of $α\geq 3/2$. Here we develop some new technical to overcome the difficult of low regularity for fractional Laplacian. △ Less

Submitted 24 April, 2024; originally announced April 2024.

Comments: 33 pages. arXiv admin note: text overlap with arXiv:2308.15287

MSC Class: 35A01; 35Q92; 35R11; 76F10

Nonlinear stability and transition threshold for the planar helical flow

Authors: Binbin Shi, Yucheng Wang

Abstract: In this paper, we study the nonlinear stability for the 3-D planar helical flow $(δ^2\sin(m_0 y),δ^2\cos(m_0 y),0)$ on torus $\mathbb{T}^3=\{(x_1,x_2,y)\big|x_1,x_2\in \mathbb{T}_{2π}, y\in \mathbb{T}_{2πδ}, δ\geq1\}$ for high Reynolds number $Re$. We prove that if the initial velocity $U_0$ satisfies $$ \left\|U_0-(δ^2\sin(m_0 y),δ^2\cos(m_0 y),0)\right\|_{X_0}\leq c_0 Re^{-7/4} $$ for some… ▽ More In this paper, we study the nonlinear stability for the 3-D planar helical flow $(δ^2\sin(m_0 y),δ^2\cos(m_0 y),0)$ on torus $\mathbb{T}^3=\{(x_1,x_2,y)\big|x_1,x_2\in \mathbb{T}_{2π}, y\in \mathbb{T}_{2πδ}, δ\geq1\}$ for high Reynolds number $Re$. We prove that if the initial velocity $U_0$ satisfies $$ \left\|U_0-(δ^2\sin(m_0 y),δ^2\cos(m_0 y),0)\right\|_{X_0}\leq c_0 Re^{-7/4} $$ for some $c_0>0$ independent of $Re$, then the solution of 3-D incompressible Navier-Stokes equation is global in time and does not transit away from the planar helical flow. Here $δ>1, m_0=δ^{-1}$ and the norm $\|\cdot\|_{X_0}$ is defined in (1.8). This is a nonlinear stability result for 3-D non-shear flow and the transition threshold is less than $7/4$. △ Less

Submitted 20 July, 2024; v1 submitted 17 April, 2024; originally announced April 2024.

Comments: 38 pages

MSC Class: 35Q30; 35Q35; 76E06

Meshfree finite difference solution of homogeneous Dirichlet problems of the fractional Laplacian

Authors: Jinye Shen, Bowen Shi, Weizhang Huang

Abstract: A so-called grid-overlay finite difference method (GoFD) was proposed recently for the numerical solution of homogeneous Dirichlet boundary value problems of the fractional Laplacian on arbitrary bounded domains. It was shown to have advantages of both finite difference and finite element methods, including its efficient implementation through the fast Fourier transform and ability to work for com… ▽ More A so-called grid-overlay finite difference method (GoFD) was proposed recently for the numerical solution of homogeneous Dirichlet boundary value problems of the fractional Laplacian on arbitrary bounded domains. It was shown to have advantages of both finite difference and finite element methods, including its efficient implementation through the fast Fourier transform and ability to work for complex domains and with mesh adaptation. The purpose of this work is to study GoFD in a meshfree setting, a key to which is to construct the data transfer matrix from a given point cloud to a uniform grid. Two approaches are proposed, one based on the moving least squares fitting and the other based on the Delaunay triangulation and piecewise linear interpolation. Numerical results obtained for examples with convex and concave domains and various types of point clouds are presented. They show that both approaches lead to comparable results. Moreover, the resulting meshfree GoFD converges at a similar order as GoFD with unstructured meshes and finite element approximation as the number of points in the cloud increases. Furthermore, numerical results show that the method is robust to random perturbations in the location of the points. △ Less

Submitted 5 April, 2024; originally announced April 2024.

Comments: 18 pages

MSC Class: 65N06; 35R11

Understanding the PDHG Algorithm via High-Resolution Differential Equations

Authors: Bowen Li, Bin Shi

Abstract: The least absolute shrinkage and selection operator (Lasso) is widely recognized across various fields of mathematics and engineering. Its variant, the generalized Lasso, finds extensive application in the fields of statistics, machine learning, image science, and related areas. Among the optimization techniques used to tackle this issue, saddle-point methods stand out, with the primal-dual hybrid… ▽ More The least absolute shrinkage and selection operator (Lasso) is widely recognized across various fields of mathematics and engineering. Its variant, the generalized Lasso, finds extensive application in the fields of statistics, machine learning, image science, and related areas. Among the optimization techniques used to tackle this issue, saddle-point methods stand out, with the primal-dual hybrid gradient (PDHG) algorithm emerging as a particularly popular choice. However, the iterative behavior of PDHG remains poorly understood. In this paper, we employ dimensional analysis to derive a system of high-resolution ordinary differential equations (ODEs) tailored for PDHG. This system effectively captures a key feature of PDHG, the coupled $x$-correction and $y$-correction, distinguishing it from the proximal Arrow-Hurwicz algorithm. The small but essential perturbation ensures that PDHG consistently converges, bypassing the periodic behavior observed in the proximal Arrow-Hurwicz algorithm. Through Lyapunov analysis, We investigate the convergence behavior of the system of high-resolution ODEs and extend our insights to the discrete PDHG algorithm. Our analysis indicates that numerical errors resulting from the implicit scheme serve as a crucial factor affecting the convergence rate and monotonicity of PDHG, showcasing a noteworthy pattern also observed for the Alternating Direction Method of Multipliers (ADMM), as identified in [Li and Shi, 2024]. In addition, we further discover that when one component of the objective function is strongly convex, the iterative average of PDHG converges strongly at a rate $O(1/N)$, where $N$ is the number of iterations. △ Less

Submitted 17 March, 2024; originally announced March 2024.

Comments: 24 pages, 3 figures

Quantitative estimates in almost periodic homogenization of parabolic systems

Authors: Jun Geng, Bojing Shi

Abstract: We consider a family of second-order parabolic operators $\partial_t+\mathcal{L}_\varepsilon$ in divergence form with rapidly oscillating, time-dependent and almost-periodic coefficients. We establish uniform interior and boundary Hölder and Lipschitz estimates as well as convergence rate. The estimates of fundamental solution and Green's function are also established. In contrast to periodic case… ▽ More We consider a family of second-order parabolic operators $\partial_t+\mathcal{L}_\varepsilon$ in divergence form with rapidly oscillating, time-dependent and almost-periodic coefficients. We establish uniform interior and boundary Hölder and Lipschitz estimates as well as convergence rate. The estimates of fundamental solution and Green's function are also established. In contrast to periodic case, the main difficulty is that the corrector equation $ (\partial_s+\mathcal{L}_1)(χ^β_{j})=-\mathcal{L}_1(P^β_j) $ in $\mathbb{R}^{d+1}$ may not be solvable in the almost periodic setting for linear functions $P(y)$ and $\partial_t χ_S$ may not in $B^2(\mathbb{R}^{d+1})$. Our results are new even in the case of time-independent coefficients. △ Less

Submitted 12 March, 2024; originally announced March 2024.

Comments: 61 pages

Understanding the ADMM Algorithm via High-Resolution Differential Equations

Authors: Bowen Li, Bin Shi

Abstract: In the fields of statistics, machine learning, image science, and related areas, there is an increasing demand for decentralized collection or storage of large-scale datasets, as well as distributed solution methods. To tackle this challenge, the alternating direction method of multipliers (ADMM) has emerged as a widely used approach, particularly well-suited to distributed convex optimization. Ho… ▽ More In the fields of statistics, machine learning, image science, and related areas, there is an increasing demand for decentralized collection or storage of large-scale datasets, as well as distributed solution methods. To tackle this challenge, the alternating direction method of multipliers (ADMM) has emerged as a widely used approach, particularly well-suited to distributed convex optimization. However, the iterative behavior of ADMM has not been well understood. In this paper, we employ dimensional analysis to derive a system of high-resolution ordinary differential equations (ODEs) for ADMM. This system captures an important characteristic of ADMM, called the $λ$-correction, which causes the trajectory of ADMM to deviate from the constrained hyperplane. To explore the convergence behavior of the system of high-resolution ODEs, we utilize Lyapunov analysis and extend our findings to the discrete ADMM algorithm. Through this analysis, we identify that the numerical error resulting from the implicit scheme is a crucial factor that affects the convergence rate and monotonicity in the discrete ADMM algorithm. In addition, we further discover that if one component of the objective function is assumed to be strongly convex, the iterative average of ADMM converges strongly with a rate $O(1/N)$, where $N$ is the number of iterations. △ Less

Submitted 13 January, 2024; originally announced January 2024.

Comments: 22 pages

Regularized lattice Boltzmann method based maximum principle and energy stability preserving finite-difference scheme for the Allen-Cahn equation

Authors: Ying Chen, Xi Liu, Zhenhua Chai, Baochang Shi

Abstract: The Allen-Cahn equation (ACE) inherently possesses two crucial properties: the maximum principle and the energy dissipation law. Preserving these two properties at the discrete level is also necessary in the numerical methods for the ACE. In this paper, unlike the traditional top-down macroscopic numerical schemes which discretize the ACE directly, we first propose a novel bottom-up mesoscopic reg… ▽ More The Allen-Cahn equation (ACE) inherently possesses two crucial properties: the maximum principle and the energy dissipation law. Preserving these two properties at the discrete level is also necessary in the numerical methods for the ACE. In this paper, unlike the traditional top-down macroscopic numerical schemes which discretize the ACE directly, we first propose a novel bottom-up mesoscopic regularized lattice Boltzmann method based macroscopic numerical scheme for d (=1, 2, 3)-dimensional ACE, where the DdQ(2d+1) [(2d+1) discrete velocities in d-dimensional space] lattice structure is adopted. In particular, the proposed macroscopic numerical scheme has a second-order accuracy in space, and can also be viewd as an implicit-explicit finite-difference scheme for the ACE, in which the nonlinear term is discretized semi-implicitly, the temporal derivative and dissipation term of the ACE are discretized by using the explicit Euler method and second-order central difference method, respectively. Then we also demonstrate that the proposed scheme can preserve the maximum bound principle and the original energy dissipation law at the discrete level under some conditions. Finally, some numerical experiments are conducted to validate our theoretical analysis. △ Less

Submitted 3 January, 2024; v1 submitted 12 December, 2023; originally announced December 2023.

Suppression of blow-up in 3-D Keller-Segel model via Couette flow in whole space

Authors: Shijin Deng, Binbin Shi, Weike Wang

Abstract: In this paper, we study the 3-D parabolic-parabolic and parabolic-elliptic Keller-Segel models with Couette flow in $\mathbb{R}^3$. We prove that the blow-up phenomenon of solution can be suppressed by enhanced dissipation of large Couette flows. Here we develop Green's function method to describe the enhanced dissipation via a more precise space-time structure and obtain the global existence toge… ▽ More In this paper, we study the 3-D parabolic-parabolic and parabolic-elliptic Keller-Segel models with Couette flow in $\mathbb{R}^3$. We prove that the blow-up phenomenon of solution can be suppressed by enhanced dissipation of large Couette flows. Here we develop Green's function method to describe the enhanced dissipation via a more precise space-time structure and obtain the global existence together with pointwise estimates of the solutions. The result of this paper shows that the enhanced dissipation exists for all frequencies in the case of whole space and it is reason that we obtain global existence for 3-D Keller-Segel models here. It is totally different from the case with the periodic spatial variable $x$ in [2,10]. This paper provides a new methodology to capture dissipation enhancement and also a surprising result which shows a totally new mechanism. △ Less

Submitted 31 December, 2023; v1 submitted 30 November, 2023; originally announced November 2023.

Comments: 22 page

MSC Class: 35B40; 35B45

Finite elements for symmetric and traceless tensors in three dimensions

Authors: Kaibo Hu, Ting Lin, Bowen Shi

Abstract: We construct a family of finite element sub-complexes of the conformal complex on tetrahedral meshes. This complex includes vector fields and symmetric and traceless tensor fields, interlinked through the conformal Killing operator, the linearized Cotton-York operator, and the divergence operator, respectively. This leads to discrete versions of transverse traceless (TT) tensors and York splits in… ▽ More We construct a family of finite element sub-complexes of the conformal complex on tetrahedral meshes. This complex includes vector fields and symmetric and traceless tensor fields, interlinked through the conformal Killing operator, the linearized Cotton-York operator, and the divergence operator, respectively. This leads to discrete versions of transverse traceless (TT) tensors and York splits in general relativity. We provide bubble complexes and investigate supersmoothness to facilitate the construction. We show the exactness of the finite element complex on contractible domains. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Comments: 44 pages, 1 figure

A Cole-Hopf transformation based fourth-order multiple-relaxation-time lattice Boltzmann model for the coupled Burgers' equations

Authors: Ying Chen, Xi Liu, Zhenhua Chai, Baochang Shi

Abstract: In this work, a Cole-Hopf transformation based fourth-order multiple-relaxation-time lattice Boltzmann (MRT-LB) model for d-dimensional coupled Burgers' equations is developed. We first adopt the Cole-Hopf transformation where an intermediate variable θis introduced to eliminate the nonlinear convection terms in the Burgers' equations on the velocity u=(u_1,u_2,...,u_d). In this case, a diffusion… ▽ More In this work, a Cole-Hopf transformation based fourth-order multiple-relaxation-time lattice Boltzmann (MRT-LB) model for d-dimensional coupled Burgers' equations is developed. We first adopt the Cole-Hopf transformation where an intermediate variable θis introduced to eliminate the nonlinear convection terms in the Burgers' equations on the velocity u=(u_1,u_2,...,u_d). In this case, a diffusion equation on the variable θcan be obtained, and particularly, the velocity u in the coupled Burgers' equations is determined by the variable θand its gradient term \nablaθ. Then we develop a general MRT-LB model with the natural moments for the d-dimensional transformed diffusion equation and present the corresponding macroscopic finite-difference scheme. At the diffusive scaling, the fourth-order modified equation of the developed MRT-LB model is derived through the Maxwell iteration method. With the aid of the free parameters in the MRT-LB model, we find that not only the consistent fourth-order modified equation can be obtained, but also the gradient term $\nablaθ$ can be calculated locally by the non-equilibrium distribution function with a fourth-order accuracy, this indicates that theoretically, the MRT-LB model for $d$-dimensional coupled Burgers' equations can achieve a fourth-order accuracy in space. Finally, some simulations are conducted to test the MRT-LB model, and the numerical results show that the proposed MRT-LB model has a fourth-order convergence rate, which is consistent with our theoretical analysis. △ Less

Submitted 6 September, 2023; originally announced September 2023.

Enhanced dissipation and blow-up suppression for the three dimensional Keller-Segel equation with a non-shear incompressible flow

Authors: Binbin Shi, Weike Wang

Abstract: In this paper, we consider the Cauchy problem for the three dimensional parabolic-elliptic Keller-Segel equation with a large non-shear incompressible flow. Without advection, there exist solution with arbitrarily mass which blow up in finite time. Firstly, we introduce a three dimensional non-shear incompressible flow and study the enhanced dissipation of such flows by resolvent estimate method.… ▽ More In this paper, we consider the Cauchy problem for the three dimensional parabolic-elliptic Keller-Segel equation with a large non-shear incompressible flow. Without advection, there exist solution with arbitrarily mass which blow up in finite time. Firstly, we introduce a three dimensional non-shear incompressible flow and study the enhanced dissipation of such flows by resolvent estimate method. Next, we show that the enhanced dissipation of such flow can suppress blow-up of solution to three dimensional parabolic-elliptic Keller-Segel equation and establish global classical solution with large initial data. △ Less

Submitted 29 August, 2023; originally announced August 2023.

Comments: 25 page

MSC Class: 35A01; 35B45; 35Q92; 76F25

The Sampling Method for Optimal Precursors of ENSO Events

Authors: Bin Shi, Junjie Ma

Abstract: El Niño-Southern Oscillation (ENSO) is one of the significant climate phenomena, which appears periodically in the tropic Pacific. The intermediate coupled ocean-atmosphere Zebiak-Cane (ZC) model is the first and classical one designed to numerically forecast the ENSO events. Traditionally, the conditional nonlinear optimal perturbation (CNOP) approach has been used to capture optimal precursors i… ▽ More El Niño-Southern Oscillation (ENSO) is one of the significant climate phenomena, which appears periodically in the tropic Pacific. The intermediate coupled ocean-atmosphere Zebiak-Cane (ZC) model is the first and classical one designed to numerically forecast the ENSO events. Traditionally, the conditional nonlinear optimal perturbation (CNOP) approach has been used to capture optimal precursors in practice. In this paper, based on state-of-the-art statistical machine learning techniques, we investigate the sampling algorithm proposed in [Shi and Sun, 2023] to obtain optimal precursors via the CNOP approach in the ZC model. For the ZC model, or more generally, the numerical models with dimension $\mathrm{O}(10^4-10^5)$, the numerical performance, regardless of the statically spatial patterns and the dynamical nonlinear time evolution behaviors as well as the corresponding quantities and indices, shows the high efficiency of the sampling method by comparison with the traditional adjoint method. The sampling algorithm does not only reduce the gradient (first-order information) to the objective function value (zeroth-order information) but also avoids the use of the adjoint model, which is hard to develop in the coupled ocean-atmosphere models and the parameterization models. In addition, based on the key characteristic that the samples are independently and identically distributed, we can implement the sampling algorithm by parallel computation to shorten the computation time. Meanwhile, we also show in the numerical experiments that the important features of optimal precursors can be still captured even when the number of samples is reduced sharply. △ Less

Submitted 26 August, 2023; originally announced August 2023.

Comments: 13 pages, 4 figures, 2 tables

The macroscopic finite-difference scheme and modified equations of the general propagation multiple-relaxation-time lattice Boltzmann model

Authors: Ying Chen, Xi Liu, Zhenhua Chai, Baochang Shi

Abstract: In this paper, we first present the general propagation multiple-relaxation-time lattice Boltzmann (GPMRT-LB) model and obtain the corresponding macroscopic finite-difference (GPMFD) scheme on conservative moments. Then based on the Maxwell iteration method, we conduct the analysis on the truncation errors and modified equations (MEs) of the GPMRT-LB model and GPMFD scheme at both diffusive and ac… ▽ More In this paper, we first present the general propagation multiple-relaxation-time lattice Boltzmann (GPMRT-LB) model and obtain the corresponding macroscopic finite-difference (GPMFD) scheme on conservative moments. Then based on the Maxwell iteration method, we conduct the analysis on the truncation errors and modified equations (MEs) of the GPMRT-LB model and GPMFD scheme at both diffusive and acoustic scalings. For the nonlinear anisotropic convection-diffusion equation (NACDE) and Navier-Stokes equations (NSEs), we also derive the first- and second-order MEs of the GPMRT-LB model and GPMFD scheme. In particular, for the one-dimensional convection-diffusion equation (CDE) with the constant velocity and diffusion coefficient, we can develop a fourth-order GPMRT-LB (F-GPMRT-LB) model and the corresponding fourth-order GPMFD (F-GPMFD) scheme at the diffusive scaling. Finally, two benchmark problems, Gauss hill problem and Poiseuille flow in two-dimensional space, are used to test the GPMRT-LB model and GPMFD scheme, and it is found that the numerical results are not only in good agreement with corresponding analytical solutions, but also have a second-order convergence rate in space. Additionally, a numerical study on one-dimensional CDE also demonstrates that the F-GPMRT-LB model and F-GPMFD scheme can achieve a fourth-order accuracy in space, which is consistent with our theoretical analysis. △ Less

Submitted 22 August, 2023; originally announced August 2023.

A general fourth-order mesoscopic multiple-relaxation-time lattice Boltzmann model and equivalent macroscopic finite-difference scheme for two-dimensional diffusion equations

Authors: Ying Chen, Zhenhua Chai, Baochang Shi

Abstract: In this work, we first develop a general mesoscopic multiple-relaxation-time lattice Boltzmann (MRT-LB) model for the two-dimensional diffusion equation with the constant diffusion coefficient and source term, where the D2Q5 (five discrete velocities in two-dimensional space) lattice structure is considered. Then we exactly derive the equivalent macroscopic finite-difference scheme of the MRT-LB m… ▽ More In this work, we first develop a general mesoscopic multiple-relaxation-time lattice Boltzmann (MRT-LB) model for the two-dimensional diffusion equation with the constant diffusion coefficient and source term, where the D2Q5 (five discrete velocities in two-dimensional space) lattice structure is considered. Then we exactly derive the equivalent macroscopic finite-difference scheme of the MRT-LB model. Additionally, we also propose a proper MRT-LB model for the diffusion equation with a linear source term, and obtain an equivalent macroscopic six-level finite-difference scheme. After that, we conduct the accuracy and stability analysis of the finite-difference scheme and the mesoscopic MRT-LB model. It is found that at the diffusive scaling, both of them can achieve a fourth-order accuracy in space based on the Taylor expansion. The stability analysis also shows that they are both unconditionally stable. Finally, some numerical experiments are conducted, and the numerical results are also consistent with our theoretical analysis. △ Less

Submitted 9 August, 2023; originally announced August 2023.

Linear convergence of forward-backward accelerated algorithms without knowledge of the modulus of strong convexity

Authors: Bowen Li, Bin Shi, Ya-xiang Yuan

Abstract: A significant milestone in modern gradient-based optimization was achieved with the development of Nesterov's accelerated gradient descent (NAG) method. This forward-backward technique has been further advanced with the introduction of its proximal generalization, commonly known as the fast iterative shrinkage-thresholding algorithm (FISTA), which enjoys widespread application in image science and… ▽ More A significant milestone in modern gradient-based optimization was achieved with the development of Nesterov's accelerated gradient descent (NAG) method. This forward-backward technique has been further advanced with the introduction of its proximal generalization, commonly known as the fast iterative shrinkage-thresholding algorithm (FISTA), which enjoys widespread application in image science and engineering. Nonetheless, it remains unclear whether both NAG and FISTA exhibit linear convergence for strongly convex functions. Remarkably, these algorithms demonstrate convergence without requiring any prior knowledge of strongly convex modulus, and this intriguing characteristic has been acknowledged as an open problem in the comprehensive review [Chambolle and Pock, 2016, Appendix B]. In this paper, we address this question by utilizing the high-resolution ordinary differential equation (ODE) framework. Expanding upon the established phase-space representation, we emphasize the distinctive approach employed in crafting the Lyapunov function, which involves a dynamically adapting coefficient of kinetic energy that evolves throughout the iterations. Furthermore, we highlight that the linear convergence of both NAG and FISTA is independent of the parameter $r$. Additionally, we demonstrate that the square of the proximal subgradient norm likewise advances towards linear convergence. △ Less

Submitted 8 April, 2024; v1 submitted 16 June, 2023; originally announced June 2023.

Comments: 17 pages, 3 figures; To appear in SIAM Journal on Optimization

On Underdamped Nesterov's Acceleration

Authors: Shuo Chen, Bin Shi, Ya-xiang Yuan

Abstract: The high-resolution differential equation framework has been proven to be tailor-made for Nesterov's accelerated gradient descent method~(\texttt{NAG}) and its proximal correspondence -- the class of faster iterative shrinkage thresholding algorithms (FISTA). However, the systems of theories is not still complete, since the underdamped case ($r < 2$) has not been included. In this paper, based on… ▽ More The high-resolution differential equation framework has been proven to be tailor-made for Nesterov's accelerated gradient descent method~(\texttt{NAG}) and its proximal correspondence -- the class of faster iterative shrinkage thresholding algorithms (FISTA). However, the systems of theories is not still complete, since the underdamped case ($r < 2$) has not been included. In this paper, based on the high-resolution differential equation framework, we construct the new Lyapunov functions for the underdamped case, which is motivated by the power of the time $t^γ$ or the iteration $k^γ$ in the mixed term. When the momentum parameter $r$ is $2$, the new Lyapunov functions are identical to the previous ones. These new proofs do not only include the convergence rate of the objective value previously obtained according to the low-resolution differential equation framework but also characterize the convergence rate of the minimal gradient norm square. All the convergence rates obtained for the underdamped case are continuously dependent on the parameter $r$. In addition, it is observed that the high-resolution differential equation approximately simulates the convergence behavior of~\texttt{NAG} for the critical case $r=-1$, while the low-resolution differential equation degenerates to the conservative Newton's equation. The high-resolution differential equation framework also theoretically characterizes the convergence rates, which are consistent with that obtained for the underdamped case with $r=-1$. △ Less

Submitted 28 April, 2023; originally announced April 2023.

Comments: 21 pages, 4 figures, 2 tables

Concentration Inequalities for Sums of Markov Dependent Random Matrices

Authors: Joe Neeman, Bobby Shi, Rachel Ward

Abstract: We give Hoeffding and Bernstein-type concentration inequalities for the largest eigenvalue of sums of random matrices arising from a Markov chain. We consider time-dependent matrix-valued functions on a general state space, generalizing previous that had only considered Hoeffding-type inequalities, and only for time-independent functions on a finite state space. In particular, we study a kind of n… ▽ More We give Hoeffding and Bernstein-type concentration inequalities for the largest eigenvalue of sums of random matrices arising from a Markov chain. We consider time-dependent matrix-valued functions on a general state space, generalizing previous that had only considered Hoeffding-type inequalities, and only for time-independent functions on a finite state space. In particular, we study a kind of noncommutative moment generating function, give tight bounds on it, and use a method of Garg et al. to turn this into tail bounds. Our proof proceeds spectrally, bounding the norm of a certain perturbed operator. In the process we make an interesting connection to dynamical systems and Banach space theory to prove a crucial result on the limiting behavior of our moment generating function that may be of independent interest. △ Less

Submitted 16 October, 2023; v1 submitted 3 March, 2023; originally announced March 2023.

Remote detectability from entanglement bootstrap I: Kirby's torus trick

Authors: Bowen Shi, Jin-Long Huang, John McGreevy

Abstract: Remote detectability is often taken as a physical assumption in the study of topologically ordered systems, and it is a central axiom of mathematical frameworks of topological quantum field theories. We show under the entanglement bootstrap approach that remote detectability is a necessary property; that is, we derive it as a theorem. Starting from a single wave function on a topologically-trivial… ▽ More Remote detectability is often taken as a physical assumption in the study of topologically ordered systems, and it is a central axiom of mathematical frameworks of topological quantum field theories. We show under the entanglement bootstrap approach that remote detectability is a necessary property; that is, we derive it as a theorem. Starting from a single wave function on a topologically-trivial region satisfying the entanglement bootstrap axioms, we can construct states on closed manifolds. The crucial technique is to immerse the punctured manifold into the topologically trivial region and then heal the puncture. This is analogous to Kirby's torus trick. We then analyze a special class of such manifolds, which we call pairing manifolds. For each pairing manifold, which pairs two classes of excitations, we identify an analog of the topological $S$-matrix. This pairing matrix is unitary, which implies remote detectability between two classes of excitations. These matrices are in general not associated with the mapping class group of the manifold. As a by-product, we can count excitation types (e.g., graph excitations in 3+1d). The pairing phenomenon occurs in many physical contexts, including systems in different dimensions, with or without gapped boundaries. We provide a variety of examples to illustrate its scope. △ Less

Submitted 17 April, 2024; v1 submitted 17 January, 2023; originally announced January 2023.

Comments: 110+20 pages. Many figures

Linear Convergence of ISTA and FISTA

Authors: Bowen Li, Bin Shi, Ya-xiang Yuan

Abstract: In this paper, we revisit the class of iterative shrinkage-thresholding algorithms (ISTA) for solving the linear inverse problem with sparse representation, which arises in signal and image processing. It is shown in the numerical experiment to deblur an image that the convergence behavior in the logarithmic-scale ordinate tends to be linear instead of logarithmic, approximating to be flat. Making… ▽ More In this paper, we revisit the class of iterative shrinkage-thresholding algorithms (ISTA) for solving the linear inverse problem with sparse representation, which arises in signal and image processing. It is shown in the numerical experiment to deblur an image that the convergence behavior in the logarithmic-scale ordinate tends to be linear instead of logarithmic, approximating to be flat. Making meticulous observations, we find that the previous assumption for the smooth part to be convex weakens the least-square model. Specifically, assuming the smooth part to be strongly convex is more reasonable for the least-square model, even though the image matrix is probably ill-conditioned. Furthermore, we improve the pivotal inequality tighter for composite optimization with the smooth part to be strongly convex instead of general convex, which is first found in [Li et al., 2022]. Based on this pivotal inequality, we generalize the linear convergence to composite optimization in both the objective value and the squared proximal subgradient norm. Meanwhile, we set a simple ill-conditioned matrix which is easy to compute the singular values instead of the original blur matrix. The new numerical experiment shows the proximal generalization of Nesterov's accelerated gradient descent (NAG) for the strongly convex function has a faster linear convergence rate than ISTA. Based on the tighter pivotal inequality, we also generalize the faster linear convergence rate to composite optimization, in both the objective value and the squared proximal subgradient norm, by taking advantage of the well-constructed Lyapunov function with a slight modification and the phase-space representation based on the high-resolution differential equation framework from the implicit-velocity scheme. △ Less

Submitted 14 January, 2023; v1 submitted 12 December, 2022; originally announced December 2022.

Comments: 16 pages, 4 figures

Revisiting the acceleration phenomenon via high-resolution differential equations

Authors: Shuo Chen, Bin Shi, Ya-xiang Yuan

Abstract: Nesterov's accelerated gradient descent (NAG) is one of the milestones in the history of first-order algorithms. It was not successfully uncovered until the high-resolution differential equation framework was proposed in [Shi et al., 2022] that the mechanism behind the acceleration phenomenon is due to the gradient correction term. To deepen our understanding of the high-resolution differential eq… ▽ More Nesterov's accelerated gradient descent (NAG) is one of the milestones in the history of first-order algorithms. It was not successfully uncovered until the high-resolution differential equation framework was proposed in [Shi et al., 2022] that the mechanism behind the acceleration phenomenon is due to the gradient correction term. To deepen our understanding of the high-resolution differential equation framework on the convergence rate, we continue to investigate NAG for the $μ$-strongly convex function based on the techniques of Lyapunov analysis and phase-space representation in this paper. First, we revisit the proof from the gradient-correction scheme. Similar to [Chen et al., 2022], the straightforward calculation simplifies the proof extremely and enlarges the step size to $s=1/L$ with minor modification. Meanwhile, the way of constructing Lyapunov functions is principled. Furthermore, we also investigate NAG from the implicit-velocity scheme. Due to the difference in the velocity iterates, we find that the Lyapunov function is constructed from the implicit-velocity scheme without the additional term and the calculation of iterative difference becomes simpler. Together with the optimal step size obtained, the high-resolution differential equation framework from the implicit-velocity scheme of NAG is perfect and outperforms the gradient-correction scheme. △ Less

Submitted 11 December, 2022; originally announced December 2022.

Comments: 17 pages

Proximal Subgradient Norm Minimization of ISTA and FISTA

Authors: Bowen Li, Bin Shi, Ya-xiang Yuan

Abstract: For first-order smooth optimization, the research on the acceleration phenomenon has a long-time history. Until recently, the mechanism leading to acceleration was not successfully uncovered by the gradient correction term and its equivalent implicit-velocity form. Furthermore, based on the high-resolution differential equation framework with the corresponding emerging techniques, phase-space repr… ▽ More For first-order smooth optimization, the research on the acceleration phenomenon has a long-time history. Until recently, the mechanism leading to acceleration was not successfully uncovered by the gradient correction term and its equivalent implicit-velocity form. Furthermore, based on the high-resolution differential equation framework with the corresponding emerging techniques, phase-space representation and Lyapunov function, the squared gradient norm of Nesterov's accelerated gradient descent (\texttt{NAG}) method at an inverse cubic rate is discovered. However, this result cannot be directly generalized to composite optimization widely used in practice, e.g., the linear inverse problem with sparse representation. In this paper, we meticulously observe a pivotal inequality used in composite optimization about the step size $s$ and the Lipschitz constant $L$ and find that it can be improved tighter. We apply the tighter inequality discovered in the well-constructed Lyapunov function and then obtain the proximal subgradient norm minimization by the phase-space representation, regardless of gradient-correction or implicit-velocity. Furthermore, we demonstrate that the squared proximal subgradient norm for the class of iterative shrinkage-thresholding algorithms (ISTA) converges at an inverse square rate, and the squared proximal subgradient norm for the class of faster iterative shrinkage-thresholding algorithms (FISTA) is accelerated to convergence at an inverse cubic rate. △ Less

Submitted 3 November, 2022; originally announced November 2022.

Comments: 17 pages, 4 figures

Gradient Norm Minimization of Nesterov Acceleration: $o(1/k^3)$

Authors: Shuo Chen, Bin Shi, Ya-xiang Yuan

Abstract: In the history of first-order algorithms, Nesterov's accelerated gradient descent (NAG) is one of the milestones. However, the cause of the acceleration has been a mystery for a long time. It has not been revealed with the existence of gradient correction until the high-resolution differential equation framework proposed in [Shi et al., 2021]. In this paper, we continue to investigate the accelera… ▽ More In the history of first-order algorithms, Nesterov's accelerated gradient descent (NAG) is one of the milestones. However, the cause of the acceleration has been a mystery for a long time. It has not been revealed with the existence of gradient correction until the high-resolution differential equation framework proposed in [Shi et al., 2021]. In this paper, we continue to investigate the acceleration phenomenon. First, we provide a significantly simplified proof based on precise observation and a tighter inequality for $L$-smooth functions. Then, a new implicit-velocity high-resolution differential equation framework, as well as the corresponding implicit-velocity version of phase-space representation and Lyapunov function, is proposed to investigate the convergence behavior of the iterative sequence $\{x_k\}_{k=0}^{\infty}$ of NAG. Furthermore, from two kinds of phase-space representations, we find that the role played by gradient correction is equivalent to that by velocity included implicitly in the gradient, where the only difference comes from the iterative sequence $\{y_{k}\}_{k=0}^{\infty}$ replaced by $\{x_k\}_{k=0}^{\infty}$. Finally, for the open question of whether the gradient norm minimization of NAG has a faster rate $o(1/k^3)$, we figure out a positive answer with its proof. Meanwhile, a faster rate of objective value minimization $o(1/k^2)$ is shown for the case $r > 2$. △ Less

Submitted 19 September, 2022; originally announced September 2022.

Comments: 16 pages

An adjoint-free algorithm for conditional nonlinear optimal perturbations (CNOPs) via sampling

Authors: Bin Shi, Guodong Sun

Abstract: In this paper, we propose a sampling algorithm based on state-of-the-art statistical machine learning techniques to obtain conditional nonlinear optimal perturbations (CNOPs), which is different from traditional (deterministic) optimization methods.1 Specifically, the traditional approach is unavailable in practice, which requires numerically computing the gradient (first-order information) such t… ▽ More In this paper, we propose a sampling algorithm based on state-of-the-art statistical machine learning techniques to obtain conditional nonlinear optimal perturbations (CNOPs), which is different from traditional (deterministic) optimization methods.1 Specifically, the traditional approach is unavailable in practice, which requires numerically computing the gradient (first-order information) such that the computation cost is expensive, since it needs a large number of times to run numerical models. However, the sampling approach directly reduces the gradient to the objective function value (zeroth-order information), which also avoids using the adjoint technique that is unusable for many atmosphere and ocean models and requires large amounts of storage. We show an intuitive analysis for the sampling algorithm from the law of large numbers and further present a Chernoff-type concentration inequality to rigorously characterize the degree to which the sample average probabilistically approximates the exact gradient. The experiments are implemented to obtain the CNOPs for two numerical models, the Burgers equation with small viscosity and the Lorenz-96 model. We demonstrate the CNOPs obtained with their spatial patterns, objective values, computation times, and nonlinear error growth. Compared with the performance of the three approaches, all the characters for quantifying the CNOPs are nearly consistent, while the computation time using the sampling approach with fewer samples is much shorter. In other words, the new sampling algorithm shortens the computation time to the utmost at the cost of losing little accuracy. △ Less

Submitted 24 March, 2024; v1 submitted 1 August, 2022; originally announced August 2022.

Comments: 20 pages, 6 figures, 4 tables

Journal ref: Nonlin. Processes Geophys.,30,263-276,2023

Hierarchies of Critical Points of a Landau-de Gennes Free Energy on Three-Dimensional Cuboids

Authors: Baoming Shi, Yucen Han, Jianyuan Yin, Apala Majumdar, Lei Zhang

Abstract: We investigate critical points of a Landau-de Gennes (LdG) free energy in three-dimensional (3D) cuboids, that model nematic equilibria. We develop a hybrid saddle dynamics-based algorithm to efficiently compute solution landscapes of these 3D systems. Our main results concern (a) the construction of 3D LdG critical points from a database of 2D LdG critical points and (b) studies of the effects of… ▽ More We investigate critical points of a Landau-de Gennes (LdG) free energy in three-dimensional (3D) cuboids, that model nematic equilibria. We develop a hybrid saddle dynamics-based algorithm to efficiently compute solution landscapes of these 3D systems. Our main results concern (a) the construction of 3D LdG critical points from a database of 2D LdG critical points and (b) studies of the effects of cross-section size and cuboid height on solution landscapes. In doing so, we discover multiple-layer 3D LdG critical points constructed by stacking 3D critical points on top of each other, novel pathways between distinct energy minima mediated by 3D LdG critical points and novel metastable escaped solutions, all of which can be tuned for tailor-made static and dynamic properties of confined nematic liquid crystal systems in 3D. △ Less

Submitted 28 March, 2023; v1 submitted 1 April, 2022; originally announced April 2022.

SHRIMP: Sparser Random Feature Models via Iterative Magnitude Pruning

Authors: Yuege Xie, Bobby Shi, Hayden Schaeffer, Rachel Ward

Abstract: Sparse shrunk additive models and sparse random feature models have been developed separately as methods to learn low-order functions, where there are few interactions between variables, but neither offers computational efficiency. On the other hand, $\ell_2$-based shrunk additive models are efficient but do not offer feature selection as the resulting coefficient vectors are dense. Inspired by th… ▽ More Sparse shrunk additive models and sparse random feature models have been developed separately as methods to learn low-order functions, where there are few interactions between variables, but neither offers computational efficiency. On the other hand, $\ell_2$-based shrunk additive models are efficient but do not offer feature selection as the resulting coefficient vectors are dense. Inspired by the success of the iterative magnitude pruning technique in finding lottery tickets of neural networks, we propose a new method -- Sparser Random Feature Models via IMP (ShRIMP) -- to efficiently fit high-dimensional data with inherent low-dimensional structure in the form of sparse variable dependencies. Our method can be viewed as a combined process to construct and find sparse lottery tickets for two-layer dense networks. We explain the observed benefit of SHRIMP through a refined analysis on the generalization error for thresholded Basis Pursuit and resulting bounds on eigenvalues. From function approximation experiments on both synthetic data and real-world benchmark datasets, we show that SHRIMP obtains better than or competitive test accuracy compared to state-of-art sparse feature and additive methods such as SRFE-S, SSAM, and SALSA. Meanwhile, SHRIMP performs feature selection with low computational complexity and is robust to the pruning rate, indicating a robustness in the structure of the obtained subnetworks. We gain insight into the lottery ticket hypothesis through SHRIMP by noting a correspondence between our model and weight/neuron subnetworks. △ Less

Submitted 7 December, 2021; originally announced December 2021.

Global well-posedness for a generalized Keller-Segel system with degenerate dissipation and mixing

Authors: Binbin Shi, Weike Wang

Abstract: We study the mixing effect for a generalized Keller-Segel system with degenerate dissipation and advection by a weakly mixing. Here the attractive operator has weak singularity, namely, the negative derivative appears in the nonlinear term by singular integral. Without advection, the solution of equation blows up in finite time. We show that the global well-posedness of solution with large advecti… ▽ More We study the mixing effect for a generalized Keller-Segel system with degenerate dissipation and advection by a weakly mixing. Here the attractive operator has weak singularity, namely, the negative derivative appears in the nonlinear term by singular integral. Without advection, the solution of equation blows up in finite time. We show that the global well-posedness of solution with large advection. Since dissipation term degenerate into the damping, the enhanced dissipation effect of mixing no longer occurs, we prove that the mixing effect can weak the influence of nonlinear term. In this case, the mixing effect is similar with inviscid damping of shear flow. Combining to the mixing effect and damping effect of degenerate dissipation, the global $L^\infty$ estimate of solution is established. △ Less

Submitted 22 November, 2021; originally announced November 2021.

Comments: 19 page. arXiv admin note: text overlap with arXiv:2103.04484

MSC Class: 35A01; 35B45; 35R11; 35Q92

Nematic liquid crystals in a rectangular confinement: solution landscape and bifurcation

Authors: Baoming Shi, Yucen Han, Lei Zhang

Abstract: We study the solution landscape and bifurcation diagrams of nematic liquid crystals confined on a rectangle, using a reduced two-dimensional Landau--de Gennes framework in terms of two geometry-dependent variables: half short edge length $λ$ and aspect ratio $b$. First, we analytically prove that, for any $b$ with a small enough $λ$ or for a large enough $b$ with a fixed domain size, there is a un… ▽ More We study the solution landscape and bifurcation diagrams of nematic liquid crystals confined on a rectangle, using a reduced two-dimensional Landau--de Gennes framework in terms of two geometry-dependent variables: half short edge length $λ$ and aspect ratio $b$. First, we analytically prove that, for any $b$ with a small enough $λ$ or for a large enough $b$ with a fixed domain size, there is a unique stable solution that has two line defects on the opposite short edges. Second, we numerically construct solution landscapes by varying $λ$ and $b$, and report a novel X state, which emerges from saddle-node bifurcation and serves as the parent state in such a solution landscape. Various new classes are then found among these solution landscapes, including the X class, the S class, and the L class. By tracking the Morse indices of individual solutions, we present bifurcation diagrams for nematic equilibria, thus illustrating the emergence mechanism of critical points and several effects of geometrical anisotropy on confined defect patterns. △ Less

Submitted 21 September, 2021; originally announced September 2021.

Comments: 20 pages, 8 figures

On the Hyperparameters in Stochastic Gradient Descent with Momentum

Authors: Bin Shi

Abstract: Following the same routine as [SSJ20], we continue to present the theoretical analysis for stochastic gradient descent with momentum (SGD with momentum) in this paper. Differently, for SGD with momentum, we demonstrate it is the two hyperparameters together, the learning rate and the momentum coefficient, that play the significant role for the linear rate of convergence in non-convex optimization.… ▽ More Following the same routine as [SSJ20], we continue to present the theoretical analysis for stochastic gradient descent with momentum (SGD with momentum) in this paper. Differently, for SGD with momentum, we demonstrate it is the two hyperparameters together, the learning rate and the momentum coefficient, that play the significant role for the linear rate of convergence in non-convex optimization. Our analysis is based on the use of a hyperparameters-dependent stochastic differential equation (hp-dependent SDE) that serves as a continuous surrogate for SGD with momentum. Similarly, we establish the linear convergence for the continuous-time formulation of SGD with momentum and obtain an explicit expression for the optimal linear rate by analyzing the spectrum of the Kramers-Fokker-Planck operator. By comparison, we demonstrate how the optimal linear rate of convergence and the final gap for SGD only about the learning rate varies with the momentum coefficient increasing from zero to one when the momentum is introduced. Then, we propose a mathematical interpretation why the SGD with momentum converges faster and more robust about the learning rate than the standard SGD in practice. Finally, we show the Nesterov momentum under the existence of noise has no essential difference with the standard momentum. △ Less

Submitted 11 September, 2022; v1 submitted 9 August, 2021; originally announced August 2021.

Comments: 34 pages, 4 figures. arXiv admin note: text overlap with arXiv:2004.06977

Conjugate and cut points in ideal fluid motion

Authors: Theodore D. Drivas, Gerard Misiołek, Bin Shi, Tsuyoshi Yoneda

Abstract: Two fluid configurations along a flow are conjugate if there is a one parameter family of geodesics (fluid flows) joining them to infinitesimal order. Geometrically, they can be seen as a consequence of the (infinite dimensional) group of volume preserving diffeomorphisms having sufficiently strong positive curvatures which `pull' nearby flows together. Physically, they indicate a form of (transie… ▽ More Two fluid configurations along a flow are conjugate if there is a one parameter family of geodesics (fluid flows) joining them to infinitesimal order. Geometrically, they can be seen as a consequence of the (infinite dimensional) group of volume preserving diffeomorphisms having sufficiently strong positive curvatures which `pull' nearby flows together. Physically, they indicate a form of (transient) stability in the configuration space of particle positions: a family of flows starting with the same configuration deviate initially and subsequently re-converge (resonate) with each other at some later moment in time. Here, we first establish existence of conjugate points in an infinite family of Kolmogorov flows - a class of stationary solutions of the Euler equations - on the rectangular flat torus of any aspect ratio. The analysis is facilitated by a general criterion for identifying conjugate points in the group of volume preserving diffeomorphisms. Next, we show non-existence of conjugate points along Arnold stable steady states on the annulus, disk and channel. Finally, we discuss cut points, their relation to non-injectivity of the exponential map (impossibility of determining a flow from a particle configuration at a given instant) and show that the closest cut point to the identity is either a conjugate point or the midpoint of a time periodic Lagrangian fluid flow. △ Less

Submitted 25 May, 2021; originally announced May 2021.

Comments: To appear special issue of Annales Mathématiques du Québec in honor of Alexander Shnirelman's 75th birthday

Dissipation enhancement of planar helical flows and applications to three-dimensional Kuramoto-Sivashinsky and Keller-Segel equations

Authors: Yuanyuan Feng, Binbin Shi, Weike Wang

Abstract: We introduce the planar helical flows on three dimensional torus and study the dissipation enhancement of such flows. We then use such flows as transport flows to solve the three dimensional advective Kuramoto-Sivashinsky and Keller-Segel equations. The global well-posedness of the Kuramoto-Sivashinsky equation is achieved when the linearized operator does not have growing mode in the direction or… ▽ More We introduce the planar helical flows on three dimensional torus and study the dissipation enhancement of such flows. We then use such flows as transport flows to solve the three dimensional advective Kuramoto-Sivashinsky and Keller-Segel equations. The global well-posedness of the Kuramoto-Sivashinsky equation is achieved when the linearized operator does not have growing mode in the direction orthogonal to the flow. The global classical solution of the three dimensional Keller-Segel is ensured for any size of the torus with arbitrarily large initial data. △ Less

Submitted 26 April, 2021; originally announced April 2021.

MSC Class: 35K25; 35K58; 76E06; 76F25

Suppression of blow up by mixing in generalized Keller-Segel system with fractional dissipation and strong singular kernel

Authors: Binbin Shi

Abstract: In this paper, we consider the Cauchy problem for a generalized parabolic-elliptic Keller-Segel equation with a fractional dissipation and advection by a weakly mixing (see Definition \ref{def:2.4}). Here the attractive kernel has strong singularity, namely, the derivative appears in the nonlinear term by singular integral. Without advection, the solution of equation blows up in finite time. Under… ▽ More In this paper, we consider the Cauchy problem for a generalized parabolic-elliptic Keller-Segel equation with a fractional dissipation and advection by a weakly mixing (see Definition \ref{def:2.4}). Here the attractive kernel has strong singularity, namely, the derivative appears in the nonlinear term by singular integral. Without advection, the solution of equation blows up in finite time. Under a suitable mixing condition on the advection, we show the global existence of classical solution with large initial data in the case of the derivative of dissipative term is higher than that of nonlinear term. Since the attractive kernel is strong singularity, the weakly mixing has destabilizing effect in addition to the enhanced dissipation effect, which makes the problem more complicated and difficult. In this paper, we establish the $L^\infty$-criterion and obtain the global $L^\infty$ estimate of the solution through some new ideas and techniques. Combined with \cite{Shi.2019}, we discuss all cases of generalized Keller-Segel system with mixing effect, which was proposed by Kiselev, Xu (see \cite{Kiselev.2016}) and Hopf, Rodrigo (see \cite{Hopf.2018}). Based on more precise estimate of solution and the resolvent estimate of semigroup operator, we introduce a new method to study the enhanced dissipation effect of mixing in generalized parabolic-elliptic Keller-Segel equation with a fractional dissipation. And the RAGE theorem is no longer needed in our analysis. △ Less

Submitted 7 March, 2021; originally announced March 2021.

Comments: 47

MSC Class: Generalized Keller-Segel System; Mixing; Fractional dissipation; Suppression of blow up

A lattice Boltzmann model for the coupled cross-diffusion-fluid system

Authors: Chengjie Zhan, Zhenhua Chai, Baochang Shi

Abstract: In this paper, we propose a lattice Boltzmann (LB) model for the generalized coupled cross-diffusion-fluid system. Through the direct Taylor expansion method, the proposed LB model can correctly recover the macroscopic equations. The cross diffusion terms in the coupled system are modeled by introducing additional collision operators, which can be used to avoid special treatments for the gradient… ▽ More In this paper, we propose a lattice Boltzmann (LB) model for the generalized coupled cross-diffusion-fluid system. Through the direct Taylor expansion method, the proposed LB model can correctly recover the macroscopic equations. The cross diffusion terms in the coupled system are modeled by introducing additional collision operators, which can be used to avoid special treatments for the gradient terms. In addition, the auxiliary source terms are constructed properly such that the numerical diffusion caused by the convection can be eliminated. We adopt the developed LB model to study two important systems, i.e., the coupled chemotaxis-fluid system and the double-diffusive convection system with Soret and Dufour effects. We first test the present LB model through considering a steady-state case of coupled chemotaxis-fluid system, then we analyze the influences of some physical parameters on the formation of sinking plumes. Finally, the double-diffusive natural convection system with Soret and Dufour effects is also studied, and the numerical results agree well with some previous works. △ Less

Submitted 7 January, 2021; originally announced January 2021.

A multiple-relaxation-time lattice Boltzmann model based four-level finite-difference scheme for one-dimensional diffusion equation

Authors: Yuxin Lin, Ning Hong, Baochang Shi, Zhenhua Chai

Abstract: In this paper, we first present a multiple-relaxation-time lattice Boltzmann (MRT-LB) model for one-dimensional diffusion equation where the D1Q3 (three discrete velocities in one-dimensional space) lattice structure is considered. Then through the theoretical analysis, we derive an explicit four-level finite-difference scheme from this MRT-LB model. The results show that the four-level finite-dif… ▽ More In this paper, we first present a multiple-relaxation-time lattice Boltzmann (MRT-LB) model for one-dimensional diffusion equation where the D1Q3 (three discrete velocities in one-dimensional space) lattice structure is considered. Then through the theoretical analysis, we derive an explicit four-level finite-difference scheme from this MRT-LB model. The results show that the four-level finite-difference scheme is unconditionally stable, and through adjusting the weight coefficient $ω_{0}$ and the relaxation parameters $s_1$ and $s_2$ corresponding to the first and second moments, it can also have a sixth-order accuracy in space. Finally, we also test the four-level finite-difference scheme through some numerical simulations, and find that the numerical results are consistent with our theoretical analysis. △ Less

Submitted 19 December, 2020; originally announced December 2020.

Comments: 20 pages, 5 figures

Journal ref: Phys. Rev. E 104, 015312 (2021)

On Learning Rates and Schrödinger Operators

Authors: Bin Shi, Weijie J. Su, Michael I. Jordan

Abstract: The learning rate is perhaps the single most important parameter in the training of neural networks and, more broadly, in stochastic (nonconvex) optimization. Accordingly, there are numerous effective, but poorly understood, techniques for tuning the learning rate, including learning rate decay, which starts with a large initial learning rate that is gradually decreased. In this paper, we present… ▽ More The learning rate is perhaps the single most important parameter in the training of neural networks and, more broadly, in stochastic (nonconvex) optimization. Accordingly, there are numerous effective, but poorly understood, techniques for tuning the learning rate, including learning rate decay, which starts with a large initial learning rate that is gradually decreased. In this paper, we present a general theoretical analysis of the effect of the learning rate in stochastic gradient descent (SGD). Our analysis is based on the use of a learning-rate-dependent stochastic differential equation (lr-dependent SDE) that serves as a surrogate for SGD. For a broad class of objective functions, we establish a linear rate of convergence for this continuous-time formulation of SGD, highlighting the fundamental importance of the learning rate in SGD, and contrasting to gradient descent and stochastic gradient Langevin dynamics. Moreover, we obtain an explicit expression for the optimal linear rate by analyzing the spectrum of the Witten-Laplacian, a special case of the Schrödinger operator associated with the lr-dependent SDE. Strikingly, this expression clearly reveals the dependence of the linear convergence rate on the learning rate -- the linear rate decreases rapidly to zero as the learning rate tends to zero for a broad class of nonconvex functions, whereas it stays constant for strongly convex functions. Based on this sharp distinction between nonconvex and convex problems, we provide a mathematical interpretation of the benefits of using learning rate decay for nonconvex optimization. △ Less

Submitted 15 April, 2020; originally announced April 2020.

Comments: 49 pages, 21 figures

Verlinde formula from entanglement

Authors: Bowen Shi

Abstract: We derive the Verlinde formula from a recently advocated set of axioms about entanglement entropy [B. Shi, K. Kato, I. H. Kim, arXiv:1906.09376 (2019)]. For any state that obeys these axioms, we can define a quantity that can be identified as the topological $S$-matrix of an abstract anyon theory. We show that the $S$-matrix is unitary and that it recovers the fusion multiplicities of the underlyi… ▽ More We derive the Verlinde formula from a recently advocated set of axioms about entanglement entropy [B. Shi, K. Kato, I. H. Kim, arXiv:1906.09376 (2019)]. For any state that obeys these axioms, we can define a quantity that can be identified as the topological $S$-matrix of an abstract anyon theory. We show that the $S$-matrix is unitary and that it recovers the fusion multiplicities of the underlying anyon theory through the Verlinde formula. Importantly, we rigorously prove the modularity of the theory, which further implies that the mutual braiding statistics of anyons are nontrivial. The key to the proof is a generalized quantum state merging technique, which generates a topology beyond that of any subsystem of the original physical system. △ Less

Submitted 9 June, 2020; v1 submitted 4 November, 2019; originally announced November 2019.

Comments: 6 pages, 5 figures, v3, close to the published version

Journal ref: Phys. Rev. Research 2, 023132 (2020)

Suppression of blow up by mixing in generalized Keller-Segel system with fractional dissipation

Authors: Binbin Shi, Weike Wang

Abstract: In this paper, we consider the Cauchy problem for a generalized parabolic-elliptic Keller-Segel equation with fractional dissipation and the additional mixing effect of advection by an incompressible flow. Under suitable mixing condition on the advection, we study well-posedness of solution with large initial data. We establish the global $L^\infty$ estimate of the solution through nonlinear maxim… ▽ More In this paper, we consider the Cauchy problem for a generalized parabolic-elliptic Keller-Segel equation with fractional dissipation and the additional mixing effect of advection by an incompressible flow. Under suitable mixing condition on the advection, we study well-posedness of solution with large initial data. We establish the global $L^\infty$ estimate of the solution through nonlinear maximum principle, and obtain the global classical solution. △ Less

Submitted 7 August, 2019; originally announced August 2019.

Acceleration via Symplectic Discretization of High-Resolution Differential Equations

Authors: Bin Shi, Simon S. Du, Weijie J. Su, Michael I. Jordan

Abstract: We study first-order optimization methods obtained by discretizing ordinary differential equations (ODEs) corresponding to Nesterov's accelerated gradient methods (NAGs) and Polyak's heavy-ball method. We consider three discretization schemes: an explicit Euler scheme, an implicit Euler scheme, and a symplectic scheme. We show that the optimization algorithm generated by applying the symplectic sc… ▽ More We study first-order optimization methods obtained by discretizing ordinary differential equations (ODEs) corresponding to Nesterov's accelerated gradient methods (NAGs) and Polyak's heavy-ball method. We consider three discretization schemes: an explicit Euler scheme, an implicit Euler scheme, and a symplectic scheme. We show that the optimization algorithm generated by applying the symplectic scheme to a high-resolution ODE proposed by Shi et al. [2018] achieves an accelerated rate for minimizing smooth strongly convex functions. On the other hand, the resulting algorithm either fails to achieve acceleration or is impractical when the scheme is implicit, the ODE is low-resolution, or the scheme is explicit. △ Less

Submitted 4 November, 2019; v1 submitted 10 February, 2019; originally announced February 2019.

Comments: Published in Neurips 2019

Equivalence of the Initialized Riemann-Liouville Derivatives and the Initialized Caputo Derivatives

Authors: Jian Yuan, Guozhong Xiu, Bao Shi

Abstract: Initialization of fractional differential equations remains an ongoing problem. In recent years, the initialization function approach and the infinite state approach provide two effective ways to deal with this problem. The purpose of this paper is to prove the equivalence of the initialized Riemann-Liouville derivatives and the initialized Caputo derivatives with arbitrary orders. By synthesizing… ▽ More Initialization of fractional differential equations remains an ongoing problem. In recent years, the initialization function approach and the infinite state approach provide two effective ways to deal with this problem. The purpose of this paper is to prove the equivalence of the initialized Riemann-Liouville derivatives and the initialized Caputo derivatives with arbitrary orders. By synthesizing the above two initialization theories, the diffusive representations of the two initialized derivatives with arbitrary orders are derived. Laplace transforms of the two initialized derivatives are shown to be equal. As a result, the two most commonly used derivatives are proved to be equivalent when initial conditions are properly imposed. △ Less

Submitted 13 November, 2018; originally announced November 2018.

Comments: 17 pages

Hereditary effects of exponentially damped oscillators with past histories

Authors: Jian Yuan, Guozhong Xiu, Bao Shi, Liying Wang

Abstract: Hereditary effects of exponentially damped oscillators with past histories are considered in this paper. Nonviscously damped oscillators involve hereditary damping forces which depend on time-histories of vibrating motions via convolution integrals over exponentially decaying functions. As a result, this kind of oscillators are said to have memory. In this work, initialization for nonviscously dam… ▽ More Hereditary effects of exponentially damped oscillators with past histories are considered in this paper. Nonviscously damped oscillators involve hereditary damping forces which depend on time-histories of vibrating motions via convolution integrals over exponentially decaying functions. As a result, this kind of oscillators are said to have memory. In this work, initialization for nonviscously damped oscillators is firstly proposed. Unlike the classical viscously damped ones, information of the past history of response velocity is necessary to fully determine the dynamic behaviors of nonviscously damped oscillators. Then, initialization response of exponentially damped oscillators is obtained to characterize the hereditary effects on the dynamic response. At last, stability of initialization response is proved and the hereditary effects are shown to gradually recede with increasing of time. △ Less

Submitted 1 November, 2018; originally announced November 2018.

Understanding the Acceleration Phenomenon via High-Resolution Differential Equations

Authors: Bin Shi, Simon S. Du, Michael I. Jordan, Weijie J. Su

Abstract: Gradient-based optimization algorithms can be studied from the perspective of limiting ordinary differential equations (ODEs). Motivated by the fact that existing ODEs do not distinguish between two fundamentally different algorithms---Nesterov's accelerated gradient method for strongly convex functions (NAG-SC) and Polyak's heavy-ball method---we study an alternative limiting process that yields… ▽ More Gradient-based optimization algorithms can be studied from the perspective of limiting ordinary differential equations (ODEs). Motivated by the fact that existing ODEs do not distinguish between two fundamentally different algorithms---Nesterov's accelerated gradient method for strongly convex functions (NAG-SC) and Polyak's heavy-ball method---we study an alternative limiting process that yields high-resolution ODEs. We show that these ODEs permit a general Lyapunov function framework for the analysis of convergence in both continuous and discrete time. We also show that these ODEs are more accurate surrogates for the underlying algorithms; in particular, they not only distinguish between NAG-SC and Polyak's heavy-ball method, but they allow the identification of a term that we refer to as "gradient correction" that is present in NAG-SC but not in the heavy-ball method and is responsible for the qualitative difference in convergence of the two methods. We also use the high-resolution ODE framework to study Nesterov's accelerated gradient method for (non-strongly) convex functions, uncovering a hitherto unknown result---that NAG-C minimizes the squared gradient norm at an inverse cubic rate. Finally, by modifying the high-resolution ODE of NAG-C, we obtain a family of new optimization methods that are shown to maintain the accelerated convergence rates of NAG-C for smooth convex functions. △ Less

Submitted 1 November, 2018; v1 submitted 21 October, 2018; originally announced October 2018.

Comments: 82 pages, 11 figures

A Conservation Law Method in Optimization

Authors: Bin Shi

Abstract: We propose some algorithms to find local minima in nonconvex optimization and to obtain global minima in some degree from the Newton Second Law without friction. With the key observation of the velocity observable and controllable in the motion, the algorithms simulate the Newton Second Law without friction based on symplectic Euler scheme. From the intuitive analysis of analytical solution, we gi… ▽ More We propose some algorithms to find local minima in nonconvex optimization and to obtain global minima in some degree from the Newton Second Law without friction. With the key observation of the velocity observable and controllable in the motion, the algorithms simulate the Newton Second Law without friction based on symplectic Euler scheme. From the intuitive analysis of analytical solution, we give a theoretical analysis for the high-speed convergence in the algorithm proposed. Finally, we propose the experiments for strongly convex function, non-strongly convex function and nonconvex function in high-dimension. △ Less

Submitted 14 October, 2017; v1 submitted 26 August, 2017; originally announced August 2017.

Sliding control for single-degree-of-freedom fractional oscillators

Authors: Jian Yuan, Bao Shi, Guozhong Xiu

Abstract: This paper proposes fractional sliding control designs for single-degree-of-freedom fractional oscillators respectively of the Kelvin-Voigt type, the modified Kelvin-Voigt type and Düffing type, whose dynamical behaviors are described by second-order differential equations involving fractional derivatives. Firstly, the differential equations of motion are transformed into non-commensurate fraction… ▽ More This paper proposes fractional sliding control designs for single-degree-of-freedom fractional oscillators respectively of the Kelvin-Voigt type, the modified Kelvin-Voigt type and Düffing type, whose dynamical behaviors are described by second-order differential equations involving fractional derivatives. Firstly, the differential equations of motion are transformed into non-commensurate fractional state equations by introducing state variables with physical significance. Secondly, fractional sliding manifolds are constructed and stability of the corresponding sliding dynamics is addressed via the infinite state approach and Lyapunov stability theory. Thirdly, sliding control laws and adaptive sliding laws are designed for fractional oscillators respectively in cases that the bound of the external exciting force is known or unknown. Finally, numerical simulations are carried out to validate the above control designs. △ Less

Submitted 17 August, 2016; originally announced August 2016.

Comments: 9 pages, 8 figures

Image segmentation based on the hybrid total variation model and the K-means clustering strategy

Authors: Baoli Shi, Zhi-Feng Pang, Jing Xu

Abstract: The performance of image segmentation highly relies on the original inputting image. When the image is contaminated by some noises or blurs, we can not obtain the efficient segmentation result by using direct segmentation methods. In order to efficiently segment the contaminated image, this paper proposes a two step method based on the hybrid total variation model with a box constraint and the K-m… ▽ More The performance of image segmentation highly relies on the original inputting image. When the image is contaminated by some noises or blurs, we can not obtain the efficient segmentation result by using direct segmentation methods. In order to efficiently segment the contaminated image, this paper proposes a two step method based on the hybrid total variation model with a box constraint and the K-means clustering method. In the first step, the hybrid model is based on the weighted convex combination between the total variation functional and the high-order total variation as the regularization term to obtain the original clustering data. In order to deal with non-smooth regularization term, we solve this model by employing the alternating split Bregman method. Then, in the second step, the segmentation can be obtained by thresholding this clustering data into different phases, where the thresholds can be given by using the K-means clustering method. Numerical comparisons show that our proposed model can provide more efficient segmentation results dealing with the noise image and blurring image. △ Less

Submitted 30 May, 2016; originally announced May 2016.