Showing 1–50 of 91 results for author: Ritschel, T

Stability analysis of nonlinear stochastic flexibility function in smart energy systems

Authors: Seyed Shahabaldin Tohidi, Tobias K. S. Ritschel, Georgios Tsaousoglou, Uffe Høgsbro Thygesen, Henrik Madsen

Abstract: Demand-side management provides a great potential for improving the efficiency and reliability of energy systems. This requires a mechanism to connect the market level and the demand side. The flexibility function is a novel approach that bridges the gap between the markets and the dynamics of physical assets at the lower levels of the energy systems and activates demand-side flexibility with the… ▽ More Demand-side management provides a great potential for improving the efficiency and reliability of energy systems. This requires a mechanism to connect the market level and the demand side. The flexibility function is a novel approach that bridges the gap between the markets and the dynamics of physical assets at the lower levels of the energy systems and activates demand-side flexibility with the purpose of decision-making as well as for offering a new framework for balancing and grid services. Employing this function as a key for many decision-making and control algorithms reveals that a mathematically rigorous stability analysis is required for it. In this paper, we investigate the stability properties of two nonlinear flexibility functions, as a dynamic mapping between electricity price and power consumption. Specifically, we analyze the stability of a deterministic flexibility function and an Itô stochastic flexibility function. Simulation results are also provided to demonstrate the dynamics of the flexibility functions and to show that the analytical results hold. △ Less

Submitted 23 May, 2024; originally announced May 2024.

Exposure Diffusion: HDR Image Generation by Consistent LDR denoising

Authors: Mojtaba Bemana, Thomas Leimkühler, Karol Myszkowski, Hans-Peter Seidel, Tobias Ritschel

Abstract: We demonstrate generating high-dynamic range (HDR) images using the concerted action of multiple black-box, pre-trained low-dynamic range (LDR) image diffusion models. Common diffusion models are not HDR as, first, there is no sufficiently large HDR image dataset available to re-train them, and second, even if it was, re-training such models is impossible for most compute budgets. Instead, we seek… ▽ More We demonstrate generating high-dynamic range (HDR) images using the concerted action of multiple black-box, pre-trained low-dynamic range (LDR) image diffusion models. Common diffusion models are not HDR as, first, there is no sufficiently large HDR image dataset available to re-train them, and second, even if it was, re-training such models is impossible for most compute budgets. Instead, we seek inspiration from the HDR image capture literature that traditionally fuses sets of LDR images, called "brackets", to produce a single HDR image. We operate multiple denoising processes to generate multiple LDR brackets that together form a valid HDR result. To this end, we introduce an exposure consistency term into the diffusion process to couple the brackets such that they agree across the exposure range they share. We demonstrate HDR versions of state-of-the-art unconditional and conditional as well as restoration-type (LDR2HDR) generative modeling. △ Less

Submitted 23 May, 2024; originally announced May 2024.

An algorithm for distributed time delay identification based on a mixed Erlang kernel approximation and the linear chain trick

Authors: Tobias K. S. Ritschel, John Wyller

Abstract: Time delays are ubiquitous in industry and nature, and they significantly affect both transient dynamics and stability properties. Consequently, it is often necessary to identify and account for the delays when, e.g., designing a model-based control strategy. However, identifying delays in differential equations is not straightforward and requires specialized methods. Therefore, we propose an algo… ▽ More Time delays are ubiquitous in industry and nature, and they significantly affect both transient dynamics and stability properties. Consequently, it is often necessary to identify and account for the delays when, e.g., designing a model-based control strategy. However, identifying delays in differential equations is not straightforward and requires specialized methods. Therefore, we propose an algorithm for identifying distributed delays in delay differential equations (DDEs) that only involves simulation of ordinary differential equations (ODEs). Specifically, we 1) approximate the kernel in the DDEs (also called the memory function) by the probability density function of a mixed Erlang distribution and 2) use the linear chain trick (LCT) to transform the resulting DDEs into ODEs. Finally, the parameters in the kernel approximation are estimated as the solution to a dynamical least-squares problem, and we use a single-shooting approach to approximate this solution. We demonstrate the efficacy of the algorithm using numerical examples that involve the logistic equation and a point reactor kinetics model of a molten salt nuclear fission reactor. △ Less

Submitted 12 May, 2024; originally announced May 2024.

Pressure-dependent electronic superlattice in the Kagome-superconductor CsV$\mathrm{_3}$Sb$\mathrm{_5}$

Authors: F. Stier, A. -A. Haghighirad, G. Garbarino, S. Mishra, N. Stilkerich, D. Chen, C. Shekhar, T. Lacmann, C. Felser, T. Ritschel, J. Geck, M. Le Tacon

Abstract: We present a high-resolution single crystal x-ray diffraction study of Kagome superconductor \cvs, exploring its response to variations in pressure and temperature. We discover that at low temperatures, the structural modulations of the electronic superlattice, commonly associated with charge density wave order, undergo a transformation around $p \sim$ 0.7 GPa from the familiar $2\times2$ pattern… ▽ More We present a high-resolution single crystal x-ray diffraction study of Kagome superconductor \cvs, exploring its response to variations in pressure and temperature. We discover that at low temperatures, the structural modulations of the electronic superlattice, commonly associated with charge density wave order, undergo a transformation around $p \sim$ 0.7 GPa from the familiar $2\times2$ pattern to a long-range ordered modulation at wavevector $q=(0, 3/8, 1/2)$. Our observations align with inferred changes in the CDW pattern from prior transport and nuclear magnetic resonance studies, providing new insights into these transitions. Interestingly, the pressure-induced variations in the electronic superlattice correlate with two peaks in the superconducting transition temperature as pressure changes, hinting that fluctuations within the electronic superlattice could be key to stabilizing superconductivity. However, our findings contrast with the minimal pressure dependency anticipated by ab initio calculations of the electronic structure. They also challenge prevailing scenarios based on a Peierls-like nesting mechanism involving van Hove singularities. △ Less

Submitted 23 April, 2024; originally announced April 2024.

NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs

Authors: Michael Fischer, Zhengqin Li, Thu Nguyen-Phuoc, Aljaz Bozic, Zhao Dong, Carl Marshall, Tobias Ritschel

Abstract: A Neural Radiance Field (NeRF) encodes the specific relation of 3D geometry and appearance of a scene. We here ask the question whether we can transfer the appearance from a source NeRF onto a target 3D geometry in a semantically meaningful way, such that the resulting new NeRF retains the target geometry but has an appearance that is an analogy to the source NeRF. To this end, we generalize class… ▽ More A Neural Radiance Field (NeRF) encodes the specific relation of 3D geometry and appearance of a scene. We here ask the question whether we can transfer the appearance from a source NeRF onto a target 3D geometry in a semantically meaningful way, such that the resulting new NeRF retains the target geometry but has an appearance that is an analogy to the source NeRF. To this end, we generalize classic image analogies from 2D images to NeRFs. We leverage correspondence transfer along semantic affinity that is driven by semantic features from large, pre-trained 2D image models to achieve multi-view consistent appearance transfer. Our method allows exploring the mix-and-match product space of 3D geometry and appearance. We show that our method outperforms traditional stylization-based methods and that a large majority of users prefer our method over several typical baselines. △ Less

Submitted 13 February, 2024; originally announced February 2024.

Comments: Project page: https://mfischer-ucl.github.io/nerf_analogies/

4D-ONIX: A deep learning approach for reconstructing 3D movies from sparse X-ray projections

Authors: Yuhe Zhang, Zisheng Yao, Robert Klöfkorn, Tobias Ritschel, Pablo Villanueva-Perez

Abstract: The X-ray flux provided by X-ray free-electron lasers and storage rings offers new spatiotemporal possibilities to study in-situ and operando dynamics, even using single pulses of such facilities. X-ray Multi-Projection Imaging (XMPI) is a novel technique that enables volumetric information using single pulses of such facilities and avoids centrifugal forces induced by state-of-the-art time-resolv… ▽ More The X-ray flux provided by X-ray free-electron lasers and storage rings offers new spatiotemporal possibilities to study in-situ and operando dynamics, even using single pulses of such facilities. X-ray Multi-Projection Imaging (XMPI) is a novel technique that enables volumetric information using single pulses of such facilities and avoids centrifugal forces induced by state-of-the-art time-resolved 3D methods such as time-resolved tomography. As a result, XMPI can acquire 3D movies (4D) at least three orders of magnitude faster than current methods. However, it is exceptionally challenging to reconstruct 4D from highly sparse projections as acquired by XMPI with current algorithms. Here, we present 4D-ONIX, a Deep Learning (DL)-based approach that learns to reconstruct 3D movies (4D) from an extremely limited number of projections. It combines the computational physical model of X-ray interaction with matter and state-of-the-art DL methods. We demonstrate the potential of 4D-ONIX to generate high-quality 4D by generalizing over multiple experiments with only two projections per timestamp for binary droplet collisions. We envision that 4D-ONIX will become an enabling tool for 4D analysis, offering new spatiotemporal resolutions to study processes not possible before. △ Less

Submitted 2 February, 2024; v1 submitted 17 January, 2024; originally announced January 2024.

Adaptive flexibility function in smart energy systems: A linearized price-demand mapping approach

Authors: Seyed Shahabaldin Tohidi, Henrik Madsen, Georgios Tsaousoglou, Tobias K. S. Ritschel

Abstract: This paper proposes an adaptive mechanism for price signal generation using a piecewise linear approximation of a flexibility function with unknown parameters. In this adaptive approach, the price signal is parameterized and the parameters are changed adaptively such that the output of the flexibility function follows the reference demand signal provided by the involved aggregator. This is guarant… ▽ More This paper proposes an adaptive mechanism for price signal generation using a piecewise linear approximation of a flexibility function with unknown parameters. In this adaptive approach, the price signal is parameterized and the parameters are changed adaptively such that the output of the flexibility function follows the reference demand signal provided by the involved aggregator. This is guaranteed using the Lyapunov stability theorem. The proposed method does not require an estimation algorithm for unknown parameters, that eliminates the need for persistency of excitation of signals, and consequently, simplifies offering the flexibility services. Furthermore, boundedness of the price signal is ensured using a projection algorithm in the adaptive system. We present simulation results that demonstrate the price generation results using the proposed approaches. △ Less

Submitted 15 February, 2024; v1 submitted 6 December, 2023; originally announced December 2023.

Neural Bounding

Authors: Stephanie Wenxin Liu, Michael Fischer, Paul D. Yoo, Tobias Ritschel

Abstract: Bounding volumes are an established concept in computer graphics and vision tasks but have seen little change since their early inception. In this work, we study the use of neural networks as bounding volumes. Our key observation is that bounding, which so far has primarily been considered a problem of computational geometry, can be redefined as a problem of learning to classify space into free or… ▽ More Bounding volumes are an established concept in computer graphics and vision tasks but have seen little change since their early inception. In this work, we study the use of neural networks as bounding volumes. Our key observation is that bounding, which so far has primarily been considered a problem of computational geometry, can be redefined as a problem of learning to classify space into free or occupied. This learning-based approach is particularly advantageous in high-dimensional spaces, such as animated scenes with complex queries, where neural networks are known to excel. However, unlocking neural bounding requires a twist: allowing -- but also limiting -- false positives, while ensuring that the number of false negatives is strictly zero. We enable such tight and conservative results using a dynamically-weighted asymmetric loss function. Our results show that our neural bounding produces up to an order of magnitude fewer false positives than traditional methods. In addition, we propose an extension of our bounding method using early exits that accelerates query speeds by 25%. We also demonstrate that our approach is applicable to non-deep learning models that train within seconds. Our project page is at: https://wenxin-liu.github.io/neural_bounding/. △ Less

Submitted 24 May, 2024; v1 submitted 10 October, 2023; originally announced October 2023.

Comments: Published in Proc. of SIGGRAPH, 2024

Patternshop: Editing Point Patterns by Image Manipulation

Authors: Xingchang Huang, Tobias Ritschel, Hans-Peter Seidel, Pooran Memari, Gurprit Singh

Abstract: Point patterns are characterized by their density and correlation. While spatial variation of density is well-understood, analysis and synthesis of spatially-varying correlation is an open challenge. No tools are available to intuitively edit such point patterns, primarily due to the lack of a compact representation for spatially varying correlation. We propose a low-dimensional perceptual embeddi… ▽ More Point patterns are characterized by their density and correlation. While spatial variation of density is well-understood, analysis and synthesis of spatially-varying correlation is an open challenge. No tools are available to intuitively edit such point patterns, primarily due to the lack of a compact representation for spatially varying correlation. We propose a low-dimensional perceptual embedding for point correlations. This embedding can map point patterns to common three-channel raster images, enabling manipulation with off-the-shelf image editing software. To synthesize back point patterns, we propose a novel edge-aware objective that carefully handles sharp variations in density and correlation. The resulting framework allows intuitive and backward-compatible manipulation of point patterns, such as recoloring, relighting to even texture synthesis that have not been available to 2D point pattern design before. Effectiveness of our approach is tested in several user experiments. △ Less

Submitted 3 September, 2023; v1 submitted 21 August, 2023; originally announced August 2023.

Journal ref: ACM Transactions on Graphics 2023 Volume 42 Issue 4 Article No.: 53

Zero Grads: Learning Local Surrogate Losses for Non-Differentiable Graphics

Authors: Michael Fischer, Tobias Ritschel

Abstract: Gradient-based optimization is now ubiquitous across graphics, but unfortunately can not be applied to problems with undefined or zero gradients. To circumvent this issue, the loss function can be manually replaced by a ``surrogate'' that has similar minima but is differentiable. Our proposed framework, ZeroGrads, automates this process by learning a neural approximation of the objective function,… ▽ More Gradient-based optimization is now ubiquitous across graphics, but unfortunately can not be applied to problems with undefined or zero gradients. To circumvent this issue, the loss function can be manually replaced by a ``surrogate'' that has similar minima but is differentiable. Our proposed framework, ZeroGrads, automates this process by learning a neural approximation of the objective function, which in turn can be used to differentiate through arbitrary black-box graphics pipelines. We train the surrogate on an actively smoothed version of the objective and encourage locality, focusing the surrogate's capacity on what matters at the current training episode. The fitting is performed online, alongside the parameter optimization, and self-supervised, without pre-computed data or pre-trained models. As sampling the objective is expensive (it requires a full rendering or simulator run), we devise an efficient sampling scheme that allows for tractable run-times and competitive performance at little overhead. We demonstrate optimizing diverse non-convex, non-differentiable black-box problems in graphics, such as visibility in rendering, discrete parameter spaces in procedural modelling or optimal control in physics-driven animation. In contrast to other derivative-free algorithms, our approach scales well to higher dimensions, which we demonstrate on problems with up to 35k interlinked variables. △ Less

Submitted 7 May, 2024; v1 submitted 10 August, 2023; originally announced August 2023.

Comments: Accepted at SIGGRAPH 2024. Project page: https://mfischer-ucl.github.io/zerograds

Mathematical meal models for simulation of human metabolism

Authors: Tobias K. S. Ritschel, Asbjørn Thode Reenberg, Peter Emil Carstensen, Jacob Bendsen, John Bagterp Jørgensen

Abstract: We present and critically discuss five commonly used mathematical models of the meal glucose rate of appearance in humans. Such models are key to simulation of the metabolism in healthy people, people with diabetes, and obese people, and they are central to developing effective treatments and prevention strategies. Furthermore, we discuss important aspects of systematic mathematical modeling of hu… ▽ More We present and critically discuss five commonly used mathematical models of the meal glucose rate of appearance in humans. Such models are key to simulation of the metabolism in healthy people, people with diabetes, and obese people, and they are central to developing effective treatments and prevention strategies. Furthermore, we discuss important aspects of systematic mathematical modeling of human metabolism, including meal consumption modeling, stoichiometry and reaction kinetics, and general-purpose model components. △ Less

Submitted 31 July, 2023; originally announced July 2023.

Comments: 17 pages, 9 figures, 2 tables

Quantitative modeling and simulation of biochemical processes in the human body

Authors: Jacob Bendsen, Peter Emil Carstensen, Asbjørn Thode Reenberg, Tobias K. S. Ritschel, John Bagterp Jørgensen

Abstract: We present a whole-body model of human metabolism that utilizes a system of organs and blood vessels to simulate the enzymatic reactions. The model focuses on key organs, including the brain, heart and lungs, liver, gut, and kidney, as well as muscle and adipose tissue. The model equations are formulated using stoichiometry and Michaelis-Menten kinetics to describe the enzymatic reactions. We demo… ▽ More We present a whole-body model of human metabolism that utilizes a system of organs and blood vessels to simulate the enzymatic reactions. The model focuses on key organs, including the brain, heart and lungs, liver, gut, and kidney, as well as muscle and adipose tissue. The model equations are formulated using stoichiometry and Michaelis-Menten kinetics to describe the enzymatic reactions. We demonstrate how the model can be used to simulate the effects of prolonged fasting and intermittent fasting on selected metabolite concentrations and glucose flux. Furthermore, by simulating intermittent fasting the effect on the carbohydrate, the protein and the lipid storage is examined. We propose this method as a simple and intuitive approach for modeling the human metabolism, which is general, systematic and easy to incorporate. This could have potential applications in PK/PD drug development and in understanding metabolic disorders. △ Less

Submitted 30 July, 2023; originally announced July 2023.

Comments: 18 pages, 12 figures, 7 tables. arXiv admin note: text overlap with arXiv:2205.01473

Dynamics of electronic states in the insulating Intermediate surface phase of 1T-TaS$_2$

Authors: Jingwei Dong, Weiyan Qi, Dongbin Shin, Laurent Cario, Zhesheng Chen, Romain Grasset, Davide Boschetto, Mateusz Weis, Pierrick Lample, Ernest Pastor, Tobias Ritschel, Marino Marsi, Amina Taleb, Noejung Park, Angel Rubio, Evangelos Papalazarou, Luca Perfetti

Abstract: This article reports a comparative study of bulk and surface properties in the transition metal dichalcogenide 1T-TaS$_2$. When heating the sample, the surface displays an intermediate insulating phase that persists for $\sim 10$ K on top of a metallic bulk. The weaker screening of Coulomb repulsion and stiffer Charge Density Wave (CDW) explain such resilience of a correlated insulator in the topm… ▽ More This article reports a comparative study of bulk and surface properties in the transition metal dichalcogenide 1T-TaS$_2$. When heating the sample, the surface displays an intermediate insulating phase that persists for $\sim 10$ K on top of a metallic bulk. The weaker screening of Coulomb repulsion and stiffer Charge Density Wave (CDW) explain such resilience of a correlated insulator in the topmost layers. Both time resolved ARPES and transient reflectivity are employed to investigate the dynamics of electrons and CDW collective motion. It follows that the amplitude mode is always stiffer at the surface and displays variable coupling to the Mott-Peierls band, stronger in the low temperature phase and weaker in the intermediate one. △ Less

Submitted 31 October, 2023; v1 submitted 12 July, 2023; originally announced July 2023.

Megahertz X-ray Multi-projection imaging

Authors: Pablo Villanueva-Perez, Valerio Bellucci, Yuhe Zhang, Sarlota Birnsteinova, Rita Graceffa, Luigi Adriano, Eleni Myrto Asimakopoulou, Ilia Petrov, Zisheng Yao, Marco Romagnoni, Andrea Mazzolari, Romain Letrun, Chan Kim, Jayanath C. P. Koliyadu, Carsten Deiter, Richard Bean, Gabriele Giovanetti, Luca Gelisio, Tobias Ritschel, Adrian Mancuso, Henry N. Chapman, Alke Meents, Tokushi Sato, Patrik Vagovic

Abstract: X-ray time-resolved tomography is one of the most popular X-ray techniques to probe dynamics in three dimensions (3D). Recent developments in time-resolved tomography opened the possibility of recording kilohertz-rate 3D movies. However, tomography requires rotating the sample with respect to the X-ray beam, which prevents characterization of faster structural dynamics. Here, we present megahertz… ▽ More X-ray time-resolved tomography is one of the most popular X-ray techniques to probe dynamics in three dimensions (3D). Recent developments in time-resolved tomography opened the possibility of recording kilohertz-rate 3D movies. However, tomography requires rotating the sample with respect to the X-ray beam, which prevents characterization of faster structural dynamics. Here, we present megahertz (MHz) X-ray multi-projection imaging (MHz-XMPI), a technique capable of recording volumetric information at MHz rates and micrometer resolution without scanning the sample. We achieved this by harnessing the unique megahertz pulse structure and intensity of the European X-ray Free-electron Laser with a combination of novel detection and reconstruction approaches that do not require sample rotations. Our approach enables generating multiple X-ray probes that simultaneously record several angular projections for each pulse in the megahertz pulse burst. We provide a proof-of-concept demonstration of the MHz-XMPI technique's capability to probe 4D (3D+time) information on stochastic phenomena and non-reproducible processes three orders of magnitude faster than state-of-the-art time-resolved X-ray tomography, by generating 3D movies of binary droplet collisions. We anticipate that MHz-XMPI will enable in-situ and operando studies that were impossible before, either due to the lack of temporal resolution or because the systems were opaque (such as for MHz imaging based on optical microscopy). △ Less

Submitted 19 May, 2023; originally announced May 2023.

Neural Field Convolutions by Repeated Differentiation

Authors: Ntumba Elie Nsampi, Adarsh Djeacoumar, Hans-Peter Seidel, Tobias Ritschel, Thomas Leimkühler

Abstract: Neural fields are evolving towards a general-purpose continuous representation for visual computing. Yet, despite their numerous appealing properties, they are hardly amenable to signal processing. As a remedy, we present a method to perform general continuous convolutions with general continuous signals such as neural fields. Observing that piecewise polynomial kernels reduce to a sparse set of D… ▽ More Neural fields are evolving towards a general-purpose continuous representation for visual computing. Yet, despite their numerous appealing properties, they are hardly amenable to signal processing. As a remedy, we present a method to perform general continuous convolutions with general continuous signals such as neural fields. Observing that piecewise polynomial kernels reduce to a sparse set of Dirac deltas after repeated differentiation, we leverage convolution identities and train a repeated integral field to efficiently execute large-scale convolutions. We demonstrate our approach on a variety of data modalities and spatially-varying kernels. △ Less

Submitted 4 April, 2024; v1 submitted 4 April, 2023; originally announced April 2023.

A Newton-like Method based on Model Reduction Techniques for Implicit Numerical Methods

Authors: Tobias K. S. Ritschel

Abstract: In this paper, we present a Newton-like method based on model reduction techniques, which can be used in implicit numerical methods for approximating the solution to ordinary differential equations. In each iteration, the Newton-like method solves a reduced order linear system in order to compute the Newton step. This reduced system is derived using a projection matrix, obtained using proper ortho… ▽ More In this paper, we present a Newton-like method based on model reduction techniques, which can be used in implicit numerical methods for approximating the solution to ordinary differential equations. In each iteration, the Newton-like method solves a reduced order linear system in order to compute the Newton step. This reduced system is derived using a projection matrix, obtained using proper orthogonal decomposition, which is updated in each time step of the numerical method. We demonstrate that the method can be used together with Euler's implicit method to simulate CO$_2$ injection into an oil reservoir, and we compare with using Newton's method. The Newton-like method achieves a speedup of between 39% and 84% for systems with between 4,800 and 52,800 state variables. △ Less

Submitted 13 March, 2023; originally announced March 2023.

Comments: 6 pages, 5 figures, 2 algorithms, Accepted for inclusion in the 2023 European Control Conference (ECC)

Software principles and concepts applied in the implementation of cyber-physical systems for real-time advanced process control

Authors: Anders H. D. Andersen, Zhanhao Zhang, Steen Hørsholt, Tobias K. S. Ritschel, John Bagterp Jørgensen

Abstract: Cyber-physical systems (CPSs) for real-time advanced process control (RT-APC) are a class of control systems using network communication to control industrial processes. In this paper, we use simple examples to describe the software principles and concepts used in the implementation of such systems. The key software principles are 1) shared data in the form of a database, files, or shared memory,… ▽ More Cyber-physical systems (CPSs) for real-time advanced process control (RT-APC) are a class of control systems using network communication to control industrial processes. In this paper, we use simple examples to describe the software principles and concepts used in the implementation of such systems. The key software principles are 1) shared data in the form of a database, files, or shared memory, 2) timers and threads for concurrent periodic execution of tasks, and 3) network communication between the control system and the process, and communication between the control system and the internet, e.g., the cloud to enable remote monitoring and commands. We show how to implement such systems for Linux operating systems applying the C programming language and we also comment on the implementation using the Python programming language. Finally, we present a complete simulation experiment using a real-time simulator. △ Less

Submitted 5 July, 2023; v1 submitted 27 February, 2023; originally announced February 2023.

Comments: 6 pages, 6 figures, 6 listings. Accepted for European Control Conference 2023 (ECC2023). Bucharest, Romania

Modeling, scientific computing and optimal control for renewable energy systems with storage

Authors: Nicola Cantisani, Tobias K. S. Ritschel, Christian A. Thilker, Henrik Madsen, John Bagterp Jørgensen

Abstract: This paper presents models for renewable energy systems with storage, and considers its optimal operation. We model and simulate wind and solar power production using stochastic differential equations as well as storage of the produced power using batteries, thermal storage, and water electrolysis. We formulate an economic optimal control problem, with the scope of controlling the system in the mo… ▽ More This paper presents models for renewable energy systems with storage, and considers its optimal operation. We model and simulate wind and solar power production using stochastic differential equations as well as storage of the produced power using batteries, thermal storage, and water electrolysis. We formulate an economic optimal control problem, with the scope of controlling the system in the most efficient way, while satisfying the power demand from the electric grid. Deploying multiple storage systems allows flexibility and higher reliability of the renewable energy system. △ Less

Submitted 17 December, 2022; originally announced December 2022.

Comments: Submitted to European Control Conference 2023

Model-based control algorithms for the quadruple tank system: An experimental comparison

Authors: Anders H. D. Andersen, Tobias K. S. Ritschel, Steen Hørsholt, Jakob Kjøbsted Huusom, John Bagterp Jørgensen

Abstract: We compare the performance of proportional-integral-derivative (PID) control, linear model predictive control (LMPC), and nonlinear model predictive control (NMPC) for a physical setup of the quadruple tank system (QTS). We estimate the parameters in a continuous-discrete time stochastic nonlinear model for the QTS using a prediction-error-method based on the measured process data and a maximum li… ▽ More We compare the performance of proportional-integral-derivative (PID) control, linear model predictive control (LMPC), and nonlinear model predictive control (NMPC) for a physical setup of the quadruple tank system (QTS). We estimate the parameters in a continuous-discrete time stochastic nonlinear model for the QTS using a prediction-error-method based on the measured process data and a maximum likelihood (ML) criterion. In the NMPC algorithm, we use this identified continuous-discrete time stochastic nonlinear model. The LMPC algorithm is based on a linearization of this nonlinear model. We tune the PID controller using Skogestad's IMC tuning rules using a transfer function representation of the linearized model. Norms of the observed tracking errors and the rate of change of the manipulated variables are used to compare the performance of the control algorithms. The LMPC and NMPC perform better than the PID controller for a predefined time-varying setpoint trajectory. The LMPC and NMPC algorithms have similar performance. △ Less

Submitted 9 December, 2022; originally announced December 2022.

Comments: 6 pages, 5 figures, 3 tables, to be published in Foundations of Computer Aided Process Operations / Chemical Process Control (FOCAPO/CPC 2023). Hilton San Antonio Hill Country, San Antonio, Texas

State Estimation for Continuous-Discrete-Time Nonlinear Stochastic Systems

Authors: Marcus Krogh Nielsen, Tobias K. S. Ritschel, Ib Christensen, Jess Dragheim, Jakob Kjøbsted Huusom, Krist V. Gernaey, John Bagterp Jørgensen

Abstract: State estimation incorporates the feedback in optimization based advanced process control systems and is very important for the performance of model predictive control. We describe the extended Kalman filter, the unscented Kalman filter, the ensemble Kalman filter, and a particle filter for continuous-discrete time nonlinear systems involving stochastic differential equations. Continuous-discrete… ▽ More State estimation incorporates the feedback in optimization based advanced process control systems and is very important for the performance of model predictive control. We describe the extended Kalman filter, the unscented Kalman filter, the ensemble Kalman filter, and a particle filter for continuous-discrete time nonlinear systems involving stochastic differential equations. Continuous-discrete time nonlinear systems is a natural way to model physical systems controlled by digital controllers. We implement the state estimation methods in Matlab, illustrate and evaluate their performance using simulations of the modified four-tank system. This system is non-stiff and the state estimation methods are implemented numerically using an explicit numerical integration scheme. We evaluate the accuracy of the state estimation methods in terms of the mean absolute percentage error over the simulation horizon. Each method successfully estimates the states and unmeasured disturbances of the simulated modified four-tank system. The key contribution is an overview and comparison of state estimation methods for continuous-discrete time nonlinear stochastic systems. This can guide efficient implementations. △ Less

Submitted 5 December, 2022; originally announced December 2022.

Comments: 6 pages, 1 figure, 1 table, to be published in proceedings of FOCAPO/CPC 2023. arXiv admin note: substantial text overlap with arXiv:2205.02730

Plateau-reduced Differentiable Path Tracing

Authors: Michael Fischer, Tobias Ritschel

Abstract: Current differentiable renderers provide light transport gradients with respect to arbitrary scene parameters. However, the mere existence of these gradients does not guarantee useful update steps in an optimization. Instead, inverse rendering might not converge due to inherent plateaus, i.e., regions of zero gradient, in the objective function. We propose to alleviate this by convolving the high-… ▽ More Current differentiable renderers provide light transport gradients with respect to arbitrary scene parameters. However, the mere existence of these gradients does not guarantee useful update steps in an optimization. Instead, inverse rendering might not converge due to inherent plateaus, i.e., regions of zero gradient, in the objective function. We propose to alleviate this by convolving the high-dimensional rendering function that maps scene parameters to images with an additional kernel that blurs the parameter space. We describe two Monte Carlo estimators to compute plateau-free gradients efficiently, i.e., with low variance, and show that these translate into net-gains in optimization error and runtime performance. Our approach is a straightforward extension to both black-box and differentiable renderers and enables optimization of problems with intricate light transport, such as caustics or global illumination, that existing differentiable renderers do not converge on. △ Less

Submitted 28 March, 2023; v1 submitted 30 November, 2022; originally announced November 2022.

Comments: Accepted to CVPR 2023. Project page and interactive demos at https://mfischer-ucl.github.io/prdpt/

3inGAN: Learning a 3D Generative Model from Images of a Self-similar Scene

Authors: Animesh Karnewar, Oliver Wang, Tobias Ritschel, Niloy Mitra

Abstract: We introduce 3inGAN, an unconditional 3D generative model trained from 2D images of a single self-similar 3D scene. Such a model can be used to produce 3D "remixes" of a given scene, by mapping spatial latent codes into a 3D volumetric representation, which can subsequently be rendered from arbitrary views using physically based volume rendering. By construction, the generated scenes remain view-c… ▽ More We introduce 3inGAN, an unconditional 3D generative model trained from 2D images of a single self-similar 3D scene. Such a model can be used to produce 3D "remixes" of a given scene, by mapping spatial latent codes into a 3D volumetric representation, which can subsequently be rendered from arbitrary views using physically based volume rendering. By construction, the generated scenes remain view-consistent across arbitrary camera configurations, without any flickering or spatio-temporal artifacts. During training, we employ a combination of 2D, obtained through differentiable volume tracing, and 3D Generative Adversarial Network (GAN) losses, across multiple scales, enforcing realism on both its 3D structure and the 2D renderings. We show results on semi-stochastic scenes of varying scale and complexity, obtained from real and synthetic sources. We demonstrate, for the first time, the feasibility of learning plausible view-consistent 3D scene variations from a single exemplar scene and provide qualitative and quantitative comparisons against recent related methods. △ Less

Submitted 27 November, 2022; originally announced November 2022.

Comments: Conference accept at 3DV 2022

Estimating a Personalized Basal Insulin Dose from Short-Term Closed-Loop Data in Type 2 Diabetes

Authors: Sarah Ellinor Engell, Tinna Björk Aradóttir, Tobias K. S. Ritschel, Henrik Bengtsson, John Bagterp Jørgensen

Abstract: In type 2 diabetes (T2D) treatment, finding a safe and effective basal insulin dose is a challenge. The dose-response is highly individual and to ensure safety, people with T2D titrate by slowly increasing the daily insulin dose to meet treatment targets. This titration can take months. To ease and accelerate the process, we use short-term artificial pancreas (AP) treatment tailored for initial ti… ▽ More In type 2 diabetes (T2D) treatment, finding a safe and effective basal insulin dose is a challenge. The dose-response is highly individual and to ensure safety, people with T2D titrate by slowly increasing the daily insulin dose to meet treatment targets. This titration can take months. To ease and accelerate the process, we use short-term artificial pancreas (AP) treatment tailored for initial titration and apply it as a diagnostic tool. Specifically, we present a method to automatically estimate a personalized daily dose of basal insulin from closed-loop data collected with an AP. Based on AP-data from a stochastic simulation model, we employ the continuous-discrete extended Kalman filter and a maximum likelihood approach to estimate parameters in a simple dose-response model for 100 virtual people. With the identified model, we compute a daily dose of basal insulin to meet treatment targets for each individual. We test the personalized dose and evaluate the treatment outcomes against clinical reference values. In the tested simulation setup, the proposed method is feasible. However, more extensive tests will reveal whether it can be deemed safe for clinical implementation. △ Less

Submitted 25 November, 2022; originally announced November 2022.

Comments: 6 pages, 4 figures, 1 table. Accepted for publication in Proceedings of the 2022 61st IEEE Conference on Decision and Control (CDC)

Learning to Rasterize Differentiably

Authors: Chenghao Wu, Hamila Mailee, Zahra Montazeri, Tobias Ritschel

Abstract: Differentiable rasterization changes the standard formulation of primitive rasterization -- by enabling gradient flow from a pixel to its underlying triangles -- using distribution functions in different stages of rendering, creating a "soft" version of the original rasterizer. However, choosing the optimal softening function that ensures the best performance and convergence to a desired goal requ… ▽ More Differentiable rasterization changes the standard formulation of primitive rasterization -- by enabling gradient flow from a pixel to its underlying triangles -- using distribution functions in different stages of rendering, creating a "soft" version of the original rasterizer. However, choosing the optimal softening function that ensures the best performance and convergence to a desired goal requires trial and error. Previous work has analyzed and compared several combinations of softening. In this work, we take it a step further and, instead of making a combinatorial choice of softening operations, parameterize the continuous space of common softening operations. We study meta-learning tunable softness functions over a set of inverse rendering tasks (2D and 3D shape, pose and occlusion) so it generalizes to new and unseen differentiable rendering tasks with optimal softness. △ Less

Submitted 15 July, 2024; v1 submitted 23 November, 2022; originally announced November 2022.

Comments: Published at Computer Graphics Forum (EGSR 2024), code see https://github.com/Theo-Wu/MetaRas, project webpage see https://theo-wu.github.io/MetaRas/

Electronic dispersion, correlations and stacking in the photoexcited state of 1T-TaS$_2$

Authors: Jingwei Dong, Dongbin Shin, Ernest Pastor, Tobias Ritschel, Laurent Cario, Zhesheng Chen, Weyain Qi, Romain Grasset, Marino Marsi, Amina Taleb-Ibrahimi, Noejung Park, Angel Rubio, Luca Perfetti, Evangelos Papalazarou

Abstract: Here we perform angle and time-resolved photoelectron spectroscopy on the commensurate Charge Density Wave (CDW) phase of 1T-TaS$_2$. Data with different probe pulse polarization are employed to map the dispersion of electronic states below and above the chemical potential. Upon photoexcitation, the fluctuations of CDW order erase the band dispersion near to the chemical potential and halve the ch… ▽ More Here we perform angle and time-resolved photoelectron spectroscopy on the commensurate Charge Density Wave (CDW) phase of 1T-TaS$_2$. Data with different probe pulse polarization are employed to map the dispersion of electronic states below and above the chemical potential. Upon photoexcitation, the fluctuations of CDW order erase the band dispersion near to the chemical potential and halve the charge gap size. This transient phase sets within half a period of the coherent lattice motion and is favored by strong electronic correlations. The experimental results are compared to Density-Functional Theory (DFT) calculations with a self-consistent evaluation of the Coulomb repulsion. Our simulations indicate that the screening of Coulomb repulsion depends on the stacking order of the TaS$_2$ layers. The entanglement of such degrees of freedom suggest that both the structural order and electronic repulsion are locally modified by the photoinduced CDW fluctuations. △ Less

Submitted 14 June, 2023; v1 submitted 20 October, 2022; originally announced October 2022.

Learning to Learn and Sample BRDFs

Authors: Chen Liu, Michael Fischer, Tobias Ritschel

Abstract: We propose a method to accelerate the joint process of physically acquiring and learning neural Bi-directional Reflectance Distribution Function (BRDF) models. While BRDF learning alone can be accelerated by meta-learning, acquisition remains slow as it relies on a mechanical process. We show that meta-learning can be extended to optimize the physical sampling pattern, too. After our method has be… ▽ More We propose a method to accelerate the joint process of physically acquiring and learning neural Bi-directional Reflectance Distribution Function (BRDF) models. While BRDF learning alone can be accelerated by meta-learning, acquisition remains slow as it relies on a mechanical process. We show that meta-learning can be extended to optimize the physical sampling pattern, too. After our method has been meta-trained for a set of fully-sampled BRDFs, it is able to quickly train on new BRDFs with up to five orders of magnitude fewer physical acquisition samples at similar quality. Our approach also extends to other linear and non-linear BRDF models, which we show in an extensive evaluation. △ Less

Submitted 4 May, 2023; v1 submitted 7 October, 2022; originally announced October 2022.

Comments: Accepted to Eurographics 2023; Project Page at https://ryushinn.github.io/metasampling

Pressure-tuning of $α$-RuCl$_3$ towards the ideal Kitaev-limit

Authors: Quirin Stahl, Tobias Ritschel, Gaston Garbarino, Frederico Cova, Anna Isaeva, Thomas Doert, Jochen Geck

Abstract: We report the discovery of an intriguing pressure-driven phase transformation in the layered Kitaev-material $α$-RuCl$_3$. By analyzing both the Bragg scattering as well as the diffuse scattering of high-quality single crystals, we reveal a collective reorganization of the layer stacking throughout the crystal. Importantly, this transformation also effects the structure of the RuCl$_3$ honeycomb l… ▽ More We report the discovery of an intriguing pressure-driven phase transformation in the layered Kitaev-material $α$-RuCl$_3$. By analyzing both the Bragg scattering as well as the diffuse scattering of high-quality single crystals, we reveal a collective reorganization of the layer stacking throughout the crystal. Importantly, this transformation also effects the structure of the RuCl$_3$ honeycomb layers, which acquire a high trigonal symmetry with a single Ru--Ru distance of 3.41Å and a single Ru--Cl--Ru bond angle of 92.8°. Hydrostatic pressure therefore allows to tune the structure of $α$-RuCl$_3$ much closer to the ideal Kitaev-limit. The high-symmetry phase can also be stabilized by biaxial stress, which can explain conflicting results reported earlier and, more importantly, makes the high-symmetry phase accessible to a variety of experiments. △ Less

Submitted 17 September, 2022; originally announced September 2022.

ReLU Fields: The Little Non-linearity That Could

Authors: Animesh Karnewar, Tobias Ritschel, Oliver Wang, Niloy J. Mitra

Abstract: In many recent works, multi-layer perceptions (MLPs) have been shown to be suitable for modeling complex spatially-varying functions including images and 3D scenes. Although the MLPs are able to represent complex scenes with unprecedented quality and memory footprint, this expressive power of the MLPs, however, comes at the cost of long training and inference times. On the other hand, bilinear/tri… ▽ More In many recent works, multi-layer perceptions (MLPs) have been shown to be suitable for modeling complex spatially-varying functions including images and 3D scenes. Although the MLPs are able to represent complex scenes with unprecedented quality and memory footprint, this expressive power of the MLPs, however, comes at the cost of long training and inference times. On the other hand, bilinear/trilinear interpolation on regular grid based representations can give fast training and inference times, but cannot match the quality of MLPs without requiring significant additional memory. Hence, in this work, we investigate what is the smallest change to grid-based representations that allows for retaining the high fidelity result of MLPs while enabling fast reconstruction and rendering times. We introduce a surprisingly simple change that achieves this task -- simply allowing a fixed non-linearity (ReLU) on interpolated grid values. When combined with coarse to-fine optimization, we show that such an approach becomes competitive with the state-of-the-art. We report results on radiance fields, and occupancy fields, and compare against multiple existing alternatives. Code and data for the paper are available at https://geometry.cs.ucl.ac.uk/projects/2022/relu_fields. △ Less

Submitted 2 July, 2023; v1 submitted 22 May, 2022; originally announced May 2022.

Comments: Published at SIGGRAPH 2022

State Estimation Methods for Continuous-Discrete Nonlinear Systems involving Stochastic Differential Equations

Authors: Marcus Krogh Nielsen, Tobias K. S. Ritschel, Ib Christensen, Jess Dragheim, Jakob Kjøbsted Huusom, Krist V. Gernaey, John Bagterp Jørgensen

Abstract: In this work, we present methods for state estimation in continuous-discrete nonlinear systems involving stochastic differential equations. We present the extended Kalman filter, the unscented Kalman filter, the ensemble Kalman filter, and a particle filter. We implement the state estimation methods in Matlab. We evaluate the performance of the methods on a simulation of the modified four-tank sys… ▽ More In this work, we present methods for state estimation in continuous-discrete nonlinear systems involving stochastic differential equations. We present the extended Kalman filter, the unscented Kalman filter, the ensemble Kalman filter, and a particle filter. We implement the state estimation methods in Matlab. We evaluate the performance of the methods on a simulation of the modified four-tank system. We implement the state estimation methods for non-stiff systems, i.e., using an explicit numerical integration scheme. The implementation of the extended Kalman filter utilises the Joseph stabilising form for numerical stability. We evaluate the accuracy of the state estimation methods in terms of the mean absolute percentage error over the simulation horizon. We show that each method successfully estimates the states and unmeasured disturbances of the simulated modified four-tank system. Finally, we present conclusions. △ Less

Submitted 5 May, 2022; originally announced May 2022.

Comments: 6 pages, 2 figures, 1 table, submitted to be presented at a conference

A whole-body multi-scale mathematical model for dynamic simulation of the metabolism in man

Authors: Peter Emil Carstensen, Jacob Bendsen, Asbjørn Thode Reenberg, Tobias K. S. Ritschel, John Bagterp Jørgensen

Abstract: We propose a whole-body model of the metabolism in man as well as a generalized approach for modeling metabolic networks. Using this approach, we are able to write a large metabolic network in a systematic and compact way. We demonstrate the approach using a whole-body model of the metabolism of the three macronutrients, carbohydrates, proteins and lipids. The model contains 7 organs, 16 metabolit… ▽ More We propose a whole-body model of the metabolism in man as well as a generalized approach for modeling metabolic networks. Using this approach, we are able to write a large metabolic network in a systematic and compact way. We demonstrate the approach using a whole-body model of the metabolism of the three macronutrients, carbohydrates, proteins and lipids. The model contains 7 organs, 16 metabolites and 31 enzymatic reactions. All reaction rates are described by Michaelis-Menten kinetics with an addition of a hormonal regulator based on the two hormones insulin and glucagon. We incorporate ingestion of food in order to simulate metabolite concentrations during the feed-fast cycle. The model can simulate several days due to the inclusion of storage forms (glycogen, muscle protein and lipid droplets), that can be depleted if food is not ingested regularly. A physiological model incorporating complex cellular metabolism and whole-body mass dynamics can be used in virtual clinical trials. Such trials can be used to improve the development of medicine, treatment strategies such as control algorithms, and increase the likelihood of a successful clinical trial. △ Less

Submitted 3 May, 2022; originally announced May 2022.

Comments: 6 pages, 7 figures, submitted to be presented at a conference

Large-scale Virtual Clinical Trials of Closed-loop Treatments for People with Type 1 Diabetes

Authors: Tobias K. S. Ritschel, Asbjørn Thode Reenberg, John Bagterp Jørgensen

Abstract: We propose a virtual clinical trial for assessing the safety and efficacy of closed-loop diabetes treatments prior to an actual clinical trial. Such virtual trials enable rapid and risk-free pretrial testing of algorithms, and they can be used to compare different treatment variations for large and diverse populations. The participants are represented by multiple mathematical models, consisting of… ▽ More We propose a virtual clinical trial for assessing the safety and efficacy of closed-loop diabetes treatments prior to an actual clinical trial. Such virtual trials enable rapid and risk-free pretrial testing of algorithms, and they can be used to compare different treatment variations for large and diverse populations. The participants are represented by multiple mathematical models, consisting of stochastic differential equations, and we use Monte Carlo closed-loop simulations to compute detailed statistics of the closed-loop treatments. We implement the virtual clinical trial using high-performance software and hardware, and we present an example trial with two mathematical models of one~million participants over 52~weeks (i.e., two~million simulations), which can be completed in 2~h 9~min. △ Less

Submitted 3 May, 2022; originally announced May 2022.

Comments: 6 pages, 2 tables, 5 figures, in submission for presentation at a conference

OutCast: Outdoor Single-image Relighting with Cast Shadows

Authors: David Griffiths, Tobias Ritschel, Julien Philip

Abstract: We propose a relighting method for outdoor images. Our method mainly focuses on predicting cast shadows in arbitrary novel lighting directions from a single image while also accounting for shading and global effects such the sun light color and clouds. Previous solutions for this problem rely on reconstructing occluder geometry, e.g. using multi-view stereo, which requires many images of the scene… ▽ More We propose a relighting method for outdoor images. Our method mainly focuses on predicting cast shadows in arbitrary novel lighting directions from a single image while also accounting for shading and global effects such the sun light color and clouds. Previous solutions for this problem rely on reconstructing occluder geometry, e.g. using multi-view stereo, which requires many images of the scene. Instead, in this work we make use of a noisy off-the-shelf single-image depth map estimation as a source of geometry. Whilst this can be a good guide for some lighting effects, the resulting depth map quality is insufficient for directly ray-tracing the shadows. Addressing this, we propose a learned image space ray-marching layer that converts the approximate depth map into a deep 3D representation that is fused into occlusion queries using a learned traversal. Our proposed method achieves, for the first time, state-of-the-art relighting results, with only a single image as input. For supplementary material visit our project page at: https://dgriffiths.uk/outcast. △ Less

Submitted 20 April, 2022; originally announced April 2022.

Comments: Eurographics 2022 - Accepted

Metappearance: Meta-Learning for Visual Appearance Reproduction

Authors: Michael Fischer, Tobias Ritschel

Abstract: There currently exist two main approaches to reproducing visual appearance using Machine Learning (ML): The first is training models that generalize over different instances of a problem, e.g., different images of a dataset. As one-shot approaches, these offer fast inference, but often fall short in quality. The second approach does not train models that generalize across tasks, but rather over-fi… ▽ More There currently exist two main approaches to reproducing visual appearance using Machine Learning (ML): The first is training models that generalize over different instances of a problem, e.g., different images of a dataset. As one-shot approaches, these offer fast inference, but often fall short in quality. The second approach does not train models that generalize across tasks, but rather over-fit a single instance of a problem, e.g., a flash image of a material. These methods offer high quality, but take long to train. We suggest to combine both techniques end-to-end using meta-learning: We over-fit onto a single problem instance in an inner loop, while also learning how to do so efficiently in an outer-loop across many exemplars. To this end, we derive the required formalism that allows applying meta-learning to a wide range of visual appearance reproduction problems: textures, BRDFs, svBRDFs, illumination or the entire light transport of a scene. The effects of meta-learning parameters on several different aspects of visual appearance are analyzed in our framework, and specific guidance for different tasks is provided. Metappearance enables visual quality that is similar to over-fit approaches in only a fraction of their runtime while keeping the adaptivity of general models. △ Less

Submitted 28 September, 2022; v1 submitted 19 April, 2022; originally announced April 2022.

Comments: Accepted as a journal paper to SIGGRAPH Asia 2022. Also see the project page at https://mfischer-ucl.github.io/metappearance

Clean Implicit 3D Structure from Noisy 2D STEM Images

Authors: Hannah Kniesel, Timo Ropinski, Tim Bergner, Kavitha Shaga Devan, Clarissa Read, Paul Walther, Tobias Ritschel, Pedro Hermosilla

Abstract: Scanning Transmission Electron Microscopes (STEMs) acquire 2D images of a 3D sample on the scale of individual cell components. Unfortunately, these 2D images can be too noisy to be fused into a useful 3D structure and facilitating good denoisers is challenging due to the lack of clean-noisy pairs. Additionally, representing a detailed 3D structure can be difficult even for clean data when using r… ▽ More Scanning Transmission Electron Microscopes (STEMs) acquire 2D images of a 3D sample on the scale of individual cell components. Unfortunately, these 2D images can be too noisy to be fused into a useful 3D structure and facilitating good denoisers is challenging due to the lack of clean-noisy pairs. Additionally, representing a detailed 3D structure can be difficult even for clean data when using regular 3D grids. Addressing these two limitations, we suggest a differentiable image formation model for STEM, allowing to learn a joint model of 2D sensor noise in STEM together with an implicit 3D model. We show, that the combination of these models are able to successfully disentangle 3D signal and noise without supervision and outperform at the same time several baselines on synthetic and real data. △ Less

Submitted 29 March, 2022; originally announced March 2022.

Comments: Accepted at CVPR 2022

ONIX: an X-ray deep-learning tool for 3D reconstructions from sparse views

Authors: Yuhe Zhang, Zisheng Yao, Tobias Ritschel, Pablo Villanueva-Perez

Abstract: Three-dimensional (3D) X-ray imaging techniques like tomography and confocal microscopy are crucial for academic and industrial applications. These approaches access 3D information by scanning the sample with respect to the X-ray source. However, the scanning process limits the temporal resolution when studying dynamics and is not feasible for some applications, such as surgical guidance in medica… ▽ More Three-dimensional (3D) X-ray imaging techniques like tomography and confocal microscopy are crucial for academic and industrial applications. These approaches access 3D information by scanning the sample with respect to the X-ray source. However, the scanning process limits the temporal resolution when studying dynamics and is not feasible for some applications, such as surgical guidance in medical applications. Alternatives to obtaining 3D information when scanning is not possible are X-ray stereoscopy and multi-projection imaging. However, these approaches suffer from limited volumetric information as they only acquire a small number of views or projections compared to traditional 3D scanning techniques. Here, we present ONIX (Optimized Neural Implicit X-ray imaging), a deep-learning algorithm capable of retrieving 3D objects with arbitrary large resolution from only a set of sparse projections. ONIX, although it does not have access to any volumetric information, outperforms current 3D reconstruction approaches because it includes the physics of image formation with X-rays, and it generalizes across different experiments over similar samples to overcome the limited volumetric information provided by sparse views. We demonstrate the capabilities of ONIX compared to state-of-the-art tomographic reconstruction algorithms by applying it to simulated and experimental datasets, where a maximum of eight projections are acquired. We anticipate that ONIX will become a crucial tool for the X-ray community by i) enabling the study of fast dynamics not possible today when implemented together with X-ray multi-projection imaging, and ii) enhancing the volumetric information and capabilities of X-ray stereoscopic imaging in medical applications. △ Less

Submitted 28 February, 2022; originally announced March 2022.

Nonlinear Model Predictive Control and System Identification for a Dual-hormone Artificial Pancreas

Authors: Asbjørn Thode Reenberg, Tobias K. S. Ritschel, Emilie B. Lindkvist, Christian Laugesen, Jannet Svensson, Ajenthen G. Ranjan, Kirsten Nørgaard, John Bagterp Jørgensen

Abstract: In this work, we present a switching nonlinear model predictive control (NMPC) algorithm for a dual-hormone artificial pancreas (AP), and we use maximum likelihood estimation (MLE) to identify model parameters. A dual-hormone AP consists of a continuous glucose monitor (CGM), a control algorithm, an insulin pump, and a glucagon pump. The AP is designed with a heuristic to switch between insulin an… ▽ More In this work, we present a switching nonlinear model predictive control (NMPC) algorithm for a dual-hormone artificial pancreas (AP), and we use maximum likelihood estimation (MLE) to identify model parameters. A dual-hormone AP consists of a continuous glucose monitor (CGM), a control algorithm, an insulin pump, and a glucagon pump. The AP is designed with a heuristic to switch between insulin and glucagon as well as state-dependent constraints. We extend an existing glucoregulatory model with glucagon and exercise for simulation, and we use a simpler model for control. We test the AP (NMPC and MLE) using in silico numerical simulations on 50 virtual people with type 1 diabetes. The system is identified for each virtual person based on data generated with the simulation model. The simulations show a mean of 89.3% time in range (3.9-10 mmol/L) and no hypoglycemic events. △ Less

Submitted 28 February, 2022; originally announced February 2022.

Comments: In submission, 7 pages, 6 figures

High-performance Uncertainty Quantification in Large-scale Virtual Clinical Trials of Closed-loop Diabetes Treatment

Authors: Asbjørn Thode Reenberg, Tobias K. S. Ritschel, Bernd Dammann, John Bagterp Jørgensen

Abstract: In this paper, we propose a virtual clinical trial for assessing the performance and identifying risks in closed-loop diabetes treatments. Virtual clinical trials enable fast and risk-free tests of many treatment variations for large populations of fictive patients (represented by mathematical models). We use closed-loop Monte Carlo simulation, implemented in high-performance software and hardware… ▽ More In this paper, we propose a virtual clinical trial for assessing the performance and identifying risks in closed-loop diabetes treatments. Virtual clinical trials enable fast and risk-free tests of many treatment variations for large populations of fictive patients (represented by mathematical models). We use closed-loop Monte Carlo simulation, implemented in high-performance software and hardware, to quantify the uncertainty in treatment performance as well as to compare the performance in different scenarios or of different closed-loop treatments. Our software can be used for testing a wide variety of control strategies ranging from heuristical approaches to nonlinear model predictive control. We present an example of a virtual clinical trial with one million patients over 52 weeks, and we use high-performance software and hardware to conduct the virtual trial in 1 h and 22 min. △ Less

Submitted 28 February, 2022; originally announced February 2022.

Comments: Accepted for publication in Proceedings of the 2022 American Control Conference (ACC), 6 pages, 8 figures

A one-size-fits-all artificial pancreas for people with type 1 diabetes based on physiological insight and feedback control

Authors: Tobias K. S. Ritschel, Asbjørn Thode Reenberg, Emilie B. Lindkvist, Christian Laugesen, Jannet Svensson, Ajenthen G. Ranjan, Kirsten Nørgaard, Bernd Dammann, John Bagterp Jørgensen

Abstract: We propose a model-free artificial pancreas (AP) for people with type 1 diabetes. The algorithmic parameters are tuned to a virtual population of 1,000,000 individuals, and the AP repeatedly estimates the basal and bolus insulin requirements necessary for maintaining normal blood glucose levels. Therefore, the AP can be used without healthcare personnel or engineers customizing the algorithm to ea… ▽ More We propose a model-free artificial pancreas (AP) for people with type 1 diabetes. The algorithmic parameters are tuned to a virtual population of 1,000,000 individuals, and the AP repeatedly estimates the basal and bolus insulin requirements necessary for maintaining normal blood glucose levels. Therefore, the AP can be used without healthcare personnel or engineers customizing the algorithm to each user. The estimates are based on bodyweight, measurements from a continuous glucose monitor (CGM), and estimates of the meal carbohydrate contents. In a virtual clinical trial with all 1,000,000 individuals (i.e., a Monte Carlo closed-loop simulation), the AP achieves a mean time in range of more than 87% and almost 89% of the participants satisfy several glycemic targets. △ Less

Submitted 27 February, 2022; originally announced February 2022.

Comments: In submission, 6 pages, 7 figures, and 3 tables

Eikonal Fields for Refractive Novel-View Synthesis

Authors: Mojtaba Bemana, Karol Myszkowski, Jeppe Revall Frisvad, Hans-Peter Seidel, Tobias Ritschel

Abstract: We tackle the problem of generating novel-view images from collections of 2D images showing refractive and reflective objects. Current solutions assume opaque or transparent light transport along straight paths following the emission-absorption model. Instead, we optimize for a field of 3D-varying Index of Refraction (IoR) and trace light through it that bends toward the spatial gradients of said… ▽ More We tackle the problem of generating novel-view images from collections of 2D images showing refractive and reflective objects. Current solutions assume opaque or transparent light transport along straight paths following the emission-absorption model. Instead, we optimize for a field of 3D-varying Index of Refraction (IoR) and trace light through it that bends toward the spatial gradients of said IoR according to the laws of eikonal light transport. △ Less

Submitted 15 June, 2022; v1 submitted 2 February, 2022; originally announced February 2022.

Comments: 8 pages, 6 figures, project webpage: https://eikonalfield.mpi-inf.mpg.de

Local mechanism of valence bond formation in IrTe$_2$

Authors: T. Ritschel, Q. Stahl, M. Kusch, J. Trinckauf, G. Garbarino, V. Svitlyk, M. Mezouar, J. Yang, S. W. Cheong, J. Geck

Abstract: Doped IrTe$_2$ is considered a platform for topological superconductivity and therefore receives currently a lot of interest. In addition, the superconductivity in these materials exists in close vicinity of electronic valence bond crystals, which we explore here by means of high-pressure single crystal x-ray diffraction in combination with density functional theory. Our crystallographic refinemen… ▽ More Doped IrTe$_2$ is considered a platform for topological superconductivity and therefore receives currently a lot of interest. In addition, the superconductivity in these materials exists in close vicinity of electronic valence bond crystals, which we explore here by means of high-pressure single crystal x-ray diffraction in combination with density functional theory. Our crystallographic refinements provide unprecedented information about the structural evolution as a function of applied pressure up to 42 GPa. Using this structural information for density functional theory calculations, we show that the valence bond formation in IrTe$_2$ is driven by changes in the Ir-Te-Ir bond angle. When a valence bond is formed, this bond angle decreases drastically, leading to a stabilization of local valence bonds large enough to push them out of a broad band continuum. This unusual local mechanism of valence bond formation in an itinerant material provides a natural explanation for the different valence bond orders in IrTe$_2$, implies a very strong electron-phonon coupling and is most likely relevant for the superconductivity as well. △ Less

Submitted 8 December, 2021; originally announced December 2021.

Comments: 10 pages, 6 figures

Variance-Aware Weight Initialization for Point Convolutional Neural Networks

Authors: Pedro Hermosilla, Michael Schelling, Tobias Ritschel, Timo Ropinski

Abstract: Appropriate weight initialization has been of key importance to successfully train neural networks. Recently, batch normalization has diminished the role of weight initialization by simply normalizing each layer based on batch statistics. Unfortunately, batch normalization has several drawbacks when applied to small batch sizes, as they are required to cope with memory limitations when learning on… ▽ More Appropriate weight initialization has been of key importance to successfully train neural networks. Recently, batch normalization has diminished the role of weight initialization by simply normalizing each layer based on batch statistics. Unfortunately, batch normalization has several drawbacks when applied to small batch sizes, as they are required to cope with memory limitations when learning on point clouds. While well-founded weight initialization strategies can render batch normalization unnecessary and thus avoid these drawbacks, no such approaches have been proposed for point convolutional networks. To fill this gap, we propose a framework to unify the multitude of continuous convolutions. This enables our main contribution, variance-aware weight initialization. We show that this initialization can avoid batch normalization while achieving similar and, in some cases, better performance. △ Less

Submitted 1 August, 2022; v1 submitted 7 December, 2021; originally announced December 2021.

Comments: Accepted at ECCV 2022

Temperature-driven reorganization of electronic order in CsV$_3$Sb$_5$

Authors: Q. Stahl, D. Chen, T. Ritschel, C. Shekhar, C. Felser, J. Geck

Abstract: We report a temperature dependent x-ray diffraction study of the electronic ordering instabilities in the kagome material CsV$_3$Sb$_5$. Our measurements between 10 K and 120 K reveal an unexpected reorganization of the three-dimensional electronic order in the bulk of CsV$_3$Sb$_5$: At 10 K, a 2x2x2 superstructure modulation due to electronic order is observed, which upon warming changes to a 2x2… ▽ More We report a temperature dependent x-ray diffraction study of the electronic ordering instabilities in the kagome material CsV$_3$Sb$_5$. Our measurements between 10 K and 120 K reveal an unexpected reorganization of the three-dimensional electronic order in the bulk of CsV$_3$Sb$_5$: At 10 K, a 2x2x2 superstructure modulation due to electronic order is observed, which upon warming changes to a 2x2x4 superstructure at 60 K. The electronic order-order transition discovered here involves a change in the stacking of electronically ordered V$_3$Sb$_5$-layers and agrees perfectly with anomalies previously observed in magneto-transport measurements. This implies that the temperature dependent three-dimensional electronic order plays a decisive role for transport properties, which are related to the Berry-curvature of the V-bands. Our data also show that the bulk electronic order in CsV$_3$Sb$_5$ breaks the 6-fold rotational symmetry of the underlying $P6/mmm$ lattice structure. △ Less

Submitted 5 December, 2021; originally announced December 2021.

Comments: 5 pages, 3 figures

Journal ref: Phys. Rev. B 105, 195136 (2022)

Model Predictive Control Tailored to Epidemic Models

Authors: Philipp Sauerteig, Willem Esterhuizen, Mitsuru Wilson, Tobias K. S. Ritschel, Karl Worthmann, Stefan Streif

Abstract: We propose a model predictive control (MPC) approach for minimising the social distancing and quarantine measures during a pandemic while maintaining a hard infection cap. To this end, we study the admissible and the maximal robust positively invariant set (MRPI) of the standard SEIR compartmental model with control inputs. Exploiting the fact that in the MRPI all restrictions can be lifted withou… ▽ More We propose a model predictive control (MPC) approach for minimising the social distancing and quarantine measures during a pandemic while maintaining a hard infection cap. To this end, we study the admissible and the maximal robust positively invariant set (MRPI) of the standard SEIR compartmental model with control inputs. Exploiting the fact that in the MRPI all restrictions can be lifted without violating the infection cap, we choose a suitable subset of the MRPI to define terminal constraints in our MPC routine and show that the number of infected people decays exponentially within this set. Furthermore, under mild assumptions we prove existence of a uniform bound on the time required to reach this terminal region (without violating the infection cap) starting in the admissible set. The findings are substantiated based on a numerical case study. △ Less

Submitted 4 May, 2022; v1 submitted 12 November, 2021; originally announced November 2021.

Comments: 14 pages, 3 figures

Metameric Varifocal Holography

Authors: David R. Walton, Koray Kavaklı, Rafael Kuffner dos Anjos, David Swapp, Tim Weyrich, Hakan Urey, Anthony Steed, Tobias Ritschel, Kaan Akşit

Abstract: Computer-Generated Holography (CGH) offers the potential for genuine, high-quality three-dimensional visuals. However, fulfilling this potential remains a practical challenge due to computational complexity and visual quality issues. We propose a new CGH method that exploits gaze-contingency and perceptual graphics to accelerate the development of practical holographic display systems. Firstly, ou… ▽ More Computer-Generated Holography (CGH) offers the potential for genuine, high-quality three-dimensional visuals. However, fulfilling this potential remains a practical challenge due to computational complexity and visual quality issues. We propose a new CGH method that exploits gaze-contingency and perceptual graphics to accelerate the development of practical holographic display systems. Firstly, our method infers the user's focal depth and generates images only at their focus plane without using any moving parts. Second, the images displayed are metamers; in the user's peripheral vision, they need only be statistically correct and blend with the fovea seamlessly. Unlike previous methods, our method prioritises and improves foveal visual quality without causing perceptually visible distortions at the periphery. To enable our method, we introduce a novel metameric loss function that robustly compares the statistics of two given images for a known gaze location. In parallel, we implement a model representing the relation between holograms and their image reconstructions. We couple our differentiable loss function and model to metameric varifocal holograms using a stochastic gradient descent solver. We evaluate our method with an actual proof-of-concept holographic display, and we show that our CGH method leads to practical and perceptually three-dimensional image reconstructions. △ Less

Submitted 16 May, 2022; v1 submitted 5 October, 2021; originally announced October 2021.

Journal ref: 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)

Hidden Charge Order in an Iron Oxide Square-Lattice Compound

Authors: Jung-Hwa Kim, Darren C. Peets, Manfred Reehuis, Peter Adler, Andrey Maljuk, Tobias Ritschel, Morgan C. Allison, Jochen Geck, Jose R. L. Mardegan, Pablo J. Bereciartua Perez, Sonia Francoual, Andrew C. Walters, Thomas Keller, Paula M. Abdala, Philip Pattison, Pinder Dosanjh, Bernhard Keimer

Abstract: Since the discovery of charge disproportionation in the FeO$_2$ square-lattice compound Sr$_3$Fe$_2$O$_7$ by Mössbauer spectroscopy more than fifty years ago, the spatial ordering pattern of the disproportionated charges has remained "hidden" to conventional diffraction probes, despite numerous x-ray and neutron scattering studies. We have used neutron Larmor diffraction and Fe K-edge resonant x-r… ▽ More Since the discovery of charge disproportionation in the FeO$_2$ square-lattice compound Sr$_3$Fe$_2$O$_7$ by Mössbauer spectroscopy more than fifty years ago, the spatial ordering pattern of the disproportionated charges has remained "hidden" to conventional diffraction probes, despite numerous x-ray and neutron scattering studies. We have used neutron Larmor diffraction and Fe K-edge resonant x-ray scattering to demonstrate checkerboard charge order in the FeO$_2$ planes that vanishes at a sharp second-order phase transition upon heating above 332 K. Stacking disorder of the checkerboard pattern due to frustrated interlayer interactions broadens the corresponding superstructure reflections and greatly reduces their amplitude, thus explaining the difficulty to detect them by conventional probes. We discuss implications of these findings for research on "hidden order" in other materials. △ Less

Submitted 5 August, 2021; originally announced August 2021.

Comments: PRL in press, 12 pages including Supplementary, CIF files available as ancillary files

Journal ref: Phys. Rev. Lett. 127, 097203 (2021)

Data-driven deep density estimation

Authors: Patrik Puchert, Pedro Hermosilla, Tobias Ritschel, Timo Ropinski

Abstract: Density estimation plays a crucial role in many data analysis tasks, as it infers a continuous probability density function (PDF) from discrete samples. Thus, it is used in tasks as diverse as analyzing population data, spatial locations in 2D sensor readings, or reconstructing scenes from 3D scans. In this paper, we introduce a learned, data-driven deep density estimation (DDE) to infer PDFs in a… ▽ More Density estimation plays a crucial role in many data analysis tasks, as it infers a continuous probability density function (PDF) from discrete samples. Thus, it is used in tasks as diverse as analyzing population data, spatial locations in 2D sensor readings, or reconstructing scenes from 3D scans. In this paper, we introduce a learned, data-driven deep density estimation (DDE) to infer PDFs in an accurate and efficient manner, while being independent of domain dimensionality or sample size. Furthermore, we do not require access to the original PDF during estimation, neither in parametric form, nor as priors, or in the form of many samples. This is enabled by training an unstructured convolutional neural network on an infinite stream of synthetic PDFs, as unbound amounts of synthetic training data generalize better across a deck of natural PDFs than any natural finite training data will do. Thus, we hope that our publicly available DDE method will be beneficial in many areas of data analysis, where continuous models are to be estimated from discrete observations. △ Less

Submitted 23 July, 2021; originally announced July 2021.

Comments: 35 pages, 25 figures. Puplished in Neural Computing and Applications (2021). The method described is available as python pip pachage deep_density_estimation and on github https://github.com/trikpachu/ DDE

How to coordinate vaccination and social distancing to mitigate SARS-CoV-2 outbreaks

Authors: Sara Grundel, Stefan Heyder, Thomas Hotz, Tobias K. S. Ritschel, Philipp Sauerteig, Karl Worthmann

Abstract: Most countries have started vaccinating people against COVID-19. However, due to limited production capacities and logistical challenges it will take months/years until herd immunity is achieved. Therefore, vaccination and social distancing have to be coordinated. In this paper, we provide some insight on this topic using optimization-based control on an age-differentiated compartmental model. For… ▽ More Most countries have started vaccinating people against COVID-19. However, due to limited production capacities and logistical challenges it will take months/years until herd immunity is achieved. Therefore, vaccination and social distancing have to be coordinated. In this paper, we provide some insight on this topic using optimization-based control on an age-differentiated compartmental model. For real-life decision making, we investigate the impact of the planning horizon on the optimal vaccination/social distancing strategy. We find that in order to reduce social distancing in the long run, without overburdening the healthcare system, it is essential to vaccinate the people with the highest contact rates first. That is also the case if the objective is to minimize fatalities provided that the social distancing measures are sufficiently strict. However, for short-term planning it is optimal to focus on the high-risk group. △ Less

Submitted 20 April, 2021; v1 submitted 22 December, 2020; originally announced April 2021.

Comments: 25 pages, 16 figures

Unsupervised Learning of 3D Object Categories from Videos in the Wild

Authors: Philipp Henzler, Jeremy Reizenstein, Patrick Labatut, Roman Shapovalov, Tobias Ritschel, Andrea Vedaldi, David Novotny

Abstract: Our goal is to learn a deep network that, given a small number of images of an object of a given category, reconstructs it in 3D. While several recent works have obtained analogous results using synthetic data or assuming the availability of 2D primitives such as keypoints, we are interested in working with challenging real data and with no manual annotations. We thus focus on learning a model fro… ▽ More Our goal is to learn a deep network that, given a small number of images of an object of a given category, reconstructs it in 3D. While several recent works have obtained analogous results using synthetic data or assuming the availability of 2D primitives such as keypoints, we are interested in working with challenging real data and with no manual annotations. We thus focus on learning a model from multiple views of a large collection of object instances. We contribute with a new large dataset of object centric videos suitable for training and benchmarking this class of models. We show that existing techniques leveraging meshes, voxels, or implicit surfaces, which work well for reconstructing isolated objects, fail on this challenging data. Finally, we propose a new neural network design, called warp-conditioned ray embedding (WCR), which significantly improves reconstruction while obtaining a detailed implicit representation of the object surface and texture, also compensating for the noise in the initial SfM reconstruction that bootstrapped the learning process. Our evaluation demonstrates performance improvements over several deep monocular reconstruction baselines on existing benchmarks and on our novel dataset. △ Less

Submitted 30 March, 2021; originally announced March 2021.

Generative Modelling of BRDF Textures from Flash Images

Authors: Philipp Henzler, Valentin Deschaintre, Niloy J. Mitra, Tobias Ritschel

Abstract: We learn a latent space for easy capture, consistent interpolation, and efficient reproduction of visual material appearance. When users provide a photo of a stationary natural material captured under flashlight illumination, first it is converted into a latent material code. Then, in the second step, conditioned on the material code, our method produces an infinite and diverse spatial field of BR… ▽ More We learn a latent space for easy capture, consistent interpolation, and efficient reproduction of visual material appearance. When users provide a photo of a stationary natural material captured under flashlight illumination, first it is converted into a latent material code. Then, in the second step, conditioned on the material code, our method produces an infinite and diverse spatial field of BRDF model parameters (diffuse albedo, normals, roughness, specular albedo) that subsequently allows rendering in complex scenes and illuminations, matching the appearance of the input photograph. Technically, we jointly embed all flash images into a latent space using a convolutional encoder, and -- conditioned on these latent codes -- convert random spatial fields into fields of BRDF parameters using a convolutional neural network (CNN). We condition these BRDF parameters to match the visual characteristics (statistics and spectra of visual features) of the input under matching light. A user study compares our approach favorably to previous work, even those with access to BRDF supervision. △ Less

Submitted 10 September, 2021; v1 submitted 23 February, 2021; originally announced February 2021.

Neural BRDF Representation and Importance Sampling

Authors: Alejandro Sztrajman, Gilles Rainer, Tobias Ritschel, Tim Weyrich

Abstract: Controlled capture of real-world material appearance yields tabulated sets of highly realistic reflectance data. In practice, however, its high memory footprint requires compressing into a representation that can be used efficiently in rendering while remaining faithful to the original. Previous works in appearance encoding often prioritised one of these requirements at the expense of the other, b… ▽ More Controlled capture of real-world material appearance yields tabulated sets of highly realistic reflectance data. In practice, however, its high memory footprint requires compressing into a representation that can be used efficiently in rendering while remaining faithful to the original. Previous works in appearance encoding often prioritised one of these requirements at the expense of the other, by either applying high-fidelity array compression strategies not suited for efficient queries during rendering, or by fitting a compact analytic model that lacks expressiveness. We present a compact neural network-based representation of BRDF data that combines high-accuracy reconstruction with efficient practical rendering via built-in interpolation of reflectance. We encode BRDFs as lightweight networks, and propose a training scheme with adaptive angular sampling, critical for the accurate reconstruction of specular highlights. Additionally, we propose a novel approach to make our representation amenable to importance sampling: rather than inverting the trained networks, we learn to encode them in a more compact embedding that can be mapped to parameters of an analytic BRDF for which importance sampling is known. We evaluate encoding results on isotropic and anisotropic BRDFs from multiple real-world datasets, and importance sampling performance for isotropic BRDFs mapped to two different analytic models. △ Less

Submitted 14 May, 2021; v1 submitted 11 February, 2021; originally announced February 2021.