Showing 1–42 of 42 results for author: Block, A

Is Behavior Cloning All You Need? Understanding Horizon in Imitation Learning

Authors: Dylan J. Foster, Adam Block, Dipendra Misra

Abstract: Imitation learning (IL) aims to mimic the behavior of an expert in a sequential decision making task by learning from demonstrations, and has been widely applied to robotics, autonomous driving, and autoregressive text generation. The simplest approach to IL, behavior cloning (BC), is thought to incur sample complexity with unfavorable quadratic dependence on the problem horizon, motivating a vari… ▽ More Imitation learning (IL) aims to mimic the behavior of an expert in a sequential decision making task by learning from demonstrations, and has been widely applied to robotics, autonomous driving, and autoregressive text generation. The simplest approach to IL, behavior cloning (BC), is thought to incur sample complexity with unfavorable quadratic dependence on the problem horizon, motivating a variety of different online algorithms that attain improved linear horizon dependence under stronger assumptions on the data and the learner's access to the expert. We revisit the apparent gap between offline and online IL from a learning-theoretic perspective, with a focus on general policy classes up to and including deep neural networks. Through a new analysis of behavior cloning with the logarithmic loss, we show that it is possible to achieve horizon-independent sample complexity in offline IL whenever (i) the range of the cumulative payoffs is controlled, and (ii) an appropriate notion of supervised learning complexity for the policy class is controlled. Specializing our results to deterministic, stationary policies, we show that the gap between offline and online IL is not fundamental: (i) it is possible to achieve linear dependence on horizon in offline IL under dense rewards (matching what was previously only known to be achievable in online IL); and (ii) without further assumptions on the policy class, online IL cannot improve over offline IL with the logarithmic loss, even in benign MDPs. We complement our theoretical results with experiments on standard RL tasks and autoregressive language generation to validate the practical relevance of our findings. △ Less

Submitted 20 July, 2024; originally announced July 2024.

Hey, Teacher, (Don't) Leave Those Kids Alone: Standardizing HRI Education

Authors: Alexis E. Block

Abstract: Creating a standardized introduction course becomes more critical as the field of human-robot interaction (HRI) becomes more established. This paper outlines the key components necessary to provide an undergraduate with a sufficient foundational understanding of the interdisciplinary nature of this field and provides proposed course content. It emphasizes the importance of creating a course with t… ▽ More Creating a standardized introduction course becomes more critical as the field of human-robot interaction (HRI) becomes more established. This paper outlines the key components necessary to provide an undergraduate with a sufficient foundational understanding of the interdisciplinary nature of this field and provides proposed course content. It emphasizes the importance of creating a course with theoretical and experimental components to accommodate all different learning preferences. This manuscript also advocates creating or adopting a universal platform to standardize the hands-on component of introductory HRI courses, regardless of university funding or size. Next, it recommends formal training in how to read scientific articles and staying up-to-date with the latest relevant papers. Finally, it provides detailed lecture content and project milestones for a 15-week semester. By creating a standardized course, researchers can ensure consistency and quality are maintained across institutions, which will help students as well as industrial and academic employers understand what foundational knowledge is expected. △ Less

Submitted 20 March, 2024; originally announced April 2024.

Comments: Presented at the Designing an Intro to HRI Course Workshop at HRI 2024 (arXiv:2403.05588) Report-no: HRI101/2024/4

The Costs of Competition in Distributing Scarce Research Funds

Authors: Gerald Schweiger, Adrian Barnett, Peter van den Besselaar, Lutz Bornmann, Andreas De Block, John P. A. Ioannidis, Ulf Sandström, Stijn Conix

Abstract: Research funding systems are not isolated systems - they are embedded in a larger scientific system with an enormous influence on the system. This paper aims to analyze the allocation of competitive research funding from different perspectives: How reliable are decision processes for funding? What are the economic costs of competitive funding? How does competition for funds affect doing risky rese… ▽ More Research funding systems are not isolated systems - they are embedded in a larger scientific system with an enormous influence on the system. This paper aims to analyze the allocation of competitive research funding from different perspectives: How reliable are decision processes for funding? What are the economic costs of competitive funding? How does competition for funds affect doing risky research? How do competitive funding environments affect scientists themselves, and which ethical issues must be considered? We attempt to identify gaps in our knowledge of research funding systems; we propose recommendations for policymakers and funding agencies, including empirical experiments of decision processes and the collection of data on these processes. With our recommendations we hope to contribute to developing improved ways of organizing research funding. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Comments: 29 pages

On the Performance of Empirical Risk Minimization with Smoothed Data

Authors: Adam Block, Alexander Rakhlin, Abhishek Shetty

Abstract: In order to circumvent statistical and computational hardness results in sequential decision-making, recent work has considered smoothed online learning, where the distribution of data at each time is assumed to have bounded likeliehood ratio with respect to a base measure when conditioned on the history. While previous works have demonstrated the benefits of smoothness, they have either assumed t… ▽ More In order to circumvent statistical and computational hardness results in sequential decision-making, recent work has considered smoothed online learning, where the distribution of data at each time is assumed to have bounded likeliehood ratio with respect to a base measure when conditioned on the history. While previous works have demonstrated the benefits of smoothness, they have either assumed that the base measure is known to the learner or have presented computationally inefficient algorithms applying only in special cases. This work investigates the more general setting where the base measure is \emph{unknown} to the learner, focusing in particular on the performance of Empirical Risk Minimization (ERM) with square loss when the data are well-specified and smooth. We show that in this setting, ERM is able to achieve sublinear error whenever a class is learnable with iid data; in particular, ERM achieves error scaling as $\tilde O( \sqrt{\mathrm{comp}(\mathcal F)\cdot T} )$, where $\mathrm{comp}(\mathcal F)$ is the statistical complexity of learning $\mathcal F$ with iid data. In so doing, we prove a novel norm comparison bound for smoothed data that comprises the first sharp norm comparison for dependent data applying to arbitrary, nonlinear function classes. We complement these results with a lower bound indicating that our analysis of ERM is essentially tight, establishing a separation in the performance of ERM between smoothed and iid data. △ Less

Submitted 22 February, 2024; originally announced February 2024.

Oracle-Efficient Differentially Private Learning with Public Data

Authors: Adam Block, Mark Bun, Rathin Desai, Abhishek Shetty, Steven Wu

Abstract: Due to statistical lower bounds on the learnability of many function classes under privacy constraints, there has been recent interest in leveraging public data to improve the performance of private learning algorithms. In this model, algorithms must always guarantee differential privacy with respect to the private samples while also ensuring learning guarantees when the private data distribution… ▽ More Due to statistical lower bounds on the learnability of many function classes under privacy constraints, there has been recent interest in leveraging public data to improve the performance of private learning algorithms. In this model, algorithms must always guarantee differential privacy with respect to the private samples while also ensuring learning guarantees when the private data distribution is sufficiently close to that of the public data. Previous work has demonstrated that when sufficient public, unlabelled data is available, private learning can be made statistically tractable, but the resulting algorithms have all been computationally inefficient. In this work, we present the first computationally efficient, algorithms to provably leverage public data to learn privately whenever a function class is learnable non-privately, where our notion of computational efficiency is with respect to the number of calls to an optimization oracle for the function class. In addition to this general result, we provide specialized algorithms with improved sample complexities in the special cases when the function class is convex or when the task is binary classification. △ Less

Submitted 13 February, 2024; originally announced February 2024.

The Steward Observatory LEO Satellite Photometric Survey

Authors: Harrison Krantz, Eric C. Pearce, Adam Block

Abstract: The Steward Observatory LEO Satellite Photometric Survey is a comprehensive observational survey to characterize the apparent brightness of the Starlink and OneWeb low Earth orbit satellites and evaluate the potential impact on astronomy. We report the results of over 16,000 independent measurements of nearly 2800 individual satellites. In addition to photometry, we also measured the astrometric p… ▽ More The Steward Observatory LEO Satellite Photometric Survey is a comprehensive observational survey to characterize the apparent brightness of the Starlink and OneWeb low Earth orbit satellites and evaluate the potential impact on astronomy. We report the results of over 16,000 independent measurements of nearly 2800 individual satellites. In addition to photometry, we also measured the astrometric position of each satellite and evaluated the accuracy of predicting satellite position with the available two-line element sets. The apparent brightness of a satellite seen in the sky is not constant and depends on the Sun-satellite-observer geometry. To capture this, we designed the survey to create an all-geometries set of measurements to fully characterize the brightness of each population of satellites as seen in the sky. We visualize the data with sky-plots that show the correlation of apparent brightness with on-sky position and relative Sun-satellite-observer geometry. The sky-plots show where in the sky the satellites are brightest. In addition to visual magnitudes, we also present two new metrics: the expected photon flux and the effective albedo. The expected photon flux metric assesses the potential impact on astronomy sensors by predicting the flux for a satellite trail in an image from a theoretical 1 m class telescope and sensor. The effective albedo metric assesses where a satellite is more reflective than baseline, which ties to the physical structure of the satellite and indicates the potential for brightness-reducing design changes. We intend to use this methodology and resulting data to inform the astronomy community about satellite brightness. △ Less

Submitted 23 November, 2023; originally announced November 2023.

Comments: 20 pages, 17 figures; published in PASP; this copy includes correct Figure 16 in place rather than separate in Erratum

Journal ref: PASP 135 095003 (2023)

Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression

Authors: Adam Block, Dylan J. Foster, Akshay Krishnamurthy, Max Simchowitz, Cyril Zhang

Abstract: This work studies training instabilities of behavior cloning with deep neural networks. We observe that minibatch SGD updates to the policy network during training result in sharp oscillations in long-horizon rewards, despite negligibly affecting the behavior cloning loss. We empirically disentangle the statistical and computational causes of these oscillations, and find them to stem from the chao… ▽ More This work studies training instabilities of behavior cloning with deep neural networks. We observe that minibatch SGD updates to the policy network during training result in sharp oscillations in long-horizon rewards, despite negligibly affecting the behavior cloning loss. We empirically disentangle the statistical and computational causes of these oscillations, and find them to stem from the chaotic propagation of minibatch SGD noise through unstable closed-loop dynamics. While SGD noise is benign in the single-step action prediction objective, it results in catastrophic error accumulation over long horizons, an effect we term gradient variance amplification (GVA). We show that many standard mitigation techniques do not alleviate GVA, but find an exponential moving average (EMA) of iterates to be surprisingly effective at doing so. We illustrate the generality of this phenomenon by showing the existence of GVA and its amelioration by EMA in both continuous control and autoregressive language generation. Finally, we provide theoretical vignettes that highlight the benefits of EMA in alleviating GVA and shed light on the extent to which classical convex models can help in understanding the benefits of iterate averaging in deep learning. △ Less

Submitted 17 October, 2023; originally announced October 2023.

Provable Guarantees for Generative Behavior Cloning: Bridging Low-Level Stability and High-Level Behavior

Authors: Adam Block, Ali Jadbabaie, Daniel Pfrommer, Max Simchowitz, Russ Tedrake

Abstract: We propose a theoretical framework for studying behavior cloning of complex expert demonstrations using generative modeling. Our framework invokes low-level controllers - either learned or implicit in position-command control - to stabilize imitation around expert demonstrations. We show that with (a) a suitable low-level stability guarantee and (b) a powerful enough generative model as our imitat… ▽ More We propose a theoretical framework for studying behavior cloning of complex expert demonstrations using generative modeling. Our framework invokes low-level controllers - either learned or implicit in position-command control - to stabilize imitation around expert demonstrations. We show that with (a) a suitable low-level stability guarantee and (b) a powerful enough generative model as our imitation learner, pure supervised behavior cloning can generate trajectories matching the per-time step distribution of essentially arbitrary expert trajectories in an optimal transport cost. Our analysis relies on a stochastic continuity property of the learned policy we call "total variation continuity" (TVC). We then show that TVC can be ensured with minimal degradation of accuracy by combining a popular data-augmentation regimen with a novel algorithmic trick: adding augmentation noise at execution time. We instantiate our guarantees for policies parameterized by diffusion models and prove that if the learner accurately estimates the score of the (noise-augmented) expert policy, then the distribution of imitator trajectories is close to the demonstrator distribution in a natural optimal transport distance. Our analysis constructs intricate couplings between noise-augmented trajectories, a technique that may be of independent interest. We conclude by empirically validating our algorithmic recommendations, and discussing implications for future research directions for better behavior cloning with generative modeling. △ Less

Submitted 24 October, 2023; v1 submitted 27 July, 2023; originally announced July 2023.

Comments: updated figures, minor notational change for readability

Efficient Model-Free Exploration in Low-Rank MDPs

Authors: Zakaria Mhammedi, Adam Block, Dylan J. Foster, Alexander Rakhlin

Abstract: A major challenge in reinforcement learning is to develop practical, sample-efficient algorithms for exploration in high-dimensional domains where generalization and function approximation is required. Low-Rank Markov Decision Processes -- where transition probabilities admit a low-rank factorization based on an unknown feature embedding -- offer a simple, yet expressive framework for RL with func… ▽ More A major challenge in reinforcement learning is to develop practical, sample-efficient algorithms for exploration in high-dimensional domains where generalization and function approximation is required. Low-Rank Markov Decision Processes -- where transition probabilities admit a low-rank factorization based on an unknown feature embedding -- offer a simple, yet expressive framework for RL with function approximation, but existing algorithms are either (1) computationally intractable, or (2) reliant upon restrictive statistical assumptions such as latent variable structure, access to model-based function approximation, or reachability. In this work, we propose the first provably sample-efficient algorithm for exploration in Low-Rank MDPs that is both computationally efficient and model-free, allowing for general function approximation and requiring no additional structural assumptions. Our algorithm, VoX, uses the notion of a barycentric spanner for the feature embedding as an efficiently computable basis for exploration, performing efficient barycentric spanner computation by interleaving representation learning and policy optimization. Our analysis -- which is appealingly simple and modular -- carefully combines several techniques, including a new approach to error-tolerant barycentric spanner computation and an improved analysis of a certain minimax representation learning objective found in prior work. △ Less

Submitted 29 February, 2024; v1 submitted 8 July, 2023; originally announced July 2023.

Computationally Relaxed Locally Decodable Codes, Revisited

Authors: Alexander R. Block, Jeremiah Blocki

Abstract: We revisit computationally relaxed locally decodable codes (crLDCs) (Blocki et al., Trans. Inf. Theory '21) and give two new constructions. Our first construction is a Hamming crLDC that is conceptually simpler than prior constructions, leveraging digital signature schemes and an appropriately chosen Hamming code. Our second construction is an extension of our Hamming crLDC to handle insertion-del… ▽ More We revisit computationally relaxed locally decodable codes (crLDCs) (Blocki et al., Trans. Inf. Theory '21) and give two new constructions. Our first construction is a Hamming crLDC that is conceptually simpler than prior constructions, leveraging digital signature schemes and an appropriately chosen Hamming code. Our second construction is an extension of our Hamming crLDC to handle insertion-deletion (InsDel) errors, yielding an InsDel crLDC. This extension crucially relies on the noisy binary search techniques of Block et al. (FSTTCS '20) to handle InsDel errors. Both crLDC constructions have binary codeword alphabets, are resilient to a constant fraction of Hamming and InsDel errors, respectively, and under suitable parameter choices have poly-logarithmic locality and encoding length linear in the message length and polynomial in the security parameter. These parameters compare favorably to prior constructions in the poly-logarithmic locality regime. △ Less

Submitted 4 September, 2023; v1 submitted 1 May, 2023; originally announced May 2023.

Oracle-Efficient Smoothed Online Learning for Piecewise Continuous Decision Making

Authors: Adam Block, Alexander Rakhlin, Max Simchowitz

Abstract: Smoothed online learning has emerged as a popular framework to mitigate the substantial loss in statistical and computational complexity that arises when one moves from classical to adversarial learning. Unfortunately, for some spaces, it has been shown that efficient algorithms suffer an exponentially worse regret than that which is minimax optimal, even when the learner has access to an optimiza… ▽ More Smoothed online learning has emerged as a popular framework to mitigate the substantial loss in statistical and computational complexity that arises when one moves from classical to adversarial learning. Unfortunately, for some spaces, it has been shown that efficient algorithms suffer an exponentially worse regret than that which is minimax optimal, even when the learner has access to an optimization oracle over the space. To mitigate that exponential dependence, this work introduces a new notion of complexity, the generalized bracketing numbers, which marries constraints on the adversary to the size of the space, and shows that an instantiation of Follow-the-Perturbed-Leader can attain low regret with the number of calls to the optimization oracle scaling optimally with respect to average regret. We then instantiate our bounds in several problems of interest, including online prediction and planning of piecewise continuous functions, which has many applications in fields as diverse as econometrics and robotics. △ Less

Submitted 19 March, 2024; v1 submitted 10 February, 2023; originally announced February 2023.

The Sample Complexity of Approximate Rejection Sampling with Applications to Smoothed Online Learning

Authors: Adam Block, Yury Polyanskiy

Abstract: Suppose we are given access to $n$ independent samples from distribution $μ$ and we wish to output one of them with the goal of making the output distributed as close as possible to a target distribution $ν$. In this work we show that the optimal total variation distance as a function of $n$ is given by $\tildeΘ(\frac{D}{f'(n)})$ over the class of all pairs $ν,μ$ with a bounded $f$-divergence… ▽ More Suppose we are given access to $n$ independent samples from distribution $μ$ and we wish to output one of them with the goal of making the output distributed as close as possible to a target distribution $ν$. In this work we show that the optimal total variation distance as a function of $n$ is given by $\tildeΘ(\frac{D}{f'(n)})$ over the class of all pairs $ν,μ$ with a bounded $f$-divergence $D_f(ν\|μ)\leq D$. Previously, this question was studied only for the case when the Radon-Nikodym derivative of $ν$ with respect to $μ$ is uniformly bounded. We then consider an application in the seemingly very different field of smoothed online learning, where we show that recent results on the minimax regret and the regret of oracle-efficient algorithms still hold even under relaxed constraints on the adversary (to have bounded $f$-divergence, as opposed to bounded Radon-Nikodym derivative). Finally, we also study efficacy of importance sampling for mean estimates uniform over a function class and compare importance sampling with rejection sampling. △ Less

Submitted 23 February, 2024; v1 submitted 9 February, 2023; originally announced February 2023.

Comments: Corrected mistake in proof of Lemma 27 from the COLT 2023 version of this paper

Ultrafast Umklapp-assisted electron-phonon cooling in magic-angle twisted bilayer graphene

Authors: Jake Dudley Mehew, Rafael Luque Merino, Hiroaki Ishizuka, Alexander Block, Jaime Díez Mérida, Andrés Díez Carlón, Kenji Watanabe, Takashi Taniguchi, Leonid S. Levitov, Dmitri K. Efetov, Klaas-Jan Tielrooij

Abstract: Carrier relaxation measurements in moiré materials offer a unique probe of the microscopic interactions, in particular the ones that are not easily measured by transport. Umklapp scattering between phonons is a ubiquitous momentum-nonconserving process that governs the thermal conductivity of semiconductors and insulators. In contrast, Umklapp scattering between electrons and phonons has not been… ▽ More Carrier relaxation measurements in moiré materials offer a unique probe of the microscopic interactions, in particular the ones that are not easily measured by transport. Umklapp scattering between phonons is a ubiquitous momentum-nonconserving process that governs the thermal conductivity of semiconductors and insulators. In contrast, Umklapp scattering between electrons and phonons has not been demonstrated experimentally. Here, we study the cooling of hot electrons in moiré graphene using time- and frequency-resolved photovoltage measurements as a direct probe of its complex energy pathways including electron-phonon coupling. We report on a dramatic speedup in hot carrier cooling of twisted bilayer graphene near the magic angle: the cooling time is a few picoseconds from room temperature down to 5 K, whereas in pristine graphene coupling to acoustic phonons takes nanoseconds. Our analysis indicates that this ultrafast cooling is a combined effect of the formation of a superlattice with low-energy moiré phonons, spatially compressed electronic Wannier orbitals, and a reduced superlattice Brillouin zone, enabling Umklapp scattering that overcomes electron-phonon momentum mismatch. These results demonstrate a way to engineer electron-phonon coupling in twistronic systems, an approach that could contribute to the fundamental understanding of their transport properties and enable applications in thermal management and ultrafast photodetection. △ Less

Submitted 31 January, 2023; originally announced January 2023.

Comments: 19 pages, 4 figures, 10 supporting figures

Smoothed Online Learning for Prediction in Piecewise Affine Systems

Authors: Adam Block, Max Simchowitz, Russ Tedrake

Abstract: The problem of piecewise affine (PWA) regression and planning is of foundational importance to the study of online learning, control, and robotics, where it provides a theoretically and empirically tractable setting to study systems undergoing sharp changes in the dynamics. Unfortunately, due to the discontinuities that arise when crossing into different ``pieces,'' learning in general sequential… ▽ More The problem of piecewise affine (PWA) regression and planning is of foundational importance to the study of online learning, control, and robotics, where it provides a theoretically and empirically tractable setting to study systems undergoing sharp changes in the dynamics. Unfortunately, due to the discontinuities that arise when crossing into different ``pieces,'' learning in general sequential settings is impossible and practical algorithms are forced to resort to heuristic approaches. This paper builds on the recently developed smoothed online learning framework and provides the first algorithms for prediction and simulation in PWA systems whose regret is polynomial in all relevant problem parameters under a weak smoothness assumption; moreover, our algorithms are efficient in the number of calls to an optimization oracle. We further apply our results to the problems of one-step prediction and multi-step simulation regret in piecewise affine dynamical systems, where the learner is tasked with simulating trajectories and regret is measured in terms of the Wasserstein distance between simulated and true data. Along the way, we develop several technical tools of more general interest. △ Less

Submitted 19 March, 2024; v1 submitted 26 January, 2023; originally announced January 2023.

A Review of NEST Models, and Their Application to Improvement of Particle Identification in Liquid Xenon Experiments

Authors: M. Szydagis, J. Balajthy, G. A. Block, J. P. Brodsky, E. Brown, J. E. Cutter, S. J. Farrell, J. Huang, E. S. Kozlova, C. S. Liebenthal, D. N. McKinsey, K. McMichael, M. Mooney, J. Mueller, K. Ni, G. R. C. Rischbieter, M. Tripathi, C. D. Tunnell, V. Velan, M. D. Wyman, Z. Zhao, M. Zhong

Abstract: This paper discusses microphysical simulation of interactions in liquid xenon, the active detector medium in many leading rare-event physics searches, and describes experimental observables useful to understanding detector performance. The scintillation and ionization yield distributions for signal and background are presented using the Noble Element Simulation Technique, or NEST, which is a toolk… ▽ More This paper discusses microphysical simulation of interactions in liquid xenon, the active detector medium in many leading rare-event physics searches, and describes experimental observables useful to understanding detector performance. The scintillation and ionization yield distributions for signal and background are presented using the Noble Element Simulation Technique, or NEST, which is a toolkit based upon experimental data and simple, empirical formulae. NEST models of light and of charge production as a function of particle type, energy, and electric field are reviewed, as well as of energy resolution and final pulse areas. After vetting of NEST against raw data, with several specific examples pulled from XENON, ZEPLIN, LUX / LZ, and PandaX, we interpolate and extrapolate its models to draw new conclusions on the properties of future detectors (e.g., XLZD), in terms of the best possible discrimination of electronic recoil backgrounds from the potential nuclear recoil signal due to WIMP dark matter. We find that the oft-quoted value of a 99.5% discrimination is likely too conservative. NEST shows that another order of magnitude improvement (99.95% discrimination) may be achievable with a high photon detection efficiency (g1 about 15-20%) and reasonably achievable drift field of approximately 300 V/cm. △ Less

Submitted 14 December, 2023; v1 submitted 19 November, 2022; originally announced November 2022.

Comments: 26 Pages, 6 Tables, 15 Figures, 18 Equations, and 156 References

A pre-time-zero spatiotemporal microscopy technique for the ultrasensitive determination of the thermal diffusivity of thin films

Authors: Sebin Varghese, Jake Dudley Mehew, Alexander Block, David Saleta Reig, Paweł Woźniak, Roberta Farris, Zeila Zanolli, Pablo Ordejón, Matthieu J. Verstraete, Niek F. van Hulst, Klaas-Jan Tielrooij

Abstract: Diffusion is one of the most ubiquitous transport phenomena in nature. Experimentally, it can be tracked by following point spreading in space and time. Here, we introduce a spatiotemporal pump-probe microscopy technique that exploits the residual spatial temperature profile obtained through the transient reflectivity when probe pulses arrive before pump pulses. This corresponds to an effective pu… ▽ More Diffusion is one of the most ubiquitous transport phenomena in nature. Experimentally, it can be tracked by following point spreading in space and time. Here, we introduce a spatiotemporal pump-probe microscopy technique that exploits the residual spatial temperature profile obtained through the transient reflectivity when probe pulses arrive before pump pulses. This corresponds to an effective pump-probe time delay of 13 ns, determined by the repetition rate of our laser system (76 MHz). This pre-time-zero technique enables probing the diffusion of long-lived excitations created by previous pump pulses with nanometer accuracy, and is particularly powerful for following in-plane heat diffusion in thin films. In contrast to existing techniques for quantifying thermal transport it does not require any material input parameters or strong heating. We demonstrate the direct determination of the thermal diffusivities of the layered materials MoSe$_2$ (0.18 cm$^2$/s), WSe$_2$ (0.20 cm$^2$/s), MoS$_2$ (0.35 cm$^2$/s), and WS$_2$ (0.59 cm$^2$/s). This technique paves the way for observing novel nanoscale thermal transport phenomena and tracking diffusion of a broad range of species. △ Less

Submitted 10 November, 2022; v1 submitted 9 November, 2022; originally announced November 2022.

Milliwatt terahertz harmonic generation from topological insulator metamaterials

Authors: Klaas-Jan Tielrooij, Alessandro Principi, David Saleta Reig, Alexander Block, Sebin Varghese, Steffen Schreyeck, Karl Brunner, Grzegorz Karczewski, Igor Ilyakov, Oleksiy Ponomaryov, Thales V. A. G. de Oliveira, Min Chen, Jan-Christoph Deinert, Carmen Gomez Carbonell, Sergio O. Valenzuela, Laurens W. Molenkamp, Tobias Kiessling, Georgy V. Astakhov, Sergey Kovalev

Abstract: Achieving efficient, high-power harmonic generation in the terahertz spectral domain has technological applications, for example in sixth generation (6G) communication networks. Massless Dirac fermions possess extremely large terahertz nonlinear susceptibilities and harmonic conversion efficiencies. However, the observed maximum generated harmonic power is limited, because of saturation effects at… ▽ More Achieving efficient, high-power harmonic generation in the terahertz spectral domain has technological applications, for example in sixth generation (6G) communication networks. Massless Dirac fermions possess extremely large terahertz nonlinear susceptibilities and harmonic conversion efficiencies. However, the observed maximum generated harmonic power is limited, because of saturation effects at increasing incident powers, as shown recently for graphene. Here, we demonstrate room-temperature terahertz harmonic generation in a Bi$_2$Se$_3$ topological insulator and topological-insulator-grating metamaterial structures with surface-selective terahertz field enhancement. We obtain a third-harmonic power approaching the milliwatt range for an incident power of 75 mW - an improvement by two orders of magnitude compared to a benchmarked graphene sample. We establish a framework in which this exceptional performance is the result of thermodynamic harmonic generation by the massless topological surface states, benefiting from ultrafast dissipation of electronic heat via surface-bulk Coulomb interactions. These results are an important step towards on-chip terahertz (opto)electronic applications. △ Less

Submitted 1 November, 2022; originally announced November 2022.

Journal ref: Light Sci Appl 11, 315 (2022)

Characterization of LEO Satellites With All-Sky Photometric Signatures

Authors: Harrison Krantz, Eric C. Pearce, Adam Block

Abstract: We present novel techniques and methodology for unresolved photometric characterization of low-Earth Orbit (LEO) satellites. With the Pomenis LEO Satellite Photometric Survey our team has made over 14,000 observations of Starlink and OneWeb satellites to measure their apparent brightness. From the apparent brightness of each satellite, we calculate a new metric: the effective albedo, which quantif… ▽ More We present novel techniques and methodology for unresolved photometric characterization of low-Earth Orbit (LEO) satellites. With the Pomenis LEO Satellite Photometric Survey our team has made over 14,000 observations of Starlink and OneWeb satellites to measure their apparent brightness. From the apparent brightness of each satellite, we calculate a new metric: the effective albedo, which quantifies the specularity of the reflecting satellite. Unlike stellar magnitude units, the effective albedo accounts for apparent range and phase angle and enables direct comparison of different satellites. Mapping the effective albedo from multiple observations across the sky produces an all-sky photometric signature which is distinct for each population of satellites, including the various sub-models of Starlink satellites. Space Situational Awareness (SSA) practitioners can use all-sky photometric signatures to differentiate populations of satellites, compare their reflection characteristics, identify unknown satellites, and find anomalous members. To test the efficacy of all-sky signatures for satellite identification, we applied a machine learning classifier algorithm which correctly identified the majority of satellites based solely on the effective albedo metric and with as few as one observation per individual satellite. Our new method of LEO satellite photometric characterization requires no prior knowledge of the satellite's properties and is readily scalable to large numbers of satellites such as those expected with developing communications mega-constellations. △ Less

Submitted 6 October, 2022; originally announced October 2022.

Comments: 11 pages, 8 figures, Proceedings of the 2022 AMOS Conference

On Relaxed Locally Decodable Codes for Hamming and Insertion-Deletion Errors

Authors: Alex Block, Jeremiah Blocki, Kuan Cheng, Elena Grigorescu, Xin Li, Yu Zheng, Minshen Zhu

Abstract: Locally Decodable Codes (LDCs) are error-correcting codes $C:Σ^n\rightarrow Σ^m$ with super-fast decoding algorithms. They are important mathematical objects in many areas of theoretical computer science, yet the best constructions so far have codeword length $m$ that is super-polynomial in $n$, for codes with constant query complexity and constant alphabet size. In a very surprising result, Ben-S… ▽ More Locally Decodable Codes (LDCs) are error-correcting codes $C:Σ^n\rightarrow Σ^m$ with super-fast decoding algorithms. They are important mathematical objects in many areas of theoretical computer science, yet the best constructions so far have codeword length $m$ that is super-polynomial in $n$, for codes with constant query complexity and constant alphabet size. In a very surprising result, Ben-Sasson et al. showed how to construct a relaxed version of LDCs (RLDCs) with constant query complexity and almost linear codeword length over the binary alphabet, and used them to obtain significantly-improved constructions of Probabilistically Checkable Proofs. In this work, we study RLDCs in the standard Hamming-error setting, and introduce their variants in the insertion and deletion (Insdel) error setting. Insdel LDCs were first studied by Ostrovsky and Paskin-Cherniavsky, and are further motivated by recent advances in DNA random access bio-technologies, in which the goal is to retrieve individual files from a DNA storage database. Our first result is an exponential lower bound on the length of Hamming RLDCs making 2 queries, over the binary alphabet. This answers a question explicitly raised by Gur and Lachish. Our result exhibits a "phase-transition"-type behavior on the codeword length for constant-query Hamming RLDCs. We further define two variants of RLDCs in the Insdel-error setting, a weak and a strong version. On the one hand, we construct weak Insdel RLDCs with with parameters matching those of the Hamming variants. On the other hand, we prove exponential lower bounds for strong Insdel RLDCs. These results demonstrate that, while these variants are equivalent in the Hamming setting, they are significantly different in the insdel setting. Our results also prove a strict separation between Hamming RLDCs and Insdel RLDCs. △ Less

Submitted 18 September, 2022; originally announced September 2022.

Efficient and Near-Optimal Smoothed Online Learning for Generalized Linear Functions

Authors: Adam Block, Max Simchowitz

Abstract: Due to the drastic gap in complexity between sequential and batch statistical learning, recent work has studied a smoothed sequential learning setting, where Nature is constrained to select contexts with density bounded by 1/σ with respect to a known measure μ. Unfortunately, for some function classes, there is an exponential gap between the statistically optimal regret and that which can be achie… ▽ More Due to the drastic gap in complexity between sequential and batch statistical learning, recent work has studied a smoothed sequential learning setting, where Nature is constrained to select contexts with density bounded by 1/σ with respect to a known measure μ. Unfortunately, for some function classes, there is an exponential gap between the statistically optimal regret and that which can be achieved efficiently. In this paper, we give a computationally efficient algorithm that is the first to enjoy the statistically optimal log(T/σ) regret for realizable K-wise linear classification. We extend our results to settings where the true classifier is linear in an over-parameterized polynomial featurization of the contexts, as well as to a realizable piecewise-regression setting assuming access to an appropriate ERM oracle. Somewhat surprisingly, standard disagreement-based analyses are insufficient to achieve regret logarithmic in 1/σ. Instead, we develop a novel characterization of the geometry of the disagreement region induced by generalized linear classifiers. Along the way, we develop numerous technical tools of independent interest, including a general anti-concentration bound for the determinant of certain matrix averages. △ Less

Submitted 25 May, 2022; originally announced May 2022.

Rate of convergence of the smoothed empirical Wasserstein distance

Authors: Adam Block, Zeyu Jia, Yury Polyanskiy, Alexander Rakhlin

Abstract: Consider an empirical measure $\mathbb{P}_n$ induced by $n$ iid samples from a $d$-dimensional $K$-subgaussian distribution $\mathbb{P}$ and let $γ= \mathcal{N}(0,σ^2 I_d)$ be the isotropic Gaussian measure. We study the speed of convergence of the smoothed Wasserstein distance $W_2(\mathbb{P}_n * γ, \mathbb{P}*γ) = n^{-α+ o(1)}$ with $*$ being the convolution of measures. For $K<σ$ and in any dim… ▽ More Consider an empirical measure $\mathbb{P}_n$ induced by $n$ iid samples from a $d$-dimensional $K$-subgaussian distribution $\mathbb{P}$ and let $γ= \mathcal{N}(0,σ^2 I_d)$ be the isotropic Gaussian measure. We study the speed of convergence of the smoothed Wasserstein distance $W_2(\mathbb{P}_n * γ, \mathbb{P}*γ) = n^{-α+ o(1)}$ with $*$ being the convolution of measures. For $K<σ$ and in any dimension $d\ge 1$ we show that $α= {1\over2}$. For $K>σ$ in dimension $d=1$ we show that the rate is slower and is given by $α= {(σ^2 + K^2)^2\over 4 (σ^4 + K^4)} < 1/2$. This resolves several open problems in \cite{goldfeld2020convergence}, and in particular precisely identifies the amount of smoothing $σ$ needed to obtain a parametric rate. In addition, we also establish that $D_{KL}(\mathbb{P}_n * γ\|\mathbb{P}*γ)$ has rate $O(1/n)$ for $K<σ$ but only slows down to $O({(\log n)^{d+1}\over n})$ for $K>σ$. The surprising difference of the behavior of $W_2^2$ and KL implies the failure of $T_{2}$-transportation inequality when $σ< K$. Consequently, the requirement $K<σ$ is necessary for validity of the log-Sobolev inequality (LSI) for the Gaussian mixture $\mathbb{P} * \mathcal{N}(0, σ^{2})$, closing an open problem in \cite{wang2016functional}, who established the LSI under precisely this condition. △ Less

Submitted 12 July, 2023; v1 submitted 4 May, 2022; originally announced May 2022.

Counterfactual Learning To Rank for Utility-Maximizing Query Autocompletion

Authors: Adam Block, Rahul Kidambi, Daniel N. Hill, Thorsten Joachims, Inderjit S. Dhillon

Abstract: Conventional methods for query autocompletion aim to predict which completed query a user will select from a list. A shortcoming of this approach is that users often do not know which query will provide the best retrieval performance on the current information retrieval system, meaning that any query autocompletion methods trained to mimic user behavior can lead to suboptimal query suggestions. To… ▽ More Conventional methods for query autocompletion aim to predict which completed query a user will select from a list. A shortcoming of this approach is that users often do not know which query will provide the best retrieval performance on the current information retrieval system, meaning that any query autocompletion methods trained to mimic user behavior can lead to suboptimal query suggestions. To overcome this limitation, we propose a new approach that explicitly optimizes the query suggestions for downstream retrieval performance. We formulate this as a problem of ranking a set of rankings, where each query suggestion is represented by the downstream item ranking it produces. We then present a learning method that ranks query suggestions by the quality of their item rankings. The algorithm is based on a counterfactual learning approach that is able to leverage feedback on the items (e.g., clicks, purchases) to evaluate query suggestions through an unbiased estimator, thus avoiding the assumption that users write or select optimal queries. We establish theoretical support for the proposed approach and provide learning-theoretic guarantees. We also present empirical results on publicly available datasets, and demonstrate real-world applicability using data from an online shopping store. △ Less

Submitted 22 April, 2022; originally announced April 2022.

In the Arms of a Robot: Designing Autonomous Hugging Robots with Intra-Hug Gestures

Authors: Alexis E. Block, Hasti Seifi, Otmar Hilliges, Roger Gassert, Katherine J. Kuchenbecker

Abstract: Hugs are complex affective interactions that often include gestures like squeezes. We present six new guidelines for designing interactive hugging robots, which we validate through two studies with our custom robot. To achieve autonomy, we investigated robot responses to four human intra-hug gestures: holding, rubbing, patting, and squeezing. Thirty-two users each exchanged and rated sixteen hugs… ▽ More Hugs are complex affective interactions that often include gestures like squeezes. We present six new guidelines for designing interactive hugging robots, which we validate through two studies with our custom robot. To achieve autonomy, we investigated robot responses to four human intra-hug gestures: holding, rubbing, patting, and squeezing. Thirty-two users each exchanged and rated sixteen hugs with an experimenter-controlled HuggieBot 2.0. The robot's inflated torso's microphone and pressure sensor collected data of the subjects' demonstrations that were used to develop a perceptual algorithm that classifies user actions with 88\% accuracy. Users enjoyed robot squeezes, regardless of their performed action, they valued variety in the robot response, and they appreciated robot-initiated intra-hug gestures. From average user ratings, we created a probabilistic behavior algorithm that chooses robot responses in real time. We implemented improvements to the robot platform to create HuggieBot 3.0 and then validated its gesture perception system and behavior algorithm with sixteen users. The robot's responses and proactive gestures were greatly enjoyed. Users found the robot more natural, enjoyable, and intelligent in the last phase of the experiment than in the first. After the study, they felt more understood by the robot and thought robots were nicer to hug. △ Less

Submitted 20 February, 2022; originally announced February 2022.

Comments: 48 pages, 22 figures, 4 supplementary videos

Smoothed Online Learning is as Easy as Statistical Learning

Authors: Adam Block, Yuval Dagan, Noah Golowich, Alexander Rakhlin

Abstract: Much of modern learning theory has been split between two regimes: the classical offline setting, where data arrive independently, and the online setting, where data arrive adversarially. While the former model is often both computationally and statistically tractable, the latter requires no distributional assumptions. In an attempt to achieve the best of both worlds, previous work proposed the sm… ▽ More Much of modern learning theory has been split between two regimes: the classical offline setting, where data arrive independently, and the online setting, where data arrive adversarially. While the former model is often both computationally and statistically tractable, the latter requires no distributional assumptions. In an attempt to achieve the best of both worlds, previous work proposed the smooth online setting where each sample is drawn from an adversarially chosen distribution, which is smooth, i.e., it has a bounded density with respect to a fixed dominating measure. We provide tight bounds on the minimax regret of learning a nonparametric function class, with nearly optimal dependence on both the horizon and smoothness parameters. Furthermore, we provide the first oracle-efficient, no-regret algorithms in this setting. In particular, we propose an oracle-efficient improper algorithm whose regret achieves optimal dependence on the horizon and a proper algorithm requiring only a single oracle call per round whose regret has the optimal horizon dependence in the classification setting and is sublinear in general. Both algorithms have exponentially worse dependence on the smoothness parameter of the adversary than the minimax rate. We then prove a lower bound on the oracle complexity of any proper learning algorithm, which matches the oracle-efficient upper bounds up to a polynomial factor, thus demonstrating the existence of a statistical-computational gap in smooth online learning. Finally, we apply our results to the contextual bandit setting to show that if a function class is learnable in the classical setting, then there is an oracle-efficient, no-regret algorithm for contextual bandits in the case that contexts arrive in a smooth manner. △ Less

Submitted 31 May, 2022; v1 submitted 9 February, 2022; originally announced February 2022.

The economics of malnutrition: Dietary transition and food system transformation

Authors: William A. Masters, Amelia B. Finaret, Steven A. Block

Abstract: Rapid increases in food supplies have reduced global hunger, while rising burdens of diet-related disease have made poor diet quality the leading cause of death and disability around the world. Today's "double burden" of undernourishment in utero and early childhood then undesired weight gain and obesity later in life is accompanied by a third less visible burden of micronutrient imbalances. The t… ▽ More Rapid increases in food supplies have reduced global hunger, while rising burdens of diet-related disease have made poor diet quality the leading cause of death and disability around the world. Today's "double burden" of undernourishment in utero and early childhood then undesired weight gain and obesity later in life is accompanied by a third less visible burden of micronutrient imbalances. The triple burden of undernutrition, obesity, and unbalanced micronutrients that underlies many diet-related diseases such as diabetes, hypertension and other cardiometabolic disorders often coexist in the same person, household and community. All kinds of deprivation are closely linked to food insecurity and poverty, but income growth does not always improve diet quality in part because consumers cannot directly or immediately observe the health consequences of their food options, especially for newly introduced or reformulated items. Even after direct experience and epidemiological evidence reveals relative risks of dietary patterns and nutritional exposures, many consumers may not consume a healthy diet because food choice is driven by other factors. This chapter reviews the evidence on dietary transition and food system transformation during economic development, drawing implications for how research and practice in agricultural economics can improve nutritional outcomes. △ Less

Submitted 5 February, 2022; originally announced February 2022.

Comments: Preprint of Chapter 6 in the Handbook of Agricultural Economics, vol. 6, edited by C.B. Barrett and D.R. Just (Amsterdam: Elsevier, forthcoming 2022). Last revised January 31, 2022. 97 pages

Once in a blue stream: Detection of recent star formation in the NGC 7241 stellar stream with MEGARA

Authors: David Martinez-Delgado, Santi Roca-Fabrega, Armando Gil de Paz, Denis Erkal, Juan Miro-Carretero, Dmitry Makarov, Karina T. Voggel, Ryan Leaman, Walter Boschin, Sarah Pearson, Giuseppe Donatiello, Evgenii Rubtsov, Mohammad Akhlaghi, M. Angeles Gomez-Flechoso, Samane Raji, Dustin Lang, Adam Block, Jesus Gallego, Esperanza Carrasco, Maria Luisa Garcia-Vargas, Jorge Iglesias-Paramo, Sergio Pascual, Nicolas Cardiel, Ana Perez-Calpena, Africa Castillo-Morales , et al. (1 additional authors not shown)

Abstract: In this work we study the striking case of a narrow blue stream around the NGC 7241 galaxy and its foreground dwarf companion. We want to figure out if the stream was generated by tidal interaction with NGC 7241 or it first interacted with the foreground dwarf companion and later both fell together towards NGC 7241. We use four sets of observations, including a follow-up spectroscopic study with t… ▽ More In this work we study the striking case of a narrow blue stream around the NGC 7241 galaxy and its foreground dwarf companion. We want to figure out if the stream was generated by tidal interaction with NGC 7241 or it first interacted with the foreground dwarf companion and later both fell together towards NGC 7241. We use four sets of observations, including a follow-up spectroscopic study with the MEGARA instrument at the 10.4-m Gran Telescopio Canarias. Our data suggest that the compact object we detected in the stream is a foreground Milky Way halo star. Near this compact object we detect emission lines overlapping a bluer and fainter blob of the stream that is clearly visible in both ultra-violet and optical deep images. From its heliocentric systemic radial velocity (Vsyst= 1548.58+/-1.80 km s^-1) and new UV and optical broad-band photometry, we conclude that this over-density could be the actual core of the stream, with an absolute magnitude of M_g ~ -10 and a (g-r) = 0.08 +/- 0.11, consistent with a remnant of a low-mass dwarf satellite undergoing a current episode of star formation. From the width of the stream and assuming a circular orbit, we calculate that the progenitor mass can be the typical of a dwarf galaxy, but it could also be substantially lower if the stream is on a very radial orbit or it was created by tidal interaction with the companion dwarf instead of with NGC 7241. Finally, we find that blue stellar streams containing star formation regions are commonly predicted by high-resolution cosmological simulations of galaxies lighter than the Milky Way. This scenario is consistent with the processes explaining the bursty star formation history of some dwarf satellites, which are followed by a gas depletion and a fast quenching once they enter within the virial radius of their host galaxies for the first time. △ Less

Submitted 14 December, 2023; v1 submitted 13 December, 2021; originally announced December 2021.

Comments: 12 pages, 5 figures, accepted for publication in Astronomy & Astrophysics

Characterizing the All-Sky Brightness of Satellite Mega-Constellations and the Impact on Astronomy Research

Authors: Harrison Krantz, Eric C. Pearce, Adam Block

Abstract: Measuring photometric brightness is a common tool for characterizaing satellites. However, characterizing satellite mega-constellations and their impact on astronomy research requires a new approach and methodology. A few measurements of singular satellites are not sufficient to fully describe a mega-constellation and assess its impact on modern astronomical systems. Characterizing the brightness… ▽ More Measuring photometric brightness is a common tool for characterizaing satellites. However, characterizing satellite mega-constellations and their impact on astronomy research requires a new approach and methodology. A few measurements of singular satellites are not sufficient to fully describe a mega-constellation and assess its impact on modern astronomical systems. Characterizing the brightness of a satellite mega-constellation requires a comprehensive measurement program conducting numerous observations over the entire set of critical variables. Utilizing Pomenis, a small-aperture and wide field-of-view astrograph, we developed an automated observing program to measure the photometric brightness of mega-constellation satellites. We report the summary results of 7631 separate observations and the statistical distribution of brightness for the Starlink, visored-Starlink, Starlink DarkSat, and OneWeb satellites. △ Less

Submitted 20 October, 2021; originally announced October 2021.

Comments: 26 pages, 24 figures, Proceedings of the 2021 AMOS Conference

Retrospective clinical evaluation of a decision-support software for adaptive radiotherapy of Head & Neck cancer patients

Authors: Sébastien A A Gros, Anand P Santhanam, Alec M Block, Bahman Emami, Brian H Lee, Cara Joyce

Abstract: Purpose: To evaluate the clinical need for automated decision-support platforms for Adaptive Radiotherapy Therapy (ART) of Head & Neck cancer (HNC) patients. Methods: We tested RTapp (SegAna), a new decision-support software for ART, to investigate 22 HNC patients data retrospectively. For each fraction, RTapp estimated the daily and cumulative doses received by targets and OARs from daily 3D imag… ▽ More Purpose: To evaluate the clinical need for automated decision-support platforms for Adaptive Radiotherapy Therapy (ART) of Head & Neck cancer (HNC) patients. Methods: We tested RTapp (SegAna), a new decision-support software for ART, to investigate 22 HNC patients data retrospectively. For each fraction, RTapp estimated the daily and cumulative doses received by targets and OARs from daily 3D imaging in real-time. RTapp also included a prediction algorithm that analyzed dosimetric parameters (DP) trends against dosimetric endpoints (DE) to trigger adaptation up to 4 fractions ahead. Warning (V95<95%) and adaptation (V95<93%) DEs were set for PTVs. OAR adaptation DEs of +10% (DE10) were set for all Dmax and Dmean DPs. Any DE violation at end of treatment (EOT) triggered a DP trends review to determine the DE-crossing fraction Fx and evaluate the prediction model accuracy (difference between calculated and predicted DP values with 95% confidence intervals). Results: RTapp was able to address the needs of treatment adaptation. 15/22 studies (68%) violated PTV coverage or parotids Dmean at EOT. 9 PTVs had V95<95% (mean coverage decrease of -7.7+/-3.3 %) including 4 flagged for adaptation at median Fx=11.5 (range: 6-18). 15 parotids were flagged for exceeding Dmean constraints with median increase of +3.18 Gy (range: 0.18-6.31 Gy) at EOT, including 8 with DP>DE10. The differences between predicted and calculated PTV V95 and parotids Dmean was up to 7.6% (mean: -2.9+/-4.6 %) and 5 Gy (mean: 0.2+/-1.6 Gy), respectively. The most accurate predictions were obtained closest to Fx. For parotids, Fx ranged between fractions 1 to 23, the lack of specific trend demonstrated the need to verify treatment adaptation for every fraction. Conclusion: Integrated in an ART clinical workflow, RTapp can predict whether specific treatment would require adaptation up to 4 fractions ahead of time. △ Less

Submitted 3 October, 2021; originally announced October 2021.

Comments: 20 pages, 7 figures, submitted to Frontiers in Oncology: Radiation Oncology

Unraveling heat transport and dissipation in suspended MoSe$_2$ crystals from bulk to monolayer

Authors: D. Saleta Reig, S. Varghese, R. Farris, A. Block, J. D. Mehew, O. Hellman, P. Woźniak, M. Sledzinska, A. El Sachat, E. Chávez-Ángel, S. O. Valenzuela, N. F. Van Hulst, P. Ordejón, Z. Zanolli, C. M. Sotomayor Torres, M. J. Verstraete, K. J. Tielrooij

Abstract: Understanding thermal transport in layered transition metal dichalcogenide (TMD) crystals is crucial for a myriad of applications exploiting these materials. Despite significant efforts, several basic thermal transport properties of TMDs are currently not well understood. Here, we present a combined experimental-theoretical study of the intrinsic lattice thermal conductivity of the representative… ▽ More Understanding thermal transport in layered transition metal dichalcogenide (TMD) crystals is crucial for a myriad of applications exploiting these materials. Despite significant efforts, several basic thermal transport properties of TMDs are currently not well understood. Here, we present a combined experimental-theoretical study of the intrinsic lattice thermal conductivity of the representative TMD MoSe$_2$, focusing on the effect of material thickness and the material's environment. We use Raman thermometry measurements on suspended crystals, where we identify and eliminate crucial artefacts, and perform $ab$ $initio$ simulations with phonons at finite, rather than zero, temperature. We find that phonon dispersions and lifetimes change strongly with thickness, yet (sub)nanometer thin TMD films exhibit a similar in-plane thermal conductivity ($\sim$20~Wm$^{-1}$K$^{-1}$) as bulk crystals ($\sim$40~Wm$^{-1}$K$^{-1}$). This is the result of compensating phonon contributions, in particular low-frequency modes with a surprisingly long mean free path of several micrometers that contribute significantly to thermal transport for monolayers. We furthermore demonstrate that out-of-plane heat dissipation to air is remarkably efficient, in particular for the thinnest crystals. These results are crucial for the design of TMD-based applications in thermal management, thermoelectrics and (opto)electronics. △ Less

Submitted 19 September, 2021; originally announced September 2021.

Intrinsic Dimension Estimation Using Wasserstein Distances

Authors: Adam Block, Zeyu Jia, Yury Polyanskiy, Alexander Rakhlin

Abstract: It has long been thought that high-dimensional data encountered in many practical machine learning tasks have low-dimensional structure, i.e., the manifold hypothesis holds. A natural question, thus, is to estimate the intrinsic dimension of a given population distribution from a finite sample. We introduce a new estimator of the intrinsic dimension and provide finite sample, non-asymptotic guaran… ▽ More It has long been thought that high-dimensional data encountered in many practical machine learning tasks have low-dimensional structure, i.e., the manifold hypothesis holds. A natural question, thus, is to estimate the intrinsic dimension of a given population distribution from a finite sample. We introduce a new estimator of the intrinsic dimension and provide finite sample, non-asymptotic guarantees. We then apply our techniques to get new sample complexity bounds for Generative Adversarial Networks (GANs) depending only on the intrinsic dimension of the data. △ Less

Submitted 31 May, 2022; v1 submitted 7 June, 2021; originally announced June 2021.

Private and Resource-Bounded Locally Decodable Codes for Insertions and Deletions

Authors: Alexander R. Block, Jeremiah Blocki

Abstract: We construct locally decodable codes (LDCs) to correct insertion-deletion errors in the setting where the sender and receiver share a secret key or where the channel is resource-bounded. Our constructions rely on a so-called "Hamming-to-InsDel" compiler (Ostrovsky and Paskin-Cherniavsky, ITS '15 & Block et al., FSTTCS '20), which compiles any locally decodable Hamming code into a locally decodable… ▽ More We construct locally decodable codes (LDCs) to correct insertion-deletion errors in the setting where the sender and receiver share a secret key or where the channel is resource-bounded. Our constructions rely on a so-called "Hamming-to-InsDel" compiler (Ostrovsky and Paskin-Cherniavsky, ITS '15 & Block et al., FSTTCS '20), which compiles any locally decodable Hamming code into a locally decodable code resilient to insertion-deletion (InsDel) errors. While the compilers were designed for the classical coding setting, we show that the compilers still work in a secret key or resource-bounded setting. Applying our results to the private key Hamming LDC of Ostrovsky, Pandey, and Sahai (ICALP '07), we obtain a private key InsDel LDC with constant rate and polylogarithmic locality. Applying our results to the construction of Blocki, Kulkarni, and Zhou (ITC '20), we obtain similar results for resource-bounded channels; i.e., a channel where computation is constrained by resources such as space or time. △ Less

Submitted 21 September, 2021; v1 submitted 25 March, 2021; originally announced March 2021.

Hot-Carrier Cooling in High-Quality Graphene is Intrinsically Limited by Optical Phonons

Authors: Eva A. A. Pogna, Xiaoyu Jia, Alessandro Principi, Alexander Block, Luca Banszerus, Jincan Zhang, Xiaoting Liu, Thibault Sohier, Stiven Forti, Karuppasamy Soundarapandian, Bernat Terrés, Jake D. Mehew, Chiara Trovatello, Camilla Coletti, Frank H. L. Koppens, Mischa Bonn, Niek van Hulst, Matthieu J. Verstraete, Hailin Peng, Zhongfan Liu, Christoph Stampfer, Giulio Cerullo, Klaas-Jan Tielrooij

Abstract: Many promising optoelectronic devices, such as broadband photodetectors, nonlinear frequency converters, and building blocks for data communication systems, exploit photoexcited charge carriers in graphene. For these systems, it is essential to understand, and eventually control, the cooling dynamics of the photoinduced hot-carrier distribution. There is, however, still an active debate on the dif… ▽ More Many promising optoelectronic devices, such as broadband photodetectors, nonlinear frequency converters, and building blocks for data communication systems, exploit photoexcited charge carriers in graphene. For these systems, it is essential to understand, and eventually control, the cooling dynamics of the photoinduced hot-carrier distribution. There is, however, still an active debate on the different mechanisms that contribute to hot-carrier cooling. In particular, the intrinsic cooling mechanism that ultimately limits the cooling dynamics remains an open question. Here, we address this question by studying two technologically relevant systems, consisting of high-quality graphene with a mobility >10,000 cm$^2$V$^{-1}$s$^{-1}$ and environments that do not efficiently take up electronic heat from graphene: WSe$_2$-encapsulated graphene and suspended graphene. We study the cooling dynamics of these two high-quality graphene systems using ultrafast pump-probe spectroscopy at room temperature. Cooling via disorder-assisted acoustic phonon scattering and out-of-plane heat transfer to the environment is relatively inefficient in these systems, predicting a cooling time of tens of picoseconds. However, we observe much faster cooling, on a timescale of a few picoseconds. We attribute this to an intrinsic cooling mechanism, where carriers in the hot-carrier distribution with enough kinetic energy emit optical phonons. During phonon emission, the electronic system continuously re-thermalizes, re-creating carriers with enough energy to emit optical phonons. We develop an analytical model that explains the observed dynamics, where cooling is eventually limited by optical-to-acoustic phonon coupling. These fundamental insights into the intrinsic cooling mechanism of hot carriers in graphene will play a key role in guiding the development of graphene-based optoelectronic devices. △ Less

Submitted 5 March, 2021; originally announced March 2021.

A Review of Basic Energy Reconstruction Techniques in Liquid Xenon and Argon Detectors for Dark Matter and Neutrino Physics Using NEST

Authors: M. Szydagis, G. A. Block, C. Farquhar, A. J. Flesher, E. S. Kozlova, C. Levy, E. A. Mangus, M. Mooney, J. Mueller, G. R. C. Rischbieter, A. K. Schwartz

Abstract: Detectors based upon the noble elements, especially liquid xenon as well as liquid argon, as both single- and dual-phase types, require reconstruction of the energies of interacting particles, both in the field of direct detection of dark matter (Weakly Interacting Massive Particles or WIMPs, axions, etc.) and in neutrino physics. Experimentalists, as well as theorists who reanalyze/reinterpret ex… ▽ More Detectors based upon the noble elements, especially liquid xenon as well as liquid argon, as both single- and dual-phase types, require reconstruction of the energies of interacting particles, both in the field of direct detection of dark matter (Weakly Interacting Massive Particles or WIMPs, axions, etc.) and in neutrino physics. Experimentalists, as well as theorists who reanalyze/reinterpret experimental data, have used a few different techniques over the past few decades. In this paper, we review techniques based on solely the primary scintillation channel, the ionization or secondary channel available at non-zero drift electric fields, and combined techniques that include a simple linear combination and weighted averages, with a brief discussion of the applications of profile likelihood, maximum likelihood, and machine learning. Comparing results for electron recoils (beta and gamma interactions) and nuclear recoils (primarily from neutrons) from the Noble Element Simulation Technique (NEST) simulation to available data, we confirm that combining all available information generates higher-precision means, lower widths (energy resolution), and more symmetric shapes (approximately Gaussian) especially at keV-scale energies, with the symmetry even greater when thresholding is addressed. Near thresholds, bias from upward fluctuations matters. For MeV-GeV scales, if only one channel is utilized, an ionization-only-based energy scale outperforms scintillation; channel combination remains beneficial. We discuss here what major collaborations use. △ Less

Submitted 21 March, 2021; v1 submitted 19 February, 2021; originally announced February 2021.

Comments: 42 Pages, 2 Tables, 11 Figures, 13 Equations

Journal ref: Instruments 2021, 5(1), 13

Majorizing Measures, Sequential Complexities, and Online Learning

Authors: Adam Block, Yuval Dagan, Sasha Rakhlin

Abstract: We introduce the technique of generic chaining and majorizing measures for controlling sequential Rademacher complexity. We relate majorizing measures to the notion of fractional covering numbers, which we show to be dominated in terms of sequential scale-sensitive dimensions in a horizon-independent way, and, under additional complexity assumptions establish a tight control on worst-case sequenti… ▽ More We introduce the technique of generic chaining and majorizing measures for controlling sequential Rademacher complexity. We relate majorizing measures to the notion of fractional covering numbers, which we show to be dominated in terms of sequential scale-sensitive dimensions in a horizon-independent way, and, under additional complexity assumptions establish a tight control on worst-case sequential Rademacher complexity in terms of the integral of sequential scale-sensitive dimension. Finally, we establish a tight contraction inequality for worst-case sequential Rademacher complexity. The above constitutes the resolution of a number of outstanding open problems in extending the classical theory of empirical processes to the sequential case, and, in turn, establishes sharp results for online learning. △ Less

Submitted 2 February, 2021; originally announced February 2021.

The Six Hug Commandments: Design and Evaluation of a Human-Sized Hugging Robot with Visual and Haptic Perception

Authors: Alexis E. Block, Sammy Christen, Roger Gassert, Otmar Hilliges, Katherine J. Kuchenbecker

Abstract: Receiving a hug is one of the best ways to feel socially supported, and the lack of social touch can have severe negative effects on an individual's well-being. Based on previous research both within and outside of HRI, we propose six tenets ("commandments") of natural and enjoyable robotic hugging: a hugging robot should be soft, be warm, be human sized, visually perceive its user, adjust its emb… ▽ More Receiving a hug is one of the best ways to feel socially supported, and the lack of social touch can have severe negative effects on an individual's well-being. Based on previous research both within and outside of HRI, we propose six tenets ("commandments") of natural and enjoyable robotic hugging: a hugging robot should be soft, be warm, be human sized, visually perceive its user, adjust its embrace to the user's size and position, and reliably release when the user wants to end the hug. Prior work validated the first two tenets, and the final four are new. We followed all six tenets to create a new robotic platform, HuggieBot 2.0, that has a soft, warm, inflated body (HuggieChest) and uses visual and haptic sensing to deliver closed-loop hugging. We first verified the outward appeal of this platform in comparison to the previous PR2-based HuggieBot 1.0 via an online video-watching study involving 117 users. We then conducted an in-person experiment in which 32 users each exchanged eight hugs with HuggieBot 2.0, experiencing all combinations of visual hug initiation, haptic sizing, and haptic releasing. The results show that adding haptic reactivity definitively improves user perception a hugging robot, largely verifying our four new tenets and illuminating several interesting opportunities for further improvement. △ Less

Submitted 19 January, 2021; originally announced January 2021.

Comments: 9 pages, 6 Figures, 2 Tables, ACM/IEEE Human-Robot Interaction (HRI) Conference 2021

A Comparison of Proton Stopping Power Measured with Proton CT and x-ray CT in Fresh Post-Mortem Porcine Structures

Authors: Don F. DeJongh, Ethan A. DeJongh, Victor Rykalin, Greg DeFillippo, Mark Pankuch, Andrew W. Best, George Coutrakon, Kirk L. Duffin, Nicholas T. Karonis, Caesar E. Ordoñez, Christina Sarosiek, Reinhard W. Schulte, John R. Winans, Alec M. Block, Courtney L. Hentz, James S. Welsh

Abstract: Purpose: Currently, calculations of proton range in proton therapy patients are based on a conversion of CT Hounsfield Units of patient tissues into proton relative stopping power. Uncertainties in this conversion necessitate larger proximal and distal planned target volume margins. Proton CT can potentially reduce these uncertainties by directly measuring proton stopping power. We aim to demonstr… ▽ More Purpose: Currently, calculations of proton range in proton therapy patients are based on a conversion of CT Hounsfield Units of patient tissues into proton relative stopping power. Uncertainties in this conversion necessitate larger proximal and distal planned target volume margins. Proton CT can potentially reduce these uncertainties by directly measuring proton stopping power. We aim to demonstrate proton CT imaging with complex porcine samples, to analyze in detail three-dimensional regions of interest, and to compare proton stopping powers directly measured by proton CT to those determined from x-ray CT scans. Methods: We have used a prototype proton imaging system with single proton tracking to acquire proton radiography and proton CT images of a sample of porcine pectoral girdle and ribs, and a pig's head. We also acquired close in time x-ray CT scans of the same samples, and compared proton stopping power measurements from the two modalities. In the case of the pig's head, we obtained x-ray CT scans from two different scanners, and compared results from high-dose and low-dose settings. Results: Comparing our reconstructed proton CT images with images derived from x-ray CT scans, we find agreement within 1% to 2% for soft tissues, and discrepancies of up to 6% for compact bone. We also observed large discrepancies, up to 40%, for cavitated regions with mixed content of air, soft tissue, and bone, such as sinus cavities or tympanic bullae. Conclusions: Our images and findings from a clinically realistic proton CT scanner demonstrate the potential for proton CT to be used for low-dose treatment planning with reduced margins. △ Less

Submitted 29 October, 2021; v1 submitted 11 December, 2020; originally announced December 2020.

Comments: Accepted for publication in Medical Physics

Locally Decodable/Correctable Codes for Insertions and Deletions

Authors: Alexander R. Block, Jeremiah Blocki, Elena Grigorescu, Shubhang Kulkarni, Minshen Zhu

Abstract: Recent efforts in coding theory have focused on building codes for insertions and deletions, called insdel codes, with optimal trade-offs between their redundancy and their error-correction capabilities, as well as efficient encoding and decoding algorithms. In many applications, polynomial running time may still be prohibitively expensive, which has motivated the study of codes with super-effic… ▽ More Recent efforts in coding theory have focused on building codes for insertions and deletions, called insdel codes, with optimal trade-offs between their redundancy and their error-correction capabilities, as well as efficient encoding and decoding algorithms. In many applications, polynomial running time may still be prohibitively expensive, which has motivated the study of codes with super-efficient decoding algorithms. These have led to the well-studied notions of Locally Decodable Codes (LDCs) and Locally Correctable Codes (LCCs). Inspired by these notions, Ostrovsky and Paskin-Cherniavsky (Information Theoretic Security, 2015) generalized Hamming LDCs to insertions and deletions. To the best of our knowledge, these are the only known results that study the analogues of Hamming LDCs in channels performing insertions and deletions. Here we continue the study of insdel codes that admit local algorithms. Specifically, we reprove the results of Ostrovsky and Paskin-Cherniavsky for insdel LDCs using a different set of techniques. We also observe that the techniques extend to constructions of LCCs. Specifically, we obtain insdel LDCs and LCCs from their Hamming LDCs and LCCs analogues, respectively. The rate and error-correction capability blow up only by a constant factor, while the query complexity blows up by a poly log factor in the block length. Since insdel locally decodable/correctble codes are scarcely studied in the literature, we believe our results and techniques may lead to further research. In particular, we conjecture that constant-query insdel LDCs/LCCs do not exist. △ Less

Submitted 6 December, 2020; v1 submitted 22 October, 2020; originally announced October 2020.

Observation of giant and tuneable thermal diffusivity of Dirac fluid at room temperature

Authors: Alexander Block, Alessandro Principi, Niels C. H. Hesp, Aron W. Cummings, Matz Liebel, Kenji Watanabe, Takashi Taniguchi, Stephan Roche, Frank H. L. Koppens, Niek F. van Hulst, Klaas-Jan Tielrooij

Abstract: Conducting materials typically exhibit either diffusive or ballistic charge transport. However, when electron-electron interactions dominate, a hydrodynamic regime with viscous charge flow emerges (1-13). More stringent conditions eventually yield a quantum-critical Dirac-fluid regime, where electronic heat can flow more efficiently than charge (14-22). Here we observe heat transport in graphene i… ▽ More Conducting materials typically exhibit either diffusive or ballistic charge transport. However, when electron-electron interactions dominate, a hydrodynamic regime with viscous charge flow emerges (1-13). More stringent conditions eventually yield a quantum-critical Dirac-fluid regime, where electronic heat can flow more efficiently than charge (14-22). Here we observe heat transport in graphene in the diffusive and hydrodynamic regimes, and report a controllable transition to the Dirac-fluid regime at room temperature, using carrier temperature and carrier density as control knobs. We introduce the technique of spatiotemporal thermoelectric microscopy with femtosecond temporal and nanometre spatial resolution, which allows for tracking electronic heat spreading. In the diffusive regime, we find a thermal diffusivity of $\sim$2,000 cm$^2$/s, consistent with charge transport. Remarkably, during the hydrodynamic time window before momentum relaxation, we observe heat spreading corresponding to a giant diffusivity up to 70,000 cm$^2$/Vs, indicative of a Dirac fluid. These results are promising for applications such as nanoscale thermal management. △ Less

Submitted 28 December, 2020; v1 submitted 10 August, 2020; originally announced August 2020.

Journal ref: Nat. Nanotechnol. 16, 1195-1200 (2021)

Fast Mixing of Multi-Scale Langevin Dynamics under the Manifold Hypothesis

Authors: Adam Block, Youssef Mroueh, Alexander Rakhlin, Jerret Ross

Abstract: Recently, the task of image generation has attracted much attention. In particular, the recent empirical successes of the Markov Chain Monte Carlo (MCMC) technique of Langevin Dynamics have prompted a number of theoretical advances; despite this, several outstanding problems remain. First, the Langevin Dynamics is run in very high dimension on a nonconvex landscape; in the worst case, due to the N… ▽ More Recently, the task of image generation has attracted much attention. In particular, the recent empirical successes of the Markov Chain Monte Carlo (MCMC) technique of Langevin Dynamics have prompted a number of theoretical advances; despite this, several outstanding problems remain. First, the Langevin Dynamics is run in very high dimension on a nonconvex landscape; in the worst case, due to the NP-hardness of nonconvex optimization, it is thought that Langevin Dynamics mixes only in time exponential in the dimension. In this work, we demonstrate how the manifold hypothesis allows for the considerable reduction of mixing time, from exponential in the ambient dimension to depending only on the (much smaller) intrinsic dimension of the data. Second, the high dimension of the sampling space significantly hurts the performance of Langevin Dynamics; we leverage a multi-scale approach to help ameliorate this issue and observe that this multi-resolution algorithm allows for a trade-off between image quality and computational expense in generation. △ Less

Submitted 22 June, 2020; v1 submitted 19 June, 2020; originally announced June 2020.

Generative Modeling with Denoising Auto-Encoders and Langevin Sampling

Authors: Adam Block, Youssef Mroueh, Alexander Rakhlin

Abstract: We study convergence of a generative modeling method that first estimates the score function of the distribution using Denoising Auto-Encoders (DAE) or Denoising Score Matching (DSM) and then employs Langevin diffusion for sampling. We show that both DAE and DSM provide estimates of the score of the Gaussian smoothed population density, allowing us to apply the machinery of Empirical Processes.… ▽ More We study convergence of a generative modeling method that first estimates the score function of the distribution using Denoising Auto-Encoders (DAE) or Denoising Score Matching (DSM) and then employs Langevin diffusion for sampling. We show that both DAE and DSM provide estimates of the score of the Gaussian smoothed population density, allowing us to apply the machinery of Empirical Processes. We overcome the challenge of relying only on $L^2$ bounds on the score estimation error and provide finite-sample bounds in the Wasserstein distance between the law of the population distribution and the law of this sampling scheme. We then apply our results to the homotopy method of arXiv:1907.05600 and provide theoretical justification for its empirical success. △ Less

Submitted 11 October, 2022; v1 submitted 31 January, 2020; originally announced February 2020.

Tracking ultrafast hot-electron diffusion in space and time by ultrafast thermo-modulation microscopy

Authors: Alexander Block, Matz Liebel, Renwen Yu, Marat Spector, Yonatan Sivan, F. Javier García de Abajo, Niek F. van Hulst

Abstract: The ultrafast response of metals to light is governed by intriguing non-equilibrium dynamics involving the interplay of excited electrons and phonons. The coupling between them gives rise to nonlinear diffusion behavior on ultrashort timescales. Here, we use scanning ultrafast thermo-modulation microscopy to image the spatio-temporal hot-electron diffusion in a thin gold film. By tracking local tr… ▽ More The ultrafast response of metals to light is governed by intriguing non-equilibrium dynamics involving the interplay of excited electrons and phonons. The coupling between them gives rise to nonlinear diffusion behavior on ultrashort timescales. Here, we use scanning ultrafast thermo-modulation microscopy to image the spatio-temporal hot-electron diffusion in a thin gold film. By tracking local transient reflectivity with 20 nm and 0.25 ps resolution, we reveal two distinct diffusion regimes, consisting of an initial rapid diffusion during the first few picoseconds after optical excitation, followed by about 100-fold slower diffusion at longer times. We simulate the thermo-optical response of the gold film with a comprehensive three-dimensional model, and identify the two regimes as hot-electron and phonon-limited thermal diffusion, respectively. △ Less

Submitted 27 September, 2018; originally announced September 2018.

Comments: 20 pages, 8 figures

Extreme Scale-out SuperMUC Phase 2 - lessons learned

Authors: Nicolay Hammer, Ferdinand Jamitzky, Helmut Satzger, Momme Allalen, Alexander Block, Anupam Karmakar, Matthias Brehm, Reinhold Bader, Luigi Iapichino, Antonio Ragagnin, Vasilios Karakasis, Dieter Kranzlmüller, Arndt Bode, Herbert Huber, Martin Kühn, Rui Machado, Daniel Grünewald, Philipp V. F. Edelmann, Friedrich K. Röpke, Markus Wittmann, Thomas Zeiser, Gerhard Wellein, Gerald Mathias, Magnus Schwörer, Konstantin Lorenzen , et al. (14 additional authors not shown)

Abstract: In spring 2015, the Leibniz Supercomputing Centre (Leibniz-Rechenzentrum, LRZ), installed their new Peta-Scale System SuperMUC Phase2. Selected users were invited for a 28 day extreme scale-out block operation during which they were allowed to use the full system for their applications. The following projects participated in the extreme scale-out workshop: BQCD (Quantum Physics), SeisSol (Geophysi… ▽ More In spring 2015, the Leibniz Supercomputing Centre (Leibniz-Rechenzentrum, LRZ), installed their new Peta-Scale System SuperMUC Phase2. Selected users were invited for a 28 day extreme scale-out block operation during which they were allowed to use the full system for their applications. The following projects participated in the extreme scale-out workshop: BQCD (Quantum Physics), SeisSol (Geophysics, Seismics), GPI-2/GASPI (Toolkit for HPC), Seven-League Hydro (Astrophysics), ILBDC (Lattice Boltzmann CFD), Iphigenie (Molecular Dynamic), FLASH (Astrophysics), GADGET (Cosmological Dynamics), PSC (Plasma Physics), waLBerla (Lattice Boltzmann CFD), Musubi (Lattice Boltzmann CFD), Vertex3D (Stellar Astrophysics), CIAO (Combustion CFD), and LS1-Mardyn (Material Science). The projects were allowed to use the machine exclusively during the 28 day period, which corresponds to a total of 63.4 million core-hours, of which 43.8 million core-hours were used by the applications, resulting in a utilization of 69%. The top 3 users were using 15.2, 6.4, and 4.7 million core-hours, respectively. △ Less

Submitted 6 September, 2016; originally announced September 2016.

Comments: 10 pages, 5 figures, presented at ParCo2015 - Advances in Parallel Computing, held in Edinburgh, September 2015. The final publication is available at IOS Press through http://dx.doi.org/10.3233/978-1-61499-621-7-827

Journal ref: Advances in Parallel Computing, vol. 27: Parallel Computing: On the Road to Exascale, eds. G.R. Joubert et al., p. 827, 2016