-
Lighthouse: A User-Friendly Library for Reproducible Video Moment Retrieval and Highlight Detection
Authors:
Taichi Nishimura,
Shota Nakada,
Hokuto Munakata,
Tatsuya Komatsu
Abstract:
We propose Lighthouse, a user-friendly library for reproducible video moment retrieval and highlight detection (MR-HD). Although researchers proposed various MR-HD approaches, the research community holds two main issues. The first is a lack of comprehensive and reproducible experiments across various methods, datasets, and video-text features. This is because no unified training and evaluation co…
▽ More
We propose Lighthouse, a user-friendly library for reproducible video moment retrieval and highlight detection (MR-HD). Although researchers proposed various MR-HD approaches, the research community holds two main issues. The first is a lack of comprehensive and reproducible experiments across various methods, datasets, and video-text features. This is because no unified training and evaluation codebase covers multiple settings. The second is user-unfriendly design. Because previous works use different libraries, researchers set up individual environments. In addition, most works release only the training codes, requiring users to implement the whole inference process of MR-HD. Lighthouse addresses these issues by implementing a unified reproducible codebase that includes six models, three features, and five datasets. In addition, it provides an inference API and web demo to make these methods easily accessible for researchers and developers. Our experiments demonstrate that Lighthouse generally reproduces the reported scores in the reference papers. The code is available at https://github.com/line/lighthouse.
△ Less
Submitted 21 August, 2024; v1 submitted 5 August, 2024;
originally announced August 2024.
-
Song Data Cleansing for End-to-End Neural Singer Diarization Using Neural Analysis and Synthesis Framework
Authors:
Hokuto Munakata,
Ryo Terashima,
Yusuke Fujita
Abstract:
We propose a data cleansing method that utilizes a neural analysis and synthesis (NANSY++) framework to train an end-to-end neural diarization model (EEND) for singer diarization. Our proposed model converts song data with choral singing which is commonly contained in popular music and unsuitable for generating a simulated dataset to the solo singing data. This cleansing is based on NANSY++, which…
▽ More
We propose a data cleansing method that utilizes a neural analysis and synthesis (NANSY++) framework to train an end-to-end neural diarization model (EEND) for singer diarization. Our proposed model converts song data with choral singing which is commonly contained in popular music and unsuitable for generating a simulated dataset to the solo singing data. This cleansing is based on NANSY++, which is a framework trained to reconstruct an input non-overlapped audio signal. We exploit the pre-trained NANSY++ to convert choral singing into clean, non-overlapped audio. This cleansing process mitigates the mislabeling of choral singing to solo singing and helps the effective training of EEND models even when the majority of available song data contains choral singing sections. We experimentally evaluated the EEND model trained with a dataset using our proposed method using annotated popular duet songs. As a result, our proposed method improved 14.8 points in diarization error rate.
△ Less
Submitted 24 June, 2024;
originally announced June 2024.
-
OGLE-2017-BLG-0039: Microlensing Event with Light from the Lens Identified from Mass Measurement
Authors:
C. Han,
Y. K. Jung,
A. Udalski,
I. Bond,
V. Bozza,
M. D. Albrow,
S. -J. Chung,
A. Gould,
K. -H. Hwang,
D. Kim,
C. -U. Lee,
H. -W. Kim,
Y. -H. Ryu,
I. -G. Shin,
J. C. Yee,
Y. Shvartzvald,
S. -M. Cha,
S. -L. Kim,
D. -J. Kim,
D. -J. Lee,
Y. Lee,
B. -G. Park,
R. W. Pogge,
M. K. Szymański,
P. Mróz
, et al. (36 additional authors not shown)
Abstract:
We present the analysis of the caustic-crossing binary microlensing event OGLE-2017-BLG-0039. Thanks to the very long duration of the event, with an event time scale $t_{\rm E}\sim 130$ days, the microlens parallax is precisely measured despite its small value of $\pie\sim 0.06$. The analysis of the well-resolved caustic crossings during both the source star's entrance and exit of the caustic yiel…
▽ More
We present the analysis of the caustic-crossing binary microlensing event OGLE-2017-BLG-0039. Thanks to the very long duration of the event, with an event time scale $t_{\rm E}\sim 130$ days, the microlens parallax is precisely measured despite its small value of $\pie\sim 0.06$. The analysis of the well-resolved caustic crossings during both the source star's entrance and exit of the caustic yields the angular Einstein radius $\thetae\sim 0.6$~mas. The measured $\pie$ and $\thetae$ indicate that the lens is a binary composed of two stars with masses $\sim 1.0~M_\odot$ and $\sim 0.15~M_\odot$, and it is located at a distance of $\sim 6$ kpc. From the color and brightness of the lens estimated from the determined lens mass and distance, it is expected that $\sim 2/3$ of the $I$-band blended flux comes from the lens. Therefore, the event is a rare case of a bright lens event for which high-resolution follow-up observations can confirm the nature of the lens.
△ Less
Submitted 27 September, 2018;
originally announced September 2018.
-
OGLE-2017-BLG-0482Lb: A Microlensing Super-Earth Orbiting a Low-mass Host Star
Authors:
C. Han,
Y. Hirao,
A. Udalski,
C. -U. Lee,
V. Bozza,
A. Gould,
F. Abe,
R. Barry,
I. A. Bond,
D. P. Bennett,
A. Bhattacharya,
M. Donachie,
P. Evans,
A. Fukui,
Y. Itow,
K. Kawasaki,
N. Koshimoto,
M. C. A. Li,
C. H. Ling,
Y. Matsubara,
S. Miyazaki,
H. Munakata,
Y. Muraki,
M. Nagakane,
K. Ohnishi
, et al. (40 additional authors not shown)
Abstract:
We report the discovery of a planetary system in which a super-earth orbits a late M-dwarf host. The planetary system was found from the analysis of the microlensing event OGLE-2017-BLG-0482, wherein the planet signal appears as a short-term anomaly to the smooth lensing light curve produced by the host. Despite its weak signal and short duration, the planetary signal was firmly detected from the…
▽ More
We report the discovery of a planetary system in which a super-earth orbits a late M-dwarf host. The planetary system was found from the analysis of the microlensing event OGLE-2017-BLG-0482, wherein the planet signal appears as a short-term anomaly to the smooth lensing light curve produced by the host. Despite its weak signal and short duration, the planetary signal was firmly detected from the dense and continuous coverage by three microlensing surveys. We find a planet/host mass ratio of $q\sim 1.4\times 10^{-4}$. We measure the microlens parallax $π_{\rm E}$ from the long-term deviation in the observed lensing light curve, but the angular Einstein radius $θ_{\rm E}$ cannot be measured because the source trajectory did not cross the planet-induced caustic. Using the measured event timescale and the microlens parallax, we find that the masses of the planet and the host are $M_{\rm p}=9.0_{-4.5}^{+9.0}\ M_\oplus$ and $M_{\rm host}=0.20_{-0.10}^{+0.20}\ M_\odot$, respectively, and the projected separation between them is $a_\perp=1.8_{-0.7}^{+0.6}$ au. The estimated distance to the lens is $D_{\rm L}=5.8_{-2.1}^{+1.8}$ kpc. The discovery of the planetary system demonstrates that microlensing provides an important method to detect low-mass planets orbiting low-mass stars.
△ Less
Submitted 28 March, 2018;
originally announced March 2018.
-
OGLE-2014-BLG-0289: Precise Characterization of a Quintuple-Peak Gravitational Microlensing Event
Authors:
A. Udalski,
C. Han,
V. Bozza,
A. Gould,
I. A. Bond,
P. Mróz,
J. Skowron,
Ł. Wyrzykowski,
M. K. Szymański,
I. Soszyński,
K. Ulaczyk,
R. Poleski,
P. Pietrukowicz,
S. Kozłowski,
F. Abe,
R. Barry,
D. P. Bennett,
A. Bhattacharya,
M. Donachie,
P. Evans,
A. Fukui,
Y. Hirao,
Y. Itow,
K. Kawasaki,
N. Koshimoto
, et al. (41 additional authors not shown)
Abstract:
We present the analysis of the binary-microlensing event OGLE-2014-BLG-0289. The event light curve exhibits very unusual five peaks where four peaks were produced by caustic crossings and the other peak was produced by a cusp approach. It is found that the quintuple-peak features of the light curve provide tight constraints on the source trajectory, enabling us to precisely and accurately measure…
▽ More
We present the analysis of the binary-microlensing event OGLE-2014-BLG-0289. The event light curve exhibits very unusual five peaks where four peaks were produced by caustic crossings and the other peak was produced by a cusp approach. It is found that the quintuple-peak features of the light curve provide tight constraints on the source trajectory, enabling us to precisely and accurately measure the microlensing parallax $π_{\rm E}$. Furthermore, the three resolved caustics allow us to measure the angular Einstein radius $\thetae$. From the combination of $π_{\rm E}$ and $\thetae$, the physical lens parameters are uniquely determined. It is found that the lens is a binary composed of two M dwarfs with masses $M_1 = 0.52 \pm 0.04\ M_\odot$ and $M_2=0.42 \pm 0.03\ M_\odot$ separated in projection by $a_\perp = 6.4 \pm 0.5$ au. The lens is located in the disk with a distance of $D_{\rm L} = 3.3 \pm 0.3$~kpc. It turns out that the reason for the absence of a lensing signal in the {\it Spitzer} data is that the time of observation corresponds to the flat region of the light curve.
△ Less
Submitted 15 January, 2018;
originally announced January 2018.
-
An Isolated Microlens Observed from K2, Spitzer and Earth
Authors:
Wei Zhu,
A. Udalski,
C. Huang,
S. Calchi Novati,
T. Sumi,
R. Poleski,
J. Skowron,
P. Mroz,
M. K. Szymanski,
I. Soszynski,
P. Pietrukowicz,
S. Kozlowski,
K. Ulaczyk,
M. Pawlak,
C Beichman,
G. Bryden,
S. Carey,
B. S. Gaudi,
A. Gould,
C. B. Henderson,
Y. Shvartzvald,
J. C. Yee,
I. A. Bond,
D. P. Bennett,
D. Suzuki
, et al. (28 additional authors not shown)
Abstract:
We present the result of microlensing event MOA-2016-BLG-290, which received observations from the two-wheel Kepler (K2), Spitzer, as well as ground-based observatories. A joint analysis of data from K2 and the ground leads to two degenerate solutions of the lens mass and distance. This degeneracy is effectively broken once the (partial) Spitzer light curve is included. Altogether, the lens is fou…
▽ More
We present the result of microlensing event MOA-2016-BLG-290, which received observations from the two-wheel Kepler (K2), Spitzer, as well as ground-based observatories. A joint analysis of data from K2 and the ground leads to two degenerate solutions of the lens mass and distance. This degeneracy is effectively broken once the (partial) Spitzer light curve is included. Altogether, the lens is found to be an extremely low-mass star located in the Galactic bulge. MOA-2016-BLG-290 is the first microlensing event for which we have signals from three well-separated ($\sim1$ AU) locations. It demonstrates the power of two-satellite microlensing experiment in reducing the ambiguity of lens properties, as pointed out independently by S. Refsdal and A. Gould several decades ago.
△ Less
Submitted 26 September, 2017;
originally announced September 2017.
