-
Deep Reinforcement Learning for Weapons to Targets Assignment in a Hypersonic strike
Authors:
Brian Gaudet,
Kris Drozd,
Roberto Furfaro
Abstract:
We use deep reinforcement learning (RL) to optimize a weapons to target assignment (WTA) policy for multi-vehicle hypersonic strike against multiple targets. The objective is to maximize the total value of destroyed targets in each episode. Each randomly generated episode varies the number and initial conditions of the hypersonic strike weapons (HSW) and targets, the value distribution of the targ…
▽ More
We use deep reinforcement learning (RL) to optimize a weapons to target assignment (WTA) policy for multi-vehicle hypersonic strike against multiple targets. The objective is to maximize the total value of destroyed targets in each episode. Each randomly generated episode varies the number and initial conditions of the hypersonic strike weapons (HSW) and targets, the value distribution of the targets, and the probability of a HSW being intercepted. We compare the performance of this WTA policy to that of a benchmark WTA policy derived using non-linear integer programming (NLIP), and find that the RL WTA policy gives near optimal performance with a 1000X speedup in computation time, allowing real time operation that facilitates autonomous decision making in the mission end game.
△ Less
Submitted 27 October, 2023;
originally announced October 2023.
-
Adaptive Approach Phase Guidance for a Hypersonic Glider via Reinforcement Meta Learning
Authors:
Brian Gaudet,
Kris Drozd,
Ryan Meltzer,
Roberto Furfaro
Abstract:
We use Reinforcement Meta Learning to optimize an adaptive guidance system suitable for the approach phase of a gliding hypersonic vehicle. Adaptability is achieved by optimizing over a range of off-nominal flight conditions including perturbation of aerodynamic coefficient parameters, actuator failure scenarios, and sensor noise. The system maps observations directly to commanded bank angle and a…
▽ More
We use Reinforcement Meta Learning to optimize an adaptive guidance system suitable for the approach phase of a gliding hypersonic vehicle. Adaptability is achieved by optimizing over a range of off-nominal flight conditions including perturbation of aerodynamic coefficient parameters, actuator failure scenarios, and sensor noise. The system maps observations directly to commanded bank angle and angle of attack rates. These observations include a velocity field tracking error formulated using parallel navigation, but adapted to work over long trajectories where the Earth's curvature must be taken into account. Minimizing the tracking error keeps the curved space line of sight to the target location aligned with the vehicle's velocity vector. The optimized guidance system will then induce trajectories that bring the vehicle to the target location with a high degree of accuracy at the designated terminal speed, while satisfying heating rate, load, and dynamic pressure constraints. We demonstrate the adaptability of the guidance system by testing over flight conditions that were not experienced during optimization. The guidance system's performance is then compared to that of a linear quadratic regulator tracking an optimal trajectory.
△ Less
Submitted 30 July, 2021;
originally announced July 2021.
-
A deep survey for symbiotic stars in the Magellanic Clouds - 1. Methodology and first discoveries in the SMC
Authors:
Krystian Ilkiewicz,
Joanna Mikolajewska,
Michael M. Shara,
Andrzej Udalski,
Katarzyna Drozd,
Jacqueline K. Faherty
Abstract:
We have initiated a survey aimed at locating a nearly complete sample of classical symbiotic stars (SySt) in the Magellanic Clouds. Such a sample is nearly impossible to obtain in the Milky Way, and is essential to constrain the formation, evolution and demise of these strongly interacting, evolved binary stars. We have imaged both Clouds in Halpha and He II 4686 narrow-band filters deeply enough…
▽ More
We have initiated a survey aimed at locating a nearly complete sample of classical symbiotic stars (SySt) in the Magellanic Clouds. Such a sample is nearly impossible to obtain in the Milky Way, and is essential to constrain the formation, evolution and demise of these strongly interacting, evolved binary stars. We have imaged both Clouds in Halpha and He II 4686 narrow-band filters deeply enough to detect all known symbiotic stars. While He II 4686 is not present in all SySt, our method should yield a high success rate because the mimics of SySt are not as likely as true symbiotics to show this emission line. We demonstrate the viability of our method through the discovery and characterization of three new SySt in the Small Magellanic Cloud: 2MASS J00411657-7233253, 2MASS J01104404-7208464 and 2MASS J01113745-7159023. Enigmatic variability was observed in 2MASS J01113745-7159023, where changes in the amplitude of its quasi-periodic variability may suggest an enhanced mass transfer rate during a periastron passage on an elliptical orbit. 2MASS J01104404-7208464 is an ellipsoidal variable with an orbital period of 403d.
△ Less
Submitted 16 November, 2018;
originally announced November 2018.
-
Nova Scorpius 1437 A.D. is now a dwarf nova, age-dated by its proper motion
Authors:
Michael M. Shara,
Krystian Ilkiewicz,
Joanna Mikolajewska,
Ashley Pagnotta,
Michael F. Bode,
Lisa A. Crause,
Katarzyna Drozd,
Jacqueline K. Faherty,
Irma Fuentes-Morales,
Jonathan E. Grindlay,
Anthony F. J. Moffat,
Linda Schmidtobreick,
F. Richard Stephenson,
Claus Tappert,
David Zurek
Abstract:
Here we report the recovery of the binary underlying the classical nova of 11 March 1437 A.D. whose age is independently confirmed by proper motion-dating, and show that in the 20th century it exhibits dwarf nova eruptions. The four oldest recovered classical novae are now all dwarf novae. Taken together they strongly suggest that mass transfer rates decrease by an order of magnitude or more in th…
▽ More
Here we report the recovery of the binary underlying the classical nova of 11 March 1437 A.D. whose age is independently confirmed by proper motion-dating, and show that in the 20th century it exhibits dwarf nova eruptions. The four oldest recovered classical novae are now all dwarf novae. Taken together they strongly suggest that mass transfer rates decrease by an order of magnitude or more in the centuries after a classical nova event, greatly slowing the evolution, and lengthening the lifetimes of these explosive binary stars.
△ Less
Submitted 31 March, 2017;
originally announced April 2017.
-
MN Draconis - peculiar, active dwarf nova in the period gap
Authors:
K. Bakowska,
A. Olech,
R. Pospieszynski,
E. Swierczynski,
F. Martinelli,
A. Rutkowski,
R. Koff,
K. Drozd,
M. Butkiewicz-Bak,
P. Kankiewicz
Abstract:
Context: We present results of an extensive world-wide observing campaign of MN Draconis.
Aims: MN Draconis is a poorly known active dwarf nova in the period gap and is one of the only two known cases of period gap SU UMa objects showing the negative superhumps. Photometric behaviour of MN Draconis poses a challenge for existing models of the superhump and superoutburst mechanisms. Therefore, th…
▽ More
Context: We present results of an extensive world-wide observing campaign of MN Draconis.
Aims: MN Draconis is a poorly known active dwarf nova in the period gap and is one of the only two known cases of period gap SU UMa objects showing the negative superhumps. Photometric behaviour of MN Draconis poses a challenge for existing models of the superhump and superoutburst mechanisms. Therefore, thorough investigation of peculiar systems, such as MN Draconis, is crucial for our understanding of evolution of the close binary stars.
Methods: To measure fundamental parameters of the system, we collected photometric data in October 2009, June-September 2013 and June-December 2015. Analysis of the light curves, $O-C$ diagrams and power spectra was carried out.
Results: During our three observational seasons we detected four superoutburts and several normal outbursts. Based on the two consecutive superoutbursts detected in 2015, the supercycle length was derived P_sc = 74 +/- 0.5 days and it has been increasing with a rate of P_dot = 3.3 x 10^(-3) during last twelve years. Based on the positive and negative superhumps we calculated the period excess epsilon = 5.6% +/- 0.1%, the period deficit epsilon_ = 2.5% +/- 0.6%, and in result, the orbital period P_orb = 0.0994(1) days (143.126 +/- 0.144 min). We updated the basic light curve parameters of MN Draconis.
Conclusions: MN Draconis is the first discovered SU UMa system in the period gap with increasing supercycle length.
△ Less
Submitted 20 March, 2017;
originally announced March 2017.
-
The first transition Wolf-Rayet WN/C star in M31
Authors:
Michael M. Shara,
Joanna Mikolajewska,
Nelson Caldwell,
Krystian Ilkiewicz,
Katarzyna Drozd,
David Zurek
Abstract:
Three decades of searches have revealed 154 Wolf-Rayet (WR) stars in M31, with 62 of WC type, 92 of WN type and zero of transition type WN/C or WC/N. In apparent contrast, about two percent of the WR stars in the Galaxy, the LMC and M33 simultaneously display strong lines of carbon and nitrogen, i.e. they are transition type WN/C or WC/N stars. We report here the serendipitous discovery of M31 WR…
▽ More
Three decades of searches have revealed 154 Wolf-Rayet (WR) stars in M31, with 62 of WC type, 92 of WN type and zero of transition type WN/C or WC/N. In apparent contrast, about two percent of the WR stars in the Galaxy, the LMC and M33 simultaneously display strong lines of carbon and nitrogen, i.e. they are transition type WN/C or WC/N stars. We report here the serendipitous discovery of M31 WR 84-1, the first transition star in M31, located at RA = 00:43:43.61 DEC = +41:45:27.95 (J2000). We present its spectrum, classify it as WN5/WC6, and compare it with other known transition stars. The star is unresolved in Hubble Space Telescope narrowband and broadband images, while its spectrum displays strong, narrow emission lines of hydrogen, [NII], [SII] and [OIII]; this indicates a nebula surrounding the star. The radial velocity of the nebular lines is consistent with that of gas at the same position in the disc of M31. The metallicity at the 11.8 kpc galactocentric distance of M31 84-1 is approximately solar, consistent with other known transition stars. We suggest that modest numbers of reddened WR stars remain to be found in M31.
△ Less
Submitted 12 October, 2015;
originally announced October 2015.
-
Symbiotic stars in the Local Group of Galaxies
Authors:
J. Mikolajewska,
M. M. Shara,
N. Caldwell,
K. Drozd,
K. Ilkiewicz,
D. Zurek
Abstract:
Preliminary results of the ongoing search for symbiotic binary stars in the Local Group of Galaxies are presented and discussed.
Preliminary results of the ongoing search for symbiotic binary stars in the Local Group of Galaxies are presented and discussed.
△ Less
Submitted 17 September, 2015;
originally announced September 2015.
