-
Ten Quick Tips for Deep Learning in Biology
Authors:
Benjamin D. Lee,
Anthony Gitter,
Casey S. Greene,
Sebastian Raschka,
Finlay Maguire,
Alexander J. Titus,
Michael D. Kessler,
Alexandra J. Lee,
Marc G. Chevrette,
Paul Allen Stewart,
Thiago Britto-Borges,
Evan M. Cofer,
Kun-Hsing Yu,
Juan Jose Carmona,
Elana J. Fertig,
Alexandr A. Kalinin,
Beth Signal,
Benjamin J. Lengerich,
Timothy J. Triche Jr,
Simina M. Boca
Abstract:
Machine learning is a modern approach to problem-solving and task automation. In particular, machine learning is concerned with the development and applications of algorithms that can recognize patterns in data and use them for predictive modeling. Artificial neural networks are a particular class of machine learning algorithms and models that evolved into what is now described as deep learning. G…
▽ More
Machine learning is a modern approach to problem-solving and task automation. In particular, machine learning is concerned with the development and applications of algorithms that can recognize patterns in data and use them for predictive modeling. Artificial neural networks are a particular class of machine learning algorithms and models that evolved into what is now described as deep learning. Given the computational advances made in the last decade, deep learning can now be applied to massive data sets and in innumerable contexts. Therefore, deep learning has become its own subfield of machine learning. In the context of biological research, it has been increasingly used to derive novel insights from high-dimensional biological data. To make the biological applications of deep learning more accessible to scientists who have some experience with machine learning, we solicited input from a community of researchers with varied biological and deep learning interests. These individuals collaboratively contributed to this manuscript's writing using the GitHub version control platform and the Manubot manuscript generation toolset. The goal was to articulate a practical, accessible, and concise set of guidelines and suggestions to follow when using deep learning. In the course of our discussions, several themes became clear: the importance of understanding and applying machine learning fundamentals as a baseline for utilizing deep learning, the necessity for extensive model comparisons with careful evaluation, and the need for critical thought in interpreting results generated by deep learning, among others.
△ Less
Submitted 29 May, 2021;
originally announced May 2021.
-
A field guide to cultivating computational biology
Authors:
Anne E Carpenter,
Casey S Greene,
Piero Carnici,
Benilton S Carvalho,
Michiel de Hoon,
Stacey Finley,
Kim-Anh Le Cao,
Jerry SH Lee,
Luigi Marchionni,
Suzanne Sindi,
Fabian J Theis,
Gregory P Way,
Jean YH Yang,
Elana J Fertig
Abstract:
Biomedical research centers can empower basic discovery and novel therapeutic strategies by leveraging their large-scale datasets from experiments and patients. This data, together with new technologies to create and analyze it, has ushered in an era of data-driven discovery which requires moving beyond the traditional individual, single-discipline investigator research model. This interdisciplina…
▽ More
Biomedical research centers can empower basic discovery and novel therapeutic strategies by leveraging their large-scale datasets from experiments and patients. This data, together with new technologies to create and analyze it, has ushered in an era of data-driven discovery which requires moving beyond the traditional individual, single-discipline investigator research model. This interdisciplinary niche is where computational biology thrives. It has matured over the past three decades and made major contributions to scientific knowledge and human health, yet researchers in the field often languish in career advancement, publication, and grant review. We propose solutions for individual scientists, institutions, journal publishers, funding agencies, and educators.
△ Less
Submitted 22 April, 2021;
originally announced April 2021.
-
Dynamics in hybrid complex systems of switches and oscillators
Authors:
Dane Taylor,
Elana J. Fertig,
Juan G. Restrepo
Abstract:
While considerable progress has been made in the analysis of large systems containing a single type of coupled dynamical component (e.g., coupled oscillators or coupled switches), systems containing diverse components (e.g., both oscillators and switches) have received much less attention. We analyze large, hybrid systems of interconnected Kuramoto oscillators and Hopfield switches with positive f…
▽ More
While considerable progress has been made in the analysis of large systems containing a single type of coupled dynamical component (e.g., coupled oscillators or coupled switches), systems containing diverse components (e.g., both oscillators and switches) have received much less attention. We analyze large, hybrid systems of interconnected Kuramoto oscillators and Hopfield switches with positive feedback. In this system, oscillator synchronization promotes switches to turn on. In turn, when switches turn on they enhance the synchrony of the oscillators to which they are coupled. Depending on the choice of parameters, we find theoretically coexisting stable solutions with either (i) incoherent oscillators and all switches permanently off, (ii) synchronized oscillators and all switches permanently on, or (iii) synchronized oscillators and switches that periodically alternate between the on and off states. Numerical experiments confirm these predictions. We discuss how transitions between these steady state solutions can be onset deterministically through dynamic bifurcations or spontaneously due to finite-size fluctuations.
△ Less
Submitted 9 August, 2013; v1 submitted 8 June, 2013;
originally announced June 2013.
-
Quantifying the dynamics of coupled networks of switches and oscillators
Authors:
Matthew R. Francis,
Elana J. Fertig
Abstract:
Complex network dynamics have been analyzed with models of systems of coupled switches or systems of coupled oscillators. However, many complex systems are composed of components with diverse dynamics whose interactions drive the system's evolution. We, therefore, introduce a new modeling framework that describes the dynamics of networks composed of both oscillators and switches. Both oscillator s…
▽ More
Complex network dynamics have been analyzed with models of systems of coupled switches or systems of coupled oscillators. However, many complex systems are composed of components with diverse dynamics whose interactions drive the system's evolution. We, therefore, introduce a new modeling framework that describes the dynamics of networks composed of both oscillators and switches. Both oscillator synchronization and switch stability are preserved in these heterogeneous, coupled networks. Furthermore, this model recapitulates the qualitative dynamics for the yeast cell cycle consistent with the hypothesized dynamics resulting from decomposition of the regulatory network into dynamic motifs. Introducing feedback into the cell-cycle network induces qualitative dynamics analogous to limitless replicative potential that is a hallmark of cancer. As a result, the proposed model of switch and oscillator coupling provides the ability to incorporate mechanisms that underlie the synchronized stimulus response ubiquitous in biochemical systems.
△ Less
Submitted 30 November, 2011;
originally announced November 2011.
-
Comparison between Local Ensemble Transform Kalman Filter and PSAS in the NASA finite volume GCM: perfect model experiments
Authors:
Junjie Liu,
Elana Judith Fertig,
Hong Li,
Eugenia Kalnay,
Brian R. Hunt,
Eric J. Kostelich,
Istvan Szunyogh,
Ricardo Todling
Abstract:
This paper explores the potential of Local Ensemble Transform Kalman Filter (LETKF) by comparing the performance of LETKF with an operational 3D-Var assimilation system, Physical-Space Statistical Analysis System (PSAS), under a perfect model scenario. The comparison is carried out on the finite volume Global Circulation Model (fvGCM) with 72 grid points zonally, 46 grid points meridionally and…
▽ More
This paper explores the potential of Local Ensemble Transform Kalman Filter (LETKF) by comparing the performance of LETKF with an operational 3D-Var assimilation system, Physical-Space Statistical Analysis System (PSAS), under a perfect model scenario. The comparison is carried out on the finite volume Global Circulation Model (fvGCM) with 72 grid points zonally, 46 grid points meridionally and 55 vertical levels. With only forty ensemble members, LETKF obtains an analysis and forecasts with lower RMS errors than those from PSAS. The performance of LETKF is further improved, especially over the oceans, by assimilating simulated temperature observations from rawinsondes and conventional surface pressure observations instead of geopotential heights. An initial decrease of the forecast errors in the NH observed in PSAS but not in LETKF suggests that the PSAS analysis is less balanced. The observed advantage of LETKF over PSAS is due to the ability of the forty-member ensemble from LETKF to capture flow-dependent errors and thus create a good estimate of the true background uncertainty. Furthermore, localization makes LETKF highly parallel and efficient, requiring only 5 minutes per analysis in a cluster of 20 PCs with forty ensemble members.
△ Less
Submitted 8 March, 2007; v1 submitted 6 March, 2007;
originally announced March 2007.
