Generic and specific recurrent neural network models: Applications for large and small scale biopharmaceutical upstream processes

Biotechnol Rep (Amst). 2021 May 28:31:e00640. doi: 10.1016/j.btre.2021.e00640. eCollection 2021 Sep.

Abstract

The calculation of temporally varying upstream process outcomes is a challenging task. Over the last years, several parametric, semi-parametric as well as non-parametric approaches were developed to provide reliable estimates for key process parameters. We present generic and product-specific recurrent neural network (RNN) models for the computation and study of growth and metabolite-related upstream process parameters as well as their temporal evolution. Our approach can be used for the control and study of single product-specific large-scale manufacturing runs as well as generic small-scale evaluations for combined processes and products at development stage. The computational results for the product titer as well as various major upstream outcomes in addition to relevant process parameters show a high degree of accuracy when compared to experimental data and, accordingly, a reasonable predictive capability of the RNN models. The calculated values for the root-mean squared errors of prediction are significantly smaller than the experimental standard deviation for the considered process run ensembles, which highlights the broad applicability of our approach. As a specific benefit for platform processes, the generic RNN model is also used to simulate process outcomes for different temperatures in good agreement with experimental results. The high level of accuracy and the straightforward usage of the approach without sophisticated parameterization and recalibration procedures highlight the benefits of the RNN models, which can be regarded as promising alternatives to existing parametric and semi-parametric methods.

Keywords: 37N25; 46N60; 62M10; 92B20; Autocorrelation functions; Generic and specific machine learning models; Principal component analysis; Recurrent neural networks; Simulation of bioreactor processes; Temporal evolution; Upstream processes.