Experimental Comparison of Theory-Guided Deep Learning Algorithms

The enrichment of machine learning models with domain knowledge has a growing impact on modern engineering and physics problems. This trend stems from the fact that the rise of deep learning algorithms is closely associated with an increasing demand for data that is not acceptable or available in many use cases. In this context, the incorporation of physical knowledge or a-priori constraints has been shown to be beneficial in many tasks. On the other hand, this collection of approaches is context-specific, and it is difficult to generalize them to new problems. In this paper, we experimentally compare some of the most widely used theory injection strategies to perform a systematic analysis of their advantages. Selected state-of-the-art algorithms have been reproduced for different use cases to evaluate their effectiveness with smaller training data and to discuss how the underlined strategies can fit into new application contexts.