This opinion column in Quanta Magazine discusses the current state of deep learning, which seems to be dominated by trial and error and recipes rather than the scientific method, in a broader context. It argues that the lack of well-understood first principles is nothing new in scientific exploration, but rather typical for a phase of experimentation followed by major scientific breakthroughs.