The article discusses the importance of starting without machine learning when approaching a new problem. It suggests that a non-ML baseline should be established first, using simple heuristics and data analysis, before considering machine learning solutions. This approach can help ensure that the problem is well understood and that the data is of high quality. By starting without machine learning, developers can create a more effective and maintainable solution.