Currently, pandas frames are persisted using pickle. We coud try alternative approach such as paquet or feather https://towardsdatascience.com/the-best-format-to-save-pandas-data-414dca023e0d