-
-
Notifications
You must be signed in to change notification settings - Fork 308
Open
Description
Memory is limited and using swap is painfully slow to fit massive amounts of data. There is discussion of incremental fitting in #8 years ago but I cannot find incremental_fit in the code. Spark has https://spark.apache.org/docs/3.1.1/api/python/reference/api/pyspark.mllib.regression.StreamingLinearRegressionWithSGD.html which also helps with limited memory with streaming data.
Metadata
Metadata
Assignees
Labels
No labels