Releases: panovvv/bigdata-docker-compose
Release 2.5.2
Release 2.5
What’s new:
Improved readme - Livy section was obsolete
Update images to 2.5
Add sample batch to test Livy
App versions:
Hadoop 3.2.0
Hive 3.1.2
Spark 2.4.5 <- update
Zeppelin 0.8.2
Livy 0.7.0
Release 2.4
What’s new:
Better logging for all apps - now using a custom
C program + bash script to ’tail’ multiple directories and scan for new files.
App versions (no change):
Hadoop 3.2.0
Hive 3.1.2
Spark 2.4.4
Zeppelin 0.8.2
Livy 0.7.0
Release 2.3
What’s new:
Moved to a separate repo to simplify CI.
Added a new data file to play with - can be joined with the first one.
App versions:
Hadoop 3.2.0
Hive 3.1.2
Spark 2.4.4
Zeppelin 0.8.2
Livy 0.7.0 <- update
Release 2.2
What’s new:
Enable History Server in Spark.
Update Alpine Linux package versions.
App versions (no change):
Hadoop 3.2.0
Hive 3.1.2
Spark 2.4.4
Zeppelin 0.8.2
Livy 0.6.0
Release 2.1
What’s new:
Enabled S3 support for Hadoop and Spark.
App versions (no change):
Hadoop 3.2.0
Hive 3.1.2
Spark 2.4.4
Zeppelin 0.8.2
Livy 0.6.0
Release 2.0
What’s new:
Ubuntu->Alpine Linux, no more inter container SSH connectivity, image cleanup.
App versions:
Hadoop 3.2.0 <- update
Hive 3.1.2 <- update
Spark 2.4.4
Zeppelin 0.8.2
Livy 0.6.0
Release 1.0
One repo for all 3 images (base Hadoop+Hive+Spark image and 2 images on top of it: Livy and Zeppelin).
All images derive from Ubuntu, but everything works (except running Hive queries via Spark).
There's inter-container SSH connectivity going on, for YARN to be able to start/stop all nodes. This has to be fixed, eventually.
App versions:
Hadoop 3.1.2
Hive 2.3.6
Spark 2.4.4
Zeppelin 0.8.2
Livy 0.6.0