얀 어플리케이션 개발

가장 단순한 헬로월드 appMaster 구현 부터 복잡한 애플리케이션까지 구현하는 것을 목적으로 합니다 Hadoop Distributed Shell 을 참고하여 개발합니다

NetCatClient v1

HelloWorld v1

아래와 같이 빌드 및 애플리케이션 실행합니다

# cat deploy.sh
docker-compose up -d

# build & deploy jar
sbin/deploy_yarn_app.sh hadoop-yarn-applications true

# custom build & deploy
./gradlew clean build
docker cp build/libs/hadoop-yarn-applications.jar datanode:/
docker cp build/resources/main/log4j.properties datanode:/
docker-compose exec datanode hadoop jar ./hadoop-yarn-applications.jar .

Debugging on http://resourcemanager:8088/cluster

# cat /etc/hosts or C:\Windows\System32\drivers\etc\hosts
127.0.0.1	nodemanager
127.0.0.1	resourcemanager
127.0.0.1	namenode
127.0.0.1	datanode
127.0.0.1	historyserver