newnius/Dockerfiles
1
0
Fork 0
mirror of https://github.com/newnius/Dockerfiles.git synced 2025-06-07 08:31:55 +00:00
Code Issues Packages Projects Releases Wiki Activity

update spark-submit

Browse Source
This commit is contained in:
Newnius 2018-03-24 14:16:03 +08:00
parent 40a8ddfad0
commit 7c1a4fa9f9
1 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
spark/2.2.1/README.md
View File

@ -59,7 +59,8 @@ sbin/start-dfs.sh
### Run Hello World ### Run Hello World
```bash ```bash
spark-submit \ spark-submit \
--master yarn-cluster \ --master yarn \
--deploy-mode cluster \
--class org.apache.spark.examples.JavaSparkPi \ --class org.apache.spark.examples.JavaSparkPi \
./examples/jars/spark-examples_2.11-2.2.1.jar 100 ./examples/jars/spark-examples_2.11-2.2.1.jar 100
``` ```
@ -78,7 +79,7 @@ _Proxy needed, e.g. [newnius/docker-proxy](https://hub.docker.com/r/newnius/dock
docker service create \ docker service create \
--name spark-master \ --name spark-master \
--hostname spark-master \ --hostname spark-master \
--detach true \ --detach=true \
--network swarm-net \ --network swarm-net \
--replicas 1 \ --replicas 1 \
--mount type=bind,source=/mnt/data/spark/hdfs/master,target=/tmp/hadoop-root \ --mount type=bind,source=/mnt/data/spark/hdfs/master,target=/tmp/hadoop-root \