Skip to content

Commit

Permalink
[SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL
Browse files Browse the repository at this point in the history
## What changes were proposed in this pull request?
Added docs for running spark jobs with Mesos on SSL

Closes apache#23342 from jomach/master.

Lead-authored-by: Jorge Machado <[email protected]>
Co-authored-by: Jorge Machado <[email protected]>
Co-authored-by: Jorge Machado <[email protected]>
Co-authored-by: Jorge Machado <[email protected]>
Signed-off-by: Sean Owen <[email protected]>
  • Loading branch information
4 people authored and srowen committed Dec 20, 2018
1 parent 7c8f475 commit a888d20
Showing 1 changed file with 13 additions and 0 deletions.
13 changes: 13 additions & 0 deletions docs/running-on-mesos.md
Original file line number Diff line number Diff line change
Expand Up @@ -108,6 +108,19 @@ Please note that if you specify multiple ways to obtain the credentials then the

An equivalent order applies for the secret. Essentially we prefer the configuration to be specified directly rather than indirectly by files, and we prefer that configuration settings are used over environment variables.

### Deploy to a Mesos running on Secure Sockets

If you want to deploy a Spark Application into a Mesos cluster that is running in a secure mode there are some environment variables that need to be set.

- `LIBPROCESS_SSL_ENABLED=true` enables SSL communication
- `LIBPROCESS_SSL_VERIFY_CERT=false` verifies the ssl certificate
- `LIBPROCESS_SSL_KEY_FILE=pathToKeyFile.key` path to key
- `LIBPROCESS_SSL_CERT_FILE=pathToCRTFile.crt` the certificate file to be used

All options can be found at http://mesos.apache.org/documentation/latest/ssl/

Then submit happens as described in Client mode or Cluster mode below

## Uploading Spark Package

When Mesos runs a task on a Mesos slave for the first time, that slave must have a Spark binary
Expand Down

0 comments on commit a888d20

Please sign in to comment.