Tests: Set PySpark driver host to localhost

[smaheshwar-pltr]

This let me (personally) run integration tests locally. Before, I was getting

py4j.protocol.Py4JJavaError: An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext. [...]
E                   : java.io.IOException: Failed to connect to [IP-REDACTED]
E                   	at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:294)
E                   	at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:214)
...

[smaheshwar-pltr]

Not sure if useful. @kevinjqliu, mind taking a peek?

[kevinjqliu]

interesting, thats the first time ive seen this issue. do you have remote dev environment?
The typical set up is running the integration test docker containers on local laptop and pyspark will automatically find the driver.
That said i think explicitly binding to the localhost should still be fine

[Fokko]

@smaheshwar-pltr thanks for raising this. I haven't seen this before either. Can you check if your local hostname is configured correctly?