-
Ebernhardson authored
It turns out only the driver has a py4j connection to the jvm, executors talk to spark directly through sockets. To use jvm implementations in the executors we need to trigger that from jvm. Added an implementation and some basic tests. Change-Id: Iee7f79662e89bcf64cdb447aac0df5b68ee1170c
e6b4616fEbernhardson authoredIt turns out only the driver has a py4j connection to the jvm, executors talk to spark directly through sockets. To use jvm implementations in the executors we need to trigger that from jvm. Added an implementation and some basic tests. Change-Id: Iee7f79662e89bcf64cdb447aac0df5b68ee1170c
Loading