tensorflowonspark.util module

find_in_path(path, file)

Find a file in a given path string.

get_ip_address()

Simple utility to get host IP address.

read_executor_id()

Read worker id from a local file in the executor’s current working directory

single_node_env(num_gpus=1, worker_index=- 1, nodes=[])

Setup environment variables for Hadoop compatibility and GPU allocation

write_executor_id(num)

Write executor_id into a local file in the executor’s current working directory