Troubleshooting Fyrefuse

This page lists problem situations related to Fyrefuse installation and usage and how to work around or solve them.

Your pipeline is correctly deployed on Fyrefuse but not in Spark on K8s

This can happen when the NFS shared volume is not correctly mounted either in Fyrefuse or in the Spark cluster.

Verify the docker compose volume is correctly set as well as the Spark Engine configuration on Fyrefuse.

The K8s cluster fails when mounting NFS volumes

Make sure every node of the cluster has the package "nfs-common" installed.

Verify firewall rules if needed.

When trying to deploy a pipeline Fyrefuse shows the message “Unable to connect to <spark-cluster-name>”

It is possible that the firewall is blocking the Fyrefuse’s connections to the k8s master node or viceversa.

Also, double check the configured spark engine’s master url, namespace, token and service account.