We start from the fact that the exception appears at some point in the execution: java.io.IOException: Filesystem closed. and GC HEAD OVER LIMIT. It does not indicate how this last message appears, but I think it is not very important. Now, I'm going to try to figure out what's going on by asking questions and…
Analizando una excepción en una aplicación Spark streaming de larga duración.
Analizando una excepción Filesystem closed en una app spark streaming de larga duración.
Preguntas y respuestas sobre Spark en ChatGPT
Consejos sobre Apache Spark.
Aironman techblog 