The default log level has been set to “WARN”. To adjust the logging level, use the sc.setLogLevel(newLevel) command. If you are using SparkR, use setLogLevel(newLevel).
However, there appears to be an issue with memory allocation on your system. The error message indicates that the Java Runtime Environment is unable to allocate memory and has failed to commit reserved memory. An error report file has been saved at /root/hs_err_pid16887.log that may contain additional information about this issue. You will need to investigate this further in order to resolve it.
