[Improvement] Keep consistent with vanilla spark when key or value is null

[zuston]

Code of Conduct

• I agree to follow this project's Code of Conduct

Search before asking

• I have searched in the issues and found no similar issues.

What would you like to be improved?

Handle when key or value is null in one record. like this:

23/02/27 15:43:06 ERROR Executor: Exception in task 31.3 in stage 2.0 (TID 2067)
java.lang.NullPointerException
	at org.apache.spark.shuffle.writer.WriteBufferManager.addRecord(WriteBufferManager.java:116)
	at org.apache.spark.shuffle.writer.RssShuffleWriter.doWrite(RssShuffleWriter.java:211)
	at org.apache.spark.shuffle.writer.RssShuffleWriter.write(RssShuffleWriter.java:170)
	at org.apache.spark.shuffle.ShuffleWriteProcessor.write(ShuffleWriteProcessor.scala:59)
	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
	at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:52)
	at org.apache.spark.scheduler.Task.run(Task.scala:131)
	at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
23/02/27 15:43:06 INFO YarnCoarseGrainedExecutorBackend: Got assigned task 2302
23/02/27 15:43:06 INFO Executor: Running task 409.0 in stage 2.0 (TID 2302)

How should we improve?

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!