Skip to content

Commit 994e98b

Browse files
committed
Address comments
1 parent e2cda3d commit 994e98b

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

core/src/main/scala/org/apache/spark/rdd/HadoopRDD.scala

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -141,8 +141,8 @@ class HadoopRDD[K, V](
141141
// local process. The local cache is accessed through HadoopRDD.putCachedMetadata().
142142
// The caching helps minimize GC, since a JobConf can contain ~10KB of temporary objects.
143143
// synchronize to prevent ConcurrentModificationException (Spark-1097, Hadoop-10456)
144-
broadcastedConf.value.value.synchronized {
145-
val newJobConf = new JobConf(broadcastedConf.value.value)
144+
conf.synchronized {
145+
val newJobConf = new JobConf(conf)
146146
initLocalJobConfFuncOpt.map(f => f(newJobConf))
147147
HadoopRDD.putCachedMetadata(jobConfCacheKey, newJobConf)
148148
newJobConf

0 commit comments

Comments
 (0)