Exception when trying to compute pagesize, as a result reporting of ProcessTree metrics is stopped

[FireFreedomK]

我换了一台电脑后，执行从一个DataFrame中，使用map按行读取数据，然后对每一行的经纬度字段应用方法determineAdmin获取省份、城市，当我使用limit从DataFrame中取8条以下的数据时很快可以输出结果，但是当我使用limit(8)、limit(10)或更大的数字时，会卡在某个地方，日志会输出Exception when trying to compute pagesize, as a result reporting of ProcessTree metrics is stopped，

在本机中sparkConf设置为.setMaster("local[*]")

还没有尝试提交到服务器运行是否会遇到同样的问题

2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Got cleaning task CleanAccum(0)
2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Cleaning accumulator 0
2021-09-29 11:18:11,423 INFO ContextCleaner:57 Spark Context Cleaner 10046 - Cleaned accumulator 0
2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Got cleaning task CleanAccum(35)
2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Cleaning accumulator 35
2021-09-29 11:18:11,423 INFO ContextCleaner:57 Spark Context Cleaner 10046 - Cleaned accumulator 35
2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Got cleaning task CleanAccum(32)
2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Cleaning accumulator 32
2021-09-29 11:18:11,423 INFO ContextCleaner:57 Spark Context Cleaner 10046 - Cleaned accumulator 32
2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Got cleaning task CleanAccum(33)
2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Cleaning accumulator 33
2021-09-29 11:18:11,423 INFO ContextCleaner:57 Spark Context Cleaner 10046 - Cleaned accumulator 33
2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Got cleaning task CleanAccum(3)
2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Cleaning accumulator 3
2021-09-29 11:18:11,423 INFO ContextCleaner:57 Spark Context Cleaner 10046 - Cleaned accumulator 3
2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Got cleaning task CleanBroadcast(0)
2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Cleaning broadcast 0
2021-09-29 11:18:11,423 DEBUG TorrentBroadcast:61 Spark Context Cleaner 10046 - Unpersisting TorrentBroadcast 0
2021-09-29 11:18:11,423 DEBUG BlockManagerSlaveEndpoint:61 block-manager-slave-async-thread-pool-9 10046 - removing broadcast 0
2021-09-29 11:18:11,423 DEBUG BlockManager:61 block-manager-slave-async-thread-pool-9 10046 - Removing broadcast 0
2021-09-29 11:18:11,423 DEBUG BlockManager:61 block-manager-slave-async-thread-pool-9 10046 - Removing block broadcast_0_piece0
2021-09-29 11:18:11,423 DEBUG MemoryStore:61 block-manager-slave-async-thread-pool-9 10046 - Block broadcast_0_piece0 of size 40552 dropped from memory (free 380968049)
2021-09-29 11:18:11,423 INFO BlockManagerInfo:57 dispatcher-event-loop-2 10046 - Removed broadcast_0_piece0 on 10.211.55.3:64053 in memory (size: 39.6 KB, free: 364.1 MB)
2021-09-29 11:18:11,423 DEBUG BlockManagerMaster:61 block-manager-slave-async-thread-pool-9 10046 - Updated info of block broadcast_0_piece0
2021-09-29 11:18:11,423 DEBUG BlockManager:61 block-manager-slave-async-thread-pool-9 10046 - Told master about block broadcast_0_piece0
2021-09-29 11:18:11,423 DEBUG BlockManager:61 block-manager-slave-async-thread-pool-9 10046 - Removing block broadcast_0
2021-09-29 11:18:11,423 DEBUG MemoryStore:61 block-manager-slave-async-thread-pool-9 10046 - Block broadcast_0 of size 400984 dropped from memory (free 381369033)
2021-09-29 11:18:11,423 DEBUG BlockManagerSlaveEndpoint:61 block-manager-slave-async-thread-pool-11 10046 - Done removing broadcast 0, response is 0
2021-09-29 11:18:11,423 DEBUG BlockManagerSlaveEndpoint:61 block-manager-slave-async-thread-pool-11 10046 - Sent response: 0 to 10.211.55.3:64022
2021-09-29 11:18:11,423 DEBUG ContextCleaner:61 Spark Context Cleaner 10046 - Cleaned broadcast 0
2021-09-29 11:18:16,721 WARN ProcfsMetricsGetter:69 driver-heartbeater 15344 - Exception when trying to compute pagesize, as a result reporting of ProcessTree metrics is stopped

[FireFreedomK]

将作业提交到服务器运行一切正常，应该是本机内存有些小的缘故？