[hadoop][yarn] Caused by: java.io.IOException: default cannot be found during refresh! 오류 수정

YARN의 커패시티 스케줄러의 큐는 운영중에 추가는 할 수 있지만, 삭제 할 수는 없습니다. 기존에 설정된 큐를 삭제하는 경우 다음과 같은 오류가 발생합니다. 리소스 매니저를 재시작해야 설정이 적용됩니다.

리소스 매니저 재시작

# 정지 
$ sudo stop hadoop-yarn-resourcemanager

# 실행 
$ sudo start hadoop-yarn-resourcemanager

오류

$ yarn rmadmin -refreshQueues
19/10/31 04:26:55 INFO client.RMProxy: Connecting to ResourceManager at /10.11.60.235:8033
refreshQueues: java.io.IOException: Failed to re-init queues
    at org.apache.hadoop.yarn.ipc.RPCUtil.getRemoteException(RPCUtil.java:38)
    at org.apache.hadoop.yarn.server.resourcemanager.AdminService.logAndWrapException(AdminService.java:862)
    at org.apache.hadoop.yarn.server.resourcemanager.AdminService.refreshQueues(AdminService.java:395)
    at org.apache.hadoop.yarn.server.api.impl.pb.service.ResourceManagerAdministrationProtocolPBServiceImpl.refreshQueues(ResourceManagerAdministrationProtocolPBServiceImpl.java:114)
    at org.apache.hadoop.yarn.proto.ResourceManagerAdministrationProtocol$ResourceManagerAdministrationProtocolService$2.callBlockingMethod(ResourceManagerAdministrationProtocol.java:271)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:447)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:989)
    at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:850)
    at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:793)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1844)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2489)
Caused by: java.io.IOException: Failed to re-init queues
    at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:379)
    at org.apache.hadoop.yarn.server.resourcemanager.AdminService.refreshQueues(AdminService.java:400)
    at org.apache.hadoop.yarn.server.resourcemanager.AdminService.refreshQueues(AdminService.java:390)
    ... 10 more
Caused by: java.io.IOException: default cannot be found during refresh!
    at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.validateExistingQueues(CapacityScheduler.java:587)
    at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitializeQueues(CapacityScheduler.java:533)
    at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:375)
    ... 12 more