티스토리 뷰

빅데이터/hadoop

[hadoop] ha 하둡 실행 시 java.lang.IllegalStateException: Could not determine own NN ID in namespace 'ha-hadoop'. Please ensure that this node is one of the machines listed as an NN RPC address, or configure dfs.ha.namenode.id 오류 처리

hs_seo 2022. 8. 21. 09:33

HA 하둡에서 네임노드 실행시 다음과 같은 오류가 발생하는 경우가 있습니다.

 

22/08/20 12:11:24 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
22/08/20 12:11:24 INFO namenode.NameNode: createNameNode [-bootstrapStandby, -force]
22/08/20 12:11:24 ERROR namenode.NameNode: Failed to start namenode.
java.io.IOException: java.lang.IllegalStateException: Could not determine own NN ID in namespace 'ha-hadoop'. Please ensure that this node is one of the machines listed as an NN RPC address, or configure dfs.ha.namenode.id
	at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.run(BootstrapStandby.java:549)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1741)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1834)
Caused by: java.lang.IllegalStateException: Could not determine own NN ID in namespace 'ha-hadoop'. Please ensure that this node is one of the machines listed as an NN RPC address, or configure dfs.ha.namenode.id
	at org.apache.hadoop.thirdparty.com.google.common.base.Preconditions.checkState(Preconditions.java:591)
	at org.apache.hadoop.hdfs.HAUtil.getNameNodeIdOfOtherNodes(HAUtil.java:180)
	at org.apache.hadoop.hdfs.HAUtil.getConfForOtherNodes(HAUtil.java:203)
	at org.apache.hadoop.hdfs.server.namenode.ha.RemoteNameNodeInfo.getRemoteNameNodes(RemoteNameNodeInfo.java:51)
	at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.parseConfAndFindOtherNN(BootstrapStandby.java:429)
	at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.run(BootstrapStandby.java:114)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:81)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:95)
	at org.apache.hadoop.hdfs.server.namenode.ha.BootstrapStandby.run(BootstrapStandby.java:544)
	... 2 more
22/08/20 12:11:24 INFO util.ExitUtil: Exiting with status 1: java.io.IOException: java.lang.IllegalStateException: Could not determine own NN ID in namespace 'ha-hadoop'. Please ensure that this node is one of the machines listed as an NN RPC address, or configure dfs.ha.namenode.id

 

이 오류는 ha 하둡 설정이 정상적인 네임노드 호스트를 지정하고 있지 않기 때문입니다.

다음 설정이 지정한 네임노드가 맞는지 확인 해 보면 됩니다.

 

  • dfs.namenode.http-address.[nameservice].[id]
  • dfs.namenode.https-address.[nameservice].[id]
  • dfs.namenode.rpc-address.[nameservice].[id]
반응형
저작자표시 비영리 동일조건

'빅데이터 > hadoop' 카테고리의 다른 글

[yarn] 커버로스 적용된 nodemanager에서 Linux Container Executor reached unrecoverable exception 오류  (0) 2022.11.16
[yarn] InvalidResourceRequestException: Invalid resource request, requested memory < 0, or requested memory > max configured, requestedMemory=-1, maxMemory=102400 에러  (0) 2022.11.09
[hdfs] Unable to start failover controller. Parent znode does not exist. 오류 수정  (0) 2022.04.20
[hdfs] Journal Storage Directory /hadoop/hdfs/journal/... not formatted 오류  (0) 2022.04.20
[hadoop] no leveldbjni64-1.8 in java.library.path, no leveldbjni-1.8 in java.library.path, no leveldbjni in java.library.path, No such file or directory 오류 수정  (0) 2021.11.15
반응형
공지사항
최근에 올라온 글
최근에 달린 댓글
Total
Today
Yesterday
링크
TAG more
«   2025/01   »
일 월 화 수 목 금 토
1 2 3 4
5 6 7 8 9 10 11
12 13 14 15 16 17 18
19 20 21 22 23 24 25
26 27 28 29 30 31
글 보관함