[tez] TEZ ui 설정

Tez는 Yarn 애플리케이션 히스토리 서버의 정보를 이용해서 TEZ UI를 제공하고, 이 서비스를 이용해서 작업 정보를 확인할 수 있습니다.

 

TEZ-UI 다운로드 - 파일 다운로드

tez ui는 TEZ에서 제공하는 war 파일을 웹서버를 이용해서 실행하는 형태로 진행합니다. 0.9.2 버전은 war 파일을 기본적으로 제공하고, 0.10.0 버전은 war 파일을 따로 다운로드 받아야 합니다.

 

메이븐 리파지토리에서 파일을 다운로드 할 수 있습니다. 버전에 맞게 선택하여 다운로드 하시기 바랍니다.

 

https://repo1.maven.org/maven2/org/apache/tez/tez-ui/

Central Repository: org/apache/tez/tez-ui

 

Tomcat 설정 - 9999 포트 설정

${TOMCAT_HOME}/conf 아래 server.xml 설정에서 Tomcat의 기본 포트를 변경해 줍니다.

 

        <Connector port="9999" protocol="HTTP/1.1"
                   connectionTimeout="20000"
                   redirectPort="8443" />

 

Tez-ui 설정

다운 받은 war 파일을 ${TOMCAT_HOME}/webapps/ 아래 압축 해제합니다. ${TOMCAT_HOME}/webapps/tez-ui/config/config.env 파일의 설정을 변경하여 줍니다.

 

 

	/**
	* Licensed to the Apache Software Foundation (ASF) under one
	* or more contributor license agreements. See the NOTICE file
	* distributed with this work for additional information
	* regarding copyright ownership. The ASF licenses this file
	* to you under the Apache License, Version 2.0 (the
	* "License"); you may not use this file except in compliance
	* with the License. You may obtain a copy of the License at
	*
	* http://www.apache.org/licenses/LICENSE-2.0
	*
	* Unless required by applicable law or agreed to in writing, software
	* distributed under the License is distributed on an "AS IS" BASIS,
	* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
	* See the License for the specific language governing permissions and
	* limitations under the License.
	*/
	ENV = {
	hosts: {
	/*
	* Timeline Server Address:
	* By default TEZ UI looks for timeline server at http://localhost:8188, uncomment and change
	* the following value for pointing to a different address.
	*/
	timeline: "http://{tez-ui-server}:8188",
	/*
	* Resource Manager Address:
	* By default RM REST APIs are expected to be at http://localhost:8088, uncomment and change
	* the following value to point to a different address.
	*/
	rm: "http://{tez-ui-server}:8088",
	/*
	* Resource Manager Web Proxy Address:
	* Optional - By default, value configured as RM host will be taken as proxy address
	* Use this configuration when RM web proxy is configured at a different address than RM.
	*/
	rmProxy: "http://{tez-ui-server}:8088",
	},
	/*
	* Time Zone in which dates are displayed in the UI:
	* If not set, local time zone will be used.
	* Refer http://momentjs.com/timezone/docs/ for valid entries.
	*/
	//timeZone: "UTC",
	/*
	* yarnProtocol:
	* If specified, this protocol would be used to construct node manager log links.
	* Possible values: http, https
	* Default value: If not specified, protocol of hosts.rm will be used
	*/
	//yarnProtocol: "<value>",
	};

view raw configs.env hosted with ❤ by GitHub

 

 

tez-site.xml 설정

tez-site.xml
-------------
...
<property>
  <description>Enable Tez to use the Timeline Server for History Logging</description>
  <name>tez.history.logging.service.class</name>
  <value>org.apache.tez.dag.history.logging.ats.ATSHistoryLoggingService</value>
</property>

<property>
  <description>URL for where the Tez UI is hosted</description>
  <name>tez.tez-ui.history-url.base</name>
  <value>http://<webserver-host:9999/tez-ui/</value>
</property>
...

 

yarn-site.xml 설정

yarn-site.xml
-------------
...
<property>
  <description>Indicate to clients whether Timeline service is enabled or not.
  If enabled, the TimelineClient library used by end-users will post entities
  and events to the Timeline server.</description>
  <name>yarn.timeline-service.enabled</name>
  <value>true</value>
</property>

<property>
  <description>The hostname of the Timeline service web application.</description>
  <name>yarn.timeline-service.hostname</name>
  <value>localhost</value>
</property>

<property>
  <description>Enables cross-origin support (CORS) for web services where
  cross-origin web response headers are needed. For example, javascript making
  a web services request to the timeline server.</description>
  <name>yarn.timeline-service.http-cross-origin.enabled</name>
  <value>true</value>
</property>

<property>
  <description>Publish YARN information to Timeline Server</description>
  <name> yarn.resourcemanager.system-metrics-publisher.enabled</name>
  <value>true</value>
</property>
...

 

톰캣 실행

이후 톰캣을 실행하면 tez-ui 를 확인할 수 있습니다. ${TOMCAT_HOME}/bin/startup.sh를 실행하면 됩니다.

 

 

참고

https://www.programmersought.com/article/68765041730/

Ambari2.7 install Tez Ui - Programmer Sought