forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
31 lines
4.0 KiB
HTML
31 lines
4.0 KiB
HTML
<a name="mrs_01_2056"></a><a name="mrs_01_2056"></a>
|
|
|
|
<h1 class="topictitle1">Why Cannot I Switch from the Yarn Web UI to the Spark Web UI?</h1>
|
|
<div id="body1595920225547"><div class="section" id="mrs_01_2056__s8cd69dd1b04c4f6790daa74c7a94c327"><h4 class="sectiontitle">Question</h4><p id="mrs_01_2056__aaba0466a4fc24d12941af7d337489cb2">In FusionInsight, the Spark application is run in yarn-client mode on the client. The following error occurs during the switch from the Yarn web UI to the application web UI:</p>
|
|
<p id="mrs_01_2056__p84867499557"><span><img id="mrs_01_2056__image5593155010551" src="en-us_image_0000001388071348.png"></span></p>
|
|
<div class="p" id="mrs_01_2056__a7479f67337204b5db0d4adb51c854693">The YARN ResourceManager log shows the following information:<pre class="screen" id="mrs_01_2056__s01e78fc59f4843e6b38c061a956d884b">2016-07-21 16:35:27,099 | INFO | Socket Reader #1 for port 8032 | Auth successful for mapred/hadoop.<em id="mrs_01_2056__i1954248201617"><System domain name></em>@<em id="mrs_01_2056__i7349755132510"><System domain name></em> (auth:KERBEROS) | Server.java:1388
|
|
2016-07-21 16:35:27,105 | INFO | 1526016381@qtp-1178290888-1015 | admin is accessing unchecked http://10.120.169.53:23011 which is the app master GUI of
|
|
application_1468986660719_0045 owned by spark | WebAppProxyServlet.java:393
|
|
2016-07-21 16:36:02,843 | INFO | Socket Reader #1 for port 8032 | Auth successful for hive/hadoop.<em id="mrs_01_2056__i17123197192612"><System domain name></em>@<em id="mrs_01_2056__i1912310713265"><System domain name></em> (auth:KERBEROS) | Server.java:1388
|
|
2016-07-21 16:36:02,851 | INFO | Socket Reader #1 for port 8032 | Auth successful for hive/hadoop.<em id="mrs_01_2056__i192384122266"><System domain name></em>@<em id="mrs_01_2056__i13238131282612"><System domain name></em> (auth:KERBEROS) | Server.java:1388
|
|
2016-07-21 16:36:12,163 | WARN | 1526016381@qtp-1178290888-1015 | /proxy/application_1468986660719_0045/: java.net.ConnectException: Connection timed out |
|
|
Slf4jLog.java:76
|
|
2016-07-21 16:37:03,918 | INFO | Socket Reader #1 for port 8032 | Auth successful for hive/hadoop.<em id="mrs_01_2056__i24551817132619"><System domain name></em>@<em id="mrs_01_2056__i18455171782610"><System domain name></em> (auth:KERBEROS) | Server.java:1388
|
|
2016-07-21 16:37:03,926 | INFO | Socket Reader #1 for port 8032 | Auth successful for hive/hadoop.<em id="mrs_01_2056__i18995151912616"><System domain name></em>@<em id="mrs_01_2056__i699581911262"><System domain name></em> (auth:KERBEROS) | Server.java:1388
|
|
2016-07-21 16:37:11,956 | INFO | AsyncDispatcher event handler | Updating application attempt appattempt_1468986660719_0045_000001 with final state: FINISHING,
|
|
and exit status: -1000 | RMAppAttemptImpl.java:1253</pre>
|
|
</div>
|
|
</div>
|
|
<div class="section" id="mrs_01_2056__s6f4ef61c1f9d404785b2f0d57f17486d"><h4 class="sectiontitle">Answer</h4><p id="mrs_01_2056__a3ceaabca5f384a3fb908893ab5af6742">On FusionInsight Manager, the IP address of the Yarn service is in the 192 network segment.</p>
|
|
<p id="mrs_01_2056__aad3602a0a793443796ed8e1d82ada93c">In Yarn logs, the IP address of Spark web UI read by Yarn is http://10.120.169.53:23011, which is in the 10 network segment. The IP addresses in the 192 network segment cannot communicate with those in the 10 network segment. As a result, the Spark web UI fails to be accessed.</p>
|
|
<p id="mrs_01_2056__afbd5dcb2967644ebaf726cf6a8b4c02c">Solution:</p>
|
|
<p id="mrs_01_2056__a0c05ca2733144d0db66c919328c4c2e0">Log in to the client whose IP address is <strong id="mrs_01_2056__b57192259193629">10.120.169.53</strong> and change the IP address in the <strong id="mrs_01_2056__b148956631093629">/etc/hosts</strong> file to the IP address in the 192 network segment. Run the Spark application again. The Spark web UI is displayed.</p>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_2002.html">Common Issues About Spark2x</a></div>
|
|
</div>
|
|
</div>
|
|
|