forked from docs/doc-exports
Yang, Tong
6182f91ba8
Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Yang, Tong <yangtong2@huawei.com> Co-committed-by: Yang, Tong <yangtong2@huawei.com>
35 lines
12 KiB
HTML
35 lines
12 KiB
HTML
<a name="mrs_01_1595"></a><a name="mrs_01_1595"></a>
|
|
|
|
<h1 class="topictitle1">Installing the Flume Client on MRS 3.<em id="i8832175823">x</em> or Later Clusters</h1>
|
|
<div id="body1595928090852"><div class="section" id="mrs_01_1595__s9d464cc917ca45b1ba39e9a7c0df6006"><h4 class="sectiontitle">Scenario</h4><p id="mrs_01_1595__a8920e65594ce47e0bc00261e734e1588">To use Flume to collect logs, you must install the Flume client on a log host. You can create an ECS and install the Flume client on it.</p>
|
|
<p id="mrs_01_1595__p17538347457">This section applies to MRS 3.<em id="mrs_01_1595__i1622794805419">x</em> or later clusters.</p>
|
|
</div>
|
|
<div class="section" id="mrs_01_1595__s9821fff1057643ba92d438ba705d54f8"><h4 class="sectiontitle">Prerequisites</h4><ul id="mrs_01_1595__ueab0ff8756a74ee6952ee4539ef5b0cb"><li id="mrs_01_1595__l3e939d5c4a87445b804b469675d40176">A cluster with the Flume component has been created.</li><li id="mrs_01_1595__l93fbddeb02074d298088ee23ae81b740">The log host is in the same VPC and subnet with the MRS cluster. </li><li id="mrs_01_1595__le8b04f7354e443e4ad419f2200d32c2c">You have obtained the username and password for logging in to the log host.</li><li id="mrs_01_1595__li5663191314712">The installation directory is automatically created if it does not exist. If it exists, the directory must be left blank. The directory path cannot contain any space.</li></ul>
|
|
</div>
|
|
<div class="section" id="mrs_01_1595__section10490173015268"><h4 class="sectiontitle">Procedure</h4><ol id="mrs_01_1595__ol666191516138"><li id="mrs_01_1595__li466112151131"><span>Obtain the software package.</span><p><p id="mrs_01_1595__p666219155133">Log in to the FusionInsight Manager. Choose <strong id="mrs_01_1595__b104509629111119">Cluster</strong> > <em id="mrs_01_1595__i621488129111119">Name of the target cluster</em> > <strong id="mrs_01_1595__b1485844175111119">Services</strong> > <strong id="mrs_01_1595__b851409744111119">Flume</strong>. On the Flume service page that is displayed, choose <strong id="mrs_01_1595__b1641257698111119">More</strong> > <strong id="mrs_01_1595__b501542393111119">Download Client</strong> in the upper right corner and set <strong id="mrs_01_1595__b1146834652111119">Select Client Type</strong> to <strong id="mrs_01_1595__b234342652111119">Complete Client</strong> to download the Flume service client file.</p>
|
|
<p id="mrs_01_1595__p126626159132">The file name of the client is <strong id="mrs_01_1595__b1404760506111119">FusionInsight_Cluster_</strong><<em id="mrs_01_1595__i1869306045111119">Cluster ID</em>><strong id="mrs_01_1595__b1686161234111119">_Flume_Client.tar</strong>. This section takes the client file <strong id="mrs_01_1595__b978383744111119">FusionInsight_Cluster_1_Flume_Client.tar</strong> as an example.</p>
|
|
</p></li><li id="mrs_01_1595__li206621015161317"><span>Upload the software package.</span><p><p id="mrs_01_1595__p15662115141313">Upload the software package to a directory, for example, <strong id="mrs_01_1595__b1545768959111119">/opt/client</strong> on the node where the Flume service client will be installed as user <strong id="mrs_01_1595__b1259465851111119">user</strong>.</p>
|
|
<div class="note" id="mrs_01_1595__note36621215171312"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><p id="mrs_01_1595__p9662815131317"><strong id="mrs_01_1595__b590332518111119">user</strong> is the user who installs and runs the Flume client.</p>
|
|
</div></div>
|
|
</p></li><li id="mrs_01_1595__li136626152134"><span>Decompress the software package.</span><p><p id="mrs_01_1595__p1766212151134">Log in to the node where the Flume service client is to be installed as user <strong id="mrs_01_1595__b66622015161318">user</strong>. Go to the directory where the installation package is installed, for example, <strong id="mrs_01_1595__b450283755111119">/opt/client</strong>, and run the following command to decompress the installation package to the current directory:</p>
|
|
<p class="litext" id="mrs_01_1595__p136621115141313"><strong id="mrs_01_1595__b166621415181316">cd /opt</strong><strong id="mrs_01_1595__b146624152134">/client</strong></p>
|
|
<p class="litext" id="mrs_01_1595__p156624151138"><strong id="mrs_01_1595__b15662131561314">tar -xvf FusionInsight</strong><strong id="mrs_01_1595__b186621115131317">_Cluster_1_Flume_Client.tar</strong></p>
|
|
</p></li><li id="mrs_01_1595__li206621615101311"><span>Verify the software package.</span><p><p id="mrs_01_1595__p14663191561315">Run the <strong id="mrs_01_1595__b1015103853111119">sha256sum -c</strong> command to verify the decompressed file. If <strong id="mrs_01_1595__b1699116438111119">OK</strong> is returned, the verification is successful. Example:</p>
|
|
<p class="litext" id="mrs_01_1595__p19663181514137"><strong id="mrs_01_1595__b166636158133">sha256sum -c FusionInsight</strong><strong id="mrs_01_1595__b17663015131318">_Cluster_1_Flume_ClientConfig.tar.sha256</strong></p>
|
|
<pre class="screen" id="mrs_01_1595__screen966361511315">FusionInsight_Cluster_1_Flume_ClientConfig.tar: OK</pre>
|
|
</p></li><li id="mrs_01_1595__li10663171511320"><span>Decompress the package.</span><p><p class="litext" id="mrs_01_1595__p146636158134"><strong id="mrs_01_1595__b266319157134">tar -xvf FusionInsight</strong><strong id="mrs_01_1595__b126637153135">_Cluster_1_Flume_ClientConfig.tar</strong></p>
|
|
</p></li><li id="mrs_01_1595__li66632015131310"><span>Run the following command in the Flume client installation directory to install the client to a specified directory (for example, <strong id="mrs_01_1595__b2073392238111119">opt/FlumeClient</strong>): After the client is installed successfully, the installation is complete.</span><p><p id="mrs_01_1595__p7663171511132"><strong id="mrs_01_1595__b7663151516134">cd /opt/client/FusionInsight</strong><strong id="mrs_01_1595__b1266321514133">_Cluster_1_Flume_ClientConfig/Flume/FlumeClient</strong></p>
|
|
<p id="mrs_01_1595__p19663141541320"><strong id="mrs_01_1595__b136636154131">./install.sh -d <em id="mrs_01_1595__i15663121571313">/</em></strong><em id="mrs_01_1595__i206631415141311">opt/FlumeClient</em> <strong id="mrs_01_1595__b4663415151312">-f </strong><em id="mrs_01_1595__i16663111510135">MonitorServer</em><em id="mrs_01_1595__i2663191561310">Service IP address or host name of the role</em><strong id="mrs_01_1595__b156008421457"> -c </strong><em id="mrs_01_1595__i156101421156">User service configuration file</em><em id="mrs_01_1595__i26703361455">Path for storing properties.properties</em><strong id="mrs_01_1595__b74649311153"> -s </strong><em id="mrs_01_1595__i566431514132">CPU threshold</em><strong id="mrs_01_1595__b12664215171316"> -l /var/log/Bigdata -e </strong><em id="mrs_01_1595__i116641015171315">FlumeServer service IP address or host name</em><strong id="mrs_01_1595__b146641215181310"><em id="mrs_01_1595__i14664191511134"> </em></strong><strong id="mrs_01_1595__b566471519131">-n </strong><em id="mrs_01_1595__i1166416156138">Flume</em></p>
|
|
<div class="note" id="mrs_01_1595__note866416151139"><img src="public_sys-resources/note_3.0-en-us.png"><span class="notetitle"> </span><div class="notebody"><ul id="mrs_01_1595__ul15666201518139"><li id="mrs_01_1595__li10666915191314"><strong id="mrs_01_1595__b760013263111119">-d</strong>: Flume client installation path</li><li id="mrs_01_1595__li16666191514132">(Optional) <strong id="mrs_01_1595__b1745647545111119">-f</strong>: IP addresses or host names of two MonitorServer roles. The IP addresses or host names are separated by commas (,). If this parameter is not configured, the Flume client does not send alarm information to MonitorServer and information about the client cannot be viewed on the FusionInsight Manager GUI.</li><li id="mrs_01_1595__li126661115191318">(Optional) <strong id="mrs_01_1595__b92681550194212">-c</strong>: Service configuration file, which needs to be generated by the user based on the service. For details about how to generate the file on the configuration tool page of the Flume server, see <a href="mrs_01_1057.html">Flume Service Configuration Guide</a>. Upload the file to any directory on the node where the client is to be installed. If this parameter is not specified during the installation, you can upload the generated service configuration file <strong id="mrs_01_1595__b1328418455458">properties.properties</strong> to the <strong id="mrs_01_1595__b14755529459">/opt/FlumeClient/fusioninsight-flume-1.9.0/conf</strong> directory after the installation.</li><li id="mrs_01_1595__li7666615121320">(Optional) <strong id="mrs_01_1595__b157296434111119">-s</strong>: cgroup threshold. The value is an integer ranging from 1 to 100 x <em id="mrs_01_1595__i193212714231">N</em>. <em id="mrs_01_1595__i20338123017239">N</em> indicates the number of CPU cores. The default threshold is <strong id="mrs_01_1595__b1558059060111119">-1</strong>, indicating that the processes added to the cgroup are not restricted by the CPU usage.</li><li id="mrs_01_1595__li16666315181315">(Optional) <strong id="mrs_01_1595__b1348110231111119">-l</strong>: Log path. The default value is <strong id="mrs_01_1595__b1553457997111119">/var/log/Bigdata</strong>. The user <strong id="mrs_01_1595__b588455686111119">user</strong> must have the write permission on the directory. When the client is installed for the first time, a subdirectory named <strong id="mrs_01_1595__b1133942994111119">flume-client</strong> is generated. After the installation, subdirectories named <strong id="mrs_01_1595__b172570235111119">flume-client-</strong><em id="mrs_01_1595__i1372949499111119">n</em> will be generated in sequence. The letter <em id="mrs_01_1595__i133779525111119">n</em> indicates a sequence number, which starts from 1 in ascending order. In the <strong id="mrs_01_1595__b1546894506111119">/conf/</strong> directory of the Flume client installation directory, modify the <strong id="mrs_01_1595__b1522345422111119">ENV_VARS</strong> file and search for the <strong id="mrs_01_1595__b1971287921111119">FLUME_LOG_DIR</strong> attribute to view the client log path.</li><li id="mrs_01_1595__li20666115121317">(Optional) <strong id="mrs_01_1595__b743776866111119">-e</strong>: Service IP address or host name of FlumeServer, which is used to receive statistics for the monitoring indicator reported by the client.</li><li id="mrs_01_1595__li15666121518134">(Optional) <strong id="mrs_01_1595__b1499874440111119">-n</strong>: Name of the Flume client. You can choose <strong id="mrs_01_1595__b1402444362111119">Cluster</strong> > <em id="mrs_01_1595__i303375432111119">Name of the desired cluster</em> > <strong id="mrs_01_1595__b810142238111119">Service</strong> > <strong id="mrs_01_1595__b1533057691111119">Flume</strong> > <strong id="mrs_01_1595__b885657207111119">Flume Management</strong> on FusionInsight Manager to view the client name on the corresponding node.</li><li id="mrs_01_1595__li066691512137">If the following error message is displayed, run the <strong id="mrs_01_1595__b407372734111119">export JAVA_HOME=<em id="mrs_01_1595__i1163444583111119">JDK</em><em id="mrs_01_1595__i474016918111119"> path</em></strong> command. <pre class="screen" id="mrs_01_1595__screen15667015141315">JAVA_HOME is null in current user,please install the JDK and set the JAVA_HOME</pre>
|
|
</li><li id="mrs_01_1595__li136679155134">IBM JDK does not support <strong id="mrs_01_1595__b1282410347111119">-Xloggc</strong>. You must change <strong id="mrs_01_1595__b135725775111119">-Xloggc</strong> to <strong id="mrs_01_1595__b770958083111119">-Xverbosegclog</strong> in <strong id="mrs_01_1595__b255012893111119">flume/conf/flume-env.sh</strong>. For 32-bit JDK, the value of <strong id="mrs_01_1595__b1127491023111119">-Xmx</strong> must not exceed 3.25 GB.</li><li id="mrs_01_1595__li16301208188">When installing a cross-platform client in a cluster, go to the <strong id="mrs_01_1595__b815417514570">/opt</strong><strong id="mrs_01_1595__b1016212519571"></strong><strong id="mrs_01_1595__b6163145118572">/client/FusionInsight_Cluster_1_Flume_ClientConfig/Flume/FusionInsight-Flume-1.9.0.tar.gz</strong> directory to install the Flume client.</li></ul>
|
|
</div></div>
|
|
</p></li></ol>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="mrs_01_0392.html">Installing the Flume Client</a></div>
|
|
</div>
|
|
</div>
|
|
|