forked from docs/doc-exports
Lai, Weijian
1ad28cc33e
Reviewed-by: Jiang, Beibei <beibei.jiang@t-systems.com> Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com> Co-authored-by: Lai, Weijian <laiweijian4@huawei.com> Co-committed-by: Lai, Weijian <laiweijian4@huawei.com>
164 lines
17 KiB
HTML
164 lines
17 KiB
HTML
<a name="modelarts_04_0208"></a><a name="modelarts_04_0208"></a>
|
|
|
|
<h1 class="topictitle1">Querying Service Monitoring Details</h1>
|
|
<div id="body8662426"><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p163813816214">You can use the API to query the monitoring information about a service.</p>
|
|
<div class="section" id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_section59151611112217"><h4 class="sectiontitle">Sample Code</h4><p id="modelarts_04_0208__en-us_topic_0180094091_p15178813165016">In the ModelArts notebook instance, you do not need to enter authentication parameters for session authentication. For details about session authentication of other development environments, see <a href="modelarts_04_0123.html">Session Authentication</a>.</p>
|
|
<ul id="modelarts_04_0208__en-us_topic_0180094091_ul8632184435510"><li id="modelarts_04_0208__en-us_topic_0180094091_li3632154410551">Method 1: Query the monitoring information about the service created in <a href="modelarts_04_0201.html">Deploying a Real-Time Service</a>.<div class="codecoloring" codetype="Python" id="modelarts_04_0208__en-us_topic_0180094091_screen2374174905512"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span>
|
|
<span class="normal">2</span>
|
|
<span class="normal">3</span>
|
|
<span class="normal">4</span>
|
|
<span class="normal">5</span></pre></div></td><td class="code"><div><pre><span></span><span class="kn">from</span> <span class="nn">modelarts.session</span> <span class="kn">import</span> <span class="n">Session</span>
|
|
<span class="kn">from</span> <span class="nn">modelarts.model</span> <span class="kn">import</span> <span class="n">Predictor</span>
|
|
<span class="n">session</span> <span class="o">=</span> <span class="n">Session</span><span class="p">()</span>
|
|
<span class="n">predictor_instance</span> <span class="o">=</span> <span class="n">Predictor</span><span class="p">(</span><span class="n">session</span><span class="p">,</span> <span class="n">service_id</span><span class="o">=</span><span class="s2">"input your service_id"</span><span class="p">)</span>
|
|
<span class="n">predictor_monitor</span> <span class="o">=</span> <span class="n">predictor_instance</span><span class="o">.</span><span class="n">get_service_monitor</span><span class="p">()</span>
|
|
</pre></div></td></tr></table></div>
|
|
|
|
</div>
|
|
</li><li id="modelarts_04_0208__en-us_topic_0180094091_li1658814685510">Method 2: Query the monitoring information about the service object returned in <a href="modelarts_04_0206.html">Querying the List of Service Objects</a>.<div class="codecoloring" codetype="Python" id="modelarts_04_0208__en-us_topic_0180094091_screen1569195618557"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span>
|
|
<span class="normal">2</span>
|
|
<span class="normal">3</span>
|
|
<span class="normal">4</span>
|
|
<span class="normal">5</span>
|
|
<span class="normal">6</span></pre></div></td><td class="code"><div><pre><span></span><span class="kn">from</span> <span class="nn">modelarts.session</span> <span class="kn">import</span> <span class="n">Session</span>
|
|
<span class="kn">from</span> <span class="nn">modelarts.model</span> <span class="kn">import</span> <span class="n">Predictor</span>
|
|
<span class="n">session</span> <span class="o">=</span> <span class="n">Session</span><span class="p">()</span>
|
|
<span class="n">predictor_object_list</span> <span class="o">=</span> <span class="n">Predictor</span><span class="o">.</span><span class="n">get_service_object_list</span><span class="p">(</span><span class="n">session</span><span class="p">)</span>
|
|
<span class="n">predictor_instance</span> <span class="o">=</span> <span class="n">predictor_object_list</span><span class="p">[</span><span class="mi">0</span><span class="p">]</span>
|
|
<span class="n">predictor_monitor</span> <span class="o">=</span> <span class="n">predictor_instance</span><span class="o">.</span><span class="n">get_service_monitor</span><span class="p">()</span>
|
|
</pre></div></td></tr></table></div>
|
|
|
|
</div>
|
|
</li></ul>
|
|
</div>
|
|
<div class="section" id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_section160814231937"><h4 class="sectiontitle">Parameter Description</h4>
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_table413209485" frame="border" border="1" rules="all"><caption><b>Table 1 </b><strong id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_b1756321318104">get_service_monitor</strong> response parameters</caption><thead align="left"><tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row461520144819"><th align="left" class="cellrowborder" valign="top" width="18.86%" id="mcps1.3.3.2.2.4.1.1"><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p671720184814">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="33.89%" id="mcps1.3.3.2.2.4.1.2"><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p41062004818">Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="47.25%" id="mcps1.3.3.2.2.4.1.3"><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p51317202481">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row121442013482"><td class="cellrowborder" valign="top" width="18.86%" headers="mcps1.3.3.2.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p1716122012489">service_id</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.89%" headers="mcps1.3.3.2.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p418162011482">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="47.25%" headers="mcps1.3.3.2.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p1819420164816">Service ID</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row92052015484"><td class="cellrowborder" valign="top" width="18.86%" headers="mcps1.3.3.2.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p20221720114814">service_name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.89%" headers="mcps1.3.3.2.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p1023220104819">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="47.25%" headers="mcps1.3.3.2.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p825162013488">Service name</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row92632004815"><td class="cellrowborder" valign="top" width="18.86%" headers="mcps1.3.3.2.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p42818204484">monitors</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="33.89%" headers="mcps1.3.3.2.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p731120134816"><strong id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_b19496998816">monitor</strong> array corresponding to <strong id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_b37955511581">infer_type</strong> of a service</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="47.25%" headers="mcps1.3.3.2.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p83212019487">Monitoring details</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
|
|
<div class="tablenoborder"><table cellpadding="4" cellspacing="0" summary="" id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_table974014115493" frame="border" border="1" rules="all"><caption><b>Table 2 </b><strong id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_b0772539227">monitor</strong> parameters corresponding to <strong id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_b14773153919215">real-time</strong></caption><thead align="left"><tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row9746151116491"><th align="left" class="cellrowborder" valign="top" width="19.22772277227723%" id="mcps1.3.4.2.4.1.1"><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p16747181134917">Parameter</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="21.643564356435643%" id="mcps1.3.4.2.4.1.2"><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p1374918110495">Type</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="59.12871287128713%" id="mcps1.3.4.2.4.1.3"><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p12751411154913">Description</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row5753131154919"><td class="cellrowborder" valign="top" width="19.22772277227723%" headers="mcps1.3.4.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p775414117493">model_id</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.643564356435643%" headers="mcps1.3.4.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p7756151110496">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="59.12871287128713%" headers="mcps1.3.4.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p7758101113496">Model ID</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row14758111124914"><td class="cellrowborder" valign="top" width="19.22772277227723%" headers="mcps1.3.4.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p147601111496">model_name</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.643564356435643%" headers="mcps1.3.4.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p14761111184916">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="59.12871287128713%" headers="mcps1.3.4.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p10763151116498">Model name</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row47648112490"><td class="cellrowborder" valign="top" width="19.22772277227723%" headers="mcps1.3.4.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p876541119491">model_version</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.643564356435643%" headers="mcps1.3.4.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p137672011124919">String</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="59.12871287128713%" headers="mcps1.3.4.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p476921114917">Model version</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row67698116499"><td class="cellrowborder" valign="top" width="19.22772277227723%" headers="mcps1.3.4.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p127716113496">invocation_times</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.643564356435643%" headers="mcps1.3.4.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p5773101184912">Number</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="59.12871287128713%" headers="mcps1.3.4.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p14774131112495">Total number of model instance calls</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row19775911204916"><td class="cellrowborder" valign="top" width="19.22772277227723%" headers="mcps1.3.4.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p19776711144916">failed_times</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.643564356435643%" headers="mcps1.3.4.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p5780201174916">Number</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="59.12871287128713%" headers="mcps1.3.4.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p2782311144916">Number of failed model instance calls</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row37831811204911"><td class="cellrowborder" valign="top" width="19.22772277227723%" headers="mcps1.3.4.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p578561184910">cpu_core_usage</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.643564356435643%" headers="mcps1.3.4.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p178731117493">Float</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="59.12871287128713%" headers="mcps1.3.4.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p5789201117496">Number of used CPUs</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row77891011104917"><td class="cellrowborder" valign="top" width="19.22772277227723%" headers="mcps1.3.4.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p1479101124913">cpu_core_total</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.643564356435643%" headers="mcps1.3.4.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p1793111116493">Float</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="59.12871287128713%" headers="mcps1.3.4.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p12795121154912">Total number of CPUs</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row12796131124912"><td class="cellrowborder" valign="top" width="19.22772277227723%" headers="mcps1.3.4.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p1579711144916">cpu_memory_usage</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.643564356435643%" headers="mcps1.3.4.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p13799151174913">Integer</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="59.12871287128713%" headers="mcps1.3.4.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p1580031124911">Used memory, in MBs</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row8801161111494"><td class="cellrowborder" valign="top" width="19.22772277227723%" headers="mcps1.3.4.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p3802111164916">cpu_memory_total</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.643564356435643%" headers="mcps1.3.4.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p168041111104914">Integer</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="59.12871287128713%" headers="mcps1.3.4.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p680611184914">Total memory, in MBs</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row11807121113499"><td class="cellrowborder" valign="top" width="19.22772277227723%" headers="mcps1.3.4.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p4809121184912">gpu_usage</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.643564356435643%" headers="mcps1.3.4.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p17810201194919">Float</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="59.12871287128713%" headers="mcps1.3.4.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p198121011184910">Number of used GPUs</p>
|
|
</td>
|
|
</tr>
|
|
<tr id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_row1881341194918"><td class="cellrowborder" valign="top" width="19.22772277227723%" headers="mcps1.3.4.2.4.1.1 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p981510119492">gpu_total</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="21.643564356435643%" headers="mcps1.3.4.2.4.1.2 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p1481771144915">Float</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="59.12871287128713%" headers="mcps1.3.4.2.4.1.3 "><p id="modelarts_04_0208__en-us_topic_0180094091_en-us_topic_0160622888_p281871154917">Total number of GPUs</p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="modelarts_04_0199.html">Service Management</a></div>
|
|
</div>
|
|
</div>
|
|
|