vpruthi/doc-exports
1
0
Fork 0
forked from docs/doc-exports
Code Pull Requests Activity
doc-exports/docs/dws/dev/dws_06_0112.html
Lu, Huayi e6fa411af0 DWS DEV 830.201 version 
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com>
Co-authored-by: Lu, Huayi <luhuayi@huawei.com>
Co-committed-by: Lu, Huayi <luhuayi@huawei.com>
2024-05-16 07:24:04 +00:00

92 lines
22 KiB
HTML
Raw Blame History

<a name="EN-US_TOPIC_0000001188429054"></a><a name="EN-US_TOPIC_0000001188429054"></a>
<h1 class="topictitle1">Testing a Configuration</h1>
<div id="body8662426"><p id="EN-US_TOPIC_0000001188429054__en-us_topic_0059778139_p173451123241">The function ts_debug allows easy testing of a text search configuration. </p>
<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001188429054__s65dc18b6f1834a8a91f0e2ecfcc10cb7"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal">1</span>
<span class="normal">2</span>
<span class="normal">3</span>
<span class="normal">4</span>
<span class="normal">5</span>
<span class="normal">6</span>
<span class="normal">7</span>
<span class="normal">8</span></pre></div></td><td class="code"><div><pre><span></span><span class="n">ts_debug</span><span class="p">([</span><span class="w"> </span><span class="n">config</span><span class="w"> </span><span class="n">regconfig</span><span class="p">,</span><span class="w"> </span><span class="p">]</span><span class="w"> </span><span class="n">document</span><span class="w"> </span><span class="nb">text</span><span class="p">,</span>
<span class="w"> </span><span class="k">OUT</span><span class="w"> </span><span class="k">alias</span><span class="w"> </span><span class="nb">text</span><span class="p">,</span>
<span class="w"> </span><span class="k">OUT</span><span class="w"> </span><span class="n">description</span><span class="w"> </span><span class="nb">text</span><span class="p">,</span>
<span class="w"> </span><span class="k">OUT</span><span class="w"> </span><span class="n">token</span><span class="w"> </span><span class="nb">text</span><span class="p">,</span>
<span class="w"> </span><span class="k">OUT</span><span class="w"> </span><span class="n">dictionaries</span><span class="w"> </span><span class="n">regdictionary</span><span class="p">[],</span>
<span class="w"> </span><span class="k">OUT</span><span class="w"> </span><span class="k">dictionary</span><span class="w"> </span><span class="n">regdictionary</span><span class="p">,</span>
<span class="w"> </span><span class="k">OUT</span><span class="w"> </span><span class="n">lexemes</span><span class="w"> </span><span class="nb">text</span><span class="p">[])</span>
<span class="w"> </span><span class="k">returns</span><span class="w"> </span><span class="k">setof</span><span class="w"> </span><span class="n">record</span>
</pre></div></td></tr></table></div>
</div>
<p id="EN-US_TOPIC_0000001188429054__a1b8c70cd61f347089eb6d97dea5b9594"><strong id="EN-US_TOPIC_0000001188429054__b842352706183451">ts_debug</strong> displays information about every token of document as produced by the parser and processed by the configured dictionaries. It uses the configuration specified by <strong id="EN-US_TOPIC_0000001188429054__b842352706183624">config</strong>, or <strong id="EN-US_TOPIC_0000001188429054__b842352706183639">default_text_search_config</strong> if that argument is omitted. </p>
<p id="EN-US_TOPIC_0000001188429054__a3fdce70541f64536919b51dbcf492521"><strong id="EN-US_TOPIC_0000001188429054__b842352706183715">ts_debug</strong> returns one row for each token identified in the text by the parser. The columns returned are:</p>
<ul id="EN-US_TOPIC_0000001188429054__ua3dc4b7bf59c4f7cae7bc5ae13612b1c"><li id="EN-US_TOPIC_0000001188429054__lf55bd5c591f441c189c80905d239ee40">alias text — short name of the token type </li><li id="EN-US_TOPIC_0000001188429054__l9af34afb026540e0994c74719bbdd141">description text — description of the token type </li><li id="EN-US_TOPIC_0000001188429054__l38135ac0b0f54cceb5d9ca8a8e0d6ade">token text — text of the token </li><li id="EN-US_TOPIC_0000001188429054__lb8ecafb125b94f0093a503a4a875714b"><strong id="EN-US_TOPIC_0000001188429054__b842352706183832">dictionaries regdictionary[]</strong> — the dictionaries selected by the configuration for this token type </li><li id="EN-US_TOPIC_0000001188429054__lc867fcc5492045478e994e1a1996c39d"><strong id="EN-US_TOPIC_0000001188429054__b84235270611848">dictionary regdictionary</strong>: the dictionary that recognized the token, or NULL if none did</li><li id="EN-US_TOPIC_0000001188429054__lf70fcf76b03942898bf8fa8a5d612ba9"><strong id="EN-US_TOPIC_0000001188429054__b8423527061191">lexemes text[]</strong>: the lexeme(s) produced by the dictionary that recognized the token, or NULL if none did; an empty array ({}) means the token was recognized as a stop word</li></ul>
<p id="EN-US_TOPIC_0000001188429054__a64a8974620a841f1afbc24ae77c97526">Here is a simple example:</p>
<div class="codecoloring" codetype="Sql" id="EN-US_TOPIC_0000001188429054__s24215936f82e4db483ca4edaa7b92710"><div class="highlight"><table class="highlighttable"><tr><td class="linenos"><div class="linenodiv"><pre><span class="normal"> 1</span>
<span class="normal"> 2</span>
<span class="normal"> 3</span>
<span class="normal"> 4</span>
<span class="normal"> 5</span>
<span class="normal"> 6</span>
<span class="normal"> 7</span>
<span class="normal"> 8</span>
<span class="normal"> 9</span>
<span class="normal">10</span>
<span class="normal">11</span>
<span class="normal">12</span>
<span class="normal">13</span>
<span class="normal">14</span>
<span class="normal">15</span>
<span class="normal">16</span>
<span class="normal">17</span>
<span class="normal">18</span>
<span class="normal">19</span>
<span class="normal">20</span>
<span class="normal">21</span>
<span class="normal">22</span>
<span class="normal">23</span>
<span class="normal">24</span>
<span class="normal">25</span>
<span class="normal">26</span>
<span class="normal">27</span>
<span class="normal">28</span></pre></div></td><td class="code"><div><pre><span></span><span class="k">SELECT</span><span class="w"> </span><span class="o">*</span><span class="w"> </span><span class="k">FROM</span><span class="w"> </span><span class="n">ts_debug</span><span class="p">(</span><span class="s1">'english'</span><span class="p">,</span><span class="s1">'a fat cat sat on a mat - it ate a fat rats'</span><span class="p">);</span>
<span class="w"> </span><span class="k">alias</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">description</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">token</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">dictionaries</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">dictionary</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">lexemes</span><span class="w"> </span>
<span class="c1">-----------+-----------------+-------+----------------+--------------+---------</span>
<span class="w"> </span><span class="n">asciiword</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">Word</span><span class="p">,</span><span class="w"> </span><span class="k">all</span><span class="w"> </span><span class="n">ASCII</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">a</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">english_stem</span><span class="err">}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">english_stem</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span>
<span class="w"> </span><span class="n">blank</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">Space</span><span class="w"> </span><span class="n">symbols</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span>
<span class="w"> </span><span class="n">asciiword</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">Word</span><span class="p">,</span><span class="w"> </span><span class="k">all</span><span class="w"> </span><span class="n">ASCII</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">fat</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">english_stem</span><span class="err">}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">english_stem</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">fat</span><span class="err">}</span>
<span class="w"> </span><span class="n">blank</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">Space</span><span class="w"> </span><span class="n">symbols</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span>
<span class="w"> </span><span class="n">asciiword</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">Word</span><span class="p">,</span><span class="w"> </span><span class="k">all</span><span class="w"> </span><span class="n">ASCII</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">cat</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">english_stem</span><span class="err">}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">english_stem</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">cat</span><span class="err">}</span>
<span class="w"> </span><span class="n">blank</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">Space</span><span class="w"> </span><span class="n">symbols</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span>
<span class="w"> </span><span class="n">asciiword</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">Word</span><span class="p">,</span><span class="w"> </span><span class="k">all</span><span class="w"> </span><span class="n">ASCII</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">sat</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">english_stem</span><span class="err">}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">english_stem</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">sat</span><span class="err">}</span>
<span class="w"> </span><span class="n">blank</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">Space</span><span class="w"> </span><span class="n">symbols</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span>
<span class="w"> </span><span class="n">asciiword</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">Word</span><span class="p">,</span><span class="w"> </span><span class="k">all</span><span class="w"> </span><span class="n">ASCII</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">on</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">english_stem</span><span class="err">}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">english_stem</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span>
<span class="w"> </span><span class="n">blank</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">Space</span><span class="w"> </span><span class="n">symbols</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span>
<span class="w"> </span><span class="n">asciiword</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">Word</span><span class="p">,</span><span class="w"> </span><span class="k">all</span><span class="w"> </span><span class="n">ASCII</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">a</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">english_stem</span><span class="err">}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">english_stem</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span>
<span class="w"> </span><span class="n">blank</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">Space</span><span class="w"> </span><span class="n">symbols</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span>
<span class="w"> </span><span class="n">asciiword</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">Word</span><span class="p">,</span><span class="w"> </span><span class="k">all</span><span class="w"> </span><span class="n">ASCII</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">mat</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">english_stem</span><span class="err">}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">english_stem</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">mat</span><span class="err">}</span>
<span class="w"> </span><span class="n">blank</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">Space</span><span class="w"> </span><span class="n">symbols</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span>
<span class="w"> </span><span class="n">blank</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">Space</span><span class="w"> </span><span class="n">symbols</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">-</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span>
<span class="w"> </span><span class="n">asciiword</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">Word</span><span class="p">,</span><span class="w"> </span><span class="k">all</span><span class="w"> </span><span class="n">ASCII</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">it</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">english_stem</span><span class="err">}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">english_stem</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span>
<span class="w"> </span><span class="n">blank</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">Space</span><span class="w"> </span><span class="n">symbols</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span>
<span class="w"> </span><span class="n">asciiword</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">Word</span><span class="p">,</span><span class="w"> </span><span class="k">all</span><span class="w"> </span><span class="n">ASCII</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">ate</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">english_stem</span><span class="err">}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">english_stem</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">ate</span><span class="err">}</span>
<span class="w"> </span><span class="n">blank</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">Space</span><span class="w"> </span><span class="n">symbols</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span>
<span class="w"> </span><span class="n">asciiword</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">Word</span><span class="p">,</span><span class="w"> </span><span class="k">all</span><span class="w"> </span><span class="n">ASCII</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">a</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">english_stem</span><span class="err">}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">english_stem</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span>
<span class="w"> </span><span class="n">blank</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">Space</span><span class="w"> </span><span class="n">symbols</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span>
<span class="w"> </span><span class="n">asciiword</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">Word</span><span class="p">,</span><span class="w"> </span><span class="k">all</span><span class="w"> </span><span class="n">ASCII</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">fat</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">english_stem</span><span class="err">}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">english_stem</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">fat</span><span class="err">}</span>
<span class="w"> </span><span class="n">blank</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="k">Space</span><span class="w"> </span><span class="n">symbols</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="o">|</span><span class="w"> </span>
<span class="w"> </span><span class="n">asciiword</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">Word</span><span class="p">,</span><span class="w"> </span><span class="k">all</span><span class="w"> </span><span class="n">ASCII</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">rats</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">english_stem</span><span class="err">}</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="n">english_stem</span><span class="w"> </span><span class="o">|</span><span class="w"> </span><span class="err">{</span><span class="n">rat</span><span class="err">}</span>
<span class="p">(</span><span class="mi">24</span><span class="w"> </span><span class="k">rows</span><span class="p">)</span>
</pre></div></td></tr></table></div>
</div>
</div>
<div>
<div class="familylinks">
<div class="parentlink"><strong>Parent topic:</strong> <a href="dws_06_0111.html">Testing and Debugging Text Search</a></div>
</div>
</div>
View Git Blame Copy Permalink