forked from docs/doc-exports
zhengxiu
93d856d5c5
Reviewed-by: Pruthi, Vineet <vineet.pruthi@t-systems.com> Co-authored-by: zhengxiu <zhengxiu@huawei.com> Co-committed-by: zhengxiu <zhengxiu@huawei.com>
100 lines
11 KiB
HTML
100 lines
11 KiB
HTML
<a name="EN-US_TOPIC_0000001992165593"></a><a name="EN-US_TOPIC_0000001992165593"></a>
|
|
|
|
<h1 class="topictitle1">Search Enhancement Features for OpenSearch Clusters</h1>
|
|
<div id="body0000001992165593"><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p8060118">Compared with open-source OpenSearch, OpenSearch clusters in CSS have many enhanced features. <a href="#EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_table25351046105517">Table 1</a> lists these enhanced features and the corresponding cluster versions.</p>
|
|
|
|
<div class="tablenoborder"><a name="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_table25351046105517"></a><a name="en-us_topic_0000001972591469_table25351046105517"></a><table cellpadding="4" cellspacing="0" summary="" id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_table25351046105517" frame="border" border="1" rules="all"><caption><b>Table 1 </b>Search enhancement features for OpenSearch clusters</caption><thead align="left"><tr id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_row1753644610558"><th align="left" class="cellrowborder" valign="top" width="15%" id="mcps1.3.2.2.5.1.1"><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p1853618461554">Enhanced Feature</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="50%" id="mcps1.3.2.2.5.1.2"><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p135361546165518">Description</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="20%" id="mcps1.3.2.2.5.1.3"><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p2354191071">Cluster Version</p>
|
|
</th>
|
|
<th align="left" class="cellrowborder" valign="top" width="15%" id="mcps1.3.2.2.5.1.4"><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p153684614555">Details</p>
|
|
</th>
|
|
</tr>
|
|
</thead>
|
|
<tbody><tr id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_row18536746175519"><td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.1 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p353674615553">Vector search</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.2.2.5.1.2 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_en-us_topic_0000001223594448_p368234122719">Unstructured data, such as images, videos, and language corpora, is converted into vectors, which are searched based on similarity using either an exact or approximate nearest neighbors algorithm.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.5.1.3 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p143531918718">OpenSearch 1.3.6, OpenSearch 2.19.0</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.4 "><p id="EN-US_TOPIC_0000001992165593__p26820405116"><a href="css_01_0103.html">About CSS Vector Search</a></p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_row145361046115514"><td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.1 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p1353613460553">Storage-compute decoupling</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.2.2.5.1.2 "><p id="EN-US_TOPIC_0000001992165593__p11199105741214">Hot data that is frequently accessed is stored in high-performance storage media, while cold data that is infrequently accessed is migrated to low-cost storage media — Object Storage Service (OBS). This ensures real-time query performance for hot data while reducing long-term storage costs.</p>
|
|
<p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p20465101118320">Compared with cold/hot storage switchover, storage-compute decoupling is a better option for use cases that are not particularly demanding in terms of search performance, as cold data is stored in OBS, which cuts storage costs.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.5.1.3 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p943713580166">OpenSearch 1.3.6, OpenSearch 2.19.0</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.4 "><p id="EN-US_TOPIC_0000001992165593__p1968211406112"><a href="css_01_0180.html">Configuring Decoupled Storage and Compute for an OpenSearch Cluster</a></p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_row45361446135515"><td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.1 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p12536134614555">Flow control</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.2.2.5.1.2 "><p id="EN-US_TOPIC_0000001992165593__p12634124015114">Protects clusters from overload through flow control policies, such as client request throttling, shard indexing backpressure, and traffic pattern analysis, ensuring proper resource allocation and risk prevention.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.5.1.3 "><p id="EN-US_TOPIC_0000001992165593__p1632194025118">OpenSearch 2.19.0</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.4 "><p id="EN-US_TOPIC_0000001992165593__p468144017118"><a href="css_01_0056.html">Configuring Flow Control for an OpenSearch Cluster</a></p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_row9536194615515"><td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.1 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p25361846205520">Large query isolation</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.2.2.5.1.2 "><p id="EN-US_TOPIC_0000001992165593__p18551050123415">Helps effectively manage memory-intensive, time-consuming query requests, ensuring cluster stability.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.5.1.3 "><p id="EN-US_TOPIC_0000001992165593__p562984012511">OpenSearch 2.19.0</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.4 "><p id="EN-US_TOPIC_0000001992165593__p168017405115"><a href="css_01_0053.html">Configuring Large Query Isolation for an OpenSearch Cluster</a></p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_row35366465553"><td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.1 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p153616464553">Enhanced aggregation</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.2.2.5.1.2 "><p id="EN-US_TOPIC_0000001992165593__p1738311563317">CSS OpenSearch clusters enhance aggregation performance in the face of large data volumes by leveraging vectorization and optimized clustering, enabling faster analytics and decision-making in complex situations.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.5.1.3 "><p id="EN-US_TOPIC_0000001992165593__p156261840165111">OpenSearch 2.19.0</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.4 "><p id="EN-US_TOPIC_0000001992165593__p46793401714"><a href="css_01_0110.html">Configuring Enhanced Aggregation for an OpenSearch Cluster</a></p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_row1853694665517"><td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.1 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p35361346195520">Read/write splitting</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.2.2.5.1.2 "><p id="EN-US_TOPIC_0000001992165593__p7999818173012">Directs writes to the leader cluster and queries to the follower cluster. This separation of workloads enhances the stability, scalability, and high-concurrency processing capabilities of clusters.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.5.1.3 "><p id="EN-US_TOPIC_0000001992165593__p26221940165117">OpenSearch 2.19.0</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.4 "><p id="EN-US_TOPIC_0000001992165593__p166795401113"><a href="css_01_0049.html">Configuring Read/Write Splitting Between Two OpenSearch Clusters</a></p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_row1838312223614"><td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.1 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p138482211617">Switchover between hot and cold storage</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.2.2.5.1.2 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p913621617206">Switching between hot and cold storage means to allocate data to nodes of different performance standards based on data temperature (that is, how often data is accessed). Typically, high-performance hardware (such as SSDs) is used to store hot data (real-time data) that is frequently accessed, while inexpensive hardware (such as HDDs) is used to store cold data (historical data) that is infrequently accessed. The goal is to achieve optimal storage costs and query performance.</p>
|
|
<p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p1112642319398">Compared with storage-compute decoupling, cold/hot storage switchover is a better option for use cases that are demanding in terms of search performance. Cold data is stored on local cold data nodes in the cluster. The storage capacity available depends on the number of cold data nodes and their disk capacity. The storage cost is higher than that of OBS.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.5.1.3 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p9351219273">This feature is supported as long as the cluster has cold data nodes.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.4 "><p id="EN-US_TOPIC_0000001992165593__p136781440317"><a href="css_01_0200.html">Switching Between Hot and Cold Storage for an OpenSearch Cluster</a></p>
|
|
</td>
|
|
</tr>
|
|
<tr id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_row170416717"><td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.1 "><p id="EN-US_TOPIC_0000001992165593__en-us_topic_0000001972591469_p27112119712">Index recycle bin</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="50%" headers="mcps1.3.2.2.5.1.2 "><p id="EN-US_TOPIC_0000001992165593__p1772002412405">To prevent data loss caused by accidental deletion, CSS provides an index recycle bin. When enabled, deleted indexes are temporarily stored in the recycle bin, allowing for recovery before they are permanently removed. This feature improves data reliability and operational security.</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="20%" headers="mcps1.3.2.2.5.1.3 "><p id="EN-US_TOPIC_0000001992165593__p561124965119">OpenSearch 2.19.0</p>
|
|
</td>
|
|
<td class="cellrowborder" valign="top" width="15%" headers="mcps1.3.2.2.5.1.4 "><p id="EN-US_TOPIC_0000001992165593__p16771440216"><a href="css_01_0047.html">Configuring an Index Recycle Bin for an OpenSearch Cluster</a></p>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|
|
</div>
|
|
</div>
|
|
<div>
|
|
<div class="familylinks">
|
|
<div class="parentlink"><strong>Parent topic:</strong> <a href="css_01_0095.html">Enhancing Search Capabilities for OpenSearch Clusters</a></div>
|
|
</div>
|
|
</div>
|
|
|