manticoresearch/.translation-cache/Searching/Distributed_searching.md.json

{
    "312ae3c53db1444a5f8866065ddf00d861d2da0d9398296dfd80891f287f4c49": {
        "original": "# Distributed searching\n\nManticore is designed to scale effectively through its distributed searching capabilities. Distributed searching is beneficial for improving query latency (i.e., search time) and throughput (i.e., max queries/sec) in multi-server, multi-CPU, or multi-core environments. This is crucial for applications that need to search through vast amounts of data (i.e., billions of records and terabytes of text).\n\nThe primary concept is to horizontally partition the searched data across search nodes and process it in parallel.\n\nPartitioning is done manually. To set it up, you should:\n\n* Set up multiple instances of Manticore on different servers\n* Distribute different parts of your dataset to different instances\n* Configure a special [distributed table](../Creating_a_table/Creating_a_distributed_table/Creating_a_distributed_table.md) on some of the `searchd` instances\n* Route your queries to the distributed table\n\nThis type of table only contains references to other local and remote tables - so it cannot be directly reindexed. Instead, you should reindex the tables that it references.\n\nWhen Manticore receives a query against a distributed table, it performs the following steps:\n\n1. Connects to the configured remote agents\n2. Sends the query to them\n3. Simultaneously searches the configured local tables (while the remote agents are searching)\n4. Retrieves the search results from the remote agents\n5. Merges all the results together, removing duplicates\n6. Sends the merged results to the client\n\nFrom the application's perspective, there are no differences between searching through a regular table or a distributed table. In other words, distributed tables are fully transparent to the application, and there's no way to tell whether the table you queried was distributed or local.\n\nLearn more about [remote nodes](../Creating_a_cluster/Remote_nodes.md).\n\n<!-- proofread -->\n\n",
        "translations": {
            "chinese": "# \u5206\u5e03\u5f0f\u641c\u7d22\n\nManticore \u901a\u8fc7\u5176\u5206\u5e03\u5f0f\u641c\u7d22\u80fd\u529b\u8bbe\u8ba1\u5f97\u4ee5\u6709\u6548\u6269\u5c55\u3002\u5206\u5e03\u5f0f\u641c\u7d22\u6709\u52a9\u4e8e\u63d0\u5347\u67e5\u8be2\u5ef6\u8fdf\uff08\u5373\u641c\u7d22\u65f6\u95f4\uff09\u548c\u541e\u5410\u91cf\uff08\u5373\u6700\u5927\u67e5\u8be2\u6b21\u6570/\u79d2\uff09\uff0c\u9002\u7528\u4e8e\u591a\u670d\u52a1\u5668\u3001\u591aCPU\u6216\u591a\u6838\u73af\u5883\u3002\u8fd9\u5bf9\u4e8e\u9700\u8981\u641c\u7d22\u6d77\u91cf\u6570\u636e\uff08\u5373\u6570\u5341\u4ebf\u8bb0\u5f55\u548c\u6570TB\u6587\u672c\uff09\u7684\u5e94\u7528\u81f3\u5173\u91cd\u8981\u3002\n\n\u5176\u4e3b\u8981\u7406\u5ff5\u662f\u5c06\u88ab\u641c\u7d22\u7684\u6570\u636e\u6c34\u5e73\u5212\u5206\u5230\u4e0d\u540c\u7684\u641c\u7d22\u8282\u70b9\u4e2d\uff0c\u5e76\u884c\u5904\u7406\u3002\n\n\u5206\u533a\u9700\u8981\u624b\u52a8\u5b8c\u6210\u3002\u914d\u7f6e\u6b65\u9aa4\u5982\u4e0b\uff1a\n\n* \u5728\u4e0d\u540c\u670d\u52a1\u5668\u4e0a\u90e8\u7f72\u591a\u4e2a Manticore \u5b9e\u4f8b\n* \u5c06\u6570\u636e\u96c6\u7684\u4e0d\u540c\u90e8\u5206\u5206\u53d1\u7ed9\u4e0d\u540c\u5b9e\u4f8b\n* \u5728\u4e00\u4e9b `searchd` \u5b9e\u4f8b\u4e0a\u914d\u7f6e\u7279\u6b8a\u7684[\u5206\u5e03\u5f0f\u8868](../Creating_a_table/Creating_a_distributed_table/Creating_a_distributed_table.md)\n* \u5c06\u67e5\u8be2\u8def\u7531\u5230\u8be5\u5206\u5e03\u5f0f\u8868\n\n\u8fd9\u79cd\u7c7b\u578b\u7684\u8868\u4ec5\u5305\u542b\u5bf9\u5176\u4ed6\u672c\u5730\u548c\u8fdc\u7a0b\u8868\u7684\u5f15\u7528\uff0c\u56e0\u6b64\u4e0d\u80fd\u76f4\u63a5\u91cd\u65b0\u7d22\u5f15\u3002\u76f8\u53cd\uff0c\u5e94\u5f53\u91cd\u65b0\u7d22\u5f15\u5b83\u6240\u5f15\u7528\u7684\u8868\u3002\n\n\u5f53 Manticore \u63a5\u6536\u5230\u9488\u5bf9\u5206\u5e03\u5f0f\u8868\u7684\u67e5\u8be2\u65f6\uff0c\u4f1a\u6267\u884c\u4ee5\u4e0b\u6b65\u9aa4\uff1a\n\n1. \u8fde\u63a5\u5230\u914d\u7f6e\u7684\u8fdc\u7a0b\u4ee3\u7406\n2. \u5c06\u67e5\u8be2\u53d1\u9001\u7ed9\u8fdc\u7a0b\u4ee3\u7406\n3. \u540c\u65f6\u641c\u7d22\u914d\u7f6e\u7684\u672c\u5730\u8868\uff08\u5728\u8fdc\u7a0b\u4ee3\u7406\u641c\u7d22\u7684\u540c\u65f6\uff09\n4. \u4ece\u8fdc\u7a0b\u4ee3\u7406\u68c0\u7d22\u641c\u7d22\u7ed3\u679c\n5. \u5408\u5e76\u6240\u6709\u7ed3\u679c\uff0c\u53bb\u9664\u91cd\u590d\u9879\n6. \u5c06\u5408\u5e76\u540e\u7684\u7ed3\u679c\u53d1\u9001\u7ed9\u5ba2\u6237\u7aef\n\n\u4ece\u5e94\u7528\u7a0b\u5e8f\u89d2\u5ea6\u770b\uff0c\u641c\u7d22\u5e38\u89c4\u8868\u548c\u5206\u5e03\u5f0f\u8868\u6ca1\u6709\u533a\u522b\u3002\u6362\u8a00\u4e4b\uff0c\u5206\u5e03\u5f0f\u8868\u5bf9\u5e94\u7528\u7a0b\u5e8f\u662f\u5b8c\u5168\u900f\u660e\u7684\uff0c\u65e0\u6cd5\u5224\u65ad\u67e5\u8be2\u7684\u662f\u5206\u5e03\u5f0f\u8868\u8fd8\u662f\u672c\u5730\u8868\u3002\n\n\u4e86\u89e3\u66f4\u591a\u5173\u4e8e[\u8fdc\u7a0b\u8282\u70b9](../Creating_a_cluster/Remote_nodes.md)\u7684\u4fe1\u606f\u3002\n\n<!-- proofread -->",
            "russian": "# \u0420\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u044b\u0439 \u043f\u043e\u0438\u0441\u043a\n\nManticore \u0440\u0430\u0437\u0440\u0430\u0431\u043e\u0442\u0430\u043d \u0434\u043b\u044f \u044d\u0444\u0444\u0435\u043a\u0442\u0438\u0432\u043d\u043e\u0433\u043e \u043c\u0430\u0441\u0448\u0442\u0430\u0431\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u044f \u0437\u0430 \u0441\u0447\u0451\u0442 \u0432\u043e\u0437\u043c\u043e\u0436\u043d\u043e\u0441\u0442\u0435\u0439 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0433\u043e \u043f\u043e\u0438\u0441\u043a\u0430. \u0420\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u044b\u0439 \u043f\u043e\u0438\u0441\u043a \u043f\u043e\u043b\u0435\u0437\u0435\u043d \u0434\u043b\u044f \u0443\u043b\u0443\u0447\u0448\u0435\u043d\u0438\u044f \u0437\u0430\u0434\u0435\u0440\u0436\u043a\u0438 \u0432\u044b\u043f\u043e\u043b\u043d\u0435\u043d\u0438\u044f \u0437\u0430\u043f\u0440\u043e\u0441\u043e\u0432 (\u0442.\u0435. \u0432\u0440\u0435\u043c\u0435\u043d\u0438 \u043f\u043e\u0438\u0441\u043a\u0430) \u0438 \u043f\u0440\u043e\u043f\u0443\u0441\u043a\u043d\u043e\u0439 \u0441\u043f\u043e\u0441\u043e\u0431\u043d\u043e\u0441\u0442\u0438 (\u0442.\u0435. \u043c\u0430\u043a\u0441\u0438\u043c\u0430\u043b\u044c\u043d\u043e\u0433\u043e \u043a\u043e\u043b\u0438\u0447\u0435\u0441\u0442\u0432\u0430 \u0437\u0430\u043f\u0440\u043e\u0441\u043e\u0432 \u0432 \u0441\u0435\u043a\u0443\u043d\u0434\u0443) \u0432 \u043c\u043d\u043e\u0433\u043e\u0441\u0435\u0440\u0432\u0435\u0440\u043d\u044b\u0445, \u043c\u043d\u043e\u0433\u043e\u044f\u0434\u0435\u0440\u043d\u044b\u0445 \u0438\u043b\u0438 \u043c\u043d\u043e\u0433\u043e\u044f\u0434\u0435\u0440\u043d\u044b\u0445 \u0441\u0440\u0435\u0434\u0430\u0445. \u042d\u0442\u043e \u043a\u0440\u0438\u0442\u0438\u0447\u043d\u043e \u0434\u043b\u044f \u043f\u0440\u0438\u043b\u043e\u0436\u0435\u043d\u0438\u0439, \u043a\u043e\u0442\u043e\u0440\u044b\u043c \u043d\u0443\u0436\u043d\u043e \u0438\u0441\u043a\u0430\u0442\u044c \u0432 \u043e\u0433\u0440\u043e\u043c\u043d\u044b\u0445 \u043e\u0431\u044a\u0451\u043c\u0430\u0445 \u0434\u0430\u043d\u043d\u044b\u0445 (\u0442.\u0435. \u043c\u0438\u043b\u043b\u0438\u0430\u0440\u0434\u044b \u0437\u0430\u043f\u0438\u0441\u0435\u0439 \u0438 \u0442\u0435\u0440\u0430\u0431\u0430\u0439\u0442\u044b \u0442\u0435\u043a\u0441\u0442\u0430).\n\n\u041e\u0441\u043d\u043e\u0432\u043d\u0430\u044f \u0438\u0434\u0435\u044f \u0437\u0430\u043a\u043b\u044e\u0447\u0430\u0435\u0442\u0441\u044f \u0432 \u0433\u043e\u0440\u0438\u0437\u043e\u043d\u0442\u0430\u043b\u044c\u043d\u043e\u043c \u0440\u0430\u0437\u0434\u0435\u043b\u0435\u043d\u0438\u0438 \u0434\u0430\u043d\u043d\u044b\u0445 \u0434\u043b\u044f \u043f\u043e\u0438\u0441\u043a\u0430 \u043c\u0435\u0436\u0434\u0443 \u0443\u0437\u043b\u0430\u043c\u0438 \u043f\u043e\u0438\u0441\u043a\u0430 \u0438 \u0438\u0445 \u043f\u0430\u0440\u0430\u043b\u043b\u0435\u043b\u044c\u043d\u043e\u0439 \u043e\u0431\u0440\u0430\u0431\u043e\u0442\u043a\u0435.\n\n\u0420\u0430\u0437\u0431\u0438\u0435\u043d\u0438\u0435 \u0432\u044b\u043f\u043e\u043b\u043d\u044f\u0435\u0442\u0441\u044f \u0432\u0440\u0443\u0447\u043d\u0443\u044e. \u0414\u043b\u044f \u043d\u0430\u0441\u0442\u0440\u043e\u0439\u043a\u0438 \u043d\u0435\u043e\u0431\u0445\u043e\u0434\u0438\u043c\u043e:\n\n* \u0420\u0430\u0437\u0432\u0435\u0440\u043d\u0443\u0442\u044c \u043d\u0435\u0441\u043a\u043e\u043b\u044c\u043a\u043e \u044d\u043a\u0437\u0435\u043c\u043f\u043b\u044f\u0440\u043e\u0432 Manticore \u043d\u0430 \u0440\u0430\u0437\u043d\u044b\u0445 \u0441\u0435\u0440\u0432\u0435\u0440\u0430\u0445\n* \u0420\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0438\u0442\u044c \u0440\u0430\u0437\u043d\u044b\u0435 \u0447\u0430\u0441\u0442\u0438 \u0432\u0430\u0448\u0435\u0433\u043e \u043d\u0430\u0431\u043e\u0440\u0430 \u0434\u0430\u043d\u043d\u044b\u0445 \u043f\u043e \u0440\u0430\u0437\u043d\u044b\u043c \u044d\u043a\u0437\u0435\u043c\u043f\u043b\u044f\u0440\u0430\u043c\n* \u041d\u0430\u0441\u0442\u0440\u043e\u0438\u0442\u044c \u0441\u043f\u0435\u0446\u0438\u0430\u043b\u044c\u043d\u0443\u044e [\u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u0443\u044e \u0442\u0430\u0431\u043b\u0438\u0446\u0443](../Creating_a_table/Creating_a_distributed_table/Creating_a_distributed_table.md) \u043d\u0430 \u043d\u0435\u043a\u043e\u0442\u043e\u0440\u044b\u0445 \u0438\u0437 `searchd` \u044d\u043a\u0437\u0435\u043c\u043f\u043b\u044f\u0440\u043e\u0432\n* \u041d\u0430\u043f\u0440\u0430\u0432\u0438\u0442\u044c \u0432\u0430\u0448\u0438 \u0437\u0430\u043f\u0440\u043e\u0441\u044b \u043a \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0442\u0430\u0431\u043b\u0438\u0446\u0435\n\n\u042d\u0442\u043e\u0442 \u0442\u0438\u043f \u0442\u0430\u0431\u043b\u0438\u0446\u044b \u0441\u043e\u0434\u0435\u0440\u0436\u0438\u0442 \u0442\u043e\u043b\u044c\u043a\u043e \u0441\u0441\u044b\u043b\u043a\u0438 \u043d\u0430 \u0434\u0440\u0443\u0433\u0438\u0435 \u043b\u043e\u043a\u0430\u043b\u044c\u043d\u044b\u0435 \u0438 \u0443\u0434\u0430\u043b\u0451\u043d\u043d\u044b\u0435 \u0442\u0430\u0431\u043b\u0438\u0446\u044b \u2014 \u043f\u043e\u044d\u0442\u043e\u043c\u0443 \u0435\u0451 \u043d\u0435\u043b\u044c\u0437\u044f \u0438\u043d\u0434\u0435\u043a\u0441\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u043d\u0430\u043f\u0440\u044f\u043c\u0443\u044e. \u0412\u043c\u0435\u0441\u0442\u043e \u044d\u0442\u043e\u0433\u043e \u043d\u0435\u043e\u0431\u0445\u043e\u0434\u0438\u043c\u043e \u043f\u0435\u0440\u0435\u0438\u043d\u0434\u0435\u043a\u0441\u0438\u0440\u043e\u0432\u0430\u0442\u044c \u0442\u0430\u0431\u043b\u0438\u0446\u044b, \u043d\u0430 \u043a\u043e\u0442\u043e\u0440\u044b\u0435 \u043e\u043d\u0430 \u0441\u0441\u044b\u043b\u0430\u0435\u0442\u0441\u044f.\n\n\u041a\u043e\u0433\u0434\u0430 Manticore \u043f\u043e\u043b\u0443\u0447\u0430\u0435\u0442 \u0437\u0430\u043f\u0440\u043e\u0441 \u043a \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0442\u0430\u0431\u043b\u0438\u0446\u0435, \u043e\u043d \u0432\u044b\u043f\u043e\u043b\u043d\u044f\u0435\u0442 \u0441\u043b\u0435\u0434\u0443\u044e\u0449\u0438\u0435 \u0448\u0430\u0433\u0438:\n\n1. \u041f\u043e\u0434\u043a\u043b\u044e\u0447\u0430\u0435\u0442\u0441\u044f \u043a \u043d\u0430\u0441\u0442\u0440\u043e\u0435\u043d\u043d\u044b\u043c \u0443\u0434\u0430\u043b\u0451\u043d\u043d\u044b\u043c \u0430\u0433\u0435\u043d\u0442\u0430\u043c\n2. \u041e\u0442\u043f\u0440\u0430\u0432\u043b\u044f\u0435\u0442 \u0438\u043c \u0437\u0430\u043f\u0440\u043e\u0441\n3. \u041e\u0434\u043d\u043e\u0432\u0440\u0435\u043c\u0435\u043d\u043d\u043e \u0432\u044b\u043f\u043e\u043b\u043d\u044f\u0435\u0442 \u043f\u043e\u0438\u0441\u043a \u043f\u043e \u043d\u0430\u0441\u0442\u0440\u043e\u0435\u043d\u043d\u044b\u043c \u043b\u043e\u043a\u0430\u043b\u044c\u043d\u044b\u043c \u0442\u0430\u0431\u043b\u0438\u0446\u0430\u043c (\u0432 \u0442\u043e \u0432\u0440\u0435\u043c\u044f \u043a\u0430\u043a \u0443\u0434\u0430\u043b\u0451\u043d\u043d\u044b\u0435 \u0430\u0433\u0435\u043d\u0442\u044b \u0438\u0449\u0443\u0442)\n4. \u041f\u043e\u043b\u0443\u0447\u0430\u0435\u0442 \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u044b \u043f\u043e\u0438\u0441\u043a\u0430 \u043e\u0442 \u0443\u0434\u0430\u043b\u0451\u043d\u043d\u044b\u0445 \u0430\u0433\u0435\u043d\u0442\u043e\u0432\n5. \u041e\u0431\u044a\u0435\u0434\u0438\u043d\u044f\u0435\u0442 \u0432\u0441\u0435 \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u044b, \u0443\u0434\u0430\u043b\u044f\u044f \u0434\u0443\u0431\u043b\u0438\u043a\u0430\u0442\u044b\n6. \u041e\u0442\u043f\u0440\u0430\u0432\u043b\u044f\u0435\u0442 \u043e\u0431\u044a\u0435\u0434\u0438\u043d\u0451\u043d\u043d\u044b\u0435 \u0440\u0435\u0437\u0443\u043b\u044c\u0442\u0430\u0442\u044b \u043a\u043b\u0438\u0435\u043d\u0442\u0443\n\n\u0421 \u0442\u043e\u0447\u043a\u0438 \u0437\u0440\u0435\u043d\u0438\u044f \u043f\u0440\u0438\u043b\u043e\u0436\u0435\u043d\u0438\u044f, \u043d\u0435\u0442 \u0440\u0430\u0437\u043b\u0438\u0447\u0438\u0439 \u043c\u0435\u0436\u0434\u0443 \u043f\u043e\u0438\u0441\u043a\u043e\u043c \u0432 \u043e\u0431\u044b\u0447\u043d\u043e\u0439 \u0442\u0430\u0431\u043b\u0438\u0446\u0435 \u0438\u043b\u0438 \u0432 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0442\u0430\u0431\u043b\u0438\u0446\u0435. \u0414\u0440\u0443\u0433\u0438\u043c\u0438 \u0441\u043b\u043e\u0432\u0430\u043c\u0438, \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u044b\u0435 \u0442\u0430\u0431\u043b\u0438\u0446\u044b \u043f\u043e\u043b\u043d\u043e\u0441\u0442\u044c\u044e \u043f\u0440\u043e\u0437\u0440\u0430\u0447\u043d\u044b \u0434\u043b\u044f \u043f\u0440\u0438\u043b\u043e\u0436\u0435\u043d\u0438\u044f, \u0438 \u043d\u0435\u0432\u043e\u0437\u043c\u043e\u0436\u043d\u043e \u043e\u043f\u0440\u0435\u0434\u0435\u043b\u0438\u0442\u044c, \u0431\u044b\u043b\u0430 \u043b\u0438 \u0437\u0430\u043f\u0440\u043e\u0448\u0435\u043d\u043d\u0430\u044f \u0442\u0430\u0431\u043b\u0438\u0446\u0430 \u0440\u0430\u0441\u043f\u0440\u0435\u0434\u0435\u043b\u0451\u043d\u043d\u043e\u0439 \u0438\u043b\u0438 \u043b\u043e\u043a\u0430\u043b\u044c\u043d\u043e\u0439.\n\n\u0423\u0437\u043d\u0430\u0439\u0442\u0435 \u0431\u043e\u043b\u044c\u0448\u0435 \u043e [\u0443\u0434\u0430\u043b\u0451\u043d\u043d\u044b\u0445 \u0443\u0437\u043b\u0430\u0445](../Creating_a_cluster/Remote_nodes.md).\n\n<!-- proofread -->"
        },
        "is_code_or_comment": false,
        "model": "openai:gpt-4.1-mini",
        "updated_at": 1766339781
    },
    "__meta": {
        "source_text": "# Distributed searching\n\nManticore is designed to scale effectively through its distributed searching capabilities. Distributed searching is beneficial for improving query latency (i.e., search time) and throughput (i.e., max queries/sec) in multi-server, multi-CPU, or multi-core environments. This is crucial for applications that need to search through vast amounts of data (i.e., billions of records and terabytes of text).\n\nThe primary concept is to horizontally partition the searched data across search nodes and process it in parallel.\n\nPartitioning is done manually. To set it up, you should:\n\n* Set up multiple instances of Manticore on different servers\n* Distribute different parts of your dataset to different instances\n* Configure a special [distributed table](../Creating_a_table/Creating_a_distributed_table/Creating_a_distributed_table.md) on some of the `searchd` instances\n* Route your queries to the distributed table\n\nThis type of table only contains references to other local and remote tables - so it cannot be directly reindexed. Instead, you should reindex the tables that it references.\n\nWhen Manticore receives a query against a distributed table, it performs the following steps:\n\n1. Connects to the configured remote agents\n2. Sends the query to them\n3. Simultaneously searches the configured local tables (while the remote agents are searching)\n4. Retrieves the search results from the remote agents\n5. Merges all the results together, removing duplicates\n6. Sends the merged results to the client\n\nFrom the application's perspective, there are no differences between searching through a regular table or a distributed table. In other words, distributed tables are fully transparent to the application, and there's no way to tell whether the table you queried was distributed or local.\n\nLearn more about [remote nodes](../Creating_a_cluster/Remote_nodes.md).\n\n<!-- proofread -->\n\n",
        "updated_at": 1768530797,
        "source_md5": "9595b0608ee94270100d454163dbc778"
    }
}