Reindex document
Introduced 0.1.0
The reindex document API operation lets you copy all or a subset of your data from a source index into a destination index.
Example
POST /_reindex
{
"source":{
"index":"my-source-index"
},
"dest":{
"index":"my-destination-index"
}
}
Path and HTTP methods
POST /_reindex
URL parameters
All URL parameters are optional.
| Parameter | Type | Description |
|---|---|---|
| refresh | Boolean | If true, Lucenia refreshes shards to make the reindex operation available to search results. Valid options are true, false, and wait_for, which tells Lucenia to wait for a refresh before executing the operation. Default is false. |
| timeout | Time | How long to wait for a response from the cluster. Default is 30s. |
| wait_for_active_shards | String | The number of active shards that must be available before Lucenia processes the reindex request. Default is 1 (only the primary shard). Set to all or a positive integer. Values greater than 1 require replicas. For example, if you specify a value of 3, the index must have two replicas distributed across two additional nodes for the operation to succeed. |
| wait_for_completion | Boolean | Waits for the matching tasks to complete. Default is false. |
| requests_per_second | Integer | Specifies the request’s throttling in sub-requests per second. Default is -1, which means no throttling. |
| require_alias | Boolean | Whether the destination index must be an index alias. Default is false. |
| scroll | Time | How long to keep the search context open. Default is 5m. |
| slices | Integer | Number of sub-tasks Lucenia should divide this task into. Default is 1, which means Lucenia should not divide this task. Setting this parameter to auto indicates to Lucenia that it should automatically decide how many slices to split the task into. |
| max_docs | Integer | How many documents the update by query operation should process at most. Default is all documents. |
Request body
Your request body must contain the names of the source index and destination index. All other fields are optional.
| Field | Description |
|---|---|
| conflicts | Indicates to Lucenia what should happen if the delete by query operation runs into a version conflict. Valid options are abort and proceed. Default is abort. |
| source | Information about the source index to include. Valid fields are index, max_docs, query, remote, size, slice, and _source. |
| index | The name of the source index to copy data from. |
| max_docs | The maximum number of documents to reindex. |
| query | The search query to use for the reindex operation. |
| remote | Information about a remote Lucenia cluster to copy data from. Valid fields are host, username, password, socket_timeout, and connect_timeout. |
| host | Host URL of the Lucenia cluster to copy data from. |
| username | Username to authenticate with the remote cluster. |
| password | Password to authenticate with the remote cluster. |
| socket_timeout | The wait time for socket reads. Default is 30s. |
| connect_timeout | The wait time for remote connection timeouts. Default is 30s. |
| size | The number of documents to reindex. |
| slice | Whether to manually or automatically slice the reindex operation so it executes in parallel. Setting this field to auto allows Lucenia to control the number of slices to use, which is one slice per shard, up to a maximum of 20. If there are multiple sources, the number of slices used are based on the index or backing index with the smallest number of shards. |
| _source | Whether to reindex source fields. Specify a list of fields to reindex or true to reindex all fields. Default is true. |
| id | The ID to associate with manual slicing. |
| max | Maximum number of slices. |
| dest | Information about the destination index. Valid values are index, version_type, op_type, and pipeline. |
| index | Name of the destination index. |
| version_type | The indexing operation’s version type. Valid values are internal, external, external_gt (retrieve the document if the specified version number is greater than the document’s current version), and external_gte (retrieve the document if the specified version number is greater or equal to than the document’s current version). |
| op_type | Whether to copy over documents that are missing in the destination index. Valid values are create (ignore documents with the same ID from the source index) and index (copy everything from the source index). |
| pipeline | Which ingest pipeline to utilize during the reindex. |
| script | A script that Lucenia uses to apply transformations to the data during the reindex operation. |
| source | The actual script that Lucenia runs. |
| lang | The scripting language. Valid options are painless, expression, mustache, and java. |
Response
{
"took": 28829,
"timed_out": false,
"total": 111396,
"updated": 0,
"created": 111396,
"deleted": 0,
"batches": 112,
"version_conflicts": 0,
"noops": 0,
"retries": {
"bulk": 0,
"search": 0
},
"throttled_millis": 0,
"requests_per_second": -1.0,
"throttled_until_millis": 0,
"failures": []
}
Response body fields
| Field | Description |
|---|---|
| took | How long the operation took in milliseconds. |
| timed_out | Whether the operation timed out. |
| total | The total number of documents processed. |
| updated | The number of documents updated in the destination index. |
| created | The number of documents created in the destination index. |
| deleted | The number of documents deleted. |
| batches | Number of scroll responses. |
| version_conflicts | Number of version conflicts. |
| noops | How many documents Lucenia ignored during the operation. |
| retries | Number of bulk and search retry requests. |
| throttled_millis | Number of throttled milliseconds during the request. |
| requests_per_second | Number of requests executed per second during the operation. |
| throttled_until_millis | The amount of time until Lucenia executes the next throttled request. |
| failures | Any failures that occurred during the operation. |