Geohash grid aggregations
The geohash_grid
aggregation buckets documents for geographical analysis. It organizes a geographical region into a grid of smaller regions of different sizes or precisions. Lower values of precision represent larger geographical areas, and higher values represent smaller, more precise geographical areas. You can aggregate documents on geopoint or geoshape fields using a geohash grid aggregation. One notable difference is that a geopoint is only present in one bucket, but a geoshape is counted in all geohash grid cells with which it intersects.
The number of results returned by a query might be far too many to display each geopoint individually on a map. The geohash_grid
aggregation buckets nearby geopoints together by calculating the geohash for each point, at the level of precision that you define (between 1 to 12; the default is 5). To learn more about geohash, see Wikipedia.
The web logs example data is spread over a large geographical area, so you can use a lower precision value. You can zoom in on this map by increasing the precision value:
GET opensearch_dashboards_sample_data_logs/_search
{
"size": 0,
"aggs": {
"geo_hash": {
"geohash_grid": {
"field": "geo.coordinates",
"precision": 4
}
}
}
}
Example response
...
"aggregations" : {
"geo_hash" : {
"buckets" : [
{
"key" : "c1cg",
"doc_count" : 104
},
{
"key" : "dr5r",
"doc_count" : 26
},
{
"key" : "9q5b",
"doc_count" : 20
},
{
"key" : "c20g",
"doc_count" : 19
},
{
"key" : "dr70",
"doc_count" : 18
}
...
]
}
}
}
You can visualize the aggregated response on a map using OpenSearch Dashboards.
The more accurate you want the aggregation to be, the more resources Lucenia consumes because of the number of buckets that the aggregation has to calculate. By default, Lucenia does not generate more than 10,000 buckets. You can change this behavior by using the size
attribute, but keep in mind that the performance might suffer for very wide queries consisting of thousands of buckets.
Aggregating geoshapes
To run an aggregation on a geoshape field, first create an index and map the location
field as a geo_shape
:
PUT national_parks
{
"mappings": {
"properties": {
"location": {
"type": "geo_shape"
}
}
}
}
Next, index some documents into the national_parks
index:
PUT national_parks/_doc/1
{
"name": "Yellowstone National Park",
"location":
{"type": "envelope","coordinates": [ [-111.15, 45.12], [-109.83, 44.12] ]}
}
PUT national_parks/_doc/2
{
"name": "Yosemite National Park",
"location":
{"type": "envelope","coordinates": [ [-120.23, 38.16], [-119.05, 37.45] ]}
}
PUT national_parks/_doc/3
{
"name": "Death Valley National Park",
"location":
{"type": "envelope","coordinates": [ [-117.34, 37.01], [-116.38, 36.25] ]}
}
You can run an aggregation on the location
field as follows:
GET national_parks/_search
{
"aggregations": {
"grouped": {
"geohash_grid": {
"field": "location",
"precision": 1
}
}
}
}
When aggregating geoshapes, one geoshape can be counted for multiple buckets because it overlaps multiple grid cells:
Response
{
"took" : 24,
"timed_out" : false,
"_shards" : {
"total" : 1,
"successful" : 1,
"skipped" : 0,
"failed" : 0
},
"hits" : {
"total" : {
"value" : 3,
"relation" : "eq"
},
"max_score" : 1.0,
"hits" : [
{
"_index" : "national_parks",
"_id" : "1",
"_score" : 1.0,
"_source" : {
"name" : "Yellowstone National Park",
"location" : {
"type" : "envelope",
"coordinates" : [
[
-111.15,
45.12
],
[
-109.83,
44.12
]
]
}
}
},
{
"_index" : "national_parks",
"_id" : "2",
"_score" : 1.0,
"_source" : {
"name" : "Yosemite National Park",
"location" : {
"type" : "envelope",
"coordinates" : [
[
-120.23,
38.16
],
[
-119.05,
37.45
]
]
}
}
},
{
"_index" : "national_parks",
"_id" : "3",
"_score" : 1.0,
"_source" : {
"name" : "Death Valley National Park",
"location" : {
"type" : "envelope",
"coordinates" : [
[
-117.34,
37.01
],
[
-116.38,
36.25
]
]
}
}
}
]
},
"aggregations" : {
"grouped" : {
"buckets" : [
{
"key" : "9",
"doc_count" : 3
},
{
"key" : "c",
"doc_count" : 1
}
]
}
}
}
Currently, Lucenia supports geoshape aggregation through the API but not in OpenSearch Dashboards visualizations. If you’d like to see geoshape aggregation implemented for visualizations, upvote the related GitHub issue.
Supported parameters
Geohash grid aggregation requests support the following parameters.
Parameter | Data type | Description |
---|---|---|
field | String | The field on which aggregation is performed. This field must be mapped as a geo_point or geo_shape field. If the field contains an array, all array values are aggregated. Required. |
precision | Integer | The granularity level used to determine grid cells for bucketing results. Cells cannot exceed the specified size (diagonal) of the required precision. Valid values are in the [0, 12] range. Optional. Default is 5. |
bounds | Object | The bounding box for filtering geopoints and geoshapes. The bounding box is defined by the upper-left and lower-right vertices. Only shapes that intersect with this bounding box or are completely enclosed by this bounding box are included in the aggregation output. The vertices are specified as geopoints in one of the following formats: - An object with a latitude and longitude - An array in the [ longitude , latitude ] format- A string in the “ latitude ,longitude ” format- A geohash - WKT See the geopoint formats for formatting examples. Optional. |
size | Integer | The maximum number of buckets to return. When there are more buckets than size , Lucenia returns buckets with more documents. Optional. Default is 10,000. |
shard_size | Integer | The maximum number of buckets to return from each shard. Optional. Default is max (10, size · number of shards), which provides a more accurate count of more highly prioritized buckets. |
Geohash precision
The relationship between geohash precision and the approximate grid cell dimensions is described in the following table.
Precision / geohash length | Latitude bits | Longitude bits | Latitude error | Longitude error | Cell height | Cell width |
---|---|---|---|---|---|---|
1 | 2 | 3 | ±23 | ±23 | 4992.6 km | 5009.4 km |
2 | 5 | 5 | ±2.8 | ±5.6 | 624.1 km | 1252.3 km |
3 | 7 | 8 | ±0.70 | ±0.70 | 156 km | 156.5 km |
4 | 10 | 10 | ±0.087 | ±0.18 | 19.5 km | 39.1 km |
5 | 12 | 13 | ±0.022 | ±0.022 | 4.9 km | 4.9 km |
6 | 15 | 15 | ±0.0027 | ±0.0055 | 609.4 m | 1.2 km |
7 | 17 | 18 | ±0.00068 | ±0.00068 | 152.5 m | 152.9 m |
8 | 20 | 20 | ±0.00086 | ±0.000172 | 19 m | 38.2 m |
9 | 22 | 23 | ±0.000021 | ±0.000021 | 4.8 m | 4.8 m |
10 | 25 | 25 | ±0.00000268 | ±0.00000536 | 59.5 cm | 1.2 m |
11 | 27 | 28 | ±0.00000067 | ±0.00000067 | 14.9 cm | 14.9 cm |
12 | 30 | 30 | ±0.00000008 | ±0.00000017 | 1.9 cm | 3.7 cm |