Elastic Cloud/Elasticsearch 8.x to Lucenia compatibility

This document provides a comprehensive feature mapping between Elastic Cloud/Elasticsearch 8.x and Lucenia. Lucenia is based on OpenSearch 2.14, which was originally forked from Elasticsearch 7.10.2.

Key compatibility notes

• API compatibility: Lucenia maintains compatibility with Elasticsearch 7.10.2 APIs
• Breaking changes: Features introduced in Elasticsearch 8.x may not have direct equivalents
• Migration path: Direct migration requires API adjustments and feature mapping

Core search features

Feature	Elastic Cloud/ES 8.x	Lucenia	Migration notes
Full-text search	Yes	Yes	Compatible
Term queries	Yes	Yes	Compatible
Match queries	Yes	Yes	Compatible
Boolean queries	Yes	Yes	Compatible
Range queries	Yes	Yes	Compatible
Fuzzy search	Yes	Yes	Compatible
Wildcard queries	Yes	Yes	Compatible
Regex queries	Yes	Yes	Compatible
Phrase search	Yes	Yes	Compatible
Proximity search	Yes	Yes	Compatible
Vector search (kNN)	Native support	k-NN plugin	Requires plugin installation
Semantic search	ELSER, E5 models	ML Commons plugin	Different implementation
Hybrid search	RRF (8.8+)	Hybrid query	Different syntax
Runtime fields	Yes (7.11+)	Yes	DynamicFields API
Point in Time (PIT)	Yes	Yes	Compatible
Async search	Yes	Yes	Compatible
Search templates	Yes	Yes	Compatible
Multi-search	Yes	Yes	Compatible
Scroll API	Deprecated	Yes	Use PIT in both platforms
SQL support	Yes	SQL plugin	Requires plugin
PPL support	No	PPL plugin	OpenSearch-specific

Indexing and data management

Feature	Elastic Cloud/ES 8.x	Lucenia	Migration notes
Dynamic mapping	Yes	Yes	Compatible
Explicit mapping	Yes	Yes	Compatible
Data types	All standard types	All standard types	Compatible
Nested objects	Yes	Yes	Compatible
Parent-child	Join field	Join field	Compatible
Geo types	geo_point, geo_shape	geo_point, geo_shape	Compatible
Data streams	Yes (7.9+)	Yes	Compatible
Index templates	Composable templates	Composable templates	Compatible
Index Lifecycle Management (ILM)	Yes	ISM (Index State Management)	Different implementation
Rollover API	Yes	Yes	Compatible
Shrink/Split index	Yes	Yes	Compatible
Force merge	Yes	Yes	Compatible
Reindex API	Yes	Yes	Compatible
Update by query	Yes	Yes	Compatible
Delete by query	Yes	Yes	Compatible
Bulk API	Yes	Yes	Compatible
Ingest pipelines	Yes	Yes	Compatible
Ingest node	Yes	Yes	Compatible
Processors	40+ processors	Most processors	Check specific processors
Snapshot and restore	Yes	Yes	Compatible
Searchable snapshots	Yes (7.10+)	Limited support	Different implementation
Frozen indices	Yes	No	Use cold tier instead

Aggregations

Feature	Elastic Cloud/ES 8.x	Lucenia	Migration notes
Metrics aggregations
Avg, Sum, Min, Max	Yes	Yes	Compatible
Stats, Extended Stats	Yes	Yes	Compatible
Percentiles	Yes	Yes	Compatible
Cardinality	Yes	Yes	Compatible
Value Count	Yes	Yes	Compatible
Geo Bounds/Centroid	Yes	Yes	Compatible
Top Metrics	Yes (7.7+)	No	Use top_hits instead
Bucket aggregations
Terms	Yes	Yes	Compatible
Histogram	Yes	Yes	Compatible
Date Histogram	Yes	Yes	Compatible
Range	Yes	Yes	Compatible
Filter(s)	Yes	Yes	Compatible
Nested	Yes	Yes	Compatible
Reverse Nested	Yes	Yes	Compatible
Sampler	Yes	Yes	Compatible
Composite	Yes	Yes	Compatible
Multi-terms	Yes (7.12+)	No	Use scripted terms
Pipeline aggregations	Yes	Yes	Compatible
Matrix aggregations	Yes	Yes	Compatible

Cluster management and operations

Feature	Elastic Cloud/ES 8.x	Lucenia	Migration notes
Cluster health	Yes	Yes	Compatible
Node management	Yes	Yes	Compatible
Shard allocation	Yes	Yes	Compatible
Cluster reroute	Yes	Yes	Compatible
Voting configuration	Yes	Yes	Compatible
Master election	Yes	Cluster Manager	Terminology change
Node roles	Multiple roles	Multiple roles	Compatible
Remote clusters	CCS/CCR	CCS/CCR plugins	Requires plugins
Cross-cluster search	Yes	Yes	Compatible
Cross-cluster replication	Yes (Platinum)	CCR plugin	Open source in OpenSearch
Autoscaling	Yes (7.11+)	Deployment-specific	Cloud provider dependent
Hot/Warm/Cold/Frozen	Data tiers	Hot/Warm/Cold	No frozen tier
Node-to-node encryption	Yes	Yes	Compatible
Cluster state API	Yes	Yes	Compatible
Task management	Yes	Yes	Compatible
Persistent tasks	Yes	Yes	Compatible

Security features

Feature	Elastic Cloud/ES 8.x	Lucenia	Migration notes
Authentication
Native users	Yes	Yes	Different implementation
LDAP/AD	Yes	Yes	Plugin required
SAML	Yes (Gold+)	Yes	Plugin required
OpenID Connect	Yes (Gold+)	Yes	Plugin required
Kerberos	Yes (Gold+)	Yes	Plugin required
PKI	Yes	Yes	Compatible
API keys	Yes	Yes	Different format
Service tokens	Yes (8.5+)	No	Use API keys
Authorization
Role-based access	Yes	Yes	Compatible
Document-level security	Yes (Platinum)	Yes	Open source
Field-level security	Yes (Platinum)	Yes	Open source
Index privileges	Yes	Yes	Compatible
Cluster privileges	Yes	Yes	Compatible
Encryption
TLS/SSL	Yes	Yes	Compatible
Encryption at rest	Cloud-managed	Provider-dependent	Configure per provider
Node-to-node	Yes	Yes	Compatible
Audit logging	Yes (Gold+)	Yes	Open source
IP filtering	Yes	Yes	Compatible
Security realms	Multiple realms	Multiple backends	Different configuration

Monitoring and observability

Feature	Elastic Cloud/ES 8.x	Lucenia	Migration notes
Metrics collection	Metricbeat	Performance Analyzer	Different tool
Cluster monitoring	Stack Monitoring	OpenSearch Dashboards	Different UI
Node stats	Yes	Yes	Compatible
Index stats	Yes	Yes	Compatible
JVM monitoring	Yes	Yes	Compatible
Thread pool stats	Yes	Yes	Compatible
Circuit breakers	Yes	Yes	Compatible
Slow log	Yes	Yes	Compatible
Deprecation log	Yes	Yes	Compatible
APM integration	Elastic APM	OpenTelemetry	Different solution
Tracing	Yes	Trace Analytics	Plugin required
Alerting	Watcher/Rules	Alerting plugin	Different syntax
Anomaly detection	ML (Platinum)	AD plugin	Open source

Machine learning and analytics

Feature	Elastic Cloud/ES 8.x	Lucenia	Migration notes
Anomaly detection	ML (Platinum)	AD plugin	Open source, different API
Forecasting	Yes (Platinum)	Limited	Basic support only
Data Frame Analytics	Yes (Platinum)	No	No equivalent
Transforms	Yes	Rollup jobs	Different implementation
Inference	Yes	ML Commons	Different API
NLP models	ELSER, PyTorch	ML Commons	Different models
Model management	Yes	Model registry	Different implementation
Vector database	Dense vectors	k-NN plugin	Plugin required
Similarity search	Yes	Yes	Compatible
Learning to Rank	Third-party	LTR plugin	Native plugin

Visualization and dashboards

Feature	Elastic Cloud/ES 8.x	Lucenia	Migration notes
Dashboard tool	Kibana	OpenSearch Dashboards	Fork of Kibana 7.10
Visualizations	20+ types	15+ types	Most common available
Canvas	Yes	No	No equivalent
Maps	Elastic Maps	Maps plugin	Different features
Lens	Yes (7.5+)	No	Use legacy visualizations
TSVB	Yes	Yes	Compatible
Vega	Yes	Yes	Compatible
Saved objects	Yes	Yes	May need conversion
Spaces	Yes	Tenants	Different concept
Reporting	PDF/CSV (Gold+)	Reporting plugin	Open source
Dev Tools Console	Yes	Yes	Compatible

API compatibility

Compatible APIs (direct migration)

The following APIs are compatible and can be directly migrated:

• Document APIs (Index, Get, Update, Delete)
• Search APIs (Basic search, Multi-search)
• Aggregation APIs
• Index APIs (Create, Delete, Settings, Mappings)
• Cluster APIs (Health, State, Stats)
• Node APIs (Info, Stats)
• Cat APIs
• Bulk Operations
• Scroll API (though PIT preferred)

APIs requiring modification

API	ES 8.x	Lucenia	Changes required
Security APIs	/_security/*	/_plugins/_security/*	Path change
ML APIs	/_ml/*	/_plugins/_ml/*	Path change
ILM APIs	/_ilm/*	/_plugins/_ism/*	Different API
Watcher APIs	/_watcher/*	/_plugins/_alerting/*	Different API
License APIs	/_license/*	Not applicable	Remove calls
X-Pack APIs	/_xpack/*	Not applicable	Remove or replace

Client compatibility

• Elasticsearch 7.10.x clients: Yes
• OpenSearch clients: Yes (recommended)
• Elasticsearch 7.11-7.17 clients: Test thoroughly
• Elasticsearch 8.x clients: Not compatible

Elastic Cloud-specific features

Feature	Elastic Cloud	Lucenia alternative
Deployment management	Elastic Cloud Console	Cloud provider console/Terraform
Auto-scaling	Built-in	Auto Scaling Groups (AWS native)
Backups	Automated	S3 snapshots (configure manually)
Monitoring	Cloud monitoring	CloudWatch + Dashboards
Traffic filtering	IP allowlists	Security Groups (cloud native)
VPC peering	Private endpoints	VPC Endpoints (cloud native)
SSO integration	Cloud SSO	Cloud provider SSO + SAML
Fleet management	Fleet Server	Not available (use alternative)
Elastic Agent	Yes	Not available (use Beats/Logstash)
Integrations	300+ integrations	Limited (build custom)

Data ingestion

Feature	Elastic Cloud/ES 8.x	Lucenia	Migration notes
Elastic Agent	Unified agent	Not available	Use individual Beats
Beats family
Filebeat	Yes	Compatible (7.x)	Use 7.x version
Metricbeat	Yes	Compatible (7.x)	Use 7.x version
Packetbeat	Yes	Compatible (7.x)	Use 7.x version
Heartbeat	Yes	Compatible (7.x)	Use 7.x version
Auditbeat	Yes	Compatible (7.x)	Use 7.x version
Winlogbeat	Yes	Compatible (7.x)	Use 7.x version
Other tools
Logstash	Latest version	OpenSearch output	Use OS output plugin
Data Prepper	Not available	Yes	OpenSearch-specific
Kafka Connect	Sink connector	Sink connector	Compatible
Fluentd/Fluent Bit	Output plugin	Output plugin	Compatible
Vector	Sink available	Sink available	Compatible
CloudWatch	Via Functionbeat	Direct integration	AWS native
Kinesis	Via integration	Direct integration	AWS native

Critical incompatibilities

When migrating from Elastic Cloud/Elasticsearch 8.x to Lucenia, be aware of these critical incompatibilities:

1. Runtime fields - Not available in OpenSearch, use scripted fields
2. Elasticsearch 8.x security features - Different implementation in OpenSearch
3. Canvas - No equivalent in OpenSearch Dashboards
4. Lens - Not available, use traditional visualizations
5. Data Frame Analytics - No direct equivalent
6. Frozen tier - Not supported, use cold storage
7. Service tokens - Use API keys instead
8. Multi-terms aggregation - Use scripted aggregations

Next steps

• See Using snapshots to migrate data for snapshot-based migration
• See Upgrading Lucenia for upgrade procedures