Infrastructure

Managed OpenSearch

Managed OpenSearch

Enterprise-grade managed OpenSearch service for full-text search, log analytics, application monitoring, and real-time data analysis.

Overview#

  • Full-Text Search: Powerful search capabilities with relevance scoring
  • Log Analytics: Centralized logging and analysis
  • Real-Time Analytics: Query and visualize data in real-time
  • Observability: Application and infrastructure monitoring
  • Scalability: Horizontal scaling with automatic sharding

Key Features#

Search Capabilities#

  • Full-text search
  • Fuzzy matching
  • Autocomplete
  • Faceted search
  • Geospatial search
  • Vector search (k-NN)

Analytics#

  • Real-time aggregations
  • Time-series analysis
  • Statistical analysis
  • Machine learning
  • Anomaly detection

Observability#

  • Log aggregation
  • Metrics collection
  • Trace analysis
  • APM integration
  • Dashboards

Performance#

  • Distributed architecture
  • Automatic sharding
  • Query caching
  • Index optimization
  • SSD storage

Security#

  • Encryption at rest
  • TLS encryption
  • Fine-grained access control
  • SAML/LDAP integration
  • Audit logging

Supported Versions#

  • OpenSearch 2.11
  • OpenSearch 2.9
  • OpenSearch 2.7
  • OpenSearch 1.3

Use Cases#

  • E-commerce product search
  • Content search
  • Document search
  • Site search
  • Autocomplete

Log Analytics#

  • Application logs
  • System logs
  • Security logs
  • Audit trails
  • Error tracking

Observability#

  • Infrastructure monitoring
  • Application performance
  • Distributed tracing
  • Metrics visualization
  • Alerting

Business Analytics#

  • Real-time dashboards
  • User behavior analysis
  • Sales analytics
  • Operational metrics
  • KPI tracking

Getting Started#

Index Creation#

1
curl -X PUT "https://opensearch.company.com/my-index" \
2
  -H 'Content-Type: application/json' \
3
  -d '{
4
    "settings": {
5
      "number_of_shards": 3,
6
      "number_of_replicas": 2
7
    }
8
  }'

Document Indexing#

1
curl -X POST "https://opensearch.company.com/my-index/_doc" \
2
  -H 'Content-Type: application/json' \
3
  -d '{
4
    "title": "My Document",
5
    "content": "Document content here",
6
    "timestamp": "2024-01-01T00:00:00Z"
7
  }'

Search Query#

1
curl -X GET "https://opensearch.company.com/my-index/_search" \
2
  -H 'Content-Type: application/json' \
3
  -d '{
4
    "query": {
5
      "match": {
6
        "content": "search term"
7
      }
8
    }
9
  }'

Architecture#

Components#

  • Data Nodes: Store and index data
  • Master Nodes: Cluster coordination
  • Coordinating Nodes: Route requests
  • Ingest Nodes: Data preprocessing
  • ML Nodes: Machine learning tasks

Deployment Options#

  • Single-node (development)
  • Multi-node cluster
  • Multi-AZ deployment
  • Cross-region replication
  • Dedicated master nodes

OpenSearch Dashboards#

Visualization#

  • Line charts
  • Bar charts
  • Pie charts
  • Heat maps
  • Geographic maps

Features#

  • Dashboard creation
  • Saved searches
  • Alerting
  • Reporting
  • Canvas

Data Ingestion#

Methods#

  • REST API
  • Bulk API
  • Logstash
  • Fluentd
  • Beats (Filebeat, Metricbeat)
  • Data Prepper

Data Sources#

  • Application logs
  • System logs
  • Metrics
  • Traces
  • Events

Management Features#

Automated Operations#

  • Cluster provisioning
  • Automatic scaling
  • Version upgrades
  • Snapshot management
  • Health monitoring

Monitoring#

  • Cluster health
  • Node statistics
  • Index statistics
  • Query performance
  • Resource utilization

Scaling#

  • Add/remove nodes
  • Vertical scaling
  • Storage expansion
  • Shard rebalancing

Index Management#

Lifecycle Policies#

  • Hot-warm-cold architecture
  • Automatic rollover
  • Index deletion
  • Snapshot policies
  • Retention management

Optimization#

  • Index templates
  • Mapping optimization
  • Shard sizing
  • Refresh intervals
  • Merge policies

Security Features#

Authentication#

  • Basic authentication
  • SAML SSO
  • LDAP/Active Directory
  • OpenID Connect
  • API keys

Authorization#

  • Role-based access control
  • Document-level security
  • Field-level security
  • Tenant isolation

Pricing#

Based on:

  • Instance type (CPU/RAM)
  • Storage capacity
  • Data transfer
  • Snapshot storage
  • Support level

Support#

  • 24/7 technical support
  • Query optimization
  • Index design consultation
  • Migration assistance

Need powerful search and analytics? Contact us to get started.