Interactive examples

The elasticsearch-labs repo contains interactive and executable Python notebooks, sample apps, and resources for testing out Elasticsearch, using the Python client. These examples are mainly focused on vector search, hybrid search and generative AI use cases, but you’ll also find examples of basic operations like creating index mappings and performing lexical search.

Search notebooks

The Search folder is a good place to start if you’re new to Elasticsearch. This folder contains a number of notebooks that demonstrate the fundamentals of Elasticsearch, like indexing vectors, running lexical, semantic and hybrid searches, and more.

The following notebooks are available:

  1. Quick start

  2. Keyword, querying, filtering

  3. Hybrid search

  4. Semantic search with ELSER

  5. Multilingual semantic search

  6. Query rules

  7. Synonyms API quick start

Here’s a brief overview of what you’ll learn in each notebook.

Quick start

In the 00-quick-start.ipynb notebook you’ll learn how to:

  • Use the Elasticsearch Python client for various operations.

  • Create and define an index for a sample dataset with dense_vector fields.

  • Transform book titles into embeddings using Sentence Transformers and index them into Elasticsearch.

  • Perform k-nearest neighbors (knn) semantic searches.

  • Integrate traditional text-based search with semantic search, for a hybrid search system.

  • Use reciprocal rank fusion (RRF) to intelligently combine search results from different retrieval systems.

Keyword, querying, filtering

In the 01-keyword-querying-filtering.ipynb notebook, you’ll learn how to:

  • Use query and filter contexts to search and filter documents in Elasticsearch.

  • Execute full-text searches with match and multi-match queries.

  • Query and filter documents based on text, number, date, or boolean values.

  • Run multi-field searches using the multi-match query.

  • Prioritize specific fields in the multi-match query for tailored results.

Hybrid search

In the 02-hybrid-search.ipynb notebook, you’ll learn how to:

  • Combine results of traditional text-based search with semantic search, for a hybrid search system.

  • Transform fields in the sample dataset into embeddings using the Sentence Transformer model and index them into Elasticsearch.

  • Use the RRF API to combine the results of a match query and a kNN semantic search.

  • Walk through a super simple toy example that demonstrates, step by step, how RRF ranking works.

Semantic search with ELSER

In the 03-ELSER.ipynb notebook, you’ll learn how to:

  • Use the Elastic Learned Sparse Encoder (ELSER) for text expansion-powered semantic search, out of the box — without training, fine-tuning, or embeddings generation.

  • Download and deploy the ELSER model in your Elastic environment.

  • Create an Elasticsearch index named search-movies with specific mappings and index a dataset of movie descriptions.

  • Create an ingest pipeline containing an inference processor for ELSER model execution.

  • Reindex the data from search-movies into another index, elser-movies, using the ELSER pipeline for text expansion.

  • Observe the results of running the documents through the model by inspecting the additional terms it adds to documents, which enhance searchability.

  • Perform simple keyword searches on the elser-movies index to assess the impact of ELSER’s text expansion.

  • Execute ELSER-powered semantic searches using the text_expansion query.

Multilingual semantic search

In the 04-multilingual.ipynb notebook, you’ll learn how to:

  • Use a multilingual embedding model for semantic search across languages.

  • Transform fields in the sample dataset into embeddings using the Sentence Transformer model and index them into Elasticsearch.

  • Use filtering with a kNN semantic search.

  • Walk through a super simple toy example that demonstrates, step by step, how multilingual search works across languages, and within non-English languages.

Query rules

In the 05-query-rules.ipynb notebook, you’ll learn how to:

  • Use the query rules management APIs to create and edit promotional rules based on contextual queries.

  • Apply these query rules by using the rule_query in Query DSL.

Synonyms API quick start

In the 06-synonyms-api.ipynb notebook, you’ll learn how to:

  • Use the synonyms management API to create a synonyms set to enhance your search recall.

  • Configure an index to use search-time synonyms.

  • Update synonyms in real time.

  • Run queries that are enhanced by synonyms.

Other notebooks

  • Generative AI. Notebooks that demonstrate various use cases for Elasticsearch as the retrieval engine and vector store for LLM-powered applications.

  • Integrations. Notebooks that demonstrate how to integrate popular services and projects with Elasticsearch, including OpenAI, Hugging Face, and LlamaIndex

  • Langchain. Notebooks that demonstrate how to integrate Elastic with LangChain, a framework for developing applications powered by language models.