# Data processing using Analyzers

An **analyzer** is a component **responsible for processing** and converting raw textual data into a format that is conducive to effective full-text search. It includes various sub-processes, such as **tokenization**, **stemming**, and removal of stop words.

## How is data processed ?

In Atlas Search, analyzers are like language experts that process and organize your data for effective searching. Think of them as tools with two main jobs:

1. **Tokenizer (Word Extractor):**
   * The tokenizer takes your text and extracts meaningful words, like breaking a sentence into individual words.
2. **Filters (Cleanup Crew):**
   * Filters are like a cleanup crew. They fix things like capitalization, punctuation, and unnecessary words, so your search results are spot-on.

By setting up an analyzer for a specific field, you decide how these language experts should do their job. They handle challenges like : 

* ignoring case (uppercase or lowercase) 
* removing unnecessary words
* understanding word variations etc. 

The result? Your data is processed in a way that makes searches super accurate and helpful. It's like having a language pro make your data search-friendly!

## For In-Depth Details

* [<mark style="color:blue;">**Refer to the Official Documentation of Analyzers**</mark>](https://www.mongodb.com/docs/atlas/atlas-search/analyzers/)


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.cosmocloud.io/resources/document-search/full-text-search/concepts/data-processing-using-analyzers.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.