Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Search Guide #6101

Merged
merged 2 commits into from
Sep 9, 2019
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
1 change: 1 addition & 0 deletions docs/guides/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,7 @@ These guides will help you customize or tune aspects of the Read the Docs build
environment-variables
feature-flags
google-analytics
searching-with-readthedocs
sitemaps
specifying-dependencies
wipe-environment
190 changes: 190 additions & 0 deletions docs/guides/searching-with-readthedocs.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,190 @@
Searching with Read the Docs
============================

.. meta::
:description lang=en:
Guide to use the powerful documentation search by Read the Docs to its full extent.
dojutsu-user marked this conversation as resolved.
Show resolved Hide resolved


This guide is intended to show that how to use the powerful search provided by Read the Docs.
It is being powered by `Elasticsearch`_.
You can find more information on the search architecture and how we index document on our
:doc:`Search <../development/search>` docs.


.. contents:: Table of contents
:local:
:backlinks: none
:depth: 3


Why "Just" Sphinx Search Is Not Enough?
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd rather phrase this as "things Read the Docs adds on top of Sphinx" rather than "Sphinx isn't doing enough". The supporting text can build on that but the title should probably be something like "Improvements over Sphinx search" or something like that.

You could also give a little background in the paragraph on why Sphinx can't do all these improvements. For example, "Sphinx is designed to create a self-contained webpage and all search indexing is done when the documentation is built. As a result, it would be impossible for Sphinx to add features like searching translations or subprojects or having analytics on common searches".

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I copied the same paragraph. It looks better than before.
Thanks.

---------------------------------------

Sphinx already have built in search functionality,
dojutsu-user marked this conversation as resolved.
Show resolved Hide resolved
but it only supports a basic search across a single documentation.
dojutsu-user marked this conversation as resolved.
Show resolved Hide resolved
While Read the Docs supports a powerful documentation search.

Features of Read the Docs documentation search are:

- Search as you type feature supported.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The order of items in this list should match the next section. Another option is just getting rid of this list since it basically is the next section and you already have the toctree.

Copy link
Member Author

@dojutsu-user dojutsu-user Aug 28, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I edited the list to match the order of sections.
I don't want to remove the list completely because it also list out the features which are not explained below in the doc.

- Search across multiple projects.
- Advanced query syntax.
- Search inside subprojects.
- Improved search result order.
- Public Search API (Documentation pending).
- Case insensitive search.
- Results from sections of the documentation.
- Code search.
- Search analytics.


Search Features for Project Admins
dojutsu-user marked this conversation as resolved.
Show resolved Hide resolved
----------------------------------

Enable "Search As You Type" In Your Documentation
dojutsu-user marked this conversation as resolved.
Show resolved Hide resolved
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

`readthedocs-sphinx-search`_ can be used to add a clean and minimal full page search UI
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you should just mention that this is a Sphinx extension that integrates documentation more closely with Read the Docs' search implementation. Users familiar with Sphinx will know how to integrate a Sphinx extension and users of MkDocs will know that this is Sphinx only.

to your documentation which supports **search as you type** feature.

To get a glimpse of it, you can press :guilabel:`/` (forward slash) and start typing
or just visit these URLs:

- https://docs.readthedocs.io/?rtd_search=contributing
- https://docs.readthedocs.io/?rtd_search=api/v3/projects/


Search Analytics
dojutsu-user marked this conversation as resolved.
Show resolved Hide resolved
~~~~~~~~~~~~~~~~

Search queries are recorded and are stored in database to provide valuable analytics to the project admins.
These analytics makes it easy to know what your users are looking for in your documentation.
You can see these analytics in your project admin dashboard.

.. note::

Currently, this feature is in beta state and is available under a
:ref:`feature flag <guides/feature-flags:Available Flags>`.
We plan to make this available for everyone soon.
If you want to test this feature out and help giving us feedback,
please contact us via `GitHub issues`_.

.. figure:: /_static/images/guides/search-analytics-demo.png
:width: 40%
:align: center
:alt: Search analytics in project admin dashboard

Search analytics demo


Search Features For Readers
dojutsu-user marked this conversation as resolved.
Show resolved Hide resolved
---------------------------

Search Across All Projects
~~~~~~~~~~~~~~~~~~~~~~~~~~

Our `main site search`_ supports searching for projects and
searching across all projects.
You can use it to select the specific project and version to narrow down the search results.

Example queries:

- https://readthedocs.org/search/?q=celery&type=project
- https://readthedocs.org/search/?q=celery._state&type=file
- https://readthedocs.org/search/?q=celery._state&type=file&project=celery
- https://readthedocs.org/search/?q=celery._state&type=file&project=celery&version=master


Search Inside Subprojects
~~~~~~~~~~~~~~~~~~~~~~~~~

We allow projects to configured as subprojects of another project.
You can read more about this in our :doc:`Subprojects <../subprojects>` documentation.

If a search is made in a project which have one or more subprojects under it,
the search results then also includes the results from subprojects because
they share a search index with their parent and sibling projects.
For example: `Kombu`_ is one of the subprojects of `Celery`_,
so if you search in Celery docs, then the results from Kombu will also be there.
Example: https://docs.celeryproject.org/en/master/search.html?q=utilities&check_keywords=yes&area=default


Search Query Syntax
~~~~~~~~~~~~~~~~~~~

Read the Docs uses `Simple Query String`_ feature of `Elasticsearch`_,
hence the search query can be made complex to get more accurate results.

Exact Phrase Search
+++++++++++++++++++

If a query is wrapped in ``"``,
then only those results where the phrase is exactly matched will be returned.

Example queries:

- https://docs.readthedocs.io/?rtd_search=%22custom%20css%22
- https://docs.readthedocs.io/?rtd_search=%22adding%20a%20subproject%22
- https://docs.readthedocs.io/?rtd_search=%22when%20a%20404%20is%20returned%22

Exact Phrase Search With Slop Value
+++++++++++++++++++++++++++++++++++

``~N`` after a phrase signifies slop amount.
It can be used to match words which are near one another.

Example queries:

- https://docs.readthedocs.io/?rtd_search=%22dashboard%20admin%22~2
- https://docs.readthedocs.io/?rtd_search=%22single%20documentation%22~1
- https://docs.readthedocs.io/?rtd_search=%22read%20the%20docs%20story%22~5

Prefix Query
++++++++++++

``*`` at the end of any term signifies a prefix query.
It returns the results containg the words with specific prefix.

Example queries:

- https://docs.readthedocs.io/?rtd_search=API%20v*
- https://docs.readthedocs.io/?rtd_search=single%20v*%20doc*
- https://docs.readthedocs.io/?rtd_search=build*%20and%20c*%20to%20doc*

Fuzzy Query
+++++++++++

``~N`` after a word signifies edit distance (fuzziness).
This type of query is helpful when spelling of the actual keyword is unsure.
It returns results that contain terms similar to the search term,
as measured by a `Levenshtein edit distance`_.

Example queries:

- https://docs.readthedocs.io/?rtd_search=reedthedcs~2
- https://docs.readthedocs.io/?rtd_search=authentation~3
- https://docs.readthedocs.io/?rtd_search=configurtion~1


Using The Search Query Syntax To Build Complex Queries
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

The search query syntaxes described in the previous section
can be used with one another to build complex queries.

Example queries:

- https://docs.readthedocs.io/?rtd_search=auto*%20redirect*
- https://docs.readthedocs.io/?rtd_search=abandon*%20proj*
- https://docs.readthedocs.io/?rtd_search=localisation~3%20of%20doc*


.. _readthedocs-sphinx-search: https://readthedocs-sphinx-search.readthedocs.io/
.. _GitHub issues: https://github.com/readthedocs/readthedocs.org/issues/new
.. _main site search: https://readthedocs.org/search/?q=&type=file&version=latest
.. _Kombu: http://docs.celeryproject.org/projects/kombu/en/master/
.. _Celery: http://docs.celeryproject.org/en/master/
.. _Simple Query String: https://www.elastic.co/guide/en/elasticsearch/reference/current/query-dsl-simple-query-string-query.html#
.. _Elasticsearch: https://www.elastic.co/products/elasticsearch
.. _Levenshtein edit distance: https://en.wikipedia.org/wiki/Levenshtein_distance