Skip to content

Commit

Permalink
remove gensim.summarization subpackage, docs and test data (#2958)
Browse files Browse the repository at this point in the history 
* remove gensim.summarization subpackage, docs and test data

* Update changelog

* remove old import

* Remove distance metrics and pivoted normalization tutorials
  • Loading branch information
@mpenkov
mpenkov authored Oct 3, 2020
1 parent 683cebe commit 2dcaaf8
Show file tree
Hide file tree
Showing 51 changed files with 55 additions and 9,282 deletions.
4 changes: 4 additions & 0 deletions CHANGELOG.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,10 @@ This release contains a major refactoring.
* Clear up LdaModel documentation - remove claim that it accepts CSC matrix as input (PR [#2832](https://github.com/RaRe-Technologies/gensim/pull/2832), [@FyzHsn](https://github.com/FyzHsn))
* Fix "generator" language in word2vec docs (PR [#2935](https://github.com/RaRe-Technologies/gensim/pull/2935), __[@polm](https://github.com/polm)__)

### :warning: Removed functionality

* Remove gensim.summarization subpackage, docs and test data (PR [#2958](https://github.com/RaRe-Technologies/gensim/pull/2958), __[@mpenkov](https://github.com/mpenkov)__)

## :warning: 3.8.x will be the last gensim version to support Py2.7. Starting with 4.0.0, gensim will only support Py3.5 and above

## 3.8.3, 2020-05-03
Expand Down
9 changes: 0 additions & 9 deletions docs/src/apiref.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -95,12 +95,3 @@ Modules:
scripts/segment_wiki
parsing/porter
parsing/preprocessing
summarization/bm25
summarization/commons
summarization/graph
summarization/keywords
summarization/mz_entropy
summarization/pagerank_weighted
summarization/summariser
summarization/syntactic_unit
summarization/textcleaner
152 changes: 37 additions & 115 deletions docs/src/auto_examples/index.rst
View file
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ If you're thinking about contributing documentation, please see :ref:`sphx_glr_a

.. raw:: html

<div class="sphx-glr-clear"></div>
<div style='clear:both'></div>



Expand All @@ -33,10 +33,9 @@ Understanding this functionality is vital for using gensim effectively.

.. only:: html

.. figure:: /auto_examples/core/images/thumb/sphx_glr_run_core_concepts_thumb.png
:alt: Core Concepts
.. figure:: /auto_examples/core/images/thumb/sphx_glr_run_core_concepts_thumb.png

:ref:`sphx_glr_auto_examples_core_run_core_concepts.py`
:ref:`sphx_glr_auto_examples_core_run_core_concepts.py`

.. raw:: html

Expand All @@ -54,10 +53,9 @@ Understanding this functionality is vital for using gensim effectively.

.. only:: html

.. figure:: /auto_examples/core/images/thumb/sphx_glr_run_corpora_and_vector_spaces_thumb.png
:alt: Corpora and Vector Spaces
.. figure:: /auto_examples/core/images/thumb/sphx_glr_run_corpora_and_vector_spaces_thumb.png

:ref:`sphx_glr_auto_examples_core_run_corpora_and_vector_spaces.py`
:ref:`sphx_glr_auto_examples_core_run_corpora_and_vector_spaces.py`

.. raw:: html

Expand All @@ -75,10 +73,9 @@ Understanding this functionality is vital for using gensim effectively.

.. only:: html

.. figure:: /auto_examples/core/images/thumb/sphx_glr_run_topics_and_transformations_thumb.png
:alt: Topics and Transformations
.. figure:: /auto_examples/core/images/thumb/sphx_glr_run_topics_and_transformations_thumb.png

:ref:`sphx_glr_auto_examples_core_run_topics_and_transformations.py`
:ref:`sphx_glr_auto_examples_core_run_topics_and_transformations.py`

.. raw:: html

Expand All @@ -96,10 +93,9 @@ Understanding this functionality is vital for using gensim effectively.

.. only:: html

.. figure:: /auto_examples/core/images/thumb/sphx_glr_run_similarity_queries_thumb.png
:alt: Similarity Queries
.. figure:: /auto_examples/core/images/thumb/sphx_glr_run_similarity_queries_thumb.png

:ref:`sphx_glr_auto_examples_core_run_similarity_queries.py`
:ref:`sphx_glr_auto_examples_core_run_similarity_queries.py`

.. raw:: html

Expand All @@ -112,7 +108,7 @@ Understanding this functionality is vital for using gensim effectively.
/auto_examples/core/run_similarity_queries
.. raw:: html

<div class="sphx-glr-clear"></div>
<div style='clear:both'></div>



Expand All @@ -131,10 +127,9 @@ Learning-oriented lessons that introduce a particular gensim feature, e.g. a mod

.. only:: html

.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_word2vec_thumb.png
:alt: Word2Vec Model
.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_word2vec_thumb.png

:ref:`sphx_glr_auto_examples_tutorials_run_word2vec.py`
:ref:`sphx_glr_auto_examples_tutorials_run_word2vec.py`

.. raw:: html

Expand All @@ -152,10 +147,9 @@ Learning-oriented lessons that introduce a particular gensim feature, e.g. a mod

.. only:: html

.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_doc2vec_lee_thumb.png
:alt: Doc2Vec Model
.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_doc2vec_lee_thumb.png

:ref:`sphx_glr_auto_examples_tutorials_run_doc2vec_lee.py`
:ref:`sphx_glr_auto_examples_tutorials_run_doc2vec_lee.py`

.. raw:: html

Expand All @@ -173,10 +167,9 @@ Learning-oriented lessons that introduce a particular gensim feature, e.g. a mod

.. only:: html

.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_fasttext_thumb.png
:alt: FastText Model
.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_fasttext_thumb.png

:ref:`sphx_glr_auto_examples_tutorials_run_fasttext.py`
:ref:`sphx_glr_auto_examples_tutorials_run_fasttext.py`

.. raw:: html

Expand All @@ -194,10 +187,9 @@ Learning-oriented lessons that introduce a particular gensim feature, e.g. a mod

.. only:: html

.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_annoy_thumb.png
:alt: Fast Similarity Queries with Annoy and Word2Vec
.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_annoy_thumb.png

:ref:`sphx_glr_auto_examples_tutorials_run_annoy.py`
:ref:`sphx_glr_auto_examples_tutorials_run_annoy.py`

.. raw:: html

Expand All @@ -215,10 +207,9 @@ Learning-oriented lessons that introduce a particular gensim feature, e.g. a mod

.. only:: html

.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_lda_thumb.png
:alt: LDA Model
.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_lda_thumb.png

:ref:`sphx_glr_auto_examples_tutorials_run_lda.py`
:ref:`sphx_glr_auto_examples_tutorials_run_lda.py`

.. raw:: html

Expand All @@ -230,37 +221,15 @@ Learning-oriented lessons that introduce a particular gensim feature, e.g. a mod

/auto_examples/tutorials/run_lda

.. raw:: html

<div class="sphx-glr-thumbcontainer" tooltip="Introduces the concept of distance between document representations, and demonstrates its calcu...">

.. only:: html

.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_distance_metrics_thumb.png
:alt: Distance Metrics

:ref:`sphx_glr_auto_examples_tutorials_run_distance_metrics.py`

.. raw:: html

</div>


.. toctree::
:hidden:

/auto_examples/tutorials/run_distance_metrics

.. raw:: html

<div class="sphx-glr-thumbcontainer" tooltip="Demonstrates using Gensim&#x27;s implemenation of the WMD.">

.. only:: html

.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_wmd_thumb.png
:alt: Word Mover's Distance
.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_wmd_thumb.png

:ref:`sphx_glr_auto_examples_tutorials_run_wmd.py`
:ref:`sphx_glr_auto_examples_tutorials_run_wmd.py`

.. raw:: html

Expand All @@ -271,51 +240,9 @@ Learning-oriented lessons that introduce a particular gensim feature, e.g. a mod
:hidden:

/auto_examples/tutorials/run_wmd

.. raw:: html

<div class="sphx-glr-thumbcontainer" tooltip="Demonstrates summarizing text by extracting the most important sentences from it.">

.. only:: html

.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_summarization_thumb.png
:alt: Text Summarization

:ref:`sphx_glr_auto_examples_tutorials_run_summarization.py`

.. raw:: html

</div>


.. toctree::
:hidden:

/auto_examples/tutorials/run_summarization

.. raw:: html

<div class="sphx-glr-thumbcontainer" tooltip="This tutorial demonstrates using Pivoted Document Length Normalization to counter the effect of...">

.. only:: html

.. figure:: /auto_examples/tutorials/images/thumb/sphx_glr_run_pivoted_doc_norm_thumb.png
:alt: Pivoted Document Length Normalization

:ref:`sphx_glr_auto_examples_tutorials_run_pivoted_doc_norm.py`

.. raw:: html

</div>


.. toctree::
:hidden:

/auto_examples/tutorials/run_pivoted_doc_norm
.. raw:: html

<div class="sphx-glr-clear"></div>
<div style='clear:both'></div>



Expand All @@ -334,10 +261,9 @@ These **goal-oriented guides** demonstrate how to **solve a specific problem** u

.. only:: html

.. figure:: /auto_examples/howtos/images/thumb/sphx_glr_run_downloader_api_thumb.png
:alt: How to download pre-trained models and corpora
.. figure:: /auto_examples/howtos/images/thumb/sphx_glr_run_downloader_api_thumb.png

:ref:`sphx_glr_auto_examples_howtos_run_downloader_api.py`
:ref:`sphx_glr_auto_examples_howtos_run_downloader_api.py`

.. raw:: html

Expand All @@ -355,10 +281,9 @@ These **goal-oriented guides** demonstrate how to **solve a specific problem** u

.. only:: html

.. figure:: /auto_examples/howtos/images/thumb/sphx_glr_run_doc_thumb.png
:alt: How to Author Gensim Documentation
.. figure:: /auto_examples/howtos/images/thumb/sphx_glr_run_doc_thumb.png

:ref:`sphx_glr_auto_examples_howtos_run_doc.py`
:ref:`sphx_glr_auto_examples_howtos_run_doc.py`

.. raw:: html

Expand All @@ -376,10 +301,9 @@ These **goal-oriented guides** demonstrate how to **solve a specific problem** u

.. only:: html

.. figure:: /auto_examples/howtos/images/thumb/sphx_glr_run_doc2vec_imdb_thumb.png
:alt: How to reproduce the doc2vec 'Paragraph Vector' paper
.. figure:: /auto_examples/howtos/images/thumb/sphx_glr_run_doc2vec_imdb_thumb.png

:ref:`sphx_glr_auto_examples_howtos_run_doc2vec_imdb.py`
:ref:`sphx_glr_auto_examples_howtos_run_doc2vec_imdb.py`

.. raw:: html

Expand All @@ -397,10 +321,9 @@ These **goal-oriented guides** demonstrate how to **solve a specific problem** u

.. only:: html

.. figure:: /auto_examples/howtos/images/thumb/sphx_glr_run_compare_lda_thumb.png
:alt: How to Compare LDA Models
.. figure:: /auto_examples/howtos/images/thumb/sphx_glr_run_compare_lda_thumb.png

:ref:`sphx_glr_auto_examples_howtos_run_compare_lda.py`
:ref:`sphx_glr_auto_examples_howtos_run_compare_lda.py`

.. raw:: html

Expand All @@ -413,7 +336,7 @@ These **goal-oriented guides** demonstrate how to **solve a specific problem** u
/auto_examples/howtos/run_compare_lda
.. raw:: html

<div class="sphx-glr-clear"></div>
<div style='clear:both'></div>



Expand All @@ -440,7 +363,6 @@ Blog posts, tutorial videos, hackathons and other useful Gensim resources, from
- ? `Colouring words by topic in a document, print words in a
topics <https://github.com/RaRe-Technologies/gensim/blob/develop/docs/notebooks/topic_methods.ipynb>`__
- ? `Topic Coherence, a metric that correlates that human judgement on topic quality. <https://github.com/RaRe-Technologies/gensim/blob/develop/docs/notebooks/topic_coherence_tutorial.ipynb>`__
- ? `Compare topics and documents using Jaccard, Kullback-Leibler and Hellinger similarities <https://radimrehurek.com/gensim/gensim_numfocus/auto_examples/tutorials/run_distance_metrics.html>`__
- ? `America's Next Topic Model slides <https://speakerdeck.com/tmylk/americas-next-topic-model-at-pydata-berlin-august-2016?slide=7>`__
- How to choose your next topic model, presented at Pydata Berlin 10 August 2016 by Lev Konstantinovsky
- ? `Dynamic Topic Modeling and Dynamic Influence Model Tutorial <https://github.com/RaRe-Technologies/gensim/blob/develop/docs/notebooks/dtm_example.ipynb>`__
Expand All @@ -457,7 +379,7 @@ Blog posts, tutorial videos, hackathons and other useful Gensim resources, from

.. raw:: html

<div class="sphx-glr-clear"></div>
<div style='clear:both'></div>



Expand All @@ -467,15 +389,15 @@ Blog posts, tutorial videos, hackathons and other useful Gensim resources, from
:class: sphx-glr-footer-gallery
.. container:: sphx-glr-download sphx-glr-download-python
.. container:: sphx-glr-download
:download:`Download all examples in Python source code: auto_examples_python.zip <//Volumes/work/workspace/gensim/trunk/docs/src/auto_examples/auto_examples_python.zip>`
:download:`Download all examples in Python source code: auto_examples_python.zip <//home/misha/git/gensim/docs/src/auto_examples/auto_examples_python.zip>`
.. container:: sphx-glr-download sphx-glr-download-jupyter
.. container:: sphx-glr-download
:download:`Download all examples in Jupyter notebooks: auto_examples_jupyter.zip <//Volumes/work/workspace/gensim/trunk/docs/src/auto_examples/auto_examples_jupyter.zip>`
:download:`Download all examples in Jupyter notebooks: auto_examples_jupyter.zip <//home/misha/git/gensim/docs/src/auto_examples/auto_examples_jupyter.zip>`
.. only:: html
Expand Down
Loading

0 comments on commit 2dcaaf8

Please sign in to comment.