Update dependency spacy to v3 #70
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![renovate[bot]](https://avatars.githubusercontent.com/in/2740?s=60&v=4){kind=small}
renovate
bot
force-pushed
the
renovate/spacy-3.x
branch
from
2d96b5c
to
e140fdb
Compare
Codecov Report
❗ Your organization needs to install the Codecov GitHub app to enable full functionality. @@ Coverage Diff @@
## master #70 +/- ##
======================================
Coverage 0.38% 0.38%
======================================
Files 16 16
Lines 1035 1035
======================================
Hits 4 4
Misses 1031 1031 📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more |
renovate
bot
force-pushed
the
renovate/spacy-3.x
branch
from
e140fdb
to
0a6c990
Compare
renovate
bot
force-pushed
the
renovate/spacy-3.x
branch
from
0a6c990
to
5a805ac
Compare
renovate
bot
force-pushed
the
renovate/spacy-3.x
branch
from
5a805ac
to
4ded11e
Compare
renovate
bot
force-pushed
the
renovate/spacy-3.x
branch
from
4ded11e
to
8cda527
Compare
renovate
bot
force-pushed
the
renovate/spacy-3.x
branch
from
8cda527
to
0e515c1
Compare
renovate
bot
force-pushed
the
renovate/spacy-3.x
branch
2 times, most recently
from
0a7a468
to
0e9cea1
Compare
renovate
bot
force-pushed
the
renovate/spacy-3.x
branch
from
0e9cea1
to
43245ca
Compare
renovate
bot
force-pushed
the
renovate/spacy-3.x
branch
from
43245ca
to
0452a8d
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
==2.3.9->==3.7.2Release Notes
explosion/spaCy (spacy)
v3.7.2: : Fixes for APIs and requirementsCompare Source
✨ New features and improvements
__all__fields (#13063).🔴 Bug fixes
spacy.cli.projectAPI.Anycomparisons forTokenandSpan.📖 Documentation and examples
spacy-llmincluding Azure OpenAI, PaLM, and Mistral support.👥 Contributors
@adrianeboyd, @honnibal, @ines, @rmitsch, @svlandeg
v3.7.1: : Bug fix for spacy.cli module loadingCompare Source
🔴 Bug fixes
spacy.infoto fix availability ofspacy.clifollowingimport spacy(#13040).👥 Contributors
@adrianeboyd, @honnibal, @ines, @svlandeg
v3.7.0: : Trained pipelines using Curated Transformers and support for Python 3.12Compare Source
This release drops support for Python 3.6 and adds support for Python 3.12.
✨ New features and improvements
spacy projectcommands should run as before, just now they're using Weasel under the hood.transformersextra tospacy-transformersv1.3 (#13025).--spans-keyoption for CLI evaluation withspacy benchmark accuracy(#12981).spacy.info(#12962).spacy.training.example(#12801).Language.replace_listeners: Pass the replaced listener and thetok2vecpipe to the callback in order to supportspacy-curated-transformers(#12785).tqdmwithdisable=Noneto disable output in non-interactive environments (#12979).📦 Trained pipelines updates
The transformer-based
trfpipelines have been updated to use our new Curated Transformers library through the Thinc model wrappers and pipeline component from spaCy Curated Transformers.rayextra.spacy projecthas a few backwards incompatibilities due to the transition to the standalone library Weasel, which is not as tightly coupled to spaCy. Weasel produces warnings when it detects older spaCy-specific settings in your environment or project config.spacy_versionconfiguration key has been dropped.check_requirementsconfiguration key has been dropped due to the deprecation ofpkg_resources.SPACY_CONFIG_OVERRIDESenvironment variable is no longer checked. You can set configuration overrides usingWEASEL_CONFIG_OVERRIDES.SPACY_PROJECT_USE_GIT_VERSIONenvironment variable has been dropped.📖 Documentation and examples
👥 Contributors
@adrianeboyd, @bdura, @connorbrinton, @danieldk, @davidberenstein1957, @denizcodeyaa, @eltociear, @evornov, @honnibal, @ines, @jmyerston, @koaning, @magdaaniol, @pdhall99, @ringohoffman, @rmitsch, @senisioi, @shadeMe, @svlandeg, @vinbo8, @wjbmattingly
v3.6.1: : Support for Pydantic v2, find-function CLI and moreCompare Source
✨ New features and improvements
find-functionCLI for finding locations of registered functions (#12757).spacy[cuda12x]forcupy-cuda12x(#12890).init configandtrainCLI (#12173).distutilstosetuptools/sysconfig(#12853).🔴 Bug fixes
<br>tags in displaCy.📖 Documentation and examples
👥 Contributors
@adrianeboyd, @afriedman412, @arplusman, @bdura, @connorbrinton, @honnibal, @ines, @it176131, @pmbaumgartner, @rmitsch, @shadeMe, @svlandeg, @thomashacker, @victorialslocum, @x-tabdeveloping
v3.6.0: : New span finder component and pipelines for SlovenianCompare Source
✨ New features and improvements
span_finderpipeline component to identify overlapping, unlabeled spans (#12507).spacy evaluate --per-component,Language.evaluate(per_component=True)andScorer.score(per_component=True)(#12540).spancat_singlelabelinspacy debug dataCLI (#12749).PhraseMatcherandSpanGroup(#12642, #12714).🔴 Bug fixes
SpanGroupspans come from the current doc.📦 Trained pipelines updates
We have added new pipelines for Slovenian that use the trainable lemmatizer and floret vectors.
sl_core_news_smsl_core_news_mdsl_core_news_lgsl_core_news_trfThe English pipelines have been updated to improve handling of contractions with various apostrophes and to lemmatize "get" as a passive auxiliary.
The Danish pipeline
da_core_news_trfhas been updated to usevesteinn/DanskBERTwith performance improvements across the board.SpanGroupspans are now required to be from the same doc. When initializing aSpanGroup, there is a new check to verify that all added spans refer to the current doc. Without this check, it was possible to run into string store or other errors.📖 Documentation and examples
👥 Contributors
@adrianeboyd, @bdura, @danieldk, @davidberenstein1957, @diyclassics, @essenmitsosse, @honnibal, @ines, @isabelizimm, @jmyerston, @kadarakos, @KennethEnevoldsen, @khursani8, @ljvmiranda921, @rmitsch, @shadeMe, @svlandeg, @tomaarsen, @victorialslocum, @vin-ivar, @ZiadAmerr
v3.5.4: : Bug fixes for overrides with registered functions and sourced components with listenersCompare Source
✨ New features and improvements
🔴 Bug fixes
👥 Contributors
@adrianeboyd, @bdura, @honnibal, @ines, @svlandeg
v3.5.3: : Speed improvements, bug fixes and moreCompare Source
✨ New features and improvements
spancat, in particular on GPU (~10x-30x faster) (#12577).>+,>-,>++,>--) for the dependency matcher (#12528).doc.spansfor displaCy output inspacy benchmark accuracy/spacy evaluate(#12575).MorphAnalysis.get(default=)argument for user-provided default values similar todict(#12545).🔴 Bug fixes
#eggfrom download URLs due to future deprecation inpip.📖 Documentation and examples
👥 Contributors
@adrianeboyd, @andyjessen, @bdura, @davidberenstein1957, @diyclassics, @honnibal, @ines, @kadarakos, @KennethEnevoldsen, @ljvmiranda921, @moxley01, @royashcenazi, @svlandeg, @tanloong, @victorialslocum
v3.5.2: : Pretraining improvements, bug fixes for spans and spancat and moreCompare Source
✨ New features and improvements
spacy pretrain(#12435).model-last.binforspacy pretrain(#12459).Spaninput fordisplacy.parse_deps(#12477).cupyinstall extras.🔴 Bug fixes
Span.sents.spancat_singlelabel.Span.sentswhen the final sentence is the last token in aDoc.Span.kb_idandSpan.idstrings inDocandDocBinserialization.📖 Documentation and examples
👥 Contributors
@adrianeboyd, @BLKSerene, @honnibal, @ines, @kadarakos, @prajakta-1527, @rmitsch, @shadeMe, @sloev, @svlandeg, @thomashacker, @willfrey
v3.5.1: : spancat for multi-class labeling, fixes for textcat+transformers and moreCompare Source
💥 We'd love to hear more about your experience with spaCy! Take our survey here.
✨ New features and improvements
spancat_singlelabelpipeline component for multi-class and non-overlapping span classification. Thespancat_singlelabelcomponent predicts at most one label for each suggested span and adds a new settingallow_overlapto restrict the output to non-overlapping spans (#11365).transformer+ CNN for efficient GPUtextcatwithspacy init config(#11900).spacy debug data(#11419).>+,>-,<+,<-) (#12334).spacy.PlainTextCorpusReader.v1for plain text input (#12122).alignment_modeandspan_idtoSpan.char_span()(#12145, #12196).🔴 Bug fixes
top_k>1in trainable lemmatizer.test_cli_find_threshold()test more robust.registry.find().Matcherpatterns with extension attributes.grcto languages with lexeme norms inspacy-lookups-data.KnowledgeBaseinstances configurable.auto_select_port.InMemoryLookupKB.is_empty.Lexeme.orthandLexeme.lower.PretrainVectors.pkg_resources.📖 Documentation and examples
👥 Contributors
@adrianeboyd, @andyjessen, @danieldk, @essenmitsosse, @honnibal, @ines, @itssimon, @kadarakos, @kwhumphreys, @ljvmiranda921, @pmbaumgartner, @polm, @richardpaulhudson, @rmitsch, @shadeMe, @svlandeg, @tanloong, @thomashacker, @victorialslocum
v3.5.0: : New CLI commands, language updates, bug fixes and much moreCompare Source
✨ New features and improvements
applyCLI command to annotate new documents with a trained pipeline (#11376).benchmarkCLI command to benchmark pipelines. The newbenchmark speedsubcommand measures the speed of a pipeline, thebenchmark accuracysubcommand is a new alias forevaluate(#11902).find-thresholdCLI command to identify an optimal threshold for classification models (#11280).FUZZYMatcheroperator for fuzzy matches based on Levenshtein edit distance. In addition, theFUZZYandREGEXoperators are now supported in combination withIN/NOT_IN. (#11359).typerv0.7.x (#11720),mypy0.990 (#11801) andtyping_extensionsv4.4.x (#12036).spacy.ConsoleLogger.v3with expanded progress tracking (#11972).textcatwithspacy.textcat_scorer.v2(#11696 and #11971) andspacy.textcat_multilabel_scorer.v2(#11820).InMemoryLookupKB(#11268).before_updatecallback that is invoked at the start of each training step (#11739).SpanGroup(#11380).displacy.servewhen the default port is in use (#11948).tok2vecversion (#11618).🔴 Bug fixes
tok2vecortransformerlayer.textcat.Vocab.to_diskrespects the exclude setting forlookupsandvectors.SpanGroupandSpanobjects.The following changes may require you to update code that is using the relevant functionality:
textcatortextcat_multilabelmodel - ensure that values are 0.0 or 1.0 as explained in the docs.KnowledgeBaseis now an abstract class, you should call the constructor of the newInMemoryLookupKBinstead when you want to use spaCy's default KB implementation. If you've written a custom KB that inherits fromKnowledgeBase, you'll need to implement its abstract methods, or alternatively inherit fromInMemoryLookupKBinstead.The following changes may influence the output of your language pipeline or trained models:
pymorphy3(#11345, #11811).tok2vecdefaults in all components (#11618).textcatandtextcat_multilabelcomponents (#11698).textcatandtextcat_multilabelto fix a bug related tothresholdfortextcatand to make it possible to score multipletextcat/textcat_multilabelcomponents in a single pipeline with custom scorers. If no custom scorers are used, thecat_p/r/fscores will now only reflect the final component's labels and performance (#11696, #11820).token_accscore to report the intended measure (# correct tokens / # predicted tokens, the same as in spaCy v2). Thetoken_accscores for v3.5 will be lower for the same performance because they were incorrectly inflated in v3.0-v3.4. Thetoken_p/r/fscores should remain unchanged (#12073).The following functionality will be changed in the near future - so it's best to start updating your scripts now to make them more generic:
masterbranch tomain.📦 Trained pipelines updates
IS_SPACEas atok2vecfeature fortaggerandmorphologizercomponents to improve tagging of non-whitespace vs. whitespace tokens.spacy-transformersv1.2, which uses the exact alignment fromtokenizersfor fast tokenizers instead of the heuristic alignment fromspacy-alignments. For all trained pipelines exceptja_core_news_trf, the alignments between spaCy tokens and transformer tokens may be slightly different. More details about thespacy-transformerschanges in the v1.2.0 release notes.📖 Documentation and examples
biluo_to_iobandiob_to_biluofunctions.👥 Contributors
@aaronzipp, @adrianeboyd, @albertvillanova, @ArchiDevil, @cfuerbachersparks, @damian-romero, @danieldk, @darigovresearch, @DSLituiev, @essenmitsosse, @gremur, @honnibal, @ines, @jmyerston, @JosPolfliet, @kadarakos, @koaning, @kwhumphreys, @ljvmiranda921, @MarcoGorelli, @orglce, @pmbaumgartner, @polm, @richardpaulhudson, @rmitsch, @ryndaniels, @shadeMe, @svlandeg, @thomashacker, @TrellixVulnTeam, @wannaphong, @zhiiw, @zrpxx
v3.4.4: : Bug fixes and future NumPy compatibilityCompare Source
This bug fix release is primarily to avoid deprecation warnings and future incompatibility with NumPy v1.24+.
🔴 Bug fixes
spancatfor docs with zero suggestions.smart_openrequirement and update deprecated options.spacy init config --gpufor environments withoutspacy-transformers.EditTreeLemmatizer.👥 Contributors
@adrianeboyd, @danieldk, @honnibal, @ines, @polm, @svlandeg
v3.4.3: : Extended Typer support and bug fixesCompare Source
✨ New features and improvements
🔴 Bug fixes
EntityLinker.Doc.to_json()for attributes set by getters.pipeline_package.load().spacy projectrequirements checks for unsupported specifiers and requirements lines.spacy.load(disable=)that could enable currently disabled components.👥 Contributors
@aaronzipp, @adrianeboyd, @honnibal, @ines, @polm, @rmitsch, @ryndaniels, @svlandeg, @thomashacker
v3.4.2: : Latin and Luganda support, Python 3.11 wheels and moreCompare Source
✨ New features and improvements
spacy.ConsoleLogger.v2optionally saves training logs to JSONL (#11214).DependencyMatcherto include matching parents or children to the left or the right of the node (#10371).cuda11xandcuda-autodetect(usingcupy-wheel) (#11279).Doc.to_json()andDoc.from_json()(#11125).enableanddisableoptions forspacy.load()more consistent (#11459).disable/enclude/excludeforspacy.load()(#11406).--urlflag forspacy infoto print the direct download URL for a pipeline (#11175).spacy projectCLI (#11226).spacy debug dataCLI for spancat data (#11504).spacy_versioninspacy packagemetadata (#11552).spacy project assets(#11458).spacy pretraincommand (#11210).natto-pyfor thekoextra (#11222).📦 Trained pipelines updates
This release includes updated English pipelines for spaCy v3.4 with improved NER performance. The updates in
en_core_web_*v3.4.1 address issues related to training from data with partial named entity annotation, which led to lower NER recall in English pipeline versions v3.0.0–v3.4.0. In particular, entities that appear in the sections of the OntoNotes training data without NER annotation were not predicted consistently by the earlier pipeline versions, such as names and places that are frequent in the Biblical sections, e.g., "David" and "Egypt" (see #7493).Use
spacy downloadto update your English pipelines to the newest version. If you'd prefer to keep using an earlier version, you can specify the version directly with e.g.spacy download -d en_core_web_sm-3.4.0. You can check that you are using the new version (v3.4.1) withspacy validate:🔴 Bug fixes
SetPredicate.Doc.__init__.pymorphy2_lookuplemmatizer mode for Russian and Ukrainian.Doctype, an error will now be raised (#11424).📖 Documentation and examples
spacy.models_and_pipes_with_nvtx_range.v1callback.ExampleAPI documentation.displacydocs.spacy project dvc.spacy-wordnet.initialize()function for pipeline components.👥 Contributors
@adrianeboyd, @bdura, @danieldk, @diyclassics, @DSLituiev, @GabrielePicco, @honnibal, @ines, @JulesBelveze, @kadarakos, @ljvmiranda921, @ninjalu, @pmbaumgartner, @polm, @radandreicristian, @richardpaulhudson, @rmitsch, @shadeMe, @stefawolf, @svlandeg, @thomashacker, @tobiusaolo, @tzussman , @yasufumy
v3.4.1: : Fix compatibility with CuPy v9.xCompare Source
🔴 Bug fixes
📖 Documentation and examples
👥 Contributors
@adrianeboyd, @danieldk, @honnibal, @ines, @lll-lll-lll-lll, @Lucaterre, @MaartenGr, @mr-bjerre, @polm, @radenkovic
v3.4.0: : Updated types, speed improvements and pipelines for CroatianCompare Source
✨ New features and improvements
{n,m}operator forMatcherpatterns (#10981).saxpy/sgemmprovided by theOpsimplementation in order to use Accelerate throughthinc-apple-ops(#10773).Example.get_aligned_parseandExample.get_aligned(#10952).StringStorelookups (#10938).spacy project cloneto try bothmainandmasterbranches by default (#10843).init_config_cli(#10788).debug data(#10960).TrainablePipecomponents (#10965).SPACY_NUM_BUILD_JOBSto specify the number of build jobs to run in parallel withpip(#11073).📦 Trained pipelines updates
We have added new pipelines for Croatian that use the trainable lemmatizer and floret vectors.
hr_core_news_smhr_core_news_mdhr_core_news_lg🙏 Special thanks to @gtoffoli for help with the new pipelines!
The English pipelines have new word vectors:
en_core_news_mden_core_news_mden_core_news_lgen_core_news_lgAll CNN pipelines have been extended to add whitespace augmentation.
🔴 Bug fixes
Doc.has_vector, distinguish 0-vectors and missing vectors insimilaritywarnings.get_array_moduleintextcat.🚀 Notes about upgrading from v3.3
Doc.has_vectornow matchesToken.has_vectorandSpan.has_vector: it returnsTrueif at least one token in the doc has a vector rather than checking only whether the vocab contains vectors.📖 Documentation and examples
👥 Contributors
@adrianeboyd, @danieldk, @ericholscher, @gorarakelyan, @honnibal, @ines, @jademlc, @kadarakos, @KennethEnevoldsen, @koaning, @Lucaterre, @maxTarlov, @philipvollet, @pmbaumgartner, @polm, @richardpaulhudson, @rmitsch, @sadovnychyi, @shadeMe, @shen-qin, @single-fingal, @svlandeg, @victorialslocum, @Zackere
v3.3.3: : Bug fixes for Pydantic and pipCompare Source
This bug fix release is primarily to address Pydantic incompatibility with
typing_extensions>=4.6.0.✨ New features and improvements
spancat, in particular on GPU (~10x-30x faster) (#12577).🔴 Bug fixes
typing_extensionsrequirement due to Pydantic incompatibility withtyping_extensions>=4.6.0.#eggfrom download URLs due to future deprecation inpip.👥 Contributors
@adrianeboyd, @honnibal, @ines, @kadarakos, @svlandeg
v3.3.2: : Bug fixes and future NumPy compatibilityCompare Source
This bug fix release is primarily to avoid deprecation warnings and future incompatibility with NumPy v1.24+.
🔴 Bug fixes
precomputable_biaffineby avoiding concatenation.Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR has been generated by Mend Renovate. View repository job log here.