Release 2.4.2

What's new

Commits details since the last release

• [a0acfd7] by @thiswillbeyourgithub, 31 seconds ago:
  bump version 2.4.1 -> 2.4.2

bumpver.toml
setup.py
wdoc/wdoc.py

• [bf27dad] by @thiswillbeyourgithub, 6 hours ago:
  fix: variable name
  thanks to @NordMike in #9

Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [a356c8d] by @thiswillbeyourgithub, 6 hours ago:
  fix: chapters in yt dlp
  thanks to @NordMike in
  #10

Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

Release 2.4.1

What's new

Commits details since the last release

• [c1c11f8] by @thiswillbeyourgithub, 3 minutes ago:
  bump version 2.4.0 -> 2.4.1

bumpver.toml
setup.py
wdoc/wdoc.py

• [633c483] by @thiswillbeyourgithub, 48 seconds ago:
  update yt dlp to latest
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [d18d777] by @thiswillbeyourgithub, 3 minutes ago:
  fix: trust platform dir to create the appropriate paths for logging and cache
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/logger.py

• [d76b9fc] by @thiswillbeyourgithub, 20 minutes ago:
  use latest persistdict version
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [cbbb1bf] by @thiswillbeyourgithub, 29 minutes ago:
  fix: mkdir local filestore
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/customs/compressed_embeddings_cache.py

Release 2.4.0

What's new

Commits details since the last release

• [3a10bd6] by @thiswillbeyourgithub, 74 seconds ago:
  bump version 2.3.9 -> 2.4.0

bumpver.toml
setup.py
wdoc/wdoc.py

• [f035f22] by @thiswillbeyourgithub, 2 minutes ago:
  minor: better storing of metadata for yt
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [b5d1d6a] by @thiswillbeyourgithub, 6 minutes ago:
  new: include youtube chapters into the summary as metadata
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/wdoc.py

• [960fdce] by @thiswillbeyourgithub, 7 minutes ago:
  minor: include title and channel as metadata
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [391fab7] by @thiswillbeyourgithub, 7 minutes ago:
  feat and fix: proper youtube loader implementation using yt_dlp instead of yt_dl and with vtt subtitle parsing using timecode aware parsing
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [7678491] by @thiswillbeyourgithub, 68 minutes ago:
  minor: fix type
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [20e6b2b] by @thiswillbeyourgithub, 2 hours ago:
  bump version 2.3.8 -> 2.3.9

bumpver.toml
setup.py
wdoc/wdoc.py

• [bc1bd69] by @thiswillbeyourgithub, 2 hours ago:
  fix: python version
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [e111e7d] by @thiswillbeyourgithub, 2 hours ago:
  fix: nonsense to install yt dlp and parse youtube in peace
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py
wdoc/utils/import_tricks.py
wdoc/utils/loaders.py

• [f930af0] by @thiswillbeyourgithub, 2 hours ago:
  fix: always crash if only one document to load and fails (allows more helpful error messages)
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/batch_file_loader.py

• [c929a96] by @thiswillbeyourgithub, 2 hours ago:
  new: in case of error in the ntfy script, print the full stacktrace
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

scripts/NtfySummarizer/NtfySummarizer.py

Release 2.3.8

What's new

Commits details since the last release

• [dd577ea] by @thiswillbeyourgithub, 18 seconds ago:
  bump version 2.3.7 -> 2.3.8

bumpver.toml
setup.py
wdoc/wdoc.py

• [0ee9aed] by @thiswillbeyourgithub, 44 seconds ago:
  fix: using yt dlo is not yet functionnal
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

Release 2.3.7

What's new

Commits details since the last release

• [0997596] by @thiswillbeyourgithub, 12 seconds ago:
  bump version 2.3.6 -> 2.3.7

bumpver.toml
setup.py
wdoc/wdoc.py

• [8ff05ec] by @thiswillbeyourgithub, 12 minutes ago:
  fix: youtube parsing failed when using a youtu.[letter letter] so updated the inference rules
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/batch_file_loader.py

• [553f93c] by @thiswillbeyourgithub, 15 minutes ago:
  docs: mention pip11 instead of pip to insist on version
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

Release 2.3.6

What's new

Commits details since the last release

• [9633800] by @thiswillbeyourgithub, 72 seconds ago:
  bump version 2.3.5 -> 2.3.6

bumpver.toml
setup.py
wdoc/wdoc.py

• [a27298d] by @thiswillbeyourgithub, 77 seconds ago:
  fix: actually we need to force it to use 3.11
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

Release 2.3.5

What's new

Commits details since the last release

• [c276429] by @thiswillbeyourgithub, 2 minutes ago:
  bump version 2.3.4 -> 2.3.5

bumpver.toml
setup.py
wdoc/wdoc.py

• [25f2f21] by @thiswillbeyourgithub, 4 minutes ago:
  docs: mention the need for testers
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [5b11962] by @thiswillbeyourgithub, 17 minutes ago:
  bump version 2.3.3 -> 2.3.4

bumpver.toml
setup.py
wdoc/wdoc.py

• [398f6d2] by @thiswillbeyourgithub, 21 minutes ago:
  docs: clarify modelname matching
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/docs/USAGE.md

• [6805040] by @thiswillbeyourgithub, 23 minutes ago:
  fix: disable model name matching by default
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/docs/USAGE.md
wdoc/utils/env.py

• [a897a1d] by @thiswillbeyourgithub, 25 minutes ago:
  fix: python version needed is 3.11 not 3.10
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [7576836] by @thiswillbeyourgithub, 6 days ago:
  new: increase max token size per batch to 1000
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/docs/USAGE.md
wdoc/utils/env.py

• [60276eb] by @thiswillbeyourgithub, 6 days ago:
  bump version 2.3.2 -> 2.3.3

bumpver.toml
setup.py
wdoc/wdoc.py

• [0c1a59a] by @thiswillbeyourgithub, 6 days ago:
  fix: better solution for filetype string
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py
wdoc/wdoc.py

• [23f11e6] by @thiswillbeyourgithub, 6 days ago:
  fix: filetype string decorator
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [fca6668] by @thiswillbeyourgithub, 6 days ago:
  fix: cache can't work for filetype string
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [68b8b5d] by @thiswillbeyourgithub, 6 days ago:
  fix: parsing of arguments for string filetype
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/main.py
wdoc/utils/loaders.py

• [cbb2903] by @thiswillbeyourgithub, 6 days ago:
  fix: clarify doc by adding = in the kwargs
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [ea997f6] by @thiswillbeyourgithub, 6 days ago:
  fix: metadata for filetype text are optional
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [befbd5f] by @thiswillbeyourgithub, 6 days ago:
  minor
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/batch_file_loader.py

• [866314d] by @thiswillbeyourgithub, 6 days ago:
  fix: forgot to update an old error message
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/batch_file_loader.py

• [9127dc2] by @thiswillbeyourgithub, 6 days ago:
  fix: filetype string was renamed to another one at some point
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/batch_file_loader.py

• [8626f0c] by @thiswillbeyourgithub, 6 days ago:
  fix: typo
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/import_tricks.py

• [5765fac] by @thiswillbeyourgithub, 6 days ago:
  new: try using yt_dl_patched and fallbac k to yt_dl
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py
wdoc/utils/import_tricks.py
wdoc/utils/loaders.py

• [f53b188] by @thiswillbeyourgithub, 6 days ago:
  fix: outdated error message
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py

• [e7890a0] by @thiswillbeyourgithub, 10 days ago:
  new: don't delete the temporary file of online_media
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [934d789] by @thiswillbeyourgithub, 10 days ago:
  minor
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

Release 2.3.4

Full Changelog: 2.3.2...2.3.4

Release 2.3.2

• Added langfuse callback for observability.

Commits since last release

• [d5a36ae] by @thiswillbeyourgithub, 15 seconds ago:
  bump version 2.3.1 -> 2.3.2

bumpver.toml
setup.py
wdoc/wdoc.py

• [81d03e1] by @thiswillbeyourgithub, 22 minutes ago:
  fix: use both langfuse callbacks
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/llm.py
wdoc/utils/misc.py

• [68b8619] by @thiswillbeyourgithub, 36 minutes ago:
  fix: langfuse callback
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/llm.py
wdoc/utils/misc.py
wdoc/wdoc.py

• [eaa0ae3] by @thiswillbeyourgithub, 2 hours ago:
  enh: pass the version of wdoc to langfuse too
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/llm.py
wdoc/utils/misc.py
wdoc/wdoc.py

• [b72a101] by @thiswillbeyourgithub, 2 hours ago:
  enh: add a unique langfuse session_id by launch of wdoce
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/llm.py

• [6d62ed4] by @thiswillbeyourgithub, 2 hours ago:
  enh: use langchain's callback for langfuse instead of litellm's
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

README.md
wdoc/utils/llm.py
wdoc/wdoc.py

Release 2.3.1

Commits since last release

• [cd131b4] by @thiswillbeyourgithub, 12 minutes ago:
  fix: wrong attribute name used for PersistDict
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/customs/compressed_embeddings_cache.py

• [e8d8d55] by @thiswillbeyourgithub, 6 hours ago:
  docs: add FAQ question to rate limiting
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [1e1446e] by @thiswillbeyourgithub, 6 hours ago:
  enh: add yet another failsafe for private mode
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/wdoc.py

• [f48e879] by @thiswillbeyourgithub, 6 hours ago:
  docs: mention langfuse as a feature
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [5c8b6aa] by @thiswillbeyourgithub, 6 hours ago:
  fix: langfuse import
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/wdoc.py

• [89b9532] by @thiswillbeyourgithub, 8 hours ago:
  new: force using litellm backend if langfuse enabled and not private
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/llm.py
wdoc/wdoc.py

• [f9af1e6] by @thiswillbeyourgithub, 8 hours ago:
  enh: add check that private == is_private
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/llm.py

• [fd41ef8] by @thiswillbeyourgithub, 8 hours ago:
  new: enable langfuse callbacks if the right env variables are provided
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/wdoc.py

• [0e40624] by @thiswillbeyourgithub, 8 hours ago:
  enh: add a flags is_private
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/flags.py

• [2ae4451] by @thiswillbeyourgithub, 8 hours ago:
  feat: --private now disables langfuse callbacks just in case
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/docs/USAGE.md
wdoc/utils/llm.py
wdoc/wdoc.py

• [f25c007] by @thiswillbeyourgithub, 8 hours ago:
  new: setup metadata tags for traces to use with langfuse etc
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/llm.py
wdoc/wdoc.py

• [c8b3038] by @thiswillbeyourgithub, 26 hours ago:
  forgot to bump version of thefiche

scripts/TheFiche/TheFiche.py

• [d194c73] by @thiswillbeyourgithub, 29 hours ago:
  enh: better formulation of source_id

wdoc/utils/prompts.py
wdoc/utils/tasks/query.py

• [48968ea] by @thiswillbeyourgithub, 29 hours ago:
  enh: combiner prompt

wdoc/utils/prompts.py

• [9b5e706] by @thiswillbeyourgithub, 29 hours ago:
  fix: logseq lines starting with > must be escaped

scripts/TheFiche/TheFiche.py

• [1167bdb] by @thiswillbeyourgithub, 34 hours ago:
  fix: boundaries of sup_tags and sub_tags

scripts/TheFiche/TheFiche.py

• [f55219f] by @thiswillbeyourgithub, 8 hours ago:
  docs: mention that dollar_limit only applies to summaries and embeddings, not queries
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md
wdoc/docs/USAGE.md