Skip to content

Batch generate a list of keywords for each record in a batch

License

Notifications You must be signed in to change notification settings

zoenolan/batch-summary

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

36 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LLM-based Batch Summary Generator

Setup

  • Create an venv python3 -m venv .
  • Activate a venv source ./bin/activate
  • Deactivate a venv deactivate
  • Install the requirements pip install -r requirements.txt

Usage

  • Create an input directory
  • Add a file with title: "Artcile title"
  • Run python summary.py <input_dir> <output_dir> <instruction_dir> will take each subdirectory of input_dir and transform them based on each file in instructions. Saving a file for each prompt in a subdirectory of output_dir

limitations

  • Limited to 16K tokens

About

Batch generate a list of keywords for each record in a batch

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages