Skip to content

SynthWomb/Synthia: Python project using Hugging Face Transformers for GPT-2 NLP, TensorFlow for model management, and SDXL-Turbo for image processing. DeepFace predicts gender. Simple CLI offers Text-to-image and Image-to-image operations, with a built-in GAN for AI art.

License

Notifications You must be signed in to change notification settings

CursedPrograms/SynthWomb

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

58 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Python HTML5 CSS3
TensorFlow Flask OpenCV


The SynthWomb, or Synthia, seamlessly integrates multiple technologies in a unified project. Powered by the Hugging Face Transformers library, it engages with a pre-trained GPT-2 model. TensorFlow ensures efficient model management, while AutoTokenizer streamlines tokenization for optimal performance. Users interactively input prompts, prompting the GPT-2 model to generate text responses. To refine the user experience, extraneous warning messages tied to the transformers library are intelligently silenced.

Expanding its capabilities, the project integrates the DeepFace library with OpenCV to extract gender information from input data, presenting gender predictions visually. The SDXL-Turbo model is harnessed for diverse image processing tasks. The project's command-line interface facilitates both Text-to-image and Image-to-image operations, empowering users to seamlessly select operations, input prompts, and witness dynamic script execution.

This versatile Python codebase introduces a Generative Adversarial Network (GAN) tailored for training and generating AI art. This addition brings an artistic dimension to the project's repertoire, enhancing its overall capabilities.


How to Run:

pip install -r requirements.txt
pip install torch torchvision torchaudio
python main.py
python app.py

To make the setup script executable, run the following command in your terminal:

chmod +x setup.sh


Scripts:

  • main.py: The selection menu for SynthWomb
  • app.py: Run SynthiaGPT as a web-server

/scripts

  • video_encoder.py: Encode a video using SynthWombAI
  • install_dependencies.py: Install dependencies
  • image_generator.py: Generate AI art
  • image_generator.py: Display webcam

/scripts/ai_trainer

  • trainer.py: Runs SynthWombAI trainer
  • modelout.py: Output images from trained models with SynthWomb
  • image-processor.py: Prepare images for SynthWombAI
  • preprocessor_data.py: Dependency for SynthWombAI /trainer

/scripts/gender_age_prediction

  • gender_predictor.py: Predicts gender from an input
  • gender_age_predictor.py: Predicts gender and age from an input
  • gender_age_predictor_webcam.py: Predicts gender and age from a webcam feed

/scripts/gpt

  • transformer.py: Run SynthiaGPT
  • transformer_t2s.py: Run SynthiaGPT with text-to-speech functionality
  • transformer_s2t2s.py: Run SynthiaGPT with speech-to-text-to-speech functionality
  • transformer_webcam.py: Run SynthiaGPT with webcam functionality

/scripts/gpt/system

  • generate_text.py: The GPT text generator
  • clean_text.py: Clean text from recorded voice audio
  • stt.py: Speech-to-text
  • tts.py: Text-to-speech
  • capture_photo.py: Capture photo with webcam
  • play_audio.py: Play generated audio


Requirements:


transformers==4.37.1
torch==1.10.0
torchvision==0.16.1
torchaudio==2.1.1
SpeechRecognition==3.10.1
tensorflow==2.14.0
numpy== 1.26.2
matplotlib==3.8.2
Pillow==10.1.0
opencv-python==4.8.1.78
deepface==0.0.81
flask==3.0.0
gtts==2.5.0
pyaudio==0.2.14 
pydub==0.25.1
beautifulsoup4==4.10.0
SpeechRecognition==3.10.1
pygame==2.5.2



About

SynthWomb/Synthia: Python project using Hugging Face Transformers for GPT-2 NLP, TensorFlow for model management, and SDXL-Turbo for image processing. DeepFace predicts gender. Simple CLI offers Text-to-image and Image-to-image operations, with a built-in GAN for AI art.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published