AI Plugin
The AI Plugin is at the forefront of transforming video content management and optimization. Utilizing artificial intelligence, it offers services such as automatic transcription, AI-driven meta-information recommendations, translation, and now AI Dubbing, significantly improving the SEO, accessibility, and global reach of your video content.
This feature automatically extracts MP3 audio from your video, transcribing the spoken content. This transcription enhances accessibility and improves meta-information recommendations, increasing your video's visibility online.
Receive detailed and tailored suggestions for meta-information elements like titles, descriptions, keywords, and summaries. These recommendations, powered by AI, are designed to optimize your content for search engines effectively.
By translating your automatically generated transcriptions into any language, this feature allows your content to reach a global audience, breaking down language barriers and engaging viewers worldwide.
With the AI Dubbing feature, you can automatically translate and dub your videos into different languages using artificial intelligence.
Important: The AI Dubbing feature is only available for videos encoded in HLS format using Encoder version 6.0 or later, and requires the VideoHLS Plugin. Be sure to update your encoder and enable the VideoHLS plugin to use this feature. For more details, refer to the VideoHLS Plugin Wiki.
Here are some examples of how the AI Dubbing feature works:
Introducing the Shorts tab, a feature that suggests optimal cuts for creating video shorts. This tool is invaluable for highlighting engaging segments, ensuring your content captures attention on various platforms. Transcription is a prerequisite for suggesting cuts. Once generated, you can:
- Save the cut as a standalone video in your video library.
- Use the cut name as a bookmark for easy navigation, requiring the installation of the Bookmark Plugin.
The AI Plugin offers numerous advantages, including:
- Improved SEO: Optimized meta-information leads to higher search rankings.
- Increased Accessibility: Transcriptions, translations, and dubbing make your videos more accessible to diverse audiences.
- Efficiency: Automatic processes save time and reduce the need for manual transcription, dubbing, and SEO efforts.
- Market Expansion: Translation and dubbing capabilities allow you to reach international audiences, broadening your market reach.
After uploading, the plugin extracts MP3 audio for transcription and saves it as subtitles in VTT format, featuring:
- One-Time Transcription: Each video is transcribed once for efficiency.
- Quality-Dependent Accuracy: High-quality audio results in more accurate transcriptions.
- AI Dubbing: Automatically translates and dubs your video into multiple languages (HLS format required, VideoHLS Plugin necessary).
Ensure the SubtitleSwitcher Plugin is installed for subtitle integration.
- Cost of AI Requests: Each AI request, including transcription, translation, and dubbing, incurs a cost, which can be determined by the site administrator. Users will be charged for these requests using the funds available in their site wallets.
- Monetization Opportunity: Site administrators can set higher prices for AI requests, thereby generating revenue from users who utilize these AI services.
-
Integration with Payment Gateways: Site administrators can integrate with PayPal or Stripe to enable users to fund their wallets. These funds can then be used to pay for AI requests.
- For wallet configuration, please visit YPTWallet Usage.
- For PayPal configuration, refer to the PayPalYPT Plugin.
- For Stripe configuration, consult the StripeYPT Plugin.
To enable regular users to utilize the AI, you must grant permission within a user group:
- Edit or create a user group and select the option "Can use AI Suggestions."
- Once this option is enabled, all users within that user group will have access to the AI functionality.
For more details about user groups, please refer to the user groups documentation.
Additionally, you can utilize the PayPerView (PPV) Plugin (documentation) or the Subscription Plugin (documentation) to automatically assign users to a user group upon payment.
- Register for a marketplace account at YouPHPTube Marketplace.
- Add funds to your wallet as detailed here. CDN and AI credits are unified.
- Obtain your Access Token from the marketplace's AI section (Image 3).
- Input the Access Token into the AI plugin parameters (Image 4).
- In the video manager, select the "AI-Powered" button for your video.
- In the basic tab, generate recommendations for Titles, Descriptions, Meta Descriptions, Keywords, Summary, and Rating.
- Use the Transcription tab to produce AI transcriptions. This is recommended before generating basic tab recommendations.
- After transcription, generate translations or dubs in the Transcription tab by selecting a language and clicking on "Generate Translations" or "Generate Dubbing."
For detailed pricing, visit AI Services Pricing.
The AI Plugin is indispensable for enhancing the visibility, accessibility, and global reach of video content. Its automated features simplify video transcription, SEO optimization, translation, and now AI-powered dubbing, making it a valuable tool in today's digital content landscape.
Reminder: The AI Dubbing feature is only available for videos encoded in HLS format using Encoder version 6.0 or later, and requires the VideoHLS Plugin. For more details, refer to the VideoHLS Plugin AI Dubbing Integration.