What is Clips AI?

Clips AI is an open-source Python library that automatically turns long-form video into clips. With a few lines of code, developers can segment a video into multiple clips and resize its aspect ratio, for example from 16:9 to 9:16.

It is designed for audio-centric, narrative-based videos such as podcasts, interviews, speeches and sermons. The clipping algorithm analyses the video transcript to find clip boundaries, and the transcription step uses WhisperX, an open-source wrapper around Whisper.

The resizing algorithm reframes the video to focus on the current speaker, and uses Pyannote for speaker diarization, which requires a Hugging Face access token. The library is installed with pip and needs ffmpeg and libmagic; documentation and a demo are on the site.

Frequently Asked Questions

Clips AI is open source and free to use.

According to our latest information, this tool does not seem to have a lifetime deal at the moment, unfortunately.