Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Accurate 'sentence' timings, is it now possible with new word-level timestamps update? #2812

Open
erturkdotgg opened this issue Feb 12, 2025 · 0 comments

Comments

@erturkdotgg
Copy link

There has been a long-standing timing issue in Whisper.cpp. In a normal video transcription for example(for regular subtitles), there is no gap between two lines. In the transcribed text, when the previous subtitle line ends, next line starts appearing on the screen before the speaker actually begins to speak the second line. However, this issue does not exist in other Whisper ports, e.g., WhisperX. Is it possible to solve this issue? Or perhaps with a custom alignment model?

Example:
Whisper.cpp Timing:
00:00:00 - 00:00:20: Hello everyone
(no gap, silence)
00:00:20 - 00:00:33: How are you?

Proper timing:
00:00:15 - 00:00:20: Hello everyone
(proper gap, silence)
00:00:27 - 00:00:33: How are you?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant