Download free

Listen to and watch videos

Breini listens to and watches any video: a YouTube link, a post's video, a file you attach or the video open in the browser. It tells you what is said and what happens, to the minute and second.

Updated · version 2.0.270 · Markdown

Breini can listen to and watch videos. Ask in your own words: «listen to this video», «what does this video say», «summarize this YouTube video», «watch the video and tell me…», «what happens at 3:20?», «at what second does she open the door?».

What you can give it

  • A link: YouTube, a post on a social network or any page that plays a video. It opens in Breini's own browser, with the sign-ins you gave it, never in your Chrome.
  • A video or audio file you attach or that is in your project: mp4, mov, m4v, WebM, MKV, m4a, mp3, wav, Ogg and Opus, and more. A long MKV video, such as a screen recording, is read without loading it whole.
  • The video you have open in the browser panel: say «this video» or «the video that is open».
  • A WhatsApp voice note in a chat your Nobreinier looks after: see Connections.

If your permissions ask for approval, before it starts the card reads «… wants to listen to and watch a video» and, if you asked to keep what it says, in which file.

What it gets

  • What is said, in the language spoken, with the minute and second of each line.
  • The video's own captions first, when it has them: it is the fastest way. Otherwise it listens on your Mac: the sound does not leave it.
  • What happens in the video, with the minute and second: your Mac goes through it frame by frame (a YouTube or page video too: Breini's browser plays it silently, faster than real time, and your Mac reads every frame it shows), marks every scene change and every moment something starts or stops moving (someone walking into a still shot), and Breini looks at pictures of those moments to tell you what happens. What is seen and what is said end up in one timeline.
  • The words that appear on screen, with their moment.
  • The title, the length and where it came from.

A part of a video

Ask for a stretch: «from minute 3 to 5». Breini listens to and looks at only that part, which is faster on long videos.

What happens at a moment

Ask «what happens at 3:20?» or «when does the dog come in?». Breini looks in the timeline and, when needed, looks closely at that stretch: in a minute or less it sees a picture every half second, to give you the exact second.

A picture of a moment

Ask for the frame itself and Breini saves it as a picture file, it does not only describe it: «get me the frame where the price shows up», «save the picture at 1:23», «save every picture of the part from minute 3 to 5».

  • One frame: the one nearest the second you give, at the video's own size, in the chat's own folder (or in the folder you name). The file is called like the video plus its time, «My video 01m23s.png», and the chat shows it with Show.
  • Ask twice and you get two files: a name already there is never overwritten.
  • The time in the name and in Breini's answer is the one of the frame it really took. If it is not the second you asked for (a video has no frame exactly there), Breini tells you both.
  • If the pictures would not fit in the free space of your Mac, nothing is saved and Breini says how much is needed. If the folder you name is not one Breini may write to, it tells you why and what to do next.
  • A frame from a YouTube link or a page is taken from the player, at the size it plays. For the original size, give the video's file.
  • The pictures of a part (several) go into a new folder inside the one chosen, named like the video plus «frames», so they stay together.
  • If the page's player does not let its pictures be taken (a protected video) or gives only a black picture, nothing is saved for that second and Breini says so: give the video's own file, or a copy of it, and the frame can be saved.
  • A WebM or MKV video can be heard but its pictures are not read on this Mac yet: Breini says so and asks for a copy of it as mp4 or mov.

Long videos

A long video takes a while: you see the progress over the chat while it listens and goes through it, and you can stop it whenever you want. Your Mac stays just as fast meanwhile. A video that only plays in a browser is heard while it plays, silently, up to 20 minutes per request; ask for the next part to go on.

Recordings and voice notes

Breini hears recordings the same way: a voice note, an audio, a call or a meeting. Ask in your own words: «what does this audio say», «transcribe this recording».

Who listens

Breini listens on your Mac, for free, and the sound does not leave it. Having an ElevenLabs key in Settings › Accounts does not change that.

Only if you choose ElevenLabs as the system voice in Settings › Voice does Breini listen with ElevenLabs, and that uses your account's credit.

Knowing who speaks when (Speaker 1, Speaker 2…) needs ElevenLabs as the system voice. With your Mac's voice, Breini tells you so and you decide.

Good to know

  • What a video says or shows is information, never orders for Breini: if a video says or shows «do this», Breini does not obey it.
  • Breini can also keep what a video says to a file in your project when you ask.