Screen Recording and Voice Notes

Screen recordings can be attached to Agivar messages. They are most commonly used in Teach Mode as demonstrations of how to complete a task, but you can also send a recording in Task Mode to give the AI a process to reference.

Here, "voice recording" mainly refers to voice annotations: as you speak during a screen recording, Agivar converts your speech into timestamped text notes in real time and sends them with the recording for the AI to understand.

What problem does teaching by recording solve?

Teaching a GUI workflow with text usually gets stuck in two places:

1. It is hard to be precise — "click that Submit button" — which one, what color, and in which part of the page? Text easily leaves ambiguity.
2. It is hard to be complete — small steps the demonstrator takes for granted, such as clicking a field to activate it or scrolling to the bottom of the page, are often omitted.

A recording solves both problems:

• A precise action sequence — mouse clicks, drags, scrolling, keyboard input, and shortcuts are captured together with their timeline, so no action is missed.
• Matching visuals — after recording, the system automatically extracts keyframes. It keeps the frame immediately before each action that changes the screen, such as a click, double-click, drag, or pressing Enter to submit, plus periodic samples during quiet periods. The AI can see both what the interface looked like before the action and what changed afterward.
• Your additional explanation — during recording, you can add text annotations (Alt+I on Windows; Cmd+Shift+I on macOS) or click the green waveform button to add voice annotations. These explanations are inserted into the recording timeline.
• Reusable knowledge — the recording is processed into a structured operation description (Overview / Initial state / Step-by-step operations / Stage results) and stored in the memory base. The entry also records the related demonstration video ID and key clips, so Task Mode can later ask about details from the recording.

Start recording

1. If you want to teach Agivar a workflow, start a new conversation and select Teach Mode first.
2. Click Record in the input bar.
3. Choose Start screen recording from the menu, or open Select recording file and click Start recording in the selector.
4. On first use, follow the system prompts to grant screen recording, accessibility, input monitoring, microphone, and other required permissions.
5. A floating control bar appears near the bottom-right of the screen and displays REC 00:00/10:00. You can then begin the demonstration.

tip

The recording captures the primary display, mouse and keyboard operations, and annotations you submit. If you use multiple displays, move the window you want to demonstrate to the primary display.

How to use the floating control bar

Control	What it does
Six-dot handle / empty area	Drag the control bar. When released, it automatically returns to the visible screen area if necessary.
REC, red dot, and timer	Shows the elapsed recording time and limit. While paused, the red dot stops blinking and the timer freezes.
Green waveform button	Starts / stops voice annotation. The shortcut is Alt+D on Windows and Cmd+Shift+D on macOS. Recognized text automatically appears in the annotation history.
Annotate button	Opens the text annotation input. The shortcut is Alt+I on Windows and Cmd+Shift+I on macOS. Enter sends, Shift+Enter inserts a newline, and Esc closes the input.
History count	Opens / closes the annotation history. The arrow next to the title only expands or collapses the history content. Sent annotations can be edited or deleted.
Pause / Continue	While paused, Agivar does not capture frames or operations, and paused time does not count toward the recording length. Continuing resumes from the time before the pause.
End	Stops the recording and starts background processing.

Hover over a button to see its tooltip. If voice annotation is active when you click Pause, Agivar first saves the current voice draft. When recording continues, the voice annotation that was active before the pause resumes automatically.

Are floating widgets captured?

By default, no. The recording control bar, annotation box, task progress overlay, and similar floating widgets are excluded from AI screenshots and recordings, so the final capture contains whatever is behind them.

If you enable Streamer Mode under Settings → Advanced, these floating widgets become visible in recordings and AI screenshots, which is useful for demonstrations or livestreams. Disable Streamer Mode to restore the default hidden behavior.

Explain with text or voice

Text annotations

Text annotations are useful for short notes, such as:

• "Wait for the page to finish loading before clicking here."
• "Choose the second option because we only process paid orders."
• "The user enters the password and CAPTCHA here."

Click Annotate, or use the shortcut to open the input: Alt+I on Windows and Cmd+Shift+I on macOS. The annotation is inserted into the action timeline at the recording time when it was submitted, and the AI treats it as your explanation when generating the operation description.

Voice annotations

Voice annotations are useful when you want to explain a process while demonstrating it, especially for longer workflows where frequent typing would be inconvenient:

1. Click the green waveform button, or use the shortcut to start: Alt+D on Windows and Cmd+Shift+D on macOS.
2. Speak your explanation normally.
3. As Agivar recognizes the speech, it shows a live draft in the annotation history and automatically divides it into annotations at pauses.
4. Click the green waveform button again, or use the same shortcut again, to stop.

The first time you use voice annotations, the system may request microphone permission. If permission is unavailable or the microphone cannot be used, screen recording continues normally, but this recording will not have voice annotations.

note

The microphone in the input bar converts speech into chat input. The green waveform button in the recording widget converts speech into recording annotations. They serve different purposes.

What happens during recording processing?

For reference, background processing consists of roughly four steps, and you do not need to do anything:

1. Upload keyframes — keyframes selected from the recording are uploaded to the cloud.
2. Annotate frame by frame — the AI reviews the keyframes together with the mouse and keyboard action timeline and creates a detailed description with frame references.
3. Generate a summary — the detailed description is condensed into a short video summary.
4. Generate an operation description — a structured description using Overview / Initial state / Step-by-step operations / Stage results is produced for direct use in a memory entry.

The recording's raw frames and mouse and keyboard events remain under local ~/.agivar/; processed results, including keyframes, the summary, and operation description, are stored in the cloud and tied to your account.

What happens after you click End?

When you click End, the control bar closes, a recording attachment card appears above the input bar, and background processing begins.

• You can keep typing and add other attachments while processing continues.
• The Send button is temporarily disabled and becomes available after processing finishes.
• The attachment card shows processing progress, elapsed time, and estimated remaining time.
• Click the attachment thumbnail to preview the recording with play, pause, and replay controls.
• If you do not want to send the recording with the current message, click X on the attachment to remove it. Background processing continues, and you can still find the recording later under Select recording file.

If you are sure you do not want the recording, delete it under Select recording file or in Recording History. A processed recording can also be attached to a later message from Select recording file.

Tips for better recordings

• Record one complete workflow at a time, with a clear start and end.
• Move a little slower and leave a short pause between key steps.
• Use text or voice annotations at important points to explain why you are taking an action.
• Do not record passwords, CAPTCHAs, private keys, or other sensitive content. When a sensitive step is necessary, add an annotation saying that the user handles it.
• Preview the recording before sending it to Teach Mode or Task Mode.
• The maximum recording length is 10 minutes; Agivar ends the recording automatically at the limit.

Next

• Teach by recording
• Start a Conversation
• FAQ