Measuring Audio Sync Offset Without Special Gear
Two people watch the same video and disagree about whether the sound is in sync. One is certain the audio is late, the other cannot see anything wrong. Both are describing their own perception, and perception of sync has a tolerance wide enough that both can be right. Settling the question needs a measurement, and it does not need expensive equipment.
We measured offset with a phone, a short recording and a waveform editor, all of which most people already have. The method produces a figure accurate enough to decide whether a correction is needed, and it is far more reliable than watching and guessing.
What are we actually measuring?
The delay between a visual event and the sound that belongs to it. In a video that means the gap between a visible action and its audio, and in a call it means the gap between speech and the corresponding movement. Either way it is one number with a direction: audio early or audio late.
The direction matters as much as the size. The eye tolerates audio arriving slightly before the picture far better than audio arriving after it, which is why the same magnitude can be acceptable in one direction and obvious in the other.
Why can’t you just watch and judge?
Because the tolerance is wide and it varies between people by a large margin. Published thresholds for detecting audio that is late are generous, and for detecting audio that is early they are more generous still. Two viewers can sit at opposite ends of that range.
Expectation also plays a role. Someone who has been told there is a sync problem will find one, and someone who has not will not. That is precisely the situation where a measurement is worth more than a discussion.
What is the simplest accurate method?
Play a test clip with a sharp visual event and a matching sharp sound, record the screen and the audio together, then open the recording and measure the gap between the two. A clapperboard-style clip is ideal, and short test files exist for exactly this purpose.
The recording has to capture both at once, which is why playing from one device and recording with another works better than any attempt to measure each separately. The absolute accuracy is limited, but the comparison is sound.
How do you read the waveform?
Find the frame where the visual event occurs and the sample where the audio transient begins, and convert the difference into milliseconds using the sample rate. Most editors show a time ruler, which makes this a matter of reading two positions and subtracting.
Repeat it several times, because the measurement quantises to the video frame rate. A figure taken once has an uncertainty of one frame, and averaging across several events reduces that considerably.
What accuracy does this give?
Good enough to detect anything that matters. The frame quantisation sets a floor of a few tens of milliseconds at common frame rates, and human detection thresholds for late audio are in a similar range. So the method resolves exactly the region that is in dispute.
It cannot resolve small differences, and it should not be used to choose between two devices differing by a few milliseconds. For deciding whether a correction is needed, which is the usual question, it is entirely adequate.
Can you measure the whole chain rather than one device?
Yes, and that is usually the more useful measurement. Record what the speaker actually produces rather than what the application sends, and the figure includes every stage from the application to the air. That is the number that corresponds to what a viewer experiences.
Measuring one device in isolation gives a smaller, cleaner figure that is much harder to connect to the experience. Unless you are comparing components specifically, measure the whole path.
Where does the offset usually come from?
Most often from video processing rather than from audio. Display pipelines that buffer frames for processing add delay to the picture, and the audio path is comparatively short. The result is audio arriving before the picture, which is the more tolerable direction and therefore often goes unnoticed.
The other common source is the audio path itself, particularly wireless, where buffering adds delay directly to the sound. That produces audio arriving after the picture, which is the direction people notice and complain about.
Is there a correction available?
Usually. Most playback software and most displays expose a delay adjustment, and setting it to cancel the measured offset is straightforward. The correction needs to be in the right direction, which is exactly what the measurement tells you.
Apply it at one point only. Correcting in two places produces double the error in the opposite direction, which is worse than the original problem and much harder to diagnose because the figure looks plausible.
Does the offset change with content?
It can, because some processing only engages for certain content types or resolutions. A measurement taken on one clip does not always transfer to another, particularly if the display changes mode between them.
Testing with the content you actually watch is the safest approach. If the display switches processing mode, the offset may switch with it, and a single correction cannot fix both cases.
What about calls and live content?
Those have an additional variable, because the network adds its own delay and it varies over time. Measuring the round trip is a different exercise and the result is a distribution rather than a number. Sync in live content is inherently less stable.
For live use, the practical approach is to minimise each stage rather than to correct the total. A wired connection, a short audio path and a display mode with minimal processing each remove a slice, and together they usually bring the problem below the detection threshold.
How should you report a result?
State the direction, the magnitude, the frame rate of the test clip, and how many events you averaged. Those four items let someone else reproduce it and decide whether your figure is comparable with theirs.
State also whether you measured the whole path or one device. Those two figures routinely differ by a wide margin, and mixing them up is the most common source of confusion in discussions of this topic.
What is the practical takeaway?
That a phone and a waveform editor settle the question, and that the answer is usually a display processing mode rather than the audio device. Correcting at one point, in the right direction, resolves most cases.
Anyone who wants to go further should measure the same clip across several output modes, because that ranking tells you which modes are adding delay and which are neutral.
What is worth measuring after sync?
Does the offset vary across a single viewing session?
It can, particularly if a wireless path is involved. Buffers adapt to conditions, so the offset measured at the start of a session is not necessarily the one at the end. That variability is itself a complaint people notice.
Measuring more than once, with some time in between, tells you whether the offset is stable. A stable offset can be corrected, and a drifting one cannot, which makes stability the more useful thing to check.
Should you correct for one device or for the whole chain?
For the whole chain, because that is what you experience. Correcting a single device in isolation leaves the rest of the path uncorrected, and the remaining error is whatever everything else contributes.
The exception is when you are specifically evaluating a device. Then isolating it is the point, and the figure is deliberately not the one you would use for a correction.
Does the correction need to be reapplied?
Sometimes, after changing any part of the chain. A new display mode, a new connection or a firmware update can each shift the offset, and a correction set before those changes is describing an old system.
Re-measuring after any change is the habit worth building. It takes a few minutes and it prevents the confusing situation where a correction that used to be right is now making things worse.
Is a small offset worth correcting at all?
Often not, because the eye tolerates small offsets well and an unnecessary correction risks introducing an error in the other direction. If you cannot reliably detect it, leaving it alone is reasonable.
The exception is audio arriving after the picture, which is detected at smaller magnitudes. Correcting in that direction is more often worth doing.
Does the offset differ between applications?
It can, because different applications buffer differently and some take exclusive control of the audio device. Measuring in the application you use most is the only figure that predicts your experience.
Testing two applications on the same system often reveals a difference. That difference is real and it belongs to the software rather than to the hardware.
The stability of the offset over time, because a figure that drifts is more objectionable than one that is consistently wrong. Logging the same measurement across a session is the natural next step and it is easy with the same setup.
Photograph: Ktmartin (CC BY 4.0) ยท Wikimedia Commons
