SteerVTE: Precise Video Text Editing with Style and Glyph Control

1Peking University   2ByteDance (CN)   3ByteDance (SG)
*Intern of ByteDance      Project Leader      Corresponding Author

Abstract

Visual text editing aims to precisely modify text in images and videos while preserving stylistic consistency and visual realism. Despite significant advances in the image domain, video text editing remains largely unexplored: it is a localized task demanding stroke-level precision within small text regions, which compounds the challenges of cross-frame accuracy, temporal coherence, and stylistic fidelity. We introduce SteerVTE, a unified framework that steers a frozen video diffusion model to perform precise Video Text Editing through style and glyph control. Built on a frozen diffusion transformer, SteerVTE attaches a lightweight text context adapter with two complementary modules: a style encoder capturing the original text's visual attributes, and dual-granularity glyph encoders encoding the target text at both the line and character levels. To overcome the inherently weak text rendering priors of video foundation models, we further propose a glyph-aware spatial-focal loss and a three-stage progressive training curriculum that scales from image to video data. To support large-scale training, we also develop an automatic synthesis pipeline and construct SteerVTE-1M, a dataset of one million triplets spanning diverse scenes, fonts, and stylistic effects. Extensive experiments demonstrate that SteerVTE substantially outperforms existing video editing baselines across text accuracy, style consistency, and temporal coherence.

Methodology

Architecture Design

SteerVTE augments a frozen video diffusion transformer with a Text Context Adapter that jointly encodes positional, stylistic, and glyph-level cues.
  • Mask-guided positional conditioning uses a spatiotemporal mask to localize edits while preserving background fidelity.
  • Native-resolution VLM style encoding preserves typographic attributes such as stroke thickness, spacing, and aspect ratio by tokenizing images at original aspect ratios.
  • Dual-granularity glyph control injects line-level layout priors and character-level stroke priors from an OCR network, both rendered in a neutral font to expose content while leaving style to the VLM encoder.
SteerVTE architecture diagram
SteerVTE architecture diagram. A frozen DiT is augmented with a Text Context Adapter injecting mask, VLM style, and glyph features via cross attention.

Glyph-Aware Spatial-Focal (GLAS) Loss

Standard flow matching treats all spatial locations equally, causing text-region gradients to be suppressed by backgrounds and lacking inductive bias toward character topology. We propose the GLAS Loss, a dual-space paradigm:
  • Spatial-Focal Loss reweights the objective with a focal map from the mask, concentrating optimization on text regions.
  • Glyph-Aware OCR Loss imposes pixel-space supervision via an OCR recognizer, enforcing stroke-level fidelity and character-level recognizability.
The overall GLAS Loss combines these components for precise character-level editing.

Training Dataset

SteerVTE training dataset construction
We construct SteerVTE-1M with two components.
  • SynthTE synthesizes 500k image pairs (easy) and 200k video pairs (hard) using 1,933 fonts and OpenSora-Plan backgrounds.
  • RealTE derives 300k image pairs from AnyWord-3M via OCR filtering, state-of-the-art editing, and style similarity verification.
The final dataset offers balanced difficulty and style coverage, released for research use.

Training Curriculum

SteerVTE progressive training curriculum
We train SteerVTE with a progressive three-stage curriculum.
  • Stage 1: Feature Alignment. Trains only linear connectors on 500k synthetic images.
  • Stage 2: In-the-Wild Fine-Tuning. Activates LoRAs and jointly optimizes on 300k real-world samples to bridge the synthetic-to-real gap.
  • Stage 3: Temporal Fine-Tuning. Extends to 200k video clips with GLAS Loss to enforce kinematic coherence and glyph fidelity.

Qualitative Comparison

Please press the play button on the top right to pause all videos for more detailed frame-by-frame comparison.
Please refresh the page if the videos are not synchronized properly.
Tip: Click any image or video to zoom in.

Video Text Editing in Scene Text Scenarios

Moving

Note: STRIVE* is our reproduced implementation of STRIVE.

Edit: "CLEAN" -> "veget"
Source Video
SteerVTE (Ours)
STRIVE*
AnyText2
FLUX.2
FLUX-Text
TextCtrl
Edit: "BORTOLINI" -> "LYMPH"
Source Video
SteerVTE (Ours)
STRIVE*
AnyText2
FLUX.2
FLUX-Text
TextCtrl
Edit: "LETRAN" -> "COUNTDOWN T"
Source Video
SteerVTE (Ours)
STRIVE*
AnyText2
FLUX.2
FLUX-Text
TextCtrl
Edit: "THURLBY" -> "nervier"
Source Video
SteerVTE (Ours)
STRIVE*
AnyText2
FLUX.2
FLUX-Text
TextCtrl

Static

Edit: "1964" -> "CERE"
Source Video
SteerVTE (Ours)
STRIVE*
AnyText2
FLUX.2
FLUX-Text
TextCtrl
Edit: "Acetic Ac" -> "UNCLASPS"
Source Video
SteerVTE (Ours)
STRIVE*
AnyText2
FLUX.2
FLUX-Text
TextCtrl
Edit: "exam-oriented" -> "Liverymen"
Source Video
SteerVTE (Ours)
STRIVE*
AnyText2
FLUX.2
FLUX-Text
TextCtrl
Edit: "London2012" -> "CAPARISON"
Source Video
SteerVTE (Ours)
STRIVE*
AnyText2
FLUX.2
FLUX-Text
TextCtrl

Video Text Editing in Synthetic Scenarios

Common

Edit: "Eye Rinitis listos A" -> "I really needed that"
Source Video
SteerVTE (Ours)
Seedance2.0
VIVA
UniVideo
Kiwi-Edit
FLUX-Text (Per Frame)
Edit: "FORTNITE Seriously f" -> "QUICK RESPONSE TEAM"
Source Video
SteerVTE (Ours)
Seedance2.0
VIVA
UniVideo
Kiwi-Edit
FLUX-Text (Per Frame)

Stylized

Edit: "TEIL Antarctic" -> "Strong Feeling"
Source Video
SteerVTE (Ours)
VIVA
UniVideo
Kiwi-Edit
FLUX-Text (Per Frame)
Edit: "laggy nnual Baguslah seducing" -> "I can't believe this happened"
Source Video
SteerVTE (Ours)
Seedance2.0
VIVA
UniVideo
Kiwi-Edit
FLUX-Text (Per Frame)

Video Text Editing in Real Scenarios

Common

Edit: "CALVI NKLEIN" -> "Happy Family"
Source Video
SteerVTE (Ours)
Seedance2.0
VIVA
UniVideo
Kiwi-Edit
FLUX-Text (Per Frame)
Edit: "in the comments" -> "Watch your step"
Source Video
SteerVTE (Ours)
Seedance2.0
VIVA
UniVideo
Kiwi-Edit
FLUX-Text (Per Frame)

Stylized

Edit: "PRO TIP" -> "New Job"
Source Video
SteerVTE (Ours)
Seedance2.0
VIVA
UniVideo
Kiwi-Edit
FLUX-Text (Per Frame)
Edit: "Something needs to change." -> "Something seems off today"
Source Video
SteerVTE (Ours)
Seedance2.0
VIVA
UniVideo
Kiwi-Edit
FLUX-Text (Per Frame)

Dataset Visualization

Stage1 Training Data: SynthTE-Easy

Edit: "SILVERTON trials IND" -> "SLIP recite molestab"
Source
src
Mask
mask
Target
tgt
Edit: "workouts date ciasta" -> "prazer finding jantu"
Source
src
Mask
mask
Target
tgt
Edit: "Peiniger WRIGGLED Re" -> "poen NASX BENEFICIOS"
Source
src
Mask
mask
Target
tgt
Edit: "Bronde" -> "murdar m'arrive impu"
Source
src
Mask
mask
Target
tgt
Edit: "COOPERATE ACEPTO FLE" -> "Immaginavo dengannya"
Source
src
Mask
mask
Target
tgt
Edit: "MENJEMPUT ADVOGADO L" -> "olhada bereute"
Source
src
Mask
mask
Target
tgt

Stage2 Training: RealTE

Edit: "THE" -> "PAY"
Source
src
Mask
mask
Target
tgt
Edit: "THE" -> "OUT"
Source
src
Mask
mask
Target
tgt
Edit: "GOLF" -> "Need"
Source
src
Mask
mask
Target
tgt
Edit: "Chinn" -> "Among"
Source
src
Mask
mask
Target
tgt
Edit: "PUT" -> "GET"
Source
src
Mask
mask
Target
tgt
Edit: "TIME" -> "HOUR"
Source
src
Mask
mask
Target
tgt

Stage3 Training Data: SynthTE-Hard

Edit: "Teste modos reur agribusiness" -> "Ngapain aliens sebodoh mer Mar"
Source
Mask
Target
Edit: "andrologia orts comport WHERE" -> "voudras Option Tristan usado C"
Source
Mask
Target
Edit: "faut datorati Pemakaian Dread" -> "nisayildiz deythin massacre br"
Source
Mask
Target
Edit: "NAIXUE" -> "fiancee Status lifetim"
Source
Mask
Target
Edit: "sabia cello kurz ortak Boutiqu" -> "Energieschub Aborte programme"
Source
Mask
Target
Edit: "relationships olhar DRAMASH Ce" -> "TOYS Stellung RACUN Step-sibli"
Source
Mask
Target

Citation

@article{zeng2026steervte,
  title={SteerVTE: Seamless Video Text Editing with Style and Glyph Control},
  author={Zeng, Kai and Li, Moran and Wang, Zhengwei and Yu, Yingchen and Lin, Yiheng and An, Ruichuan and Lu, Ming and She, Qi and Zhang, Wentao},
  journal={arXiv preprint arXiv:2606.23254},
  year={2026}
}