Diffusion-consistent visual probing

TINA+: Probing Residual Visual Knowledge in Unlearned Diffusion Models via Diffusion-Consistent Text-Free Inversion

TINA+ bypasses the text pathway and searches for diffusion-consistent visual trajectories, testing whether erased models still retain generative knowledge of the target concept.

Qianlong Xiang Miao Zhang Kun Wang Haoyu Zhang Junhui Hou Liqiang Nie

Harbin Institute of Technology (Shenzhen) · City University of Hong Kong · National University of Singapore · Pengcheng Laboratory · Shenzhen Loop Area Institute

Paper · Coming soon Code · Coming soon BibTeX
Conceptual comparison between text-centric concept erasure, previous text attacks, and the text-free TINA+ attack
Concept erasure may suppress generation triggered by the target text without deleting the corresponding visual knowledge. TINA+ bypasses the text pathway and tests whether that knowledge remains recoverable through a valid visual generative trajectory.

Core question

Does removing a text–image association remove the visual knowledge itself?

The prevailing test

Can a text prompt still generate the erased concept?

Existing erasure methods and adversarial probes mainly operate through textual conditions. A failed text attack therefore shows that the text-to-image route is blocked, but does not establish that the model has forgotten how the concept looks.

Our visual test

Can the model still follow a valid visual trajectory to that concept?

TINA+ starts from a target image, searches for its seed latent under a null-text condition, and then asks the same erased model to regenerate the concept along a diffusion-consistent trajectory.

01

Abstract

Although text-to-image diffusion models exhibit remarkable generative power, concept erasure techniques are essential for their safe deployment to prevent the creation of harmful content. Adversarial probes test whether erased concepts can still be recovered and have driven the development of stronger defenses. Yet both erasure and probe methods remain largely confined to a text-centric paradigm, testing whether the text-to-image mapping is severed while overlooking whether the corresponding visual knowledge remains.

We instead adopt a visual perspective and ask whether diffusion inversion can still find a generative trajectory that reconstructs visual instances of the erased concept. A natural starting point is standard inversion, where a text prompt facilitates faithful reconstruction. That textual condition is precisely what text-centric defenses suppress, and using it would prevent a purely visual assessment. Operating under a null-text condition removes this dependence, but amplifies the approximation errors of standard inversion and hinders faithful trajectory recovery.

We therefore introduce TINA+, a diffusion-consistent Text-free INversion Attack with an optimization-based inversion procedure that improves null-text inversion accuracy. Beyond accuracy, we find that unconstrained inversion may discover spurious trajectories and can even allow a randomly initialized diffusion model to reconstruct the target concept. These trajectories are inconsistent with the diffusion process and may falsely indicate the presence of residual visual knowledge.

TINA+ therefore introduces Diffusion-Consistent Trajectory Regularization. By penalizing trajectories that fall far below the expected marginal energy evolution of diffusion, TINA+ avoids spurious inversion paths while preserving its ability to recover erased concepts through diffusion-consistent trajectories.

Experiments across twelve erasure methods, four concept-erasure tasks, and different model architectures demonstrate that TINA+ reliably probes residual visual knowledge through diffusion-consistent trajectories. The results provide stronger evidence that current methods often obscure concepts by severing text-image links rather than eliminating the underlying visual knowledge.

02

TINA+ in one trajectory

From a target image to a valid seed latent, then back through the same concept-erased model under a null-text condition.

High-level framework of the TINA+ visual probe
TINA+ discovers a seed latent from a target image and feeds it back into the same erased model. Regeneration of the erased concept indicates that a corresponding visual generative pathway remains.

Technical overview

Accurate inversion is necessary. A valid trajectory is equally important.

Overview of the TINA+ method including fixed-point optimization, forward marginal initialization, and marginal energy regularization
TINA+ combines fixed-point optimization with forward marginal initialization and marginal energy regularization, then generates from the optimized seed under the null-text condition.
01

Start visually

Encode a representative target image and remove dependence on the erased prompt.

02

Correct inversion

Optimize each latent for fixed-point consistency instead of accepting accumulated DDIM approximation errors.

03

Enforce validity

Use forward marginal initialization and marginal energy regularization to suppress diffusion-inconsistent paths.

04

Probe the model

Generate from the discovered seed with the same erased model and test whether the concept reappears.

03

Evidence at scale

TINA+ remains effective in settings where attacks through textual conditions are substantially suppressed.

12erasure methods
4concept-erasure tasks
6representative attacks
2model architecture families

Attack Success Rate (%) across eight nudity-erasure defenses.

AttackESDFMNUCEMACERECEAdvUn.SalUnSTEREOAVG.
PEZ11.8662.7125.428.4715.251.690.000.0015.68
MMA13.1067.0032.606.0022.801.701.705.5018.80
RAB50.5397.8929.476.3210.532.110.008.4225.66
P4D69.0197.8976.0675.3566.2018.3115.4924.6555.37
UDA76.0597.8978.8781.6963.3823.2413.3825.3557.48
TINA+86.44100.0097.4693.2293.2292.3773.7397.4691.74

04

A probe must reject false evidence

A visually similar reconstruction is not sufficient. Even a random model can be inverted through an invalid trajectory.

Trajectory diagnostics

Initialization aligns. Energy regularization keeps the path valid.

Forward Marginal Initialization provides an aligned starting point. The marginal energy constraint then prevents optimization from exploiting a severe energy collapse in the Random-UNet negative control.

Trajectory energy diagnostics on Stable Diffusion and a randomly initialized UNet

Negative control

Invalid reconstructions become explicit failures.

DDIM and unconstrained TINA can reproduce recognizable target characteristics from a model with no learned target knowledge. TINA+ suppresses these false positives during optimization instead of merely rejecting them afterward.

False-positive reconstruction comparison on a Random-UNet Taylor Swift benchmark

05

Further Analysis

t-SNE visualization of optimized noises and internal UNet features
Internal representations Noise-like seed latents elicit clearly separable, concept-specific responses inside erased UNets.
TINA+ qualitative results on the DiT-based PixArt model
Different model architectures The vulnerability extends from UNet-based models to the DiT-based PixArt model.

06

Citation

This entry will be updated when the paper is publicly released.

@misc{xiang2026tinaplus,
  title  = {TINA+: Probing Residual Visual Knowledge in Unlearned
            Diffusion Models via Diffusion-Consistent Text-Free Inversion},
  author = {Xiang, Qianlong and Zhang, Miao and Wang, Kun and Zhang, Haoyu
            and Hou, Junhui and Nie, Liqiang},
  year   = {2026}
}