2.8 KiB
2.8 KiB
Neural Body Annotated Figure (Text Conversion)
This file converts the annotated Neural Body figure into reusable writing notes.
Purpose
Use this mapping to understand how one Method section can explicitly separate:
- Module motivation
- Module design (data structure)
- Module design (forward process)
- Technical advantages
Block-by-Block Mapping
Section 3.1: Structured Latent Codes
- Module design (data structure)
- The paragraph defines structured latent codes anchored to the deformable human model (SMPL).
- It explains what is constructed (latent codes + their anchor positions + frame-dependent transformation by pose).
- Technical advantages
- The paragraph explains why this design works better: dynamic-human representation and cross-frame integration of observations.
- It highlights why anchoring codes to deformable geometry is beneficial.
Section 3.2: Code Diffusion
- Motivation of this module
- The paragraph states the remaining problem: direct interpolation of sparse structured codes leads to near-zero vectors at many 3D points.
- This motivates diffusion from surface codes to nearby 3D space.
- Module design (forward process)
- The paragraph explains the execution pipeline: build sparse latent volumes, run sparse convolutions, interpolate latent codes at query points, and feed codes to prediction networks.
- This is a canonical input -> steps -> output module description.
Section 3.3: Density and Color Regression
- Module design (forward process) for density model
- The density paragraph defines how density is regressed from latent code and frame condition.
- Module design (data structure) for color model
- The color paragraph introduces required inputs/embeddings (latent code, view direction, spatial location, temporal embedding).
- Module design (forward process) for color model
- The next paragraph describes how those inputs are encoded and passed into the color MLP for final color prediction.
Section 3.4: Volume Rendering
- Module design (forward process)
- The paragraph describes ray sampling and volume integration to render image outputs from predicted density/color fields.
Reusable Writing Pattern from This Figure
For each module subsection, follow this order:
Motivation: state unresolved challenge and technical reason.Design-1: define structure/representation/network.Design-2: describe forward process in execution order.Advantage: explain why this module improves over alternatives.
Suggested Paragraph Starters
- Motivation:
A remaining challenge is ... - Data structure design:
We represent ... with ... - Forward process:
Given [input], we first ... then ... finally ... - Technical advantage:
Compared with previous methods, this design ... because ...