-
Notifications
You must be signed in to change notification settings - Fork 2
/
Copy pathsuperai-20240428-superv-visual-quality.txt
64 lines (40 loc) · 2.31 KB
/
superai-20240428-superv-visual-quality.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
### Generalized Visual Quality ###
(still updating ...)
#Priori as Condition
Increamental hash priori as Condition for UNet/Diffusion #DiffHashPriori #UNet3DConditionModel #Contional Unet
#Unseen Process
2D novel views generation #MVDream:4views+MVControl #LGM:4views-unet-GS #RetrievalFuse:knn-database #Zero123++*: n-view-images #2404.18669 Bootstrap 3DGS
#Local Process
Local Patcher Supervised #TripoSR(NoCode)
Local vs. Global #eg. LOD in GameEngine
Structure-Aware: 2404.19149SAGS
#Bigger Data/Representation/Network
Bigger I/O #Point-number #SH-degree
Bigger Network #Deeper/Wider
Better Network (#En+De #ViT #Unet #Diffusion) #EDM/Diffusion #AGG #Splatter/Unet #Gamba/DINO+Gamba->3dgs->Render #LatenSplat #DIG3D #FDGaussian
#Extra Network
Extra Refine #HybridRepresentation+SuperResolution:2401.04099 AGG/DINOv2+...+PVCNN https://github.com/mit-han-lab/pvcnn
Depth Inpaint #InvisibleStitch:Generating Smooth 3D Scenes with Depth Inpainting:https://github.com/paulengstler/invisible-stitch
#Special Network
Recursion-Resolution #PointInfinity: Train@LowResolution+Infer@HighResolution
Super-Resolution #Transformer for Single Image Super-Resolution #Multi-Scale Vision Longformer #FlexiViT
#Special Loss&Regularization
Visual #LPIPS
Surface #SuGaR
Deblure #2401.00834-Deblurring 3DGS
Robust #2404.04211-Robust GS
GS-Point #dense/distance, scale, sh-degree, ...
###########################
### Some Important Networks
## Gamba
image -> GambaNet -> 3dgs -> Render -> image'
## AGG
image -> DINOv2 -> feature#11 -| -|
-> Transformer Geometry -> location-point-cloud#211 -| -> PVCNN -| -> CrossAttent -> feature-expan -| -> CrossAttent -> PVCNN -> HR-GS
-> Transformer Texture/reshape -> triplane#221 -> MLP -> opacity-color#222 -|
## LatenSplat
image -> {Encoder: DINO -> Transformer -> header}) -> 3dgs -> feature-map -> (Decoder) -> Diffustion
## Splatter
image -> Unet -> GS***
## DIG3D (X)
## FDGaussian (X)