relab — pipeline gallery

Mask bake-off (NG-008 vs Fotello truth)

namemethodclassiouboundary_fboundary_precisionboundary_recallover_paint_pctmissed_pctcoverage_pctsecondsextra
current_stackoneformer+sam2wall0.85210.20090.220.18481.663.1629.430.03provided 0.85 reference mask
colorlab-heuristicwall0.91530.33410.31290.35840.452.229.182.12
colorlab-heuristicceiling0.9230.05470.04260.07631.360.5123.70.54
groundinggroundingdino+samwall0.00.00.00.00.030.930.013.620 boxes
groundinggroundingdino+samceiling0.00.00.00.00.022.850.00.50 boxes
fluxflux2-klein-paintwall0.00.00.00.00.030.930.00.17BLOCKED gateway @cf/black-forest-labs/flux-2-klein-4b HTTP 502: b'{"error":"5006: Error: required properties at \'/\' are \'multipart\'"}'

Per-frame pipeline vs Fotello

de00_fullde00_wallde00_ceilingde00_glassecc_to_fotelloecc_to_inputhp_corr_wallhp_corr_ceilingwall_cov_pctnamesecondswall_strengthwindow_amount
5.7110.76.656.110.72240.9840.9690.8915.04chan_00319.210.70.8
10.16.173.385.570.98260.99210.9330.8947.82chan_0049.970.70.8
8.744.883.425.820.98040.9930.9340.8477.44chan_0059.450.70.8
4.663.33.285.860.94120.97310.8880.7882.93chan_0068.820.70.8
9.65.153.684.330.96190.97280.8820.53510.76chan_0089.240.70.8
9.84.694.474.470.97130.97010.9470.6513.57chan_0099.050.70.8
14.628.686.5711.450.89620.9921-0.065-0.21427.98golf_01712.530.70.8
15.9610.957.8110.120.97640.98550.9080.89524.02mont_09910.980.70.8

Frames (IN · Fotello · ours · intermediates)

chan_003

in
fotello
final
input
window
recolour
flatten
wall_mask
ceiling_mask
window_mask
depth

chan_004

in
fotello
final
input
window
recolour
flatten
wall_mask
ceiling_mask
window_mask
depth

chan_005

in
fotello
final
input
window
recolour
flatten
wall_mask
ceiling_mask
window_mask
depth

chan_006

in
fotello
final
input
window
recolour
flatten
wall_mask
ceiling_mask
window_mask
depth

chan_008

in
fotello
final
input
window
recolour
flatten
wall_mask
ceiling_mask
window_mask
depth

chan_009

in
fotello
final
input
window
recolour
flatten
wall_mask
ceiling_mask
window_mask
depth

golf_017

in
fotello
final
input
window
recolour
flatten
wall_mask
ceiling_mask
window_mask
depth

mont_099

in
fotello
final
input
window
recolour
flatten
wall_mask
ceiling_mask
window_mask
depth