relab — pipeline gallery

Masks: SegFormer ADE20K (wall/ceiling/floor/windowpane) + SAM point refine on the original pixels; wall minus ceiling. FLUX.2 klein paint-over was attempted and is unconditioned through the gateway this round (see NOTES.md).

Mask bake-off (NG-008 vs Fotello truth)

name	method	class	iou	boundary_f	boundary_precision	boundary_recall	over_paint_pct	missed_pct	coverage_pct	seconds	extra
current_stack	oneformer+sam2	wall	0.8521	0.2009	0.22	0.1848	1.66	3.16	29.43	0.02	provided 0.85 reference mask
color	lab-heuristic	wall	0.9153	0.3341	0.3129	0.3584	0.45	2.2	29.18	1.97	hand-tuned on NG-008; fails on dark rooms
color	lab-heuristic	ceiling	0.923	0.0547	0.0426	0.0763	1.36	0.51	23.7	0.51	hand-tuned on NG-008; fails on dark rooms
semseg	segformer+sam	wall	0.9086	0.1365	0.1513	0.1242	0.36	2.5	28.78	12.04	ADE20K wall class -> SAM points -> minus ceiling
semseg	segformer+snap	ceiling	0.9409	0.2194	0.242	0.2007	0.52	0.86	22.52	12.04	ADE20K ceiling class -> colour edge-snap
klein	flux2-klein-paint+sam	wall	0.0129	0.0039	0.0079	0.0026	15.67	30.33	16.27	16.0	UNCONDITIONED: output 1024x1024 text-to-image, ECC 0.0361; probe 'return this exact photo unchanged' returned a generated forest (results/klein/evidence/)
klein	flux2-klein-paint+sam	ceiling	0.0	0.0	0.0	0.0	0.0	22.85	0.0	16.04	UNCONDITIONED: output 1024x1024 text-to-image, ECC 0.0361; probe 'return this exact photo unchanged' returned a generated forest (results/klein/evidence/)
chan_003	segformer+sam	coverage							39.97	11.8	wall=39.97 ceiling=4.82 floor=8.65 glass=1.79 frame=42.05 kind=interior
chan_004	segformer+sam	coverage							40.73	2.8	wall=40.73 ceiling=6.98 floor=14.98 glass=1.45 frame=0.0 kind=interior
chan_005	segformer+sam	coverage							51.92	3.2	wall=51.92 ceiling=8.69 floor=10.37 glass=1.48 frame=2.7 kind=interior
chan_006	segformer+sam	coverage							56.63	2.1	wall=56.63 ceiling=11.15 floor=0.0 glass=4.02 frame=0.0 kind=interior
chan_008	segformer+sam	coverage							30.2	2.7	wall=30.2 ceiling=19.18 floor=16.82 glass=1.45 frame=0.0 kind=interior
chan_009	segformer+sam	coverage							25.17	2.7	wall=25.17 ceiling=21.43 floor=14.97 glass=1.79 frame=0.0 kind=interior
golf_017	segformer+sam	coverage							8.88	3.5	wall=8.88 ceiling=25.79 floor=25.2 glass=0.06 frame=3.43 kind=interior
mont_099	segformer+sam	coverage							33.15	2.8	wall=33.15 ceiling=4.43 floor=9.53 glass=0.0 frame=2.85 kind=interior
prop1_1	segformer+sam	coverage							10.9	1.5	wall=10.9 ceiling=3.96 floor=3.48 glass=0.31 frame=57.47 kind=interior
prop1_2	segformer+sam	coverage							34.25	1.2	wall=34.25 ceiling=4.42 floor=1.89 glass=0.97 frame=0.0 kind=interior
prop1_3	segformer+sam	coverage							23.87	1.3	wall=23.87 ceiling=24.41 floor=2.04 glass=6.25 frame=0.0 kind=interior
prop2_1	segformer+sam	coverage							4.72	1.2	wall=4.72 ceiling=6.1 floor=1.42 glass=6.6 frame=0.0 kind=interior
prop2_2	segformer+sam	coverage							21.58	1.1	wall=21.58 ceiling=9.67 floor=9.04 glass=0.0 frame=0.0 kind=interior
prop2_3	segformer+sam	coverage							22.35	1.2	wall=22.35 ceiling=0.13 floor=0.36 glass=0.0 frame=0.07 kind=interior
prop3_1	segformer+sam	coverage							0.0	0.1	wall=0.0 ceiling=0.0 floor=0.0 glass=0.0 frame=0.0 kind=exterior
prop3_2	segformer+sam	coverage							12.28	1.2	wall=12.28 ceiling=17.37 floor=11.53 glass=20.62 frame=0.0 kind=interior
prop3_3	segformer+sam	coverage							27.65	1.3	wall=27.65 ceiling=26.79 floor=7.32 glass=5.27 frame=1.03 kind=interior
prop4_1	segformer+sam	coverage							27.56	1.2	wall=27.56 ceiling=24.41 floor=12.95 glass=2.16 frame=0.0 kind=interior
prop4_2	segformer+sam	coverage							15.92	1.3	wall=15.92 ceiling=8.88 floor=2.4 glass=1.9 frame=4.29 kind=exterior
prop4_3	segformer+sam	coverage							16.56	1.4	wall=16.56 ceiling=29.22 floor=22.91 glass=2.12 frame=2.98 kind=exterior
prop5_1	segformer+sam	coverage							0.21	0.1	wall=0.21 ceiling=0.0 floor=0.0 glass=0.0 frame=0.0 kind=exterior
prop5_2	segformer+sam	coverage							0.0	0.1	wall=0.0 ceiling=0.0 floor=0.0 glass=0.0 frame=0.0 kind=exterior
prop5_3	segformer+sam	coverage							46.01	0.9	wall=46.01 ceiling=0.45 floor=0.0 glass=0.0 frame=0.0 kind=interior
prop6_1	segformer+sam	coverage							33.07	1.4	wall=33.07 ceiling=23.81 floor=22.23 glass=9.44 frame=5.44 kind=interior
prop6_2	segformer+sam	coverage							40.34	1.4	wall=40.34 ceiling=22.86 floor=25.58 glass=0.54 frame=5.68 kind=interior
prop6_3	segformer+sam	coverage							58.03	1.2	wall=58.03 ceiling=16.89 floor=16.18 glass=7.63 frame=0.0 kind=interior
prop7_1	segformer+sam	coverage							54.25	1.3	wall=54.25 ceiling=9.88 floor=12.09 glass=1.63 frame=15.48 kind=interior
prop7_2	segformer+sam	coverage							58.07	1.2	wall=58.07 ceiling=9.55 floor=9.87 glass=0.0 frame=12.61 kind=interior
prop7_3	segformer+sam	coverage							41.49	1.2	wall=41.49 ceiling=16.08 floor=3.63 glass=9.17 frame=0.0 kind=interior
prop8_1	segformer+sam	coverage							43.23	1.4	wall=43.23 ceiling=9.45 floor=9.06 glass=3.08 frame=9.43 kind=interior
prop8_2	segformer+sam	coverage							19.76	1.3	wall=19.76 ceiling=21.13 floor=14.37 glass=0.0 frame=0.96 kind=interior
prop8_3	segformer+sam	coverage							27.74	1.4	wall=27.74 ceiling=18.98 floor=7.08 glass=14.17 frame=8.14 kind=interior
ng_008	segformer+sam	coverage							28.78	3.5	wall=28.78 ceiling=22.52 floor=23.85 glass=4.09 frame=1.2 kind=interior

Mask coverage — all 32 frames

name	source	kind	wall_cov_pct	ceiling_cov_pct	floor_cov_pct	glass_cov_pct	frame_cov_pct	seconds	wall_iou	wall_over_pct	wall_missed_pct	wall_truth_cov_pct	ceiling_iou	ceiling_over_pct	ceiling_missed_pct	ceiling_truth_cov_pct
chan_003	pairs	interior	39.97	4.82	8.65	1.79	42.05	11.8
chan_004	pairs	interior	40.73	6.98	14.98	1.45	0.0	2.8
chan_005	pairs	interior	51.92	8.69	10.37	1.48	2.7	3.2
chan_006	pairs	interior	56.63	11.15	0.0	4.02	0.0	2.1
chan_008	pairs	interior	30.2	19.18	16.82	1.45	0.0	2.7
chan_009	pairs	interior	25.17	21.43	14.97	1.79	0.0	2.7
golf_017	pairs	interior	8.88	25.79	25.2	0.06	3.43	3.5
mont_099	pairs	interior	33.15	4.43	9.53	0.0	2.85	2.8
prop1_1	pairs2	interior	10.9	3.96	3.48	0.31	57.47	1.5
prop1_2	pairs2	interior	34.25	4.42	1.89	0.97	0.0	1.2
prop1_3	pairs2	interior	23.87	24.41	2.04	6.25	0.0	1.3
prop2_1	pairs2	interior	4.72	6.1	1.42	6.6	0.0	1.2
prop2_2	pairs2	interior	21.58	9.67	9.04	0.0	0.0	1.1
prop2_3	pairs2	interior	22.35	0.13	0.36	0.0	0.07	1.2
prop3_1	pairs2	exterior	0.0	0.0	0.0	0.0	0.0	0.1
prop3_2	pairs2	interior	12.28	17.37	11.53	20.62	0.0	1.2
prop3_3	pairs2	interior	27.65	26.79	7.32	5.27	1.03	1.3
prop4_1	pairs2	interior	27.56	24.41	12.95	2.16	0.0	1.2
prop4_2	pairs2	exterior	15.92	8.88	2.4	1.9	4.29	1.3
prop4_3	pairs2	exterior	16.56	29.22	22.91	2.12	2.98	1.4
prop5_1	pairs2	exterior	0.21	0.0	0.0	0.0	0.0	0.1
prop5_2	pairs2	exterior	0.0	0.0	0.0	0.0	0.0	0.1
prop5_3	pairs2	interior	46.01	0.45	0.0	0.0	0.0	0.9
prop6_1	pairs2	interior	33.07	23.81	22.23	9.44	5.44	1.4
prop6_2	pairs2	interior	40.34	22.86	25.58	0.54	5.68	1.4
prop6_3	pairs2	interior	58.03	16.89	16.18	7.63	0.0	1.2
prop7_1	pairs2	interior	54.25	9.88	12.09	1.63	15.48	1.3
prop7_2	pairs2	interior	58.07	9.55	9.87	0.0	12.61	1.2
prop7_3	pairs2	interior	41.49	16.08	3.63	9.17	0.0	1.2
prop8_1	pairs2	interior	43.23	9.45	9.06	3.08	9.43	1.4
prop8_2	pairs2	interior	19.76	21.13	14.37	0.0	0.96	1.3
prop8_3	pairs2	interior	27.74	18.98	7.08	14.17	8.14	1.4
ng_008	walltool	interior	28.78	22.52	23.85	4.09	1.2	3.5	0.9086	0.36	2.5	30.93	0.9409	0.52	0.86	22.85

Per-frame pipeline vs Fotello

de00_full	de00_wall	de00_ceiling	de00_glass	ecc_to_fotello	ecc_to_input	geom_shift_px	hp_corr_wall	hp_corr_ceiling	wall_cov_pct	name	wall_strength	window_amount	mask_method	ceiling_cov_pct	floor_cov_pct
5.75	4.9	5.38	6.33	0.6947	0.9749	0.029	0.824	0.825	39.97	chan_003	0.7	0.8	semseg	4.82	8.65
10.21	3.84	4.67	6.02	0.9833	0.9884	0.031	0.858	0.826	40.73	chan_004	0.7	0.8	semseg	6.98	14.98
9.35	4.69	3.47	7.37	0.983	0.9854	0.021	0.791	0.827	51.92	chan_005	0.7	0.8	semseg	8.69	10.37
5.0	2.8	3.07	5.1	0.957	0.9354	0.049	0.366	0.717	56.63	chan_006	0.7	0.8	semseg	11.15	0.0
9.99	7.57	3.65	5.18	0.9363	0.9848	0.009	0.916	0.785	30.2	chan_008	0.7	0.8	semseg	19.18	16.82
10.22	4.85	4.4	4.77	0.9527	0.9904	0.018	0.736	0.781	25.17	chan_009	0.7	0.8	semseg	21.43	14.97
15.8	6.1	14.0	12.06	0.8901	0.9953	0.012	0.929	0.78	8.88	golf_017	0.7	0.8	semseg	25.79	25.2
16.66	14.49	10.05		0.9593	0.9634	0.106	0.931	0.925	33.15	mont_099	0.7	0.8	semseg	4.43	9.53
13.2	13.84	10.71	9.21	0.9342	0.975	0.01	0.89	0.979	10.9	prop1_1	0.7	0.8	semseg	3.96	3.48
7.69	5.35	13.62	7.5	0.8307	0.9692	0.043	0.819	0.928	34.25	prop1_2	0.7	0.8	semseg	4.42	1.89
13.3	6.1	14.97	10.78	0.9131	0.9549	0.02	0.863	0.988	23.87	prop1_3	0.7	0.8	semseg	24.41	2.04
29.03	39.49	36.26	40.8	-0.0556	0.9829	0.016	0.919	0.975	4.72	prop2_1	0.7	0.8	semseg	6.1	1.42
9.33	5.27	10.36		0.8824	0.9913	0.005	0.881	0.973	21.58	prop2_2	0.7	0.8	semseg	9.67	9.04
7.84	6.01	6.58		0.8786	0.9732	0.009	0.942	0.941	22.35	prop2_3	0.7	0.8	semseg	0.13	0.36
19.75				0.5498	0.9832	0.002	nan	nan	0.0	prop3_1	0.7	0.8	semseg	0.0	0.0
13.12	9.61	13.82	16.62	0.6623	0.9568	0.028	0.742	0.934	12.28	prop3_2	0.7	0.8	semseg	17.37	11.53
8.78	4.35	10.56	9.63	0.7439	0.9657	0.03	0.813	0.935	27.65	prop3_3	0.7	0.8	semseg	26.79	7.32
10.74	3.62	8.42	10.48	0.9237	0.9687	0.092	0.618	0.977	27.56	prop4_1	0.7	0.8	semseg	24.41	12.95
9.35	10.79	6.96	6.99	0.8598	0.968	0.028	0.919	0.98	15.92	prop4_2	0.7	0.8	semseg	8.88	2.4
10.23	3.89	3.31	6.37	0.8994	0.983	0.021	0.711	0.951	16.56	prop4_3	0.7	0.8	semseg	29.22	22.91
23.24	20.71			0.6117	0.9857	0.002	0.928	nan	0.21	prop5_1	0.7	0.8	semseg	0.0	0.0
16.54				0.7594	0.9932	0.0	nan	nan	0.0	prop5_2	0.7	0.8	semseg	0.0	0.0
22.57	24.18	26.27		0.4996	0.9582	0.008	0.985	0.988	46.01	prop5_3	0.7	0.8	semseg	0.45	0.0
10.23	3.81	10.05	14.07	0.6914	0.9519	0.044	0.821	0.964	33.07	prop6_1	0.7	0.8	semseg	23.81	22.23
8.33	3.1	7.78	13.63	0.8271	0.9621	0.112	0.801	0.991	40.34	prop6_2	0.7	0.8	semseg	22.86	25.58
11.37	10.95	14.77	14.81	0.3274	0.9278	0.126	0.667	0.856	58.03	prop6_3	0.7	0.8	semseg	16.89	16.18
8.37	6.24	10.4	13.94	0.8182	0.945	0.006	0.841	0.964	54.25	prop7_1	0.7	0.8	semseg	9.88	12.09
7.65	5.15	6.37		0.8843	0.9494	0.042	0.871	0.991	58.07	prop7_2	0.7	0.8	semseg	9.55	9.87
6.61	3.91	6.82	9.29	0.8103	0.9484	0.066	0.823	0.991	41.49	prop7_3	0.7	0.8	semseg	16.08	3.63
8.5	3.77	5.67	7.84	0.9581	0.9797	0.067	0.793	0.991	43.23	prop8_1	0.7	0.8	semseg	9.45	9.06
12.39	9.07	9.94		0.901	0.9799	0.013	0.984	0.973	19.76	prop8_2	0.7	0.8	semseg	21.13	14.37
8.55	5.06	3.32	8.91	0.88	0.9677	0.022	0.802	0.994	27.74	prop8_3	0.7	0.8	semseg	18.98	7.08

Frames (IN · Fotello · ours · masks · intermediates)

chan_003

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

chan_004

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

chan_005

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

chan_006

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

chan_008

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

chan_009

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

golf_017

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

mont_099

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop1_1

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop1_2

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop1_3

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop2_1

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop2_2

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop2_3

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop3_1 (exterior/aerial — surface masks not meaningful)

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop3_2

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop3_3

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop4_1

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop4_2 (exterior/aerial — surface masks not meaningful)

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop4_3 (exterior/aerial — surface masks not meaningful)

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop5_1 (exterior/aerial — surface masks not meaningful)

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop5_2 (exterior/aerial — surface masks not meaningful)

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop5_3

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop6_1

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop6_2

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop6_3

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop7_1

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop7_2

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop7_3

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop8_1

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop8_2

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth

prop8_3

fotello

final

overlay

input

window

recolour

flatten

wall_mask

ceiling_mask

floor_mask

window_mask

depth