polygon cell geometry of Baysor segmentation vs Xenium

[alipirani88]

Hi @VPetukhov

I ran baysor with the following parameters:
-m 50 -p --prior-segmentation-confidence 0.2 --scale-std 0.8 --scale 5 --save-polygons GeoJSON

I see the cell boundaries are drawn like a polygon compare to xenium cell boundaries which seems to be more uniform. Is this expected from Baysor or did something went wrong during the segmentation?

I also see Baysor finding cells of unusual shapes and size in areas which Xenium segmentation is missing? I am not sure what to make ofit?

I would appreciate your thoughts on it.

[alipirani88]

Also, the xenium sample is a multi tissue array - can baysor handle multi-tissue arrays ?

[VPetukhov]

Hi @alipirani88 ,

I see the cell boundaries are drawn like a polygon compare to xenium cell boundaries which seems to be more uniform. Is this expected from Baysor or did something went wrong during the segmentation?

Yes, that's how Baysor usually outputs polygons. It's a variation of a concave hull algorithm.

I also see Baysor finding cells of unusual shapes and size in areas which Xenium segmentation is missing? I am not sure what to make ofit?

Regions without prior segmentation are segmented de-novo. If you think that their size is too large, you can either manually provide scale parameter and set it to a smaller value, or you can filter the final segmentation results by cell area.

Also, the xenium sample is a multi tissue array - can baysor handle multi-tissue arrays ?

Baysor assumes uniform cell sizes, which can be violated in multi-tissue arrays. It can also be violated within the same tissue, but if that's the case see #140. That can be a reason why you see cells of unusual size. Also, in multi-tissue arrays NCV coloring would capture tissue differences instead of cell types. So, it would be better to split the data by tissue before Baysor.