Skip to main content

MMMultiSphere (v02): BC_PCL_PNet2_avg_ee

Now doing the multi-sphere env with 1 distractor (might be hard). Here we have the segmentation PN++ with an averaging layer so we backprop through the average.
Created on April 21|Last edited on April 25
(0.4024+ 0.269 + 0.232) / 3 = 0.3011

Train/Eval MSEs, Episode Success/Reward


50100150200Step0.050.060.070.080.09
050100150200Step0.10.150.20.25
050100150200Step00.20.40.60.8
Run set
3


Example GIFs

First seed after 250. OH ... it seems to be getting confused between balls, interesting. They have different labels in the segmented point clouds, though...

Second seed after 250. This actually gets 0% performance, because it seems to be picking the red ball?? I wonder if this is a function of there not being that many points in the point cloud? Interestingly that could be something we might need to innovate on, if there's something more we can do for object-centric relationships between the ladle and the points?

Third seed after 250. Once again, it's getting the red ball?? Oh, actually if the yellow ball isn't visible, it's not going to be accounted for in any points, so maybe the network might be getting to that red one if the one-hot label isn't a strong enough signal?