BC03 4DoF, 1 Sphere, # of demos
Check to see how much performance varies based on # of demos.
Created on May 27|Last edited on June 4
Comment
This is designed to be the "vary # of demos" study in the spreadsheet.
For "our" method, the best performing one. Use these settings by default:
# 6D flow, but using SVD to extract actions, learning from >= 4DoF demos.SVD_POINTWISE_6D_EE2FLOW_SVD = dict(obs_type='point_cloud',act_type='ee2flow',encoder_type='pointnet_svd_pointwise_6d_flow',method_flow2act='svd',use_consistency_loss=True,lambda_consistency=0.1,scale_pcl_flow=True,scale_pcl_val=250,separate_MLPs_R_t=False,)
0010 demos:
- Did 1X run locally on 06/02/2022 (home machine).
- 06/04/2022: running 4X more on cluster
0100 demos:
0500 demos:
- NOTE: after running + investigating I made a slight error and this one has separate_MLPs_R_t = True whereas we are NOT using this for the others. However, I am convinced this is a minor thing (we can always re-run this after the deadline).
- takeshi: 1X run on 05/27/2022, 1X on 05/29/2022, 1X on 05/31/2022.
- cluster: 2X runs on 06/02/2022, that gives us the 5 we need.
Results
SVD Pointwise 6D flow, ee2flow, 500 demos
5
SVD Pointwise 6D flow, ee2flow, 10 demos
5
SVD Pointwise 6D flow, ee2flow, 100 demos
5
Add a comment