raghmura

Raghmura's workspace

Runs

Avg_Q_Values

cumulative_avg_reward

cumulative_avg_reward-10

cumulative_avg_reward-100

cumulative_avg_reward-200

cumulative_avg_reward-50

cumulative_avg_reward-500

episode_reward-10

episode_reward-100

episode_reward-200

episode_reward-50

episode_reward-500

episodic_reward

total_Q

Finished

raghmura

5y ago

4m 16s

100

3.07418

212.5

180

Finished

raghmura

5y ago

3m 34s

100

1.65056

266.7

260

Finished

raghmura

5y ago

3m 59s

100

13.51968

136.85

Finished

raghmura

5y ago

3m 43s

100

1.46253

272.85

270

Crashed

raghmura

5y ago

1h 45m 20s

100

74.45

Crashed

raghmura

5y ago

1h 34m 2s

100

139.15

[80,70,215,168.75,179,175,197.1428571428571,182.5,166.11111111111111,158.5,148.1818181818182,155,153.84615384615384,151.42857142857142,145.66666666666666,147.8125,152.05882352941177,148.61111111111111,154.21052631578948,150.25,149.52380952380952,151.13636363636363,156.52173913043478,153.125,153.6,150,144.62962962962962,142.5,145.68965517241378,141.5,139.19354838709677,139.6875,137.87878787878788,136.76470588235293,133.85714285714286,132.08333333333334,138.64864864864865,136.44736842105263,138.33333333333334,140,141.58536585365854,146.54761904761904,143.8372093023256,144.3181818181818,142.22222222222223,141.30434782608697,140.4255319148936,138.75,137.55102040816325,137.4,139.80392156862746,139.71153846153845,137.9245283018868,140.1851851851852,140.8181818181818,138.66071428571428,138.24561403508773,136.89655172413794,136.35593220338984,135.83333333333334,134.34426229508196,134.75806451612902,133.17460317460316,133.28125,136.07692307692307,134.62121212121212,133.73134328358208,133.16176470588235,132.53623188405797,131.85714285714286,130.28169014084506,129.79166666666666,129.58904109589042,128.71621621621622,127.73333333333332,126.71052631578948,125.1948051948052,125.25641025641026,124.873417721519,124.3125,126.66666666666669,125.91463414634148,125,124.22619047619048,123.23529411764706,122.55813953488372,123.27586206896552,123.75,127.69662921348316,128.83333333333334,128.5164835164835,130.81521739130434,131.0215053763441,131.27659574468086,133.10526315789474,132.1875,133.71134020618555,133.3673469387755,132.22222222222223,132.9]

[140,117.5,93.33333333333331,85,84,110,112.14285714285714,112.5,107.22222222222224,109,104.54545454545456,102.08333333333331,96.92307692307692,98.57142857142856,107.33333333333331,125.3125,120.88235294117646,117.5,112.36842105263158,125.25,121.9047619047619,134.77272727272728,133.04347826086956,130.20833333333334,128.6,128.46153846153845,129.44444444444446,125.89285714285714,121.89655172413794,126.5,123.87096774193547,125,121.8181818181818,119.26470588235294,119.71428571428572,124.86111111111111,124.32432432432432,140.1315789473684,144.6153846153846,143.875,142.9268292682927,140.71428571428572,138.48837209302326,142.95454545454547,141.55555555555554,139.67391304347825,137.87234042553192,140.72916666666666,139.18367346938774,137.9,136.1764705882353,139.03846153846155,138.39622641509433,137.3148148148148,135.45454545454547,134.64285714285714,133.68421052631578,135.25862068965515,135.5084745762712,133.75,133.11475409836066,132.25806451612902,132.22222222222223,131.40625,135,133.78787878787878,135.7462686567164,134.63235294117646,132.7536231884058,132.42857142857142,134.1549295774648,139.58333333333334,138.63013698630138,137.5,136.26666666666668,135.26315789473685,137.01298701298705,135.7051282051282,135.18987341772151,134.4375,135.4320987654321,139.26829268292684,140,139.4047619047619,138.7058823529412,142.5,141.49425287356323,141.5909090909091,142.6966292134831,142.88888888888889,141.92307692307693,141.68478260869566,140.3763440860215,140.2659574468085,139,140.67708333333334,139.48453608247422,138.87755102040816,137.57575757575756,139.15]

[155,257.5,196.66666666666663,158.75,151,218.33333333333337,212.1428571428571,193.125,186.66666666666663,178,175,170.83333333333334,160.3846153846154,153.57142857142858,152.66666666666666,150.9375,144.11764705882354,138.88888888888889,135,130,134.52380952380952,130.45454545454547,126.7391304347826,124.79166666666669,121.8,121.73076923076924,120.37037037037037,122.5,121.03448275862068,119.66666666666669,121.7741935483871,121.40625,119.0909090909091,120.29411764705884,120.14285714285714,119.86111111111111,117.29729729729728,114.60526315789474,115.12820512820512,114.5,119.26829268292684,120.23809523809524,118.83720930232558,117.8409090909091,115.77777777777776,115.7608695652174,118.51063829787236,124.0625,123.26530612244898,122.3,120.49019607843135,121.25,119.90566037735849,119.72222222222224,119,119.10714285714286,119.47368421052632,126.8103448275862,125.67796610169492,123.91666666666669,125.90163934426228,125.56451612903226,130.3968253968254,131.40625,136.76923076923077,135.15151515151516,135.29850746268656,134.7058823529412,136.44927536231884,135.35714285714286,137.46478873239437,136.45833333333334,135.06849315068493,135.47297297297297,137.2,136.51315789473685,136.88311688311688,135.96153846153845,136.8987341772152,135.4375,134.320987654321,133.23170731707316,132.65060240963857,132.79761904761904,131.64705882352942,136.04651162790697,135.91954022988506,135.45454545454547,135.1123595505618,134.94444444444446,134.12087912087912,134.83695652173913,133.70967741935485,133.51063829787233,132.3684210526316,132.08333333333334,131.75257731958763,131.6326530612245,130.5050505050505,131.15]

[80,60,505,30,220,155,330,80,35,90,45,230,140,120,65,180,220,90,255,75,135,185,275,75,165,60,5,85,235,20,70,155,80,100,35,70,375,55,210,205,205,350,30,165,50,100,100,60,80,130,260,135,45,260,175,20,115,60,105,105,45,160,35,140,315,40,75,95,90,85,20,95,115,65,55,50,10,130,95,80,315,65,50,60,40,65,185,165,475,230,100,340,150,155,305,45,280,100,20,200]

[140,95,45,60,80,240,125,115,65,125,60,75,35,120,230,395,50,60,20,370,55,405,95,65,90,125,155,30,10,260,45,160,20,35,135,305,105,725,315,115,105,50,45,335,80,55,55,275,65,75,50,285,105,80,35,90,80,225,150,30,95,80,130,80,365,55,265,60,5,110,255,525,70,55,45,60,270,35,95,75,215,450,200,90,80,465,55,150,240,160,55,120,20,130,20,300,25,80,10,295]

[155,360,75,45,120,555,175,60,135,100,145,125,35,65,140,125,35,50,65,35,225,45,45,80,50,120,85,180,80,80,185,110,45,160,115,110,25,15,135,90,310,160,60,75,25,115,245,385,85,75,30,160,50,110,80,125,140,545,60,20,245,105,430,195,480,30,145,95,255,60,285,65,35,165,265,85,165,65,210,20,45,45,85,145,35,510,125,95,105,120,60,200,30,115,25,105,100,120,20,195]

295

Crashed

raghmura

5y ago

34m 44s

100

214.9

[290,227.5,228.33333333333337,241.25,229,279.1666666666667,265,258.125,245.55555555555551,232.5,224.0909090909091,218.33333333333337,214.6153846153846,233.92857142857144,263.6666666666667,250.3125,240.2941176470588,238.61111111111111,247.8947368421053,251,249.04761904761904,240.22727272727272,235.8695652173913,244.16666666666663,241.6,242.30769230769232,237.40740740740745,232.8571428571429,231.3793103448276,229.66666666666663,228.5483870967742,227.96875,226.8181818181818,226.3235294117647,229.42857142857144,227.08333333333337,223.3783783783784,221.05263157894737,218.07692307692307,217.75,215.85365853658536,212.5,211.86046511627907,211.9318181818182,211.22222222222223,208.91304347826087,213.51063829787233,213.85416666666663,214.18367346938777,219.4,224.1176470588235,223.26923076923077,223.0188679245283,224.44444444444449,224.1818181818182,222.67857142857144,220.7017543859649,219.74137931034485,219.0677966101695,217.16666666666663,216.31147540983608,220.24193548387095,220.47619047619048,220.078125,219.46153846153845,219.3181818181818,218.73134328358208,217.1323529411765,216.231884057971,215.71428571428572,214.7887323943662,212.91666666666663,212.46575342465752,213.17567567567568,213.13333333333333,212.69736842105263,212.27272727272728,213.84615384615384,213.41772151898735,213.5625,214.69135802469137,214.26829268292684,213.85542168674695,213.45238095238096,213.47058823529412,212.4418604651163,212.41379310344828,210.9090909090909,210.1685393258427,209.88888888888889,210.71428571428572,209.8913043478261,209.56989247311827,210.37234042553192,210.05263157894737,208.95833333333337,208.5051546391753,208.87755102040816,214.6969696969697,214.9]

[290,165,230,280,180,530,180,210,145,115,140,155,170,485,680,50,80,210,415,310,210,55,140,435,180,260,110,110,190,180,195,210,190,210,335,145,90,135,105,205,140,75,185,215,180,105,425,230,230,475,460,180,210,300,210,140,110,165,180,105,165,460,235,195,180,210,180,110,155,180,150,80,180,265,210,180,180,335,180,225,305,180,180,180,215,125,210,80,145,185,285,135,180,285,180,105,165,245,785,235]

235

Crashed

raghmura

5y ago

24m 7s

100

278.8

[630,715,571.6666666666666,628.75,553,489.1666666666667,452.8571428571428,430.625,398.3333333333333,383,375,367.5,356.9230769230769,341.07142857142856,330,320.3125,318.2352941176471,307.5,305.5263157894737,305,297.14285714285717,294.3181818181818,293.9130434782609,293.9583333333333,291.6,288.2692307692308,287.962962962963,283.2142857142857,283.1034482758621,283.5,282.258064516129,279.21875,276.3636363636364,275.1470588235294,274.42857142857144,273.05555555555554,280,278.8157894736842,278.97435897435895,278.75,278.4146341463415,279.04761904761904,279.8837209302326,279.8863636363636,279.8888888888889,279.3478260869565,279.468085106383,279.1666666666667,278.57142857142856,282.5,281.37254901960785,281.4423076923077,280.5660377358491,281.01851851851853,287,286.42857142857144,286.4035087719298,284.82758620689657,284.8305084745763,285.0833333333333,287.37704918032784,286.53225806451616,286.26984126984127,290.3125,290.46153846153845,298.1818181818182,298.13432835820896,297.94117647058823,297.82608695652175,296.85714285714283,295.7042253521127,294.44444444444446,293.63013698630135,292.8378378378378,292.26666666666665,291.5131578947368,295.1948051948052,294.29487179487177,294.24050632911394,293.875,292.9012345679012,292.7439024390244,291.26506024096386,290.23809523809524,289.8235294117647,289.7093023255814,289.08045977011494,288.40909090909093,287.5280898876405,287.1666666666667,286.8131868131868,285.9782608695652,286.18279569892474,284.9468085106383,284.7368421052632,283.6979166666667,283.96907216494844,284.18367346938777,284.34343434343435,283.75]

[315,292.5,291.6666666666667,293.75,269,265.8333333333333,310,313.75,336.6666666666667,330,321.8181818181818,306.6666666666667,303.0769230769231,302.14285714285717,295.3333333333333,290.9375,290.5882352941176,293.8888888888889,295,292.75,287.6190476190476,283.40909090909093,281.30434782608694,281.25,281,276.7307692307692,272.22222222222223,273.0357142857143,272.7586206896552,271,278.7096774193548,283.90625,282.42424242424244,282.79411764705884,280.57142857142856,279.8611111111111,280,281.57894736842104,281.6666666666667,281.625,280.2439024390244,280.5952380952381,278.72093023255815,277.95454545454544,277,276.0869565217391,276.59574468085106,276.7708333333333,275.81632653061223,275,275.29411764705884,275.38461538461536,273.1132075471698,270.74074074074076,271.8181818181818,270.98214285714283,270.17543859649123,269.05172413793105,268.5593220338983,271.3333333333333,270.9016393442623,271.3709677419355,271.984126984127,270.9375,271.0769230769231,271.43939393939394,269.7014925373134,270.22058823529414,270.3623188405797,273.57142857142856,276.83098591549293,276.1111111111111,278.4246575342466,278.44594594594594,285.4,285.5921052631579,286.1038961038961,284.2307692307692,286.0126582278481,288.8125,288.14814814814815,288.0487804878049,288.1927710843373,287.32142857142856,287.2352941176471,286.27906976744185,286.37931034482756,285.0568181818182,284.9438202247191,284.5,284.1758241758242,283.64130434782606,285.21505376344084,285.21276595744683,287.3157894736842,287.2395833333333,286.44329896907215,286.4795918367347,285.45454545454544,285.35]

[280,247.5,261.6666666666667,233.75,237,230,230.71428571428572,228.125,223.88888888888889,229.5,228.63636363636363,234.58333333333337,230.76923076923077,228.92857142857144,229.33333333333337,227.1875,227.05882352941177,241.94444444444449,241.05263157894737,250.25,247.1428571428571,246.13636363636363,247.6086956521739,248.75,249.4,251.15384615384616,249.07407407407408,250.71428571428572,250.86206896551724,250.66666666666663,251.6129032258065,251.40625,252.27272727272728,255.44117647058823,256.2857142857143,262.77777777777777,259.4594594594595,258.1578947368421,265.5128205128205,264.5,265.1219512195122,271.1904761904762,276.74418604651163,275.5681818181818,275.6666666666667,274.7826086956522,273.93617021276594,274.1666666666667,274.8979591836735,273,273.1372549019608,289.03846153846155,288.6792452830189,288.8888888888889,287.90909090909093,288.125,287.9824561403509,287.32758620689657,286.77966101694915,285.8333333333333,285.8196721311475,285,285.07936507936506,284.921875,284.46153846153845,284.54545454545456,284.6268656716418,283.97058823529414,282.536231884058,281.85714285714283,280.7042253521127,281.0416666666667,286.3013698630137,285.47297297297297,283.53333333333336,283.35526315789474,285.5194805194805,285.2564102564103,284.8101265822785,284.1875,283.58024691358025,282.8658536585366,282.28915662650604,281.25,280.7647058823529,281.74418604651163,281.95402298850576,280.7386363636364,281.0112359550562,279.72222222222223,279.6703296703297,279.7826086956522,279.35483870967744,280.3723404255319,280.10526315789474,279.5833333333333,279.58762886597935,279.1326530612245,279.24242424242425,278.8]

[335,280,356.6666666666667,313.75,286,277.5,281.42857142857144,275.625,295,291.5,290.45454545454544,279.5833333333333,273.46153846153845,273.92857142857144,284,283.75,277.94117647058823,277.77777777777777,275.5263157894737,271,270.23809523809524,268.8636363636364,266.30434782608694,265,266.2,263.0769230769231,263.51851851851853,263.92857142857144,264.6551724137931,264.6666666666667,265.16129032258067,262.1875,263.030303030303,260.1470588235294,267.2857142857143,266.25,272.8378378378378,271.8421052631579,272.6923076923077,271,269.6341463414634,269.76190476190476,270,269.77272727272725,267.44444444444446,267.7173913043478,266.8085106382979,265.8333333333333,266.9387755102041,265.9,269.01960784313724,267.11538461538464,265,265.27777777777777,264.54545454545456,265,265.6140350877193,265.86206896551727,266.0169491525424,264.4166666666667,263.8524590163934,263.6290322580645,264.12698412698415,264.609375,264.9230769230769,264.1666666666667,264.4776119402985,263.0882352941176,266.30434782608694,265.35714285714283,266.1267605633803,270.27777777777777,269.3150684931507,269.18918918918916,271.26666666666665,270.85526315789474,270.2597402597403,270.12820512820514,270.50632911392404,270.6875,270.55555555555554,270.7317073170732,271.26506024096386,271.1309523809524,271.29411764705884,271.45348837209303,271.7816091954023,273.52272727272725,273.59550561797755,273.5,273.24175824175825,273.4782608695652,273.2258064516129,273.13829787234044,276,276.09375,276.44329896907215,275.9183673469388,274.8484848484849,275.15]

[630,800,285,800,250,170,235,275,140,245,295,285,230,135,175,175,285,125,270,295,140,235,285,295,235,205,280,155,280,295,245,185,185,235,250,225,530,235,285,270,265,305,315,280,280,255,285,265,250,475,225,285,235,305,610,255,285,195,285,300,425,235,270,545,300,800,295,285,290,230,215,205,235,235,250,235,575,225,290,265,215,280,170,205,255,280,235,230,210,255,255,210,305,170,265,185,310,305,300,225]

[315,270,290,300,170,250,575,340,520,270,240,140,260,290,200,225,285,350,315,250,185,195,235,280,275,170,155,295,265,220,510,445,235,295,205,255,285,340,285,280,225,295,200,245,235,235,300,285,230,235,290,280,155,145,330,225,225,205,240,435,245,300,310,205,280,295,155,305,280,495,505,225,445,280,800,300,325,140,425,510,235,280,300,215,280,205,295,170,275,245,255,235,430,285,485,280,210,290,185,275]

[280,215,290,150,250,195,235,210,190,280,220,300,185,205,235,195,225,495,225,425,185,225,280,275,265,295,195,295,255,245,280,245,280,360,285,490,140,210,545,225,290,520,510,225,280,235,235,285,310,180,280,1100,270,300,235,300,280,250,255,230,285,235,290,275,255,290,290,240,185,235,200,305,665,225,140,270,450,265,250,235,235,225,235,195,240,365,300,175,305,165,275,290,240,375,255,230,280,235,290,235]

[335,225,510,185,175,235,305,235,450,260,280,160,200,280,425,280,185,275,235,185,255,240,210,235,295,185,275,275,285,265,280,170,290,165,510,230,510,235,305,205,215,275,280,260,165,280,225,220,320,215,425,170,155,280,225,290,300,280,275,170,230,250,295,295,285,215,285,170,485,200,320,565,200,260,425,240,225,260,300,285,260,285,315,260,285,285,300,425,280,265,250,295,250,265,545,285,310,225,170,305]

235

Finished

This is a DQN based implementation trained over 1 million frames. The notebook can be found in below path - https://drive.google.com/open?id=1LxOTjA8J_i_rhtIZRMa1dDVGG6gqzh2d

raghmura

5y ago

8h 21m 34s

348.33333

365

Finished

This is based on the A3C algorithm without LSTM and without shared optimizer with 8 processes and each of them running to a max of 1.6 million frames thus training for a total of 12.8 million frames. The notebook for this can be found at below path - https://drive.google.com/open?id=1Lh9PD6I1c1TeYsLRaNUsKux896isO7h9

raghmura

5y ago

11h 7m 28s

129

110

1-10

of 93