2 Commits

Author	SHA1	Message	Date
George Hotz	c36d306606	KOPT is over, BEAM is upstream (#2071) ... * create cache for q learning * make linter happy * global beam * where it belongs * bugfix * ditch the kopt, use the beam * faster lin and DEBUG=2 okay * remove kopt, move search to features	2023-10-16 09:46:03 -07:00
George Hotz	6f1810af2d	with unroll, the action space goes from 161 -> 127 (#2060) ... * with unroll, the action space goes from 161 -> 127 * more reliable instrumentation * beam search is so op * beam bugfix	2023-10-12 20:52:23 -07:00