mirror of
https://github.com/acon96/home-llm.git
synced 2026-01-08 21:28:05 -05:00
experiment notes
This commit is contained in:
@@ -101,3 +101,41 @@
|
||||
- 3600: 0.9736842105263158
|
||||
- 4000: 0.9706477732793523
|
||||
- Final: 0.9711538461538461
|
||||
|
||||
# rev6
|
||||
- lora rank: 64, alpha: 128
|
||||
- batch size: 32
|
||||
- dataset size: medium (with new device types)
|
||||
+ evaluation results:
|
||||
- 100: 0.7545546558704453
|
||||
- 200: 0.8567813765182186
|
||||
- 300: 0.8977732793522267
|
||||
- 400: 0.9068825910931174
|
||||
- 500: 0.9261133603238867
|
||||
- 600: 0.9342105263157895
|
||||
- 700: 0.9407894736842105
|
||||
- 800: 0.9478744939271255
|
||||
- 900: 0.937246963562753
|
||||
- 1000: 0.9438259109311741
|
||||
- Final: 0.9453441295546559
|
||||
|
||||
# rev7
|
||||
- lora rank: 64, alpha: 128
|
||||
- epochs: 2
|
||||
- batch size: 128
|
||||
- dataset size: large (with fixed service names)
|
||||
+ evaluation results:
|
||||
- 50: 0.6022267206477733
|
||||
- 100: 0.8254048582995951
|
||||
- 150: 0.8689271255060729
|
||||
- 200: 0.9013157894736842
|
||||
- 250: 0.9073886639676113
|
||||
- 300: 0.9210526315789473
|
||||
- 350: 0.937753036437247
|
||||
- 400: 0.9362348178137652
|
||||
- 450: 0.9478744939271255
|
||||
- 500: 0.9463562753036437
|
||||
- 550:
|
||||
- 600: 0.9473684210526315
|
||||
- 650: 0.9387651821862348
|
||||
- Final: 0.9463562753036437
|
||||
Reference in New Issue
Block a user