experiment notes

This commit is contained in:
Alex O'Connell
2024-03-20 23:05:22 -04:00
parent fa31682c51
commit c67759e16f
3 changed files with 61 additions and 17 deletions

View File

@@ -101,3 +101,41 @@
- 3600: 0.9736842105263158
- 4000: 0.9706477732793523
- Final: 0.9711538461538461
# rev6
- lora rank: 64, alpha: 128
- batch size: 32
- dataset size: medium (with new device types)
+ evaluation results:
- 100: 0.7545546558704453
- 200: 0.8567813765182186
- 300: 0.8977732793522267
- 400: 0.9068825910931174
- 500: 0.9261133603238867
- 600: 0.9342105263157895
- 700: 0.9407894736842105
- 800: 0.9478744939271255
- 900: 0.937246963562753
- 1000: 0.9438259109311741
- Final: 0.9453441295546559
# rev7
- lora rank: 64, alpha: 128
- epochs: 2
- batch size: 128
- dataset size: large (with fixed service names)
+ evaluation results:
- 50: 0.6022267206477733
- 100: 0.8254048582995951
- 150: 0.8689271255060729
- 200: 0.9013157894736842
- 250: 0.9073886639676113
- 300: 0.9210526315789473
- 350: 0.937753036437247
- 400: 0.9362348178137652
- 450: 0.9478744939271255
- 500: 0.9463562753036437
- 550:
- 600: 0.9473684210526315
- 650: 0.9387651821862348
- Final: 0.9463562753036437