31 Commits

Author SHA1 Message Date
Alberto Soutullo
ceab94f247 Nomos testing in master (#141)
* Changed gennet to generate simple nomos topology

* Added nomos node to build.sh

* Updated nomos yaml trait

* Added nomos variables to system_variables.star

* Prepared nomos_builder.star

* Modify gennet to work with nomos topology and traits

* Gennet currently doesn't support mixed topologies between waku and nomos nodes.

* Restructured config.json to add separated testing and simulation functionalities

* Added assertions.star file

* Modified wakurtosis to set up integration tests

* Updated kurtosis version in README.md
2023-07-30 13:42:18 +02:00
Alberto Soutullo
306fd03067 Downgrading kurtosis version because of docker subnetwork limitation 2023-07-17 18:05:22 +02:00
Alberto Soutullo Rendo
6f7e960362 Solved conflicts with prometheus dump 2023-07-15 12:52:17 +02:00
Alberto
ef56eab3d7 Fixed bug in build.sh 2023-06-13 11:25:44 +02:00
Alberto Soutullo Rendo
dfe6588e43 commented wrong lines 2023-06-12 18:00:50 +02:00
Alberto
81e7d9546c Fixed bug in build.sh 2023-06-12 17:02:39 +02:00
Alberto Soutullo
3f09c5fc95 Resolved conflicts with main 2023-06-09 17:38:49 +02:00
Alberto Soutullo
d014ba2713 Cleaned files after cleaning git cache 2023-06-09 13:19:27 +02:00
Alberto Soutullo
3c206431a1 Deleted comment with older kurtosis version 2023-06-09 12:55:15 +02:00
0xFugue
996b7323f4 dstats/host-proc analysis (#125)
* cli scaffolding for processings metrics

* pandas description: dstats

* added dstats columns

* added procfs columns

* prune procfs/dstats columns

* sanitize, convert dstats

* re-write dstats and size conversion

* faster Human2ByteConveter

* dstats violin plots

* dstats, all plots, cdf

* all plots, pdf

* added prefix option

* option for cdf/pdf plots

* add jordis propagation delay calc - partial

* dstats takes only one arg now

* refactor jordis module

* added file check to dstats

* make analysis classes singleton

* ProcFS read/processing

* refactoring; added Plot baseclass

* added TODO

* Plot, violin_plots_helper()

* added ContainerID

* procfs plots - v0

* add rpc/metrics and update config.json

* added settling time plots

* setting labels

* added InOctets/OutOctets

* procfs plots - v1

* MiBs

* TODO

* change perms for prometheus and grafana configs

* conditional import tomli/tomllib

* BLKR/BLKW in MiB

* grafana dashboard

* run.sh refactoring

* dstats is now a standalone module

* added dstats dir

* bug fix

* fast pid2node_name

* kurtosis version check

* dstats bug fix

* bug fix

* dstats analysis - v2

* container2node_name via kurtosis inspect

* added dstats to cleanup

* dstats - container2name - v3

* dstats - v3

* host-proc - v2

* delete old host-proc launcher

* host-proc - v2: inline cpu stats

* host proc v2 : analysis : cpu stats

* add kinspect to host-proc

* host-proc-helper.sh

* host-proc v4

* plots 4 total and avg metrics

* clusters: kmeans

* per container clusters

* panelling is now class-wide

* per container clusters

* take care of incomplete samples

* extract the maximal, complete sample set

* grouping is now done by Key + removed HWM

* host-proc bug fix

* uniformise run.sh conditionals

* bug fix run.sh

* --full-uuids

* remove kurtosis inspect altogether

* cleanup run.sh

* kurtosis run cleanup

* added container size

* host-proc-helper.py

* run.sh

* incorporated config.json

* run.sh

* analysis.py

* config.json .plotting.host-proc

* conditional histograms - v0

* host-proc-helper.py omit fields

* conditional histograms

* compare plots done

* config.json dstats/host-proc

* config.json dstats/host-proc

* dstats/host-proc plotting run.sh

* run.sh

* cmd_helper

* analysis requirements.txt

* monitoring/host-proc/analysis.py -> analysis-module/src/hproc.py

* run.sh

* make top_plot strict

* remove/modify prints

* cleanup the old dockers

* set default to compare plots

* hproc.py

* src/main.py

* Dockerfile main.py

* plot_compare_panel

* set common --out-prefix

* build.sh

* work around ifindex issues

* run.sh: synchronous sudo and supressed analysis output

* run.sh

* venv for host-proc

* cleanup container-proc outputs

* add run summary to plot titles

* delete monitoring/host-proc/analysis.py

* remove log.info()

* host-proc: profile only wakunodes with config

* col rename, output plot dir, medians

* CPU % fixed

* export all plots to wakurtosis_log

* setting defaults to config.json

* config.json: num_nodes >= fanout

* run.sh plot dirs

* MemUse to VmPeak/VmSize is now configurable

* install python3-venv

* K -> KiB; i -> fo in summary
2023-06-08 14:11:36 +05:30
Alberto Soutullo
ffeb01283e Updated kurtosis version to 0.77 2023-05-27 20:40:56 +02:00
Daimakaimura
6acfe22698 Deleted old container-proc monitoring venv build 2023-05-22 12:55:46 +01:00
Daimakaimura
5895030fc4 Added container-proc build image 2023-05-19 11:17:57 +01:00
Daimakaimura
35c18ac220 Move cproc venv to root 2023-05-18 08:46:50 +01:00
Daimakaimura
fea0d10384 Calls analysis build script instead 2023-05-11 07:47:13 +01:00
Daimakaimura
ececad6e66 Added container-proc venv creation 2023-05-11 07:00:42 +01:00
Daimakaimura
885cc9ac65 Added analysis build 2023-05-05 11:42:30 +01:00
0xFugue
cf24c7f44e removed tomli, traits into dockerfile, build/run context update (#104)
* removed tomli, traits into dockerfile, build/run context update

* issue 98

* build_docker.sh, --traits-dir

* minor edits
2023-04-18 16:56:55 +02:00
Alberto Soutullo
bde6a0e18d Updated Kurtosis version to 0.70.2 2023-03-27 16:43:24 +02:00
Alberto Soutullo
8f34f0cdc3 Updated kurtosis version to 0.67.3 2023-03-16 17:30:44 +01:00
Gusto Bacvinka
2df81532ec Simplify dockerfiles and mark files as executable 2023-03-10 12:41:00 +01:00
Alberto Soutullo
13ebdea853 Renamed propperly WSL to WLS to avoid confussions 2023-03-10 12:40:54 +01:00
Alberto
035fbc9379 Modified runner and wakurtosis to add cadvisor to the enclave. Also updated kurtosis version 2023-02-27 13:40:59 +01:00
0xFugue
400c76ac13 cleaned up build.sh, fixed gennet run.sh, updated gennet (#85)
* cleaned up build.sh and run.sh, updated gennet

* port-shift to port_shift
2023-02-16 17:07:12 +05:30
guillaume.bouvignies
ab6f7b671c Upgrade Kurtosis and fix breaking changes 2023-02-09 10:05:19 +01:00
Jordi Arranz
64a562e0d6 Typo: container names were mixed up 2023-01-26 10:24:32 +00:00
Alberto Soutullo
a3397f67b0 Added gowaku docker image to runsh since it is not up to date in dockerhub 2023-01-22 20:25:28 +01:00
Alberto Soutullo
f9b9e82ff9 Added docker build for gennet and wsl into build.sh 2023-01-21 17:34:54 +01:00
Alberto Soutullo
1f714e9670 Updated kurtosis version to 0.64.2 2023-01-19 19:25:22 +01:00
Alberto Soutullo
e27038d31e Modified build to get specific version of kurtosis 2023-01-18 16:35:52 +01:00
Alberto Soutullo
36a354a4e1 Created a build.sh to install docker and kurtosis, that are the only things needed to run this repo 2023-01-18 15:06:59 +01:00