chore: Build streamlined (#4)

* chore: create a command for unified build and scrape flow

* chore: cleanup repo from temp folders

* feat: add new .md fetching mode

* feat: fetching through git added

* ci: add Scrape stage to the Jenkinsfile

* feat: add env variables to the Jenkinsfile

.gitignore

@@ -24,3 +24,12 @@ yalc.lock
 .idea
 
 static/search-index.json
+
+codex
+nomos
+status
+vac
+waku
+
+temp
+raw_temp