DST - Update commitments (#326)

This commit is contained in:
Alberto Soutullo
2025-11-04 07:52:05 +01:00
committed by GitHub
parent c068161aea
commit d99b483997
2 changed files with 87 additions and 0 deletions

View File

@@ -0,0 +1,84 @@
---
title: Codex Evaluation
tags:
- "2025q4"
- "dst"
- "codex"
draft: false
description: "Test Codex on each new version or requested feature
and look for regressions,
learn scaling properties and run scaling studies."
---
`vac:dst:codex:2025q4-codex-evaluation`
## Description
Test Codex on each new version or requested feature
and look for regressions if this is required.
Help Codex with testing and benchmarking new features.
### Background
We want to learn specific, actionable information
about Codex's behaviour
and how it is evolving over time
with each new release
and with each thing we are specifically asked to check and test.
We will use a combination of real world testing,
theoretical analysis and experiments.
### Narratives
We will support the Conduit of Expertise narrative directly
by analysing and evaluating new Codex releases and their features,
both with regards to features they have today
and with regards to how that compares to past behaviour.
We will:
* Enable improvements to Codex
by allowing for repeatable, measureable
and real world insights into Codex,
all the way from theory to practice and back.
* Reduce the risk of a Codex regression
making it into a new release of Codex.
Additionally, these efforts will contribute
to the Premier Research destination narrative by:
* Improving and strengthening our relationship with the Codex team
and improving the quality and reputation of IFT's work, inside
and outside of Codex.
### Background
### Narratives
We will support the Conduit of Expertise narrative directly
by providing valuable insights to Codex
that allow them to understand how Codex performs
in comparison to common and popular systems in the "altruistic" space.
## Task List
### Codex-in-Status
* fully qualified name: `vac:dst:codex:2025q4-codex-evaluation:codex-in-status`
* owner: Alberto
* status: not started
* start-date: 2025/11/03
* end-date: 2025/11/15
#### Description
Assist the Codex team to check the functionality of
replacing bittorrent usage in status go (in the Community History Service).
Evaluate if the new feature is working as expected by trying to assert:
1. Presence of archive in filesytem
2. Presence of messages in status DB
#### Deliverables
- PRs/Issues/Docs/Reports

View File

@@ -41,6 +41,9 @@ are not only effective but also maintain or improve system performance and scala
* [[dst/waku/2025q4-waku-evaluation|waku-evaluation]]
* [[dst/waku/2025q4-waku-scaling|waku-scaling]]
### `codex`
* [[dst/codex/2025q4-codex-evaluation|codex-evaluation]]
---
## 2025q3 `vac:dst:`
---