Deployment and DevOps tooling for ByteLyst
Go to file
Hermes VM eaaa545e6c feat(dashboard): close Phase 6 (trend cards + theme toggle), drop-root scaffold, Agents inventory, Phase 0 reconfirm
Closes the remaining tractable items from the carry-forward queue.

1. Drop-root scaffold for the backend container (P2 mitigation)
   `backend/Dockerfile` adds non-root `app` user (uid 1001) + `docker`
   group (gid via `DOCKER_GID` build arg, default 999). `BACKEND_USER`
   build arg defaults to `root` so existing deployments keep working;
   set it to `app` plus `DOCKER_GID=$(getent group docker | cut -d: -f3)`
   to flip the runtime non-root. `dashboard/DEPLOYMENT.md` gets a new
   "Running non-root" section with the exact `chgrp`/`chmod` recipe
   for the bind-mounted log files (the host-side prep that pairs with
   the build flip). DEPLOYMENT.md mitigation roadmap updated.

2. Phase 6 trend cards
   `lib/hermes-ops-history.ts` keeps the last 24 ops snapshots in
   localStorage (de-duped on `generatedAt`, schema-guarded on read,
   degrades silently on quota exceeded). Three trend cards in the
   ops panel:
     - Warning-volume sparkline + current count
     - Healthy-instance count sparkline (X/2)
     - Per-instance "minutes since last backup commit" with a 30m
       stale threshold
   SVG polyline sparklines, no chart library — `<svg viewBox="0 0
   100 100" preserveAspectRatio="none">` with `vector-effect:
   non-scaling-stroke` so the line stays 2px regardless of the
   parent's width.

3. Phase 6 theme toggle
   `components/theme-toggle.tsx` Sun/Moon button mounted in the
   Hermes layout next to the instance switcher. Persists in
   localStorage `bytelyst.theme.v1`. The design system already
   defined `[data-theme="light"]` overrides in `styles/tokens.css`;
   the toggle just sets the attribute. FOUC-prevention inline script
   in the root layout reads the same key BEFORE React hydrates so
   the first paint matches the user's last choice.

4. Phase 3 partial close: Agents pane → telemetry inventory
   `/hermes/agents` now renders a "Memory & Skills inventory (live)"
   SectionCard backed by the Phase 3 telemetry endpoint per instance
   — `hermes memory list` and `hermes skills list` rendered with
   per-section probe-status badges (`up`/`unknown`), item counts,
   and the first N entries each. Agent **health** statuses (latency,
   failure rate, last-success/failure) stay seed-data — observability
   for those needs a separate ingestion contract that the telemetry
   endpoint doesn't provide today.

5. Phase 0 reconfirmation
   Roadmap Phase 0 ticked with explicit verification notes for each
   guardrail (no public listener, manual approvals, secret hygiene,
   Caddy review). Remains "must hold throughout" — the ticks reflect
   today's verified state, not single-checkbox completion.

Verified: backend typecheck , 74/74 backend unit tests , web
typecheck , 7/7 E2E , lint 0 errors, build green, coverage gate
≥95% lines on every gated file.

Generated with [Devin](https://cli.devin.ai/docs)

Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-05-30 08:26:26 +00:00
_AZURE docs: remove Ollama from VM, switch to openrouter/auto 2026-03-31 01:43:35 -07:00
.gitea/workflows fix(cli): harden bytelyst-cli env loading, pagination, and HTTP checks 2026-05-28 22:30:08 -07:00
.github/workflows ci: add GitHub Actions CI (shellcheck, syntax, preview) 2026-05-29 21:31:00 -07:00
agent-queue docs(agent-queue): add Dependabot dependency-triage prompt for common-plat 2026-05-30 00:56:55 -07:00
aliases feat(aliases): add aq/aqs/aqd agent-queue aliases; scope shell-ci shellcheck 2026-05-28 21:52:36 -07:00
dashboard feat(dashboard): close Phase 6 (trend cards + theme toggle), drop-root scaffold, Agents inventory, Phase 0 reconfirm 2026-05-30 08:26:26 +00:00
docs feat(dashboard): close Phase 6 (trend cards + theme toggle), drop-root scaffold, Agents inventory, Phase 0 reconfirm 2026-05-30 08:26:26 +00:00
git-work-safety-tools more scripts and precommit checks 2025-06-25 12:48:48 -07:00
github_access_scripts Move scanner outputs out of repo root 2026-05-05 01:18:10 +00:00
github_repo_scanners Untrack secrets and generated artifacts 2026-05-05 01:19:00 +00:00
scripts feat(vm): Phase 5 closure — GPU/freshness checks, chaos validation, I/O alert 2026-05-30 05:26:49 +00:00
Slack Message Untrack secrets and generated artifacts 2026-05-05 01:19:00 +00:00
supabase monitor Untrack secrets and generated artifacts 2026-05-05 01:19:00 +00:00
systemd feat(vm): Phase 5 closure — GPU/freshness checks, chaos validation, I/O alert 2026-05-30 05:26:49 +00:00
youtube Untrack secrets and generated artifacts 2026-05-05 01:19:00 +00:00
.gitattributes chore(devops): add cross-platform runners and README; normalize EOLs 2026-05-29 21:26:47 -07:00
.gitignore Add live Hermes operations dashboard 2026-05-27 13:04:36 +00:00
.pre-commit-config.yaml precommit & git_repos_rebase_commit_push.sh 2025-06-25 12:29:55 -07:00
accounts.example.json Add safe templates and tooling adoption docs 2026-05-05 01:16:27 +00:00
AGENTS.md docs(devops): document deployment-status.sh in AGENTS.md and README.md 2026-05-12 20:50:14 +00:00
bytelyst-cli.sh chore(cli): make bytelyst-cli.sh executable 2026-05-29 16:42:39 -07:00
check_i_ayushh18_collaborator.sh feat: git commit related 2025-09-16 17:43:59 -07:00
CLAUDE.md Add safe templates and tooling adoption docs 2026-05-05 01:16:27 +00:00
clean_chrome.sh feat: clean up scripts 2025-05-21 21:43:59 -07:00
cleanup.sh feat: clean up scripts 2025-05-21 21:43:59 -07:00
cli-install-report.md chore(devops): update CLI install report and add symlink helper 2026-05-29 21:20:52 -07:00
delete_team_interactive.sh more changes 2025-06-23 21:59:14 -07:00
deploy-all.sh revert(deploy): revert base image changes due to workspace complexity 2026-05-10 00:27:24 +00:00
deploy-clock.sh chore(devops): tighten deployment scripts 2026-05-18 09:01:03 +00:00
deploy-invttrdg.sh chore(deploy): remove debug logging from deployment script 2026-05-13 02:48:54 +00:00
deploy-notes.sh chore(devops): tighten deployment scripts 2026-05-18 09:01:03 +00:00
DEPLOYMENT_GUIDE.md Add production deployment scripts for ByteLyst services 2026-05-09 21:42:58 +00:00
deployment-status.sh feat(devops): add deployment status report script 2026-05-12 20:40:53 +00:00
github_acc_input.json more changes 2025-06-23 21:59:14 -07:00
github_repos.json more changes 2025-06-23 21:59:14 -07:00
install_clis_wsl.sh feat(devops): add interactive WSL CLI installer script 2026-05-29 16:05:01 -07:00
interactive_user_removal.sh feat: git commit related 2025-09-16 17:43:59 -07:00
list_all_public_repos.sh more changes 2025-06-23 21:59:14 -07:00
list_all_repos_tree.sh feat: list repos and prs 2025-06-24 23:22:19 -07:00
list_orgs_teams_members.sh more changes 2025-06-23 21:59:14 -07:00
list_prs_by_user.sh feat: list repos and prs 2025-06-24 23:22:19 -07:00
list_repos_contributors_by_user.sh more changes 2025-06-23 21:59:14 -07:00
list_repos_contributors.sh more changes 2025-06-23 21:59:14 -07:00
make_repos_private.sh ops: add failure reason 2025-02-08 23:56:43 -08:00
make_symlinks_wsl.sh chore(devops): update CLI install report and add symlink helper 2026-05-29 21:20:52 -07:00
README_INSTALL.md chore(devops): add cross-platform runners and README; normalize EOLs 2026-05-29 21:26:47 -07:00
README_interactive_script.md feat: git commit related 2025-09-16 17:43:59 -07:00
README_remove_user_script.md feat: git commit related 2025-09-16 17:43:59 -07:00
README.md docs(devops): document deployment-status.sh in AGENTS.md and README.md 2026-05-12 20:50:14 +00:00
remove_user_from_repos.sh feat: git commit related 2025-09-16 17:43:59 -07:00
remove_user_guided.sh feat: git commit related 2025-09-16 17:43:59 -07:00
remove_user_i-ayushh18.sh feat: git commit related 2025-09-16 17:43:59 -07:00
remove_user_interactive.sh feat: git commit related 2025-09-16 17:43:59 -07:00
REPO_CONTEXT.md docs(devops): add repo context note 2026-05-18 09:01:09 +00:00
repos.json users and repos 2025-06-23 21:11:45 -07:00
repos.txt repos.txt 2025-05-21 21:43:42 -07:00
run_installers.ps1 chore(devops): add cross-platform runners and README; normalize EOLs 2026-05-29 21:26:47 -07:00
run_installers.sh chore(devops): add cross-platform runners and README; normalize EOLs 2026-05-29 21:26:47 -07:00
setup.sh setup: handle managed python pre-commit installs 2026-05-05 03:26:55 +00:00
sync_repos.sh sync_repos.sh 2026-04-13 15:10:02 -07:00
test_interactive.sh feat: git commit related 2025-09-16 17:43:59 -07:00
test.sh feat: clean up scripts 2025-05-21 21:43:59 -07:00
update-dns.sh feat(devops): adopt trading web deployment model with docker-compose 2026-05-11 03:24:11 +00:00
users_black_list.json more changes 2025-06-24 00:14:27 -07:00
users_white_list.json more changes 2025-06-24 00:14:27 -07:00
wsl_path_and_check.sh chore(devops): finalize CLI install report and helper 2026-05-29 21:20:52 -07:00
wsl_test.sh chore(devops): finalize CLI install report and helper 2026-05-29 21:20:52 -07:00

ByteLyst DevOps Tools

Internal repository for GitHub administration scripts, multi-repo safety helpers, and a few adjacent utility projects used by ByteLyst.

This repo is not a single application. It is a workspace of operational tools with three main characteristics:

  • The primary surface area is Bash scripts for GitHub and repository operations.
  • Some subdirectories are self-contained Python utilities with their own setup and runtime expectations.
  • A number of JSON files and outputs are generated artifacts or operational inputs, not source code to edit casually.

Start Here

If you are new to the repo, read these in order:

  1. docs/getting-started.md
  2. docs/repo-map.md
  3. docs/tooling-status.md
  4. scripts/README.md for supported standalone operational scripts
  5. AGENTS.md if you are working through an AI coding agent
  6. CLAUDE.md if you are using Claude Code specifically

Primary Entry Points

GitHub Operations

  • ./bytelyst-cli.sh
    • Main unified CLI for common GitHub admin operations.
    • Requires curl, jq, and GITHUB_TOKEN.
  • ./remove_user_interactive.sh
    • Interactive collaborator-removal workflow with repository pattern matching.
  • ./remove_user_guided.sh
    • Guided wrapper around the same removal flow with a more opinionated interactive UX.
  • ./remove_user_from_repos.sh
    • Scripted removal flow suitable for repeatable or semi-automated use.

Multi-Repo Git Safety

  • git-work-safety-tools/git_repos_status.sh
  • git-work-safety-tools/git_repos_rebase_commit_push.sh
  • git-work-safety-tools/multi_repo_safe_push.sh
  • git-work-safety-tools/multi_repo_status.sh

These are for scanning many repositories, checking dirty state, and performing safer batch git workflows.

Deployment Operations

  • ./deployment-status.sh
    • Comprehensive deployment status report for ByteLyst Investment Trading
    • Shows container status, deployed commit info, git status, health endpoints, and suggested actions
    • Usage: ./deployment-status.sh
  • ./deploy-invttrdg.sh
    • Production deployment script for ByteLyst Investment Trading
    • Builds and deploys Docker containers to production
    • Usage: ./deploy-invttrdg.sh [options]

Repository Layout

Core Operational Scripts

  • Root *.sh files
    • Main Bash-based GitHub and maintenance utilities.
  • scripts/
    • Named operational scripts that are more self-contained than the older root-level helpers.
  • git-work-safety-tools/
    • Safer multi-repo git helpers.
  • github_access_scripts/
    • Focused access checks and repo listing utilities.
  • github_repo_scanners/
    • Scripts plus generated repo/contributor JSON outputs.

Side Projects

  • Slack Message/
    • Python CLI for Slack posting and AI-assisted chat.
  • youtube/
    • YouTube transcript and summarization helpers.
  • supabase monitor/
    • Separate Python workflow project for YouTube processing despite the directory name.

Documentation

  • docs/
    • Canonical onboarding and repo-orientation docs.
  • scripts/README.md
    • Support and usage conventions for standalone operational scripts.
  • Legacy root docs:
    • README_interactive_script.md
    • README_remove_user_script.md

These older docs are still useful but are no longer the best starting point.

Setup

Root Tooling

./setup.sh

This installs the local development hooks and prepares the shell-based workflow. If pip3 is unavailable or blocked by an externally managed Python environment, install the distro package first:

sudo apt-get install -y pre-commit
./setup.sh

Required Dependencies

  • bash
  • curl
  • jq

Authentication

Most GitHub-facing scripts require:

export GITHUB_TOKEN=your_token_here

Use a token with the minimum permissions required for the task. Many admin flows assume repo and admin:org.

For scripts that require multi-account scanning, start from:

cp accounts.example.json accounts.json

Then fill in real values locally. accounts.json is intentionally ignored from future commits.

Common Commands

./bytelyst-cli.sh help
./bytelyst-cli.sh list-public-repos --user <username>
./bytelyst-cli.sh list-private-repos --org <orgname>
./remove_user_interactive.sh
./git-work-safety-tools/git_repos_status.sh
pre-commit run --all-files

Operational Safety

  • Treat accounts.json, *.json account snapshots, .env files, and generated collaborator data as potentially sensitive.
  • Prefer dry runs or interactive confirmation flows before bulk removal or visibility changes.
  • Do not assume every tracked JSON file is a stable source file; many are data snapshots or inputs.
  • Review scripts before reuse in automation. Some are one-off operational helpers and may encode assumptions about ByteLyst org structure.

Notes On Secrets And Outputs

This repo uses example/template files for local credentials and generated outputs should generally stay out of git. If you need local credentials, create untracked local copies such as accounts.json or .env from the provided examples.

Contributing

  • Keep new docs in docs/ unless they are tightly scoped to a subproject.
  • Prefer adding a short README to a subdirectory instead of expanding the root README with niche workflow details.
  • Validate shell scripts with:
pre-commit run --all-files
  • When adding new operational scripts, document:
    • required environment variables
    • destructive behavior
    • expected input files
    • example usage