Implementation plan

Structure

System map

Experiment control moves through the server boundary

The frontend drives setup and review. The server owns filesystem access, persistence, and ComfyUI jobs. The shared core package keeps workflow and rendering logic reusable by both the API and CLI wrappers.

System Structure

Monorepo
1

Web

packages/web

  • Experiment setup
  • Source and references
  • Render progress
  • Candidate review
  • Good baselines
  • Next-round editor
2

Server

packages/server

  • GraphQL API
  • Upload staging
  • Render orchestration
  • Artifact indexing
  • Preference persistence
  • Round analysis
3

Core Engine

packages/experiment-core

  • Candidate generation
  • Workflow mutation
  • API prompt conversion
  • ComfyUI client
  • Metrics
  • Feedback proposal logic
4

Runtime

storage and services

  • /app/storage PVC
  • Host Postgres
  • ComfyUI renderer
  • Run artifacts
  • Reference images
  • Contact sheets

Feedback Loop

Candidate search
1Create experiment
2Attach source and references
3Generate candidates
4Render through ComfyUI
5Review candidates
6Mark good baselines
7Analyze round
8Propose next dials

Phase Structure

Roadmap
1

Workspace conversion

Complete

Monorepo, web shell, server shell, experiment-core.

2

Core extraction

Next

Move candidate generation, renderer, workflow conversion, and metrics into the shared engine.

3

Server API

Next

Harden experiment CRUD, uploads, render control, persistence, and job state.

4

Setup flow

In progress

Keep improving source image, reference image, and experiment setup workflows.

5

Rendering dashboard

Planned

Queue status, thumbnails, output links, failures, and retry controls.

6

Review and scoring

In progress

Numbered grid, fullscreen viewer, good marks, scoring, pairwise preference.

7

Feedback loop

Planned

Merge subjective signals with metrics and create next-round proposals.

8

Hardening

Planned

Cancellation, resumability, diagnostics, reports, cleanup, and operations polish.

Responsibility Boundaries

Ownership
BrowserGraphQL calls, review UI, operator decisions.
ServerFilesystem access, ComfyUI calls, jobs, persistence, artifact indexing.
Core enginePure workflow mutation, candidate generation, render helpers, analysis helpers.
PostgresExperiments, scores, good baselines, preferences, round state.
StorageUploaded images, references, workflows, rendered outputs, contact sheets.
ComfyUIImage generation execution through the configured renderer endpoint.