后端能力: - 新增 Celery app、worker task、ProcessingTask 模型、/api/tasks 查询接口和 media_task_runner,将 /api/media/parse 改为创建后台任务并由 worker 执行 FFmpeg/OpenCV/pydicom 拆帧。 - 新增 Redis 进度事件模块和 FastAPI Redis pub/sub 订阅,将 worker 任务进度广播到 /ws/progress;Dashboard 后端概览接口改为聚合 projects/frames/annotations/templates/processing_tasks。 - 统一项目状态为 pending/parsing/ready/error,新增共享 status 常量,并让前端兼容归一化旧状态值。 - 扩展 AI 后端:新增 SAM registry、SAM2 真实运行状态、SAM3 状态检测与文本语义推理适配入口,以及 /api/ai/models/status GPU/模型状态接口。 - 补齐标注保存/更新/删除、COCO/PNG mask 导出相关后端契约和模板 mapping_rules 打包/解包行为。 前端能力: - 新增运行时 API/WS 地址推导配置,前端 API 封装对齐 FastAPI 路由、字段映射、任务轮询、标注归档、导出下载和 AI 预测响应转换。 - Dashboard 改为读取 /api/dashboard/overview,并订阅 WebSocket progress/complete/error/status 更新解析队列和实时流转记录。 - 项目库导入视频/DICOM 后创建项目、上传媒体、触发异步解析并刷新真实项目列表。 - 工作区加载真实帧、无帧时触发解析任务、回显已保存标注、保存未归档 mask、更新 dirty mask、清空当前帧后端标注、导出 COCO JSON。 - Canvas 支持当前帧点/框提示调用后端 AI、渲染推理/已保存 mask、应用模板分类并维护保存状态计数;时间轴按项目 fps 播放。 - AI 页面新增 SAM2/SAM3 模型选择,预测请求携带 model;侧边栏和工作区新增真实 GPU/SAM 状态徽标。 - 模板库和本体面板接入真实模板 CRUD、分类编辑、拖拽排序、JSON 导入、默认腹腔镜分类和本地自定义分类选择。 测试与文档: - 新增 Vitest 配置、前端测试 setup、API/config/websocket/store/组件测试,覆盖登录、项目库、Dashboard、Canvas、工作区、模型状态、时间轴、本体和模板库。 - 新增 pytest 后端测试夹具和 auth/projects/templates/media/AI/export/dashboard/tasks/progress 测试,使用 SQLite、fake MinIO、fake SAM registry 和 Redis monkeypatch 隔离外部服务。 - 新增 doc/ 文档结构,冻结当前需求、设计、接口契约、测试计划、前端逐元素审计、实现地图和后续实施计划,并同步更新 README 与 AGENTS。 验证: - conda run -n seg_server pytest backend/tests:27 passed。 - npm run test:run:54 passed。 - npm run lint、npm run build、compileall、git diff --check 均通过;Vite 仅提示大 chunk 警告。
138 lines
5.8 KiB
TypeScript
138 lines
5.8 KiB
TypeScript
import React, { useEffect, useMemo, useState } from 'react';
|
|
import { Play, Pause } from 'lucide-react';
|
|
import { cn } from '../lib/utils';
|
|
import { useStore } from '../store/useStore';
|
|
|
|
export function FrameTimeline() {
|
|
const frames = useStore((state) => state.frames);
|
|
const currentProject = useStore((state) => state.currentProject);
|
|
const currentFrameIndex = useStore((state) => state.currentFrameIndex);
|
|
const setCurrentFrame = useStore((state) => state.setCurrentFrame);
|
|
const [isPlaying, setIsPlaying] = useState(false);
|
|
|
|
const totalFrames = frames.length;
|
|
const currentFrame = totalFrames > 0 ? currentFrameIndex + 1 : 0;
|
|
const playbackFps = useMemo(() => {
|
|
const fps = currentProject?.parse_fps || currentProject?.original_fps || 12;
|
|
return Math.min(Math.max(fps, 1), 30);
|
|
}, [currentProject?.original_fps, currentProject?.parse_fps]);
|
|
|
|
useEffect(() => {
|
|
if (!isPlaying || totalFrames <= 1) return;
|
|
|
|
const timer = window.setTimeout(() => {
|
|
if (currentFrameIndex >= totalFrames - 1) {
|
|
setIsPlaying(false);
|
|
return;
|
|
}
|
|
|
|
setCurrentFrame(currentFrameIndex + 1);
|
|
}, 1000 / playbackFps);
|
|
|
|
return () => window.clearTimeout(timer);
|
|
}, [currentFrameIndex, isPlaying, playbackFps, setCurrentFrame, totalFrames]);
|
|
|
|
useEffect(() => {
|
|
if (totalFrames === 0) {
|
|
setIsPlaying(false);
|
|
}
|
|
}, [totalFrames]);
|
|
|
|
// show frames around current frame
|
|
const frameWindow = 20;
|
|
const displayIndices = totalFrames > 0
|
|
? Array.from({ length: 41 }, (_, i) => currentFrameIndex - frameWindow + i)
|
|
: [];
|
|
|
|
return (
|
|
<div className="h-32 bg-[#111] border-t border-white/5 flex flex-col shrink-0 z-20">
|
|
<div className="h-4 bg-[#0d0d0d] flex items-center group relative">
|
|
<input
|
|
type="range"
|
|
min="1"
|
|
max={Math.max(totalFrames, 1)}
|
|
value={currentFrame}
|
|
onChange={(e) => setCurrentFrame(parseInt(e.target.value) - 1)}
|
|
className="w-full absolute inset-0 opacity-0 cursor-ew-resize z-20"
|
|
disabled={totalFrames === 0}
|
|
/>
|
|
<div className="h-1 bg-white/10 w-full relative group-hover:h-2 transition-all">
|
|
<div
|
|
className="h-full bg-cyan-500 absolute left-0"
|
|
style={{ width: `${totalFrames > 0 ? (currentFrame / totalFrames) * 100 : 0}%` }}
|
|
/>
|
|
<div
|
|
className="w-3 h-3 bg-white rounded-full absolute top-1/2 -translate-y-1/2 -ml-1.5 shadow-sm transform scale-0 group-hover:scale-100 transition-transform shadow-cyan-500/50"
|
|
style={{ left: `${totalFrames > 0 ? (currentFrame / totalFrames) * 100 : 0}%` }}
|
|
/>
|
|
</div>
|
|
</div>
|
|
|
|
<div className="flex-1 flex items-center px-4 gap-6">
|
|
<div className="flex flex-col items-center gap-2 px-4 border-r border-white/10 shrink-0">
|
|
<button
|
|
className="p-2 rounded-full bg-white/5 text-white hover:bg-white/10 disabled:opacity-40 disabled:cursor-not-allowed"
|
|
disabled={totalFrames <= 1}
|
|
onClick={() => {
|
|
if (currentFrameIndex >= totalFrames - 1) {
|
|
setCurrentFrame(0);
|
|
}
|
|
setIsPlaying(!isPlaying);
|
|
}}
|
|
>
|
|
{isPlaying ? <Pause size={20} fill="currentColor" /> : <Play size={20} fill="currentColor" />}
|
|
</button>
|
|
<span className="text-[10px] font-mono text-gray-500">{isPlaying ? '暂停 (SPACE)' : '播放序列 (F5)'}</span>
|
|
</div>
|
|
|
|
<div
|
|
className="flex-1 flex gap-px flex-nowrap items-center overflow-hidden justify-center"
|
|
style={{ WebkitMaskImage: 'linear-gradient(to right, transparent, black 10%, black 90%, transparent)' }}
|
|
>
|
|
{totalFrames === 0 ? (
|
|
<div className="text-xs text-gray-600 font-mono">暂无帧数据</div>
|
|
) : (
|
|
displayIndices.map((idx) => {
|
|
if (idx < 0 || idx >= totalFrames) {
|
|
return <div key={`empty-${idx}`} className="w-16 h-12 opacity-0 shrink-0" />
|
|
}
|
|
const frame = frames[idx];
|
|
const isCurrent = idx === currentFrameIndex;
|
|
return (
|
|
<div
|
|
key={frame.id}
|
|
onClick={() => setCurrentFrame(idx)}
|
|
className={cn(
|
|
"relative shrink-0 rounded-sm transition-all cursor-pointer flex items-center justify-center overflow-hidden group mx-0.5",
|
|
isCurrent ? "w-28 h-16 border-2 border-cyan-500 bg-gray-700 shadow-[0_0_15px_rgba(6,182,212,0.3)] z-10" : "w-16 h-12 border border-white/5 bg-gray-800/50 opacity-40 hover:opacity-100"
|
|
)}
|
|
>
|
|
{frame.url ? (
|
|
<img
|
|
src={frame.url}
|
|
alt={`frame-${idx}`}
|
|
className="absolute inset-0 w-full h-full object-cover"
|
|
loading="lazy"
|
|
draggable={false}
|
|
/>
|
|
) : (
|
|
<div className="absolute inset-0 bg-gradient-to-br from-gray-800 to-gray-900 opacity-20" />
|
|
)}
|
|
<span className={cn("text-[9px] font-mono text-white text-center z-10 drop-shadow", isCurrent ? "text-[10px] font-bold" : "")}>
|
|
{(idx + 1).toString().padStart(4, '0')}
|
|
</span>
|
|
</div>
|
|
);
|
|
})
|
|
)}
|
|
</div>
|
|
|
|
<div className="w-48 text-right shrink-0">
|
|
<div className="text-2xl font-mono text-white">{currentFrame}<span className="text-xs text-gray-500"> / {totalFrames}</span></div>
|
|
<div className="text-[10px] text-gray-500 uppercase tracking-widest mt-1">底层时序视频图层截帧导航轴</div>
|
|
</div>
|
|
</div>
|
|
</div>
|
|
);
|
|
}
|