4 Commits

Author	SHA1	Message	Date
Alpamys	cbc0a0e558	v0.16.0: embedding models, ONNX/TensorRT export, speculative decoding ... New features: - task: embedding — fine-tune sentence embedding models (BGE, E5, GTE) with contrastive, triplet, or cosine loss and configurable pooling - soup export --format onnx — ONNX export via optimum - soup export --format tensorrt — TensorRT-LLM export for GPU inference - soup serve --speculative-decoding — draft model for 2-3x faster generation (transformers assisted generation + vLLM native speculative decoding) - soup init --template embedding — new template for embedding fine-tuning Security: - ONNX export: removed unconditional trust_remote_code, added warning - Speculative decoding: SSRF protection (URL blocked), warning panel - vLLM speculative: URL validation rejects http:// schemes - TensorRT export: separated try/except per subprocess call - Embedding config: Literal constraints, margin gt=0 validation 1270 tests, 52 test files, 58% coverage	2026-03-26 12:41:39 +05:00
Alpamys	7bee22052b	v0.10.10: Security hardening — Web UI auth, CORS, SSRF, path traversal protection ... Security fixes across all HTTP surfaces: - Web UI: Bearer token auth on mutating endpoints, CORS restricted to served origin, path traversal protection on /api/data/inspect, config validated before training, removed user-controlled config_path from API - Serve/vLLM: max_tokens capped at 16384, generic error messages (no stack traces) - Generate: SSRF protection (--api-base blocks non-HTTPS for remote URLs), --api-key deprecated in favor of OPENAI_API_KEY env var - Export: llama.cpp pinned to tag b5270 (supply-chain safety) - Push: --token deprecated in favor of HF_TOKEN env var - Rewards: warning before executing custom .py reward files - Tests: all 40 UI tests updated with auth headers, 666 tests pass Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>	2026-03-25 12:14:10 +05:00
Alpamys	f1d039f223	Fix CI: use Optional[] instead of str|None for Python 3.9 compat ... Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>	2026-03-23 21:35:00 +05:00
Alpamys	14f619cc00	Add vLLM backend for soup serve (Phase 9) — v0.8.0 ... - Add --backend vllm flag to soup serve for 2-4x better inference throughput - Add --tensor-parallel and --gpu-memory flags for vLLM tuning - Auto-detect vLLM and show hint when installed but not enabled - New utils/vllm.py with engine creation, app factory, LoRA support - Native token-by-token streaming via vLLM AsyncLLMEngine - Add serve-fast extra: pip install 'soup-cli[serve-fast]' - Add vllm detection to version --full - 30 new tests (560 total), ruff clean Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>	2026-03-23 21:30:08 +05:00