Commit Graph

183 Commits

Author SHA1 Message Date
Jaret Burkett 307ff11bc5 Drastically improved the performance of the dataset viewer on large datasets by switching to virtualization. Fixed issue with images loading when they have two periods in a row .. 2026-05-24 15:13:55 -06:00
Jaret Burkett c6a7e81a70 Added a dataset image viewer. Fixed an issue where captions would show as not saved when they were saved. 2026-05-24 14:31:06 -06:00
Jaret Burkett 6102370df9 Add support for ZImage L2P 2026-05-22 14:58:28 -06:00
Jaret Burkett 6fc08a8928 Fix issue with saving images from new sample viewer 2026-05-22 11:58:32 -06:00
Jaret Burkett 15d4fb89ff Fixed overflow issue on modal 2026-05-19 10:12:43 -06:00
Jaret Burkett df851b3497 Made the UI mobile friendly, finally... 2026-05-19 09:27:36 -06:00
Jaret Burkett 6ecaf679dc Add ability to run small scripts from the ui and added a merge lora script 2026-05-18 14:33:47 -06:00
Jaret Burkett (Ostris) fc4d6ebf39
Add support for fine-tuning Hidream O1 (#831)
* Initial support for hidream. Lora keys likely need work

* Fix saving for hidream-o1

* Remove dependence on flash attention for hidream o1

* Fix gradient checkpointing for hidream o1

* A lot of fixes for hidream. Handle loading and saving as comfy model.

* Omit layers not used in comfy. Fix issue with lora loading keys in comfy

* Version bumpo
2026-05-12 11:15:16 -06:00
Jaret Burkett d144cb5ea6 Switch to uplot for loss graph and rework performance of graph. It is significantly more perfromant now. 2026-05-07 07:38:00 -06:00
Jaret Burkett aeca7fe404 Add Automagic v2 optimizer. It uses significantly less vram and is much more efficient. 2026-05-05 09:09:07 -06:00
Jaret Burkett 0d91fcee9e Allow edit of captioning job 2026-04-30 16:00:16 -06:00
Jaret Burkett 77b8765939 Fix issue with hover styling on select components. 2026-04-28 10:55:20 -06:00
Jaret Burkett 43989cc19e Add advanced config section to the captioner 2026-04-28 10:49:46 -06:00
Jaret Burkett f972b750e6 Performance improvements to captioner. Add ability to set a default caption for ace captioner to avoid needing to caption the audio so we only transcribe 2026-04-28 10:15:11 -06:00
Jaret Burkett afb62b1fa5 Add support for Nucleus-Image 2026-04-16 13:09:10 -06:00
Jaret Burkett (Ostris) 3e0c904054
Add support for Baidu's ERNIE-Image (#793)
* Add support for ERNIE Image

* change float64 to float32

* Version bump

* Update ERNIE defaults
2026-04-14 09:45:12 -06:00
Jaret Burkett 0d11be41fa Adjust default sample steps. 2026-04-10 17:46:34 -06:00
Jaret Burkett 62e18427b4 Adjust default sample steps. 2026-04-10 17:46:09 -06:00
Jaret Burkett 0b9c365acb Add flac and ogg support 2026-04-10 12:10:54 -06:00
Jaret Burkett 145144eee3 Fix issue with auto updating captions when captioning a dataset 2026-04-10 11:51:18 -06:00
Jaret Burkett 765a9d5b2e Add a download button to music samples in in the gear menu 2026-04-10 10:07:45 -06:00
Jaret Burkett d08ea8318f Change default timestep type for ace step to linear 2026-04-09 17:39:00 -06:00
Jaret Burkett 78cf049c29
Add support for ACE-Step 1.5 and ACE-Step 1.5 XL. Also added dataset captioning through the UI. (#785)
* Base ace step 1.5 xl added. Generating, still wip on training and ui

* Base training code done

* Fix some issues with caching text embeddings. Update sample cards to show audio

* Fix issue with quantizing ace step

* Add album artwork to samples with waveform.

* Cleanup logs

* Add album art endpoint to speed up album art loading

* Made an make video with artwork script

* Make ui handle basic audio models. Make multi line adjustments to the editor and better syntax hilighting.

* Add prompt tagging system for special tagged models.

* prompt tagging processing for ui working.

* Moved default samples to a special file so we can add more when needed and they can be adjusted for a specific model

* Add a captioner job with music captioner that is prepped for use with the ui

* Add basit ui setup for captioning modal and handeling captioning jobs

* Starting captioning job from ui working. Still better management for it.

* Better filtering of job options in the job view for captioning jobs

* Added qwen3 vl as a captioner for images

* Have an indicator when a dataset is being captioned.

* Adjust the way caption jobs look in the queue

* Fix a few issues. Adjust defaults.

* Version bump

* Added ace step to the readme.
2026-04-09 15:02:03 -06:00
Jaret Burkett 853ffaf207 Add light mode support. 2026-03-31 16:54:55 -06:00
Jaret Burkett e22039e4aa Add more optimizers to the ui 2026-03-31 09:20:20 -06:00
Jaret Burkett b43ea6c2d3 Abort caption requests when they are not in view to tax the server less. 2026-03-30 10:46:25 -06:00
Jaret Burkett a484e55d66 Rework dataset model and file dragging. Use single model for dragging, uploading, and selecting images. 2026-03-30 10:33:10 -06:00
Jaret Burkett ac82ebd852 Dont try to list hidden files in datasets 2026-03-30 10:03:10 -06:00
Jaret Burkett 171535833a
Add Mac OS support for Apple Silicon (#770)
* Made an install script and auto updates env for mac

* GPU sensors and initial training working for MAC. Still WIP.

* Switch dataloader to single threaded until I can work around some mac pickeling issues.

* Get quantization working on mac

* Fix mac exclusive imports so they don't break other builds.

* Add mac instructions to the UI
2026-03-30 09:37:47 -06:00
Jaret Burkett fbda10d088 Add a duplicate dataset function to the ui 2026-03-29 13:51:18 -06:00
Jaret Burkett 45e99664b9 Add icons to the top bar on the job page 2026-03-29 12:38:47 -06:00
Jaret Burkett 540659709d Improved the load time of dataset and sample images and videos by switching to streaming 2026-03-29 10:38:34 -06:00
Jaret Burkett e030f4f2e0 Show the control images in the image viewer when clicked so they can be easily previewed for reference. 2026-03-29 10:00:54 -06:00
willhsmit 20929b93df
Fix onChange path for EMA Decay input (#695)
Changes to the EMA Decay input don't get preserved when switching back and forth between Advanced and Simple view. I believe the onChange is not writing it correctly here.
2026-03-28 13:02:32 -06:00
Rayane ca72eb1515
Add 1328 native resolution for Qwen Image training (#749)
* Add 1328 native resolution for Qwen Image training

Qwen-Image and Qwen-Image-2512 have a native 1:1 resolution of 1328x1328
as documented in the official model card's aspect ratio table. Adding it
to the resolution buckets and UI allows training at the model's native
resolution for improved quality.

* Revert example config change (24GB OOM at 1328)
2026-03-28 12:09:15 -06:00
Jaret Burkett 740657e25e Improve dataset uploader. Upload the files one at a time instead of one huge chunk. Show progress for each file. 2026-03-27 09:26:22 -06:00
Jaret Burkett 2c8d2acdcb On jobs table, sort idle jobs by last updated so recent active ones are at the top 2026-03-26 10:33:17 -06:00
Jaret Burkett 9a77389653 On a new training job, or when editing one, load everything before allowing editing 2026-03-26 10:23:42 -06:00
Jaret Burkett a7bb4ddb2c Work on loss graph. Add smoothed overlay. Allow user to hilite a secton of the graph to zoom into. 2026-03-26 10:05:09 -06:00
Jaret Burkett 4df3b0463f Save job pid to the database and sing sigint to kill it when stopping so it stops immediatly. 2026-03-26 09:10:37 -06:00
Jaret Burkett 89d2090962 Fixed race condition that would occasionally set the dataset path to the first one when editing a job 2026-03-25 11:22:42 -06:00
Jaret Burkett 5d5a8ef9da Fixed issue with deleting datasets and jobs with newer version of node.js. Bumped minimum version of node js to 20 2026-03-25 10:04:36 -06:00
Jaret Burkett 7f3309b291 Add support for audo frame count so datasets can have varrying length videos. Varous ltx 2.3 VAE optimizations such as removing tiling articacts, and doing frame split encoding to reduce vram on encoding/decoding. 2026-03-24 12:20:09 -06:00
Rasmus Lerdorf 4ad14d211a
Add an import config button (#733) 2026-03-23 15:41:27 -06:00
Jaret Burkett 859635e95b
Add support for training LTX 2.3 (#745)
* Initial support for ltx 2.3. Still needs a lot of testing to make sure it is all right.

* bump version

* Handle lora renaming keys for new ltx 2.3 layers
2026-03-22 17:56:59 -06:00
Jaret Burkett 35978df8a3 Adjust defaults for ui graph to get and show all losses 2026-03-02 10:27:15 -07:00
Jaret Burkett 57d407cfd4 Add support for training lodestones/Zeta-Chroma 2026-03-01 12:52:29 -07:00
Jaret Burkett 1c74ca5d22 Add audio_loss_multiplier to scale audio loss to larger values if desired. 2026-02-19 11:57:44 -07:00
Jaret Burkett 42acb0d4be Build out an audio player card in preperation for audio datasets and samples. 2026-02-03 08:15:55 -07:00
Jaret Burkett ea912d2d7b Increase default sample steps from 25 to 30 for z_image 2026-01-27 09:39:21 -07:00