Within the past week, I've noticed textgen webui sometimes ignores my GPU split string when loading a model with either ExLlamav2_HF or ExLlamav2. It's not a consistent issue across all models but it ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback