LoRADockadapter operations
Sign in Sign up
Community knowledge base

Field notes from people shipping adapters

Practical run logs, evaluation methods, build reports, and postmortems from LoRADock contributors.

Results for “inference”

5 articles
Inference & Serving 6 min

Serving Four LoRA Adapters from One Base Model

A practical LoRADock note covering inputs, validation, tradeoffs, and release criteria for serving four lora adapters from one base model.

@local-builds
Inference & Serving 6 min

Safetensors or GGUF: What Worked Better on My Small Server

A practical LoRADock note covering inputs, validation, tradeoffs, and release criteria for safetensors or gguf: what worked better on my small server.

@local-builds
Inference & Serving 5 min

Reducing Cold-Start Time for Frequently Swapped Adapters

A practical LoRADock note covering inputs, validation, tradeoffs, and release criteria for reducing cold-start time for frequently swapped adapters.

@bench-protocol
Inference & Serving 6 min

Running a Quantized Text Adapter on a 16 GB Machine

A practical LoRADock note covering inputs, validation, tradeoffs, and release criteria for running a quantized text adapter on a 16 gb machine.

@local-builds
Inference & Serving 5 min

Tracking Memory Use During Concurrent Generation Requests

A practical LoRADock note covering inputs, validation, tradeoffs, and release criteria for tracking memory use during concurrent generation requests.

@query-bench