How to use from
vLLM
Install from pip and serve model
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Vortex5/G4-Starry-Ocean-12B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Vortex5/G4-Starry-Ocean-12B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'
Use Docker
docker model run hf.co/Vortex5/G4-Starry-Ocean-12B
Quick Links

G4-Starry-Ocean-12B

Overview

G4-Starry-Ocean-12B was created through a merge combining gemma-4-12B-it, Semancer-12B, and G4-12B-Station-Keeper, using a custom method.

Merge configuration
base_model: google/gemma-4-12B-it
models:
  - model: UnstableLlama/Semancer-12B
  - model: ewald1976/G4-12B-Station-Keeper
merge_method: hcr
chat_template: auto
parameters:
  strength: 0.9
  retention: 0.6
  novelty: 0.36
  stability: 0.7
dtype: float32
out_dtype: bfloat16
tokenizer:
  source: union

Intended Use

Storytelling Structured long-form narrative
Roleplay Emotion-forward interaction
Creative Writing Atmospheric fiction
Downloads last month
116
Safetensors
Model size
12B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Vortex5/G4-Starry-Ocean-12B