Instructions to use FINAL-Bench/Darwin-180B-RSI-R3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use FINAL-Bench/Darwin-180B-RSI-R3 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="FINAL-Bench/Darwin-180B-RSI-R3")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("FINAL-Bench/Darwin-180B-RSI-R3")
model = AutoModelForMultimodalLM.from_pretrained("FINAL-Bench/Darwin-180B-RSI-R3", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use FINAL-Bench/Darwin-180B-RSI-R3 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "FINAL-Bench/Darwin-180B-RSI-R3"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FINAL-Bench/Darwin-180B-RSI-R3",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/FINAL-Bench/Darwin-180B-RSI-R3

SGLang

How to use FINAL-Bench/Darwin-180B-RSI-R3 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "FINAL-Bench/Darwin-180B-RSI-R3" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FINAL-Bench/Darwin-180B-RSI-R3",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "FINAL-Bench/Darwin-180B-RSI-R3" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FINAL-Bench/Darwin-180B-RSI-R3",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use FINAL-Bench/Darwin-180B-RSI-R3 with Docker Model Runner:
```
docker model run hf.co/FINAL-Bench/Darwin-180B-RSI-R3
```

SeaWolf-AI commited on 23 days ago

Commit

e9f7db5

verified ·

1 Parent(s): 25d3fde

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

model-00001-of-00131.safetensors +3 -0
model-00003-of-00131.safetensors +3 -0
model-00004-of-00131.safetensors +3 -0
model-00005-of-00131.safetensors +3 -0
model-00006-of-00131.safetensors +3 -0
model-00007-of-00131.safetensors +3 -0
model-00009-of-00131.safetensors +3 -0
model-00010-of-00131.safetensors +3 -0
model-00011-of-00131.safetensors +3 -0
model-00012-of-00131.safetensors +3 -0
model-00016-of-00131.safetensors +3 -0
model-00017-of-00131.safetensors +3 -0
model-00018-of-00131.safetensors +3 -0
model-00019-of-00131.safetensors +3 -0
model-00020-of-00131.safetensors +3 -0
model-00021-of-00131.safetensors +3 -0
model-00023-of-00131.safetensors +3 -0
model-00024-of-00131.safetensors +3 -0
model-00025-of-00131.safetensors +3 -0
model-00026-of-00131.safetensors +3 -0
model-00030-of-00131.safetensors +3 -0
model-00032-of-00131.safetensors +3 -0
model-00033-of-00131.safetensors +3 -0
model-00036-of-00131.safetensors +3 -0
model-00037-of-00131.safetensors +3 -0
model-00039-of-00131.safetensors +3 -0
model-00041-of-00131.safetensors +3 -0
model-00042-of-00131.safetensors +3 -0
model-00049-of-00131.safetensors +3 -0
model-00050-of-00131.safetensors +3 -0
model-00051-of-00131.safetensors +3 -0
model-00052-of-00131.safetensors +3 -0
model-00053-of-00131.safetensors +3 -0
model-00055-of-00131.safetensors +3 -0
model-00056-of-00131.safetensors +3 -0
model-00057-of-00131.safetensors +3 -0
model-00058-of-00131.safetensors +3 -0
model-00059-of-00131.safetensors +3 -0
model-00060-of-00131.safetensors +3 -0
model-00061-of-00131.safetensors +3 -0
model-00062-of-00131.safetensors +3 -0
model-00063-of-00131.safetensors +3 -0
model-00064-of-00131.safetensors +3 -0
model-00065-of-00131.safetensors +3 -0
model-00067-of-00131.safetensors +3 -0
model-00068-of-00131.safetensors +3 -0
model-00071-of-00131.safetensors +3 -0
model-00075-of-00131.safetensors +3 -0
model-00078-of-00131.safetensors +3 -0
model-00080-of-00131.safetensors +3 -0

model-00001-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:db4dbc41ff716fedab5ce82ac9711fd57408d882760d088d75003c961fe60634
+size 1040155944

model-00003-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:738991c72599e033658a33e34276cdd5e89194cb4c62da2e7209ff6b4fbaf519
+size 1832518264

model-00004-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:18b75622772985f1d4e3d12427511043eb61a491c9c89c1c97ea340b735c3c86
+size 3355443368

model-00005-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1e22b5cafe1b301c65e7303e333da2e57057457c73310a64fcce93482af2b016
+size 3355888504

model-00006-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8277a48e1fd7ab7ff7f0282befcc6eb4e09ab2e0780c00af6685e198faba233e
+size 3200016032

model-00007-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0fba369354e45b43efbe2773d63b7cb20caedb56ff9ed80e076bbcdaf560666a
+size 3200016032

model-00009-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:23fbef154f7f68e5b6f555492832c78822a827554757797daf91de48df06b496
+size 3200016032

model-00010-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b3a303529a190c6661870d5abebf0ac18d36922a1da8db737d19f55bd1031fe8
+size 3200016032

model-00011-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d1215943b48481febb33a1129c96613dec5f364613a2cc3ba1e27c23be0ca78a
+size 3200016032

model-00012-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f63d649ea84867ec75884dace5ea4d8c723a6560463674a6ee0ce621b4b9dbc1
+size 3200016032

model-00016-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:73c4b1bd1f3752d70f0161ec8c8a7701f0538e1ae722daf16a905e04a666e69f
+size 3200016032

model-00017-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ee60c1269974cc797bad8bfc9a0fac72437b323ceafcb225cef6980ecffce1b3
+size 3200016032

model-00018-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:72cf3696aa1af4611b2da2b013868f3724082362899d9dce3e9fec908d441fc2
+size 3200016032

model-00019-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bdad649be407bd8033a4abd6a24bf434ed6a173807892d18cc1c9771031bfd0c
+size 3200016032

model-00020-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2258dad55787922f1d4429aea528495511f58447baa9b4f1b7f92f58ba7110b0
+size 3200016032

model-00021-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:775952ac572fa4ff7e5e316ecb60483d4dd96f4369d6a7a403fa31d7f9d1a6d0
+size 3200016032

model-00023-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:598d4f772853233b88911fdb1a49f8865e3c732e93b17aea44b65f455e69e9dc
+size 3200016032

model-00024-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:09e534942e7d4eb31803b347e14dd70090f16f85c89b0ad766bdace135806f12
+size 3200016032

model-00025-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:482d18f0e515c23c6933593d0cce289770600c6fa539168bd304e2169cc8a2be
+size 3200016032

model-00026-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ac479fe29ed3e03b7c3523974371d68dace22b7744ff9236f9429cdbb9241da0
+size 3200016032

model-00030-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:893a9b59e412a3242252274770efe0794ce8b216b2b3907b6854b7eaa6ddd334
+size 3200016032

model-00032-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7453fcb5872160888730439ac71a5279d348686d68c6ba2d62ff12461443dc69
+size 3200016040

model-00033-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5b2f577ce40932031c4749f9177dab2119ff118f9f9b9df3d0d5e57c8e41d128
+size 3200016040

model-00036-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:237789c0cef556ef22c9f1ca99b7baf71b33a56b70c5828380e1008e02510649
+size 3200016040

model-00037-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3179608ad7c3de07a12aaa1e39771ccc561487c452cbb22865cbbbb62fe79da3
+size 1742347160

model-00039-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:22994c99f48e22b78f022842251d1450041d996bd492ee81fda39fcf621e484d
+size 1716599840

model-00041-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8496f9422a1a181d4cbc24fa0d856711303fa86090e4b8122188c08be7f50893
+size 1941966288

model-00042-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:071bb12fa66a5f393d9aaacba701ce8672567e17ee0249e4c256d881c6d7ee1d
+size 3355443376

model-00049-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b387bd8b0c8b071cb7179c539f1b543fe1069195e7267959772799ff7f12548c
+size 1935433152

model-00050-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6014a2b71b74a5e2703bf5a1182251a71d7f0720a0244988874deb430b312d50
+size 3355443376

model-00051-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8c5b62eb9832ed65038deca23fcd85995ea011f30310feb2c7ca7e702478f65b
+size 1832518280

model-00052-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1914762c6994289c4fe57ed1a6bc21cac2625f09e0ce27dabc3772eee9456b86
+size 3355443376

model-00053-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f372dd26689a1b9a031e39bd5710830f8464d1deff05462d97602b1a1321fd82
+size 1839072024

model-00055-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b60e8b2fbb9d1c23b2d41407cd8e4682301e1aaf78f84eefe60a85651585b5c9
+size 1716599840

model-00056-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:86ef0b5385fe31de2a7b448dd4db943f4554e56677c62354f827e19288ade4e0
+size 3355443376

model-00057-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a85297a06c802fa64fa3e3f99a1fcc1daa8a826fcae40e50c8807f99f3ddbf7f
+size 1941966280

model-00058-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b7d2ab70d914dea5f5434f983e758dd6bd32978fdcb3a3de93dd8c3265d4afd1
+size 3355443368

model-00059-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4bab69c2545749215905759caf117335495d4232be2bf9cb90b2ef9117cea5e0
+size 1716600048

model-00060-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2c6cbd23562cf882ee1c2f4b0e29ab950b656c05033e4b9ab709ce6ab8e93cc9
+size 3471361528

model-00061-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cf5bff0a9663c4beeecec664d09566ee7a9e153da6ab1d54b3ca3cf10bba5f2e
+size 3355443376

model-00062-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c68937f4505de84503dc1e69b3c286c2c809c800761a101d2fa18aca773af401
+size 3510240000

model-00063-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e35a86ae511bb2e0fe98d5423011002e682ce7182d639fc7cb13fea652db22e6
+size 3355443376

model-00064-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1b01ea481e780dcc6883068c5bfd9658e4601de97c70432440fb7d56f9ae3d01
+size 1832518280

model-00065-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:040b73058fe0248ec72e1bdd37b6cbd3b59cb0cb7e6e2142421dcad3c574579c
+size 3355443376

model-00067-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9223da6ff56d9b76cbd7889dc81040ba47cddbe1936a2216a32e314fe8b4239b
+size 3355443376

model-00068-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:430f9be15e3ce72ef8019c710bec9b7f0896b0f897e596bc14820b1e83c8197c
+size 1935412552

model-00071-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:184e042c9702c23d3adacbc6f94ffc8b65394189aae2e32bbaa1d159dc330ffa
+size 3355443376

model-00075-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fc43b07ed4817ba262538c44b9f917eed68e7fbcb3c833b2365c28f78dc343f9
+size 3355443376

model-00078-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b5737170d108115e9025f68bc34dacd9c32b837e59a155d8d140b3b800e5cb7f
+size 1832600344

model-00080-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:01a00f9e14aafdc95ccd659a3e458e46c4bd8b3f1f6c80715d87ed28393844be
+size 1716599840