REST Client

We recommend interacting with the router's REST API via the Infernet Client (opens in a new tab) Python library or CLI.

ℹ️

The following examples assume an Infernet Router is running at http://localhost:4000.

Container discovery

Discover containers running across the discoverable network.

from infernet_client import RouterClient
 
client = RouterClient("http://localhost:4000")
containers = await client.get_containers()
 
print(containers)

Expected Output:

[
    {
        "id": "hello-world",
        "count": 100,
        "description": "Hello World container"
    },
    {
        "id": "ritual-tgi-inference",
        "count": 5,
        "description": "Serving meta-llama/Llama-2-7b-chat-hf via TGI"
    },
]

Node discovery

Discover nodes by container ID(s) running across the discoverable network.

from infernet_client import RouterClient
 
client = RouterClient("http://localhost:4000")
nodes = await client.get_nodes_by_container_ids(
    ["hello-world", "ritual-tgi-inference"],
    n=4,
)
 
print(nodes)

Expected Output:

[
    "37.27.106.57:4000",
    "161.97.157.96:4000",
    "176.98.41.25:4000",
    "84.46.244.212:4000"
]

REST API