REST Client
We recommend interacting with the router's REST API via the Infernet Client (opens in a new tab) Python library or CLI.
ℹ️
The following examples assume an Infernet Router is running at http://localhost:4000
.
Container discovery
Discover containers running across the discoverable network.
from infernet_client import RouterClient
client = RouterClient("http://localhost:4000")
containers = await client.get_containers()
print(containers)
Expected Output:
[
{
"id": "hello-world",
"count": 100,
"description": "Hello World container"
},
{
"id": "ritual-tgi-inference",
"count": 5,
"description": "Serving meta-llama/Llama-2-7b-chat-hf via TGI"
},
]
Node discovery
Discover nodes by container ID(s) running across the discoverable network.
from infernet_client import RouterClient
client = RouterClient("http://localhost:4000")
nodes = await client.get_nodes_by_container_ids(
["hello-world", "ritual-tgi-inference"],
n=4,
)
print(nodes)
Expected Output:
[
"37.27.106.57:4000",
"161.97.157.96:4000",
"176.98.41.25:4000",
"84.46.244.212:4000"
]