Support for new key= mechanism

[simonw]

https://llm.datasette.io/en/stable/plugins/advanced-model-plugins.html#advanced-model-plugins-api-keys

[simonw]

Without this passing an invalid key would still use the valid key stored in llm keys set mistral:

llm -m mistral-small 'goat joke' --key invalid

I got a goat joke:

Sure, her

e's a light-hearted goat joke for you:

Why don't goats make good secret keepers?

Because they always bleat everything out!

But with the fix applied I get:

{
 "message":"Unauthorized",
 "request_id":"6941f674e9372b3df07b6e320d7f201d"
}
Error: Client error '401 Unauthorized' for url 'https://api.mistral.ai/v1/chat/completions'
For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/401

[simonw]

Spotted this bug:

llm -m mistral-small 'goat joke' --key invalid --async

Error: Attempted to call a sync iterator on an async stream.

It works without --async and it worked fine before this fix.

[simonw]

Fired up a debugger:

RuntimeError: Attempted to call a sync iterator on an async stream.
>>> import pdb
>>> pdb.pm()
> /Users/simon/.local/share/virtualenvs/llm-mistral-LjsSd8B3/lib/python3.10/site-packages/httpx/_models.py(944)iter_raw()
-> raise RuntimeError("Attempted to call a sync iterator on an async stream.")
(Pdb) u
> /Users/simon/.local/share/virtualenvs/llm-mistral-LjsSd8B3/lib/python3.10/site-packages/httpx/_models.py(897)iter_bytes()
-> for raw_bytes in self.iter_raw():
(Pdb) u
> /Users/simon/.local/share/virtualenvs/llm-mistral-LjsSd8B3/lib/python3.10/site-packages/httpx/_models.py(881)read()
-> self._content = b"".join(self.iter_bytes())
(Pdb) u
> /Users/simon/Dropbox/Development/llm-mistral/llm_mistral.py(380)execute()
-> decoded = json.loads(event_source.response.read())