Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Ollama models runs into TypeError: string indices must be integers #43

Closed
1 task done
namin opened this issue Jan 29, 2025 · 3 comments
Closed
1 task done
Assignees
Labels
bug Something isn't working

Comments

@namin
Copy link
Contributor

namin commented Jan 29, 2025

Is there an existing issue for the same bug?

  • I have checked the existing issues.

Describe the bug and reproduction steps

I am trying to run the system with Ollama, and just following the instructions on the README.md, using either the webui or the console, I get the following error, with models qwen2.5, gemma2 and llama3.2.

% # Example with house prices dataset
aide agent.code.model="qwen2.5" agent.feedback.model="qwen2.5" report.model="qwen2.5" \
    data_dir="example_tasks/house_prices" \
    goal="Predict the sales price for each house" \
    eval="Use the RMSE metric between the logarithm of the predicted and observed values."
zsh: command not found: #
Traceback (most recent call last):
  File "/opt/anaconda3/envs/aideml3/bin/aide", line 33, in <module>
    sys.exit(load_entry_point('aideml', 'console_scripts', 'aide')())
  File "/Users/namin/code/mlk/aideml/aide/run.py", line 131, in run
    agent.step(exec_callback=exec_callback)
  File "/Users/namin/code/mlk/aideml/aide/agent.py", line 290, in step
    self.parse_exec_result(
  File "/Users/namin/code/mlk/aideml/aide/agent.py", line 324, in parse_exec_result
    if not isinstance(response["metric"], float):
TypeError: string indices must be integers

AIDE Installation

Commandline

AIDE Version

main

LLM

any Ollama model as far as I can

Operating System

MacOS

Logs, Errors, Screenshots, and Additional Context

No response

@namin namin added the bug Something isn't working label Jan 29, 2025
@dexhunter dexhunter self-assigned this Jan 30, 2025
@dexhunter
Copy link
Member

dexhunter commented Jan 30, 2025

I found the issue is qwen2.5 or other models actually supports function calling [1] while it's not on the supported list [2], will find a better way to handle this

dexhunter added a commit to dexhunter/aideml that referenced this issue Jan 30, 2025
dexhunter added a commit to dexhunter/aideml that referenced this issue Jan 30, 2025
* remove the supported model lists
* update error handling WecoAI#43
* update code block display for html
dexhunter added a commit that referenced this issue Jan 30, 2025
* remove the supported model lists
* update error handling #43
* update code block display for html
@dexhunter
Copy link
Member

I've added the fix, can you please try if it works for you? @namin Let me know if any issues persist.

@namin
Copy link
Contributor Author

namin commented Jan 31, 2025

Just got around to testing this, it works end-to-end now! Thanks for the quick reaction, @dexhunter!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants