AutoGen Studio and AutoGen v0.4 [Status Updates, Discussion]

[victordibia]

Hi all,

We are rewriting AutoGen Studio to take advantage of new features coming in AutoGen 0.4, as outlined in our readme. The goal of AutoGen Studio remains to create a tool to rapidly prototype, and debug multi-agent applications. This post updates developers on our progress and provides information for those interested in contributing or testing.

Installation Options

You can find the current version's code in autogen/python/packages/autogen-studio. There are two ways to install:

1. Recommended Method: Install the latest dev version from PyPI:

   pip install autogenstudio==0.4.0.dev37
   

run the app

autogenstudio ui 

if you have any issues with db etc ... you can create a new db

autogenstudio ui --appdir new

if you would like to force autoupgrade your db (still experimental)

autogenstudio ui --upgrade-database

2. Advanced Method: Install from source by following the AutoGen Studio readme. Note that this method is more complex and better suited for experienced users.

Development Status

While we're still in early development, you can view our planned features here.

Some Key Improvements

ags_update.mp4

The new AutoGen v0.4 API introduces asynchronous operation, which enables seamless message passing between agents. This enhancement particularly benefits end-user applications by adding several crucial features that were difficult to implement in the previous version:

New Features Already Available:

• Real-time agent updates streaming to the frontend
• Run control: You can now stop agents mid-execution if they're heading in the wrong direction, adjust the team, and continue
• Interactive feedback: Add a UserProxyAgent to get human input through the UI during team runs
• Message flow visualization: See how agents communicate with each other

Features Coming Soon:

See the roadmap here for planned features. Some include:

• Implement a drag and drop team builder interface for AGS #4202
• Ability to attach 3rd party or local gallery of components to AGS #4203

We welcome your feedback and contributions if you've had a chance to try the new version.

[SailorJoe6]

Just wanted to say, this looks pretty amazing!

[victordibia]

Thanks! @SailorJoe6, I seem to have gotten a notification on a session issue you reported, but cant seem to find that right now.
Any chance you can point me to it (assuming there was indeed an issue)?
Many thanks

[inayatwali]

This is great!

[SailorJoe6]

Last issue I reported was on the old version. Nothing reported against this one.

[victordibia]

Got it, thank you!

[mkarpovi-amd]

Attempting to create a team gives me an error reading: "POST /api/teams/ HTTP/1.1" 422 Unprocessable Entity. I made a clean Conda environment and installed ags v.0.4.0.dev37 with pip. Do you have any idea what might cause this?

[mkarpovi-amd]

pip show autogenstudio
Name: autogenstudio
Version: 0.4.0.dev37

[victordibia]

Thanks. Let me debug this a bit more in a new GH spaces env.
Will post any updates.

[victordibia]

I am unable to replicate this issue in fresh GH space.

autogenstudio ui --appdir new

Runs the app in a new directory, teams can be created and tasks run (after an openai_api_key is set).

Any chance you can share full logs from autogenstudio ui --appdir new

[mkarpovi-amd]

I seem to get a lot of messages like this:

INFO: Will watch for changes in these directories: ['C:\Users\mkarpovi']
INFO: Uvicorn running on http://127.0.0.1:7002 (Press CTRL+C to quit)
WARNING: --reload-include and --reload-exclude have no effect unless watchfiles is installed.
INFO: Started reloader process [636724] using StatReload
2024-11-22 14:20:49.704 | INFO | autogenstudio.web.initialization:init:38 - Initialized application data folder: new
INFO: Started server process [624616]
INFO: Waiting for application startup.
2024-11-22 14:20:49.738 | INFO | autogenstudio.web.app:lifespan:34 - Initializing application...
2024-11-22 14:20:49.746 | INFO | autogenstudio.database.schema_manager:init:64 - Initializing new Alembic configuration
2024-11-22 14:20:49.748 | INFO | autogenstudio.database.schema_manager:_initialize_alembic:141 - Initializing Alembic configuration...
2024-11-22 14:20:49.751 | INFO | autogenstudio.database.schema_manager:_initialize_alembic:152 - Created new env.py
2024-11-22 14:20:49.752 | INFO | autogenstudio.database.schema_manager:_initialize_alembic:158 - Created alembic.ini
2024-11-22 14:20:49.767 | INFO | autogenstudio.database.db_manager:init:56 - Schema status: Schema needs upgrade but auto_upgrade is disabled. Status: Unmigrated changes detected:
('add_table', Table('agent', MetaData(), Column('id', Integer(), table=, primary_key=True, nullable=False), Column('created_at', DateTime(timezone=True), table=, server_default=DefaultClause(<sqlalchemy.sql.functions.now at 0x287a457dd00; now>, for_update=False)), Column('updated_at', DateTime(timezone=True), table=, onupdate=ColumnElementColumnDefault(<sqlalchemy.sql.functions.now at 0x287a457df70; now>)), Column('user_id', AutoString(), table=), Column('version', AutoString(), table=, default=ScalarElementColumnDefault('0.0.1')), Column('config', JSON(), table=), schema=None))
('add_table', Table('model', MetaData(), Column('id', Integer(), table=, primary_key=True, nullable=False), Column('created_at', DateTime(timezone=True), table=, server_default=DefaultClause(<sqlalchemy.sql.functions.now at 0x287a4542450; now>, for_update=False)), Column('updated_at', DateTime(timezone=True), table=, onupdate=ColumnElementColumnDefault(<sqlalchemy.sql.functions.now at 0x287a457cb60; now>)), Column('user_id', AutoString(), table=), Column('version', AutoString(), table=, default=ScalarElementColumnDefault('0.0.1')), Column('config', JSON(), table=), schema=None))
('add_table', Table('team', MetaData(), Column('id', Integer(), table=, primary_key=True, nullable=False), Column('created_at', DateTime(timezone=True), table=, server_default=DefaultClause(<sqlalchemy.sql.functions.now at 0x287a457c9e0; now>, for_update=False)), Column('updated_at', DateTime(timezone=True), table=, onupdate=ColumnElementColumnDefault(<sqlalchemy.sql.functions.now at 0x287a457d340; now>)), Column('user_id', AutoString(), table=), Column('version', AutoString(), table=, default=ScalarElementColumnDefault('0.0.1')), Column('config', JSON(), table=), schema=None))
('add_table', Table('tool', MetaData(), Column('id', Integer(), table=, primary_key=True, nullable=False), Column('created_at', DateTime(timezone=True), table=, server_default=DefaultClause(<sqlalchemy.sql.functions.now at 0x287a4127140; now>, for_update=False)), Column('updated_at', DateTime(timezone=True), table=, onupdate=ColumnElementColumnDefault(<sqlalchemy.sql.functions.now at 0x287a442a000; now>)), Column('user_id', AutoString(), table=), Column('version', AutoString(), table=, default=ScalarElementColumnDefault('0.0.1')), Column('config', JSON(), table=), schema=None))
('add_table', Table('agentmodellink', MetaData(), Column('agent_id', Integer(), ForeignKey('agent.id'), table=, primary_key=True, nullable=False), Column('model_id', Integer(), ForeignKey('model.id'), table=, primary_key=True, nullable=False), Column('sequence', Integer(), table=, primary_key=True, nullable=False, default=ScalarElementColumnDefault(0)), schema=None))
('add_table', Table('agenttoollink', MetaData(), Column('agent_id', Integer(), ForeignKey('agent.id'), table=, primary_key=True, nullable=False), Column('tool_id', Integer(), ForeignKey('tool.id'), table=, primary_key=True, nullable=False), Column('sequence', Integer(), table=, primary_key=True, nullable=False, default=ScalarElementColumnDefault(0)), schema=None))
('add_table', Table('session', MetaData(), Column('id', Integer(), table=, primary_key=True, nullable=False), Column('created_at', DateTime(timezone=True), table=, server_default=DefaultClause(<sqlalchemy.sql.functions.now at 0x287a45c8080; now>, for_update=False)), Column('updated_at', DateTime(timezone=True), table=, onupdate=ColumnElementColumnDefault(<sqlalchemy.sql.functions.now at 0x287a45c9eb0; now>)), Column('user_id', AutoString(), table=), Column('version', AutoString(), table=, default=ScalarElementColumnDefault('0.0.1')), Column('team_id', Integer(), ForeignKey('team.id'), table=), Column('name', AutoString(), table=), schema=None))
('add_table', Table('teamagentlink', MetaData(), Column('team_id', Integer(), ForeignKey('team.id'), table=, primary_key=True, nullable=False), Column('agent_id', Integer(), ForeignKey('agent.id'), table=, primary_key=True, nullable=False), Column('sequence', Integer(), table=, primary_key=True, nullable=False, default=ScalarElementColumnDefault(0)), schema=None))
('add_table', Table('run', MetaData(), Column('id', Uuid(), table=, primary_key=True, nullable=False, default=CallableColumnDefault(<function uuid4 at 0x00000287A46107C0>)), Column('created_at', DateTime(timezone=True), table=, server_default=DefaultClause(<sqlalchemy.sql.functions.now at 0x287a45ca4b0; now>, for_update=False)), Column('updated_at', DateTime(timezone=True), table=, onupdate=ColumnElementColumnDefault(<sqlalchemy.sql.functions.now at 0x287a45ca7b0; now>)), Column('session_id', Integer(), ForeignKey('session.id'), table=, nullable=False), Column('status', Enum('CREATED', 'ACTIVE', 'COMPLETE', 'ERROR', 'STOPPED', name='runstatus'), table=, nullable=False, default=ScalarElementColumnDefault(<RunStatus.CREATED: 'created'>)), Column('error_message', AutoString(), table=), Column('run_meta', JSON(), table=), Column('version', AutoString(), table=, default=ScalarElementColumnDefault('0.0.1')), schema=None))
('add_index', Index('ix_run_id', Column('id', Uuid(), table=, primary_key=True, nullable=False, default=CallableColumnDefault(<function uuid4 at 0x00000287A46107C0>))))
('add_table', Table('message', MetaData(), Column('id', Integer(), table=, primary_key=True, nullable=False), Column('created_at', DateTime(timezone=True), table=, server_default=DefaultClause(<sqlalchemy.sql.functions.now at 0x287a457f6b0; now>, for_update=False)), Column('updated_at', DateTime(timezone=True), table=, onupdate=ColumnElementColumnDefault(<sqlalchemy.sql.functions.now at 0x287a457f3b0; now>)), Column('user_id', AutoString(), table=), Column('version', AutoString(), table=, default=ScalarElementColumnDefault('0.0.1')), Column('config', JSON(), table=), Column('session_id', Integer(), ForeignKey('session.id'), table=), Column('run_id', Uuid(), ForeignKey('run.id'), table=), Column('message_meta', JSON(), table=), schema=None))
2024-11-22 14:20:49.882 | INFO | autogenstudio.database.db_manager:create_db_and_tables:128 - Database tables created successfully
2024-11-22 14:20:49.884 | INFO | autogenstudio.web.app:lifespan:38 - Managers initialized successfully
2024-11-22 14:20:49.884 | INFO | autogenstudio.web.app:lifespan:41 - Application startup complete
INFO: Application startup complete.

The other issue is that I intend to do LLM inference through a local corporate gateway (which i accessed on 0.1.5 by modifying source to pass the relevant headers)--but I don't think I have got to the relevant point yet.

[victordibia]

I agree that we have not gotten to the LLM part yet (there is some work to be done there as its mostly the OpenAI client supported now).

I just made a dev release - 0.4.0.dev38 that fixes the Unmigrated changes detected issues above (though I dont think that should be what is preventing teams from being created).

pip install autogenstudio==0.4.0.dev38 

[rajramakalai]

Can you help with how to define a ollama model on the json structure please
"model_client": {
"component_type": "model",
"model": "gpt-4o-2024-08-06",
"model_type": "OpenAIChatCompletionClient"
}

[ekzhu]

You need to add model capabilities.

[rajramakalai]

Got it working, Thank you, but running from source, and adding the model names to the _model_info.py
with model client as
"model_client": {
"api_key": ".",
"base_url": "http://localhost:11434/v1",
"component_type": "model",
"model": "phi3.5",
"model_type": "OpenAIChatCompletionClient"
}