scawful ec88f087a2 feat: Add AI GUI controller and vision action refiner for enhanced automation ...

- Introduced `AIGUIController` class to manage AI-driven GUI automation with vision feedback, enabling natural language command execution and iterative action refinement.
- Implemented `VisionActionRefiner` class to analyze screenshots and refine actions based on visual feedback, improving action success rates.
- Added header and implementation files for both classes, along with necessary methods for screenshot analysis, action verification, and UI element location.
- Updated CMake configuration to include new source files for the AI GUI controller and vision action refiner functionalities.

2025-10-04 23:09:59 -04:00

..

ai_action_parser.cc

feat: Add AI action parser for natural language command processing

2025-10-04 22:19:09 -04:00

ai_action_parser.h

feat: Add AI action parser for natural language command processing

2025-10-04 22:19:09 -04:00

ai_gui_controller.cc

feat: Add AI GUI controller and vision action refiner for enhanced automation

2025-10-04 23:09:59 -04:00

ai_gui_controller.h

feat: Add AI GUI controller and vision action refiner for enhanced automation

2025-10-04 23:09:59 -04:00

ai_service.cc

feat: Add resource search and dungeon room description commands

2025-10-04 12:00:51 -04:00

ai_service.h

Add YAML support and enhance AI service context handling

2025-10-03 16:44:29 -04:00

common.h

Add ToolDispatcher for Enhanced Tool Call Management

2025-10-03 12:47:15 -04:00

gemini_ai_service.cc

feat: Update function schemas and system prompt for enhanced agent capabilities

2025-10-04 22:14:04 -04:00

gemini_ai_service.h

feat: Update function schemas and system prompt for enhanced agent capabilities

2025-10-04 22:14:04 -04:00

ollama_ai_service.cc

feat: Enhance system prompt JSON schema and clarify tool result formatting in conversational agent

2025-10-04 03:19:28 -04:00

ollama_ai_service.h

Add YAML support and enhance AI service context handling

2025-10-03 16:44:29 -04:00

prompt_builder.cc

feat: Enhance AI agent capabilities with new tool calling instructions, improved response handling, and terminal color utilities

2025-10-04 03:04:22 -04:00

prompt_builder.h

feat: Expand collaborative session capabilities in Z3ED documentation

2025-10-04 17:31:36 -04:00

service_factory.cc

feat: Add overworld sprite and entrance commands to agent tool

2025-10-04 21:27:10 -04:00

service_factory.h

feat: Add overworld sprite and entrance commands to agent tool

2025-10-04 21:27:10 -04:00

vision_action_refiner.cc

feat: Add AI GUI controller and vision action refiner for enhanced automation

2025-10-04 23:09:59 -04:00

vision_action_refiner.h

feat: Add AI GUI controller and vision action refiner for enhanced automation

2025-10-04 23:09:59 -04:00