scawful/yaze
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: Enhance GUI action generation and testing for AI tile placement

Browse Source 
- Introduced `GuiActionGenerator` class to convert high-level AI actions into executable GUI test scripts, supporting JSON output for automated testing.
- Added comprehensive test suite for AI tile placement commands, validating command parsing and generated test scripts.
- Updated `README.md` to reflect recent enhancements and completed features in the project.
- Improved CMake configuration to include new source files for GUI action generation and related services.
This commit is contained in:
scawful
2025-10-04 22:23:31 -04:00
parent 9d5919adb5
commit 13bbe8078a
7 changed files with 481 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
docs/z3ed/README.md
View File

@@ -887,11 +887,15 @@ The AI response appears in your chat history and can reference specific details
4. **Collaboration UI Enhancements (1 day)**: Add UI elements for ROM sync, snapshot sharing, and proposal management in the Agent Chat widget.
5. **Windows Cross-Platform Testing (8-10h)**: Validate `z3ed` and the test harness on Windows.
### ✅ Recently Completed (v0.2.0-alpha)
### ✅ Recently Completed (v0.2.0-alpha - October 5, 2025)
- **Enhanced System Prompt (v3)**: Proactive tool chaining with implicit iteration to minimize back-and-forth
- **Learn Command**: Full implementation with preferences, ROM patterns, project context, and conversation memory
- **gRPC Windows Build Optimization**: Documented vcpkg approach and optimization strategies
- **Enhanced System Prompt (v3)**: Proactive tool chaining with implicit iteration to minimize back-and-forth conversations
- **Learn Command**: Full implementation with preferences, ROM patterns, project context, and conversation memory storage
- **Native Gemini Function Calling**: Upgraded from manual curl to native function calling API with automatic tool schema generation
- **Multimodal Vision Testing**: Comprehensive test suite for Gemini vision capabilities with screenshot integration
- **AI-Controlled GUI Automation**: Natural language parsing (`AIActionParser`) and test script generation (`GuiActionGenerator`) for automated tile placement
- **gRPC Windows Build Optimization**: vcpkg integration for 10-20x faster Windows builds, removed abseil-cpp submodule
- **Improved Documentation**: Consolidated architecture, enhancement plans, and build instructions with JSON-first approach
## 12. Troubleshooting