Compare commits
87 Commits
| Author | SHA1 | Date | |
|---|---|---|---|
| 2fee2d5ea3 | |||
| 3082843810 | |||
| 34098e2f66 | |||
| 8461006c91 | |||
| 2e76a35188 | |||
| abc96b415f | |||
| 77ce3b0b49 | |||
| 3742f75d14 | |||
| c2e9e6a571 | |||
| 54eb50f7be | |||
| 9351948794 | |||
| 68d1a10dd0 | |||
| b9fe8146b6 | |||
| 2a727226bc | |||
| 0167377b2f | |||
| f21914284c | |||
| 035091045a | |||
| 1cd18b3ba9 | |||
| 8ba04bf243 | |||
| 67bf38c8d5 | |||
| 8885bde0ec | |||
| b33e361cee | |||
| d1c8ca8197 | |||
| 2b8b6ef86a | |||
| 0b46fd1d7a | |||
| e2819714f1 | |||
| 3e6c431a0b | |||
| d0836fd788 | |||
| 32c17627e9 | |||
| 13a6d2c164 | |||
| d756a2ef1c | |||
| b9b812cc25 | |||
| 70caf6856b | |||
| 34dad35698 | |||
| 34e3a1a75c | |||
| cac86f2fbf | |||
| d1290c8070 | |||
| 49d6163a70 | |||
| 20f33ac478 | |||
| 683602bb6b | |||
| ad19a26a57 | |||
| 51f81fc44c | |||
| 71905a6ca0 | |||
| 9ada66bb43 | |||
| 2d66915570 | |||
| 25098f8772 | |||
| 8a67b96fdb | |||
| 682a08e0dc | |||
| b53d4dd8a5 | |||
| a4e48d32a4 | |||
| cdd1602f79 | |||
| adec9d8197 | |||
| 1b9970da14 | |||
| aa8f5ae235 | |||
| 60a6b5e5b6 | |||
| 7ae8fe753a | |||
| a1dfe879c1 | |||
| 6e7619760f | |||
| efc85da91c | |||
| 8e11fcb918 | |||
| 4a9bd9aed0 | |||
| 0f697c21bd | |||
| e0d6d0d51b | |||
| d92ba7d882 | |||
| 3e8e584065 | |||
| 9bdd565feb | |||
| b0a31e777b | |||
| 78a54d0d3d | |||
| 7f04f3564a | |||
| 22a25b17f5 | |||
| 8a63c1b716 | |||
| ab710bcaf5 | |||
| df449166d5 | |||
| da822c5fe1 | |||
| 78412323a7 | |||
| ad06cd1869 | |||
| 86682c3a1e | |||
| fee3bbdf85 | |||
| 4d3c878809 | |||
| e704398c43 | |||
| 56d20904b9 | |||
| bdddcb860e | |||
| e6e8ebf4e3 | |||
| 9b1131ce13 | |||
| 462d76dbb6 | |||
| 3791d1e157 | |||
| 2e3355f52c |
@@ -6,32 +6,11 @@ body:
|
|||||||
- type: markdown
|
- type: markdown
|
||||||
attributes:
|
attributes:
|
||||||
value: |
|
value: |
|
||||||
Please follow our community communication guidelines when filing issues.
|
Thanks for your interest in improving the project! Before submitting, please read our guidelines.
|
||||||
- Be polite and respectful.
|
感谢您对改进项目的兴趣!提交前请阅读我们的指南。
|
||||||
- Prefer constructive, actionable feedback over venting.
|
|
||||||
- Include clear reproduction steps and environment details.
|
|
||||||
- Consider contributing a fix if possible — PRs are welcome.
|
|
||||||
|
|
||||||
提交 Issue 时请遵守社区沟通规范:
|
- [Code of Conduct](https://github.com/alibaba/page-agent/blob/main/CODE_OF_CONDUCT.md)
|
||||||
- 保持礼貌与尊重。
|
- [Contributing Guide](https://github.com/alibaba/page-agent/blob/main/CONTRIBUTING.md)
|
||||||
- 提供建设性、可行动的反馈,避免情绪化表达。
|
|
||||||
- 请包含清晰的复现步骤与环境信息。
|
|
||||||
- 如果可以,欢迎直接提交修复 PR。
|
|
||||||
|
|
||||||
See: CODE_OF_CONDUCT.md / CODE_OF_CONDUCT_zh.md, CONTRIBUTING.md
|
|
||||||
|
|
||||||
- type: checkboxes
|
|
||||||
id: community
|
|
||||||
attributes:
|
|
||||||
label: Community Communication / 社区沟通
|
|
||||||
description: Confirm you will communicate respectfully and constructively / 确认将以礼貌、建设性的方式沟通
|
|
||||||
options:
|
|
||||||
- label: I will be polite and respectful. / 我会保持礼貌与尊重。
|
|
||||||
required: true
|
|
||||||
- label: I will share constructive, actionable details. / 我会提供建设性、可行动的细节。
|
|
||||||
required: true
|
|
||||||
- label: I have read the Code of Conduct. / 我已阅读行为准则。
|
|
||||||
required: true
|
|
||||||
|
|
||||||
- type: textarea
|
- type: textarea
|
||||||
id: description
|
id: description
|
||||||
@@ -48,7 +27,7 @@ body:
|
|||||||
render: typescript
|
render: typescript
|
||||||
placeholder: Minimal reproduction code
|
placeholder: Minimal reproduction code
|
||||||
validations:
|
validations:
|
||||||
required: true
|
required: false
|
||||||
|
|
||||||
- type: input
|
- type: input
|
||||||
id: browser
|
id: browser
|
||||||
@@ -56,7 +35,7 @@ body:
|
|||||||
label: Browser
|
label: Browser
|
||||||
placeholder: 'Chrome 120, Firefox 119, etc.'
|
placeholder: 'Chrome 120, Firefox 119, etc.'
|
||||||
validations:
|
validations:
|
||||||
required: true
|
required: false
|
||||||
|
|
||||||
- type: input
|
- type: input
|
||||||
id: version
|
id: version
|
||||||
@@ -64,4 +43,19 @@ body:
|
|||||||
label: version
|
label: version
|
||||||
placeholder: '0.0.0'
|
placeholder: '0.0.0'
|
||||||
validations:
|
validations:
|
||||||
required: true
|
required: false
|
||||||
|
|
||||||
|
- type: checkboxes
|
||||||
|
id: community
|
||||||
|
attributes:
|
||||||
|
label: Community Communication / 社区沟通
|
||||||
|
description: Confirm you will communicate respectfully and constructively / 确认将以礼貌、建设性的方式沟通
|
||||||
|
options:
|
||||||
|
- label: I will be polite and respectful. / 我会保持礼貌与尊重。
|
||||||
|
required: true
|
||||||
|
- label: I will share constructive, actionable suggestions. / 我会提供建设性、可行动的建议。
|
||||||
|
required: true
|
||||||
|
- label: I have read the Code of Conduct. / 我已阅读行为准则。
|
||||||
|
required: true
|
||||||
|
validations:
|
||||||
|
required: true
|
||||||
@@ -12,6 +12,3 @@ contact_links:
|
|||||||
- name: Code of Conduct / 行为准则
|
- name: Code of Conduct / 行为准则
|
||||||
url: https://github.com/alibaba/page-agent/blob/main/CODE_OF_CONDUCT.md
|
url: https://github.com/alibaba/page-agent/blob/main/CODE_OF_CONDUCT.md
|
||||||
about: Community expectations and standards. 社区行为期望与标准。
|
about: Community expectations and standards. 社区行为期望与标准。
|
||||||
- name: 行为准则(中文)
|
|
||||||
url: https://github.com/alibaba/page-agent/blob/main/CODE_OF_CONDUCT_zh.md
|
|
||||||
about: 中文版社区行为准则。
|
|
||||||
|
|||||||
@@ -6,19 +6,30 @@ body:
|
|||||||
- type: markdown
|
- type: markdown
|
||||||
attributes:
|
attributes:
|
||||||
value: |
|
value: |
|
||||||
Please follow our community communication guidelines when proposing features.
|
Thanks for your interest in improving the project! Before submitting, please read our guidelines.
|
||||||
- Be polite and respectful.
|
感谢您对改进项目的兴趣!提交前请阅读我们的指南。
|
||||||
- Explain the problem first, then propose solutions.
|
|
||||||
- Prefer constructive, actionable suggestions.
|
|
||||||
- Contributions are encouraged — consider opening a PR.
|
|
||||||
|
|
||||||
提交功能建议时请遵守社区沟通规范:
|
- [Code of Conduct](https://github.com/alibaba/page-agent/blob/main/CODE_OF_CONDUCT.md)
|
||||||
- 保持礼貌与尊重。
|
- [Contributing Guide](https://github.com/alibaba/page-agent/blob/main/CONTRIBUTING.md)
|
||||||
- 先阐述问题,再提出解决方案。
|
|
||||||
- 提供建设性、可行动的建议。
|
|
||||||
- 鼓励代码贡献,欢迎直接提交 PR。
|
|
||||||
|
|
||||||
See: CODE_OF_CONDUCT.md / CODE_OF_CONDUCT_zh.md, CONTRIBUTING.md
|
- type: textarea
|
||||||
|
id: description
|
||||||
|
attributes:
|
||||||
|
label: Feature Description / 功能描述
|
||||||
|
description: Describe the problem, solution, and any API changes. / 描述问题、解决方案以及 API 变更。
|
||||||
|
placeholder: |
|
||||||
|
**Problem**:
|
||||||
|
What problem does this solve?
|
||||||
|
|
||||||
|
**Solution**:
|
||||||
|
How should this work?
|
||||||
|
|
||||||
|
**Proposed API**:
|
||||||
|
```typescript
|
||||||
|
// code here
|
||||||
|
```
|
||||||
|
validations:
|
||||||
|
required: true
|
||||||
|
|
||||||
- type: checkboxes
|
- type: checkboxes
|
||||||
id: community
|
id: community
|
||||||
@@ -32,27 +43,5 @@ body:
|
|||||||
required: true
|
required: true
|
||||||
- label: I have read the CODE_OF_CONDUCT.md and CONTRIBUTING.md. / 我已阅读行为准则。
|
- label: I have read the CODE_OF_CONDUCT.md and CONTRIBUTING.md. / 我已阅读行为准则。
|
||||||
required: true
|
required: true
|
||||||
|
|
||||||
- type: textarea
|
|
||||||
id: problem
|
|
||||||
attributes:
|
|
||||||
label: Problem
|
|
||||||
placeholder: What problem does this solve?
|
|
||||||
validations:
|
validations:
|
||||||
required: true
|
required: true
|
||||||
|
|
||||||
- type: textarea
|
|
||||||
id: solution
|
|
||||||
attributes:
|
|
||||||
label: Solution
|
|
||||||
placeholder: How should this work?
|
|
||||||
validations:
|
|
||||||
required: true
|
|
||||||
|
|
||||||
- type: textarea
|
|
||||||
id: api
|
|
||||||
attributes:
|
|
||||||
label: Proposed API
|
|
||||||
render: typescript
|
|
||||||
validations:
|
|
||||||
required: false
|
|
||||||
@@ -5,9 +5,12 @@ Brief description of changes.
|
|||||||
## Type
|
## Type
|
||||||
|
|
||||||
- [ ] Bug fix
|
- [ ] Bug fix
|
||||||
- [ ] New feature
|
- [ ] Feature / Improvement
|
||||||
- [ ] Breaking change
|
- [ ] Refactor
|
||||||
- [ ] Documentation
|
- [ ] Documentation
|
||||||
|
- [ ] Website
|
||||||
|
- [ ] Demo / Testing
|
||||||
|
- [ ] Breaking change
|
||||||
|
|
||||||
## Testing
|
## Testing
|
||||||
|
|
||||||
@@ -19,10 +22,4 @@ Closes #(issue)
|
|||||||
|
|
||||||
## Requirements / 要求
|
## Requirements / 要求
|
||||||
|
|
||||||
- [ ] I will be polite and respectful. / 我会保持礼貌与尊重。
|
|
||||||
- [ ] My comments and replies are constructive and actionable. / 我的评论与回复具有建设性。
|
|
||||||
- [ ] I have read and follow the [Code of Conduct](CODE_OF_CONDUCT.md) and [Contributing Guide](CONTRIBUTING.md) . / 我已阅读并遵守行为准则。
|
- [ ] I have read and follow the [Code of Conduct](CODE_OF_CONDUCT.md) and [Contributing Guide](CONTRIBUTING.md) . / 我已阅读并遵守行为准则。
|
||||||
|
|
||||||
## Contributing / 贡献
|
|
||||||
|
|
||||||
Constructive suggestions and code contributions are encouraged. If this PR originated from a discussion or issue, please link it above. 欢迎建设性意见与代码贡献;如源自讨论或 Issue,请在上方关联链接。
|
|
||||||
|
|||||||
@@ -13,10 +13,10 @@ jobs:
|
|||||||
runs-on: ubuntu-latest
|
runs-on: ubuntu-latest
|
||||||
strategy:
|
strategy:
|
||||||
matrix:
|
matrix:
|
||||||
node-version: [20, 22]
|
node-version: [20, 24, 25]
|
||||||
|
|
||||||
steps:
|
steps:
|
||||||
- uses: actions/checkout@v5
|
- uses: actions/checkout@v6
|
||||||
|
|
||||||
- name: Setup Node.js ${{ matrix.node-version }}
|
- name: Setup Node.js ${{ matrix.node-version }}
|
||||||
uses: actions/setup-node@v6
|
uses: actions/setup-node@v6
|
||||||
@@ -24,6 +24,13 @@ jobs:
|
|||||||
node-version: ${{ matrix.node-version }}
|
node-version: ${{ matrix.node-version }}
|
||||||
cache: 'npm'
|
cache: 'npm'
|
||||||
|
|
||||||
|
# test on default version of npm
|
||||||
|
# - 9.6~10.8 on node@20
|
||||||
|
# - 11.3~11.6 on node@24
|
||||||
|
|
||||||
|
- name: Node and NPM version
|
||||||
|
run: node --version && npm --version
|
||||||
|
|
||||||
- name: Install dependencies
|
- name: Install dependencies
|
||||||
run: npm install
|
run: npm install
|
||||||
|
|
||||||
|
|||||||
@@ -13,19 +13,19 @@ jobs:
|
|||||||
id-token: write
|
id-token: write
|
||||||
|
|
||||||
steps:
|
steps:
|
||||||
- uses: actions/checkout@v5
|
- uses: actions/checkout@v6
|
||||||
|
|
||||||
- name: Setup Node.js
|
- name: Setup Node.js
|
||||||
uses: actions/setup-node@v6
|
uses: actions/setup-node@v6
|
||||||
with:
|
with:
|
||||||
node-version: 20
|
node-version: 24
|
||||||
cache: 'npm'
|
cache: 'npm'
|
||||||
|
|
||||||
- name: Install dependencies
|
- name: Install dependencies
|
||||||
run: npm ci
|
run: npm ci
|
||||||
|
|
||||||
- name: Build demo
|
- name: Build demo
|
||||||
run: npm run build
|
run: npm run build:website
|
||||||
|
|
||||||
- name: Setup Pages
|
- name: Setup Pages
|
||||||
uses: actions/configure-pages@v5
|
uses: actions/configure-pages@v5
|
||||||
@@ -33,7 +33,7 @@ jobs:
|
|||||||
- name: Upload artifact
|
- name: Upload artifact
|
||||||
uses: actions/upload-pages-artifact@v4
|
uses: actions/upload-pages-artifact@v4
|
||||||
with:
|
with:
|
||||||
path: './dist'
|
path: './packages/website/dist'
|
||||||
|
|
||||||
- name: Deploy to GitHub Pages
|
- name: Deploy to GitHub Pages
|
||||||
id: deployment
|
id: deployment
|
||||||
|
|||||||
@@ -13,12 +13,12 @@ jobs:
|
|||||||
release:
|
release:
|
||||||
runs-on: ubuntu-latest
|
runs-on: ubuntu-latest
|
||||||
steps:
|
steps:
|
||||||
- uses: actions/checkout@v5
|
- uses: actions/checkout@v6
|
||||||
|
|
||||||
- name: Setup Node.js
|
- name: Setup Node.js
|
||||||
uses: actions/setup-node@v6
|
uses: actions/setup-node@v6
|
||||||
with:
|
with:
|
||||||
node-version: 20
|
node-version: 24
|
||||||
registry-url: 'https://registry.npmjs.org'
|
registry-url: 'https://registry.npmjs.org'
|
||||||
|
|
||||||
# Ensure npm 11.5.1 or later is installed
|
# Ensure npm 11.5.1 or later is installed
|
||||||
@@ -29,7 +29,7 @@ jobs:
|
|||||||
run: npm ci
|
run: npm ci
|
||||||
|
|
||||||
- name: Build
|
- name: Build
|
||||||
run: npm run build:lib
|
run: npm run build:libs
|
||||||
|
|
||||||
- name: Publish to npm
|
- name: Publish all public packages
|
||||||
run: npm publish
|
run: npm publish --workspaces --access public
|
||||||
+7
-1
@@ -23,7 +23,13 @@ dist-ssr
|
|||||||
*.njsproj
|
*.njsproj
|
||||||
*.sln
|
*.sln
|
||||||
*.sw?
|
*.sw?
|
||||||
|
.qoder
|
||||||
|
|
||||||
|
|
||||||
#
|
#
|
||||||
.env
|
.env
|
||||||
|
|
||||||
|
# Copied files for npm publish (generated by prepublishOnly)
|
||||||
|
packages/page-agent/README.md
|
||||||
|
packages/page-agent/README-zh.md
|
||||||
|
packages/page-agent/LICENSE
|
||||||
+1
-1
@@ -1 +1 @@
|
|||||||
npx lint-staged
|
npx lint-staged --allow-empty
|
||||||
Vendored
+1
-1
@@ -1,3 +1,3 @@
|
|||||||
{
|
{
|
||||||
"recommendations": ["dbaeumer.vscode-eslint", "esbenp.prettier-vscode"]
|
"recommendations": ["dbaeumer.vscode-eslint", "prettier.prettier-vscode"]
|
||||||
}
|
}
|
||||||
|
|||||||
Vendored
+1
-1
@@ -1,6 +1,6 @@
|
|||||||
{
|
{
|
||||||
"editor.fontLigatures": true,
|
"editor.fontLigatures": true,
|
||||||
"cSpell.words": ["HITL", "opensource", "retryable"],
|
"cSpell.words": ["HITL", "innerhtml", "opensource", "retryable", "wouter"],
|
||||||
"markdownlint.config": {
|
"markdownlint.config": {
|
||||||
// "comment": "Relaxed rules",
|
// "comment": "Relaxed rules",
|
||||||
"default": true,
|
"default": true,
|
||||||
|
|||||||
@@ -2,56 +2,106 @@
|
|||||||
|
|
||||||
## Project Overview
|
## Project Overview
|
||||||
|
|
||||||
This is a dual-architecture project with **two separate parts**:
|
This is a **monorepo** with npm workspaces containing **two main packages**:
|
||||||
|
|
||||||
1. **Core Library** (`src/`) - Pure JavaScript/TypeScript AI agent library for browser DOM automation
|
1. **Core Library** (`packages/page-agent/`) - Pure JavaScript/TypeScript AI agent library for browser DOM automation, published as `page-agent` on npm
|
||||||
2. **Demo&docs Website** (`pages/`) - React documentation and landing page
|
2. **Website** (`packages/website/`) - React documentation and landing page. Also as demo and test page for the core lib. private package `@page-agent/website`
|
||||||
|
|
||||||
|
And other internal packages:
|
||||||
|
|
||||||
|
- **Page Controller** (`packages/page-controller/`) - DOM operations and element interactions. Independent of LLM.
|
||||||
|
- **UI** (`packages/ui/`) - Panel, SimulatorMask, and i18n. Decoupled from PageAgent.
|
||||||
|
|
||||||
## Development Commands
|
## Development Commands
|
||||||
|
|
||||||
### Core Commands
|
### Core Commands
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
npm start # Start React website development server
|
npm start # Start website dev server
|
||||||
npm run build # Build both library AND website
|
npm run build # Build all packages
|
||||||
npm run build:lib # Build pure JS library only (src/ → dist/lib/)
|
npm run build:libs # Build all libraries
|
||||||
npm run build:lib:watch # Library development with auto-rebuild
|
npm run build:website # Build the website
|
||||||
npm run lint # ESLint with TypeScript strict rules
|
npm run lint # ESLint with TypeScript strict rules
|
||||||
```
|
```
|
||||||
|
|
||||||
## Architecture & Critical Patterns
|
## Architecture & Critical Patterns
|
||||||
|
|
||||||
### Dual Build System
|
### Monorepo Structure
|
||||||
|
|
||||||
- **Website build**: `vite.config.js` → React SPA with hash routing → `dist/`
|
We adopt a very simple monorepo solution: ts reference + vite alias.
|
||||||
- **Library build**: `vite.lib.config.js` → UMD/ES modules → `dist/lib/`
|
|
||||||
- **Entry points**: `src/entry.ts` (library), `pages/main.tsx` (website)
|
You must update tsconfig and vite config if you add/remove/rename a package.
|
||||||
|
|
||||||
|
```bash
|
||||||
|
packages/
|
||||||
|
├── page-agent/ # npm: "page-agent" ⭐ MAIN
|
||||||
|
│ ├── src/
|
||||||
|
│ │ ├── PageAgent.ts # Main AI agent class
|
||||||
|
│ │ ├── tools/ # LLM tool definitions
|
||||||
|
│ │ └── llms/ # LLM integration
|
||||||
|
│ ├── vite.config.js # Library build (ES + UMD)
|
||||||
|
│ └── package.json
|
||||||
|
├── website/ # npm: "@page-agent/website" (private) ⭐ MAIN
|
||||||
|
│ ├── src/ # Website source
|
||||||
|
│ └── index.html # Entry of vite webpage
|
||||||
|
│
|
||||||
|
│ # ...internal packages below...
|
||||||
|
│
|
||||||
|
├── page-controller/ # npm: "@page-agent/page-controller"
|
||||||
|
│ └── src/ # DOM operations
|
||||||
|
│ ├── PageController.ts
|
||||||
|
│ ├── actions.ts
|
||||||
|
│ └── dom/
|
||||||
|
└── ui/ # npm: "@page-agent/ui"
|
||||||
|
└── src/ # Panel and Mask Effects
|
||||||
|
├── Panel.ts
|
||||||
|
├── SimulatorMask.ts
|
||||||
|
└── i18n/
|
||||||
|
```
|
||||||
|
|
||||||
|
`workspaces` must be written in topological order to guarantee build order.
|
||||||
|
|
||||||
|
```json
|
||||||
|
"workspaces": [
|
||||||
|
// internal deps (topological order)
|
||||||
|
"packages/page-controller",
|
||||||
|
"packages/ui",
|
||||||
|
"packages/page-agent",
|
||||||
|
"packages/website"
|
||||||
|
],
|
||||||
|
```
|
||||||
|
|
||||||
### Module Boundaries (Critical)
|
### Module Boundaries (Critical)
|
||||||
|
|
||||||
- **Core library** (`src/`): NEVER import from `pages/` - must remain pure JavaScript
|
- **Website** (`packages/website/`): CAN import from `page-agent` for demos. Alias `@/` → `website/src/`
|
||||||
- **Website** (`pages/`): CAN import from `src/` via `@/` alias for demos
|
- **Page Agent** (`packages/page-agent/`): The core lib. Imports from `@page-agent/page-controller` and `@page-agent/ui`.
|
||||||
- **Import aliases**: `@/` → `src/`, `@pages/` → `pages/`
|
- **UI** (`packages/ui/`): Panel, Mask, i18n. No dependency on page-agent.
|
||||||
|
- **Page Controller** (`packages/page-controller/`): Pure DOM operations. No LLM or UI dependency.
|
||||||
|
|
||||||
|
### PageController ↔ PageAgent Communication
|
||||||
|
|
||||||
|
All communication between PageAgent and PageController is async and isolated:
|
||||||
|
|
||||||
|
```typescript
|
||||||
|
// PageAgent delegates DOM operations to PageController
|
||||||
|
await this.pageController.updateTree() // Refresh DOM state
|
||||||
|
await this.pageController.clickElement(index) // Click by index
|
||||||
|
await this.pageController.inputText(index, text)
|
||||||
|
await this.pageController.scroll({ down: true, numPages: 1 })
|
||||||
|
|
||||||
|
// PageController exposes state via async methods
|
||||||
|
const simplifiedHTML = await this.pageController.getSimplifiedHTML()
|
||||||
|
const pageInfo = await this.pageController.getPageInfo()
|
||||||
|
```
|
||||||
|
|
||||||
|
DOM element references and internal state (selectorMap, elementTextMap) are encapsulated in PageController.
|
||||||
|
|
||||||
### DOM Pipeline
|
### DOM Pipeline
|
||||||
|
|
||||||
1. **DOM Extraction**: Convert live DOM to `FlatDomTree` via `src/dom/dom_tree/`
|
1. **DOM Extraction**: Convert live DOM to `FlatDomTree` via `page-controller/src/dom/dom_tree/`
|
||||||
2. **Dehydration**: DOM tree → simplified text for LLM processing
|
2. **Dehydration**: DOM tree → simplified text for LLM processing
|
||||||
3. **LLM Processing**: AI model returns action plans
|
3. **LLM Processing**: AI model returns action plans (in page-agent)
|
||||||
4. **Indexed Operations**: Map LLM responses back to specific DOM elements
|
4. **Indexed Operations**: PageAgent calls PageController methods by element index
|
||||||
|
|
||||||
### Event Bus Communication
|
|
||||||
|
|
||||||
Use `src/utils/bus.ts` for decoupled PageAgent ↔ UI communication:
|
|
||||||
|
|
||||||
```typescript
|
|
||||||
// Emit from PageAgent
|
|
||||||
getEventBus().emit('panel:show')
|
|
||||||
getEventBus().emit('panel:update', { status: 'thinking' })
|
|
||||||
|
|
||||||
// Listen in UI components
|
|
||||||
getEventBus().on('panel:show', () => panel.show())
|
|
||||||
```
|
|
||||||
|
|
||||||
### Hash Routing Requirement
|
### Hash Routing Requirement
|
||||||
|
|
||||||
@@ -71,47 +121,59 @@ Library auto-initializes when injected via script tag:
|
|||||||
|
|
||||||
Query params configure `PageAgentConfig` automatically in `src/entry.ts`.
|
Query params configure `PageAgentConfig` automatically in `src/entry.ts`.
|
||||||
|
|
||||||
## File Organization
|
## Key Files Reference
|
||||||
|
|
||||||
### Core Library (`src/`)
|
### Page Agent (`packages/page-agent/`)
|
||||||
|
|
||||||
- `entry.ts` - CDN/UMD entry point with auto-initialization
|
| File | Description |
|
||||||
- `PageAgent.ts` - **Main AI agent class** orchestrating DOM operations
|
|------|-------------|
|
||||||
- `tools/` - Agent tool implementations for web actions
|
| `src/PageAgent.ts` | ⭐ Main AI agent class orchestrating tools and LLM |
|
||||||
- `ui/` - UI components (Panel, SimulatorMask) with CSS modules
|
| `src/umd.ts` | CDN/UMD entry point with auto-initialization |
|
||||||
- `utils/bus.ts` - **Type-safe event bus** for decoupled communication
|
| `src/tools/` | Tool definitions that call PageController methods |
|
||||||
- `patches/` - Framework-specific optimizations (React, Antd compatibility)
|
| `src/llms/` | LLM integration and communication layer |
|
||||||
- `llms/` - LLM integration and communication layer
|
| `vite.config.js` | Library build configuration (ES + UMD) |
|
||||||
- `dom/` - HTML serialization and page analysis utilities
|
|
||||||
- `config/` - Configuration constants and settings
|
|
||||||
|
|
||||||
### Website (`pages/`)
|
### Page Controller (`packages/page-controller/`)
|
||||||
|
|
||||||
- `main.tsx` - Site entry with hash routing setup
|
| File | Description |
|
||||||
- `router.tsx` - **Manual route definitions** (requires explicit registration)
|
|------|-------------|
|
||||||
- `components/DocsLayout.tsx` - Navigation structure (hardcoded nav items)
|
| `src/PageController.ts` | ⭐ Main controller class managing DOM state and actions |
|
||||||
- `docs/[section]/[topic]/page.tsx` - Documentation pages
|
| `src/actions.ts` | Element interaction implementations (click, input, scroll) |
|
||||||
- `test-pages/` - Library integration test pages
|
| `src/dom/dom_tree/index.js` | Core DOM extraction engine (ported from browser-use) |
|
||||||
|
| `src/dom/getPageInfo.ts` | Page scroll/size information |
|
||||||
|
| `src/patches/` | Framework-specific optimizations (React, Antd) |
|
||||||
|
| `src/types.ts` | TypeScript interfaces for controller |
|
||||||
|
|
||||||
|
### Website (`packages/website/`)
|
||||||
|
|
||||||
|
| File | Description |
|
||||||
|
|------|-------------|
|
||||||
|
| `src/router.tsx` | ⭐ Central routing (manual registration required) |
|
||||||
|
| `src/components/DocsLayout.tsx` | Navigation structure (hardcoded nav items) |
|
||||||
|
| `src/main.tsx` | Site entry with hash routing setup |
|
||||||
|
| `src/docs/[section]/[topic]/page.tsx` | Documentation pages |
|
||||||
|
| `src/test-pages/` | Library integration test pages |
|
||||||
|
| `vite.config.js` | Website build configuration |
|
||||||
|
|
||||||
## Adding New Features
|
## Adding New Features
|
||||||
|
|
||||||
### New Documentation Page
|
### New Documentation Page
|
||||||
|
|
||||||
1. Create `pages/docs/<section>/<slug>/page.tsx`
|
1. Create `packages/website/src/docs/<section>/<slug>/page.tsx`
|
||||||
2. Add route to `pages/router.tsx` with `<Header /> + <DocsLayout>` wrapper
|
2. Add route to `packages/website/src/router.tsx` with `<Header /> + <DocsLayout>` wrapper
|
||||||
3. Add navigation item to `DocsLayout.tsx`
|
3. Add navigation item to `DocsLayout.tsx`
|
||||||
|
|
||||||
### New Agent Tool
|
### New Agent Tool
|
||||||
|
|
||||||
1. Implement under `src/tools/`
|
1. Implement tool in `packages/page-agent/src/tools/index.ts`
|
||||||
2. Export via `src/tools/index.ts`
|
2. If tool needs DOM operations, add method to PageController first
|
||||||
3. Wire into `PageAgent.ts` if needed
|
3. Tool calls `this.pageController.methodName()` for DOM interactions
|
||||||
|
|
||||||
### New UI Component
|
### New PageController Action
|
||||||
|
|
||||||
1. Create in `src/ui/` with colocated CSS modules
|
1. Add action implementation in `packages/page-controller/src/actions.ts`
|
||||||
2. Use event bus for PageAgent communication
|
2. Expose via async method in `PageController.ts`
|
||||||
3. Test via `pages/test-pages/`
|
3. Export from `packages/page-controller/src/index.ts`
|
||||||
|
|
||||||
## Code Standards
|
## Code Standards
|
||||||
|
|
||||||
@@ -134,28 +196,17 @@ Query params configure `PageAgentConfig` automatically in `src/entry.ts`.
|
|||||||
- Relative imports last
|
- Relative imports last
|
||||||
- Blank lines between groups
|
- Blank lines between groups
|
||||||
|
|
||||||
## Critical Files to Understand
|
|
||||||
|
|
||||||
- `pages/router.tsx` - Central routing definition (manual registration required)
|
|
||||||
- `pages/components/DocsLayout.tsx` - Navigation structure
|
|
||||||
- `src/PageAgent.ts` - Core AI agent class with DOM manipulation
|
|
||||||
- `src/dom/dom_tree/index.js` - DOM extraction engine
|
|
||||||
- `src/utils/bus.ts` - Type-safe event bus system
|
|
||||||
- `src/entry.ts` - Library entry point for CDN usage
|
|
||||||
- `vite.config.js` / `vite.lib.config.js` - Dual build configuration
|
|
||||||
|
|
||||||
## Debugging Common Issues
|
## Debugging Common Issues
|
||||||
|
|
||||||
### Blank Documentation Pages
|
### Blank Documentation Pages
|
||||||
|
|
||||||
1. Verify route exists in `pages/router.tsx`
|
1. Verify route exists in `packages/website/src/router.tsx`
|
||||||
2. Check component import path
|
2. Check component import path
|
||||||
3. Verify CSS isn't hiding content (check dark mode classes)
|
3. Verify CSS isn't hiding content (check dark mode classes)
|
||||||
4. Test with minimal component first
|
4. Test with minimal component first
|
||||||
|
|
||||||
### Library Integration Issues
|
### Library Integration Issues
|
||||||
|
|
||||||
1. Check `dist/lib/page-agent.umd.js` builds correctly
|
1. Check `packages/page-agent/dist/lib/page-agent.umd.js` builds correctly
|
||||||
2. Test CDN injection with query params
|
2. Test CDN injection with query params
|
||||||
3. Verify event bus communications are properly typed
|
4. Use `packages/website/src/test-pages/` for isolated testing
|
||||||
4. Use `pages/test-pages/` for isolated testing
|
|
||||||
|
|||||||
+20
-27
@@ -7,11 +7,9 @@ Thank you for your interest in contributing to Page-Agent! We welcome contributi
|
|||||||
### Development Setup
|
### Development Setup
|
||||||
|
|
||||||
1. **Prerequisites**
|
1. **Prerequisites**
|
||||||
- Node.js 20+
|
- `node.js >= 20` with `npm >= 10`
|
||||||
- npm 10+
|
- An editor that supports `ts/eslint/prettier`
|
||||||
- typescript as required in package.json
|
- Make sure `eslint`, `prettier` and `commitlint` work well
|
||||||
- vscode or other editors that support ts/eslint/prettier
|
|
||||||
- make sure `eslint`, `auto-format` and `commit-lint` all work
|
|
||||||
|
|
||||||
2. **Setup**
|
2. **Setup**
|
||||||
|
|
||||||
@@ -22,10 +20,16 @@ Thank you for your interest in contributing to Page-Agent! We welcome contributi
|
|||||||
|
|
||||||
### Project Structure
|
### Project Structure
|
||||||
|
|
||||||
This project has **two separate parts**:
|
This is a **monorepo** with npm workspaces containing **two main packages**:
|
||||||
|
|
||||||
- **Core Library** (`src/`) - Pure JavaScript AI agent library
|
1. **Core Library** (`packages/page-agent/`) - Pure JavaScript/TypeScript AI agent library for browser DOM automation, published as `page-agent` on npm
|
||||||
- **Documentation Website** (`pages/`) - React web app for landing page and docs
|
2. **Website** (`packages/website/`) - React documentation and landing page. Also as demo and test page for the core lib. private package `@page-agent/website`
|
||||||
|
|
||||||
|
We use a simplified monorepo solution with `native npm-workspace + ts reference + vite alias`. No fancy tooling. Hoisting is required.
|
||||||
|
|
||||||
|
- When developing. Use alias so that we don't have to pre-build.
|
||||||
|
- When bundling. Use external and disable ts `paths` alias to leave deps out.
|
||||||
|
- When bundling `UMD` and `Website`. Bundle everything including local packages.
|
||||||
|
|
||||||
## 🤝 How to Contribute
|
## 🤝 How to Contribute
|
||||||
|
|
||||||
@@ -95,19 +99,6 @@ This project has **two separate parts**:
|
|||||||
- Github Copilot: `./.github/copilot-instructions.md`
|
- Github Copilot: `./.github/copilot-instructions.md`
|
||||||
- Claude Code: `./CLAUDE.md`
|
- Claude Code: `./CLAUDE.md`
|
||||||
|
|
||||||
### Core Library (`src/`)
|
|
||||||
|
|
||||||
- **No React dependencies** - Pure JavaScript/TypeScript only
|
|
||||||
- Use event bus for component communication
|
|
||||||
- Follow browser-use patterns for DOM operations
|
|
||||||
|
|
||||||
### Doc&demo Site (`pages/`)
|
|
||||||
|
|
||||||
- Use React 19 + TypeScript
|
|
||||||
- Follow hash routing patterns (`useHashLocation`)
|
|
||||||
- Use Tailwind CSS for styling
|
|
||||||
- Add new docs pages to both router and sidebar
|
|
||||||
|
|
||||||
## 🔧 Development Workflows
|
## 🔧 Development Workflows
|
||||||
|
|
||||||
### Website Development
|
### Website Development
|
||||||
@@ -118,24 +109,26 @@ npm start # React development server
|
|||||||
|
|
||||||
### Core Lib Development and Testing
|
### Core Lib Development and Testing
|
||||||
|
|
||||||
|
> @TODO this part is outdated. Update this.
|
||||||
|
|
||||||
- Config your LLM API
|
- Config your LLM API
|
||||||
- Start a local script
|
- Start and serve a local umd script
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
npm run build:lib:watch # Auto-rebuild on changes
|
npm run dev:umd # Serving UMD with auto rebuild at http://localhost:5173/page-agent.umd.cjs
|
||||||
```
|
```
|
||||||
|
|
||||||
- Add a new bookmark enable it on other website
|
- Add a new bookmark enable it on other website
|
||||||
|
|
||||||
```
|
```
|
||||||
javascript:(function(){var s=document.createElement('script');s.src=`http://localhost:5173/dist/lib/page-agent.umd.cjs?t=${Math.random()}`;s.onload=()=>console.log(%27PageAgent ready!%27);document.head.appendChild(s);})();
|
javascript:(function(){var s=document.createElement('script');s.src=`http://localhost:5173/page-agent.umd.cjs?t=${Math.random()}`;s.onload=()=>console.log(%27PageAgent ready!%27);document.head.appendChild(s);})();
|
||||||
```
|
```
|
||||||
|
|
||||||
### Adding Documentation
|
### Adding Documentation
|
||||||
|
|
||||||
1. Create `pages/docs/section/page-name/page.tsx`
|
1. Create `website/src/docs/section/page-name/page.tsx`
|
||||||
2. Add route to `pages/router.tsx`
|
2. Add route to `website/src/router.tsx`
|
||||||
3. Add navigation link to `pages/components/DocsLayout.tsx`
|
3. Add navigation link to `website/src/components/DocsLayout.tsx`
|
||||||
|
|
||||||
## 🎯 Contribution Areas
|
## 🎯 Contribution Areas
|
||||||
|
|
||||||
|
|||||||
+11
-13
@@ -4,13 +4,13 @@
|
|||||||
|
|
||||||
[](https://badge.fury.io/js/page-agent) [](https://opensource.org/licenses/MIT) [](http://www.typescriptlang.org/) [](https://www.npmjs.com/package/page-agent) [](https://bundlephobia.com/package/page-agent) [](https://github.com/alibaba/page-agent)
|
[](https://badge.fury.io/js/page-agent) [](https://opensource.org/licenses/MIT) [](http://www.typescriptlang.org/) [](https://www.npmjs.com/package/page-agent) [](https://bundlephobia.com/package/page-agent) [](https://github.com/alibaba/page-agent)
|
||||||
|
|
||||||
**让你的网页支持 AI 自动化。**
|
纯 JS 实现的 GUI agent。使用自然语言操作你的 Web 应用。无须后端、客户端、浏览器插件。
|
||||||
|
|
||||||
运行在页面内的 UI agent. 使用自然语言操作 Web 应用。
|
|
||||||
|
|
||||||
🌐 [English](./README.md) | **中文**
|
🌐 [English](./README.md) | **中文**
|
||||||
|
|
||||||
👉 [🚀 **Demo**](https://alibaba.github.io/page-agent/) | [📖 **Documentation**](https://alibaba.github.io/page-agent/#/docs/introduction/overview)
|
👉 <a href="https://alibaba.github.io/page-agent/" target="_blank"><b>🚀 Demo</b></a> | <a href="https://alibaba.github.io/page-agent/#/docs/introduction/overview" target="_blank"><b>📖 Documentation</b></a>
|
||||||
|
|
||||||
|
<video id="demo-video" src="https://github.com/user-attachments/assets/141bbb01-8022-4d1f-919d-9efc9a1dc1cf" width="640" crossorigin muted autoplay loop></video>
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -33,7 +33,7 @@
|
|||||||
```html
|
```html
|
||||||
<!-- 临时 CDN URL. 未来会变更 -->
|
<!-- 临时 CDN URL. 未来会变更 -->
|
||||||
<script
|
<script
|
||||||
src="https://hwcxiuzfylggtcktqgij.supabase.co/storage/v1/object/public/demo-public/v0.0.2/page-agent.js"
|
src="https://hwcxiuzfylggtcktqgij.supabase.co/storage/v1/object/public/demo-public/v0.0.4/page-agent.js"
|
||||||
crossorigin="true"
|
crossorigin="true"
|
||||||
type="text/javascript"
|
type="text/javascript"
|
||||||
></script>
|
></script>
|
||||||
@@ -67,16 +67,14 @@ await agent.execute('点击登录按钮')
|
|||||||
|
|
||||||
## 🏗️ 架构设计
|
## 🏗️ 架构设计
|
||||||
|
|
||||||
PageAgent 采用清晰的模块化架构:
|
PageAgent adopts a simplified monorepo structure:
|
||||||
|
|
||||||
```
|
```
|
||||||
src/
|
packages/
|
||||||
├── PageAgent.ts # Agent 主流程
|
├── page-agent/ # AI agent (npm: page-agent)
|
||||||
├── dom/ # DOM 理解
|
├── page-controller/ # DOM 操作 (npm: @page-agent/page-controller)
|
||||||
├── tools/ # 代理交互工具
|
├── ui/ # 面板 & 蒙层 & 模拟鼠标 (npm: @page-agent/ui)
|
||||||
├── ui/ # UI 组件和面板
|
└── website/ # 文档站点
|
||||||
├── llms/ # LLM 集成层
|
|
||||||
└── utils/ # 事件总线和工具
|
|
||||||
```
|
```
|
||||||
|
|
||||||
## 🤝 贡献
|
## 🤝 贡献
|
||||||
|
|||||||
@@ -1,22 +1,22 @@
|
|||||||
# PageAgent 🤖🪄
|
# PageAgent 🤖🪄
|
||||||
|
|
||||||

|

|
||||||
|
|
||||||
[](https://badge.fury.io/js/page-agent) [](https://opensource.org/licenses/MIT) [](http://www.typescriptlang.org/) [](https://www.npmjs.com/package/page-agent) [](https://bundlephobia.com/package/page-agent) [](https://github.com/alibaba/page-agent)
|
[](https://badge.fury.io/js/page-agent) [](https://opensource.org/licenses/MIT) [](http://www.typescriptlang.org/) [](https://www.npmjs.com/package/page-agent) [](https://bundlephobia.com/package/page-agent) [](https://github.com/alibaba/page-agent)
|
||||||
|
|
||||||
**Transform your webpage into an AI-powered application with a single script tag.**
|
The GUI Agent Living in Your Webpage. Control web interfaces with natural language.
|
||||||
|
|
||||||
An in-page UI agent in javascript. Control web interfaces with natural language.
|
|
||||||
|
|
||||||
🌐 **English** | [中文](./README-zh.md)
|
🌐 **English** | [中文](./README-zh.md)
|
||||||
|
|
||||||
👉 [🚀 **Demo**](https://alibaba.github.io/page-agent/) | [📖 **Documentation**](https://alibaba.github.io/page-agent/#/docs/introduction/overview)
|
👉 <a href="https://alibaba.github.io/page-agent/" target="_blank"><b>🚀 Demo</b></a> | <a href="https://alibaba.github.io/page-agent/#/docs/introduction/overview" target="_blank"><b>📖 Documentation</b></a>
|
||||||
|
|
||||||
|
<video id="demo-video" src="https://github.com/user-attachments/assets/de8d1964-8bde-494f-a52f-2975469557a5" width="640" crossorigin muted autoplay loop></video>
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## ✨ Features
|
## ✨ Features
|
||||||
|
|
||||||
- **🎯 Easy Integration**
|
- **🎯 Easy Integration** - Transform your webpage into an agent with a single script tag.
|
||||||
- **🔐 Client-Side Processing**
|
- **🔐 Client-Side Processing**
|
||||||
- **🧠 DOM Extraction**
|
- **🧠 DOM Extraction**
|
||||||
- **💬 Natural Language Interface**
|
- **💬 Natural Language Interface**
|
||||||
@@ -33,7 +33,7 @@ An in-page UI agent in javascript. Control web interfaces with natural language.
|
|||||||
```html
|
```html
|
||||||
<!-- temporary CDN URL. May change in the future -->
|
<!-- temporary CDN URL. May change in the future -->
|
||||||
<script
|
<script
|
||||||
src="https://hwcxiuzfylggtcktqgij.supabase.co/storage/v1/object/public/demo-public/v0.0.2/page-agent.js"
|
src="https://hwcxiuzfylggtcktqgij.supabase.co/storage/v1/object/public/demo-public/v0.0.4/page-agent.js"
|
||||||
crossorigin="true"
|
crossorigin="true"
|
||||||
type="text/javascript"
|
type="text/javascript"
|
||||||
></script>
|
></script>
|
||||||
@@ -67,16 +67,14 @@ await agent.execute('Click the login button')
|
|||||||
|
|
||||||
## 🏗️ Structure
|
## 🏗️ Structure
|
||||||
|
|
||||||
PageAgent follows a clean, modular architecture:
|
PageAgent adopts a simplified monorepo structure:
|
||||||
|
|
||||||
```
|
```
|
||||||
src/
|
packages/
|
||||||
├── PageAgent.ts # Agent main loop
|
├── page-agent/ # AI agent (npm: page-agent)
|
||||||
├── dom/ # DOM processing
|
├── page-controller/ # DOM operations (npm: @page-agent/page-controller)
|
||||||
├── tools/ # Agent tools
|
├── ui/ # Panel & Mask & Mouse Animation (npm: @page-agent/ui)
|
||||||
├── ui/ # UI components & panels
|
└── website/ # Demo & Documentation site
|
||||||
├── llms/ # LLM integration layer
|
|
||||||
└── utils/ # Event bus & utilities
|
|
||||||
```
|
```
|
||||||
|
|
||||||
## 🤝 Contributing
|
## 🤝 Contributing
|
||||||
|
|||||||
+14
-8
@@ -24,27 +24,33 @@ The development progress and future plans for PageAgent.
|
|||||||
- [ ] **Hooks and Events**
|
- [ ] **Hooks and Events**
|
||||||
- [x] **lifecycle hooks**
|
- [x] **lifecycle hooks**
|
||||||
- [ ] **lifecycle events**
|
- [ ] **lifecycle events**
|
||||||
- [ ] **❗Pause and intervene**
|
- [ ] **User takeover**
|
||||||
- Current pause does not allow user intervention.
|
- [#64](https://github.com/alibaba/page-agent/issues/64)
|
||||||
- [ ] **❗Hijack `page_open/page_change/page_unload` behavior**
|
- [ ] **❗Hijack `page_open/page_change/page_unload` behavior**
|
||||||
- [ ] **Custom knowledge base and instructions**
|
- [ ] **Custom knowledge base and instructions**
|
||||||
|
- [#45](https://github.com/alibaba/page-agent/issues/45)
|
||||||
- [ ] **Black/white-list safeguard**
|
- [ ] **Black/white-list safeguard**
|
||||||
- [ ] **Data-masking**
|
- [ ] **Data-masking**
|
||||||
|
- [#44](https://github.com/alibaba/page-agent/issues/44)
|
||||||
|
- [ ] **Improve Memory**
|
||||||
|
- [#66](https://github.com/alibaba/page-agent/issues/66)
|
||||||
|
- [#65](https://github.com/alibaba/page-agent/issues/65)
|
||||||
- [ ] **Optimize for popular UI frameworks**
|
- [ ] **Optimize for popular UI frameworks**
|
||||||
- [x] **i18n of the website**
|
- [x] **i18n of the website**
|
||||||
- [x] Chinese version
|
- [x] Chinese version
|
||||||
- [x] English version
|
- [x] English version
|
||||||
- [ ] **Testing suits**
|
- [x] **Refactor: Separate `Agent` and `PageController`**
|
||||||
- [ ] **Support custom llm fetch**
|
- [ ] **Chrome-ext wrapper for multi-page tasks**
|
||||||
- [ ] **Refactor: Separate `Agent` and `Page-Controller`**
|
|
||||||
- Agent should be able to run w/o dom.
|
|
||||||
- Actions should be able to be injected through iframe.
|
|
||||||
|
|
||||||
♻️ Following browser-use's update and contribute back.
|
♻️ Following browser-use's update and contribute back.
|
||||||
|
|
||||||
## 📋 Pending Features
|
## 📋 Pending Features
|
||||||
|
|
||||||
- [ ] **Chrome-ext wrapper**
|
- [ ] **Tools for more complex tasks**
|
||||||
|
- todo list
|
||||||
|
- file sys
|
||||||
|
- [ ] **Support custom llm fetch**
|
||||||
|
- [ ] **Testing suits**
|
||||||
- [ ] **Same-origin multi-page-app rally**
|
- [ ] **Same-origin multi-page-app rally**
|
||||||
- [ ] **Local MCP proxy**
|
- [ ] **Local MCP proxy**
|
||||||
|
|
||||||
|
|||||||
+8
-3
@@ -8,7 +8,7 @@ import globals from 'globals'
|
|||||||
import tseslint from 'typescript-eslint'
|
import tseslint from 'typescript-eslint'
|
||||||
|
|
||||||
export default defineConfig([
|
export default defineConfig([
|
||||||
globalIgnores(['dist', 'test-pages']),
|
globalIgnores(['**/dist', '**/test-pages', '**/node_modules']),
|
||||||
{
|
{
|
||||||
plugins: {
|
plugins: {
|
||||||
'react-hooks': reactHooks,
|
'react-hooks': reactHooks,
|
||||||
@@ -37,8 +37,10 @@ export default defineConfig([
|
|||||||
],
|
],
|
||||||
languageOptions: {
|
languageOptions: {
|
||||||
parserOptions: {
|
parserOptions: {
|
||||||
project: ['./tsconfig.json'],
|
// project: ['./tsconfig.json'],
|
||||||
tsconfigRootDir: import.meta.dirname,
|
// project: ['./packages/*/tsconfig.json'],
|
||||||
|
// tsconfigRootDir: import.meta.dirname,
|
||||||
|
projectService: true,
|
||||||
},
|
},
|
||||||
ecmaVersion: 2020,
|
ecmaVersion: 2020,
|
||||||
globals: globals.browser,
|
globals: globals.browser,
|
||||||
@@ -67,6 +69,9 @@ export default defineConfig([
|
|||||||
'react-dom/no-missing-button-type': 'off',
|
'react-dom/no-missing-button-type': 'off',
|
||||||
'react-x/no-nested-component-definitions': 'off',
|
'react-x/no-nested-component-definitions': 'off',
|
||||||
'@typescript-eslint/prefer-optional-chain': 'off',
|
'@typescript-eslint/prefer-optional-chain': 'off',
|
||||||
|
|
||||||
|
// 'require-await': 'off',
|
||||||
|
'@typescript-eslint/require-await': 'off',
|
||||||
},
|
},
|
||||||
},
|
},
|
||||||
])
|
])
|
||||||
|
|||||||
-45
@@ -1,45 +0,0 @@
|
|||||||
<!doctype html>
|
|
||||||
<html lang="zh-CN">
|
|
||||||
<head>
|
|
||||||
<meta charset="UTF-8" />
|
|
||||||
<link
|
|
||||||
rel="icon"
|
|
||||||
type="image/svg+xml"
|
|
||||||
href="https://img.alicdn.com/imgextra/i3/O1CN01uo9VaC20mamWNM2Zn_!!6000000006892-55-tps-64-64.svg"
|
|
||||||
/>
|
|
||||||
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
|
|
||||||
<title>PageAgent - AI-powered UI Agent in Your Webpage</title>
|
|
||||||
<meta
|
|
||||||
name="description"
|
|
||||||
content="PageAgent.js: One-line CDN import, add intelligent UI Agent to any website. Modern web AI automation with minimal integration."
|
|
||||||
/>
|
|
||||||
<meta
|
|
||||||
name="keywords"
|
|
||||||
content="PageAgent, AI Agent, Web Automation, UI Automation, Frontend, CDN, JavaScript, React, Vite, LLM"
|
|
||||||
/>
|
|
||||||
<meta name="theme-color" content="#58c0fc" />
|
|
||||||
<meta name="color-scheme" content="light dark" />
|
|
||||||
<meta name="author" content="PageAgent.js Team" />
|
|
||||||
<meta property="og:title" content="PageAgent.js - AI-powered UI Agent" />
|
|
||||||
<meta
|
|
||||||
property="og:description"
|
|
||||||
content="One-line CDN import, add intelligent UI Agent to any website."
|
|
||||||
/>
|
|
||||||
<meta property="og:type" content="website" />
|
|
||||||
<meta property="og:locale" content="en_US" />
|
|
||||||
<meta property="og:locale:alternate" content="zh_CN" />
|
|
||||||
</head>
|
|
||||||
<body>
|
|
||||||
<div id="root"></div>
|
|
||||||
<script type="module" src="./pages/main.tsx"></script>
|
|
||||||
<script>
|
|
||||||
// Dynamically update html lang attribute based on i18n detection
|
|
||||||
const updateHtmlLang = () => {
|
|
||||||
const lang = localStorage.getItem('i18nextLng') || navigator.language || 'zh-CN'
|
|
||||||
document.documentElement.lang = lang
|
|
||||||
}
|
|
||||||
updateHtmlLang()
|
|
||||||
window.addEventListener('storage', updateHtmlLang)
|
|
||||||
</script>
|
|
||||||
</body>
|
|
||||||
</html>
|
|
||||||
Generated
+1144
-994
File diff suppressed because it is too large
Load Diff
+32
-66
@@ -1,35 +1,15 @@
|
|||||||
{
|
{
|
||||||
"name": "page-agent",
|
"name": "root",
|
||||||
"private": false,
|
"private": true,
|
||||||
"version": "0.0.4",
|
"version": "0.0.11",
|
||||||
"type": "module",
|
"type": "module",
|
||||||
"main": "./dist/lib/page-agent.js",
|
"workspaces": [
|
||||||
"module": "./dist/lib/page-agent.js",
|
"packages/page-controller",
|
||||||
"types": "./dist/lib/PageAgent.d.ts",
|
"packages/ui",
|
||||||
"exports": {
|
"packages/page-agent",
|
||||||
".": {
|
"packages/website"
|
||||||
"types": "./dist/lib/PageAgent.d.ts",
|
|
||||||
"import": "./dist/lib/page-agent.js",
|
|
||||||
"default": "./dist/lib/page-agent.js"
|
|
||||||
}
|
|
||||||
},
|
|
||||||
"files": [
|
|
||||||
"dist/lib/",
|
|
||||||
"README.md",
|
|
||||||
"LICENSE",
|
|
||||||
"NOTICE"
|
|
||||||
],
|
|
||||||
"description": "AI-powered UI agent for web applications - add intelligent automation to any webpage with a single script tag",
|
|
||||||
"keywords": [
|
|
||||||
"ai",
|
|
||||||
"automation",
|
|
||||||
"ui-agent",
|
|
||||||
"browser-automation",
|
|
||||||
"web-agent",
|
|
||||||
"llm",
|
|
||||||
"dom-interaction",
|
|
||||||
"intelligent-ui"
|
|
||||||
],
|
],
|
||||||
|
"description": "AI-powered UI agent for web applications",
|
||||||
"author": "Simon<gaomeng1900>",
|
"author": "Simon<gaomeng1900>",
|
||||||
"license": "MIT",
|
"license": "MIT",
|
||||||
"repository": {
|
"repository": {
|
||||||
@@ -38,56 +18,42 @@
|
|||||||
},
|
},
|
||||||
"homepage": "https://alibaba.github.io/page-agent/",
|
"homepage": "https://alibaba.github.io/page-agent/",
|
||||||
"engines": {
|
"engines": {
|
||||||
"node": ">=20.0.0"
|
"node": ">=20.0.0",
|
||||||
|
"npm": ">=10.0.0"
|
||||||
},
|
},
|
||||||
"scripts": {
|
"scripts": {
|
||||||
"dev": "vite",
|
"start": "npm run dev --workspace=@page-agent/website",
|
||||||
"start": "vite",
|
"build:website": "npm run build:website --workspace=@page-agent/website",
|
||||||
"build": "tsc -b && vite build && npm run build:lib && npm run build:umd",
|
"build:libs": "npm run build --workspaces --if-present",
|
||||||
"build:lib": "MODE=lib vite build",
|
"build": "npm run build:libs && npm run build:website",
|
||||||
"build:lib:watch": "MODE=lib vite build --watch",
|
"dev:umd": "npm run dev:umd --workspace=page-agent",
|
||||||
"build:umd": "MODE=umd vite build",
|
"version": "node scripts/sync-version.js",
|
||||||
"lint": "eslint .",
|
"lint": "eslint .",
|
||||||
"prepare": "husky"
|
"prepare": "husky"
|
||||||
},
|
},
|
||||||
"dependencies": {
|
|
||||||
"ai-motion": "^0.4.7",
|
|
||||||
"chalk": "^5.6.2",
|
|
||||||
"zod": "^4.1.12"
|
|
||||||
},
|
|
||||||
"devDependencies": {
|
"devDependencies": {
|
||||||
"@commitlint/cli": "^20.1.0",
|
"@commitlint/cli": "^20.2.0",
|
||||||
"@commitlint/config-conventional": "^20.0.0",
|
"@commitlint/config-conventional": "^20.2.0",
|
||||||
"@eslint/js": "^9.37.0",
|
"@eslint/js": "^9.39.2",
|
||||||
"@microsoft/api-extractor": "^7.53.1",
|
"@microsoft/api-extractor": "^7.55.2",
|
||||||
"@tailwindcss/vite": "^4.1.14",
|
"@trivago/prettier-plugin-sort-imports": "^6.0.0",
|
||||||
"@trivago/prettier-plugin-sort-imports": "^5.2.2",
|
"concurrently": "^9.2.1",
|
||||||
"@types/react": "^19.2.2",
|
|
||||||
"@types/react-dom": "^19.2.1",
|
|
||||||
"@vitejs/plugin-react-swc": "^4.1.0",
|
|
||||||
"dotenv": "^17.2.3",
|
"dotenv": "^17.2.3",
|
||||||
"eslint": "^9.37.0",
|
"eslint": "^9.39.2",
|
||||||
"eslint-config-prettier": "^10.1.8",
|
"eslint-config-prettier": "^10.1.8",
|
||||||
"eslint-plugin-react-dom": "^2.0.6",
|
"eslint-plugin-react-dom": "^2.3.13",
|
||||||
"eslint-plugin-react-hooks": "^7.0.0",
|
"eslint-plugin-react-hooks": "^7.0.1",
|
||||||
"eslint-plugin-react-refresh": "^0.4.23",
|
"eslint-plugin-react-refresh": "^0.4.25",
|
||||||
"eslint-plugin-react-x": "^2.0.6",
|
"eslint-plugin-react-x": "^2.3.13",
|
||||||
"globals": "^16.4.0",
|
"globals": "^16.4.0",
|
||||||
"husky": "^9.1.7",
|
"husky": "^9.1.7",
|
||||||
"i18next": "^25.6.0",
|
|
||||||
"i18next-browser-languagedetector": "^8.2.0",
|
|
||||||
"lint-staged": "^16.2.4",
|
"lint-staged": "^16.2.4",
|
||||||
"prettier": "^3.6.2",
|
"prettier": "^3.7.4",
|
||||||
"react": "^19.2.0",
|
|
||||||
"react-dom": "^19.2.0",
|
|
||||||
"react-i18next": "^16.1.4",
|
|
||||||
"tailwindcss": "^4.1.14",
|
|
||||||
"typescript": "^5.9.3",
|
"typescript": "^5.9.3",
|
||||||
"typescript-eslint": "^8.46.0",
|
"typescript-eslint": "^8.50.0",
|
||||||
"unplugin-dts": "^1.0.0-beta.6",
|
"unplugin-dts": "^1.0.0-beta.6",
|
||||||
"vite": "^7.1.9",
|
"vite": "^7.3.0",
|
||||||
"vite-plugin-css-injected-by-js": "^3.5.2",
|
"vite-plugin-css-injected-by-js": "^3.5.2"
|
||||||
"wouter": "^3.7.1"
|
|
||||||
},
|
},
|
||||||
"lint-staged": {
|
"lint-staged": {
|
||||||
"*.{js,ts,cjs,cts,mjs,mts}": [
|
"*.{js,ts,cjs,cts,mjs,mts}": [
|
||||||
|
|||||||
@@ -0,0 +1,52 @@
|
|||||||
|
{
|
||||||
|
"name": "page-agent",
|
||||||
|
"private": false,
|
||||||
|
"version": "0.0.11",
|
||||||
|
"type": "module",
|
||||||
|
"main": "./dist/esm/page-agent.js",
|
||||||
|
"module": "./dist/esm/page-agent.js",
|
||||||
|
"types": "./dist/esm/PageAgent.d.ts",
|
||||||
|
"exports": {
|
||||||
|
".": {
|
||||||
|
"types": "./dist/esm/PageAgent.d.ts",
|
||||||
|
"import": "./dist/esm/page-agent.js",
|
||||||
|
"default": "./dist/esm/page-agent.js"
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"files": [
|
||||||
|
"dist/"
|
||||||
|
],
|
||||||
|
"description": "GUI agent for web applications - add intelligent automation to any webpage with a single script",
|
||||||
|
"keywords": [
|
||||||
|
"ai",
|
||||||
|
"automation",
|
||||||
|
"ui-agent",
|
||||||
|
"GUI-agent",
|
||||||
|
"browser-automation",
|
||||||
|
"web-agent",
|
||||||
|
"llm",
|
||||||
|
"dom-interaction",
|
||||||
|
"web-automation",
|
||||||
|
"GUI-simulation"
|
||||||
|
],
|
||||||
|
"author": "Simon<gaomeng1900>",
|
||||||
|
"license": "MIT",
|
||||||
|
"repository": {
|
||||||
|
"type": "git",
|
||||||
|
"url": "https://github.com/alibaba/page-agent.git"
|
||||||
|
},
|
||||||
|
"homepage": "https://alibaba.github.io/page-agent/",
|
||||||
|
"scripts": {
|
||||||
|
"build": "vite build && MODE=umd vite build",
|
||||||
|
"serve": "npx serve dist/umd -p 5173",
|
||||||
|
"dev:umd": "concurrently \"MODE=umd vite build --watch\" \"npm run serve\"",
|
||||||
|
"prepublishOnly": "node -e \"const fs=require('fs');['README.md','LICENSE'].forEach(f=>fs.copyFileSync('../../'+f,f))\"",
|
||||||
|
"postpublish": "node -e \"['README.md','LICENSE'].forEach(f=>{try{require('fs').unlinkSync(f)}catch{}})\""
|
||||||
|
},
|
||||||
|
"dependencies": {
|
||||||
|
"chalk": "^5.6.2",
|
||||||
|
"zod": "^4.2.0",
|
||||||
|
"@page-agent/page-controller": "0.0.11",
|
||||||
|
"@page-agent/ui": "0.0.11"
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -2,24 +2,18 @@
|
|||||||
* Copyright (C) 2025 Alibaba Group Holding Limited
|
* Copyright (C) 2025 Alibaba Group Holding Limited
|
||||||
* All rights reserved.
|
* All rights reserved.
|
||||||
*/
|
*/
|
||||||
|
import { PageController } from '@page-agent/page-controller'
|
||||||
|
import { Panel, SimulatorMask } from '@page-agent/ui'
|
||||||
import chalk from 'chalk'
|
import chalk from 'chalk'
|
||||||
import zod from 'zod'
|
import zod from 'zod'
|
||||||
|
|
||||||
import type { PageAgentConfig } from './config'
|
import type { PageAgentConfig } from './config'
|
||||||
import { MAX_STEPS, VIEWPORT_EXPANSION } from './config/constants'
|
import { MAX_STEPS } from './config/constants'
|
||||||
import * as dom from './dom'
|
|
||||||
import { FlatDomTree, InteractiveElementDomNode } from './dom/dom_tree/type'
|
|
||||||
import { getPageInfo } from './dom/getPageInfo'
|
|
||||||
import { I18n } from './i18n'
|
|
||||||
import { LLM, type Tool } from './llms'
|
import { LLM, type Tool } from './llms'
|
||||||
import { patchReact } from './patches/react'
|
|
||||||
import SYSTEM_PROMPT from './prompts/system_prompt.md?raw'
|
import SYSTEM_PROMPT from './prompts/system_prompt.md?raw'
|
||||||
import { tools } from './tools'
|
import { tools } from './tools'
|
||||||
import { Panel, getToolCompletedText, getToolExecutingText } from './ui/Panel'
|
|
||||||
import { SimulatorMask } from './ui/SimulatorMask'
|
|
||||||
import { trimLines, uid, waitUntil } from './utils'
|
import { trimLines, uid, waitUntil } from './utils'
|
||||||
import { assert } from './utils/assert'
|
import { assert } from './utils/assert'
|
||||||
import { getEventBus } from './utils/bus'
|
|
||||||
|
|
||||||
export type { PageAgentConfig }
|
export type { PageAgentConfig }
|
||||||
export { tool, type PageAgentTool } from './tools'
|
export { tool, type PageAgentTool } from './tools'
|
||||||
@@ -74,8 +68,6 @@ export interface ExecutionResult {
|
|||||||
export class PageAgent extends EventTarget {
|
export class PageAgent extends EventTarget {
|
||||||
config: PageAgentConfig
|
config: PageAgentConfig
|
||||||
id = uid()
|
id = uid()
|
||||||
bus = getEventBus(this.id)
|
|
||||||
i18n: I18n
|
|
||||||
panel: Panel
|
panel: Panel
|
||||||
tools: typeof tools
|
tools: typeof tools
|
||||||
paused = false
|
paused = false
|
||||||
@@ -86,20 +78,12 @@ export class PageAgent extends EventTarget {
|
|||||||
#llm: LLM
|
#llm: LLM
|
||||||
#totalWaitTime = 0
|
#totalWaitTime = 0
|
||||||
#abortController = new AbortController()
|
#abortController = new AbortController()
|
||||||
|
#llmRetryListener: ((e: Event) => void) | null = null
|
||||||
|
#llmErrorListener: ((e: Event) => void) | null = null
|
||||||
|
#beforeUnloadListener: ((e: Event) => void) | null = null
|
||||||
|
|
||||||
/** Corresponds to eval_page in browser-use */
|
/** PageController for DOM operations */
|
||||||
flatTree: FlatDomTree | null = null
|
pageController: PageController
|
||||||
/**
|
|
||||||
* All highlighted index-mapped interactive elements
|
|
||||||
* Corresponds to DOMState.selector_map in browser-use
|
|
||||||
*/
|
|
||||||
selectorMap = new Map<number, InteractiveElementDomNode>()
|
|
||||||
/** highlight index -> element text */
|
|
||||||
elementTextMap = new Map<number, string>()
|
|
||||||
/** Corresponds to clickable_elements_to_string in browser-use */
|
|
||||||
simplifiedHTML = '<EMPTY>'
|
|
||||||
/** last time the tree was updated */
|
|
||||||
lastTimeUpdate = 0
|
|
||||||
|
|
||||||
/** Fullscreen mask */
|
/** Fullscreen mask */
|
||||||
mask = new SimulatorMask()
|
mask = new SimulatorMask()
|
||||||
@@ -110,11 +94,34 @@ export class PageAgent extends EventTarget {
|
|||||||
super()
|
super()
|
||||||
|
|
||||||
this.config = config
|
this.config = config
|
||||||
this.#llm = new LLM(this.config, this.id)
|
this.#llm = new LLM(this.config)
|
||||||
this.i18n = new I18n(this.config.language)
|
this.panel = new Panel({
|
||||||
this.panel = new Panel(this)
|
language: this.config.language,
|
||||||
|
onExecuteTask: (task) => this.execute(task),
|
||||||
|
onStop: () => this.dispose(),
|
||||||
|
onPauseToggle: () => {
|
||||||
|
this.paused = !this.paused
|
||||||
|
return this.paused
|
||||||
|
},
|
||||||
|
getPaused: () => this.paused,
|
||||||
|
})
|
||||||
this.tools = new Map(tools)
|
this.tools = new Map(tools)
|
||||||
|
|
||||||
|
// Initialize PageController with config
|
||||||
|
this.pageController = new PageController(this.config)
|
||||||
|
|
||||||
|
// Listen to LLM events
|
||||||
|
this.#llmRetryListener = (e) => {
|
||||||
|
const { current, max } = (e as CustomEvent).detail
|
||||||
|
this.panel.update({ type: 'retry', current, max })
|
||||||
|
}
|
||||||
|
this.#llmErrorListener = (e) => {
|
||||||
|
const { error } = (e as CustomEvent).detail
|
||||||
|
this.panel.update({ type: 'error', message: `step failed: ${error.message}` })
|
||||||
|
}
|
||||||
|
this.#llm.addEventListener('retry', this.#llmRetryListener)
|
||||||
|
this.#llm.addEventListener('error', this.#llmErrorListener)
|
||||||
|
|
||||||
if (this.config.customTools) {
|
if (this.config.customTools) {
|
||||||
for (const [name, tool] of Object.entries(this.config.customTools)) {
|
for (const [name, tool] of Object.entries(this.config.customTools)) {
|
||||||
if (tool === null) {
|
if (tool === null) {
|
||||||
@@ -125,11 +132,14 @@ export class PageAgent extends EventTarget {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
patchReact(this)
|
if (!this.config.experimentalScriptExecutionTool) {
|
||||||
|
this.tools.delete('execute_javascript')
|
||||||
|
}
|
||||||
|
|
||||||
window.addEventListener('beforeunload', (e) => {
|
this.#beforeUnloadListener = (e) => {
|
||||||
if (!this.disposed) this.dispose('PAGE_UNLOADING')
|
if (!this.disposed) this.dispose('PAGE_UNLOADING')
|
||||||
})
|
}
|
||||||
|
window.addEventListener('beforeunload', this.#beforeUnloadListener)
|
||||||
}
|
}
|
||||||
|
|
||||||
/**
|
/**
|
||||||
@@ -150,13 +160,10 @@ export class PageAgent extends EventTarget {
|
|||||||
// Show mask and panel
|
// Show mask and panel
|
||||||
this.mask.show()
|
this.mask.show()
|
||||||
|
|
||||||
this.bus.emit('panel:show')
|
this.panel.show()
|
||||||
this.bus.emit('panel:reset')
|
this.panel.reset()
|
||||||
|
|
||||||
this.bus.emit('panel:update', {
|
this.panel.update({ type: 'input', task: this.task })
|
||||||
type: 'input',
|
|
||||||
displayText: this.task,
|
|
||||||
})
|
|
||||||
|
|
||||||
if (this.#abortController) {
|
if (this.#abortController) {
|
||||||
this.#abortController.abort()
|
this.#abortController.abort()
|
||||||
@@ -171,7 +178,7 @@ export class PageAgent extends EventTarget {
|
|||||||
while (true) {
|
while (true) {
|
||||||
await onBeforeStep.call(this, step)
|
await onBeforeStep.call(this, step)
|
||||||
|
|
||||||
console.group(`step: ${step + 1}`)
|
console.group(`step: ${step}`)
|
||||||
|
|
||||||
// abort
|
// abort
|
||||||
if (this.#abortController.signal.aborted) throw new Error('AbortError')
|
if (this.#abortController.signal.aborted) throw new Error('AbortError')
|
||||||
@@ -180,10 +187,7 @@ export class PageAgent extends EventTarget {
|
|||||||
|
|
||||||
// Update status to thinking
|
// Update status to thinking
|
||||||
console.log(chalk.blue('Thinking...'))
|
console.log(chalk.blue('Thinking...'))
|
||||||
this.bus.emit('panel:update', {
|
this.panel.update({ type: 'thinking' })
|
||||||
type: 'thinking',
|
|
||||||
displayText: this.i18n.t('ui.panel.thinking'),
|
|
||||||
})
|
|
||||||
|
|
||||||
const result = await this.#llm.invoke(
|
const result = await this.#llm.invoke(
|
||||||
[
|
[
|
||||||
@@ -193,7 +197,7 @@ export class PageAgent extends EventTarget {
|
|||||||
},
|
},
|
||||||
{
|
{
|
||||||
role: 'user',
|
role: 'user',
|
||||||
content: this.#assembleUserPrompt(),
|
content: await this.#assembleUserPrompt(),
|
||||||
},
|
},
|
||||||
],
|
],
|
||||||
{ AgentOutput: this.#packMacroTool() },
|
{ AgentOutput: this.#packMacroTool() },
|
||||||
@@ -313,22 +317,14 @@ export class PageAgent extends EventTarget {
|
|||||||
`)
|
`)
|
||||||
|
|
||||||
console.log(brain)
|
console.log(brain)
|
||||||
this.bus.emit('panel:update', {
|
this.panel.update({ type: 'thinking', text: brain })
|
||||||
type: 'thinking',
|
|
||||||
displayText: brain,
|
|
||||||
})
|
|
||||||
|
|
||||||
// Find the corresponding tool
|
// Find the corresponding tool
|
||||||
const tool = tools.get(toolName)
|
const tool = tools.get(toolName)
|
||||||
assert(tool, `Tool ${toolName} not found. (@note should have been caught before this!!!)`)
|
assert(tool, `Tool ${toolName} not found. (@note should have been caught before this!!!)`)
|
||||||
|
|
||||||
console.log(chalk.blue.bold(`Executing tool: ${toolName}`), toolInput)
|
console.log(chalk.blue.bold(`Executing tool: ${toolName}`), toolInput)
|
||||||
this.bus.emit('panel:update', {
|
this.panel.update({ type: 'toolExecuting', toolName, args: toolInput })
|
||||||
type: 'tool_executing',
|
|
||||||
toolName,
|
|
||||||
toolArgs: toolInput,
|
|
||||||
displayText: getToolExecutingText(toolName, toolInput, this.i18n),
|
|
||||||
})
|
|
||||||
|
|
||||||
const startTime = Date.now()
|
const startTime = Date.now()
|
||||||
|
|
||||||
@@ -350,16 +346,13 @@ export class PageAgent extends EventTarget {
|
|||||||
}
|
}
|
||||||
|
|
||||||
// Briefly display execution result
|
// Briefly display execution result
|
||||||
const displayResult = getToolCompletedText(toolName, toolInput, this.i18n)
|
this.panel.update({
|
||||||
if (displayResult)
|
type: 'toolCompleted',
|
||||||
this.bus.emit('panel:update', {
|
toolName,
|
||||||
type: 'tool_executing',
|
args: toolInput,
|
||||||
toolName,
|
result,
|
||||||
toolArgs: toolInput,
|
duration,
|
||||||
toolResult: result,
|
})
|
||||||
displayText: displayResult,
|
|
||||||
duration,
|
|
||||||
})
|
|
||||||
|
|
||||||
// Wait a moment to let user see the result
|
// Wait a moment to let user see the result
|
||||||
await new Promise((resolve) => setTimeout(resolve, 100))
|
await new Promise((resolve) => setTimeout(resolve, 100))
|
||||||
@@ -388,7 +381,7 @@ export class PageAgent extends EventTarget {
|
|||||||
return systemPrompt
|
return systemPrompt
|
||||||
}
|
}
|
||||||
|
|
||||||
#assembleUserPrompt(): string {
|
async #assembleUserPrompt(): Promise<string> {
|
||||||
let prompt = ''
|
let prompt = ''
|
||||||
|
|
||||||
// <agent_history>
|
// <agent_history>
|
||||||
@@ -426,62 +419,65 @@ export class PageAgent extends EventTarget {
|
|||||||
|
|
||||||
// <browser_state>
|
// <browser_state>
|
||||||
|
|
||||||
prompt += this.#getBrowserState()
|
prompt += await this.#getBrowserState()
|
||||||
|
|
||||||
return trimLines(prompt)
|
return trimLines(prompt)
|
||||||
}
|
}
|
||||||
|
|
||||||
#onDone(text: string, success = true) {
|
#onDone(text: string, success = true) {
|
||||||
dom.cleanUpHighlights()
|
this.pageController.cleanUpHighlights()
|
||||||
|
|
||||||
// Update panel status
|
// Update panel status
|
||||||
this.bus.emit('panel:update', {
|
if (success) {
|
||||||
type: success ? 'output' : 'error',
|
this.panel.update({ type: 'output', text })
|
||||||
displayText: text,
|
} else {
|
||||||
})
|
this.panel.update({ type: 'error', message: text })
|
||||||
|
}
|
||||||
|
|
||||||
// Task completed
|
// Task completed
|
||||||
this.bus.emit('panel:update', {
|
this.panel.update({ type: 'completed' })
|
||||||
type: 'completed',
|
|
||||||
displayText: this.i18n.t('ui.panel.taskCompleted'),
|
|
||||||
})
|
|
||||||
|
|
||||||
this.mask.hide()
|
this.mask.hide()
|
||||||
|
|
||||||
this.#abortController.abort()
|
this.#abortController.abort()
|
||||||
}
|
}
|
||||||
|
|
||||||
#getBrowserState(): string {
|
async #getBrowserState(): Promise<string> {
|
||||||
const pageUrl = window.location.href
|
const pageUrl = await this.pageController.getCurrentUrl()
|
||||||
const pageTitle = document.title
|
const pageTitle = await this.pageController.getPageTitle()
|
||||||
const pi = getPageInfo()
|
const pi = await this.pageController.getPageInfo()
|
||||||
|
const viewportExpansion = await this.pageController.getViewportExpansion()
|
||||||
|
|
||||||
this.#updateTree()
|
this.mask.wrapper.style.pointerEvents = 'none'
|
||||||
|
await this.pageController.updateTree()
|
||||||
|
this.mask.wrapper.style.pointerEvents = 'auto'
|
||||||
|
|
||||||
|
const simplifiedHTML = await this.pageController.getSimplifiedHTML()
|
||||||
|
|
||||||
let prompt = trimLines(`<browser_state>
|
let prompt = trimLines(`<browser_state>
|
||||||
Current Page: [${pageTitle}](${pageUrl})
|
Current Page: [${pageTitle}](${pageUrl})
|
||||||
|
|
||||||
Page info: ${pi.viewport_width}x${pi.viewport_height}px viewport, ${pi.page_width}x${pi.page_height}px total page size, ${pi.pages_above.toFixed(1)} pages above, ${pi.pages_below.toFixed(1)} pages below, ${pi.total_pages.toFixed(1)} total pages, at ${(pi.current_page_position * 100).toFixed(0)}% of page
|
Page info: ${pi.viewport_width}x${pi.viewport_height}px viewport, ${pi.page_width}x${pi.page_height}px total page size, ${pi.pages_above.toFixed(1)} pages above, ${pi.pages_below.toFixed(1)} pages below, ${pi.total_pages.toFixed(1)} total pages, at ${(pi.current_page_position * 100).toFixed(0)}% of page
|
||||||
|
|
||||||
${VIEWPORT_EXPANSION === -1 ? 'Interactive elements from top layer of the current page (full page):' : 'Interactive elements from top layer of the current page inside the viewport:'}
|
${viewportExpansion === -1 ? 'Interactive elements from top layer of the current page (full page):' : 'Interactive elements from top layer of the current page inside the viewport:'}
|
||||||
|
|
||||||
`)
|
`)
|
||||||
|
|
||||||
// Page header info
|
// Page header info
|
||||||
const has_content_above = pi.pixels_above > 4
|
const has_content_above = pi.pixels_above > 4
|
||||||
if (has_content_above && VIEWPORT_EXPANSION !== -1) {
|
if (has_content_above && viewportExpansion !== -1) {
|
||||||
prompt += `... ${pi.pixels_above} pixels above (${pi.pages_above.toFixed(1)} pages) - scroll to see more ...\n`
|
prompt += `... ${pi.pixels_above} pixels above (${pi.pages_above.toFixed(1)} pages) - scroll to see more ...\n`
|
||||||
} else {
|
} else {
|
||||||
prompt += `[Start of page]\n`
|
prompt += `[Start of page]\n`
|
||||||
}
|
}
|
||||||
|
|
||||||
// Current viewport info
|
// Current viewport info
|
||||||
prompt += this.simplifiedHTML
|
prompt += simplifiedHTML
|
||||||
prompt += `\n`
|
prompt += `\n`
|
||||||
|
|
||||||
// Page footer info
|
// Page footer info
|
||||||
const has_content_below = pi.pixels_below > 4
|
const has_content_below = pi.pixels_below > 4
|
||||||
if (has_content_below && VIEWPORT_EXPANSION !== -1) {
|
if (has_content_below && viewportExpansion !== -1) {
|
||||||
prompt += `... ${pi.pixels_below} pixels below (${pi.pages_below.toFixed(1)} pages) - scroll to see more ...\n`
|
prompt += `... ${pi.pixels_below} pixels below (${pi.pages_below.toFixed(1)} pages) - scroll to see more ...\n`
|
||||||
} else {
|
} else {
|
||||||
prompt += `[End of page]\n`
|
prompt += `[End of page]\n`
|
||||||
@@ -492,42 +488,31 @@ export class PageAgent extends EventTarget {
|
|||||||
return prompt
|
return prompt
|
||||||
}
|
}
|
||||||
|
|
||||||
/**
|
|
||||||
* Update document tree
|
|
||||||
*/
|
|
||||||
#updateTree() {
|
|
||||||
this.dispatchEvent(new Event('beforeUpdate'))
|
|
||||||
this.lastTimeUpdate = Date.now()
|
|
||||||
dom.cleanUpHighlights()
|
|
||||||
this.mask.wrapper.style.pointerEvents = 'none'
|
|
||||||
this.flatTree = dom.getFlatTree({
|
|
||||||
...this.config,
|
|
||||||
interactiveBlacklist: [
|
|
||||||
...(this.config.interactiveBlacklist || []),
|
|
||||||
...document.querySelectorAll('[data-page-agent-not-interactive]').values(),
|
|
||||||
],
|
|
||||||
})
|
|
||||||
this.mask.wrapper.style.pointerEvents = 'auto'
|
|
||||||
this.simplifiedHTML = dom.flatTreeToString(this.flatTree, this.config.include_attributes)
|
|
||||||
this.selectorMap.clear()
|
|
||||||
this.selectorMap = dom.getSelectorMap(this.flatTree)
|
|
||||||
this.elementTextMap.clear()
|
|
||||||
this.elementTextMap = dom.getElementTextMap(this.simplifiedHTML)
|
|
||||||
this.dispatchEvent(new Event('afterUpdate'))
|
|
||||||
}
|
|
||||||
|
|
||||||
dispose(reason?: string) {
|
dispose(reason?: string) {
|
||||||
console.log('Disposing PageAgent...')
|
console.log('Disposing PageAgent...')
|
||||||
this.disposed = true
|
this.disposed = true
|
||||||
dom.cleanUpHighlights()
|
this.pageController.dispose()
|
||||||
this.flatTree = null
|
|
||||||
this.selectorMap.clear()
|
|
||||||
this.elementTextMap.clear()
|
|
||||||
this.panel.dispose()
|
this.panel.dispose()
|
||||||
this.mask.dispose()
|
this.mask.dispose()
|
||||||
this.history = []
|
this.history = []
|
||||||
this.#abortController.abort(reason ?? 'PageAgent disposed')
|
this.#abortController.abort(reason ?? 'PageAgent disposed')
|
||||||
|
|
||||||
|
// Clean up LLM event listeners
|
||||||
|
if (this.#llmRetryListener) {
|
||||||
|
this.#llm.removeEventListener('retry', this.#llmRetryListener)
|
||||||
|
this.#llmRetryListener = null
|
||||||
|
}
|
||||||
|
if (this.#llmErrorListener) {
|
||||||
|
this.#llm.removeEventListener('error', this.#llmErrorListener)
|
||||||
|
this.#llmErrorListener = null
|
||||||
|
}
|
||||||
|
|
||||||
|
// Clean up window event listeners
|
||||||
|
if (this.#beforeUnloadListener) {
|
||||||
|
window.removeEventListener('beforeunload', this.#beforeUnloadListener)
|
||||||
|
this.#beforeUnloadListener = null
|
||||||
|
}
|
||||||
|
|
||||||
this.config.onDispose?.call(this, reason)
|
this.config.onDispose?.call(this, reason)
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
@@ -1,10 +1,3 @@
|
|||||||
/**
|
|
||||||
* @note Since isTopElement depends on elementFromPoint,
|
|
||||||
* it returns null when out of viewport, this feature has no practical use, only differ between -1 and 0
|
|
||||||
*/
|
|
||||||
// export const VIEWPORT_EXPANSION = 100
|
|
||||||
export const VIEWPORT_EXPANSION = -1
|
|
||||||
|
|
||||||
// Dev environment: use .env config if available, otherwise fallback to testing api
|
// Dev environment: use .env config if available, otherwise fallback to testing api
|
||||||
export const DEFAULT_MODEL_NAME: string =
|
export const DEFAULT_MODEL_NAME: string =
|
||||||
import.meta.env.DEV && import.meta.env.LLM_MODEL_NAME
|
import.meta.env.DEV && import.meta.env.LLM_MODEL_NAME
|
||||||
@@ -1,8 +1,8 @@
|
|||||||
import type { AgentHistory, ExecutionResult, PageAgent } from '@/PageAgent'
|
import type { PageControllerConfig } from '@page-agent/page-controller'
|
||||||
import type { DomConfig } from '@/dom'
|
import type { SupportedLanguage } from '@page-agent/ui'
|
||||||
import type { SupportedLanguage } from '@/i18n'
|
|
||||||
import type { PageAgentTool } from '@/tools'
|
|
||||||
|
|
||||||
|
import type { AgentHistory, ExecutionResult, PageAgent } from '../PageAgent'
|
||||||
|
import type { PageAgentTool } from '../tools'
|
||||||
import {
|
import {
|
||||||
DEFAULT_API_KEY,
|
DEFAULT_API_KEY,
|
||||||
DEFAULT_BASE_URL,
|
DEFAULT_BASE_URL,
|
||||||
@@ -72,6 +72,14 @@ export interface AgentConfig {
|
|||||||
|
|
||||||
// page behavior hooks
|
// page behavior hooks
|
||||||
|
|
||||||
|
/**
|
||||||
|
* @experimental
|
||||||
|
* Enable the experimental script execution tool that allows executing generated JavaScript code on the page.
|
||||||
|
* @note Can cause unpredictable side effects.
|
||||||
|
* @note May bypass some safe guards and data-masking mechanisms.
|
||||||
|
*/
|
||||||
|
experimentalScriptExecutionTool?: boolean
|
||||||
|
|
||||||
/**
|
/**
|
||||||
* TODO: @unimplemented
|
* TODO: @unimplemented
|
||||||
* hook when action causes a new page to be opened
|
* hook when action causes a new page to be opened
|
||||||
@@ -87,7 +95,7 @@ export interface AgentConfig {
|
|||||||
experimentalPreventNewPage?: boolean
|
experimentalPreventNewPage?: boolean
|
||||||
}
|
}
|
||||||
|
|
||||||
export type PageAgentConfig = LLMConfig & AgentConfig & DomConfig
|
export type PageAgentConfig = LLMConfig & AgentConfig & PageControllerConfig
|
||||||
|
|
||||||
export function parseLLMConfig(config: LLMConfig): Required<LLMConfig> {
|
export function parseLLMConfig(config: LLMConfig): Required<LLMConfig> {
|
||||||
return {
|
return {
|
||||||
+1
-6
@@ -1,5 +1,5 @@
|
|||||||
/// <reference types="vite/client" />
|
/// <reference types="vite/client" />
|
||||||
import type { PageAgent } from './src/PageAgent'
|
import type { PageAgent } from './PageAgent'
|
||||||
|
|
||||||
declare module '*.module.css' {
|
declare module '*.module.css' {
|
||||||
const classes: Record<string, string>
|
const classes: Record<string, string>
|
||||||
@@ -11,15 +11,10 @@ declare module '*.md?raw' {
|
|||||||
export default content
|
export default content
|
||||||
}
|
}
|
||||||
|
|
||||||
/**
|
|
||||||
* for local dev and umd demo
|
|
||||||
*/
|
|
||||||
|
|
||||||
declare global {
|
declare global {
|
||||||
interface Window {
|
interface Window {
|
||||||
pageAgent?: PageAgent
|
pageAgent?: PageAgent
|
||||||
PageAgent: typeof PageAgent
|
PageAgent: typeof PageAgent
|
||||||
|
|
||||||
__PAGE_AGENT_IDS__: string[]
|
__PAGE_AGENT_IDS__: string[]
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
+1
-2
@@ -1,8 +1,7 @@
|
|||||||
/**
|
/**
|
||||||
* OpenAI Client implementation
|
* OpenAI Client implementation
|
||||||
*/
|
*/
|
||||||
import type { MacroToolInput } from '@/PageAgent'
|
import type { MacroToolInput } from '../PageAgent'
|
||||||
|
|
||||||
import { InvokeError, InvokeErrorType } from './errors'
|
import { InvokeError, InvokeErrorType } from './errors'
|
||||||
import type { InvokeResult, LLMClient, Message, OpenAIClientConfig, Tool } from './types'
|
import type { InvokeResult, LLMClient, Message, OpenAIClientConfig, Tool } from './types'
|
||||||
import { lenientParseMacroToolCall, modelPatch, zodToOpenAITool } from './utils'
|
import { lenientParseMacroToolCall, modelPatch, zodToOpenAITool } from './utils'
|
||||||
@@ -31,27 +31,21 @@
|
|||||||
* - 永远使用 tool call 来返回结构化数据,禁止模型直接返回(视为出错)
|
* - 永远使用 tool call 来返回结构化数据,禁止模型直接返回(视为出错)
|
||||||
* - 不能假设 tool 参数合法,必须有修复机制,而且修复也应该使用 tool call 返回
|
* - 不能假设 tool 参数合法,必须有修复机制,而且修复也应该使用 tool call 返回
|
||||||
*/
|
*/
|
||||||
import type { LLMConfig } from '@/config'
|
import type { LLMConfig } from '../config'
|
||||||
import { parseLLMConfig } from '@/config'
|
import { parseLLMConfig } from '../config'
|
||||||
import { EventBus, getEventBus } from '@/utils/bus'
|
|
||||||
|
|
||||||
import { OpenAIClient } from './OpenAILenientClient'
|
import { OpenAIClient } from './OpenAILenientClient'
|
||||||
import { InvokeError } from './errors'
|
import { InvokeError } from './errors'
|
||||||
import type { InvokeResult, LLMClient, Message, Tool } from './types'
|
import type { InvokeResult, LLMClient, Message, Tool } from './types'
|
||||||
|
|
||||||
export type { Message, Tool, InvokeResult, LLMClient }
|
export type { Message, Tool, InvokeResult, LLMClient }
|
||||||
|
|
||||||
export class LLM {
|
export class LLM extends EventTarget {
|
||||||
config: Required<LLMConfig>
|
config: Required<LLMConfig>
|
||||||
id: string
|
|
||||||
client: LLMClient
|
client: LLMClient
|
||||||
#bus: EventBus
|
|
||||||
|
|
||||||
constructor(config: LLMConfig, id: string) {
|
constructor(config: LLMConfig) {
|
||||||
|
super()
|
||||||
this.config = parseLLMConfig(config)
|
this.config = parseLLMConfig(config)
|
||||||
this.id = id
|
|
||||||
|
|
||||||
this.#bus = getEventBus(id)
|
|
||||||
|
|
||||||
// Default to OpenAI client
|
// Default to OpenAI client
|
||||||
this.client = new OpenAIClient({
|
this.client = new OpenAIClient({
|
||||||
@@ -82,17 +76,13 @@ export class LLM {
|
|||||||
// retry settings
|
// retry settings
|
||||||
{
|
{
|
||||||
maxRetries: this.config.maxRetries,
|
maxRetries: this.config.maxRetries,
|
||||||
onRetry: (retries: number) => {
|
onRetry: (current: number) => {
|
||||||
this.#bus.emit('panel:update', {
|
this.dispatchEvent(
|
||||||
type: 'retry',
|
new CustomEvent('retry', { detail: { current, max: this.config.maxRetries } })
|
||||||
displayText: `retry-ing (${retries} / ${this.config.maxRetries})`,
|
)
|
||||||
})
|
|
||||||
},
|
},
|
||||||
onError: (error: Error, withRetry: boolean) => {
|
onError: (error: Error) => {
|
||||||
this.#bus.emit('panel:update', {
|
this.dispatchEvent(new CustomEvent('error', { detail: { error } }))
|
||||||
type: 'error',
|
|
||||||
displayText: `step failed: ${(error as Error).message}`,
|
|
||||||
})
|
|
||||||
},
|
},
|
||||||
}
|
}
|
||||||
)
|
)
|
||||||
@@ -104,7 +94,7 @@ async function withRetry<T>(
|
|||||||
settings: {
|
settings: {
|
||||||
maxRetries: number
|
maxRetries: number
|
||||||
onRetry: (retries: number) => void
|
onRetry: (retries: number) => void
|
||||||
onError: (error: Error, withRetry: boolean) => void
|
onError: (error: Error) => void
|
||||||
}
|
}
|
||||||
): Promise<T> {
|
): Promise<T> {
|
||||||
let retries = 0
|
let retries = 0
|
||||||
@@ -119,7 +109,7 @@ async function withRetry<T>(
|
|||||||
return await fn()
|
return await fn()
|
||||||
} catch (error: unknown) {
|
} catch (error: unknown) {
|
||||||
console.error(error)
|
console.error(error)
|
||||||
settings.onError(error as Error, retries < settings.maxRetries)
|
settings.onError(error as Error)
|
||||||
|
|
||||||
// do not retry if aborted by user
|
// do not retry if aborted by user
|
||||||
if ((error as { name?: string })?.name === 'AbortError') throw error
|
if ((error as { name?: string })?.name === 'AbortError') throw error
|
||||||
@@ -4,8 +4,7 @@
|
|||||||
import chalk from 'chalk'
|
import chalk from 'chalk'
|
||||||
import { z } from 'zod'
|
import { z } from 'zod'
|
||||||
|
|
||||||
import type { MacroToolInput } from '@/PageAgent'
|
import type { MacroToolInput } from '../PageAgent'
|
||||||
|
|
||||||
import { InvokeError, InvokeErrorType } from './errors'
|
import { InvokeError, InvokeErrorType } from './errors'
|
||||||
import type { Tool } from './types'
|
import type { Tool } from './types'
|
||||||
|
|
||||||
@@ -42,6 +41,7 @@ export function lenientParseMacroToolCall(
|
|||||||
// check
|
// check
|
||||||
switch (choice.finish_reason) {
|
switch (choice.finish_reason) {
|
||||||
case 'tool_calls':
|
case 'tool_calls':
|
||||||
|
case 'function_call': // gemini
|
||||||
case 'stop': // will try a robust parse
|
case 'stop': // will try a robust parse
|
||||||
// ✅ Normal
|
// ✅ Normal
|
||||||
break
|
break
|
||||||
@@ -4,23 +4,8 @@
|
|||||||
*/
|
*/
|
||||||
import zod, { type z } from 'zod'
|
import zod, { type z } from 'zod'
|
||||||
|
|
||||||
import type { PageAgent } from '@/PageAgent'
|
import type { PageAgent } from '../PageAgent'
|
||||||
|
import { waitFor } from '../utils'
|
||||||
import {
|
|
||||||
clickElement,
|
|
||||||
getElementByIndex,
|
|
||||||
getSystemInfo,
|
|
||||||
inputTextElement,
|
|
||||||
scrollHorizontally,
|
|
||||||
scrollVertically,
|
|
||||||
selectOptionElement,
|
|
||||||
waitFor,
|
|
||||||
} from './actions'
|
|
||||||
// debug
|
|
||||||
import * as utils from './actions'
|
|
||||||
|
|
||||||
// @ts-expect-error debug only
|
|
||||||
window.utils = utils
|
|
||||||
|
|
||||||
/**
|
/**
|
||||||
* Internal tool definition that has access to PageAgent `this` context
|
* Internal tool definition that has access to PageAgent `this` context
|
||||||
@@ -42,18 +27,6 @@ export function tool<TParams>(options: PageAgentTool<TParams>): PageAgentTool<TP
|
|||||||
*/
|
*/
|
||||||
export const tools = new Map<string, PageAgentTool>()
|
export const tools = new Map<string, PageAgentTool>()
|
||||||
|
|
||||||
// tools.set(
|
|
||||||
// 'get_current_html',
|
|
||||||
// tool({
|
|
||||||
// description: 'Get the current (updated) simplified HTML of the page',
|
|
||||||
// inputSchema: zod.object({}),
|
|
||||||
// execute: function (this: PageAgent) {
|
|
||||||
// this.updateTree()
|
|
||||||
// return this.simplifiedHTML
|
|
||||||
// },
|
|
||||||
// })
|
|
||||||
// )
|
|
||||||
|
|
||||||
tools.set(
|
tools.set(
|
||||||
'done',
|
'done',
|
||||||
tool({
|
tool({
|
||||||
@@ -80,11 +53,11 @@ tools.set(
|
|||||||
seconds: zod.number().min(1).max(10).default(1),
|
seconds: zod.number().min(1).max(10).default(1),
|
||||||
}),
|
}),
|
||||||
execute: async function (this: PageAgent, input) {
|
execute: async function (this: PageAgent, input) {
|
||||||
const lastTimeUpdate = this.lastTimeUpdate
|
const lastTimeUpdate = await this.pageController.getLastUpdateTime()
|
||||||
const actualWaitTime = Math.max(0, input.seconds - (Date.now() - lastTimeUpdate) / 1000)
|
const actualWaitTime = Math.max(0, input.seconds - (Date.now() - lastTimeUpdate) / 1000)
|
||||||
console.log(`actualWaitTime: ${actualWaitTime} seconds`)
|
console.log(`actualWaitTime: ${actualWaitTime} seconds`)
|
||||||
await waitFor(actualWaitTime)
|
await waitFor(actualWaitTime)
|
||||||
return `✅ Waited for ${input.seconds} seconds.` + (await getSystemInfo())
|
return `✅ Waited for ${input.seconds} seconds.`
|
||||||
},
|
},
|
||||||
})
|
})
|
||||||
)
|
)
|
||||||
@@ -99,7 +72,7 @@ tools.set(
|
|||||||
}),
|
}),
|
||||||
execute: async function (this: PageAgent, input) {
|
execute: async function (this: PageAgent, input) {
|
||||||
const answer = await this.panel.askUser(input.question)
|
const answer = await this.panel.askUser(input.question)
|
||||||
return `✅ Received user answer: ${answer}` + (await getSystemInfo())
|
return `✅ Received user answer: ${answer}`
|
||||||
},
|
},
|
||||||
})
|
})
|
||||||
)
|
)
|
||||||
@@ -112,16 +85,8 @@ tools.set(
|
|||||||
index: zod.int().min(0),
|
index: zod.int().min(0),
|
||||||
}),
|
}),
|
||||||
execute: async function (this: PageAgent, input) {
|
execute: async function (this: PageAgent, input) {
|
||||||
const element = getElementByIndex(this, input.index)
|
const result = await this.pageController.clickElement(input.index)
|
||||||
const elemText = this.elementTextMap.get(input.index)
|
return result.message
|
||||||
await clickElement(element)
|
|
||||||
|
|
||||||
// @workaround: Handle links that open in new tabs
|
|
||||||
if (element instanceof HTMLAnchorElement && element.target === '_blank') {
|
|
||||||
return `⚠️ Clicked link that opens in a new tab (${elemText ? elemText : input.index}). You are not capable of reading new tabs.`
|
|
||||||
}
|
|
||||||
|
|
||||||
return `✅ Clicked element (${elemText ? elemText : input.index}).` + (await getSystemInfo())
|
|
||||||
},
|
},
|
||||||
})
|
})
|
||||||
)
|
)
|
||||||
@@ -135,13 +100,8 @@ tools.set(
|
|||||||
text: zod.string(),
|
text: zod.string(),
|
||||||
}),
|
}),
|
||||||
execute: async function (this: PageAgent, input) {
|
execute: async function (this: PageAgent, input) {
|
||||||
const element = getElementByIndex(this, input.index)
|
const result = await this.pageController.inputText(input.index, input.text)
|
||||||
const elemText = this.elementTextMap.get(input.index)
|
return result.message
|
||||||
await inputTextElement(element, input.text)
|
|
||||||
return (
|
|
||||||
`✅ Input text (${input.text}) into element (${elemText ? elemText : input.index}).` +
|
|
||||||
(await getSystemInfo())
|
|
||||||
)
|
|
||||||
},
|
},
|
||||||
})
|
})
|
||||||
)
|
)
|
||||||
@@ -156,13 +116,8 @@ tools.set(
|
|||||||
text: zod.string(),
|
text: zod.string(),
|
||||||
}),
|
}),
|
||||||
execute: async function (this: PageAgent, input) {
|
execute: async function (this: PageAgent, input) {
|
||||||
const element = getElementByIndex(this, input.index)
|
const result = await this.pageController.selectOption(input.index, input.text)
|
||||||
const elemText = this.elementTextMap.get(input.index)
|
return result.message
|
||||||
await selectOptionElement(element as HTMLSelectElement, input.text)
|
|
||||||
return (
|
|
||||||
`✅ Selected option (${input.text}) in element (${elemText ? elemText : input.index}).` +
|
|
||||||
(await getSystemInfo())
|
|
||||||
)
|
|
||||||
},
|
},
|
||||||
})
|
})
|
||||||
)
|
)
|
||||||
@@ -182,13 +137,11 @@ tools.set(
|
|||||||
index: zod.number().int().min(0).optional(),
|
index: zod.number().int().min(0).optional(),
|
||||||
}),
|
}),
|
||||||
execute: async function (this: PageAgent, input) {
|
execute: async function (this: PageAgent, input) {
|
||||||
const { down, num_pages, index, pixels } = input
|
const result = await this.pageController.scroll({
|
||||||
|
...input,
|
||||||
const scroll_amount = pixels ? pixels : num_pages * (down ? 1 : -1) * window.innerHeight
|
numPages: input.num_pages,
|
||||||
|
})
|
||||||
const element = index !== undefined ? getElementByIndex(this, index) : null
|
return result.message
|
||||||
|
|
||||||
return (await scrollVertically(down, scroll_amount, element)) + (await getSystemInfo())
|
|
||||||
},
|
},
|
||||||
})
|
})
|
||||||
)
|
)
|
||||||
@@ -204,13 +157,23 @@ tools.set(
|
|||||||
index: zod.number().int().min(0).optional(),
|
index: zod.number().int().min(0).optional(),
|
||||||
}),
|
}),
|
||||||
execute: async function (this: PageAgent, input) {
|
execute: async function (this: PageAgent, input) {
|
||||||
const { right, pixels, index } = input
|
const result = await this.pageController.scrollHorizontally(input)
|
||||||
|
return result.message
|
||||||
|
},
|
||||||
|
})
|
||||||
|
)
|
||||||
|
|
||||||
const scroll_amount = pixels * (right ? 1 : -1)
|
tools.set(
|
||||||
|
'execute_javascript',
|
||||||
const element = index !== undefined ? getElementByIndex(this, index) : null
|
tool({
|
||||||
|
description:
|
||||||
return (await scrollHorizontally(right, scroll_amount, element)) + (await getSystemInfo())
|
'Execute JavaScript code on the current page. Supports async/await syntax. Use with caution!',
|
||||||
|
inputSchema: zod.object({
|
||||||
|
script: zod.string(),
|
||||||
|
}),
|
||||||
|
execute: async function (this: PageAgent, input) {
|
||||||
|
const result = await this.pageController.executeJavascript(input.script)
|
||||||
|
return result.message
|
||||||
},
|
},
|
||||||
})
|
})
|
||||||
)
|
)
|
||||||
@@ -37,4 +37,4 @@ if (currentScript) {
|
|||||||
|
|
||||||
console.log('🚀 page-agent.js initialized with config:', window.pageAgent.config)
|
console.log('🚀 page-agent.js initialized with config:', window.pageAgent.config)
|
||||||
|
|
||||||
window.pageAgent.bus.emit('panel:show') // Show panel
|
window.pageAgent.panel.show() // Show panel
|
||||||
@@ -1,30 +1,9 @@
|
|||||||
/**
|
|
||||||
* Type-safe event bus for decoupling PageAgent and Panel
|
|
||||||
*/
|
|
||||||
import type { Step } from '@/ui/UIState'
|
|
||||||
|
|
||||||
/**
|
/**
|
||||||
* Event mapping definitions
|
* Event mapping definitions
|
||||||
* @note Event bus callbacks must be repeatable without errors
|
* @note Event bus callbacks must be repeatable without errors
|
||||||
*/
|
*/
|
||||||
export interface PageAgentEventMap {
|
export interface PageAgentEventMap {
|
||||||
// Panel control events
|
|
||||||
// call panel.show()
|
|
||||||
'panel:show': { params: undefined }
|
|
||||||
// call panel.hide()
|
|
||||||
'panel:hide': { params: undefined }
|
|
||||||
// call panel.reset()
|
|
||||||
'panel:reset': { params: undefined }
|
|
||||||
// call panel.update()
|
|
||||||
'panel:update': { params: Omit<Step, 'id' | 'stepNumber' | 'timestamp'> }
|
|
||||||
// call panel.expand()
|
|
||||||
'panel:expand': { params: undefined }
|
|
||||||
// call panel.collapse()
|
|
||||||
'panel:collapse': { params: undefined }
|
|
||||||
|
|
||||||
// PageAgent status events
|
// PageAgent status events
|
||||||
// 'agent:beforeUpdate': { params: undefined }
|
|
||||||
// 'agent:afterUpdate': { params: undefined }
|
|
||||||
// 'agent:execute': { params: { task: string } }
|
// 'agent:execute': { params: { task: string } }
|
||||||
// 'agent:done': { params: { text: string; success: boolean } }
|
// 'agent:done': { params: { text: string; success: boolean } }
|
||||||
// 'agent:paused': { params: undefined }
|
// 'agent:paused': { params: undefined }
|
||||||
@@ -33,8 +12,7 @@ export interface PageAgentEventMap {
|
|||||||
// 'agent:error': { params: { error: string | Error } }
|
// 'agent:error': { params: { error: string | Error } }
|
||||||
|
|
||||||
// Task status change events
|
// Task status change events
|
||||||
// 'task:start': { params: { task: string } }
|
'task:start': { params: { task: string } }
|
||||||
// 'task:step': { params: Omit<AgentStep, 'id' | 'stepNumber' | 'timestamp'> }
|
|
||||||
// 'task:complete': { params: { text: string; success: boolean } }
|
// 'task:complete': { params: { text: string; success: boolean } }
|
||||||
// 'task:error': { params: { error: string | Error } }
|
// 'task:error': { params: { error: string | Error } }
|
||||||
|
|
||||||
@@ -69,10 +47,7 @@ class EventBus extends EventTarget {
|
|||||||
/**
|
/**
|
||||||
* Listen to built-in events
|
* Listen to built-in events
|
||||||
*/
|
*/
|
||||||
on<T extends keyof PageAgentEventMap>(
|
on<T extends keyof PageAgentEventMap>(event: T, handler: EventHandler<T>): void {
|
||||||
event: T,
|
|
||||||
handler: EventHandler<T & keyof PageAgentEventMap>
|
|
||||||
): void {
|
|
||||||
const wrappedHandler = (e: Event) => {
|
const wrappedHandler = (e: Event) => {
|
||||||
const customEvent = e as CustomEvent
|
const customEvent = e as CustomEvent
|
||||||
const params = customEvent.detail?.[0]
|
const params = customEvent.detail?.[0]
|
||||||
@@ -84,10 +59,7 @@ class EventBus extends EventTarget {
|
|||||||
/**
|
/**
|
||||||
* Listen to built-in events (one-time)
|
* Listen to built-in events (one-time)
|
||||||
*/
|
*/
|
||||||
once<T extends keyof PageAgentEventMap>(
|
once<T extends keyof PageAgentEventMap>(event: T, handler: EventHandler<T>): void {
|
||||||
event: T,
|
|
||||||
handler: EventHandler<T & keyof PageAgentEventMap>
|
|
||||||
): void {
|
|
||||||
const wrappedHandler = (e: Event) => {
|
const wrappedHandler = (e: Event) => {
|
||||||
const customEvent = e as CustomEvent
|
const customEvent = e as CustomEvent
|
||||||
const params = customEvent.detail?.[0]
|
const params = customEvent.detail?.[0]
|
||||||
@@ -20,6 +20,10 @@ export async function waitUntil(check: () => boolean, timeout = 60 * 60_1000): P
|
|||||||
})
|
})
|
||||||
}
|
}
|
||||||
|
|
||||||
|
export async function waitFor(seconds: number): Promise<void> {
|
||||||
|
await new Promise((resolve) => setTimeout(resolve, seconds * 1000))
|
||||||
|
}
|
||||||
|
|
||||||
//
|
//
|
||||||
|
|
||||||
export function truncate(text: string, maxLength: number): string {
|
export function truncate(text: string, maxLength: number): string {
|
||||||
@@ -0,0 +1,9 @@
|
|||||||
|
{
|
||||||
|
"extends": "./tsconfig.json",
|
||||||
|
"compilerOptions": {
|
||||||
|
// @workaround DTS bug
|
||||||
|
// dts do not work with monorepo path mapping
|
||||||
|
// disable path mapping for it
|
||||||
|
"paths": {}
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,22 @@
|
|||||||
|
{
|
||||||
|
"extends": "../../tsconfig.base.json",
|
||||||
|
"compilerOptions": {
|
||||||
|
"tsBuildInfoFile": "./node_modules/.tmp/tsconfig.tsbuildinfo",
|
||||||
|
"noEmit": false,
|
||||||
|
"allowImportingTsExtensions": false,
|
||||||
|
"baseUrl": ".",
|
||||||
|
"outDir": "dist",
|
||||||
|
"paths": {
|
||||||
|
//
|
||||||
|
"@page-agent/page-controller": ["../page-controller/src/PageController.ts"],
|
||||||
|
"@page-agent/ui": ["../ui/src/index.ts"]
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"include": ["**/*.ts"],
|
||||||
|
"exclude": ["dist", "node_modules"],
|
||||||
|
"references": [
|
||||||
|
//
|
||||||
|
{ "path": "../page-controller" },
|
||||||
|
{ "path": "../ui" }
|
||||||
|
]
|
||||||
|
}
|
||||||
@@ -1,9 +1,4 @@
|
|||||||
// @ts-check
|
// @ts-check
|
||||||
// ============================================================================
|
|
||||||
// Export Configuration Based on MODE Environment Variable
|
|
||||||
// ============================================================================
|
|
||||||
import tailwindcss from '@tailwindcss/vite'
|
|
||||||
import react from '@vitejs/plugin-react-swc'
|
|
||||||
import chalk from 'chalk'
|
import chalk from 'chalk'
|
||||||
import 'dotenv/config'
|
import 'dotenv/config'
|
||||||
import process from 'node:process'
|
import process from 'node:process'
|
||||||
@@ -13,44 +8,18 @@ import { fileURLToPath } from 'url'
|
|||||||
import { defineConfig } from 'vite'
|
import { defineConfig } from 'vite'
|
||||||
import cssInjectedByJsPlugin from 'vite-plugin-css-injected-by-js'
|
import cssInjectedByJsPlugin from 'vite-plugin-css-injected-by-js'
|
||||||
|
|
||||||
const __filename = fileURLToPath(import.meta.url)
|
const __dirname = dirname(fileURLToPath(import.meta.url))
|
||||||
const __dirname = dirname(__filename)
|
|
||||||
|
|
||||||
// Website Config (React Documentation Site)
|
|
||||||
|
|
||||||
/** @type {import('vite').UserConfig} */
|
|
||||||
const websiteConfig = {
|
|
||||||
// https://vite.dev/config/
|
|
||||||
base: './',
|
|
||||||
plugins: [react(), tailwindcss()],
|
|
||||||
resolve: {
|
|
||||||
alias: {
|
|
||||||
'@': resolve(__dirname, 'src'),
|
|
||||||
'@pages': resolve(__dirname, 'pages'),
|
|
||||||
},
|
|
||||||
},
|
|
||||||
define: {
|
|
||||||
'import.meta.env.LLM_MODEL_NAME': JSON.stringify(process.env.LLM_MODEL_NAME),
|
|
||||||
'import.meta.env.LLM_API_KEY': JSON.stringify(process.env.LLM_API_KEY),
|
|
||||||
'import.meta.env.LLM_BASE_URL': JSON.stringify(process.env.LLM_BASE_URL),
|
|
||||||
},
|
|
||||||
}
|
|
||||||
|
|
||||||
// ============================================================================
|
// ============================================================================
|
||||||
// Library Config (ES Module for NPM Package)
|
// ES Module for NPM Package
|
||||||
// ============================================================================
|
// ============================================================================
|
||||||
/** @type {import('vite').UserConfig} */
|
/** @type {import('vite').UserConfig} */
|
||||||
const libConfig = {
|
const esmConfig = {
|
||||||
// Library build configuration
|
clearScreen: false,
|
||||||
plugins: [
|
plugins: [
|
||||||
dts({ tsconfigPath: './tsconfig.json', bundleTypes: true }),
|
dts({ tsconfigPath: './tsconfig.dts.json', bundleTypes: true }),
|
||||||
cssInjectedByJsPlugin({ relativeCSSInjection: true }),
|
cssInjectedByJsPlugin({ relativeCSSInjection: true }),
|
||||||
],
|
],
|
||||||
resolve: {
|
|
||||||
alias: {
|
|
||||||
'@': resolve(__dirname, 'src'),
|
|
||||||
},
|
|
||||||
},
|
|
||||||
publicDir: false,
|
publicDir: false,
|
||||||
esbuild: {
|
esbuild: {
|
||||||
keepNames: true,
|
keepNames: true,
|
||||||
@@ -62,11 +31,15 @@ const libConfig = {
|
|||||||
fileName: 'page-agent',
|
fileName: 'page-agent',
|
||||||
formats: ['es'],
|
formats: ['es'],
|
||||||
},
|
},
|
||||||
outDir: resolve(__dirname, 'dist', 'lib'),
|
outDir: resolve(__dirname, 'dist', 'esm'),
|
||||||
rollupOptions: {
|
rollupOptions: {
|
||||||
external: ['ai', 'ai-motion', 'chalk', 'zod'],
|
external: [
|
||||||
|
'chalk',
|
||||||
|
'zod',
|
||||||
|
// all the internal packages
|
||||||
|
/^@page-agent\//,
|
||||||
|
],
|
||||||
},
|
},
|
||||||
// minify: 'terser',
|
|
||||||
minify: false,
|
minify: false,
|
||||||
sourcemap: true,
|
sourcemap: true,
|
||||||
cssCodeSplit: true,
|
cssCodeSplit: true,
|
||||||
@@ -77,29 +50,37 @@ const libConfig = {
|
|||||||
}
|
}
|
||||||
|
|
||||||
// ============================================================================
|
// ============================================================================
|
||||||
// UMD Config (Browser Bundle for CDN)
|
// UMD Bundle for CDN
|
||||||
|
// - alias all local packages so that they can be build in
|
||||||
|
// - no external
|
||||||
|
// - no d.ts. dts does not work with monorepo aliasing
|
||||||
// ============================================================================
|
// ============================================================================
|
||||||
/** @type {import('vite').UserConfig} */
|
/** @type {import('vite').UserConfig} */
|
||||||
const umdConfig = {
|
const umdConfig = {
|
||||||
// Library build configuration
|
|
||||||
plugins: [cssInjectedByJsPlugin({ relativeCSSInjection: true })],
|
plugins: [cssInjectedByJsPlugin({ relativeCSSInjection: true })],
|
||||||
resolve: {
|
|
||||||
alias: {
|
|
||||||
'@': resolve(__dirname, 'src'),
|
|
||||||
},
|
|
||||||
},
|
|
||||||
publicDir: false,
|
publicDir: false,
|
||||||
esbuild: {
|
esbuild: {
|
||||||
keepNames: true,
|
keepNames: true,
|
||||||
},
|
},
|
||||||
|
resolve: {
|
||||||
|
alias: {
|
||||||
|
'@page-agent/page-controller': resolve(__dirname, '../page-controller/src/PageController.ts'),
|
||||||
|
'@page-agent/ui': resolve(__dirname, '../ui/src/index.ts'),
|
||||||
|
},
|
||||||
|
},
|
||||||
build: {
|
build: {
|
||||||
lib: {
|
lib: {
|
||||||
entry: resolve(__dirname, 'src/entry.ts'),
|
entry: resolve(__dirname, 'src/umd.ts'),
|
||||||
name: 'PageAgent',
|
name: 'PageAgent',
|
||||||
fileName: 'page-agent',
|
fileName: 'page-agent',
|
||||||
formats: ['umd'],
|
formats: ['umd'],
|
||||||
},
|
},
|
||||||
outDir: resolve(__dirname, 'dist', 'umd'),
|
outDir: resolve(__dirname, 'dist', 'umd'),
|
||||||
|
rollupOptions: {
|
||||||
|
output: {
|
||||||
|
entryFileNames: 'page-agent.js', // 强制指定完整文件名
|
||||||
|
},
|
||||||
|
},
|
||||||
cssCodeSplit: true,
|
cssCodeSplit: true,
|
||||||
},
|
},
|
||||||
define: {
|
define: {
|
||||||
@@ -109,19 +90,15 @@ const umdConfig = {
|
|||||||
|
|
||||||
// ============================================================================
|
// ============================================================================
|
||||||
|
|
||||||
// ============================================================================
|
|
||||||
|
|
||||||
const MODE = process.env.MODE
|
const MODE = process.env.MODE
|
||||||
|
|
||||||
console.log(chalk.cyan(`📦 Build mode: ${chalk.bold(MODE || 'website')}`))
|
console.log(chalk.cyan(`📦 Build mode: ${chalk.bold(MODE || 'esm')}`))
|
||||||
|
|
||||||
let config
|
let config
|
||||||
if (MODE === 'lib') {
|
if (MODE === 'umd') {
|
||||||
config = libConfig
|
|
||||||
} else if (MODE === 'umd') {
|
|
||||||
config = umdConfig
|
config = umdConfig
|
||||||
} else {
|
} else {
|
||||||
config = websiteConfig
|
config = esmConfig
|
||||||
}
|
}
|
||||||
|
|
||||||
export default defineConfig(config)
|
export default defineConfig(config)
|
||||||
@@ -0,0 +1,38 @@
|
|||||||
|
{
|
||||||
|
"name": "@page-agent/page-controller",
|
||||||
|
"version": "0.0.11",
|
||||||
|
"type": "module",
|
||||||
|
"main": "./dist/lib/page-controller.js",
|
||||||
|
"module": "./dist/lib/page-controller.js",
|
||||||
|
"types": "./dist/lib/PageController.d.ts",
|
||||||
|
"exports": {
|
||||||
|
".": {
|
||||||
|
"types": "./dist/lib/PageController.d.ts",
|
||||||
|
"import": "./dist/lib/page-controller.js",
|
||||||
|
"default": "./dist/lib/page-controller.js"
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"files": [
|
||||||
|
"dist/"
|
||||||
|
],
|
||||||
|
"description": "Page controller for page-agent - DOM operations and element interactions",
|
||||||
|
"keywords": [
|
||||||
|
"page-agent",
|
||||||
|
"dom",
|
||||||
|
"browser-automation",
|
||||||
|
"web-automation"
|
||||||
|
],
|
||||||
|
"author": "Simon<gaomeng1900>",
|
||||||
|
"license": "MIT",
|
||||||
|
"repository": {
|
||||||
|
"type": "git",
|
||||||
|
"url": "https://github.com/alibaba/page-agent.git",
|
||||||
|
"directory": "packages/page-controller"
|
||||||
|
},
|
||||||
|
"homepage": "https://alibaba.github.io/page-agent/",
|
||||||
|
"scripts": {
|
||||||
|
"build": "vite build",
|
||||||
|
"prepublishOnly": "node -e \"const fs=require('fs');['LICENSE'].forEach(f=>fs.copyFileSync('../../'+f,f))\"",
|
||||||
|
"postpublish": "node -e \"['LICENSE'].forEach(f=>{try{require('fs').unlinkSync(f)}catch{}})\""
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,339 @@
|
|||||||
|
/**
|
||||||
|
* Copyright (C) 2025 Alibaba Group Holding Limited
|
||||||
|
* All rights reserved.
|
||||||
|
*
|
||||||
|
* PageController - Manages DOM operations and element interactions.
|
||||||
|
* Designed to be independent of LLM and can be tested in unit tests.
|
||||||
|
* All public methods are async for potential remote calling support.
|
||||||
|
*/
|
||||||
|
import {
|
||||||
|
clickElement,
|
||||||
|
getElementByIndex,
|
||||||
|
inputTextElement,
|
||||||
|
scrollHorizontally,
|
||||||
|
scrollVertically,
|
||||||
|
selectOptionElement,
|
||||||
|
} from './actions'
|
||||||
|
import { VIEWPORT_EXPANSION } from './constants'
|
||||||
|
import * as dom from './dom'
|
||||||
|
import type { FlatDomTree, InteractiveElementDomNode } from './dom/dom_tree/type'
|
||||||
|
import { getPageInfo } from './dom/getPageInfo'
|
||||||
|
import { patchReact } from './patches/react'
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Configuration for PageController
|
||||||
|
*/
|
||||||
|
export interface PageControllerConfig extends dom.DomConfig {
|
||||||
|
viewportExpansion?: number
|
||||||
|
}
|
||||||
|
|
||||||
|
interface ActionResult {
|
||||||
|
success: boolean
|
||||||
|
message: string
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* PageController manages DOM state and element interactions.
|
||||||
|
* It provides async methods for all DOM operations, keeping state isolated.
|
||||||
|
*
|
||||||
|
* @lifecycle
|
||||||
|
* - beforeUpdate: Emitted before the DOM tree is updated.
|
||||||
|
* - afterUpdate: Emitted after the DOM tree is updated.
|
||||||
|
*/
|
||||||
|
export class PageController extends EventTarget {
|
||||||
|
private config: PageControllerConfig
|
||||||
|
|
||||||
|
/** Corresponds to eval_page in browser-use */
|
||||||
|
private flatTree: FlatDomTree | null = null
|
||||||
|
|
||||||
|
/**
|
||||||
|
* All highlighted index-mapped interactive elements
|
||||||
|
* Corresponds to DOMState.selector_map in browser-use
|
||||||
|
*/
|
||||||
|
private selectorMap = new Map<number, InteractiveElementDomNode>()
|
||||||
|
|
||||||
|
/** Index -> element text description mapping */
|
||||||
|
private elementTextMap = new Map<number, string>()
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Simplified HTML for LLM consumption.
|
||||||
|
* Corresponds to clickable_elements_to_string in browser-use
|
||||||
|
*/
|
||||||
|
private simplifiedHTML = '<EMPTY>'
|
||||||
|
|
||||||
|
/** last time the tree was updated */
|
||||||
|
private lastTimeUpdate = 0
|
||||||
|
|
||||||
|
constructor(config: PageControllerConfig = {}) {
|
||||||
|
super()
|
||||||
|
|
||||||
|
this.config = config
|
||||||
|
|
||||||
|
patchReact(this)
|
||||||
|
}
|
||||||
|
|
||||||
|
// ======= State Queries =======
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Get current page URL
|
||||||
|
*/
|
||||||
|
async getCurrentUrl(): Promise<string> {
|
||||||
|
return window.location.href
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Get current page title
|
||||||
|
*/
|
||||||
|
async getPageTitle(): Promise<string> {
|
||||||
|
return document.title
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Get page scroll and size info
|
||||||
|
*/
|
||||||
|
async getPageInfo() {
|
||||||
|
return getPageInfo()
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Get the simplified HTML representation of the page.
|
||||||
|
* This is used by LLM to understand the page structure.
|
||||||
|
*/
|
||||||
|
async getSimplifiedHTML(): Promise<string> {
|
||||||
|
return this.simplifiedHTML
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Get text description for an element by index
|
||||||
|
*/
|
||||||
|
async getElementText(index: number): Promise<string | undefined> {
|
||||||
|
return this.elementTextMap.get(index)
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Get total number of indexed interactive elements
|
||||||
|
*/
|
||||||
|
async getElementCount(): Promise<number> {
|
||||||
|
return this.selectorMap.size
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Get last tree update timestamp
|
||||||
|
*/
|
||||||
|
async getLastUpdateTime(): Promise<number> {
|
||||||
|
return this.lastTimeUpdate
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Get the viewport expansion setting
|
||||||
|
*/
|
||||||
|
async getViewportExpansion(): Promise<number> {
|
||||||
|
return this.config.viewportExpansion ?? VIEWPORT_EXPANSION
|
||||||
|
}
|
||||||
|
|
||||||
|
// ======= DOM Tree Operations =======
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Update DOM tree, returns simplified HTML for LLM.
|
||||||
|
* This is the main method to refresh the page state.
|
||||||
|
*/
|
||||||
|
async updateTree(): Promise<string> {
|
||||||
|
this.dispatchEvent(new Event('beforeUpdate'))
|
||||||
|
|
||||||
|
this.lastTimeUpdate = Date.now()
|
||||||
|
|
||||||
|
dom.cleanUpHighlights()
|
||||||
|
|
||||||
|
const blacklist = [
|
||||||
|
...(this.config.interactiveBlacklist || []),
|
||||||
|
...document.querySelectorAll('[data-page-agent-not-interactive]').values(),
|
||||||
|
]
|
||||||
|
|
||||||
|
this.flatTree = dom.getFlatTree({
|
||||||
|
...this.config,
|
||||||
|
interactiveBlacklist: blacklist,
|
||||||
|
})
|
||||||
|
|
||||||
|
this.simplifiedHTML = dom.flatTreeToString(this.flatTree, this.config.include_attributes)
|
||||||
|
|
||||||
|
this.selectorMap.clear()
|
||||||
|
this.selectorMap = dom.getSelectorMap(this.flatTree)
|
||||||
|
|
||||||
|
this.elementTextMap.clear()
|
||||||
|
this.elementTextMap = dom.getElementTextMap(this.simplifiedHTML)
|
||||||
|
|
||||||
|
this.dispatchEvent(new Event('afterUpdate'))
|
||||||
|
|
||||||
|
return this.simplifiedHTML
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Clean up all element highlights
|
||||||
|
*/
|
||||||
|
async cleanUpHighlights(): Promise<void> {
|
||||||
|
dom.cleanUpHighlights()
|
||||||
|
}
|
||||||
|
|
||||||
|
// ======= Element Actions =======
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Click element by index
|
||||||
|
*/
|
||||||
|
async clickElement(index: number): Promise<ActionResult> {
|
||||||
|
try {
|
||||||
|
const element = getElementByIndex(this.selectorMap, index)
|
||||||
|
const elemText = this.elementTextMap.get(index)
|
||||||
|
await clickElement(element)
|
||||||
|
|
||||||
|
// Handle links that open in new tabs
|
||||||
|
if (element instanceof HTMLAnchorElement && element.target === '_blank') {
|
||||||
|
return {
|
||||||
|
success: true,
|
||||||
|
message: `✅ Clicked element (${elemText ?? index}). ⚠️ Link opens in a new tab. You are not capable of reading new tabs.`,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
return {
|
||||||
|
success: true,
|
||||||
|
message: `✅ Clicked element (${elemText ?? index}).`,
|
||||||
|
}
|
||||||
|
} catch (error) {
|
||||||
|
return {
|
||||||
|
success: false,
|
||||||
|
message: `❌ Failed to click element: ${error}`,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Input text into element by index
|
||||||
|
*/
|
||||||
|
async inputText(index: number, text: string): Promise<ActionResult> {
|
||||||
|
try {
|
||||||
|
const element = getElementByIndex(this.selectorMap, index)
|
||||||
|
const elemText = this.elementTextMap.get(index)
|
||||||
|
await inputTextElement(element, text)
|
||||||
|
|
||||||
|
return {
|
||||||
|
success: true,
|
||||||
|
message: `✅ Input text (${text}) into element (${elemText ?? index}).`,
|
||||||
|
}
|
||||||
|
} catch (error) {
|
||||||
|
return {
|
||||||
|
success: false,
|
||||||
|
message: `❌ Failed to input text: ${error}`,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Select dropdown option by index and option text
|
||||||
|
*/
|
||||||
|
async selectOption(index: number, optionText: string): Promise<ActionResult> {
|
||||||
|
try {
|
||||||
|
const element = getElementByIndex(this.selectorMap, index)
|
||||||
|
const elemText = this.elementTextMap.get(index)
|
||||||
|
await selectOptionElement(element as HTMLSelectElement, optionText)
|
||||||
|
|
||||||
|
return {
|
||||||
|
success: true,
|
||||||
|
message: `✅ Selected option (${optionText}) in element (${elemText ?? index}).`,
|
||||||
|
}
|
||||||
|
} catch (error) {
|
||||||
|
return {
|
||||||
|
success: false,
|
||||||
|
message: `❌ Failed to select option: ${error}`,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Scroll vertically
|
||||||
|
*/
|
||||||
|
async scroll(options: {
|
||||||
|
down: boolean
|
||||||
|
numPages: number
|
||||||
|
pixels?: number
|
||||||
|
index?: number
|
||||||
|
}): Promise<ActionResult> {
|
||||||
|
try {
|
||||||
|
const { down, numPages, pixels, index } = options
|
||||||
|
|
||||||
|
const scrollAmount = pixels ?? numPages * (down ? 1 : -1) * window.innerHeight
|
||||||
|
|
||||||
|
const element = index !== undefined ? getElementByIndex(this.selectorMap, index) : null
|
||||||
|
|
||||||
|
const message = await scrollVertically(down, scrollAmount, element)
|
||||||
|
|
||||||
|
return {
|
||||||
|
success: true,
|
||||||
|
message,
|
||||||
|
}
|
||||||
|
} catch (error) {
|
||||||
|
return {
|
||||||
|
success: false,
|
||||||
|
message: `❌ Failed to scroll: ${error}`,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Scroll horizontally
|
||||||
|
*/
|
||||||
|
async scrollHorizontally(options: {
|
||||||
|
right: boolean
|
||||||
|
pixels: number
|
||||||
|
index?: number
|
||||||
|
}): Promise<ActionResult> {
|
||||||
|
try {
|
||||||
|
const { right, pixels, index } = options
|
||||||
|
|
||||||
|
const scrollAmount = pixels * (right ? 1 : -1)
|
||||||
|
|
||||||
|
const element = index !== undefined ? getElementByIndex(this.selectorMap, index) : null
|
||||||
|
|
||||||
|
const message = await scrollHorizontally(right, scrollAmount, element)
|
||||||
|
|
||||||
|
return {
|
||||||
|
success: true,
|
||||||
|
message,
|
||||||
|
}
|
||||||
|
} catch (error) {
|
||||||
|
return {
|
||||||
|
success: false,
|
||||||
|
message: `❌ Failed to scroll horizontally: ${error}`,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Execute arbitrary JavaScript on the page
|
||||||
|
*/
|
||||||
|
async executeJavascript(script: string): Promise<ActionResult> {
|
||||||
|
try {
|
||||||
|
// Wrap script in async function to support await
|
||||||
|
const asyncFunction = eval(`(async () => { ${script} })`)
|
||||||
|
const result = await asyncFunction()
|
||||||
|
return {
|
||||||
|
success: true,
|
||||||
|
message: `✅ Executed JavaScript. Result: ${result}`,
|
||||||
|
}
|
||||||
|
} catch (error) {
|
||||||
|
return {
|
||||||
|
success: false,
|
||||||
|
message: `❌ Error executing JavaScript: ${error}`,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Dispose and clean up resources
|
||||||
|
*/
|
||||||
|
dispose(): void {
|
||||||
|
dom.cleanUpHighlights()
|
||||||
|
this.flatTree = null
|
||||||
|
this.selectorMap.clear()
|
||||||
|
this.elementTextMap.clear()
|
||||||
|
this.simplifiedHTML = '<EMPTY>'
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -2,26 +2,14 @@
|
|||||||
* Copyright (C) 2025 Alibaba Group Holding Limited
|
* Copyright (C) 2025 Alibaba Group Holding Limited
|
||||||
* All rights reserved.
|
* All rights reserved.
|
||||||
*/
|
*/
|
||||||
import type { PageAgent } from '../PageAgent'
|
import type { InteractiveElementDomNode } from './dom/dom_tree/type'
|
||||||
|
|
||||||
// ======= general utils =======
|
// ======= general utils =======
|
||||||
|
|
||||||
export async function waitFor(seconds: number): Promise<void> {
|
async function waitFor(seconds: number): Promise<void> {
|
||||||
await new Promise((resolve) => setTimeout(resolve, seconds * 1000))
|
await new Promise((resolve) => setTimeout(resolve, seconds * 1000))
|
||||||
}
|
}
|
||||||
|
|
||||||
let currentUrl = window.location.href
|
|
||||||
export async function getSystemInfo() {
|
|
||||||
// If current URL is already up to date, no need to add message
|
|
||||||
if (currentUrl === window.location.href) return ''
|
|
||||||
|
|
||||||
await waitFor(0.3) // Wait a bit longer for page to load
|
|
||||||
|
|
||||||
currentUrl = window.location.href
|
|
||||||
|
|
||||||
return `\n<sys> Current URL changed to: ${currentUrl} </sys>`
|
|
||||||
}
|
|
||||||
|
|
||||||
// ======= dom utils =======
|
// ======= dom utils =======
|
||||||
|
|
||||||
export async function movePointerToElement(element: HTMLElement) {
|
export async function movePointerToElement(element: HTMLElement) {
|
||||||
@@ -35,10 +23,13 @@ export async function movePointerToElement(element: HTMLElement) {
|
|||||||
}
|
}
|
||||||
|
|
||||||
/**
|
/**
|
||||||
* Get the HTMLElement by index from the selectorMap in PageAgent.
|
* Get the HTMLElement by index from a selectorMap.
|
||||||
*/
|
*/
|
||||||
export function getElementByIndex(pageAgent: PageAgent, index: number): HTMLElement {
|
export function getElementByIndex(
|
||||||
const interactiveNode = pageAgent.selectorMap.get(index)
|
selectorMap: Map<number, InteractiveElementDomNode>,
|
||||||
|
index: number
|
||||||
|
): HTMLElement {
|
||||||
|
const interactiveNode = selectorMap.get(index)
|
||||||
if (!interactiveNode) {
|
if (!interactiveNode) {
|
||||||
throw new Error(`No interactive element found at index ${index}`)
|
throw new Error(`No interactive element found at index ${index}`)
|
||||||
}
|
}
|
||||||
@@ -170,7 +161,6 @@ export async function selectOptionElement(selectElement: HTMLSelectElement, opti
|
|||||||
await waitFor(0.1) // Wait to ensure change event processing completes
|
await waitFor(0.1) // Wait to ensure change event processing completes
|
||||||
}
|
}
|
||||||
|
|
||||||
// eslint-disable-next-line @typescript-eslint/require-await
|
|
||||||
export async function scrollIntoViewIfNeeded(element: HTMLElement) {
|
export async function scrollIntoViewIfNeeded(element: HTMLElement) {
|
||||||
const el = element as any
|
const el = element as any
|
||||||
if (el.scrollIntoViewIfNeeded) {
|
if (el.scrollIntoViewIfNeeded) {
|
||||||
@@ -0,0 +1,16 @@
|
|||||||
|
/**
|
||||||
|
* Copyright (C) 2025 Alibaba Group Holding Limited
|
||||||
|
* All rights reserved.
|
||||||
|
*/
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Viewport expansion for DOM tree extraction.
|
||||||
|
* -1 means full page (no viewport restriction)
|
||||||
|
* 0 means viewport only
|
||||||
|
* positive values expand the viewport by that many pixels
|
||||||
|
*
|
||||||
|
* @note Since isTopElement depends on elementFromPoint,
|
||||||
|
* it returns null when out of viewport, this feature has no practical use, only differ between -1 and 0
|
||||||
|
*/
|
||||||
|
// export const VIEWPORT_EXPANSION = 100
|
||||||
|
export const VIEWPORT_EXPANSION = -1
|
||||||
@@ -1,11 +1,11 @@
|
|||||||
import { VIEWPORT_EXPANSION } from '@/config/constants'
|
import { VIEWPORT_EXPANSION } from '../constants'
|
||||||
import domTree from '@/dom/dom_tree/index'
|
import domTree from './dom_tree/index.js'
|
||||||
import {
|
import {
|
||||||
ElementDomNode,
|
ElementDomNode,
|
||||||
FlatDomTree,
|
FlatDomTree,
|
||||||
InteractiveElementDomNode,
|
InteractiveElementDomNode,
|
||||||
TextDomNode,
|
TextDomNode,
|
||||||
} from '@/dom/dom_tree/type'
|
} from './dom_tree/type'
|
||||||
|
|
||||||
export interface DomConfig {
|
export interface DomConfig {
|
||||||
interactiveBlacklist?: (Element | (() => Element))[]
|
interactiveBlacklist?: (Element | (() => Element))[]
|
||||||
@@ -1,4 +1,4 @@
|
|||||||
import type { PageAgent } from '@/PageAgent'
|
import type { PageController } from '../PageController'
|
||||||
|
|
||||||
const clearFunctions = [] as (() => void)[]
|
const clearFunctions = [] as (() => void)[]
|
||||||
|
|
||||||
@@ -11,9 +11,9 @@ function fixAntdSelect() {
|
|||||||
// for (const select of selects) {}
|
// for (const select of selects) {}
|
||||||
}
|
}
|
||||||
|
|
||||||
export function patchAntd(pageAgent: PageAgent) {
|
export function patchAntd(pageController: PageController) {
|
||||||
pageAgent.addEventListener('beforeUpdate', fixAntdSelect)
|
pageController.addEventListener('beforeUpdate', fixAntdSelect)
|
||||||
pageAgent.addEventListener('afterUpdate', () => {
|
pageController.addEventListener('afterUpdate', () => {
|
||||||
for (const fn of clearFunctions) fn()
|
for (const fn of clearFunctions) fn()
|
||||||
clearFunctions.length = 0
|
clearFunctions.length = 0
|
||||||
})
|
})
|
||||||
@@ -1,7 +1,7 @@
|
|||||||
import type { PageAgent } from '@/PageAgent'
|
import type { PageController } from '../PageController'
|
||||||
|
|
||||||
// Find common React root elements and add data-page-agent-not-interactive attribute
|
// Find common React root elements and add data-page-agent-not-interactive attribute
|
||||||
export function patchReact(pageAgent: PageAgent) {
|
export function patchReact(pageController: PageController) {
|
||||||
const reactRootElements = document.querySelectorAll(
|
const reactRootElements = document.querySelectorAll(
|
||||||
'[data-reactroot], [data-reactid], [data-react-checksum], #root, #app, [id^="root-"], [id^="app-"], #adex-wrapper, #adex-root'
|
'[data-reactroot], [data-reactid], [data-react-checksum], #root, #app, [id^="root-"], [id^="app-"], #adex-wrapper, #adex-root'
|
||||||
)
|
)
|
||||||
@@ -0,0 +1,9 @@
|
|||||||
|
{
|
||||||
|
"extends": "./tsconfig.json",
|
||||||
|
"compilerOptions": {
|
||||||
|
// @workaround DTS bug
|
||||||
|
// dts do not work with monorepo path mapping
|
||||||
|
// disable path mapping for it
|
||||||
|
"paths": {}
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,12 @@
|
|||||||
|
{
|
||||||
|
"extends": "../../tsconfig.base.json",
|
||||||
|
"compilerOptions": {
|
||||||
|
"tsBuildInfoFile": "./node_modules/.tmp/tsconfig.tsbuildinfo",
|
||||||
|
"noEmit": false,
|
||||||
|
"allowImportingTsExtensions": false,
|
||||||
|
"baseUrl": ".",
|
||||||
|
"outDir": "dist"
|
||||||
|
},
|
||||||
|
"include": ["**/*.ts", "**/*.js"],
|
||||||
|
"exclude": ["dist", "node_modules"]
|
||||||
|
}
|
||||||
@@ -0,0 +1,41 @@
|
|||||||
|
// @ts-check
|
||||||
|
import chalk from 'chalk'
|
||||||
|
import { dirname, resolve } from 'path'
|
||||||
|
import dts from 'unplugin-dts/vite'
|
||||||
|
import { fileURLToPath } from 'url'
|
||||||
|
import { defineConfig } from 'vite'
|
||||||
|
import cssInjectedByJsPlugin from 'vite-plugin-css-injected-by-js'
|
||||||
|
|
||||||
|
const __dirname = dirname(fileURLToPath(import.meta.url))
|
||||||
|
|
||||||
|
console.log(chalk.cyan(`📦 Building @page-agent/page-controller`))
|
||||||
|
|
||||||
|
export default defineConfig({
|
||||||
|
clearScreen: false,
|
||||||
|
plugins: [
|
||||||
|
dts({ tsconfigPath: './tsconfig.dts.json', bundleTypes: true }),
|
||||||
|
cssInjectedByJsPlugin({ relativeCSSInjection: true }),
|
||||||
|
],
|
||||||
|
publicDir: false,
|
||||||
|
esbuild: {
|
||||||
|
keepNames: true,
|
||||||
|
},
|
||||||
|
build: {
|
||||||
|
lib: {
|
||||||
|
entry: resolve(__dirname, 'src/PageController.ts'),
|
||||||
|
name: 'PageController',
|
||||||
|
fileName: 'page-controller',
|
||||||
|
formats: ['es'],
|
||||||
|
},
|
||||||
|
outDir: resolve(__dirname, 'dist', 'lib'),
|
||||||
|
rollupOptions: {
|
||||||
|
external: ['@page-agent/*'],
|
||||||
|
},
|
||||||
|
minify: false,
|
||||||
|
sourcemap: true,
|
||||||
|
cssCodeSplit: true,
|
||||||
|
},
|
||||||
|
define: {
|
||||||
|
'process.env.NODE_ENV': '"production"',
|
||||||
|
},
|
||||||
|
})
|
||||||
@@ -0,0 +1,41 @@
|
|||||||
|
{
|
||||||
|
"name": "@page-agent/ui",
|
||||||
|
"version": "0.0.11",
|
||||||
|
"type": "module",
|
||||||
|
"main": "./dist/lib/page-agent-ui.js",
|
||||||
|
"module": "./dist/lib/page-agent-ui.js",
|
||||||
|
"types": "./dist/lib/index.d.ts",
|
||||||
|
"exports": {
|
||||||
|
".": {
|
||||||
|
"types": "./dist/lib/index.d.ts",
|
||||||
|
"import": "./dist/lib/page-agent-ui.js",
|
||||||
|
"default": "./dist/lib/page-agent-ui.js"
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"files": [
|
||||||
|
"dist/"
|
||||||
|
],
|
||||||
|
"description": "UI components for page-agent - Panel, SimulatorMask, and i18n",
|
||||||
|
"keywords": [
|
||||||
|
"page-agent",
|
||||||
|
"ui",
|
||||||
|
"panel",
|
||||||
|
"i18n"
|
||||||
|
],
|
||||||
|
"author": "Simon<gaomeng1900>",
|
||||||
|
"license": "MIT",
|
||||||
|
"repository": {
|
||||||
|
"type": "git",
|
||||||
|
"url": "https://github.com/alibaba/page-agent.git",
|
||||||
|
"directory": "packages/ui"
|
||||||
|
},
|
||||||
|
"homepage": "https://alibaba.github.io/page-agent/",
|
||||||
|
"scripts": {
|
||||||
|
"build": "vite build",
|
||||||
|
"prepublishOnly": "node -e \"const fs=require('fs');['LICENSE'].forEach(f=>fs.copyFileSync('../../'+f,f))\"",
|
||||||
|
"postpublish": "node -e \"['LICENSE'].forEach(f=>{try{require('fs').unlinkSync(f)}catch{}})\""
|
||||||
|
},
|
||||||
|
"dependencies": {
|
||||||
|
"ai-motion": "^0.4.7"
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -1,12 +1,35 @@
|
|||||||
import type { PageAgent } from '@/PageAgent'
|
|
||||||
import type { I18n } from '@/i18n'
|
|
||||||
import { truncate } from '@/utils'
|
|
||||||
import type { EventBus } from '@/utils/bus'
|
|
||||||
|
|
||||||
import { type Step, UIState } from './UIState'
|
import { type Step, UIState } from './UIState'
|
||||||
|
import { I18n, type SupportedLanguage } from './i18n'
|
||||||
|
import { truncate } from './utils'
|
||||||
|
|
||||||
import styles from './Panel.module.css'
|
import styles from './Panel.module.css'
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Panel configuration
|
||||||
|
*/
|
||||||
|
export interface PanelConfig {
|
||||||
|
language?: SupportedLanguage
|
||||||
|
onExecuteTask: (task: string) => void
|
||||||
|
onStop: () => void
|
||||||
|
onPauseToggle: () => boolean // returns new paused state
|
||||||
|
getPaused: () => boolean
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Semantic update types - Panel handles i18n internally
|
||||||
|
*/
|
||||||
|
export type PanelUpdate =
|
||||||
|
| { type: 'thinking'; text?: string } // text is optional, defaults to i18n thinking text
|
||||||
|
| { type: 'input'; task: string }
|
||||||
|
| { type: 'question'; question: string }
|
||||||
|
| { type: 'userAnswer'; input: string }
|
||||||
|
| { type: 'retry'; current: number; max: number }
|
||||||
|
| { type: 'error'; message: string }
|
||||||
|
| { type: 'output'; text: string }
|
||||||
|
| { type: 'completed' }
|
||||||
|
| { type: 'toolExecuting'; toolName: string; args: any }
|
||||||
|
| { type: 'toolCompleted'; toolName: string; args: any; result?: string; duration?: number }
|
||||||
|
|
||||||
/**
|
/**
|
||||||
* Agent control panel
|
* Agent control panel
|
||||||
*/
|
*/
|
||||||
@@ -20,11 +43,11 @@ export class Panel {
|
|||||||
#stopButton: HTMLElement
|
#stopButton: HTMLElement
|
||||||
#inputSection: HTMLElement
|
#inputSection: HTMLElement
|
||||||
#taskInput: HTMLInputElement
|
#taskInput: HTMLInputElement
|
||||||
#bus: EventBus
|
|
||||||
|
|
||||||
#state = new UIState()
|
#state = new UIState()
|
||||||
#isExpanded = false
|
#isExpanded = false
|
||||||
#pageAgent: PageAgent
|
#config: PanelConfig
|
||||||
|
#i18n: I18n
|
||||||
#userAnswerResolver: ((input: string) => void) | null = null
|
#userAnswerResolver: ((input: string) => void) | null = null
|
||||||
#isWaitingForUserAnswer: boolean = false
|
#isWaitingForUserAnswer: boolean = false
|
||||||
#headerUpdateTimer: ReturnType<typeof setInterval> | null = null
|
#headerUpdateTimer: ReturnType<typeof setInterval> | null = null
|
||||||
@@ -35,9 +58,9 @@ export class Panel {
|
|||||||
return this.#wrapper
|
return this.#wrapper
|
||||||
}
|
}
|
||||||
|
|
||||||
constructor(pageAgent: PageAgent) {
|
constructor(config: PanelConfig) {
|
||||||
this.#pageAgent = pageAgent
|
this.#config = config
|
||||||
this.#bus = pageAgent.bus
|
this.#i18n = new I18n(config.language ?? 'en-US')
|
||||||
this.#wrapper = this.#createWrapper()
|
this.#wrapper = this.#createWrapper()
|
||||||
this.#indicator = this.#wrapper.querySelector(`.${styles.indicator}`)!
|
this.#indicator = this.#wrapper.querySelector(`.${styles.indicator}`)!
|
||||||
this.#statusText = this.#wrapper.querySelector(`.${styles.statusText}`)!
|
this.#statusText = this.#wrapper.querySelector(`.${styles.statusText}`)!
|
||||||
@@ -50,16 +73,8 @@ export class Panel {
|
|||||||
|
|
||||||
this.#setupEventListeners()
|
this.#setupEventListeners()
|
||||||
this.#startHeaderUpdateLoop()
|
this.#startHeaderUpdateLoop()
|
||||||
// this.#expand() // debug
|
|
||||||
|
|
||||||
this.#showInputArea()
|
this.#showInputArea()
|
||||||
|
|
||||||
this.#bus.on('panel:show', () => this.#show())
|
|
||||||
this.#bus.on('panel:hide', () => this.#hide())
|
|
||||||
this.#bus.on('panel:reset', () => this.#reset())
|
|
||||||
this.#bus.on('panel:update', (stepData) => this.#update(stepData))
|
|
||||||
this.#bus.on('panel:expand', () => this.#expand())
|
|
||||||
this.#bus.on('panel:collapse', () => this.#collapse())
|
|
||||||
}
|
}
|
||||||
|
|
||||||
/**
|
/**
|
||||||
@@ -72,18 +87,67 @@ export class Panel {
|
|||||||
this.#userAnswerResolver = resolve
|
this.#userAnswerResolver = resolve
|
||||||
|
|
||||||
// Update state to `running`
|
// Update state to `running`
|
||||||
this.#update({
|
this.#updateInternal({
|
||||||
type: 'output',
|
type: 'output',
|
||||||
displayText: this.#pageAgent.i18n.t('ui.panel.question', { question }),
|
displayText: this.#i18n.t('ui.panel.question', { question }),
|
||||||
}) // Expand history panel
|
}) // Expand history panel
|
||||||
if (!this.#isExpanded) {
|
if (!this.#isExpanded) {
|
||||||
this.#expand()
|
this.#expand()
|
||||||
}
|
}
|
||||||
|
|
||||||
this.#showInputArea(this.#pageAgent.i18n.t('ui.panel.userAnswerPrompt'))
|
this.#showInputArea(this.#i18n.t('ui.panel.userAnswerPrompt'))
|
||||||
})
|
})
|
||||||
}
|
}
|
||||||
|
|
||||||
|
// ========== Public control methods ==========
|
||||||
|
|
||||||
|
show(): void {
|
||||||
|
this.wrapper.style.display = 'block'
|
||||||
|
void this.wrapper.offsetHeight
|
||||||
|
this.wrapper.style.opacity = '1'
|
||||||
|
this.wrapper.style.transform = 'translateX(-50%) translateY(0)'
|
||||||
|
}
|
||||||
|
|
||||||
|
hide(): void {
|
||||||
|
this.wrapper.style.opacity = '0'
|
||||||
|
this.wrapper.style.transform = 'translateX(-50%) translateY(20px)'
|
||||||
|
this.wrapper.style.display = 'none'
|
||||||
|
}
|
||||||
|
|
||||||
|
reset(): void {
|
||||||
|
this.#state.reset()
|
||||||
|
this.#statusText.textContent = this.#i18n.t('ui.panel.ready')
|
||||||
|
this.#updateStatusIndicator('thinking')
|
||||||
|
this.#updateHistory()
|
||||||
|
this.#collapse()
|
||||||
|
// Reset pause state via callback
|
||||||
|
if (this.#config.getPaused()) {
|
||||||
|
this.#config.onPauseToggle()
|
||||||
|
}
|
||||||
|
this.#updatePauseButton()
|
||||||
|
// Reset user input state
|
||||||
|
this.#isWaitingForUserAnswer = false
|
||||||
|
this.#userAnswerResolver = null
|
||||||
|
// Show input area
|
||||||
|
this.#showInputArea()
|
||||||
|
}
|
||||||
|
|
||||||
|
expand(): void {
|
||||||
|
this.#expand()
|
||||||
|
}
|
||||||
|
|
||||||
|
collapse(): void {
|
||||||
|
this.#collapse()
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Update panel with semantic data - i18n handled internally
|
||||||
|
*/
|
||||||
|
update(data: PanelUpdate): void {
|
||||||
|
const stepData = this.#toStepData(data)
|
||||||
|
this.#updateInternal(stepData)
|
||||||
|
}
|
||||||
|
|
||||||
/**
|
/**
|
||||||
* Dispose panel
|
* Dispose panel
|
||||||
*/
|
*/
|
||||||
@@ -93,10 +157,102 @@ export class Panel {
|
|||||||
this.wrapper.remove()
|
this.wrapper.remove()
|
||||||
}
|
}
|
||||||
|
|
||||||
|
// ========== Private methods ==========
|
||||||
|
|
||||||
/**
|
/**
|
||||||
* Update status
|
* Convert semantic update to step data with i18n
|
||||||
*/
|
*/
|
||||||
#update(stepData: Omit<Step, 'id' | 'stepNumber' | 'timestamp'>): void {
|
#toStepData(data: PanelUpdate): Omit<Step, 'id' | 'stepNumber' | 'timestamp'> {
|
||||||
|
switch (data.type) {
|
||||||
|
case 'thinking':
|
||||||
|
return { type: 'thinking', displayText: data.text ?? this.#i18n.t('ui.panel.thinking') }
|
||||||
|
case 'input':
|
||||||
|
return { type: 'input', displayText: data.task }
|
||||||
|
case 'question':
|
||||||
|
return {
|
||||||
|
type: 'output',
|
||||||
|
displayText: this.#i18n.t('ui.panel.question', { question: data.question }),
|
||||||
|
}
|
||||||
|
case 'userAnswer':
|
||||||
|
return {
|
||||||
|
type: 'input',
|
||||||
|
displayText: this.#i18n.t('ui.panel.userAnswer', { input: data.input }),
|
||||||
|
}
|
||||||
|
case 'retry':
|
||||||
|
return { type: 'retry', displayText: `retry-ing (${data.current} / ${data.max})` }
|
||||||
|
case 'error':
|
||||||
|
return { type: 'error', displayText: data.message }
|
||||||
|
case 'output':
|
||||||
|
return { type: 'output', displayText: data.text }
|
||||||
|
case 'completed':
|
||||||
|
return { type: 'completed', displayText: this.#i18n.t('ui.panel.taskCompleted') }
|
||||||
|
case 'toolExecuting':
|
||||||
|
return {
|
||||||
|
type: 'tool_executing',
|
||||||
|
toolName: data.toolName,
|
||||||
|
toolArgs: data.args,
|
||||||
|
displayText: this.#getToolExecutingText(data.toolName, data.args),
|
||||||
|
}
|
||||||
|
case 'toolCompleted': {
|
||||||
|
const displayText = this.#getToolCompletedText(data.toolName, data.args)
|
||||||
|
if (!displayText) return { type: 'tool_executing', displayText: '' } // will be filtered
|
||||||
|
return {
|
||||||
|
type: 'tool_executing',
|
||||||
|
toolName: data.toolName,
|
||||||
|
toolArgs: data.args,
|
||||||
|
toolResult: data.result,
|
||||||
|
displayText,
|
||||||
|
duration: data.duration,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#getToolExecutingText(toolName: string, args: any): string {
|
||||||
|
switch (toolName) {
|
||||||
|
case 'click_element_by_index':
|
||||||
|
return this.#i18n.t('ui.tools.clicking', { index: args.index })
|
||||||
|
case 'input_text':
|
||||||
|
return this.#i18n.t('ui.tools.inputting', { index: args.index })
|
||||||
|
case 'select_dropdown_option':
|
||||||
|
return this.#i18n.t('ui.tools.selecting', { text: args.text })
|
||||||
|
case 'scroll':
|
||||||
|
return this.#i18n.t('ui.tools.scrolling')
|
||||||
|
case 'wait':
|
||||||
|
return this.#i18n.t('ui.tools.waiting', { seconds: args.seconds })
|
||||||
|
case 'done':
|
||||||
|
return this.#i18n.t('ui.tools.done')
|
||||||
|
default:
|
||||||
|
return this.#i18n.t('ui.tools.executing', { toolName })
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#getToolCompletedText(toolName: string, args: any): string | null {
|
||||||
|
switch (toolName) {
|
||||||
|
case 'click_element_by_index':
|
||||||
|
return this.#i18n.t('ui.tools.clicked', { index: args.index })
|
||||||
|
case 'input_text':
|
||||||
|
return this.#i18n.t('ui.tools.inputted', { text: args.text })
|
||||||
|
case 'select_dropdown_option':
|
||||||
|
return this.#i18n.t('ui.tools.selected', { text: args.text })
|
||||||
|
case 'scroll':
|
||||||
|
return this.#i18n.t('ui.tools.scrolled')
|
||||||
|
case 'wait':
|
||||||
|
return this.#i18n.t('ui.tools.waited')
|
||||||
|
case 'done':
|
||||||
|
return null
|
||||||
|
default:
|
||||||
|
return null
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
/**
|
||||||
|
* Update status (internal)
|
||||||
|
*/
|
||||||
|
#updateInternal(stepData: Omit<Step, 'id' | 'stepNumber' | 'timestamp'>): void {
|
||||||
|
// Skip empty displayText (filtered toolCompleted for 'done')
|
||||||
|
if (!stepData.displayText) return
|
||||||
|
|
||||||
const step = this.#state.addStep(stepData)
|
const step = this.#state.addStep(stepData)
|
||||||
|
|
||||||
// Queue header text update (will be processed by periodic check)
|
// Queue header text update (will be processed by periodic check)
|
||||||
@@ -121,59 +277,20 @@ export class Panel {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
/**
|
|
||||||
* Show panel
|
|
||||||
*/
|
|
||||||
#show(): void {
|
|
||||||
this.wrapper.style.display = 'block'
|
|
||||||
// Force reflow to trigger animation
|
|
||||||
void this.wrapper.offsetHeight
|
|
||||||
this.wrapper.style.opacity = '1'
|
|
||||||
this.wrapper.style.transform = 'translateX(-50%) translateY(0)'
|
|
||||||
}
|
|
||||||
|
|
||||||
/**
|
|
||||||
* Hide panel
|
|
||||||
*/
|
|
||||||
#hide(): void {
|
|
||||||
this.wrapper.style.opacity = '0'
|
|
||||||
this.wrapper.style.transform = 'translateX(-50%) translateY(20px)'
|
|
||||||
this.wrapper.style.display = 'none'
|
|
||||||
}
|
|
||||||
|
|
||||||
/**
|
|
||||||
* Reset state
|
|
||||||
*/
|
|
||||||
#reset(): void {
|
|
||||||
this.#state.reset()
|
|
||||||
this.#statusText.textContent = this.#pageAgent.i18n.t('ui.panel.ready')
|
|
||||||
this.#updateStatusIndicator('thinking')
|
|
||||||
this.#updateHistory()
|
|
||||||
this.#collapse()
|
|
||||||
// Reset pause state
|
|
||||||
this.#pageAgent.paused = false
|
|
||||||
this.#updatePauseButton()
|
|
||||||
// Reset user input state
|
|
||||||
this.#isWaitingForUserAnswer = false
|
|
||||||
this.#userAnswerResolver = null
|
|
||||||
// Show input area
|
|
||||||
this.#showInputArea()
|
|
||||||
}
|
|
||||||
|
|
||||||
/**
|
/**
|
||||||
* Toggle pause state
|
* Toggle pause state
|
||||||
*/
|
*/
|
||||||
#togglePause(): void {
|
#togglePause(): void {
|
||||||
this.#pageAgent.paused = !this.#pageAgent.paused
|
const paused = this.#config.onPauseToggle()
|
||||||
this.#updatePauseButton()
|
this.#updatePauseButton()
|
||||||
|
|
||||||
// Update status display
|
// Update status display
|
||||||
if (this.#pageAgent.paused) {
|
if (paused) {
|
||||||
this.#statusText.textContent = this.#pageAgent.i18n.t('ui.panel.paused')
|
this.#statusText.textContent = this.#i18n.t('ui.panel.paused')
|
||||||
this.#updateStatusIndicator('thinking') // Use existing thinking state
|
this.#updateStatusIndicator('thinking')
|
||||||
} else {
|
} else {
|
||||||
this.#statusText.textContent = this.#pageAgent.i18n.t('ui.panel.continueExecution')
|
this.#statusText.textContent = this.#i18n.t('ui.panel.continueExecution')
|
||||||
this.#updateStatusIndicator('tool_executing') // Restore to execution state
|
this.#updateStatusIndicator('tool_executing')
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -181,13 +298,14 @@ export class Panel {
|
|||||||
* Update pause button state
|
* Update pause button state
|
||||||
*/
|
*/
|
||||||
#updatePauseButton(): void {
|
#updatePauseButton(): void {
|
||||||
if (this.#pageAgent.paused) {
|
const paused = this.#config.getPaused()
|
||||||
|
if (paused) {
|
||||||
this.#pauseButton.textContent = '▶'
|
this.#pauseButton.textContent = '▶'
|
||||||
this.#pauseButton.title = this.#pageAgent.i18n.t('ui.panel.continue')
|
this.#pauseButton.title = this.#i18n.t('ui.panel.continue')
|
||||||
this.#pauseButton.classList.add(styles.paused)
|
this.#pauseButton.classList.add(styles.paused)
|
||||||
} else {
|
} else {
|
||||||
this.#pauseButton.textContent = '⏸︎'
|
this.#pauseButton.textContent = '⏸︎'
|
||||||
this.#pauseButton.title = this.#pageAgent.i18n.t('ui.panel.pause')
|
this.#pauseButton.title = this.#i18n.t('ui.panel.pause')
|
||||||
this.#pauseButton.classList.remove(styles.paused)
|
this.#pauseButton.classList.remove(styles.paused)
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
@@ -197,12 +315,12 @@ export class Panel {
|
|||||||
*/
|
*/
|
||||||
#stopAgent(): void {
|
#stopAgent(): void {
|
||||||
// Update status display
|
// Update status display
|
||||||
this.#update({
|
this.#updateInternal({
|
||||||
type: 'error',
|
type: 'error',
|
||||||
displayText: this.#pageAgent.i18n.t('ui.panel.taskTerminated'),
|
displayText: this.#i18n.t('ui.panel.taskTerminated'),
|
||||||
})
|
})
|
||||||
|
|
||||||
this.#pageAgent.dispose()
|
this.#config.onStop()
|
||||||
}
|
}
|
||||||
|
|
||||||
/**
|
/**
|
||||||
@@ -219,7 +337,7 @@ export class Panel {
|
|||||||
// Handle user input mode
|
// Handle user input mode
|
||||||
this.#handleUserAnswer(input)
|
this.#handleUserAnswer(input)
|
||||||
} else {
|
} else {
|
||||||
this.#pageAgent.execute(input)
|
this.#config.onExecuteTask(input)
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -228,9 +346,9 @@ export class Panel {
|
|||||||
*/
|
*/
|
||||||
#handleUserAnswer(input: string): void {
|
#handleUserAnswer(input: string): void {
|
||||||
// Add user input to history
|
// Add user input to history
|
||||||
this.#update({
|
this.#updateInternal({
|
||||||
type: 'input',
|
type: 'input',
|
||||||
displayText: this.#pageAgent.i18n.t('ui.panel.userAnswer', { input }),
|
displayText: this.#i18n.t('ui.panel.userAnswer', { input }),
|
||||||
})
|
})
|
||||||
|
|
||||||
// Reset state
|
// Reset state
|
||||||
@@ -249,7 +367,7 @@ export class Panel {
|
|||||||
#showInputArea(placeholder?: string): void {
|
#showInputArea(placeholder?: string): void {
|
||||||
// Clear input field
|
// Clear input field
|
||||||
this.#taskInput.value = ''
|
this.#taskInput.value = ''
|
||||||
this.#taskInput.placeholder = placeholder || this.#pageAgent.i18n.t('ui.panel.taskInput')
|
this.#taskInput.placeholder = placeholder || this.#i18n.t('ui.panel.taskInput')
|
||||||
this.#inputSection.classList.remove(styles.hidden)
|
this.#inputSection.classList.remove(styles.hidden)
|
||||||
// Focus on input field
|
// Focus on input field
|
||||||
setTimeout(() => {
|
setTimeout(() => {
|
||||||
@@ -295,23 +413,23 @@ export class Panel {
|
|||||||
stepNumber: 0,
|
stepNumber: 0,
|
||||||
timestamp: new Date(),
|
timestamp: new Date(),
|
||||||
type: 'thinking',
|
type: 'thinking',
|
||||||
displayText: this.#pageAgent.i18n.t('ui.panel.waitingPlaceholder'),
|
displayText: this.#i18n.t('ui.panel.waitingPlaceholder'),
|
||||||
})}
|
})}
|
||||||
</div>
|
</div>
|
||||||
</div>
|
</div>
|
||||||
<div class="${styles.header}">
|
<div class="${styles.header}">
|
||||||
<div class="${styles.statusSection}">
|
<div class="${styles.statusSection}">
|
||||||
<div class="${styles.indicator} ${styles.thinking}"></div>
|
<div class="${styles.indicator} ${styles.thinking}"></div>
|
||||||
<div class="${styles.statusText}">${this.#pageAgent.i18n.t('ui.panel.ready')}</div>
|
<div class="${styles.statusText}">${this.#i18n.t('ui.panel.ready')}</div>
|
||||||
</div>
|
</div>
|
||||||
<div class="${styles.controls}">
|
<div class="${styles.controls}">
|
||||||
<button class="${styles.controlButton} ${styles.expandButton}" title="${this.#pageAgent.i18n.t('ui.panel.expand')}">
|
<button class="${styles.controlButton} ${styles.expandButton}" title="${this.#i18n.t('ui.panel.expand')}">
|
||||||
▼
|
▼
|
||||||
</button>
|
</button>
|
||||||
<button class="${styles.controlButton} ${styles.pauseButton}" title="${this.#pageAgent.i18n.t('ui.panel.pause')}">
|
<button class="${styles.controlButton} ${styles.pauseButton}" title="${this.#i18n.t('ui.panel.pause')}">
|
||||||
⏸︎
|
⏸︎
|
||||||
</button>
|
</button>
|
||||||
<button class="${styles.controlButton} ${styles.stopButton}" title="${this.#pageAgent.i18n.t('ui.panel.stop')}">
|
<button class="${styles.controlButton} ${styles.stopButton}" title="${this.#i18n.t('ui.panel.stop')}">
|
||||||
X
|
X
|
||||||
</button>
|
</button>
|
||||||
</div>
|
</div>
|
||||||
@@ -502,8 +620,8 @@ export class Panel {
|
|||||||
// Check if this is a result from done tool
|
// Check if this is a result from done tool
|
||||||
if (step.toolName === 'done') {
|
if (step.toolName === 'done') {
|
||||||
// Judge success or failure based on result
|
// Judge success or failure based on result
|
||||||
const failureKeyword = this.#pageAgent.i18n.t('ui.tools.resultFailure')
|
const failureKeyword = this.#i18n.t('ui.tools.resultFailure')
|
||||||
const errorKeyword = this.#pageAgent.i18n.t('ui.tools.resultError')
|
const errorKeyword = this.#i18n.t('ui.tools.resultError')
|
||||||
const isSuccess =
|
const isSuccess =
|
||||||
!step.toolResult ||
|
!step.toolResult ||
|
||||||
(!step.toolResult.includes(failureKeyword) && !step.toolResult.includes(errorKeyword))
|
(!step.toolResult.includes(failureKeyword) && !step.toolResult.includes(errorKeyword))
|
||||||
@@ -532,7 +650,7 @@ export class Panel {
|
|||||||
}
|
}
|
||||||
|
|
||||||
const durationText = step.duration ? ` · ${step.duration}ms` : ''
|
const durationText = step.duration ? ` · ${step.duration}ms` : ''
|
||||||
const stepLabel = this.#pageAgent.i18n.t('ui.panel.step', {
|
const stepLabel = this.#i18n.t('ui.panel.step', {
|
||||||
number: step.stepNumber.toString(),
|
number: step.stepNumber.toString(),
|
||||||
time,
|
time,
|
||||||
duration: durationText || '', // Explicitly pass empty string to replace template
|
duration: durationText || '', // Explicitly pass empty string to replace template
|
||||||
@@ -551,47 +669,3 @@ export class Panel {
|
|||||||
`
|
`
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
/**
|
|
||||||
* Get display text for tool execution
|
|
||||||
*/
|
|
||||||
export function getToolExecutingText(toolName: string, args: any, i18n: I18n): string {
|
|
||||||
switch (toolName) {
|
|
||||||
case 'click_element_by_index':
|
|
||||||
return i18n.t('ui.tools.clicking', { index: args.index })
|
|
||||||
case 'input_text':
|
|
||||||
return i18n.t('ui.tools.inputting', { index: args.index })
|
|
||||||
case 'select_dropdown_option':
|
|
||||||
return i18n.t('ui.tools.selecting', { text: args.text })
|
|
||||||
case 'scroll':
|
|
||||||
return i18n.t('ui.tools.scrolling')
|
|
||||||
case 'wait':
|
|
||||||
return i18n.t('ui.tools.waiting', { seconds: args.seconds })
|
|
||||||
case 'done':
|
|
||||||
return i18n.t('ui.tools.done')
|
|
||||||
default:
|
|
||||||
return i18n.t('ui.tools.executing', { toolName })
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
/**
|
|
||||||
* Get display text for tool completion
|
|
||||||
*/
|
|
||||||
export function getToolCompletedText(toolName: string, args: any, i18n: I18n): string | null {
|
|
||||||
switch (toolName) {
|
|
||||||
case 'click_element_by_index':
|
|
||||||
return i18n.t('ui.tools.clicked', { index: args.index })
|
|
||||||
case 'input_text':
|
|
||||||
return i18n.t('ui.tools.inputted', { text: args.text })
|
|
||||||
case 'select_dropdown_option':
|
|
||||||
return i18n.t('ui.tools.selected', { text: args.text })
|
|
||||||
case 'scroll':
|
|
||||||
return i18n.t('ui.tools.scrolled')
|
|
||||||
case 'wait':
|
|
||||||
return i18n.t('ui.tools.waited')
|
|
||||||
case 'done':
|
|
||||||
return null
|
|
||||||
default:
|
|
||||||
return null
|
|
||||||
}
|
|
||||||
}
|
|
||||||
@@ -1,6 +1,6 @@
|
|||||||
import { Motion } from 'ai-motion'
|
import { Motion } from 'ai-motion'
|
||||||
|
|
||||||
import { isPageDark } from '@/utils/checkDarkMode'
|
import { isPageDark } from './checkDarkMode'
|
||||||
|
|
||||||
import styles from './SimulatorMask.module.css'
|
import styles from './SimulatorMask.module.css'
|
||||||
import cursorStyles from './cursor.module.css'
|
import cursorStyles from './cursor.module.css'
|
||||||
Vendored
+6
@@ -0,0 +1,6 @@
|
|||||||
|
/// <reference types="vite/client" />
|
||||||
|
|
||||||
|
declare module '*.module.css' {
|
||||||
|
const classes: Record<string, string>
|
||||||
|
export default classes
|
||||||
|
}
|
||||||
@@ -0,0 +1,4 @@
|
|||||||
|
export { Panel, type PanelConfig, type PanelUpdate } from './Panel'
|
||||||
|
export { SimulatorMask } from './SimulatorMask'
|
||||||
|
export { UIState, type Step, type AgentStatus } from './UIState'
|
||||||
|
export { I18n, type SupportedLanguage, type TranslationKey } from './i18n'
|
||||||
@@ -0,0 +1,6 @@
|
|||||||
|
export function truncate(text: string, maxLength: number): string {
|
||||||
|
if (text.length > maxLength) {
|
||||||
|
return text.substring(0, maxLength) + '...'
|
||||||
|
}
|
||||||
|
return text
|
||||||
|
}
|
||||||
@@ -0,0 +1,10 @@
|
|||||||
|
{
|
||||||
|
"extends": "./tsconfig.json",
|
||||||
|
"compilerOptions": {
|
||||||
|
// @workaround DTS bug
|
||||||
|
// dts do not work with monorepo path mapping
|
||||||
|
// disable path mapping for it
|
||||||
|
"paths": {}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
@@ -0,0 +1,13 @@
|
|||||||
|
{
|
||||||
|
"extends": "../../tsconfig.base.json",
|
||||||
|
"compilerOptions": {
|
||||||
|
"tsBuildInfoFile": "./node_modules/.tmp/tsconfig.tsbuildinfo",
|
||||||
|
"noEmit": false,
|
||||||
|
"allowImportingTsExtensions": false,
|
||||||
|
"baseUrl": ".",
|
||||||
|
"outDir": "dist"
|
||||||
|
},
|
||||||
|
"include": ["**/*.ts", "**/*.js"],
|
||||||
|
"exclude": ["dist", "node_modules"]
|
||||||
|
}
|
||||||
|
|
||||||
@@ -0,0 +1,41 @@
|
|||||||
|
// @ts-check
|
||||||
|
import chalk from 'chalk'
|
||||||
|
import { dirname, resolve } from 'path'
|
||||||
|
import dts from 'unplugin-dts/vite'
|
||||||
|
import { fileURLToPath } from 'url'
|
||||||
|
import { defineConfig } from 'vite'
|
||||||
|
import cssInjectedByJsPlugin from 'vite-plugin-css-injected-by-js'
|
||||||
|
|
||||||
|
const __dirname = dirname(fileURLToPath(import.meta.url))
|
||||||
|
|
||||||
|
console.log(chalk.cyan(`📦 Building @page-agent/ui`))
|
||||||
|
|
||||||
|
export default defineConfig({
|
||||||
|
clearScreen: false,
|
||||||
|
plugins: [
|
||||||
|
dts({ tsconfigPath: './tsconfig.dts.json', bundleTypes: true }),
|
||||||
|
cssInjectedByJsPlugin({ relativeCSSInjection: true }),
|
||||||
|
],
|
||||||
|
publicDir: false,
|
||||||
|
esbuild: {
|
||||||
|
keepNames: true,
|
||||||
|
},
|
||||||
|
build: {
|
||||||
|
lib: {
|
||||||
|
entry: resolve(__dirname, 'src/index.ts'),
|
||||||
|
name: 'PageAgentUI',
|
||||||
|
fileName: 'page-agent-ui',
|
||||||
|
formats: ['es'],
|
||||||
|
},
|
||||||
|
outDir: resolve(__dirname, 'dist', 'lib'),
|
||||||
|
rollupOptions: {
|
||||||
|
external: ['ai-motion'],
|
||||||
|
},
|
||||||
|
minify: false,
|
||||||
|
sourcemap: true,
|
||||||
|
cssCodeSplit: true,
|
||||||
|
},
|
||||||
|
define: {
|
||||||
|
'process.env.NODE_ENV': '"production"',
|
||||||
|
},
|
||||||
|
})
|
||||||
@@ -0,0 +1 @@
|
|||||||
|
# Landing Page & Docs
|
||||||
@@ -0,0 +1,60 @@
|
|||||||
|
<!doctype html>
|
||||||
|
<html lang="zh-CN">
|
||||||
|
<head>
|
||||||
|
<meta charset="UTF-8" />
|
||||||
|
<link
|
||||||
|
rel="icon"
|
||||||
|
type="image/svg+xml"
|
||||||
|
href="https://img.alicdn.com/imgextra/i2/O1CN012eGDRI1X6nnMt9clU_!!6000000002875-49-tps-64-64.webp"
|
||||||
|
/>
|
||||||
|
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
|
||||||
|
<title>PageAgent - The GUI Agent Living in Your Webpage</title>
|
||||||
|
<meta
|
||||||
|
name="description"
|
||||||
|
content="PageAgent.js: Intelligent GUI Agent for any website. Modern web AI automation with minimal integration."
|
||||||
|
/>
|
||||||
|
<meta
|
||||||
|
name="keywords"
|
||||||
|
content="PageAgent, AI Agent, GUI Agent, Web Automation, GUI Automation, Frontend, CDN, JavaScript, React, Vite, LLM"
|
||||||
|
/>
|
||||||
|
<meta
|
||||||
|
property="og:image"
|
||||||
|
content="https://img.alicdn.com/imgextra/i3/O1CN01JPT4Fj1FJTfmHfNxO_!!6000000000466-49-tps-512-512.webp"
|
||||||
|
/>
|
||||||
|
<meta property="og:url" content="https://alibaba.github.io/page-agent" />
|
||||||
|
<meta property="og:type" content="website" />
|
||||||
|
<meta name="theme-color" content="#58c0fc" />
|
||||||
|
<meta name="color-scheme" content="light dark" />
|
||||||
|
<meta name="author" content="PageAgent.js Team" />
|
||||||
|
<meta property="og:title" content="PageAgent.js - AI-powered GUI Agent" />
|
||||||
|
<meta property="og:description" content="The GUI Agent living in your website." />
|
||||||
|
<meta property="og:type" content="website" />
|
||||||
|
<meta property="og:locale" content="en_US" />
|
||||||
|
<meta property="og:locale:alternate" content="zh_CN" />
|
||||||
|
|
||||||
|
<!-- Google tag (gtag.js) -->
|
||||||
|
<script async src="https://www.googletagmanager.com/gtag/js?id=G-HCGRJTN3HM"></script>
|
||||||
|
<script>
|
||||||
|
window.dataLayer = window.dataLayer || []
|
||||||
|
function gtag() {
|
||||||
|
dataLayer.push(arguments)
|
||||||
|
}
|
||||||
|
gtag('js', new Date())
|
||||||
|
|
||||||
|
gtag('config', 'G-HCGRJTN3HM')
|
||||||
|
</script>
|
||||||
|
</head>
|
||||||
|
<body>
|
||||||
|
<div id="root"></div>
|
||||||
|
<script type="module" src="./src/main.tsx"></script>
|
||||||
|
<script>
|
||||||
|
// Dynamically update html lang attribute based on i18n detection
|
||||||
|
const updateHtmlLang = () => {
|
||||||
|
const lang = localStorage.getItem('i18nextLng') || navigator.language || 'zh-CN'
|
||||||
|
document.documentElement.lang = lang
|
||||||
|
}
|
||||||
|
updateHtmlLang()
|
||||||
|
window.addEventListener('storage', updateHtmlLang)
|
||||||
|
</script>
|
||||||
|
</body>
|
||||||
|
</html>
|
||||||
@@ -0,0 +1,25 @@
|
|||||||
|
{
|
||||||
|
"name": "@page-agent/website",
|
||||||
|
"private": true,
|
||||||
|
"version": "0.0.11",
|
||||||
|
"type": "module",
|
||||||
|
"scripts": {
|
||||||
|
"dev": "vite",
|
||||||
|
"build:website": "vite build",
|
||||||
|
"preview": "vite preview",
|
||||||
|
"typecheck": "tsc --noEmit"
|
||||||
|
},
|
||||||
|
"devDependencies": {
|
||||||
|
"@tailwindcss/vite": "^4.1.18",
|
||||||
|
"@types/react": "^19.2.2",
|
||||||
|
"@types/react-dom": "^19.2.1",
|
||||||
|
"@vitejs/plugin-react-swc": "^4.1.0",
|
||||||
|
"i18next": "^25.7.3",
|
||||||
|
"i18next-browser-languagedetector": "^8.2.0",
|
||||||
|
"react": "^19.2.3",
|
||||||
|
"react-dom": "^19.2.3",
|
||||||
|
"react-i18next": "^16.5.0",
|
||||||
|
"tailwindcss": "^4.1.14",
|
||||||
|
"wouter": "^3.8.1"
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -6,7 +6,7 @@ export default function BetaNotice() {
|
|||||||
return (
|
return (
|
||||||
<div className="bg-orange-50 dark:bg-orange-900/20 border border-orange-200 dark:border-orange-800 rounded-lg p-4 mb-8">
|
<div className="bg-orange-50 dark:bg-orange-900/20 border border-orange-200 dark:border-orange-800 rounded-lg p-4 mb-8">
|
||||||
<div className="flex items-start">
|
<div className="flex items-start">
|
||||||
<div className="flex-shrink-0">
|
<div className="shrink-0">
|
||||||
<span className="text-xl">🚧</span>
|
<span className="text-xl">🚧</span>
|
||||||
</div>
|
</div>
|
||||||
<div className="ml-3">
|
<div className="ml-3">
|
||||||
@@ -28,7 +28,7 @@ const CodeEditor: React.FC<CodeEditorProps> = ({
|
|||||||
|
|
||||||
// 使用 Tailwind 的 dark: 前缀实现自动主题切换
|
// 使用 Tailwind 的 dark: 前缀实现自动主题切换
|
||||||
const containerClasses =
|
const containerClasses =
|
||||||
'bg-gradient-to-br from-gray-50 to-gray-100 dark:from-gray-900 dark:to-gray-800 border-gray-300 dark:border-gray-700'
|
'bg-linear-to-br from-gray-50 to-gray-100 dark:from-gray-900 dark:to-gray-800 border-gray-300 dark:border-gray-700'
|
||||||
const headerClasses = 'bg-gray-100 dark:bg-gray-800 border-gray-300 dark:border-gray-700'
|
const headerClasses = 'bg-gray-100 dark:bg-gray-800 border-gray-300 dark:border-gray-700'
|
||||||
const headerTextClasses = 'text-gray-700 dark:text-gray-300'
|
const headerTextClasses = 'text-gray-700 dark:text-gray-300'
|
||||||
const languageTextClasses = 'text-gray-600 dark:text-gray-400'
|
const languageTextClasses = 'text-gray-600 dark:text-gray-400'
|
||||||
@@ -72,7 +72,7 @@ const CodeEditor: React.FC<CodeEditorProps> = ({
|
|||||||
<div className="flex">
|
<div className="flex">
|
||||||
{/* 行号 */}
|
{/* 行号 */}
|
||||||
{showLineNumbers && (
|
{showLineNumbers && (
|
||||||
<div className={`flex-shrink-0 px-4 py-4 ${lineNumbersClasses} border-r select-none`}>
|
<div className={`shrink-0 px-4 py-4 ${lineNumbersClasses} border-r select-none`}>
|
||||||
<div className="text-xs font-mono leading-6">
|
<div className="text-xs font-mono leading-6">
|
||||||
{lines.map((line, lineIdx) => {
|
{lines.map((line, lineIdx) => {
|
||||||
const lineNum = lineIdx + 1
|
const lineNum = lineIdx + 1
|
||||||
@@ -54,7 +54,7 @@ export default function DocsLayout({ children }: DocsLayoutProps) {
|
|||||||
<div className="max-w-7xl mx-auto px-6 py-8 overflow-x-auto">
|
<div className="max-w-7xl mx-auto px-6 py-8 overflow-x-auto">
|
||||||
<div className="flex gap-8 min-w-[900px]">
|
<div className="flex gap-8 min-w-[900px]">
|
||||||
{/* Sidebar */}
|
{/* Sidebar */}
|
||||||
<aside className="w-64 flex-shrink-0" role="complementary" aria-label="文档导航">
|
<aside className="w-64 shrink-0" role="complementary" aria-label="文档导航">
|
||||||
<div className="sticky top-8">
|
<div className="sticky top-8">
|
||||||
<nav className="space-y-8" role="navigation" aria-label="文档章节">
|
<nav className="space-y-8" role="navigation" aria-label="文档章节">
|
||||||
{navigationSections.map((section) => (
|
{navigationSections.map((section) => (
|
||||||
@@ -0,0 +1,142 @@
|
|||||||
|
import { useState } from 'react'
|
||||||
|
import { useTranslation } from 'react-i18next'
|
||||||
|
import { Link } from 'wouter'
|
||||||
|
|
||||||
|
import LanguageSwitcher from './LanguageSwitcher'
|
||||||
|
import ThemeSwitcher from './ThemeSwitcher'
|
||||||
|
import { BookIcon, CloseIcon, GithubIcon, MenuIcon } from './icons'
|
||||||
|
|
||||||
|
export default function Header() {
|
||||||
|
const { t } = useTranslation('common')
|
||||||
|
const [mobileMenuOpen, setMobileMenuOpen] = useState(false)
|
||||||
|
|
||||||
|
return (
|
||||||
|
<>
|
||||||
|
<header
|
||||||
|
className="relative z-50 bg-white/80 dark:bg-gray-900/80 backdrop-blur-md border-b border-gray-200 dark:border-gray-700"
|
||||||
|
role="banner"
|
||||||
|
>
|
||||||
|
<div className="max-w-7xl mx-auto px-6 py-4">
|
||||||
|
<div className="flex items-center justify-between gap-2">
|
||||||
|
{/* Logo */}
|
||||||
|
<Link
|
||||||
|
href="/"
|
||||||
|
className="flex items-center gap-2 sm:gap-3 group shrink-0"
|
||||||
|
aria-label={t('header.logo_alt')}
|
||||||
|
onClick={() => setMobileMenuOpen(false)}
|
||||||
|
>
|
||||||
|
<img
|
||||||
|
src="https://img.alicdn.com/imgextra/i2/O1CN01HB8ylu1uozANEMZw2_!!6000000006085-49-tps-128-128.webp"
|
||||||
|
alt="PageAgent Logo"
|
||||||
|
className="w-10 h-10 rounded-xl group-hover:scale-110 transition-transform duration-200"
|
||||||
|
/>
|
||||||
|
<div>
|
||||||
|
<span className="text-base sm:text-xl font-bold text-gray-900 dark:text-white block leading-tight">
|
||||||
|
page-agent
|
||||||
|
</span>
|
||||||
|
<p className="hidden sm:block text-xs text-gray-600 dark:text-gray-300">
|
||||||
|
{t('header.slogan')}
|
||||||
|
</p>
|
||||||
|
</div>
|
||||||
|
</Link>
|
||||||
|
|
||||||
|
{/* Mobile Icon Navigation (横向滚动) */}
|
||||||
|
<nav
|
||||||
|
className="md:hidden flex items-center gap-1 overflow-x-auto scrollbar-hide flex-1"
|
||||||
|
role="navigation"
|
||||||
|
aria-label="Mobile navigation"
|
||||||
|
>
|
||||||
|
<Link
|
||||||
|
href="/docs/introduction/overview"
|
||||||
|
className="p-2 rounded-lg text-gray-600 dark:text-gray-300 hover:bg-gray-100 dark:hover:bg-gray-800 hover:text-blue-600 dark:hover:text-blue-400 transition-colors duration-200 shrink-0"
|
||||||
|
aria-label={t('header.nav_docs')}
|
||||||
|
>
|
||||||
|
<BookIcon className="w-5 h-5" />
|
||||||
|
</Link>
|
||||||
|
<a
|
||||||
|
href="https://github.com/alibaba/page-agent"
|
||||||
|
target="_blank"
|
||||||
|
rel="noopener noreferrer"
|
||||||
|
className="p-2 rounded-lg text-gray-600 dark:text-gray-300 hover:bg-gray-100 dark:hover:bg-gray-800 hover:text-blue-600 dark:hover:text-blue-400 transition-colors duration-200 shrink-0"
|
||||||
|
aria-label={t('header.nav_source')}
|
||||||
|
>
|
||||||
|
<GithubIcon className="w-5 h-5" />
|
||||||
|
</a>
|
||||||
|
</nav>
|
||||||
|
|
||||||
|
{/* Desktop Navigation */}
|
||||||
|
<nav
|
||||||
|
className="hidden md:flex items-center space-x-6"
|
||||||
|
role="navigation"
|
||||||
|
aria-label={t('header.nav_docs')}
|
||||||
|
>
|
||||||
|
<Link
|
||||||
|
href="/docs/introduction/overview"
|
||||||
|
className="flex items-center gap-1.5 text-gray-600 dark:text-gray-300 hover:text-blue-600 dark:hover:text-blue-400 transition-colors duration-200"
|
||||||
|
>
|
||||||
|
<BookIcon />
|
||||||
|
{t('header.nav_docs')}
|
||||||
|
</Link>
|
||||||
|
<a
|
||||||
|
href="https://github.com/alibaba/page-agent"
|
||||||
|
target="_blank"
|
||||||
|
rel="noopener noreferrer"
|
||||||
|
className="flex items-center gap-1.5 text-gray-600 dark:text-gray-300 hover:text-blue-600 dark:hover:text-blue-400 transition-colors duration-200"
|
||||||
|
aria-label={t('header.nav_source')}
|
||||||
|
>
|
||||||
|
<GithubIcon />
|
||||||
|
{t('header.nav_source')}
|
||||||
|
</a>
|
||||||
|
<ThemeSwitcher />
|
||||||
|
<LanguageSwitcher />
|
||||||
|
</nav>
|
||||||
|
|
||||||
|
{/* Mobile menu button */}
|
||||||
|
<button
|
||||||
|
type="button"
|
||||||
|
className="md:hidden p-2 rounded-lg text-gray-600 dark:text-gray-300 hover:bg-gray-100 dark:hover:bg-gray-800 transition-colors duration-200 shrink-0"
|
||||||
|
aria-label={t('header.mobile_menu')}
|
||||||
|
aria-expanded={mobileMenuOpen}
|
||||||
|
aria-controls="mobile-menu"
|
||||||
|
onClick={() => setMobileMenuOpen(!mobileMenuOpen)}
|
||||||
|
>
|
||||||
|
{mobileMenuOpen ? <CloseIcon /> : <MenuIcon />}
|
||||||
|
</button>
|
||||||
|
</div>
|
||||||
|
|
||||||
|
{/* Mobile Navigation */}
|
||||||
|
{mobileMenuOpen && (
|
||||||
|
<nav
|
||||||
|
id="mobile-menu"
|
||||||
|
className="md:hidden pt-4 pb-2 space-y-3 border-t border-gray-200 dark:border-gray-700 mt-4"
|
||||||
|
role="navigation"
|
||||||
|
>
|
||||||
|
<Link
|
||||||
|
href="/docs/introduction/overview"
|
||||||
|
className="flex items-center gap-2 px-3 py-2 rounded-lg text-gray-600 dark:text-gray-300 hover:bg-gray-100 dark:hover:bg-gray-800 hover:text-blue-600 dark:hover:text-blue-400 transition-colors duration-200"
|
||||||
|
onClick={() => setMobileMenuOpen(false)}
|
||||||
|
>
|
||||||
|
<BookIcon className="w-5 h-5" />
|
||||||
|
{t('header.nav_docs')}
|
||||||
|
</Link>
|
||||||
|
<a
|
||||||
|
href="https://github.com/alibaba/page-agent"
|
||||||
|
target="_blank"
|
||||||
|
rel="noopener noreferrer"
|
||||||
|
className="flex items-center gap-2 px-3 py-2 rounded-lg text-gray-600 dark:text-gray-300 hover:bg-gray-100 dark:hover:bg-gray-800 hover:text-blue-600 dark:hover:text-blue-400 transition-colors duration-200"
|
||||||
|
aria-label={t('header.nav_source')}
|
||||||
|
>
|
||||||
|
<GithubIcon className="w-5 h-5" />
|
||||||
|
{t('header.nav_source')}
|
||||||
|
</a>
|
||||||
|
<div className="flex items-center gap-3 px-3 py-2">
|
||||||
|
<ThemeSwitcher />
|
||||||
|
<LanguageSwitcher />
|
||||||
|
</div>
|
||||||
|
</nav>
|
||||||
|
)}
|
||||||
|
</div>
|
||||||
|
</header>
|
||||||
|
</>
|
||||||
|
)
|
||||||
|
}
|
||||||
@@ -0,0 +1,126 @@
|
|||||||
|
.syntax {
|
||||||
|
white-space: pre-wrap;
|
||||||
|
word-break: break-word;
|
||||||
|
overflow-wrap: break-word;
|
||||||
|
font-family: monospace;
|
||||||
|
color: #171717;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .syntax {
|
||||||
|
color: #e0e0e0;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* JavaScript/TypeScript 关键字 */
|
||||||
|
.keyword {
|
||||||
|
color: #d73a49;
|
||||||
|
font-weight: 600;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .keyword {
|
||||||
|
color: #ff6b6b;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* TypeScript 特定关键字 (interface, type, enum, etc.) */
|
||||||
|
.tsKeyword {
|
||||||
|
color: #af00db;
|
||||||
|
font-weight: 600;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .tsKeyword {
|
||||||
|
color: #c792ea;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* TypeScript 内置类型 */
|
||||||
|
.type {
|
||||||
|
color: #267f99;
|
||||||
|
font-weight: 500;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .type {
|
||||||
|
color: #4ec9b0;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 字符串 */
|
||||||
|
.string {
|
||||||
|
color: #1d6eca;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .string {
|
||||||
|
color: #4fc3f7;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 数字 */
|
||||||
|
.number {
|
||||||
|
color: #00c583;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .number {
|
||||||
|
color: #66bb6a;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 布尔值和字面量 (true, false, null, undefined) */
|
||||||
|
.literal {
|
||||||
|
color: #0000ff;
|
||||||
|
font-weight: 500;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .literal {
|
||||||
|
color: #569cd6;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 注释 */
|
||||||
|
.comment {
|
||||||
|
color: #6a737d;
|
||||||
|
font-style: italic;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .comment {
|
||||||
|
color: #9e9e9e;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 装饰器 (@decorator) */
|
||||||
|
.decorator {
|
||||||
|
color: #e0aa00;
|
||||||
|
font-weight: 500;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .decorator {
|
||||||
|
color: #dcdcaa;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 箭头函数 (=>) */
|
||||||
|
.arrow {
|
||||||
|
color: #d73a49;
|
||||||
|
font-weight: bold;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .arrow {
|
||||||
|
color: #ff6b6b;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 标识符(变量名、函数名等) */
|
||||||
|
.identifier {
|
||||||
|
color: #171717;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .identifier {
|
||||||
|
color: #e0e0e0;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 属性访问 (.property) */
|
||||||
|
.property {
|
||||||
|
color: #0550ae;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .property {
|
||||||
|
color: #9cdcfe;
|
||||||
|
}
|
||||||
|
|
||||||
|
/* 运算符 */
|
||||||
|
.operator {
|
||||||
|
color: #5a5a5a;
|
||||||
|
}
|
||||||
|
|
||||||
|
:global(.dark) .operator {
|
||||||
|
color: #d4d4d4;
|
||||||
|
}
|
||||||
@@ -0,0 +1,176 @@
|
|||||||
|
/**
|
||||||
|
* js 语法高亮组件,适合在文章中演示代码片段
|
||||||
|
*/
|
||||||
|
import React from 'react'
|
||||||
|
|
||||||
|
import styles from './HighlightSyntax.module.css'
|
||||||
|
|
||||||
|
interface HighlightSyntaxProps {
|
||||||
|
code: string
|
||||||
|
}
|
||||||
|
|
||||||
|
// JavaScript/TypeScript 关键字
|
||||||
|
const keywords =
|
||||||
|
'async|await|function|const|let|var|if|else|for|while|return|try|catch|finally|class|extends|from|import|export|default|undefined|throw|break|continue|switch|case|do|with|yield|delete|typeof|void|static|get|set|super|debugger'
|
||||||
|
|
||||||
|
// TypeScript 特定关键字
|
||||||
|
const tsKeywords =
|
||||||
|
'interface|type|enum|namespace|module|declare|abstract|implements|public|private|protected|readonly|as|satisfies|infer|keyof|is'
|
||||||
|
|
||||||
|
// 布尔值和空值
|
||||||
|
const literals = 'true|false|null|undefined|NaN|Infinity'
|
||||||
|
|
||||||
|
// TypeScript 内置类型
|
||||||
|
const tsTypes =
|
||||||
|
'string|number|boolean|any|unknown|never|void|object|symbol|bigint|Array|Promise|Record|Partial|Required|Readonly|Pick|Omit|Exclude|Extract|NonNullable|ReturnType|Parameters|ConstructorParameters|InstanceType|ThisType|Uppercase|Lowercase|Capitalize|Uncapitalize'
|
||||||
|
|
||||||
|
// 辅助函数:转义 HTML 特殊字符
|
||||||
|
function escapeHtml(text: string): string {
|
||||||
|
return text.replace(/&/g, '&').replace(/</g, '<').replace(/>/g, '>')
|
||||||
|
}
|
||||||
|
|
||||||
|
// 语法高亮函数,先提取 token 再转义和高亮
|
||||||
|
function highlightSyntax(code: string): string {
|
||||||
|
// 构建正则模式,包含更多 token 类型(在原始文本上匹配)
|
||||||
|
const pattern = new RegExp(
|
||||||
|
'(' +
|
||||||
|
// 1. 字符串(双引号、单引号、模板字符串)
|
||||||
|
'"([^"\\\\]|\\\\.)*"|' +
|
||||||
|
"'([^'\\\\]|\\\\.)*'|" +
|
||||||
|
'`([^`\\\\]|\\\\.)*`|' +
|
||||||
|
// 2. 注释(单行和多行)
|
||||||
|
'//[^\\n]*|' +
|
||||||
|
'/\\*[\\s\\S]*?\\*/|' +
|
||||||
|
// 3. 装饰器
|
||||||
|
'@[a-zA-Z_$][\\w$]*|' +
|
||||||
|
// 4. 数字(包括小数、十六进制、科学计数法)
|
||||||
|
'\\b0[xX][0-9a-fA-F]+\\b|' +
|
||||||
|
'\\b\\d+\\.?\\d*(?:[eE][+-]?\\d+)?\\b|' +
|
||||||
|
// 5. TypeScript/JavaScript 关键字
|
||||||
|
'\\b(?:' +
|
||||||
|
keywords +
|
||||||
|
'|' +
|
||||||
|
tsKeywords +
|
||||||
|
'|' +
|
||||||
|
literals +
|
||||||
|
')\\b|' +
|
||||||
|
// 6. TypeScript 内置类型
|
||||||
|
'\\b(?:' +
|
||||||
|
tsTypes +
|
||||||
|
')\\b|' +
|
||||||
|
// 7. 箭头函数
|
||||||
|
'=>|' +
|
||||||
|
// 8. 函数调用(函数名后跟括号)
|
||||||
|
'\\b[a-zA-Z_$][\\w$]*(?=\\()|' +
|
||||||
|
// 9. 属性访问
|
||||||
|
'\\.[a-zA-Z_$][\\w$]*|' +
|
||||||
|
// 10. 运算符和特殊符号
|
||||||
|
'[+\\-*/%&|^!~<>=?:]+|' +
|
||||||
|
'[{}\\[\\]();,.]' +
|
||||||
|
')',
|
||||||
|
'g'
|
||||||
|
)
|
||||||
|
|
||||||
|
const tokens: string[] = []
|
||||||
|
let lastIndex = 0
|
||||||
|
let match: RegExpExecArray | null
|
||||||
|
while ((match = pattern.exec(code)) !== null) {
|
||||||
|
if (match.index > lastIndex) {
|
||||||
|
const gap = code.slice(lastIndex, match.index)
|
||||||
|
// 将间隙按空白符分割,保留空白符
|
||||||
|
tokens.push(...gap.split(/(\s+)/))
|
||||||
|
}
|
||||||
|
tokens.push(match[0])
|
||||||
|
lastIndex = pattern.lastIndex
|
||||||
|
}
|
||||||
|
if (lastIndex < code.length) {
|
||||||
|
tokens.push(...code.slice(lastIndex).split(/(\s+)/))
|
||||||
|
}
|
||||||
|
|
||||||
|
const highlighted = tokens
|
||||||
|
.map((token) => {
|
||||||
|
// 空白符直接返回
|
||||||
|
if (/^\s+$/.test(token)) {
|
||||||
|
return token
|
||||||
|
}
|
||||||
|
|
||||||
|
// 1. 注释(单行和多行)
|
||||||
|
if (/^\/\/.*$/.test(token) || /^\/\*[\s\S]*?\*\/$/.test(token)) {
|
||||||
|
return `<span class="${styles.comment}">${escapeHtml(token)}</span>`
|
||||||
|
}
|
||||||
|
|
||||||
|
// 2. 字符串
|
||||||
|
if (
|
||||||
|
/^"([^"\\]|\\.)*"$/.test(token) ||
|
||||||
|
/^'([^'\\]|\\.)*'$/.test(token) ||
|
||||||
|
/^`([^`\\]|\\.)*`$/.test(token)
|
||||||
|
) {
|
||||||
|
return `<span class="${styles.string}">${escapeHtml(token)}</span>`
|
||||||
|
}
|
||||||
|
|
||||||
|
// 3. 数字
|
||||||
|
if (/^(0[xX][0-9a-fA-F]+|\d+\.?\d*(?:[eE][+-]?\d+)?)$/.test(token)) {
|
||||||
|
return `<span class="${styles.number}">${escapeHtml(token)}</span>`
|
||||||
|
}
|
||||||
|
|
||||||
|
// 4. 布尔值和特殊字面量
|
||||||
|
if (new RegExp(`^(?:${literals})$`).test(token)) {
|
||||||
|
return `<span class="${styles.literal}">${escapeHtml(token)}</span>`
|
||||||
|
}
|
||||||
|
|
||||||
|
// 5. JavaScript/TypeScript 关键字
|
||||||
|
if (new RegExp(`^(?:${keywords})$`).test(token)) {
|
||||||
|
return `<span class="${styles.keyword}">${escapeHtml(token)}</span>`
|
||||||
|
}
|
||||||
|
|
||||||
|
// 6. TypeScript 特定关键字
|
||||||
|
if (new RegExp(`^(?:${tsKeywords})$`).test(token)) {
|
||||||
|
return `<span class="${styles.tsKeyword}">${escapeHtml(token)}</span>`
|
||||||
|
}
|
||||||
|
|
||||||
|
// 7. TypeScript 内置类型
|
||||||
|
if (new RegExp(`^(?:${tsTypes})$`).test(token)) {
|
||||||
|
return `<span class="${styles.type}">${escapeHtml(token)}</span>`
|
||||||
|
}
|
||||||
|
|
||||||
|
// 8. 装饰器
|
||||||
|
if (/^@[a-zA-Z_$][\w$]*$/.test(token)) {
|
||||||
|
return `<span class="${styles.decorator}">${escapeHtml(token)}</span>`
|
||||||
|
}
|
||||||
|
|
||||||
|
// 9. 箭头函数
|
||||||
|
if (token === '=>') {
|
||||||
|
return `<span class="${styles.arrow}">${escapeHtml(token)}</span>`
|
||||||
|
}
|
||||||
|
|
||||||
|
// 10. 函数调用和标识符
|
||||||
|
if (/^[a-zA-Z_$][\w$]*$/.test(token)) {
|
||||||
|
return `<span class="${styles.identifier}">${escapeHtml(token)}</span>`
|
||||||
|
}
|
||||||
|
|
||||||
|
// 11. 属性访问
|
||||||
|
if (/^\.[a-zA-Z_$][\w$]*$/.test(token)) {
|
||||||
|
return `<span class="${styles.property}">${escapeHtml(token)}</span>`
|
||||||
|
}
|
||||||
|
|
||||||
|
// 12. 运算符
|
||||||
|
if (/^[+\-*/%&|^!~<>=?:]+$/.test(token)) {
|
||||||
|
return `<span class="${styles.operator}">${escapeHtml(token)}</span>`
|
||||||
|
}
|
||||||
|
|
||||||
|
// 13. 其他符号,需要转义
|
||||||
|
return escapeHtml(token)
|
||||||
|
})
|
||||||
|
.join('')
|
||||||
|
|
||||||
|
return highlighted
|
||||||
|
}
|
||||||
|
|
||||||
|
const HighlightSyntaxClient: React.FC<HighlightSyntaxProps> = ({ code }) => {
|
||||||
|
const htmlContent = highlightSyntax(code)
|
||||||
|
|
||||||
|
// eslint-disable-next-line react-dom/no-dangerously-set-innerhtml
|
||||||
|
return <code className={styles.syntax} dangerouslySetInnerHTML={{ __html: htmlContent }} />
|
||||||
|
}
|
||||||
|
|
||||||
|
export default HighlightSyntaxClient
|
||||||
+1
-1
@@ -56,7 +56,7 @@ export default function ThemeSwitcher() {
|
|||||||
style={{
|
style={{
|
||||||
backgroundColor: theme === 'dark' ? '#1e293b' : '#e0f2fe',
|
backgroundColor: theme === 'dark' ? '#1e293b' : '#e0f2fe',
|
||||||
}}
|
}}
|
||||||
aria-label={theme === 'light' ? '切换到深色模式' : '切换到浅色模式'}
|
aria-label={theme === 'light' ? 'Switch to dark mode' : 'Switch to light mode'}
|
||||||
role="switch"
|
role="switch"
|
||||||
aria-checked={theme === 'dark'}
|
aria-checked={theme === 'dark'}
|
||||||
>
|
>
|
||||||
@@ -0,0 +1,75 @@
|
|||||||
|
// SVG图标组件集合,用于Header等地方复用
|
||||||
|
|
||||||
|
interface IconProps {
|
||||||
|
className?: string
|
||||||
|
'aria-hidden'?: boolean
|
||||||
|
}
|
||||||
|
|
||||||
|
export function BookIcon({ className = 'w-4 h-4', ...props }: IconProps) {
|
||||||
|
return (
|
||||||
|
<svg
|
||||||
|
className={className}
|
||||||
|
fill="none"
|
||||||
|
stroke="currentColor"
|
||||||
|
viewBox="0 0 24 24"
|
||||||
|
aria-hidden="true"
|
||||||
|
{...props}
|
||||||
|
>
|
||||||
|
<path
|
||||||
|
strokeLinecap="round"
|
||||||
|
strokeLinejoin="round"
|
||||||
|
strokeWidth={2}
|
||||||
|
d="M12 6.253v13m0-13C10.832 5.477 9.246 5 7.5 5S4.168 5.477 3 6.253v13C4.168 18.477 5.754 18 7.5 18s3.332.477 4.5 1.253m0-13C13.168 5.477 14.754 5 16.5 5c1.747 0 3.332.477 4.5 1.253v13C19.832 18.477 18.247 18 16.5 18c-1.746 0-3.332.477-4.5 1.253"
|
||||||
|
/>
|
||||||
|
</svg>
|
||||||
|
)
|
||||||
|
}
|
||||||
|
|
||||||
|
export function GithubIcon({ className = 'w-4 h-4', ...props }: IconProps) {
|
||||||
|
return (
|
||||||
|
<svg
|
||||||
|
className={className}
|
||||||
|
fill="currentColor"
|
||||||
|
viewBox="0 0 24 24"
|
||||||
|
aria-hidden="true"
|
||||||
|
{...props}
|
||||||
|
>
|
||||||
|
<path d="M12 0c-6.626 0-12 5.373-12 12 0 5.302 3.438 9.8 8.207 11.387.599.111.793-.261.793-.577v-2.234c-3.338.726-4.033-1.416-4.033-1.416-.546-1.387-1.333-1.756-1.333-1.756-1.089-.745.083-.729.083-.729 1.205.084 1.839 1.237 1.839 1.237 1.07 1.834 2.807 1.304 3.492.997.107-.775.418-1.305.762-1.604-2.665-.305-5.467-1.334-5.467-5.931 0-1.311.469-2.381 1.236-3.221-.124-.303-.535-1.524.117-3.176 0 0 1.008-.322 3.301 1.23.957-.266 1.983-.399 3.003-.404 1.02.005 2.047.138 3.006.404 2.291-1.552 3.297-1.23 3.297-1.23.653 1.653.242 2.874.118 3.176.77.84 1.235 1.911 1.235 3.221 0 4.609-2.807 5.624-5.479 5.921.43.372.823 1.102.823 2.222v3.293c0 .319.192.694.801.576 4.765-1.589 8.199-6.086 8.199-11.386 0-6.627-5.373-12-12-12z" />
|
||||||
|
</svg>
|
||||||
|
)
|
||||||
|
}
|
||||||
|
|
||||||
|
export function MenuIcon({ className = 'w-6 h-6', ...props }: IconProps) {
|
||||||
|
return (
|
||||||
|
<svg
|
||||||
|
className={className}
|
||||||
|
fill="none"
|
||||||
|
stroke="currentColor"
|
||||||
|
viewBox="0 0 24 24"
|
||||||
|
aria-hidden="true"
|
||||||
|
{...props}
|
||||||
|
>
|
||||||
|
<path
|
||||||
|
strokeLinecap="round"
|
||||||
|
strokeLinejoin="round"
|
||||||
|
strokeWidth={2}
|
||||||
|
d="M4 6h16M4 12h16M4 18h16"
|
||||||
|
/>
|
||||||
|
</svg>
|
||||||
|
)
|
||||||
|
}
|
||||||
|
|
||||||
|
export function CloseIcon({ className = 'w-6 h-6', ...props }: IconProps) {
|
||||||
|
return (
|
||||||
|
<svg
|
||||||
|
className={className}
|
||||||
|
fill="none"
|
||||||
|
stroke="currentColor"
|
||||||
|
viewBox="0 0 24 24"
|
||||||
|
aria-hidden="true"
|
||||||
|
{...props}
|
||||||
|
>
|
||||||
|
<path strokeLinecap="round" strokeLinejoin="round" strokeWidth={2} d="M6 18L18 6M6 6l12 12" />
|
||||||
|
</svg>
|
||||||
|
)
|
||||||
|
}
|
||||||
+3
-2
@@ -1,7 +1,8 @@
|
|||||||
import BetaNotice from '@pages/components/BetaNotice'
|
|
||||||
import CodeEditor from '@pages/components/CodeEditor'
|
|
||||||
import { useTranslation } from 'react-i18next'
|
import { useTranslation } from 'react-i18next'
|
||||||
|
|
||||||
|
import BetaNotice from '@/components/BetaNotice'
|
||||||
|
import CodeEditor from '@/components/CodeEditor'
|
||||||
|
|
||||||
export default function CustomTools() {
|
export default function CustomTools() {
|
||||||
const { t } = useTranslation('docs')
|
const { t } = useTranslation('docs')
|
||||||
|
|
||||||
+2
-2
@@ -1,5 +1,5 @@
|
|||||||
import BetaNotice from '@pages/components/BetaNotice'
|
import BetaNotice from '@/components/BetaNotice'
|
||||||
import CodeEditor from '@pages/components/CodeEditor'
|
import CodeEditor from '@/components/CodeEditor'
|
||||||
|
|
||||||
export default function DataMasking() {
|
export default function DataMasking() {
|
||||||
return (
|
return (
|
||||||
+2
-2
@@ -1,5 +1,5 @@
|
|||||||
import BetaNotice from '@pages/components/BetaNotice'
|
import BetaNotice from '@/components/BetaNotice'
|
||||||
import CodeEditor from '@pages/components/CodeEditor'
|
import CodeEditor from '@/components/CodeEditor'
|
||||||
|
|
||||||
export default function KnowledgeInjection() {
|
export default function KnowledgeInjection() {
|
||||||
return (
|
return (
|
||||||
+29
-2
@@ -1,7 +1,8 @@
|
|||||||
import BetaNotice from '@pages/components/BetaNotice'
|
|
||||||
import CodeEditor from '@pages/components/CodeEditor'
|
|
||||||
import { useTranslation } from 'react-i18next'
|
import { useTranslation } from 'react-i18next'
|
||||||
|
|
||||||
|
import BetaNotice from '@/components/BetaNotice'
|
||||||
|
import CodeEditor from '@/components/CodeEditor'
|
||||||
|
|
||||||
export default function ModelIntegration() {
|
export default function ModelIntegration() {
|
||||||
const { t } = useTranslation('docs')
|
const { t } = useTranslation('docs')
|
||||||
|
|
||||||
@@ -106,6 +107,32 @@ export default function ModelIntegration() {
|
|||||||
</ul>
|
</ul>
|
||||||
</div>
|
</div>
|
||||||
|
|
||||||
|
<h2 className="text-2xl font-bold mb-3">{t('model_integration.security')}</h2>
|
||||||
|
|
||||||
|
<div className="p-4 bg-yellow-50 dark:bg-yellow-900/20 border-l-4 border-yellow-500 mb-4">
|
||||||
|
<p className="text-sm font-semibold text-yellow-900 dark:text-yellow-200">
|
||||||
|
{t('model_integration.security_warning')}
|
||||||
|
</p>
|
||||||
|
</div>
|
||||||
|
|
||||||
|
<p className="text-gray-600 dark:text-gray-300 mb-4">
|
||||||
|
{t('model_integration.security_desc')}
|
||||||
|
</p>
|
||||||
|
|
||||||
|
<div className="p-4 bg-blue-50 dark:bg-blue-900/20 rounded-lg mb-6">
|
||||||
|
<h3 className="text-lg font-semibold mb-3 text-blue-900 dark:text-blue-300">
|
||||||
|
{t('model_integration.security_backend_proxy')}
|
||||||
|
</h3>
|
||||||
|
<p className="text-sm text-gray-600 dark:text-gray-300 mb-3">
|
||||||
|
{t('model_integration.security_backend_desc')}
|
||||||
|
</p>
|
||||||
|
<ul className="text-sm text-gray-600 dark:text-gray-300 space-y-1 list-none pl-0">
|
||||||
|
<li>{t('model_integration.security_method_1')}</li>
|
||||||
|
<li>{t('model_integration.security_method_2')}</li>
|
||||||
|
<li>{t('model_integration.security_method_3')}</li>
|
||||||
|
</ul>
|
||||||
|
</div>
|
||||||
|
|
||||||
<h2 className="text-2xl font-bold mb-3">{t('model_integration.configuration')}</h2>
|
<h2 className="text-2xl font-bold mb-3">{t('model_integration.configuration')}</h2>
|
||||||
|
|
||||||
<CodeEditor
|
<CodeEditor
|
||||||
+1
-1
@@ -1,4 +1,4 @@
|
|||||||
import BetaNotice from '@pages/components/BetaNotice'
|
import BetaNotice from '@/components/BetaNotice'
|
||||||
|
|
||||||
export default function SecurityPermissions() {
|
export default function SecurityPermissions() {
|
||||||
return (
|
return (
|
||||||
+2
-2
@@ -1,5 +1,5 @@
|
|||||||
import BetaNotice from '@pages/components/BetaNotice'
|
import BetaNotice from '@/components/BetaNotice'
|
||||||
import CodeEditor from '@pages/components/CodeEditor'
|
import CodeEditor from '@/components/CodeEditor'
|
||||||
|
|
||||||
export default function BestPractices() {
|
export default function BestPractices() {
|
||||||
return (
|
return (
|
||||||
+3
-3
@@ -1,5 +1,5 @@
|
|||||||
import BetaNotice from '@pages/components/BetaNotice'
|
import BetaNotice from '@/components/BetaNotice'
|
||||||
import CodeEditor from '@pages/components/CodeEditor'
|
import CodeEditor from '@/components/CodeEditor'
|
||||||
|
|
||||||
export default function CdnSetup() {
|
export default function CdnSetup() {
|
||||||
return (
|
return (
|
||||||
@@ -16,7 +16,7 @@ export default function CdnSetup() {
|
|||||||
className="mb-8"
|
className="mb-8"
|
||||||
code={`
|
code={`
|
||||||
// 仅供测试使用,稳定 CDN 待定
|
// 仅供测试使用,稳定 CDN 待定
|
||||||
<script src="https://hwcxiuzfylggtcktqgij.supabase.co/storage/v1/object/public/demo-public/v0.0.2/page-agent.js" crossorigin="true" type="text/javascript"></script>
|
<script src="https://hwcxiuzfylggtcktqgij.supabase.co/storage/v1/object/public/demo-public/v0.0.4/page-agent.js" crossorigin="true" type="text/javascript"></script>
|
||||||
|
|
||||||
<script>
|
<script>
|
||||||
window.pageAgent.panel.show()
|
window.pageAgent.panel.show()
|
||||||
+12
-3
@@ -1,4 +1,4 @@
|
|||||||
import CodeEditor from '@pages/components/CodeEditor'
|
import CodeEditor from '@/components/CodeEditor'
|
||||||
|
|
||||||
export default function Configuration() {
|
export default function Configuration() {
|
||||||
return (
|
return (
|
||||||
@@ -9,7 +9,7 @@ export default function Configuration() {
|
|||||||
className="mb-8"
|
className="mb-8"
|
||||||
language="typescript"
|
language="typescript"
|
||||||
code={`// config
|
code={`// config
|
||||||
type PageAgentConfig = LLMConfig & AgentConfig & DomConfig
|
type PageAgentConfig = LLMConfig & AgentConfig & PageControllerConfig
|
||||||
|
|
||||||
interface LLMConfig {
|
interface LLMConfig {
|
||||||
baseURL?: string
|
baseURL?: string
|
||||||
@@ -70,6 +70,14 @@ interface AgentConfig {
|
|||||||
|
|
||||||
// page behavior hooks
|
// page behavior hooks
|
||||||
|
|
||||||
|
/**
|
||||||
|
* @experimental
|
||||||
|
* Enable the experimental script execution tool that allows executing generated JavaScript code on the page.
|
||||||
|
* @note Can cause unpredictable side effects.
|
||||||
|
* @note May bypass some safe guards and data-masking mechanisms.
|
||||||
|
*/
|
||||||
|
experimentalScriptExecutionTool?: boolean
|
||||||
|
|
||||||
/**
|
/**
|
||||||
* TODO: @unimplemented
|
* TODO: @unimplemented
|
||||||
* hook when action causes a new page to be opened
|
* hook when action causes a new page to be opened
|
||||||
@@ -85,12 +93,13 @@ interface AgentConfig {
|
|||||||
experimentalPreventNewPage?: boolean
|
experimentalPreventNewPage?: boolean
|
||||||
}
|
}
|
||||||
|
|
||||||
interface DomConfig {
|
interface PageControllerConfig {
|
||||||
interactiveBlacklist?: (Element | (() => Element))[]
|
interactiveBlacklist?: (Element | (() => Element))[]
|
||||||
interactiveWhitelist?: (Element | (() => Element))[]
|
interactiveWhitelist?: (Element | (() => Element))[]
|
||||||
include_attributes?: string[]
|
include_attributes?: string[]
|
||||||
highlightOpacity?: number
|
highlightOpacity?: number
|
||||||
highlightLabelOpacity?: number
|
highlightLabelOpacity?: number
|
||||||
|
viewportExpansion?: number
|
||||||
}
|
}
|
||||||
|
|
||||||
`}
|
`}
|
||||||
+6
-6
@@ -1,4 +1,4 @@
|
|||||||
import CodeEditor from '@pages/components/CodeEditor'
|
import CodeEditor from '@/components/CodeEditor'
|
||||||
|
|
||||||
export default function ThirdPartyAgentPage() {
|
export default function ThirdPartyAgentPage() {
|
||||||
return (
|
return (
|
||||||
@@ -48,25 +48,25 @@ const pageAgentTool = {
|
|||||||
|
|
||||||
<h2 className="text-2xl font-bold mb-4">应用场景</h2>
|
<h2 className="text-2xl font-bold mb-4">应用场景</h2>
|
||||||
<div className="grid md:grid-cols-2 gap-4 mb-6">
|
<div className="grid md:grid-cols-2 gap-4 mb-6">
|
||||||
<div className="bg-gradient-to-br from-blue-50 to-purple-50 dark:from-gray-800 dark:to-gray-700 p-4 rounded-lg">
|
<div className="bg-linear-to-br from-blue-50 to-purple-50 dark:from-gray-800 dark:to-gray-700 p-4 rounded-lg">
|
||||||
<h4 className="font-semibold mb-2 text-gray-900 dark:text-white">🤖 智能客服系统</h4>
|
<h4 className="font-semibold mb-2 text-gray-900 dark:text-white">🤖 智能客服系统</h4>
|
||||||
<p className="text-sm text-gray-600 dark:text-gray-300">
|
<p className="text-sm text-gray-600 dark:text-gray-300">
|
||||||
客服机器人帮用户直接操作系统,如"帮我提交工单"
|
客服机器人帮用户直接操作系统,如"帮我提交工单"
|
||||||
</p>
|
</p>
|
||||||
</div>
|
</div>
|
||||||
<div className="bg-gradient-to-br from-green-50 to-blue-50 dark:from-gray-800 dark:to-gray-700 p-4 rounded-lg">
|
<div className="bg-linear-to-br from-green-50 to-blue-50 dark:from-gray-800 dark:to-gray-700 p-4 rounded-lg">
|
||||||
<h4 className="font-semibold mb-2 text-gray-900 dark:text-white">📋 业务流程助手</h4>
|
<h4 className="font-semibold mb-2 text-gray-900 dark:text-white">📋 业务流程助手</h4>
|
||||||
<p className="text-sm text-gray-600 dark:text-gray-300">
|
<p className="text-sm text-gray-600 dark:text-gray-300">
|
||||||
引导新员工完成复杂流程,如"完成客户入职"
|
引导新员工完成复杂流程,如"完成客户入职"
|
||||||
</p>
|
</p>
|
||||||
</div>
|
</div>
|
||||||
<div className="bg-gradient-to-br from-purple-50 to-pink-50 dark:from-gray-800 dark:to-gray-700 p-4 rounded-lg">
|
<div className="bg-linear-to-br from-purple-50 to-pink-50 dark:from-gray-800 dark:to-gray-700 p-4 rounded-lg">
|
||||||
<h4 className="font-semibold mb-2 text-gray-900 dark:text-white">🎯 个人效率助手</h4>
|
<h4 className="font-semibold mb-2 text-gray-900 dark:text-white">🎯 个人效率助手</h4>
|
||||||
<p className="text-sm text-gray-600 dark:text-gray-300">
|
<p className="text-sm text-gray-600 dark:text-gray-300">
|
||||||
跨网站帮你完成任务,如"预订会议室"
|
跨网站帮你完成任务,如"预订会议室"
|
||||||
</p>
|
</p>
|
||||||
</div>
|
</div>
|
||||||
<div className="bg-gradient-to-br from-orange-50 to-red-50 dark:from-gray-800 dark:to-gray-700 p-4 rounded-lg">
|
<div className="bg-linear-to-br from-orange-50 to-red-50 dark:from-gray-800 dark:to-gray-700 p-4 rounded-lg">
|
||||||
<h4 className="font-semibold mb-2 text-gray-900 dark:text-white">🔧 运维自动化</h4>
|
<h4 className="font-semibold mb-2 text-gray-900 dark:text-white">🔧 运维自动化</h4>
|
||||||
<p className="text-sm text-gray-600 dark:text-gray-300">
|
<p className="text-sm text-gray-600 dark:text-gray-300">
|
||||||
通过自然语言操作管理后台,如"重启服务器"
|
通过自然语言操作管理后台,如"重启服务器"
|
||||||
@@ -98,7 +98,7 @@ const pageAgentTool = {
|
|||||||
</ul>
|
</ul>
|
||||||
</div>
|
</div>
|
||||||
|
|
||||||
<div className="bg-gradient-to-r from-green-50 to-blue-50 dark:from-green-900/20 dark:to-blue-900/20 p-4 rounded-lg">
|
<div className="bg-linear-to-r from-green-50 to-blue-50 dark:from-green-900/20 dark:to-blue-900/20 p-4 rounded-lg">
|
||||||
<h3 className="text-lg font-semibold mb-2 text-gray-900 dark:text-white">🎉 开始集成</h3>
|
<h3 className="text-lg font-semibold mb-2 text-gray-900 dark:text-white">🎉 开始集成</h3>
|
||||||
<p className="mb-3 text-gray-700 dark:text-gray-300">
|
<p className="mb-3 text-gray-700 dark:text-gray-300">
|
||||||
通过这种方式,你的 Agent 系统就能真正成为用户的智能助手。
|
通过这种方式,你的 Agent 系统就能真正成为用户的智能助手。
|
||||||
+5
-5
@@ -8,7 +8,7 @@ export default function Overview() {
|
|||||||
{/* 头图 */}
|
{/* 头图 */}
|
||||||
<figure className="mb-8 rounded-xl overflow-hidden">
|
<figure className="mb-8 rounded-xl overflow-hidden">
|
||||||
<img
|
<img
|
||||||
src="https://img.alicdn.com/imgextra/i1/O1CN01RY0Wvh26ATVeDIX7v_!!6000000007621-0-tps-1672-512.jpg"
|
src="https://img.alicdn.com/imgextra/i3/O1CN014xLeic1gnF2iWdzjJ_!!6000000004186-49-tps-1280-353.webp"
|
||||||
alt="page-agent"
|
alt="page-agent"
|
||||||
className="w-full h-64 object-cover"
|
className="w-full h-64 object-cover"
|
||||||
/>
|
/>
|
||||||
@@ -174,7 +174,7 @@ export default function Overview() {
|
|||||||
|
|
||||||
<ul className="space-y-4 mb-8">
|
<ul className="space-y-4 mb-8">
|
||||||
<li className="flex items-start space-x-3">
|
<li className="flex items-start space-x-3">
|
||||||
<span className="w-6 h-6 min-w-6 bg-blue-500 text-white rounded-full flex items-center justify-center font-bold text-sm mt-0.5 flex-shrink-0">
|
<span className="w-6 h-6 min-w-6 bg-blue-500 text-white rounded-full flex items-center justify-center font-bold text-sm mt-0.5 shrink-0">
|
||||||
1
|
1
|
||||||
</span>
|
</span>
|
||||||
<div className="text-gray-700 dark:text-gray-300">
|
<div className="text-gray-700 dark:text-gray-300">
|
||||||
@@ -182,7 +182,7 @@ export default function Overview() {
|
|||||||
</div>
|
</div>
|
||||||
</li>
|
</li>
|
||||||
<li className="flex items-start space-x-3">
|
<li className="flex items-start space-x-3">
|
||||||
<span className="w-6 h-6 min-w-6 bg-green-500 text-white rounded-full flex items-center justify-center font-bold text-sm mt-0.5 flex-shrink-0">
|
<span className="w-6 h-6 min-w-6 bg-green-500 text-white rounded-full flex items-center justify-center font-bold text-sm mt-0.5 shrink-0">
|
||||||
2
|
2
|
||||||
</span>
|
</span>
|
||||||
<div className="text-gray-700 dark:text-gray-300">
|
<div className="text-gray-700 dark:text-gray-300">
|
||||||
@@ -190,7 +190,7 @@ export default function Overview() {
|
|||||||
</div>
|
</div>
|
||||||
</li>
|
</li>
|
||||||
<li className="flex items-start space-x-3">
|
<li className="flex items-start space-x-3">
|
||||||
<span className="w-6 h-6 min-w-6 bg-purple-500 text-white rounded-full flex items-center justify-center font-bold text-sm mt-0.5 flex-shrink-0">
|
<span className="w-6 h-6 min-w-6 bg-purple-500 text-white rounded-full flex items-center justify-center font-bold text-sm mt-0.5 shrink-0">
|
||||||
3
|
3
|
||||||
</span>
|
</span>
|
||||||
<div className="text-gray-700 dark:text-gray-300">
|
<div className="text-gray-700 dark:text-gray-300">
|
||||||
@@ -198,7 +198,7 @@ export default function Overview() {
|
|||||||
</div>
|
</div>
|
||||||
</li>
|
</li>
|
||||||
<li className="flex items-start space-x-3">
|
<li className="flex items-start space-x-3">
|
||||||
<span className="w-6 h-6 min-w-6 bg-orange-500 text-white rounded-full flex items-center justify-center font-bold text-sm mt-0.5 flex-shrink-0">
|
<span className="w-6 h-6 min-w-6 bg-orange-500 text-white rounded-full flex items-center justify-center font-bold text-sm mt-0.5 shrink-0">
|
||||||
4
|
4
|
||||||
</span>
|
</span>
|
||||||
<div className="text-gray-700 dark:text-gray-300">
|
<div className="text-gray-700 dark:text-gray-300">
|
||||||
+4
-3
@@ -1,7 +1,8 @@
|
|||||||
import BetaNotice from '@pages/components/BetaNotice'
|
|
||||||
import CodeEditor from '@pages/components/CodeEditor'
|
|
||||||
import { useTranslation } from 'react-i18next'
|
import { useTranslation } from 'react-i18next'
|
||||||
|
|
||||||
|
import BetaNotice from '@/components/BetaNotice'
|
||||||
|
import CodeEditor from '@/components/CodeEditor'
|
||||||
|
|
||||||
export default function QuickStart() {
|
export default function QuickStart() {
|
||||||
const { t } = useTranslation('docs')
|
const { t } = useTranslation('docs')
|
||||||
|
|
||||||
@@ -23,7 +24,7 @@ export default function QuickStart() {
|
|||||||
<p className="text-sm font-medium mb-2">{t('quick_start.step1_cdn')}</p>
|
<p className="text-sm font-medium mb-2">{t('quick_start.step1_cdn')}</p>
|
||||||
<CodeEditor
|
<CodeEditor
|
||||||
code={`// 仅供测试使用
|
code={`// 仅供测试使用
|
||||||
<script src="https://hwcxiuzfylggtcktqgij.supabase.co/storage/v1/object/public/demo-public/v0.0.2/page-agent.js" crossorigin="true" type="text/javascript"></script>`}
|
<script src="https://hwcxiuzfylggtcktqgij.supabase.co/storage/v1/object/public/demo-public/v0.0.4/page-agent.js" crossorigin="true" type="text/javascript"></script>`}
|
||||||
language="html"
|
language="html"
|
||||||
/>
|
/>
|
||||||
</div>
|
</div>
|
||||||
Vendored
+6
@@ -0,0 +1,6 @@
|
|||||||
|
/// <reference types="vite/client" />
|
||||||
|
|
||||||
|
declare module '*.module.css' {
|
||||||
|
const classes: Record<string, string>
|
||||||
|
export default classes
|
||||||
|
}
|
||||||
Some files were not shown because too many files have changed in this diff Show More
Reference in New Issue
Block a user