Category: task

Alibaba Cloud Model Studio Crawl and Skill Generation

Prerequisites

• Node.js (for npx)
• Python 3
• Network access to the models page

Workflow

1. Crawl models page (raw markdown)

npx -y @just-every/crawl \"https://help.aliyun.com/zh/model-studio/models\" > alicloud-model-studio-models.md

1. Rebuild summary (models + API/usage links)

python3 skills/ai/misc/alicloud-ai-misc-crawl-and-skill/scripts/refresh_models_summary.py

1. Regenerate skills (creates/updates skills/ai/**)

python3 skills/ai/misc/alicloud-ai-misc-crawl-and-skill/scripts/refresh_alicloud_skills.py

Outputs

• alicloud-model-studio-models.md: raw crawl output
• output/alicloud-model-studio-models-summary.md: cleaned summary
• output/alicloud-model-studio-models.json: structured model list
• output/alicloud-model-studio-skill-scan.md: skill coverage report
• skills/ai/**: generated skills

Notes

• Do not invent model IDs or API endpoints; only use links present on the models page.
• After regeneration, update README.md, README.en.md, and README.zh-TW.md if skills list changed.

Validation

mkdir -p output/alicloud-ai-misc-crawl-and-skill
for f in skills/ai/misc/alicloud-ai-misc-crawl-and-skill/scripts/*.py; do
  python3 -m py_compile "$f"
done
echo "py_compile_ok" > output/alicloud-ai-misc-crawl-and-skill/validate.txt

Pass criteria: command exits 0 and output/alicloud-ai-misc-crawl-and-skill/validate.txt is generated.

Output And Evidence

• Save artifacts, command outputs, and API response summaries under output/alicloud-ai-misc-crawl-and-skill/.
• Include key parameters (region/resource id/time range) in evidence files for reproducibility.

References

• Source list: references/sources.md