Skip to content

Feedback on your ms365-tenant-manager skill #1033

@RichardHightower

Description

@RichardHightower

I found your ms365-tenant-manager skill while reviewing the latest grading batch—the approach to tenant lifecycle management caught my attention, though the current implementation leaves some room for refinement. At 72/100, there are some solid foundations here, but I wanted to dig into what's working and where we can push it further.

Links:

The TL;DR

You're at 72/100, solidly in C territory. This is based on Anthropic's best practices for agentic skills. Your Ease of Use scored the strongest at 19/25—the metadata and overall structure make sense—but Progressive Disclosure Architecture (18/30) and Utility (14/20) are dragging things down. The gap between what you promise and what you actually deliver is the core issue here.

What's Working Well

  • Structure and organization – Your section headers flow logically, and the 197-line skill doesn't feel scattered. The "How to Use" section and trigger scenarios are clearly laid out.
  • Realistic use cases – You nailed the practical scenarios: tenant setup, user management, security policies. These are real admin problems, not theoretical fluff.
  • Security awareness – You're thinking about guards, validation steps, and rollback procedures upfront. That mindset is solid, even if the execution is incomplete.

The Big One: Missing Reference Files and Examples

This is what's actually holding you back. You list five Python scripts (tenant_setup.py, user_management.py, etc.) in lines 58–64, but they don't exist. You promise "validation checklists" and "rollback procedures" in your output capabilities, but you don't provide actual templates.

For a Microsoft 365 admin skill, this is a credibility problem. If someone asks you to set up a tenant, they'll expect concrete PowerShell scripts or at least JSON templates—not vague guidance.

Here's the fix: Create a references/ directory with actual templates:

  • references/scripts/tenant-setup.ps1 (PowerShell for tenant initialization)
  • references/checklists/deployment-validation.md (actual checklist items)
  • references/rollback/ (rollback procedures by task type)

This alone adds 5+ points (PDA and Utility both improve).

Other Things Worth Fixing

  1. Add trigger phrases to the description – Currently it's just "Comprehensive Microsoft 365..." Add explicit triggers like "ms365 tenant manager", "Azure AD tenant setup", "PowerShell M365 admin". That's a quick +2 points (spec compliance).

  2. Inconsistent terminology – You mix "Azure AD" and "Azure Active Directory", "admin" and "administrator". Pick one per concept and stick with it. This affects ease of use and makes searching harder.

  3. No table of contents – At 197 lines, you're over the 100-line threshold. Add a quick TOC after the frontmatter to help navigation. +1 point.

  4. Marketing language creeping in – Phrases like "expert guidance" and "ready-to-use scripts" undermine credibility when the scripts don't exist. Stick to objective technical language.

Quick Wins

  • Highest impact: Create reference files for scripts and checklists (+5 points)
  • Easy win: Add trigger phrases to frontmatter description (+2 points)
  • Polish: Fix terminology consistency and add TOC (+2 points)
  • Total potential: 81/100 if you nail these three areas

Checkout your skill here: [SkillzWave.ai](https://skillzwave.ai) | [SpillWave](https://spillwave.com) We have an agentic skill installer that install skills in 14+ coding agent platforms. Check out this guide on how to improve your agentic skills.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions