Vibe Evaluator GitHub Action

A reusable GitHub Action that:

• Triggers the evaluation process
• Works with both private and public repositories

---

Inputs

Name	Description	Required	Default
isPrivate	Set to true to make the code private in Vibe Code Arena. Always private for private repositories.	false	"true"

---

Evaluation Results

The evaluation process typically takes about one hour to complete. Once finished, you can access the detailed summary and results on the Github Action Workflow.

---

Usage

This action authenticates with our Server using a GitHub OIDC token, so your workflow must grant the id-token: write permission. Without it, the action cannot request the token and the evaluation will fail. The contents: read permission is also needed for actions/checkout.

name: Evaluate Repository

on:
  push:
  workflow_dispatch:

permissions:
  id-token: write
  contents: read

jobs:
  evaluate:
    runs-on: ubuntu-latest

    steps:
      - name: Checkout repository
        uses: actions/checkout@v6

      - name: Run Vibe Evaluator
        uses: VibeCodeArena/vibe-evaluator@v1

Note: Permissions can be set at the workflow level (as shown above) or scoped to the individual job. If your workflow already defines a permissions block, make sure id-token: write is included, since setting any permission explicitly removes all the defaults.

Maintainer Build Instructions

npm install
npx husky init
npm run build
npm run start