Skip to content

Conversation

Copy link
Contributor

Copilot AI commented Jan 19, 2026

Validates that ghcr.io/githubnext/serena-mcp-server:latest correctly supports Go, Java, JavaScript, and Python through the MCP protocol using stdio communication.

Test Script (test_serena.sh - 488 lines)

  • 20+ test cases across 13 sections: infrastructure, language runtimes, MCP protocol, language-specific analysis (symbols/diagnostics), error handling
  • Sends JSON-RPC requests over stdin, validates responses against known sample codebases
  • Color-coded output, JSON response logging, success rate calculation
  • Exit codes for CI/CD integration
# Usage
./test/serena-mcp-tests/test_serena.sh
SERENA_IMAGE="serena-mcp-server:local" ./test/serena-mcp-tests/test_serena.sh

Sample Codebases

Four Calculator implementations with known symbols for validation:

  • Go: 3 files (Calculator type, Add/Multiply methods, utilities)
  • Java: 2 files (Calculator class, Utils with JavaDoc)
  • JavaScript: 3 files (Calculator class, CommonJS exports)
  • Python: 2 files (Calculator with type hints, docstrings)

Tests validate each language server can:

  • Find symbols (functions, classes, methods)
  • Run diagnostics
  • Handle initialization and tool listing

Documentation

  • README.md (265 lines): Complete reference with test categories, troubleshooting, extension guidelines
  • QUICKSTART.md (159 lines): Quick start and common issues
  • expected/README.md (120 lines): Expected MCP response structures

Structure

test/serena-mcp-tests/
├── test_serena.sh           # Main test script
├── README.md                # Complete documentation
├── QUICKSTART.md           # Quick start guide
├── expected/               # Expected response formats
└── samples/                # Sample codebases
    ├── go_project/
    ├── java_project/
    ├── js_project/
    └── python_project/

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Copilot AI and others added 4 commits January 19, 2026 05:34
Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>
…tests

Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>
Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>
Co-authored-by: lpcox <15877973+lpcox@users.noreply.github.com>
Copilot AI changed the title [WIP] Add comprehensive shell script tests for mcp server Add comprehensive shell test suite for Serena MCP server multi-language support Jan 19, 2026
Copilot AI requested a review from lpcox January 19, 2026 05:41
@lpcox lpcox marked this pull request as ready for review January 19, 2026 16:32
@lpcox lpcox merged commit 36e58d2 into main Jan 19, 2026
3 checks passed
@lpcox lpcox deleted the copilot/add-shell-script-tests branch January 19, 2026 16:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants