Test Automation Platform

A complete web-based test automation platform for FortiGate and FortiAuthenticator, similar to Jenkins but specialized for mobile app testing.

🌟 Features

1. VM Dashboard

Monitor FortiGate and FortiAuthenticator virtual machines
Track test metrics (pass rate, failure rate, execution time)
Real-time resource monitoring (CPU, memory, disk usage)
Docker-based VM isolation
Start/Stop VMs with one click

2. AI-Powered Test Analysis

Automatic code analysis using Claude API
Calculate automation coverage vs manual tests
Compare with CSV-uploaded manual test cases
Intelligent failure analysis and recommendations

3. File Browser

Manage APK/IPA mobile test files
Automatic metadata extraction (version, signature, permissions)
Drag-and-drop file upload
Preview and download capabilities

4. Device Management

Auto-discover physical iOS and Android devices
Support for emulators and cloud devices
Real-time device status monitoring (battery, storage, availability)
One-click device selection for test execution
Health check and heartbeat monitoring

5. Test Execution

Docker-containerized test environments
Parallel test execution
Real-time log streaming via WebSocket
Automatic retry on failures
Detailed test reports

🚀 Quick Start

Prerequisites

Docker (20.10+)
Docker Compose (2.0+)
4GB+ RAM
10GB+ disk space

One-Command Deployment

./deploy.sh

That's it! The script will:

Check prerequisites
Create necessary directories
Generate .env file
Build and start all services
Initialize database with sample data

Access the Platform

After deployment completes:

Frontend: http://localhost:3000
Backend API: http://localhost:8000
API Documentation: http://localhost:8000/docs
Database: localhost:5432 (user: testuser, pass: testpass)
Redis: localhost:6379

📊 Architecture

┌─────────────────────────────────────────────────────────┐
│                     Web Frontend                        │
│              (React + Ant Design)                       │
└──────────────────┬──────────────────────────────────────┘
                   │ REST API / WebSocket
┌──────────────────▼──────────────────────────────────────┐
│                  Backend API                            │
│               (FastAPI + Python)                        │
└──────────────────┬──────────────────────────────────────┘
                   │
      ┌────────────┼────────────┐
      │            │            │
┌─────▼─────┐ ┌───▼────┐ ┌────▼─────┐
│PostgreSQL │ │ Redis  │ │  Docker  │
│ Database  │ │ Cache  │ │  Engine  │
└───────────┘ └────────┘ └──────────┘
                              │
                    ┌─────────┴──────────┐
                    │                    │
              ┌─────▼──────┐      ┌─────▼──────┐
              │  Appium    │      │  Physical  │
              │  Servers   │      │  Devices   │
              └────────────┘      └────────────┘

📁 Project Structure

test-platform/
├── backend/                 # FastAPI backend
│   ├── app/
│   │   ├── api/            # API endpoints
│   │   ├── models/         # Database models
│   │   ├── services/       # Business logic
│   │   └── core/           # Core configuration
│   ├── Dockerfile
│   └── requirements.txt
├── frontend/                # React frontend
│   ├── src/
│   │   ├── pages/          # Page components
│   │   └── components/     # Reusable components
│   ├── Dockerfile
│   └── package.json
├── test-files/             # Test file storage
│   ├── mobile-apps/        # APK/IPA files
│   ├── test-scripts/       # Test scripts
│   └── test-data/          # Test data
├── docker-compose.yml      # Docker Compose config
├── deploy.sh               # One-click deployment
└── README.md               # This file

🔧 Configuration

Environment Variables

Edit .env file to configure:

# Database
DATABASE_URL=postgresql://testuser:testpass@db:5432/testplatform

# Redis
REDIS_URL=redis://redis:6379/0

# Security
SECRET_KEY=your-secret-key-here

# AI Services (Optional)
CLAUDE_API_KEY=your-claude-api-key
OPENAI_API_KEY=your-openai-api-key

# Appium
APPIUM_ANDROID_URL=http://appium-android:4723
APPIUM_IOS_URL=http://appium-ios:4724

Adding AI Capabilities

To enable AI-powered features:

Get your API key from Anthropic
Add it to .env: CLAUDE_API_KEY=your-key-here
Restart services: docker-compose restart backend

📱 Connecting Physical Devices

Android Devices

Enable USB debugging on your Android device
Connect via USB
Verify connection: adb devices
In the platform, go to Devices → Refresh Devices

iOS Devices

Install libimobiledevice: brew install libimobiledevice
Connect iOS device via USB
Trust the computer on your device
Verify: idevice_id -l
In the platform, go to Devices → Refresh Devices

🧪 Running Tests

Via Web UI

Go to Tests page
Click "New Test Job"
Select VM and devices
Choose test scripts
Click "Start Test"

Via API

curl -X POST http://localhost:8000/api/tests/execute \
  -H "Content-Type: application/json" \
  -d '{
    "name": "Smoke Test",
    "vm_id": "vm-uuid",
    "device_ids": ["device-uuid"],
    "test_scripts": ["test_login.py"]
  }'

📊 Monitoring

View Logs

# All services
docker-compose logs -f

# Specific service
docker-compose logs -f backend
docker-compose logs -f frontend

Database Access

docker exec -it testplatform-db psql -U testuser -d testplatform

Redis Access

docker exec -it testplatform-redis redis-cli

🛠 Development

Backend Development

cd backend
python -m venv venv
source venv/bin/activate
pip install -r requirements.txt
uvicorn main:app --reload

Frontend Development

cd frontend
npm install
npm run dev

Running Tests

# Backend tests
cd backend
pytest

# Frontend tests
cd frontend
npm test

🔄 Common Operations

Stop All Services

docker-compose down

Restart Services

docker-compose restart

Update Code and Rebuild

docker-compose down
docker-compose up -d --build

Remove Everything (Including Data)

docker-compose down -v

Backup Database

docker exec testplatform-db pg_dump -U testuser testplatform > backup.sql

Restore Database

cat backup.sql | docker exec -i testplatform-db psql -U testuser -d testplatform

📚 API Documentation

Once the platform is running, visit:

http://localhost:8000/docs

This provides interactive Swagger documentation for all API endpoints.

🎯 Usage Examples

1. Create a VM

import requests

response = requests.post('http://localhost:8000/api/vms', json={
    'name': 'FortiGate-Test-VM',
    'platform': 'FortiGate',
    'version': '7.4.2',
    'test_priority': 5
})
print(response.json())

2. List Available Devices

response = requests.get('http://localhost:8000/api/devices', params={
    'status': 'available'
})
devices = response.json()['devices']

3. Upload Test File

files = {'file': open('FortiClient.apk', 'rb')}
response = requests.post('http://localhost:8000/api/files/upload', files=files)

🐛 Troubleshooting

Backend Won't Start

Check Docker is running: docker ps
Check logs: docker-compose logs backend
Verify database is healthy: docker-compose ps db

Can't Connect to Database

Ensure PostgreSQL container is running
Check connection string in .env
Wait for database to be healthy: docker-compose logs db

Devices Not Detected

For Android: Run adb devices to verify connection
For iOS: Run idevice_id -l to verify connection
Check Appium logs: docker-compose logs appium-android

Port Already in Use

Change ports in docker-compose.yml
Or stop conflicting services

🔒 Security Notes

⚠️ Important: This is a development setup. For production:

Change all default passwords in .env
Use HTTPS (add nginx with SSL)
Enable authentication (implement JWT)
Restrict Docker socket access
Use secrets management (HashiCorp Vault, AWS Secrets Manager)
Enable firewall rules
Regular security updates

🤝 Contributing

Contributions are welcome! Please:

Fork the repository
Create a feature branch
Make your changes
Add tests
Submit a pull request

📝 License

MIT License - See LICENSE file for details

🆘 Support

Documentation: Check /docs folder
Jenkins Cloud runner API: See docs/JENKINS_CLOUD_API.md for the Jenkins Cloud endpoints used to trigger and monitor multi-platform test runs.
API Docs: http://localhost:8000/docs
Issues: Create a GitHub issue
Email: support@example.com

🎉 Credits

Built with:

FastAPI
React
Ant Design
Docker
PostgreSQL
Redis
Appium

📈 Roadmap

Kubernetes deployment support
Advanced test scheduling
Integration with CI/CD pipelines
Real-time test result dashboards
Machine learning for test failure prediction
Multi-tenant support
Advanced reporting and analytics
Cloud device farm integration (AWS, BrowserStack)

Happy Testing! 🚀

Name		Name	Last commit message	Last commit date
.claude		.claude
backend		backend
certs		certs
docs		docs
frontend		frontend
.env		.env
.env.example		.env.example
.gitignore		.gitignore
AUTHENTICATION_GUIDE.md		AUTHENTICATION_GUIDE.md
CLAUDE.md		CLAUDE.md
JENKINS_DOCKER_IMPLEMENTATION_SUMMARY.md		JENKINS_DOCKER_IMPLEMENTATION_SUMMARY.md
JENKINS_EXECUTION_ENGINE.md		JENKINS_EXECUTION_ENGINE.md
JENKINS_IMPLEMENTATION_SUMMARY.md		JENKINS_IMPLEMENTATION_SUMMARY.md
JENKINS_WORKFLOW_GUIDE.md		JENKINS_WORKFLOW_GUIDE.md
PR_DESCRIPTION.md		PR_DESCRIPTION.md
README.md		README.md
WORKER_DASHBOARD_SUMMARY.md		WORKER_DASHBOARD_SUMMARY.md
deploy.sh		deploy.sh
docker-compose.yml		docker-compose.yml

Latest commit

History

Folders and files

Repository files navigation