Technical Documentation
This directory contains all technical documentation for the Ohpen case study project, including testing guides, implementation details, and best practices.
Testing & Validation
Quick Start & Guides
- Testing Quick Start - Get started with running tests quickly
- Testing Guide - Comprehensive testing documentation (Python + SQL)
- Test Runner Guide - Efficient test execution strategies
- Docker Testing - Dockerized test environment guide
Test Results & Metrics
- Test Results Overview - Test execution results and history
- Test Metrics Guide - Understanding test metrics and reporting
- Test Fixes 2026-01-24 - Recent test fixes and best practices
Standards & Conventions
- Unified Testing Convention - Testing standards across all tasks
- Test Suite Summary - Overview of test suites for all tasks
Environment & Setup
- PySpark Test Environment - PySpark testing setup and configuration
Implementation Guides
PySpark
- PySpark Migration Guide - Step-by-step migration guide
- PySpark Implementation Summary - Implementation details
- PySpark AWS Optimization Analysis - Performance optimization
Architecture & Services
- AWS Services Analysis - AWS service selection and usage
Task-Specific Testing
While general testing documentation is here, task-specific test implementations are in their respective task directories:
- Task 1 (ETL):
tasks/data_ingestion_transformation/tests/ - Task 3 (SQL):
tasks/sql/tests/ - Task 4 (CI/CD):
tasks/devops_cicd/tests/
For task-specific test execution, see:
- Task 1: Test Directory README (source only) - Task 1 test documentation
- Task 3: SQL Testing README (source only) - Task 3 SQL testing guide
- Task 4: CI/CD Testing (source only) - Task 4 CI/CD testing guide
Note: General test guides (Quick Start, Metrics, Runner, Docker) are now in this directory (docs/technical/) rather than in task directories for better organization and reusability.