Data Engineering
Design scalable ETL and ELT pipelines with clear contracts, validation, and observability.
Python · SQL · SparkKrishnakanth Mohanraj · Data Engineer | Cloud | AI
Designing scalable AWS-powered data platforms, intelligent ETL pipelines, and AI-enabled backend systems that transform raw data into actionable business insights.
I build cloud-native data platforms that enable organisations to ingest, process, store, and analyse data efficiently.
My work combines backend engineering, cloud architecture, distributed systems, and artificial intelligence to create scalable and reliable data solutions. I'm currently completing a Master of Information Technology at Monash University.
Design scalable ETL and ELT pipelines with clear contracts, validation, and observability.
Python · SQL · SparkDevelop secure cloud-native systems using managed and serverless AWS services.
AWS · Lambda · S3Build reliable APIs and event-driven services that connect data products.
FastAPI · REST · AuthCreate maintainable infrastructure for storage, transformation, and analytics.
Warehousing · ModellingIntegrate machine learning and generative AI where they add measurable value.
Bedrock · PyTorch · YOLODesign resilient services that scale across containers and cloud resources.
Docker · KubernetesNov 2022 — Jun 2024
Built complex SQL and Python workflows to extract, clean, validate, and transform enterprise datasets. Automated recurring transformation pipelines, developed Power BI reporting on AWS Redshift, and documented shared data definitions—reducing report turnaround by approximately 30% and manual reporting requests by approximately 20%.
Jun 2022 — Oct 2022
Prepared historical retail-sales data through cleaning, preprocessing, feature engineering, and exploratory analysis. Structured optimised SQL tables for repeatable analytical workflows, contributed to a Python forecasting model, and developed JavaScript REST API endpoints for downstream reporting applications.
Melbourne, Australia
Teach programming and computational thinking through practical Python, JavaScript, Scratch, and game-development projects, translating technical concepts into clear learning experiences.
Monash University · Melbourne, Australia
APIs · Files · Events
Lambda · API Gateway
Spark · Python · ETL
S3 · Warehouse · DynamoDB
SQL · Power BI · APIs
Bedrock · ML · YOLO
Decisions · Automation
Each project explains the problem, system design, engineering challenge, and outcome.
Enterprise cloud platform for automated profiling, quality assessment, and intelligent remediation.
Manual profiling makes quality issues slow to detect and difficult to explain.
A FastAPI service orchestrates profiling and AWS Bedrock-assisted remediation behind stable REST contracts.
Designing explainable AI outputs without weakening deterministic quality checks.
A reusable architecture for faster, governed data-quality assessment.
Cloud-native, event-driven platform for scalable bird-image processing and classification.
Media uploads and inference workloads require decoupled processing that can scale independently.
S3 events trigger Lambda workflows, YOLO inference produces structured results, and DynamoDB stores query-ready metadata.
Coordinating asynchronous events, secure access, and predictable failure recovery.
A serverless reference architecture with low operational overhead.
ATP analytics pipeline supporting feature engineering, prediction, statistics, and visualisation.
Raw historical match records need consistent transformations before modelling can be trusted.
A repeatable Python pipeline validates records, engineers predictive features, and feeds XGBoost and statistical analysis.
Preventing leakage while handling incomplete and time-sensitive match features.
A reproducible path from raw records to analysis-ready datasets.
Containerised computer-vision backend designed around scalable inference APIs.
Real-time pose inference requires reliable APIs and portable deployment across environments.
FastAPI exposes model inference through containerised services designed for Kubernetes orchestration.
Balancing inference latency, container size, and horizontal scalability.
A deployment-ready backend pattern for computer-vision workloads.
I approach data platforms as long-lived products: observable, secure, cost-aware, and easy for downstream teams to trust. Architecture decisions should reduce operational friction and make data more useful—not merely add technology.
Discuss a data platformClarify the business objective, users, data sources, constraints, and success measures.
Define contracts, architecture, security boundaries, failure modes, and observability.
Implement small, testable pipeline and service components with automated validation.
Package repeatable releases and provision infrastructure with operational safeguards.
Track freshness, quality, latency, cost, failures, and downstream service health.
Use evidence to improve performance, reliability, maintainability, and cloud spend.

Validated expertise in designing secure, resilient, high-performing AWS architectures.

Foundational understanding of AWS cloud concepts, services, security, and economics.
Public work spanning TypeScript and JavaScript applications, frontend systems, and ongoing engineering experiments.
class DataPlatform:
pillars = ["Scale", "Quality", "Trust"]
cloud_native = True
def transform(self, raw):
return raw.to_business_value()Data Engineer focused on cloud-native platforms, reliable pipelines, backend services, and pragmatic AI integration. Available for conversations with teams building modern data systems.
krishnakanthmohanraj21@gmail.comOpen to graduate roles
Open to full-time opportunities
Open to remote work
Start a conversation