Prince Raj
Software Engineer
Full-stack systems · LLM evaluation · AWS
- praj81232@gmail.com · +91 82183 28333
- Noida, India
- linkedin.com/in/prince404 · github.com/HardCoder404
- prince404.in
scan for live site
Summary
Software engineer with 2+ years of experience shipping full-stack products on Node, Next.js and AWS, and the last year on LLM evaluation: engineering the code-migration harness behind a Microsoft frontier-model program, designing rubrics and the platforms that score them. B.Tech CSE at Galgotias University (9.4 CGPA), graduating 2026.
Experience
Quess Corp · Client: Ethara AI
Feb 2026 – Present · Gurugram, IndiaSoftware Engineer - Gen AI & Full Stack
- Architected and owned an end-to-end code-migration evaluation harness for a Microsoft frontier-model program, extending the RepoTransBench research benchmark into a production evaluation workflow adopted by the tasking team.
- Engineered 1,200+ multi-architecture Docker images (amd64, arm64) across 16 programming languages for LLM evaluation infrastructure, parallelised builds with Docker BuildKit and published to AWS ECR for high-throughput evaluation.
- Built an end-to-end Python data pipeline generating a Supervised Fine-Tuning (SFT) dataset for a frontier coding model: mined bounty-linked GitHub issues, filtered issue-resolving pull requests, extracted verified fix and test patches, and produced structured JSONL ground-truth instances across 16 languages.
- Designed a registry-driven evaluation harness with per-repository build, dependency and test configurations for 50+ open-source projects (Redis, curl, systemd, Valkey, DiceDB), enabling deterministic, automated scoring of LLM-generated patches in isolated containers.
- Owned grading and output verification: produced specification-compliant output bundles and agent trajectories, audited every sample end to end, and ran binary-rubric and side-by-side (SxS) evaluations against GPT-5.2 and Gemini-3 Pro, delivering structured JSON reports used in post-training analysis.
WhatBytes
Aug 2025 – Jan 2026 · Bengaluru, IndiaFull Stack Developer
- Architected an internal LLM benchmarking platform using Next.js, Node.js, and Redis to evaluate and compare outputs across 5+ frontier LLM APIs simultaneously.
- Designed multi-turn conversation evaluation pipelines, capturing per-turn scoring and semantic quality metrics across 10,000+ benchmark prompts.
- Automated data validation workflows by enforcing structured JSONL output schemas and mandatory rationale checks, cutting manual QC audit overhead by 35%.
- Engineered configurable task-generation modules, allowing engineering teams to dynamically test model outputs against custom rubric criteria and export validated datasets for fine-tuning.
DevTown
Jun 2024 – Jul 2025 · Mumbai, IndiaSDE I
- Engineered 30+ scalable RESTful APIs using the MERN stack to power core platform features, standardizing frontend-backend data flow and implementing secure JWT-based user authentication.
- Architected an AI-powered chat application from the ground up, streamlining component rendering and backend data processing to improve frontend efficiency by 60% and backend performance by 30%.
- Optimized AI model response pipelines through strategic API design and advanced caching mechanisms, successfully reducing AI response latency from 1.86s to 1.2s (a 35% improvement).
- Led a cloud infrastructure cost-optimization initiative, identifying underutilized AWS resources and enforcing S3 lifecycle expiration policies to reduce annual AWS expenditures by over $50,000.
- Executed zero-downtime database migrations (leveraging NeonDB) and implemented robust security protocols, improving overall system scalability and operational efficiency by 40%.
- Spearheaded the rollout of new platform features across the MERN stack, establishing reusable UI components that cut down average development time by 40% and accelerated product iteration cycles.
Xipper
Nov 2023 – Jan 2024 · Bengaluru, IndiaFull Stack Developer (Internship)
- Designed and integrated 25+ RESTful APIs, reducing system overload and enhancing communication between frontend and backend systems by 30%, ensuring robust and scalable interactions.
- Designed scalable real-time communication features using WebSocket, ensuring smooth and reliable user experiences in live chat applications, reducing latency issues by 35%.
- Participated in regular code reviews and unit testing, identifying architectural bottlenecks and reducing legacy technical debt across shared modules by 30%.
- Optimized frontend rendering performance in React.js, reducing unnecessary DOM updates to deliver smoother tab switching and faster client-side navigation.
Selected projects
Agent Studio · Product · live
Next.js · React Flow · TypeScript · FastAPI · LangGraph · PostgreSQLA visual builder and time-travel debugger on top of an execution and evaluation harness for multi-agent workflows. Execution harness on LangGraph: a save point after every step, so runs can pause for a human, resume, or fork with edited state. A full run of the demo workflow costs about $0.00007 and a fork re-runs nothing it already did. Deployed end to end on free tiers.
github.com/HardCoder404/agent-studio
SafeReport · Product
Next.js · TypeScript · Prisma · NeonDB (Postgres) · Gemini AI · NextAuthAI-powered anonymous crime reporting platform. Gemini-powered incident analysis that classifies the report, extracts key facts and drafts the structured report automatically. A complete report in under a minute, tracked until it is resolved, with the reporter's identity never stored.
github.com/HardCoder404/crime-report-app
Production-grade Backend · Open source
Node.js · Express · TypeScript · MongoDB · Docker · AWS ECR / EC2Typed Node/Express API with a real CI/CD path to AWS. TypeScript Express API with versioned routes, health and version endpoints. Push to main, live on EC2 a few minutes later. Used as the base for my own services.
github.com/HardCoder404/production-grade-backend
AWS Deployment with CI/CD Guide · Open source · most-starred
AWS EC2 · Nginx · PM2 · Docker · AWS ECR · GitHub ActionsFrom SSH + PM2 + Nginx to Docker + ECR + GitHub Actions. Two complete paths: a basic PM2 + Nginx setup and a Docker + ECR + GitHub Actions pipeline. A guide other developers actually use; my most-starred repository.
github.com/HardCoder404/AWS-Deployment-with-CICD-Guide
Skills
Use in production: TypeScript, JavaScript, Node.js, Next.js, React, Express.js, PostgreSQL, MongoDB, Prisma, REST APIs, AWS (EC2, S3, CloudFront, Lambda), Docker, GitHub Actions / CI/CD, Tailwind CSS, Framer Motion
Comfortable: Python, SQL, Redis, GraphQL, Microservices, Event-driven systems, Serverless, Supabase, React Native, Angular, Zoho / Canva APIs
Going deeper: Kubernetes, LLM evaluation at scale, Observability, System design
AI / LLM work: Rubric design, SxS evaluation, Benchmarking (GPT-5.2, Gemini-3 Pro), Multi-turn conversation scoring, Gemini API, OpenAI API, Prompt design
Education
B.Tech, Computer Science and Engineering
Aug 2022 – Sep 2026Galgotias University, Noida
CGPA 9.4 / 10Senior Secondary (PCM)
Feb 2020 – Mar 2022New Lancer Convent School
92%Achievements & certifications
- LeetCode 1800+ contest rating (3-star), 700+ DSA problems solved, 200+ day streak
- Codeforces rating 1200+
- GSSoC 2024 open-source contributor
- AWS Academy Graduate: Cloud Foundations and Cloud Architecting
- 9.4 CGPA in B.Tech CSE
- GirlScript Summer of Code 2024, Open-source contributor (May – Jun 2024)
