Initialising
Srikrishna Pradeep Jorige
Senior Data Engineer · AI Systems Builder
Open to Senior Data Engineer & AI Engineer roles — globally

Srikrishna Pradeep Jorige

5+ Years MSc AI · QMUL TA · UCL London Uber · Indium Software

I design and build data platforms and AI systems that operate at enterprise scale — from identity-resolution pipelines powering the AI annotation supply chain for Google, Meta, Amazon, Microsoft, and Zoom, to agentic AI tools that cut schema design from days to minutes. My work sits at the intersection of data engineering depth and applied AI, always with measurable impact on the teams and clients I serve.

Scroll to explore
83%
Workload reduced through automation across Uber pipelines
70+
Production-grade Spark pipelines built and maintained
10+
Freshers onboarded, mentored and made project-ready
Days → Minutes
AI cuts schema design from days to minutes, every time
01 / About

The engineer behind the systems

Srikrishna Pradeep Jorige
Available for opportunities
Srikrishna Pradeep Jorige
Senior Data Engineer · AI Builder
LocationHyderabad, India
Experience5+ Years
CurrentIndium Software
MScAI · QMUL London
TeachingTA · UCL London
ClientsUber · Google
Gem Award2025
Shining Star Award2026

I'm a Senior Data Engineer with an MSc in Artificial Intelligence from Queen Mary University of London — a rare combination that lets me build systems where data engineering rigour and applied AI aren't separate disciplines.

My most significant work is the 3P SSOT system for Uber AI Solutions — the data engineering backbone of Uber's AI annotation supply chain. Tech giants like Google, Meta, Amazon, Microsoft, and Zoom use human-annotated data to train their AI models, outsourcing annotation tasks to vendors like Uber. I solely designed and built the system that consolidates all worker identity, task assignments, quality scores, billing rates, and vendor payments — previously scattered across dozens of disconnected spreadsheets — into one governed Hive data layer. It now powers an executive dashboard tracking 78 projects, $3.11M in revenue, and 94.96% quality across 237K+ annotation tasks. The identity-resolution architecture — a union-find graph with source-trust ranking across 8+ disjointed systems — was my own design.

Alongside the data platform work, I build AI products: Liftr AI — an agentic MCP-based platform for end-to-end data operations via conversational workflows — and the AI Data Modeling Assistant, a LangGraph agent that takes raw data and generates production-ready schemas across 10 modeling methodologies with a Pinecone RAG knowledge base.

I've led teams of 6–8 engineers, mentored 10+ freshers from zero industry experience to independent contributors, and spent a year as a Graduate Teaching Assistant at UCL alongside my MSc — running seminars, supervising dissertations, and building the habit of translating complexity into clarity.

Timeline
May 2025
Present
Senior Data Engineer
Indium Software · Hyderabad
Jun 2024
May 2025
Data Engineer
Indium Software · Hyderabad
Dec 2022
Jan 2024
Graduate Teaching Assistant Part-time
University College London · UK
2022
2023
MSc Artificial Intelligence
Queen Mary University of London
Jan 2020
Aug 2022
Software Development Engineer
Modak · Hyderabad
02 / Work

Where I've built

UB
Indium Software — Uber Account
Data Engineer · Senior Data Engineer·Jun 2024 – Present
Active
Uber AI Solutions · UAIS
4 projects
Uber AI Solutions · UAIS Flagship · Sole ownership
3P SSOT — Annotation Data Platform
Production data platform consolidating the entire AI annotation supply chain into one governed source of truth — serving Google, Meta, Amazon, Microsoft, Zoom and other AI companies
Tech giants like Google, Meta, Amazon, Microsoft, and Zoom need massive human-annotated datasets to train their AI models — they outsource this annotation work to vendors like Uber, who assign Raters, Experts, and Auditors to tasks (prompts, responses, transcription, video). Uber in turn works with sub-vendors. The result is a complex web of workers, tasks, skills, quality scores, billing rates, and vendor payments — all of it was previously scattered across dozens of disconnected Google Sheets with no reliable way to get a complete picture. I solely designed and built the 3P SSOT system to solve this: a union-find identity-resolution graph that reconciles every worker's UUID, vendor, skill level, and engagement type from 8+ disjointed systems into one authoritative record, then joins it with task, quality, and billing data across three production Piper pipelines into governed Hive tables. Now every question — which workers are on which tasks, what the quality is, what revenue is flowing, how vendors are being paid — is answerable from one place.
610K+Persons identity-resolved
10M+Task rows in SSOT table
95%UUID resolution rate
$3.11MRevenue tracked
  • Built three production Piper pipelines: hourly worker data enrichment, hourly operational SSOT join (attaches resolved identity to every task row with quality scores, billing rates, and project metadata), and daily retainer billing (shift hours, downtime, vendor/client cost)
  • Reconciles worker data from 8+ disjointed source systems — KWM Profile, KWM Spine, Taurus, Pinnacle, DIM_CLIENT, WHOBER, onboarding records, alias bridges — into a single authoritative record per worker with source-trust ranking
  • CQIA Report Automation quality exports are one of its structured source inputs — transformed and loaded into SSOT Hive tables as the quality metrics layer that tech giants use to validate and pay for completed work
  • Pipeline output is the sole upstream data source for an executive analytics dashboard used by Uber leadership to track all AI annotation operations across Google, Meta, Amazon, Microsoft, Zoom and other clients
Piper / AirflowHivePythonPresto / SparkGoogle Sheets API
Uber AI Solutions · UAIS Sole ownership
CQIA Report Automation
Consensus, Quality, Insights & Audit — automating the reporting cycle that validates AI training data quality for tech giants
When tech giants assign annotation tasks to Uber's workforce, each task goes through a structured quality pipeline: multiple Raters independently answer the same task (Consensus), their outputs are scored against quality thresholds (Quality), patterns are surfaced across tasks (Insights), and senior Auditors do a final independent review (Audit). These four report types were previously generated manually using Google Sheets formulas — a slow, error-prone process. I built CQIA Report Automation to fully automate this cycle: AppScript handles the UI and workflow triggers, Google Sheets serves as the backend and input store, and Python runs all processing logic to produce standardised, scalable reports across any task template. The quality details extracted from each cycle feed directly into the 3P SSOT pipeline as the governed quality metrics layer.
3k+Reports generated
<10 minWas 2–3 hours
4Report types automated
  • Consensus — aggregates responses from multiple Raters on the same task, identifies agreement patterns and surfaces the most accepted answer per question
  • Quality — scores per-worker output against defined rubrics; these scores are extracted to a structured export tab and ingested by the 3P SSOT pipeline as the quality metrics layer
  • Insights — surfaces trend analysis across tasks and worker cohorts; helps Uber and clients understand which task types or templates have quality issues
  • Audit — generates independent review reports for senior Auditors who assess tasks without replication; final verdict layer in the quality pipeline
  • Designed for reliability and scalability across multiple task types and client templates within Uber AI Solutions; used across 3,000+ reports
PythonGoogle Apps ScriptGoogle SheetsPiper / AirflowHive
Uber AI Solutions · UAIS
AI Data Insights Assistant
Automated analytics platform — raw datasets to dashboards with zero manual configuration
Converts raw datasets into automated dashboards with KPIs and visual insights using LLMs. AI-based interpretation eliminates dependency on manual dashboard creation for analytics teams.
  • Converts raw datasets into dashboards with KPIs and visual insights automatically
  • AI interpretation layer reduces time from data to business decision from hours to minutes
  • Deployed for Uber AI Solutions analytics workflows
LLMsPythonStreamlitLooker Studio
Uber AI Solutions · UAIS
Pinnacle Leave Tracker
Two-way leave management system replacing manual Google Forms and email approval chains
Built a full-stack leave management application that auto-checks leave balances and eligibility, routes approvals to managers with full team visibility, and eliminates the manual back-and-forth of Forms + email. Piloted with 500 employees with positive feedback.
500Employees piloted
80%Admin effort cut
LivePilot status
  • Replaced manual Google Forms + email approval chain with automated two-way workflow
  • Auto-checks leave balances, eligibility criteria; managers approve with full team visibility
  • Potential for org-wide rollout based on pilot feedback
ReactJavaGoogle Workspace
Global Intelligence
3 projects
Global Intelligence Core Infrastructure
GI Pipeline Infrastructure & Modernisation
Hive → Spark migration · Route sampling · Time-zone engineering · Observability
Solely responsible for building and modernising the full data infrastructure that powers Uber's Global Intelligence pricing metrics. Four workstreams: migrating 16 legacy Hive pipelines to Spark across 5 pipeline categories, building a route sampling pipeline that generates statistically representative fare samples per country-market accounting for local geography and seasonal time-zone changes, maintaining time-zone correctness across 3 DST adjustment rounds, and building observability dashboards across all GI pipelines.
16Hive→Spark pipelines
45Country-markets covered
3DST rounds, zero incidents
  • Pipeline migration — migrated 16 Hive pipelines to Spark across 5 categories: Vendor Ingestion (3 competitor data feed pipelines), Core Metrics (trips_cp, billings_cp), NPI & Sessions, Publication, and Archival — all with zero data loss
  • Route sampling pipeline — built from scratch to generate statistically representative fare samples per country-market, accounting for local geography and fare structures; expanded to 45 country-markets — this is the foundation that makes global fare comparisons meaningful and comparable across markets
  • Time-zone engineering — maintained fare timestamp correctness across 3 Daylight Saving Time adjustment rounds covering North America, Europe, and APAC; zero incidents — critical because incorrect timestamps break fare-per-trip calculations globally
  • Observability — built Tableau dashboards tracking table freshness, storage footprint, SLA adherence, and failure indicators; migrated 120+ test cases to UDQ framework
PySparkHiveSQLAirflowTableauUDQPython
Global Intelligence
Vendor Feed Onboarding
12 external competitive intelligence feeds across 7 vendors — raw data layer for GI metrics
Onboarded 12 external data feeds from 7 vendors into the GI data layer, each unlocking a distinct dimension of competitive market insight. Built schema validations, integrity checks, quality monitoring, and SLA adherence for every feed.
12Feeds onboarded
7Vendor sources
ZeroData loss
  • Built 7 dedicated ingestion pipelines — one per vendor — each with schema validation, data integrity checks, quality monitoring, and SLA adherence, writing to governed Hive tables that feed the GI metrics layer
  • Competitor fare quotes from rival rideshare platforms — direct input to the Normalized Price Index (NPI) and Price Distance Index (PDI) metric computation; enables Uber to benchmark its pricing against competitors in real time
  • Restaurant and menu pricing data from food delivery platforms — restaurant-level item pricing and menu structure; powers item-level price comparison and menu intelligence for Uber Eats competitive analysis
  • Subscription and membership data from competing delivery services — enables subscription penetration analysis by market and cross-vertical competitive benchmarking
  • Merchant and catalogue data from structured merchant communications — supplements item catalogue and pricing data; enables merchant feature development and analytics
PySparkPythonAirflowData QualityHiveSQL
Global Intelligence
GI Business Metrics — NPI, PDI, ERI & Competitive Intelligence
Five production pricing metrics consumed by Marketplace Health, Pricing Strategy, and Competitive Intelligence teams
Built and validated the five core GI business metrics that Uber's pricing, strategy, and competitive intelligence teams rely on for market decisions globally. Each metric has a precise economic definition and a distinct downstream consumer — this is the production data layer that makes pricing decisions possible at scale.
  • NPI (Normalized Price Index) — measures Uber's price relative to competitors; primary signal for Competitive Intelligence and Pricing Strategy teams to assess market position
  • PDI (Price Distance Index) — quantifies fare variation by distance band within a city; used by Marketplace Health to detect pricing anomalies and ensure fare consistency
  • ERI (Effective Rate Index) — captures the actual effective rate drivers earn after incentives and fees; key input for driver supply and earnings policy teams
  • trips_cp & billings_cp — competitive trip volume and billing comparisons per market; consumed by Strategy teams for market share analysis and growth planning
  • All 5 metrics computed at country-market granularity, validated against source data, and published to Hive tables consumed by multiple analyst and product teams
PythonSQLPySparkHiveTableau
Safety Ops
1 project
Safety Ops
Pipeline Modernisation & Standardisation
Architectural leadership — 150+ fragile Jupyter notebooks consolidated into a scalable, reusable Spark pipeline platform
The Safety Ops team had 150+ Jupyter notebooks scheduled as production "pipelines" — each one fragile, non-reusable, and difficult to debug or extend. I led the architectural redesign: defined how pipelines should be structured for scalability and reliability, directed the team in rebuilding them as proper Spark pipelines on Airflow using the Piper framework, and established a reusable, modular codebase. Consolidated from 150+ notebooks to 50+ well-structured pipelines with zero functionality lost and the entire team's requirements maintained.
150→50+Notebooks to pipelines
70%Failure rate reduced
6–8Engineers led
  • Inherited 150+ Jupyter notebooks scheduled as pipelines — each notebook was an isolated script with no shared logic, inconsistent error handling, and high failure rates
  • Defined the target architecture: proper Spark pipelines on Airflow/Piper with a reusable codebase, consistent structure, and standardised error handling; directed 6–8 engineers in the migration
  • Consolidated to 50+ well-structured pipelines — reduced pipeline failure rate by 70%, significantly easier to maintain, debug, and extend; zero functionality lost
  • Improved traceability, reliability, and onboarding speed across Safety Ops — new engineers can now understand and contribute to pipelines in days rather than weeks
PySparkAirflow / PiperPythonSQL
Rider Team
1 project
Rider Team
Spark 2.4 → 3 Migration
Critical pipeline modernisation — full migration within a 2-month deadline, zero downtime
Migrated all Spark 2.4 pipelines within a 2-month critical deadline with zero disruption to production. Refactored code, resolved compatibility issues, implemented robust error handling, and ran full unit, integration, and E2E validation — zero data loss.
2 monthsDelivered on time
ZeroDowntime
100%Data integrity
  • Migrated all Spark 2.4 pipelines within a 2-month critical deadline with zero disruption
  • Refactored code, resolved compatibility issues, implemented robust error handling throughout
  • Full unit, integration, and E2E validation — zero data loss confirmed
PySparkSpark 3Python
AI
Indium Software — Internal AI Products
Senior Data Engineer · AI Platform Lead·2024 – Present
Indium AI Products Flagship
Liftr AI Platform
Agentic platform for end-to-end data operations through conversational workflows
Built Liftr AI — Indium's agentic data engineering platform that lets users query, profile, migrate, and transform data through conversational workflows, with no manual SQL or pipeline code required. I designed and owned the MCP-based execution layer end-to-end: tool registration, validation, access control, and full audit trail. Integrated LangGraph for stateful multi-step reasoning — the agent plans, executes, validates, and self-corrects across heterogeneous data systems.
  • MCP-based execution layer with tool registration, validation, access control, and audit trail for every operation
  • LangGraph stateful reasoning — agent plans, executes, validates, and self-corrects in a single conversation
  • Data-source agnostic: connects to Hive, PostgreSQL, BigQuery, Snowflake, and flat files through a unified interface
  • Tasks that previously required pipeline code and hours of iteration now complete in minutes
MCP ServersLangGraphClaude AIFastAPIPythonHivePostgreSQL
Indium AI Products Full-stack · 4 deploy targets
AI Data Modeling Assistant
Agentic schema generation — raw data to production-ready warehouse in minutes
Built an end-to-end AI-powered data modeling platform. A stateful LangGraph agent ingests raw data (CSV, Parquet, databases, Google Sheets), profiles it via an embedded DuckDB engine with PK/FK and relationship detection, recommends one of 10 modeling methodologies, generates the schema, self-validates, and self-corrects before output. A Pinecone-powered RAG knowledge base with 18 curated documents ensures every recommendation is grounded in established data modeling theory. Shipped across four deployment targets from one shared engine.
  • Supports 10 methodologies: Star, Snowflake, Galaxy, Inmon 3NF, Data Vault 2.0, Anchor, OBT, Medallion, Hybrid, and Flat Denormalized — agent selects and justifies the right one based on profiled data characteristics
  • Full artifact suite (12 types): multi-dialect SQL DDL, Mermaid ERD, draw.io XML, data dictionary, dbt YAML + SQL project ZIP, semantic layer YAML, migration scripts, data quality rules, sample queries, lineage map, and one-click DDL deploy
  • RAG knowledge base using Pinecone vector database with 18 documents — methodology trade-offs, domain-specific modeling patterns, and best practices grounding every agent recommendation
  • 20 MCP tools for Claude Code / Cursor — covering profiling, methodology selection, schema generation, artifact export, and HITL review workflows with WebSocket streaming
  • Shipped as: React + FastAPI web app · Flask reference build · MCP server for Claude Code / Cursor · packaged AI-assistant Cursor skills
LangGraphGPT-4oPineconeReactFastAPIDuckDBdbtMCP ServersRAGPostgreSQLWebSocket
UCL
University College London
Graduate Teaching Assistant·London, UK·Part-time alongside MSc
Graduate Teaching Assistant Dec 2022 – Jan 2024 · Part-time
Software Engineering & AI Dissertation Supervision
University College London — alongside MSc in Artificial Intelligence at QMUL
Held the TA role simultaneously with my MSc — running graduate seminars on Software Engineering for MSc students at UCL, guiding teams building full production applications, and mentoring MSc students through AI and Deep Learning dissertations. Developed the ability to translate complex engineering problems into clarity under pressure — a skill that now directly shapes how I lead teams.
  • Led graduate seminars on core Software Engineering; evaluated architecture decisions, code quality, and delivery
  • Guided student teams through building full production applications applying SE principles end-to-end
  • Mentored MSc students through AI and Deep Learning dissertation projects — research direction, model selection, implementation
Software EngineeringGraduate TeachingAIDeep LearningResearch Supervision
MK
Modak
Software Development Engineer·Hyderabad, India·Jan 2020 – Aug 2022
Modak · Software Development Engineer Jan 2020 – Aug 2022
Nabu — Enterprise Data Migration Platform
Multi-cloud metadata crawling, migration, profiling & indexing · Clients: Humana, AbbVie, GSK
Core contributor to Nabu across four of its sub-systems. Nabu is Modak's enterprise platform for migrating, profiling, and indexing data across cloud environments. My work spanned the full stack — from crawling metadata out of cloud databases, to writing migration workflows, to building the one-script Azure deployment that brings the entire platform up from nothing.
70%Faster workflows
70%Infra setup reduced
100%Zero data loss
  • Nabu Crawlers — built multi-threaded metadata crawlers across 7 cloud targets using Java, Kafka, CDC
  • Nabu Botworks — wrote migration workflow scripts enabling zero-data-loss migration across all targets
  • Migration Engine — wrote PySpark scripts for Spark local, cloud, and Databricks execution targets
  • Nabu Terraform — solely built one-script Azure deployment provisioning all resources; coordinated across multiple internal teams; reduced setup by ~70%
Nabu Crawlers
Multi-threaded metadata crawlers across Azure Synapse, Redshift, BigQuery, Snowflake, ADLS Gen 2, S3, and GCP Bucket using Java, Kafka, and CDC protocols
Nabu Botworks
Migration workflow scripts enabling zero-data-loss migration across all cloud targets — orchestrates crawling, schema mapping, data movement, and validation end-to-end
Migration Engine
PySpark migration scripts supporting three execution targets: Spark local, cloud (Azure/AWS/GCP), and Databricks — improved workflow speed by ~70%
Nabu Terraform SOLE-BUILT
Single Terraform script provisioning all Azure resources (VMs, networking, storage, Nabu UI) in one execution — coordinated across internal teams; reduced setup by ~70%; primary use for Humana client
JavaKafkaCDCPySparkTerraformBigQuerySnowflakeAzure SynapseADLS Gen 2Databricks
03 / Skills

Technical arsenal

Python5 / 5
PySpark5 / 5
SQL / T-SQL5 / 5
Java3.5 / 5
FastAPI / Flask4.5 / 5
React / TypeScript4 / 5
Streamlit / AppScript4 / 5
Shell / Bash3.5 / 5
Presto / Trino SQL4 / 5
GraphQL3 / 5
LangChain / LangGraph4.5 / 5
OpenAI GPT-4o5 / 5
Claude / Anthropic API4.5 / 5
MCP Servers4.5 / 5
Agentic AI Systems4.5 / 5
RAG Pipelines4.5 / 5
Prompt Engineering4.5 / 5
ML / NLP / Deep Learning80%
Vector Databases / Embeddings4 / 5
HITL Pipelines4 / 5
WebSocket Streaming3.5 / 5
BMAD / SpecKit3.5 / 5
Apache Spark5 / 5
Apache Airflow4.5 / 5
ETL / ELT Pipelines5 / 5
Data Modeling4.5 / 5
Data Lakehouse / DeltaAdvanced
Kafka4 / 5
dbt4 / 5
Data Governance3.5 / 5
Piper (Airflow-based)4.5 / 5
Data Vault 2.04.5 / 5
Medallion Architecture4.5 / 5
CDC (Change Data Capture)4 / 5
Metadata Management4 / 5
Data Lineage4 / 5
Pipeline Observability4 / 5
Tableau / Looker Studio4 / 5
Azure (ADF, Databricks, Synapse)4.5 / 5
GCP (BigQuery, Dataflow)Advanced
AWS (Glue, S3, Redshift)3.5 / 5
Docker3.5 / 5
Terraform3.5 / 5
Git / GitHub / CI/CDAdvanced
Microservices4 / 5
REST APIs4.5 / 5
Databricks4.5 / 5
ADLS Gen 2 / S3 / GCP Storage4 / 5
Jira / Agile3.5 / 5
BigQuery4.5 / 5
PostgreSQL4.5 / 5
Snowflake4 / 5
Apache Hive4.5 / 5
Azure Synapse4 / 5
DuckDB3.5 / 5
Redshift3.5 / 5
MySQL3.5 / 5
Presto / Trino4 / 5
Google BigTable / Spanner3 / 5
04 / Recognition

Awards & impact

Gem Award
2025 · Indium Software
Awarded for exceptional technical contributions, delivering high-impact AI-driven solutions and outstanding engineering leadership across cross-functional teams serving Uber.
Shining Star Award
2026 · Indium Software
Recognized for driving automation, pioneering GenAI platform development, and delivering measurable business impact while simultaneously growing team capabilities.
Talent Development
2024–2026 · Indium Software
Personally onboarded and mentored 10+ freshers — engineers who came with no industry experience and are now independent contributors on Uber client projects, directly expanding Indium's delivery capacity.
UCL Teaching
2022–2024 · University College London
Delivered graduate-level Software Engineering instruction and mentored MSc students through AI and Deep Learning dissertations at one of the world's top research universities.
05 / Education

Academic foundation

MSc Artificial Intelligence
Queen Mary University of London · UK
Year2022 – 2023
LocationLondon, UK
DissertationConversational AI via RAG Transformers
Machine Learning · Deep Learning & NLP · Applied Statistics · Neural Networks
B.Eng Computer Science
Osmania University · Hyderabad, India
Year2016 – 2020
LocationHyderabad, India
Data Science & Big Data Analytics · Operating Systems · Internet of Things
Teaching Assistant
University College London · UK
PeriodDec 2022 – Jan 2024
TypePart-time · Graduate Level
ModuleSoftware Engineering
Graduate seminars · Final project supervision · MSc AI & Deep Learning dissertation mentorship
Certifications
Azure Databricks Data Engineer Professional (Pursuing) Azure Data Scientist — Associate Azure AI Fundamentals Azure Data Fundamentals Azure Fundamentals Snowflake — Data Warehouse & Applications
06 / Contact
Let's build
something
remarkable

Open to Senior Data Engineer & AI Engineer roles — remote or hybrid, globally. If you're building at the intersection of data scale and intelligent systems, let's talk.

Open to Opportunities Remote & Hybrid Worldwide