Experience | Vinay Kumar N

Finoa Now Oct 2024 – Present Berlin, DE

Senior Data Engineer

Data Platform

First data hire. Work directly with the CTO to define data strategy and build the platform end to end, from ingestion and governance through to team adoption.

Data Platform

Designed and built the platform from scratch across ingestion, storage, transformation, and governance. Built on AWS Data Stack with Snowflake.

Multi-Agent Developer Workflows

Built multi-agent SDLC workflows to accelerate feature development and testing across repositories. Defined role-specific agents, guardrails, and orchestration workflows. Building a higher-level coordinator agent for end-to-end development across multiple repos.Stack: Python, FastMCP, AWS Kiro, Amazon Q, Claude Code, Gemini

Platform Adoption & Governance

Partnered with Engineering, SecOps, and Compliance to onboard assets and automate operational workflows. Built Lake Formation governance controls, observability metrics, and deployment processes. Tracked adoption with usage metrics and user feedback.

N26 Apr 2023 – Aug 2024 Berlin, DE

Data Engineer

Data Governance

Built governance tooling, data quality observability, and a discovery platform used by 200+ users across the organization.

Data Discovery Platform

Designed and shipped a discovery platform that improved access to data assets and reduced time-to-discovery for business users across the organization.

Data Engineering

Built scalable metadata and data pipelines on Apache Airflow and an in-house Kubernetes orchestrator. Custom connectors, containerized execution, and data quality & observability around accuracy, completeness, and consistency.

Data Governance Frameworks

Contributed to automated access management controls and audit report generation to support Security, Audit, and Compliance requirements.

Walmart Global Tech Nov 2021 – Mar 2023 Bangalore, IN

Software Engineer III

Data Engineering

Built large-scale GCP data pipelines and a self-serve data platform that reduced dependency on dedicated engineering support.

Data Processing Pipelines at Scale

Built GCP pipelines using Dataproc, BigQuery, and GCS across multiple data formats. PySpark and Python for ingestion, refinement, and data science integration. Standardized reusable templates to reduce duplicated implementation effort.

Self-Serve Data Platform

Developed a self-serve platform with connectors to internal Walmart data sources, letting analysts access data without waiting for dedicated engineering support. Stack: FastAPI, SQLAlchemy.

Neudesic Nov 2020 – Nov 2021 Hyderabad, IN

Senior Data Engineer

Big Data

Migrated on-premise workloads to Azure and built streaming pipelines and cross-cloud data integration patterns.

Azure Migration & Streaming

Migrated workstation telemetry processing from on-premise Hadoop/Cloudera to Azure. Built 5 Spark Structured Streaming jobs using Databricks and Azure Event Hubs.

Data Integration Patterns

Designed data movement patterns across cloud and on-premise systems: GCP BigQuery to ADLS, Hive to ADLS via Kafka MirrorMaker, Apache NiFi pipelines, and QlikView reporting on refined data.

Platform Enablement

Built a logging framework on Azure Application Insights for Databricks jobs and enabled QlikView reporting on refined ADLS Gen2 data through external tables.

MAQ Software Sep 2018 – Oct 2020 Hyderabad, IN

Software Engineer II

Migrated multiple client projects from on-premise infrastructure to Azure and built reusable data engineering utilities at scale.

Azure Migration

Migrated multiple projects from on-premise VM-based systems to Azure: Data Factory, Databricks, Function Apps, Logic Apps, Event Hubs, SQL Database, and Synapse Analytics.

Data Engineering Utilities

Built reusable Databricks utilities for large-scale fuzzy string matching across 80M × 20K records, parallel DB interactions, ADLS Gen2 writes, and schema validation.

Stream Analytics & Advanced Solutions

Built real-time Cosmos DB change feed integration with Event Hubs and Power BI dashboards. Developed a Neo4j recommendation engine PoC selected for further development.