I am a Senior Machine Learning Engineer at Adobe Firefly, with a Master's in Computational Data Science from Indiana University, Bloomington, and over 10 years of experience designing, building, and deploying scalable machine learning systems. My current work spans distributed inference and training frameworks, MLOps platforms on Kubernetes, and foundation-model training for generative AI on billions of images and videos. Prior to Firefly, I worked on data and ML platforms at EvolutionIQ, Swiggy, and Flipkart. I am also a first-author published researcher in Fairness-Aware Graph Neural Networks (NetSci 2023, IC2S2 2023).
Let's Connect!
I'm always open to discussing new projects, creative ideas, or opportunities to be part of your vision.
- Aug 2021 - May 2023Indiana University, Bloomington
MS (Computational Data Science)
GPA - 3.87/4.0
-
Jul 2011 - Jun 2015National Institute of Technology, Patna
B-Tech (Computer Science & Engineering)
CGPA - 8.32/10.0
-
2023Biased Contrastive Learning debiases Graph Neural Networks
Ashutosh Tiwari, Prof. Sadamori Kojaku, Prof. Yong-Yeol Ahn — accepted at NetSci 2023 (Poster) and IC2S2 2023 (Parallel Talk) as first author.
- Summer 2022 - Summer 2023Indiana University Network Science Institute
Worked on novel model training methods to produce "Fairness Aware Graph Recommendation" models with Prof. YY Ahn and Prof. S Kojaku.
- Summer 2022 - Fall 2022Kelly School of Business
Paid RA on "User Intent as a Network" with Prof. YY Ahn, P Kantak, and FB Yara. Collaboration with Luddy, funded by Kelly School of Business.
- Fall 2021NLP LAB @ IUB
Contributed extensively to design of TieML and Events' Timeline modelling using fine-tuned Large Language Models.
-
Jul 2024 – PresentAdobe Firefly
Senior Machine Learning Engineer (ML Platform & Frameworks)
- Leading parts of ML Platform — distributed inference for billions of images/videos and training frameworks for foundation models.
- Designed and led the org's online and offline inference systems: vLLM + Ray for LLMs like Falcon-40B / Llama 2 70B, and Ray Data + PyTorch Lightning for offline inference achieving 3–8K images/sec on 32 GPUs (10–50× faster image loading).
- Leading development of a PyTorch-based foundation model training framework adopted across the org — plugin-based FSDP/FSDP2 strategies, Flash Attention 2/3, and context/distributed attention for DiT text-to-image and text-to-video training.
- Co-built the underlying Kubernetes platform: plugin pipelines (KEDA-autoscaled on SQS), BuildKit/ECR image builds, a Rust control plane, and an MCP interface so AI agents can drive build/deploy/inference end-to-end.
- Built the org's first data quality framework on Cerberus, used across enrichment pipelines to validate the correctness of feature-generation outputs.
-
Sep 2023 – Jul 2024EvolutionIQ
Senior Software Engineer (Data Platform)
- Part of Scoring and Quality sub-team, working at the intersection of generative AI, fin-tech, and health sector.
- Responsible for writing data pipelines that ingest, and process data to be ingested, and used for training by our machine learning models.
- Writing pipelines that train our models to predict a claimant's expected time to return to work, ICD extractions from diagnosis notes, alternate VOC recommendations, etc.
- Working on a framework to evaluate that our models are unbiased and fair to different demographic groups.
-
Jan 2019 – Jul 2021Swiggy
Software Dev Engineer II (ML Platform)
Bengaluru, India
- Was part of team that worked on Feature Store and pipeline which feeds on-demand features to deployed ML models at production scale(4Bn rows, 10K QPS). Pipeline-supported multichannel ingestion, i.e. Spark, Flink and user files etc.
- Founding member of Forecasting and Correlation Platform which was considered by many teams to forecast concerned time series. These forecasts power critical scaling decisions across organizations in real time.
- Led DAQ, a tool used to scrape APIs at scale. Used to collect data for analysis/ model training at a scale of 15 M rows daily.
-
Sep 2017 – Jan 2019Flipkart
Software Development Engineer (Search Relevance)
Bengaluru, India
- Was responsible for improvements/inception of search intent models(CRF/Neural Network based), identifying error classes, coming up with solutions, and fixing them. These models power user search and discovery for millions every day.
- Implemented a FastText based query store classifier, which predicts the category of a tail query.
- Implemented the first workflow to automate training and auto-deployment of various search models in Flipkart. First was written using Luigi and later migrated to Airflow.
- Wrote a generic framework using Airflow which at runtime creates generic dags for different ML models and orchestrates their training to deployment flow, including data and model validations.
- Implemented large scale (4Bn+ datapoints) pipelines using Cascading/HDFS to extract data from user events and then transform it to be used for training these models.
-
Sep 2016 – Sep 2017Groupon
Software Development Engineer
Bengaluru, India
- Worked on a component called Cyclops, an interface between Customer representatives and internal services.
- This service is live in all countries in which Groupon operates.
-
Sep 2015 – Aug 2016Netspeed Systems
Software Engineer
Bengaluru, India
- Led engineering efforts on modules like Polarity based Arbitration, Multi-Cast Filtering, Structural Latency Breakdown, etc.
-
Jan 2023 - Present
- Aug 2022 - Dec 2023
-
Jan 2022 - May 2022
Stocks Prediction (16th Rank AnalyticsVidhya)
This is a project based on competition held by AnalyticsVidhya.
Topic modelling (19th Rank AnalyticsVidhya)
In this contest solution, contestants had to come up with a solution to a multiclass text classification problem.
Hospitalization Period Prediction (115th Rank)
This was again a AnalyticsVidhya contest, where contestants were supposed to predict the period for which a patient is going to be hospitalized.
BiasNet: Learning to fight in StreetFighter II with induced Relational Bias from Differential Scenes
A novel deep on-policy model free actor critic reinforcement learning approach to act in a large action space using only the difference in scenes.
Bias Manifolds: Investigating Structure of Bias Manifolds and Bias Evolution
A survey of different approaches to study the structure of bias manifolds in different datasets. Also, a novel approach to study the evolution of bias in a dataset over a period of time.
BlindNet: Distilling world knowledge in Neural Networks
A survey of different possible neural network architectures to learn to understand the world using MS COCO dataset.
DeepFoodie: Clustering Food Items using Ingredient Embeddings
A novel approach to cluster food items using deep self supervised learning which uses ingredient embeddings.
Flipkart Hackday 9 Ekart Winner Hack 2018
Built a Multiclass model(inspired by Inception v3) to annotate images of lifestyle products. We also used Google OCR API to extract selected text from the tag. The end goal was to find top candidate FSNs. Text from tag was primarily used for features like price and brand. Others more important ones came from annotations(color, type, cloth type etc). On top of this to search that product we formed a query using this information and predicted using a CRF model trained on clickstream data of Flipkart using features from features generated using Flipkart's catalog. It was so appreciated that it is in the process of going to production(which is the reason, not providing code pointer here). We did use differential learning rates to tune accuracies in the last stages of training to reach a 99.6% validation accuracy.
Groupon Geekon 2017
Deal recommendations to a user based on NSVD, using it as an unsupervised, collaborative filtering algorithm. Language: Python. Packages: Tensorflow, py2neo, pandas, and numpy. DB used was Neo4j. Dataset used was movielens dataset.