catalog data synchronization image ingestion retail

Master Products - Centralized Catalog Sync

Backend (.NET + Queues)

Screenshots coming soon

About

A backend suite that collects master product data from multiple providers (GS1, GrocerKey), stores normalized records, manages image downloads, and exposes APIs/agents to keep master catalog data synchronized.

My Role

Built APIs and agents to synchronize master product catalogs across GS1, GrocerKey, and other providers. Implemented image ingestion via FileManager queues and S3/Cloudinary buckets with remediation jobs. Maintained environment-driven configuration, logging, and queue handling for master and GrocerKey DBs.

Core Capabilities

Product sync pipeline: APIs accept UPC batches, agents fetch/sync in configurable batches
Image ingestion with multiple variants per product via FileManager queue
GrocerKey sync merging master products with GS1 mapping and S3 uploads
RabbitMQ queue listener for async image upload responses

Architecture

ASP.NET Core API with SimpleInjector DI
Background HostedServices for agent jobs
RabbitMQ for async image processing coordination
SQL repositories targeting master and GrocerKey databases

Tech Stack

ASP.NET Core SimpleInjector RabbitMQ AWS S3 Cloudinary SQL Server

Reporting 2 - Event Streaming & Core Data Sync

File Manager - Asynchronous Media Orchestrator