Automated Image Import v2 - Retail Asset Pipeline

Backend (.NET Worker)

About

A nightly cron-style worker that ingests product imagery from retailer FTP endpoints, stages assets locally, pushes validated files into each chain's S3 bucket, updates SQL, and emits sync events for downstream catalog refresh.

My Role

Implemented nightly FTP/SFTP-based asset ingestion into S3 and SQL-backed catalogs for multiple retailers. Handled resizing, normalization, and activation of product images with retry and logging paths. Published SyncChain events and logged errors for ops teams.

Core Capabilities

• Multi-chain FTP/SFTP ingestion with credential overrides
• UPC-to-product resolution via Dapper with paged SQL updates
• ImageMagick thumbnail and large variant generation
• RabbitMQ fan-out events for downstream search sync

Architecture

• .NET console host with SimpleInjector DI
• FluentFTP and Renci SSH.NET for FTP/SFTP discovery
• ImageMagick CLI for image normalization
• AWS S3 SDK for bucket uploads

Tech Stack