Skip to content

misaw-kun/node-img-csv-proc

Repository files navigation

Async Image Processing API w/ Workers

This API allows users to upload CSV files with image URLs, processes the images, and generates an output CSV file with the processed URLs.

Features

  • Upload CSV with image URLs
  • Image processing (resizing, etc.)
  • Webhook notification on completion
  • Generate output CSV with processed URLs

Technology Stack

  • Node.js, Express.js - API Server
  • BullMQ, Redis - Job Queue
  • Cloudinary, MongoDB - Asset storage & CSV Data
  • PM2, AWS Lightsail - Process Management & Hosting

Setup Instructions

Either use the postman collection for a deployed version

or run locally with own credentials 👇

  1. Clone the Repository:
git clone https://github.com/misaw-kun/node-img-csv-proc.git
cd node-img-csv-proc
  1. Install Dependencies:
npm install
  1. Environment Variables:

    Create a .env file from the .env.example file.

  2. Start the Server:

npm start
  1. Start the Worker:
npm run start:worker

LLD

check here

Postman Collection

Import the collection file from the postman directory for testing.

Usage

Refer the postman documentation for usage.

About

system to process image data from CSV files

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published