Advanced Log Management & Storage

The most flexible, secure, and developer-friendly logging retention and storage toolkit for Node.js projects

🚀 Production Ready 🔐 Security First 📊 Multi-Provider ⚡ High Performance

Get Started View Examples API Docs

npm install logstack

production-implementation.js

const { init, createDailyJobs } = require('logstack');

const config = {
  dbUri: process.env.MONGODB_URI,
  uploadProvider: 's3',
  retention: {
    dbRetentionDays: 14,
    fileRetentionDays: 180
  },
  dataMasking: {
    maskPasswords: true,
    maskEmails: true
  }
};

await init(config);
await createDailyJobs();

Powerful Features

🗄️

Multi-Database Support

MongoDB, MySQL, PostgreSQL, SQLite support with unified configuration interface

☁️

Multiple Storage Providers

AWS S3 and local storage with easy switching between providers

🔐

Advanced Security

Sensitive data masking, configurable rules, encryption, and access control

📁

Flexible File Structure

Daily, monthly, yearly folders with custom naming and organization patterns

⚡

High Performance

Batch processing, streaming, compression, and optimized for 100k+ logs/hour

🔄

Intelligent Retry

Exponential backoff, circuit breaker, and comprehensive error handling

📊

Real-time Monitoring

Job status dashboard, metrics, alerts, and performance analytics

🛠️

Developer Experience

CLI tools, TypeScript support, extensive documentation, and examples

🔍

Advanced Filtering

Filter by path, method, status code, user info with custom query builders

Quick Start

Install Package

npm install logstack

Configure Environment

MONGODB_URI=mongodb://localhost:27017/logs
AWS_ACCESS_KEY_ID=your_access_key
AWS_SECRET_ACCESS_KEY=your_secret_key
S3_BUCKET=your-log-bucket
                        

Initialize LogStack

const { init, createDailyJobs } = require('logstack');

const config = {
  dbUri: process.env.MONGODB_URI,
  uploadProvider: 's3',
  retention: {
    dbRetentionDays: 14,
    fileRetentionDays: 180
  }
};

await init(config);
await createDailyJobs();
                        

Live Demo Result

✅ Database connected

✅ S3 configuration validated

✅ Daily jobs created (24 hourly tasks)

📁 Folder structure: logs_2025-09-02/

🔐 Password masking enabled

🗑️ Retention: 14 days DB, 180 days files

🎉 LogStack ready for production!

Development Roadmap

✅

Version 0.1.0 (MVP) - Q3 2025

Status: Complete

Core log saving to MongoDB
Configurable database connections
Automatic daily job creation
Multi-provider storage support
File compression and retention
Retry mechanism

🚧

Version 0.2.0 - Q4 2025

Status: In Progress

🔐 Security Enhancements

Sensitive data masking
Configurable masking rules
Pre-file generation masking

📊 Data Handling

Large volume processing (10k+ records/hour)
Streaming file generation
Configurable chunk sizes

🛠️ Developer Experience

Enhanced CLI tool
Debug mode with detailed logs
Advanced filtering options

📋

Version 0.3.0 - Q1 2026

Status: Planned

🌍 Framework Extensions

Multiple database support
Plugin-based DB integration
Unified configuration interface

📦 Storage Extensions

MinIO and DigitalOcean Spaces
Storage provider plugins
Extensible storage system

🔎 Advanced Features

User-specific metadata
Advanced query capabilities
File indexing for search

🎯

Version 1.0.0 - Q2 2026