feat: add Telegram integration with forum topic support and creator tracking

Adds full Telegram ZIP ingestion pipeline: TDLib worker service scans source
channels for archive files, deduplicates by content hash, extracts metadata,
uploads to archive channel, and indexes in Postgres. Forum supergroups are
scanned per-topic with topic names used as creator. Filename-based creator
extraction (e.g. "Mammoth Factory - 2026-01.zip") serves as fallback.

Includes admin UI for managing accounts/channels, simplified account setup
(API credentials via env vars), auth code/password submission dialog,
package browser with creator column, and live ingestion activity tracking.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
xCyanGrizzly
2026-02-24 16:02:06 +01:00
parent beb9cfb312
commit b427193d17
70 changed files with 8627 additions and 2 deletions

View File

@@ -10,11 +10,37 @@ services:
- AUTH_SECRET=change-me-to-a-random-secret-in-production
- AUTH_TRUST_HOST=true
- NEXT_PUBLIC_APP_URL=http://localhost:3000
- TELEGRAM_API_KEY=${TELEGRAM_API_KEY:-}
depends_on:
db:
condition: service_healthy
restart: unless-stopped
worker:
build:
context: .
dockerfile: worker/Dockerfile
environment:
- DATABASE_URL=postgresql://dragons:stash@db:5432/dragonsstash
- WORKER_INTERVAL_MINUTES=60
- WORKER_TEMP_DIR=/tmp/zips
- TDLIB_STATE_DIR=/data/tdlib
- WORKER_MAX_ZIP_SIZE_MB=4096
- LOG_LEVEL=info
volumes:
- tdlib_state:/data/tdlib
- tmp_zips:/tmp/zips
depends_on:
db:
condition: service_healthy
restart: unless-stopped
deploy:
resources:
limits:
memory: 1G
reservations:
memory: 256M
db:
image: postgres:16-alpine
ports:
@@ -34,3 +60,5 @@ services:
volumes:
postgres_data:
tdlib_state:
tmp_zips: