feat: add Telegram integration with forum topic support and creator tracking

Adds full Telegram ZIP ingestion pipeline: TDLib worker service scans source
channels for archive files, deduplicates by content hash, extracts metadata,
uploads to archive channel, and indexes in Postgres. Forum supergroups are
scanned per-topic with topic names used as creator. Filename-based creator
extraction (e.g. "Mammoth Factory - 2026-01.zip") serves as fallback.

Includes admin UI for managing accounts/channels, simplified account setup
(API credentials via env vars), auth code/password submission dialog,
package browser with creator column, and live ingestion activity tracking.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
xCyanGrizzly
2026-02-24 16:02:06 +01:00
parent beb9cfb312
commit b427193d17
70 changed files with 8627 additions and 2 deletions

View File

@@ -15,5 +15,27 @@ services:
timeout: 5s
retries: 5
worker:
build:
context: .
dockerfile: worker/Dockerfile
environment:
- DATABASE_URL=postgresql://dragons:stash@db:5432/dragonsstash
- WORKER_INTERVAL_MINUTES=5
- WORKER_TEMP_DIR=/tmp/zips
- TDLIB_STATE_DIR=/data/tdlib
- WORKER_MAX_ZIP_SIZE_MB=4096
- LOG_LEVEL=debug
- TELEGRAM_API_ID=${TELEGRAM_API_ID}
- TELEGRAM_API_HASH=${TELEGRAM_API_HASH}
volumes:
- tdlib_dev_state:/data/tdlib
- tmp_dev_zips:/tmp/zips
depends_on:
db:
condition: service_healthy
volumes:
postgres_dev_data:
tdlib_dev_state:
tmp_dev_zips: