feat: add Telegram integration with forum topic support and creator tracking

Adds full Telegram ZIP ingestion pipeline: TDLib worker service scans source
channels for archive files, deduplicates by content hash, extracts metadata,
uploads to archive channel, and indexes in Postgres. Forum supergroups are
scanned per-topic with topic names used as creator. Filename-based creator
extraction (e.g. "Mammoth Factory - 2026-01.zip") serves as fallback.

Includes admin UI for managing accounts/channels, simplified account setup
(API credentials via env vars), auth code/password submission dialog,
package browser with creator column, and live ingestion activity tracking.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
xCyanGrizzly
2026-02-24 16:02:06 +01:00
parent beb9cfb312
commit b427193d17
70 changed files with 8627 additions and 2 deletions

View File

@@ -0,0 +1,11 @@
-- AlterTable
ALTER TABLE "ingestion_runs" ADD COLUMN "currentActivity" TEXT,
ADD COLUMN "currentChannel" TEXT,
ADD COLUMN "currentFile" TEXT,
ADD COLUMN "currentFileNum" INTEGER,
ADD COLUMN "currentStep" TEXT,
ADD COLUMN "downloadPercent" INTEGER,
ADD COLUMN "downloadedBytes" BIGINT,
ADD COLUMN "lastActivityAt" TIMESTAMP(3),
ADD COLUMN "totalBytes" BIGINT,
ADD COLUMN "totalFiles" INTEGER;