15 Commits

Author SHA1 Message Date
Melchior Reimers
1dc79b8b64 Refactor: Code-Qualität verbessert und Projektstruktur aufgeräumt
Some checks failed
Deployment / deploy-docker (push) Has been cancelled
- daemon.py: gc.collect() entfernt, robustes Scheduling (last_run_date statt Minuten-Check),
  Exchange Registry Pattern eingeführt (STREAMING_EXCHANGES/STANDARD_EXCHANGES)
- deutsche_boerse.py: Thread-safe User-Agent Rotation bei Rate-Limits,
  Logging statt print(), Feiertags-Prüfung, aufgeteilte Parse-Methoden
- eix.py: Logging statt print(), spezifische Exception-Typen statt blankem except
- read.py gelöscht und durch scripts/inspect_gzip.py ersetzt (Streaming-basiert)
- Utility-Scripts in scripts/ verschoben (cleanup_duplicates, restore_and_fix, verify_fix)
2026-02-01 08:18:55 +01:00
Melchior Reimers
9cd84e0855 Fix: Streaming-Verarbeitung für EIX um RAM-Überlauf zu verhindern
Some checks failed
Deployment / deploy-docker (push) Has been cancelled
- EIX verarbeitet jetzt eine Datei nach der anderen (nicht alle auf einmal)
- Speicher wird nach jeder Datei freigegeben (gc.collect)
- Day-basiertes Caching für Duplikatprüfung mit Cache-Clearing
- Reduziert RAM-Verbrauch von 8GB+ auf unter 500MB
2026-01-29 16:17:11 +01:00
Melchior Reimers
a07319d957 Fix: Analytics Worker berechnet jetzt alle Tabellen pro Tag
Some checks failed
Deployment / deploy-docker (push) Has been cancelled
2026-01-29 16:00:09 +01:00
Melchior Reimers
2ac24cd5ea Fix: Analytics Worker berechnet jetzt alle Tabellen pro Tag
Some checks failed
Deployment / deploy-docker (push) Has been cancelled
2026-01-27 14:49:34 +01:00
Melchior Reimers
01f4c23f51 updated dashboard
All checks were successful
Deployment / deploy-docker (push) Successful in 16s
2026-01-27 11:30:50 +01:00
Melchior Reimers
22b09669c1 updated dashboard
All checks were successful
Deployment / deploy-docker (push) Successful in 18s
2026-01-27 10:48:11 +01:00
Melchior Reimers
44e7004fc9 added more exchanges
All checks were successful
Deployment / deploy-docker (push) Successful in 40s
2026-01-27 09:59:43 +01:00
Melchior Reimers
33f5c90fce updated
All checks were successful
Deployment / deploy-docker (push) Successful in 17s
2026-01-25 17:36:29 +01:00
Melchior Reimers
786fef2e71 performance improvements by pre-defining queries
All checks were successful
Deployment / deploy-docker (push) Successful in 17s
2026-01-25 17:11:05 +01:00
Melchior Reimers
b9062c5dac now downloads historical eix dat
All checks were successful
Deployment / deploy-docker (push) Successful in 14s
2026-01-25 16:44:43 +01:00
Melchior Reimers
3fc149599e fix: resolve NameError in run_task function
All checks were successful
Deployment / deploy-docker (push) Successful in 3s
2026-01-23 18:00:34 +01:00
Melchior Reimers
bddddfffee feat: enable unlimited historical data fetching for EIX
All checks were successful
Deployment / deploy-docker (push) Successful in 3s
2026-01-23 17:56:47 +01:00
Melchior Reimers
47a8ceab32 feat: add automatic historical fetch on startup if DB is empty
All checks were successful
Deployment / deploy-docker (push) Successful in 4s
2026-01-23 17:44:06 +01:00
Melchior Reimers
746c7167b0 feat: move daemon to docker with daily schedule and deduplication
All checks were successful
Deployment / deploy-docker (push) Successful in 17s
2026-01-23 17:24:05 +01:00
Melchior Reimers
ccfee645e8 first commit 2026-01-23 16:30:35 +01:00