hmo/MoFin
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
417 Commits 4 Branches 0 Tags
57377e9dd39b84e3a17ee922a0f8f7f6b71c6399
Commit Graph
247 Commits
Author SHA1 Message Date
hmo 57377e9dd3 feat(auto_heal): multi-profile key switching + fix two error classes 
Error investigation (from restored monitoring) found 2 root causes:

1. 'Blocked: script path resolves outside scripts dir' (5+ cron jobs):
   Jul 17 symlink refactor replaced real scripts with symlinks; the hermes
   cron scheduler's security check (Path.resolve + relative_to) rejects
   symlink escape. ALL no_agent script jobs blocked since Jul 17 23:12.
   FIX: converted 102 symlinks to hardlinks (same inode, resolve() stays
   inside scripts_dir, single-source still works). Permanent structural fix.

2. HTTP 429 on default profile (知识研究/梦境循环/wiki-self-growth/
   evolution-pulse/大脑任务执行): default gateway used ocg-key1 (weekly
   100%). FIX: switched default profile to ocg-key6 + added missing
   provider block. LLM verified working (3.1s).

auto_heal extended to actually cover these automatically next time:
- PROFILES registry: zhiwei (8643, system svc) + default (8642, user svc)
- current_provider/switch_key/_scan_agent_log parameterized by profile
- health() now reports llm_provider_default (agent.log scan)
- auto_heal: per-profile 429 detection -> best_key -> switch_key(profile)
- _ensure_provider_block: injects missing provider credentials from
  zhiwei config (single source of truth) into target config
 2026-07-20 01:12:38 +08:00
hmo a05c118cbc feat(dashboard): restore lost monitoring + add 开发原则 tab (AgentsMeeting parity) 
Two regressions fixed:

1. RESTORED: original health monitoring (功能树/全部Cron/数据实体/数据流)
   was an iframe to /mofin_health.html — refactor replaced it with a
   minimal services-only panel and lost all of it. mofin_health.json
   (86KB, fresh) was still being generated the whole time.
   - 健康 tab: XMPP panel (native) + restored iframe below

2. ADDED: 开发原则 parent tab replicating AgentsMeeting structure:
   - G 规范: /api/spec renders docs/dev-spec.md + git history
   - K 测试: /api/tests renders agents_health_check report as pass/fail
   - F 健康: iframe to /mofin_health.html + link to 健康 tab
   - H 需求: /api/prd (placeholder — prd.md not yet created)
   - mdRender() ported from AgentsMeeting dashboard
 2026-07-20 00:40:32 +08:00
hmo 2de527b883 fix(health): drop live LLM ping — scan agent.log instead (38s -> 0.1s) 
Every /api/xmpp/health fetch ran a real LLM call (22k token system prompt
each). Dashboard refreshes every 10s -> thousands of paid LLM calls/day,
plus 38s latency hanging the health tab on '加载中...'.

LLM health is now derived from the gateway's own agent.log (zero cost,
more accurate than synthetic ping — real traffic results):
- last 'API call #N latency=Xs' -> ok
- last 'API call failed ... HTTP 429...' -> error with summary
- health() runtime 38s -> 0.1s; endpoint 38s -> 0.097s
 2026-07-20 00:21:49 +08:00
hmo 058c42ce27 feat(health): recent XMPP conversation log panel + stale error fix 
User requirement: health tab should show recent XMPP conversations.
- bot hooks log_xmpp on inbound (on_msg) and outbound (_deliver_loop)
  so real chats land in xmpp_messages.jsonl (was: only cron/scanner)
- index.html health tab: new '最近对话' panel (last 10 msgs, dir arrow,
  preview, status, time); refreshHealth updates it incrementally
- last_error now shows age and resolved state: once a successful
  outbound happens after an error, it's shown gray as '已恢复'
  instead of alarming red forever; unresolved errors still red
- health() status no longer degraded by errors that were later
  resolved by successful outbound
 2026-07-20 00:07:28 +08:00
hmo bb1529909b feat(bot): screenshot OCR pipeline + ack delay 120s 
D fix: screenshots were silently dropped (empty body + OOB url).
- register xep_0066, capture msg['oob']['url'] when body empty
- also handle body-as-URL messages (some clients put URL in body)
- download from upload.yoin.fun, OCR via SenseNova (sensenova-6.7-flash-lite)
- inject OCR text as context into LLM call
- config at /home/hmo/.config/mofin/ocr_config.json (outside repo)
- replaces dead node122 GLM-OCR path (host unreachable)

A+B fix: ACK_DELAY 15s -> 120s. 15s fired on every normal LLM
cold-start (20-100s), now only signals genuine hangs.
 2026-07-19 23:23:46 +08:00
hmo e0f47f9349 fix(xmpp_monitor): exclude key7(kimi) from auto-heal switch candidates 
zhiwei must stay on ocg-key6 (deepseek-v4-flash) per user decision.
key7 is kimi — different model provider, incompatible model name.
If best_key returns key7, auto_heal logs skip_switch instead of switching.
 2026-07-19 22:09:15 +08:00
hmo 9509b80d8b feat(xmpp_monitor): dynamic key switching + coalesce auto-heal 
- xmpp_logger.py:
  - Add switch_key(key_id): switch Hermes model.provider via sed + systemctl restart
  - Add current_provider() reading model: block correctly (not just first '  provider:' line)
  - Add KEY_TO_PROVIDER mapping (AgentsMeeting key_id -> Hermes provider name)
  - Add RESTART_COOLDOWN_FILE/SEC = 180s to prevent restart loops
  - auto_heal(): detect HTTP 429 / Weekly usage limit -> call best_key() -> switch_key()
  - auto_heal(): detect timeout/error -> async systemctl restart (Popen, not blocking)
  - _verify_llm(): bump timeout 25s -> 90s (cold-start gateway takes 20-40s)
  - health(): urlopen timeout 8s -> 90s (match verify window)
  - Use sudo NOPASSWD (hmo ALL=(ALL) NOPASSWD: ALL already configured)

- agents_health_check.py:
  - Replace inline pkill+Popen restart logic (caused multiple instances) with systemctl
  - Add RESTART_COOLDOWN_FILE state to skip restart within 3 min of last
  - Call xmpp_logger.auto_heal() at end of every cron cycle
  - Both inline restart and auto_heal restarts share cooldown file

- scripts/key_status.py: Reports weekly/monthly/rolling status of all 6 OCG keys
- scripts/test_llm.py: 90s timeout test (was 15s, gateway cold-start >= 30s)
- scripts/test_production.py: smoke test on /home/hmo/MoFin/ (hardlinked to web-dashboard)

Fixes:
- Old assumption 'Cloudflare blocks Python User-Agent' was WRONG.
  True cause was HTTP 429 Weekly usage limit on key5 (12hr reset window).
  Hermes silently ignored providers.X.headers config keys; only model.default_headers works.
  Config already has model.default_headers: User-Agent: curl/8.5.0 (defense in depth).
- Multiple gateway instances were caused by 3 competing systemd units
  (hermes-gateway@.service template + hermes-gateway-zhiwei.service named).
  Masked the template unit @position-analyst and @zhiwei so only the named one wins.
 2026-07-19 20:12:47 +08:00
hmo b41bed7959 feat: XMPP observability — logger, monitor endpoints, clean dead xiaoguo refs 2026-07-19 12:47:15 +08:00
hmo b08bfa5d03 refactor: integrate dashboard into server.py :8899, remove standalone dashboard 2026-07-19 11:06:50 +08:00
hmo 782a914a3c fix: dashboard port 5804→5807 (avoid conflicts with wechat_webhook and zhiwei bot) 2026-07-19 10:56:42 +08:00
知微 90966c63ca chore: 同步运行版本与git一致 
- strategy_lifecycle.py: GATE_9D_ANALYSIS → GATE_12D_ANALYSIS（12维交叉验证）
- system_audit.py: 审计策略评估改用holding_strategies.updated_at
- CHANGELOG.md + analyst-knowledge-log.md 日常更新
 2026-07-17 23:08:11 +08:00
知微 b4a5020cf5 fix: 暴跌告警仅持仓触发 + 状态立即持久化防重复推送 2026-07-14 15:33:35 +08:00
知微 2c0d6ff587 fix: Gateway看门狗v2 — 新增session健康检查，卡死自动重启 2026-07-14 15:00:56 +08:00
知微 c9ae1e143b fix: cron_to_xmpp取最后一个Response节防误判（parts[1]→parts[-1]） 2026-07-14 12:14:08 +08:00
知微 377bb4d1e4 price_monitor: 5min regenerate_all冷却 + 跳过冗余全量重评 2026-07-14 11:48:34 +08:00
知微 d972553b6e fix: divergence_detector 改用新浪API直接获取指数数据（原mo_data不支持指数代码） 2026-07-14 11:08:07 +08:00
知微 136f3f9fb8 sync scripts/mofin_db.py with root + knowledge log 2026-07-14 11:01:59 +08:00
知微 59e94d135c fix: 盘中脚本统一使用get_conn()替代raw sqlite3.connect防DB死锁 
- mofin_health.py, cron_health_monitor.py, intraday_health_check.py,
  self_todo_executor.py: 替换raw sqlite3.connect() → get_conn()
  统一使用WAL模式+busy_timeout=30s连接
- mofin_db.py: get_conn()每次新建连接时WAL checkpoint
  防止被kill进程残留WAL导致后续全部卡死
- 并发测试验证: 3x price_monitor + 3x mofin_health同时运行
  6/6通过，WAL仅32bytes

关联问题: 2026-07-14 SQLite写锁死锁根因诊断
 2026-07-14 10:56:38 +08:00
知微 3ee3d9ba6c fix: price_monitor添加os.nice(10)降低优先级减少DB竞争 2026-07-14 10:47:58 +08:00
知微 93dce81413 fix: price_monitor DB写锁死锁根治 + mofin_db.py reassessed_at同步 
1. price_monitor.py: 统一BEGIN IMMEDIATE包裹所有DB写操作，
   5次重试+指数退避(1→2→4→8→16s)，重试耗尽后自动
   emergency WAL checkpoint，try/finally确保conn释放
2. 补充进程锁：防止cron每2分钟触发但脚本跑3分钟时的并发
3. mofin_db.py: 同步cron版本的reassessed_at列处理逻辑
 2026-07-14 10:42:54 +08:00
知微 02d1c93923 fix(price_monitor): DB写锁死锁根治 - 统一BEGIN IMMEDIATE + 5次重试指数退避 + emergency WAL checkpoint 
- 统一一个BEGIN IMMEDIATE事务包裹所有写操作，替代独立写函数调用
- 5次重试 + 指数退避 (1s,2s,4s,8s,16s)，原3次+固定2s
- 重试耗尽后自动 emergency WAL checkpoint(TRUNCATE)释放死锁
- try/except确保连接始终释放，修复conn泄漏
- 三副本同步：profile/scripts + MoFin/scripts + MoFin/root
 2026-07-14 10:30:15 +08:00
知微 9239ab40c0 docs: 更新CHANGELOG + 开发日志记录07/13全部变更 
- XMPP Bot非阻塞/本地XMPP/MUC修复
- price_monitor推送冷却持久化
- 深套股规则重构+换股规划swap-plan
- 周月线技术分析增强
- 健康Tab写无读清零
- stale_push_wlin/per_stock_reassess/promote_candidates更新
- static/index.html + mofin_health.json + server.py同步
 2026-07-13 12:09:25 +08:00
知微 2109289668 feat: 换股规划 swap-plan — 深套股可替代性排序+资金释放方案 
- print_swap_plan(): 五维评分（亏损程度/仓位/技术趋势/流动性/前景）
- 排序输出，明确标注"当前亏损X%深套"而非"深套持有"
- --need 参数模拟指定资金需求，自动计算卖几只够
- 可独立运行：python strategy_lifecycle.py swap-plan [--need 金额]
 2026-07-13 12:05:36 +08:00
知微 a6d37c6f30 fix: 删除深套股全部硬编码限制——该加就加，一切根据客观判断 
- 删除 is_deep_loss 对止损/止盈/买入区/推荐的全部 guard
- 删除 action_note="深套持有" 覆盖
- 删除 position_advice="不补不割" / time_horizon="长期"
- 深套股回归正常分析流程，stock_category="深套"仅作标签
- "深套持有" 改为 "亏损X%深套" 实际状态描述
 2026-07-13 12:02:06 +08:00
知微 be961c6af6 fix: _push_cooldown持久化到文件，避免每2分钟重复推送操作区间通知 2026-07-13 11:17:59 +08:00
知微 ab72288296 fix: stock_weekly/monthly/watchlist_log加manual readers消除写无读警告 2026-07-10 21:12:28 +08:00
知微 e92e4473c8 feat: 周线+月线趋势/MA/支撑阻力注入mtf_context 2026-07-10 21:07:59 +08:00
知微 ea139b05b0 fix: 每日汇总只发一次(16:35)+加sent标记防重复 2026-07-10 17:05:29 +08:00
知微 e2f02ad023 fix: 资金流采集器正常运行(修import+科创板null处理) 2026-07-10 14:06:20 +08:00
知微 ea07d8c8df feat: 买入信号写入时自动推XMPP通知(通过5805桥) 2026-07-10 13:58:23 +08:00
知微 49ef74826a fix: 触发重评推送条件收紧(仅买入/加仓/卖出/止盈信号才推) 2026-07-10 13:43:39 +08:00
知微 b9ba737248 fix: 不构成操作建议不推XMPP+代码降级改报错+LLM失败=None 2026-07-10 13:29:32 +08:00
知微 ba70700e4d fix: 代码降级分析也加时间标注+LLM路径日志改为12维 2026-07-10 13:23:34 +08:00
知微 98d6189b69 feat: 每维数据标注时间窗口(MA日数/资金近5日/消息最近3条/财报最新) 2026-07-10 13:17:40 +08:00
知微 005903af83 fix: 9维→12维(3横×4纵:大盘/行业/个股×基本面/消息面/技术面/资金面) 2026-07-10 12:47:05 +08:00
知微 c79fb53722 feat: 盘前全量重评(08:10)+自选退出机制+进出日志 2026-07-10 12:20:18 +08:00
知微 8d733ca16a fix: deploy_sync新增mofin_db.py同步(根目录→profile) 2026-07-10 11:59:08 +08:00
知微 7f65f0cbd2 fix: 九维分析全面升级-资金流+消息面入prompt+交叉综合+capital_flow_collector修mo_data引用 2026-07-10 11:45:03 +08:00
知微 c48429b994 feat: 单日暴跌>7%实时告警(不依赖zone边界) 2026-07-10 11:30:46 +08:00
知微 73df767ac0 fix: 买入区用live_prices+统一DB读取+报告前验价 2026-07-10 10:26:14 +08:00
知微 e461c57028 fix: stale_detector零标记漏洞(买入区上沿~+20%未覆盖) 2026-07-10 09:43:27 +08:00
知微 66c3cfecc3 fix: 健康监控全绿(小果cron移除+死表清理+补录写入方) 2026-07-10 01:02:52 +08:00
知微 b63bfc11f5 fix: 仓位输出要求带一句话理由 2026-07-10 00:54:57 +08:00
知微 ebc3a15f73 fix: 仅买入信号输出仓位+仓位计算公式(RR/大盘/品种) 2026-07-10 00:14:52 +08:00
知微 7026959f58 fix: 信号-仓位一致性校验(观望/卖出→0%, 关注≤5%) 2026-07-10 00:09:38 +08:00
知微 02268405e2 fix: 仓位改为百分比数字(轻仓3%/中仓5%/重仓10%) 2026-07-09 23:21:26 +08:00
知微 016258bc09 feat: 批量LLM九维分析+仓位建议列+Dashboard显示 2026-07-09 23:16:47 +08:00
知微 0c6dd82b30 fix: price_monitor同股同区间30分钟冷却去重 2026-07-09 23:05:00 +08:00
知微 974c4b5d11 fix: 交易时段冷却4h→1h 2026-07-09 22:58:30 +08:00
知微 67c2502f52 feat: 重评冷却期+LLM信号产出+reassessed_at追踪 2026-07-09 22:51:26 +08:00