DeepSeek V4 Pro runs 5 sets of Harnesses: Pi has the highest success rate, DSH saves the most money

Comparative news, AI News, Agent Tool Company Composio put the same DeepSeek V4 Pro 0813 into Pi Agent, DeepSeek Harness 0.1, Claude Code, OpenCode, and Hermes Agent respectively, and unify them to the max level, running 30 multi-step Agent tasks. Pass rate: 1. Pi Agent: 21/302. DeepSeek Harness: 20/303 Claude Code: 19/304 OpenCode: 19/305. Hermes Agent: In the 18/3030 question, all 5 out of 15 were passed, and all 7 were broken. Only the Harness was replaced with the remaining 8 tracks, and the result was reversed. Speed ranking: 1. Claude Code: 181.8 seconds 2. DeepSeek Harness: 252.1 s 3. Hermes Agent: 273.6 seconds 4. OpenCode: 280.6 seconds 5. Pi Agent: 362.9 seconds Cost per success: 1. DeepSeek Harness: $0.028 2. Pi Agent: $0.031 3. OpenCode: $0.032 4. Hermes Agent: $0.037 5. Claude Code: $0.074 Pi has the highest pass rate, DeepSeek Official Harness saves the most money, and Claude Code is the fastest but most expensive. Composio previously used DeepSeek V4 Flash for similar tests, and Pi also had the highest pass rate at the time.