run · run-mpylekh0-3

mineru-claude

on Legal Contract Review

status

scored · passed

total score

0.842

cases

16 passed · 3 failed

latency

644.52s

cost

tokens

scored

2026-06-03 21:42:50

duration

645s

Run summary

score
0.842
passed
total cases
19
passed cases
16
skipped cases
0
pass threshold
0.800
tokens total
null
cost total
null
latency p95
604.50 s
latency total
644.52 s
latency median
2.04 s

score by category

dates
100%
money
86%
clauses
75%
deposit
100%
scenario
100%
scenario_reasoning
100%

extras

n_scored=19n_skipped_no_gold=0

Solution metadata

Self-reported by the solution. Not validated.

repo
https://github.com/Ruqii/trapstreet-solutions

Per-case results

caseexitdurationmetrics
break_clause01478 msid=break_clausetype=booleanscore=1category=clausesdifficulty=mediumagent_answer=Noexpected_answer=nomatcher_results=[object Object]
deposit_amount02435 msid=deposit_amounttype=numericscore=1category=moneydifficulty=easyagent_answer=£2,250.00expected_answer=2250matcher_results=[object Object]
deposit_dispute_escalation02402 msid=deposit_dispute_escalationtype=textscore=1category=depositdifficulty=hardagent_answer=The unresolved dispute is referred to the Independent Case Examiner (ICE) for adjudication, and all parties agree to co-operate with the adjudication.expected_answer=The dispute may be submitted to the Independent Case Examiner (ICE) for adjudication.matcher_results=[object Object],[object Object]
deposit_scheme01632 msid=deposit_schemetype=textscore=1category=clausesdifficulty=mediumagent_answer=The Tenancy Deposit Scheme (administered by The Dispute Service Limited).expected_answer=TDSmatcher_results=[object Object],[object Object]
early_surrender01428 msid=early_surrendertype=booleanscore=1category=clausesdifficulty=hardagent_answer=Yesexpected_answer=yesmatcher_results=[object Object]
early_surrender_economic_incentive02701 msid=early_surrender_economic_incentivetype=booleanscore=1category=scenario_reasoningdifficulty=expertagent_answer=No. The clause only provides for the surrendering tenant to pay any difference where the replacement tenant pays a LOWER amount; it does not provide any refund or credit if the replacement pays a higher rent.expected_answer=nomatcher_results=[object Object],[object Object],[object Object]
fixed_term_departure_notice02044 msid=fixed_term_departure_noticetype=booleanscore=0category=clausesdifficulty=hardagent_answer=Noexpected_answer=yesmatcher_results=[object Object]
governing_act01590 msid=governing_acttype=textscore=1category=clausesdifficulty=hardagent_answer=Housing Act 1988expected_answer=Housing Act 1988matcher_results=[object Object],[object Object]
inventory_referenced01452 msid=inventory_referencedtype=booleanscore=1category=clausesdifficulty=hardagent_answer=Yesexpected_answer=yesmatcher_results=[object Object]
late_rent_interest_rate02125 msid=late_rent_interest_ratetype=textscore=1category=moneydifficulty=hardagent_answer=3% per annum above the Bank of England base rateexpected_answer=3% per annum above Bank of England base ratematcher_results=[object Object],[object Object],[object Object]
pets_allowed01628 msid=pets_allowedtype=textscore=1category=clausesdifficulty=mediumagent_answer=with landlord consentexpected_answer=with landlord consentmatcher_results=[object Object],[object Object],[object Object]
post_fixed_term_extension02931 msid=post_fixed_term_extensiontype=textscore=0category=clausesdifficulty=hardagent_answer=The tenancy will continue on a month-to-month basis from the expiration of the term, with the rent during the extended six-month period increasing by 5% from the previous rent, without affecting the Landlord's ability to serve a Section 21 to end the Tenancy at the end of the fixed term.expected_answer=the tenancy automatically extends for six monthsmatcher_results=[object Object],[object Object]
rent_increase_scope02035 msid=rent_increase_scopetype=textscore=0category=moneydifficulty=hardagent_answer=The extension period.expected_answer=the automatic extension period onlymatcher_results=[object Object],[object Object],[object Object]
rent_payment_day01703 msid=rent_payment_daytype=textscore=1category=moneydifficulty=mediumagent_answer=On or prior to the 5th of the month.expected_answer=on or prior 5th of the monthmatcher_results=[object Object],[object Object],[object Object]
rent_year20604498 msid=rent_year2type=numericscore=1category=moneydifficulty=mediumagent_answer=£2100.00expected_answer=2100matcher_results=[object Object]
rent_year301708 msid=rent_year3type=numericscore=1category=moneydifficulty=mediumagent_answer=£2,400.00expected_answer=2400matcher_results=[object Object]
scenario_leave_22mo_replacement_1mo_gap06326 msid=scenario_leave_22mo_replacement_1mo_gaptype=numericscore=1category=scenariodifficulty=hardagent_answer=Months elapsed: 22. Months remaining at surrender: 14. Replacement found 1 month later, so replacement covers 13 months. Rent schedule: tenancy started 05/09/2022. Month 22 ends around 05/07/2024. The gap month (month 23) falls in the period 05/09/2023–04/09/2024 at £2,100/month. The remaining 13 months (months 24–36) span 05/08/2024–04/09/2025: 1 month at £2,100 (to 04/09/2024) + 12 months at £2,400. (a) Gap rent: £2,100 (b) Letting fee: replacement rent = (1 × £2,100) + (12 × £2,400) = £2,100 + £28,800 = £30,900; × 13.2% = £4,078.80 (c) Inventory: £144 × 14/36 = £56.00 (d) Admin: £480 × 14/36 = £186.67 Total: £2,100 + £4,078.80 + £56.00 + £186.67 = **£6,421.47**expected_answer=£6,421.47matcher_results=[object Object]
term_start01519 msid=term_starttype=datescore=1category=datesdifficulty=easyagent_answer=05/09/2022expected_answer=05/09/2022matcher_results=[object Object]
total_rent_fixed_term02885 msid=total_rent_fixed_termtype=numericscore=1category=moneydifficulty=hardagent_answer=12×1950 + 12×2100 + 12×2400 = 23400 + 25200 + 28800 = £77,400expected_answer=77400matcher_results=[object Object]
discuss this run →