RAG Test Results — anthropic/claude-sonnet-4 — 2026-03-26 20:56
Instance: fundloans-guidelines-search Model: anthropic/claude-sonnet-4 Mode: Chat Completions Result: 0/22 passed (0%)
Summary
| # | ID | Result | Source Found | Score | Question |
|---|---|---|---|---|---|
| 1 | apex-oo-1 | ERROR | No | — | What is the maximum LTV for a purchase on an Apex Alt Doc loan with 740 FICO, ow |
| 2 | apex-oo-2 | ERROR | No | — | Can I get a cash-out refinance under Apex with a 660 FICO score and a $1.2 milli |
| 3 | apex-inv-1 | ERROR | No | — | What are the LTV limits for an Apex investor loan with 700 FICO and $2.3 million |
| 4 | apex-pnl-1 | ERROR | No | — | What LTV can I get on an Apex P&L Only loan for $1.8 million with 720 FICO, owne |
| 5 | apex-jumbo-1 | ERROR | No | — | What are the Apex super jumbo LTV limits for a $4.5 million loan with 760 FICO, |
| 6 | montage-oo-1 | ERROR | No | — | What is the max LTV for a Montage Full Doc purchase loan, 720 FICO, $900K, prima |
| 7 | montage-inv-1 | ERROR | No | — | What are the Montage investment property LTV limits for a $1.3 million loan with |
| 8 | spectrum-1 | ERROR | No | — | What is the maximum LTV for a Spectrum DSCR loan with 700 FICO, $1.2 million pur |
| 9 | spectrum-noratio-1 | ERROR | No | — | Can I get a no-ratio DSCR loan under Spectrum with 720 FICO for $1.3 million? Wh |
| 10 | spectrum-fn-1 | ERROR | No | — | What are the LTV limits for a foreign national borrower under the Spectrum DSCR |
| 11 | reserves-1 | ERROR | No | — | How many months of reserves are required for a $600,000 Apex loan? |
| 12 | reserves-inv-1 | ERROR | No | — | What are the reserve requirements for a first-time investor under Apex? |
| 13 | cashout-1 | ERROR | No | — | What is the maximum cash-out amount if my LTV is 65%? |
| 14 | fico-min-1 | ERROR | No | — | What is the minimum FICO score for any FundLoans loan program? |
| 15 | max-loan-1 | ERROR | No | — | What is the maximum loan amount FundLoans will fund? |
| 16 | min-loan-1 | ERROR | No | — | What is the minimum loan amount for a Spectrum DSCR loan? |
| 17 | borrower-1 | ERROR | No | — | Are foreign nationals eligible for FundLoans programs? |
| 18 | housing-1 | ERROR | No | — | What is the minimum housing history requirement for FundLoans? |
| 19 | dti-1 | ERROR | No | — | What is the maximum DTI ratio allowed under FundLoans programs? |
| 20 | edge-boundary-1 | ERROR | No | — | I have a 680 FICO and want a $2 million Apex investment loan. What is my max LTV |
| 21 | edge-na-1 | ERROR | No | — | Can I get a cash-out refinance on a $2.8 million Apex investment property with 6 |
| 22 | edge-casebycase-1 | ERROR | No | — | What happens with Apex P&L Only loans over $3 million? |
Detailed Results
apex-oo-1 — ERROR
Question: What is the maximum LTV for a purchase on an Apex Alt Doc loan with 740 FICO, owner occupied primary residence, loan amount $800,000?
Expected: 90% LTV
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: apex, owner-occ, ltv
apex-oo-2 — ERROR
Question: Can I get a cash-out refinance under Apex with a 660 FICO score and a $1.2 million loan amount on my primary residence?
Expected: 75% max LTV for cash out
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: apex, owner-occ, cashout
apex-inv-1 — ERROR
Question: What are the LTV limits for an Apex investor loan with 700 FICO and $2.3 million loan amount?
Expected: 75% purchase/RT refi, 65% cash out
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: apex, investor, ltv
apex-pnl-1 — ERROR
Question: What LTV can I get on an Apex P&L Only loan for $1.8 million with 720 FICO, owner occupied?
Expected: 75% purchase/RT refi, 65% cash out
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: apex, pnl, ltv
apex-jumbo-1 — ERROR
Question: What are the Apex super jumbo LTV limits for a $4.5 million loan with 760 FICO, owner occupied?
Expected: 65% purchase, 60% RT refi, 55% cash out
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: apex, super-jumbo, ltv
montage-oo-1 — ERROR
Question: What is the max LTV for a Montage Full Doc purchase loan, 720 FICO, $900K, primary residence?
Expected: 85% LTV
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: montage, owner-occ, ltv
montage-inv-1 — ERROR
Question: What are the Montage investment property LTV limits for a $1.3 million loan with 680 FICO?
Expected: 80% purchase/RT refi, 70% cash out
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: montage, investor, ltv
spectrum-1 — ERROR
Question: What is the maximum LTV for a Spectrum DSCR loan with 700 FICO, $1.2 million purchase, DSCR >= 1.00?
Expected: 75% purchase
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: spectrum, dscr, ltv
spectrum-noratio-1 — ERROR
Question: Can I get a no-ratio DSCR loan under Spectrum with 720 FICO for $1.3 million? What are the LTV limits?
Expected: 65% purchase, 65% rate/term, 60% cash out
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: spectrum, no-ratio, ltv
spectrum-fn-1 — ERROR
Question: What are the LTV limits for a foreign national borrower under the Spectrum DSCR program?
Expected: 65% purchase, 65% rate/term, 60% cash out for loans up to $1.5MM
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: spectrum, foreign-national, ltv
reserves-1 — ERROR
Question: How many months of reserves are required for a $600,000 Apex loan?
Expected: 6 months (>$500k-$1.5MM tier)
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: reserves
reserves-inv-1 — ERROR
Question: What are the reserve requirements for a first-time investor under Apex?
Expected: 12 months
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: reserves, investor
cashout-1 — ERROR
Question: What is the maximum cash-out amount if my LTV is 65%?
Expected: $1.5MM (over 60% LTV cap is $1.5MM)
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: cashout
fico-min-1 — ERROR
Question: What is the minimum FICO score for any FundLoans loan program?
Expected: 660 for Apex and Montage, 660 for Spectrum
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: fico, eligibility
max-loan-1 — ERROR
Question: What is the maximum loan amount FundLoans will fund?
Expected: $6,000,000
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: loan-amount
min-loan-1 — ERROR
Question: What is the minimum loan amount for a Spectrum DSCR loan?
Expected: $200,000 (Spectrum min is $200K vs $300K for Apex/Montage)
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: spectrum, loan-amount
borrower-1 — ERROR
Question: Are foreign nationals eligible for FundLoans programs?
Expected: Only under the DSCR/Spectrum program
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: eligibility, foreign-national
housing-1 — ERROR
Question: What is the minimum housing history requirement for FundLoans?
Expected: 12 months minimum, 0x30x12 (no 30-day lates in 12 months)
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: credit, housing
dti-1 — ERROR
Question: What is the maximum DTI ratio allowed under FundLoans programs?
Expected: 50% max DTI
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: dti
edge-boundary-1 — ERROR
Question: I have a 680 FICO and want a $2 million Apex investment loan. What is my max LTV for a purchase?
Expected: 75% (>$1.5MM to $2MM tier, 680 FICO row) for purchase/RT refi
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: apex, edge-case, boundary
edge-na-1 — ERROR
Question: Can I get a cash-out refinance on a $2.8 million Apex investment property with 680 FICO?
Expected: Not eligible (N/A) — cash out not available at that FICO/loan amount combination
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: apex, edge-case, not-eligible
edge-casebycase-1 — ERROR
Question: What happens with Apex P&L Only loans over $3 million?
Expected: Case-by-case review required; all loans >$4MM require prior submission review
Error: Client error '404 Not Found' for url 'https://api.cloudflare.com/client/v4/accounts/78c2ff4b863281b6ce4ba351c04527c8/ai-search/instances/fundloans-guidelines-search/chat/completions' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/404 Tags: apex, edge-case, case-by-case
Pass Rate by Category
| Tag | Pass Rate | Passed/Total |
|---|---|---|
| apex | 0% | 0/8 |
| owner-occ | 0% | 0/3 |
| ltv | 0% | 0/9 |
| cashout | 0% | 0/2 |
| investor | 0% | 0/3 |
| pnl | 0% | 0/1 |
| super-jumbo | 0% | 0/1 |
| montage | 0% | 0/2 |
| spectrum | 0% | 0/4 |
| dscr | 0% | 0/1 |
| no-ratio | 0% | 0/1 |
| foreign-national | 0% | 0/2 |
| reserves | 0% | 0/2 |
| fico | 0% | 0/1 |
| eligibility | 0% | 0/2 |
| loan-amount | 0% | 0/2 |
| credit | 0% | 0/1 |
| housing | 0% | 0/1 |
| dti | 0% | 0/1 |
| edge-case | 0% | 0/3 |
| boundary | 0% | 0/1 |
| not-eligible | 0% | 0/1 |
| case-by-case | 0% | 0/1 |